Nov 17 01:12:52 user nova-compute[75226]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=75226) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 17 01:12:52 user nova-compute[75226]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=75226) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 17 01:12:52 user nova-compute[75226]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=75226) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 17 01:12:52 user nova-compute[75226]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Nov 17 01:12:52 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:12:52 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.019s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:12:53 user nova-compute[75226]: INFO nova.virt.driver [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] Loading compute driver 'libvirt.LibvirtDriver'
Nov 17 01:12:53 user nova-compute[75226]: INFO nova.compute.provider_config [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] Acquiring lock "singleton_lock" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] Acquired lock "singleton_lock" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] Releasing lock "singleton_lock" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] Full set of CONF: {{(pid=75226) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] ******************************************************************************** {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] Configuration options gathered from: {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] ================================================================================ {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] allow_resize_to_same_host      = True {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] arq_binding_timeout            = 300 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] backdoor_port                  = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] backdoor_socket                = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] block_device_allocate_retries  = 300 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] block_device_allocate_retries_interval = 5 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] cert                           = self.pem {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] compute_monitors               = [] {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] config_dir                     = [] {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] config_drive_format            = iso9660 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] config_source                  = [] {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] console_host                   = user {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] control_exchange               = nova {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] cpu_allocation_ratio           = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] daemon                         = False {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] debug                          = True {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] default_access_ip_network_name = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] default_availability_zone      = nova {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] default_ephemeral_format       = ext4 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] default_green_pool_size        = 1000 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] default_schedule_zone          = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] disk_allocation_ratio          = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] enable_new_services            = True {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] enabled_apis                   = ['osapi_compute'] {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] enabled_ssl_apis               = [] {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] flat_injected                  = False {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] force_config_drive             = False {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] force_raw_images               = True {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] graceful_shutdown_timeout      = 5 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] heal_instance_info_cache_interval = 60 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] host                           = user {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] initial_disk_allocation_ratio  = 1.0 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] initial_ram_allocation_ratio   = 1.0 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] instance_build_timeout         = 0 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] instance_delete_interval       = 300 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] instance_format                = [instance: %(uuid)s]  {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] instance_name_template         = instance-%08x {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] instance_usage_audit           = False {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] instance_usage_audit_period    = month {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] internal_service_availability_zone = internal {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] key                            = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] live_migration_retry_count     = 30 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] log_config_append              = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] log_dir                        = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] log_file                       = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] log_options                    = True {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] log_rotate_interval            = 1 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] log_rotate_interval_type       = days {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] log_rotation_type              = none {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] long_rpc_timeout               = 1800 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] max_concurrent_builds          = 10 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] max_concurrent_live_migrations = 1 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] max_concurrent_snapshots       = 5 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] max_local_block_devices        = 3 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] max_logfile_count              = 30 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] max_logfile_size_mb            = 200 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] maximum_instance_delete_attempts = 5 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] metadata_listen                = 0.0.0.0 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] metadata_listen_port           = 8775 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] metadata_workers               = 3 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] migrate_max_retries            = -1 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] mkisofs_cmd                    = genisoimage {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] my_block_storage_ip            = 10.0.0.210 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] my_ip                          = 10.0.0.210 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] network_allocate_retries       = 0 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] osapi_compute_listen           = 0.0.0.0 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] osapi_compute_listen_port      = 8774 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] osapi_compute_unique_server_name_scope =  {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] osapi_compute_workers          = 3 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] password_length                = 12 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] periodic_enable                = True {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] periodic_fuzzy_delay           = 60 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] pointer_model                  = ps2mouse {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] preallocate_images             = none {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] publish_errors                 = False {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] pybasedir                      = /opt/stack/nova {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] ram_allocation_ratio           = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] rate_limit_burst               = 0 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] rate_limit_except_level        = CRITICAL {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] rate_limit_interval            = 0 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] reboot_timeout                 = 0 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] reclaim_instance_interval      = 0 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] record                         = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] reimage_timeout_per_gb         = 60 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] report_interval                = 120 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] rescue_timeout                 = 0 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] reserved_host_cpus             = 0 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] reserved_host_disk_mb          = 0 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] reserved_host_memory_mb        = 512 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] reserved_huge_pages            = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] resize_confirm_window          = 0 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] resize_fs_using_block_device   = False {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] resume_guests_state_on_host_boot = False {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] rpc_response_timeout           = 60 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] run_external_periodic_tasks    = True {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] running_deleted_instance_action = reap {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] running_deleted_instance_poll_interval = 1800 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] running_deleted_instance_timeout = 0 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] scheduler_instance_sync_interval = 120 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] service_down_time              = 720 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] servicegroup_driver            = db {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] shelved_offload_time           = 0 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] shelved_poll_interval          = 3600 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] shutdown_timeout               = 0 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] source_is_ipv6                 = False {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] ssl_only                       = False {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] state_path                     = /opt/stack/data/nova {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] sync_power_state_interval      = 600 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] sync_power_state_pool_size     = 1000 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] syslog_log_facility            = LOG_USER {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] tempdir                        = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] timeout_nbd                    = 10 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] transport_url                  = **** {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] update_resources_interval      = 0 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] use_cow_images                 = True {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] use_eventlog                   = False {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] use_journal                    = False {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] use_json                       = False {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] use_rootwrap_daemon            = False {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] use_stderr                     = False {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] use_syslog                     = False {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] vcpu_pin_set                   = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] vif_plugging_is_fatal          = False {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] vif_plugging_timeout           = 0 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] virt_mkfs                      = [] {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] volume_usage_poll_interval     = 0 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] watch_log_file                 = False {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] web                            = /usr/share/spice-html5 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] oslo_concurrency.disable_process_locking = False {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] api.auth_strategy              = keystone {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] api.compute_link_prefix        = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] api.dhcp_domain                = novalocal {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] api.enable_instance_password   = True {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] api.glance_link_prefix         = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] api.instance_list_cells_batch_strategy = distributed {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] api.instance_list_per_project_cells = False {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] api.list_records_by_skipping_down_cells = True {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] api.local_metadata_per_cell    = False {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] api.max_limit                  = 1000 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] api.metadata_cache_expiration  = 15 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] api.neutron_default_tenant_id  = default {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] api.use_forwarded_for          = False {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] api.use_neutron_default_nets   = False {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] api.vendordata_dynamic_failure_fatal = False {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] api.vendordata_dynamic_targets = [] {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] api.vendordata_jsonfile_path   = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] cache.backend                  = dogpile.cache.memcached {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] cache.backend_argument         = **** {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] cache.config_prefix            = cache.oslo {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] cache.dead_timeout             = 60.0 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] cache.debug_cache_backend      = False {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] cache.enable_retry_client      = False {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] cache.enable_socket_keepalive  = False {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] cache.enabled                  = True {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] cache.expiration_time          = 600 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] cache.hashclient_retry_attempts = 2 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] cache.hashclient_retry_delay   = 1.0 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] cache.memcache_dead_retry      = 300 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] cache.memcache_password        =  {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] cache.memcache_pool_maxsize    = 10 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] cache.memcache_sasl_enabled    = False {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] cache.memcache_socket_timeout  = 1.0 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] cache.memcache_username        =  {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] cache.proxies                  = [] {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] cache.retry_attempts           = 2 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] cache.retry_delay              = 0.0 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] cache.socket_keepalive_count   = 1 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] cache.socket_keepalive_idle    = 1 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] cache.socket_keepalive_interval = 1 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] cache.tls_allowed_ciphers      = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] cache.tls_cafile               = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] cache.tls_certfile             = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] cache.tls_enabled              = False {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] cache.tls_keyfile              = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] cinder.auth_section            = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] cinder.auth_type               = password {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] cinder.cafile                  = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] cinder.catalog_info            = volumev3::publicURL {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] cinder.certfile                = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] cinder.collect_timing          = False {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] cinder.cross_az_attach         = True {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] cinder.debug                   = False {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] cinder.endpoint_template       = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] cinder.http_retries            = 3 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] cinder.insecure                = False {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] cinder.keyfile                 = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] cinder.os_region_name          = RegionOne {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] cinder.split_loggers           = False {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] cinder.timeout                 = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] compute.cpu_dedicated_set      = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] compute.cpu_shared_set         = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] compute.image_type_exclude_list = [] {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] compute.live_migration_wait_for_vif_plug = True {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] compute.max_concurrent_disk_ops = 0 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] compute.max_disk_devices_to_attach = -1 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] compute.resource_provider_association_refresh = 300 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] compute.shutdown_retry_interval = 10 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] conductor.workers              = 3 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] console.allowed_origins        = [] {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] console.ssl_ciphers            = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] console.ssl_minimum_version    = default {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] consoleauth.token_ttl          = 600 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] cyborg.cafile                  = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] cyborg.certfile                = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] cyborg.collect_timing          = False {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] cyborg.connect_retries         = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] cyborg.connect_retry_delay     = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] cyborg.endpoint_override       = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] cyborg.insecure                = False {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] cyborg.keyfile                 = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] cyborg.max_version             = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] cyborg.min_version             = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] cyborg.region_name             = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] cyborg.service_name            = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] cyborg.service_type            = accelerator {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] cyborg.split_loggers           = False {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] cyborg.status_code_retries     = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] cyborg.status_code_retry_delay = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] cyborg.timeout                 = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] cyborg.version                 = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] database.backend               = sqlalchemy {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] database.connection            = **** {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] database.connection_debug      = 0 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] database.connection_parameters =  {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] database.connection_recycle_time = 3600 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] database.connection_trace      = False {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] database.db_inc_retry_interval = True {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] database.db_max_retries        = 20 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] database.db_max_retry_interval = 10 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] database.db_retry_interval     = 1 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] database.max_overflow          = 50 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] database.max_pool_size         = 5 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] database.max_retries           = 10 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] database.mysql_wsrep_sync_wait = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] database.pool_timeout          = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] database.retry_interval        = 10 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] database.slave_connection      = **** {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] database.sqlite_synchronous    = True {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] api_database.backend           = sqlalchemy {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] api_database.connection        = **** {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] api_database.connection_debug  = 0 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] api_database.connection_parameters =  {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] api_database.connection_recycle_time = 3600 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] api_database.connection_trace  = False {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] api_database.db_inc_retry_interval = True {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] api_database.db_max_retries    = 20 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] api_database.db_max_retry_interval = 10 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] api_database.db_retry_interval = 1 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] api_database.max_overflow      = 50 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] api_database.max_pool_size     = 5 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] api_database.max_retries       = 10 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] api_database.mysql_wsrep_sync_wait = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] api_database.pool_timeout      = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] api_database.retry_interval    = 10 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] api_database.slave_connection  = **** {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] api_database.sqlite_synchronous = True {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] devices.enabled_mdev_types     = [] {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] ephemeral_storage_encryption.enabled = False {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] ephemeral_storage_encryption.key_size = 512 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] glance.api_servers             = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] glance.cafile                  = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] glance.certfile                = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] glance.collect_timing          = False {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] glance.connect_retries         = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] glance.connect_retry_delay     = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] glance.debug                   = False {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] glance.default_trusted_certificate_ids = [] {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] glance.enable_certificate_validation = False {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] glance.enable_rbd_download     = False {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] glance.endpoint_override       = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] glance.insecure                = False {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] glance.keyfile                 = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] glance.max_version             = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] glance.min_version             = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] glance.num_retries             = 3 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] glance.rbd_ceph_conf           =  {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] glance.rbd_connect_timeout     = 5 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] glance.rbd_pool                =  {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] glance.rbd_user                =  {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] glance.region_name             = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] glance.service_name            = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] glance.service_type            = image {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] glance.split_loggers           = False {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] glance.status_code_retries     = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] glance.status_code_retry_delay = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] glance.timeout                 = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] glance.verify_glance_signatures = False {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] glance.version                 = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] guestfs.debug                  = False {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] hyperv.config_drive_cdrom      = False {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] hyperv.config_drive_inject_password = False {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] hyperv.enable_instance_metrics_collection = False {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] hyperv.enable_remotefx         = False {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] hyperv.instances_path_share    =  {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] hyperv.iscsi_initiator_list    = [] {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] hyperv.limit_cpu_features      = False {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] hyperv.power_state_check_timeframe = 60 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] hyperv.power_state_event_polling_interval = 2 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] hyperv.use_multipath_io        = False {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] hyperv.volume_attach_retry_count = 10 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] hyperv.volume_attach_retry_interval = 5 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] hyperv.vswitch_name            = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] mks.enabled                    = False {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] image_cache.manager_interval   = 2400 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] image_cache.precache_concurrency = 1 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] image_cache.remove_unused_base_images = True {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] image_cache.subdirectory_name  = _base {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] ironic.api_max_retries         = 60 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] ironic.api_retry_interval      = 2 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] ironic.auth_section            = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] ironic.auth_type               = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] ironic.cafile                  = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] ironic.certfile                = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] ironic.collect_timing          = False {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] ironic.conductor_group         = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] ironic.connect_retries         = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] ironic.connect_retry_delay     = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] ironic.endpoint_override       = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] ironic.insecure                = False {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] ironic.keyfile                 = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] ironic.max_version             = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] ironic.min_version             = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] ironic.peer_list               = [] {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] ironic.region_name             = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] ironic.serial_console_state_timeout = 10 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] ironic.service_name            = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] ironic.service_type            = baremetal {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] ironic.split_loggers           = False {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] ironic.status_code_retries     = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] ironic.status_code_retry_delay = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] ironic.timeout                 = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] ironic.version                 = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] key_manager.fixed_key          = **** {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] barbican.barbican_api_version  = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] barbican.barbican_endpoint     = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] barbican.barbican_endpoint_type = public {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] barbican.barbican_region_name  = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] barbican.cafile                = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] barbican.certfile              = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] barbican.collect_timing        = False {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] barbican.insecure              = False {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] barbican.keyfile               = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] barbican.number_of_retries     = 60 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] barbican.retry_delay           = 1 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] barbican.send_service_user_token = False {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] barbican.split_loggers         = False {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] barbican.timeout               = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] barbican.verify_ssl            = True {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] barbican.verify_ssl_path       = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] barbican_service_user.auth_section = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] barbican_service_user.auth_type = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] barbican_service_user.cafile   = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] barbican_service_user.certfile = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] barbican_service_user.collect_timing = False {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] barbican_service_user.insecure = False {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] barbican_service_user.keyfile  = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] barbican_service_user.split_loggers = False {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] barbican_service_user.timeout  = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] vault.approle_role_id          = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] vault.approle_secret_id        = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] vault.cafile                   = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] vault.certfile                 = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] vault.collect_timing           = False {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] vault.insecure                 = False {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] vault.keyfile                  = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] vault.kv_mountpoint            = secret {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] vault.kv_path                  = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] vault.kv_version               = 2 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] vault.namespace                = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] vault.root_token_id            = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] vault.split_loggers            = False {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] vault.ssl_ca_crt_file          = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] vault.timeout                  = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] vault.use_ssl                  = False {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] keystone.auth_section          = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] keystone.auth_type             = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] keystone.cafile                = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] keystone.certfile              = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] keystone.collect_timing        = False {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] keystone.connect_retries       = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] keystone.connect_retry_delay   = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] keystone.endpoint_override     = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] keystone.insecure              = False {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] keystone.keyfile               = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] keystone.max_version           = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] keystone.min_version           = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] keystone.region_name           = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] keystone.service_name          = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] keystone.service_type          = identity {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] keystone.split_loggers         = False {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] keystone.status_code_retries   = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] keystone.status_code_retry_delay = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] keystone.timeout               = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] keystone.version               = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] libvirt.connection_uri         =  {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] libvirt.cpu_mode               = custom {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] libvirt.cpu_model_extra_flags  = [] {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: WARNING oslo_config.cfg [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] libvirt.cpu_power_governor_high = performance {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] libvirt.cpu_power_governor_low = powersave {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] libvirt.cpu_power_management   = False {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] libvirt.device_detach_attempts = 8 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] libvirt.device_detach_timeout  = 20 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] libvirt.disk_cachemodes        = [] {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] libvirt.disk_prefix            = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] libvirt.enabled_perf_events    = [] {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] libvirt.file_backed_memory     = 0 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] libvirt.gid_maps               = [] {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] libvirt.hw_disk_discard        = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] libvirt.hw_machine_type        = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] libvirt.images_rbd_ceph_conf   =  {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] libvirt.images_rbd_glance_store_name =  {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] libvirt.images_rbd_pool        = rbd {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] libvirt.images_type            = default {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] libvirt.images_volume_group    = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] libvirt.inject_key             = False {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] libvirt.inject_partition       = -2 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] libvirt.inject_password        = False {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] libvirt.iscsi_iface            = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] libvirt.iser_use_multipath     = False {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] libvirt.live_migration_bandwidth = 0 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] libvirt.live_migration_completion_timeout = 800 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] libvirt.live_migration_downtime = 500 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] libvirt.live_migration_downtime_delay = 75 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] libvirt.live_migration_downtime_steps = 10 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] libvirt.live_migration_inbound_addr = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] libvirt.live_migration_permit_auto_converge = False {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] libvirt.live_migration_permit_post_copy = False {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] libvirt.live_migration_scheme  = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] libvirt.live_migration_timeout_action = abort {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] libvirt.live_migration_tunnelled = False {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: WARNING oslo_config.cfg [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Nov 17 01:12:53 user nova-compute[75226]: live_migration_uri is deprecated for removal in favor of two other options that
Nov 17 01:12:53 user nova-compute[75226]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Nov 17 01:12:53 user nova-compute[75226]: and ``live_migration_inbound_addr`` respectively.
Nov 17 01:12:53 user nova-compute[75226]: ).  Its value may be silently ignored in the future.
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] libvirt.live_migration_with_native_tls = False {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] libvirt.max_queues             = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] libvirt.mem_stats_period_seconds = 10 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] libvirt.nfs_mount_options      = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] libvirt.num_aoe_discover_tries = 3 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] libvirt.num_iser_scan_tries    = 5 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] libvirt.num_memory_encrypted_guests = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] libvirt.num_nvme_discover_tries = 5 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] libvirt.num_pcie_ports         = 0 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] libvirt.num_volume_scan_tries  = 5 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] libvirt.pmem_namespaces        = [] {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] libvirt.quobyte_client_cfg     = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] libvirt.rbd_connect_timeout    = 5 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] libvirt.rbd_secret_uuid        = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] libvirt.rbd_user               = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] libvirt.realtime_scheduler_priority = 1 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] libvirt.remote_filesystem_transport = ssh {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] libvirt.rescue_image_id        = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] libvirt.rescue_kernel_id       = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] libvirt.rescue_ramdisk_id      = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] libvirt.rx_queue_size          = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] libvirt.smbfs_mount_options    =  {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] libvirt.snapshot_compression   = False {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] libvirt.snapshot_image_format  = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] libvirt.sparse_logical_volumes = False {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] libvirt.swtpm_enabled          = False {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] libvirt.swtpm_group            = tss {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] libvirt.swtpm_user             = tss {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] libvirt.sysinfo_serial         = unique {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] libvirt.tb_cache_size          = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] libvirt.tx_queue_size          = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] libvirt.uid_maps               = [] {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] libvirt.use_virtio_for_bridges = True {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] libvirt.virt_type              = kvm {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] libvirt.volume_clear           = zero {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] libvirt.volume_clear_size      = 0 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] libvirt.volume_use_multipath   = False {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] libvirt.vzstorage_cache_path   = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] libvirt.vzstorage_mount_group  = qemu {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] libvirt.vzstorage_mount_opts   = [] {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] libvirt.vzstorage_mount_user   = stack {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] neutron.auth_section           = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] neutron.auth_type              = password {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] neutron.cafile                 = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] neutron.certfile               = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] neutron.collect_timing         = False {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] neutron.connect_retries        = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] neutron.connect_retry_delay    = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] neutron.default_floating_pool  = public {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] neutron.endpoint_override      = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] neutron.extension_sync_interval = 600 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] neutron.http_retries           = 3 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] neutron.insecure               = False {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] neutron.keyfile                = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] neutron.max_version            = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] neutron.metadata_proxy_shared_secret = **** {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] neutron.min_version            = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] neutron.ovs_bridge             = br-int {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] neutron.physnets               = [] {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] neutron.region_name            = RegionOne {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] neutron.service_metadata_proxy = True {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] neutron.service_name           = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] neutron.service_type           = network {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] neutron.split_loggers          = False {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] neutron.status_code_retries    = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] neutron.status_code_retry_delay = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] neutron.timeout                = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] neutron.version                = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] notifications.bdms_in_notifications = False {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] notifications.default_level    = INFO {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] notifications.notification_format = unversioned {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] notifications.notify_on_state_change = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] pci.alias                      = [] {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] pci.device_spec                = [] {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] pci.report_in_placement        = False {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] placement.auth_section         = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] placement.auth_type            = password {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] placement.cafile               = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] placement.certfile             = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] placement.collect_timing       = False {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] placement.connect_retries      = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] placement.connect_retry_delay  = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] placement.default_domain_id    = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] placement.default_domain_name  = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] placement.domain_id            = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] placement.domain_name          = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] placement.endpoint_override    = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] placement.insecure             = False {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] placement.keyfile              = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] placement.max_version          = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] placement.min_version          = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] placement.password             = **** {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] placement.project_domain_id    = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] placement.project_domain_name  = Default {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] placement.project_id           = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] placement.project_name         = service {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] placement.region_name          = RegionOne {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] placement.service_name         = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] placement.service_type         = placement {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] placement.split_loggers        = False {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] placement.status_code_retries  = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] placement.status_code_retry_delay = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] placement.system_scope         = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] placement.timeout              = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] placement.trust_id             = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] placement.user_domain_id       = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] placement.user_domain_name     = Default {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] placement.user_id              = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] placement.username             = placement {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] placement.version              = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] quota.cores                    = 20 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] quota.count_usage_from_placement = False {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] quota.injected_file_content_bytes = 10240 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] quota.injected_file_path_length = 255 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] quota.injected_files           = 5 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] quota.instances                = 10 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] quota.key_pairs                = 100 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] quota.metadata_items           = 128 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] quota.ram                      = 51200 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] quota.recheck_quota            = True {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] quota.server_group_members     = 10 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] quota.server_groups            = 10 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] rdp.enabled                    = False {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] scheduler.image_metadata_prefilter = False {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] scheduler.max_attempts         = 3 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] scheduler.max_placement_results = 1000 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] scheduler.query_placement_for_image_type_support = False {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] scheduler.workers              = 3 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] filter_scheduler.host_subset_size = 1 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] filter_scheduler.image_properties_default_architecture = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] filter_scheduler.isolated_hosts = [] {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] filter_scheduler.isolated_images = [] {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] filter_scheduler.max_instances_per_host = 50 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] filter_scheduler.pci_in_placement = False {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] filter_scheduler.track_instance_changes = False {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] metrics.required               = True {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] metrics.weight_multiplier      = 1.0 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] metrics.weight_setting         = [] {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] serial_console.enabled         = False {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] serial_console.port_range      = 10000:20000 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] serial_console.serialproxy_port = 6083 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] service_user.auth_section      = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] service_user.auth_type         = password {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] service_user.cafile            = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] service_user.certfile          = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] service_user.collect_timing    = False {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] service_user.insecure          = False {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] service_user.keyfile           = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] service_user.send_service_user_token = True {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] service_user.split_loggers     = False {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] service_user.timeout           = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] spice.agent_enabled            = True {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] spice.enabled                  = False {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] spice.html5proxy_port          = 6082 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] spice.image_compression        = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] spice.jpeg_compression         = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] spice.playback_compression     = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] spice.server_listen            = 127.0.0.1 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] spice.streaming_mode           = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] spice.zlib_compression         = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] upgrade_levels.baseapi         = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] upgrade_levels.compute         = auto {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] upgrade_levels.conductor       = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] upgrade_levels.scheduler       = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] vendordata_dynamic_auth.auth_section = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] vendordata_dynamic_auth.auth_type = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] vendordata_dynamic_auth.cafile = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] vendordata_dynamic_auth.certfile = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] vendordata_dynamic_auth.collect_timing = False {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] vendordata_dynamic_auth.insecure = False {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] vendordata_dynamic_auth.keyfile = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] vendordata_dynamic_auth.split_loggers = False {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] vendordata_dynamic_auth.timeout = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] vmware.api_retry_count         = 10 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] vmware.ca_file                 = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] vmware.cache_prefix            = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] vmware.cluster_name            = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] vmware.connection_pool_size    = 10 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] vmware.console_delay_seconds   = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] vmware.datastore_regex         = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] vmware.host_ip                 = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] vmware.host_password           = **** {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] vmware.host_port               = 443 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] vmware.host_username           = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] vmware.insecure                = False {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] vmware.integration_bridge      = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] vmware.maximum_objects         = 100 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] vmware.pbm_default_policy      = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] vmware.pbm_enabled             = False {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] vmware.pbm_wsdl_location       = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] vmware.serial_port_proxy_uri   = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] vmware.serial_port_service_uri = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] vmware.task_poll_interval      = 0.5 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] vmware.use_linked_clone        = True {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] vmware.vnc_keymap              = en-us {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] vmware.vnc_port                = 5900 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] vmware.vnc_port_total          = 10000 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] vnc.auth_schemes               = ['none'] {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] vnc.enabled                    = True {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] vnc.novncproxy_port            = 6080 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] vnc.server_listen              = 0.0.0.0 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] vnc.vencrypt_ca_certs          = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] vnc.vencrypt_client_cert       = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] vnc.vencrypt_client_key        = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] workarounds.disable_fallback_pcpu_query = False {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] workarounds.disable_group_policy_check_upcall = True {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] workarounds.disable_rootwrap   = False {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] workarounds.enable_numa_live_migration = False {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] workarounds.handle_virt_lifecycle_events = True {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] workarounds.libvirt_disable_apic = False {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] workarounds.never_download_image_if_on_rbd = False {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] wsgi.client_socket_timeout     = 900 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] wsgi.default_pool_size         = 1000 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] wsgi.keep_alive                = True {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] wsgi.max_header_line           = 16384 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] wsgi.secure_proxy_ssl_header   = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] wsgi.ssl_ca_file               = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] wsgi.ssl_cert_file             = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] wsgi.ssl_key_file              = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] wsgi.tcp_keepidle              = 600 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] zvm.ca_file                    = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] zvm.cloud_connector_url        = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] zvm.reachable_timeout          = 300 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] oslo_policy.enforce_new_defaults = True {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] oslo_policy.enforce_scope      = True {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] oslo_policy.policy_default_rule = default {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] oslo_policy.policy_file        = policy.yaml {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] profiler.connection_string     = messaging:// {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] profiler.enabled               = False {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] profiler.es_doc_type           = notification {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] profiler.es_scroll_size        = 10000 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] profiler.es_scroll_time        = 2m {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] profiler.filter_error_trace    = False {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] profiler.hmac_keys             = **** {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] profiler.sentinel_service_name = mymaster {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] profiler.socket_timeout        = 0.1 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] profiler.trace_requests        = False {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] profiler.trace_sqlalchemy      = False {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] profiler_jaeger.process_tags   = {} {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] profiler_jaeger.service_name_prefix = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] profiler_otlp.service_name_prefix = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] remote_debug.host              = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] remote_debug.port              = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] oslo_messaging_rabbit.ssl      = False {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] oslo_messaging_rabbit.ssl_version =  {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] oslo_messaging_notifications.retry = -1 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] oslo_messaging_notifications.transport_url = **** {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] oslo_limit.auth_section        = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] oslo_limit.auth_type           = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] oslo_limit.cafile              = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] oslo_limit.certfile            = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] oslo_limit.collect_timing      = False {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] oslo_limit.connect_retries     = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] oslo_limit.connect_retry_delay = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] oslo_limit.endpoint_id         = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] oslo_limit.endpoint_override   = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] oslo_limit.insecure            = False {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] oslo_limit.keyfile             = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] oslo_limit.max_version         = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] oslo_limit.min_version         = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] oslo_limit.region_name         = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] oslo_limit.service_name        = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] oslo_limit.service_type        = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] oslo_limit.split_loggers       = False {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] oslo_limit.status_code_retries = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] oslo_limit.status_code_retry_delay = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] oslo_limit.timeout             = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] oslo_limit.valid_interfaces    = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] oslo_limit.version             = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] oslo_reports.file_event_handler = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] oslo_reports.log_dir           = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] vif_plug_linux_bridge_privileged.group = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] vif_plug_linux_bridge_privileged.user = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] vif_plug_ovs_privileged.group  = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] vif_plug_ovs_privileged.helper_command = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] vif_plug_ovs_privileged.user   = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] os_vif_linux_bridge.flat_interface = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] os_vif_linux_bridge.vlan_interface = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] os_vif_ovs.isolate_vif         = False {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] os_vif_ovs.ovsdb_interface     = native {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] os_vif_ovs.per_port_bridge     = False {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] os_brick.lock_path             = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] privsep_osbrick.capabilities   = [21] {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] privsep_osbrick.group          = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] privsep_osbrick.helper_command = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] privsep_osbrick.thread_pool_size = 12 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] privsep_osbrick.user           = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] nova_sys_admin.group           = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] nova_sys_admin.helper_command  = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] nova_sys_admin.thread_pool_size = 12 {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] nova_sys_admin.user            = None {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG oslo_service.service [None req-97dd4527-9175-4ab1-8bb3-66fdceb6cc9f None None] ******************************************************************************** {{(pid=75226) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Nov 17 01:12:53 user nova-compute[75226]: INFO nova.service [-] Starting compute node (version 0.0.0)
Nov 17 01:12:53 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-5439cf8a-5bb2-447e-9351-06058b1fe5ef None None] Connecting to libvirt: qemu:///system {{(pid=75226) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:506}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-5439cf8a-5bb2-447e-9351-06058b1fe5ef None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7fc4d4d223e0> {{(pid=75226) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:512}}
Nov 17 01:12:53 user nova-compute[75226]: libvirt:  error : internal error: could not initialize domain event timer
Nov 17 01:12:53 user nova-compute[75226]: WARNING nova.virt.libvirt.host [None req-5439cf8a-5bb2-447e-9351-06058b1fe5ef None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Nov 17 01:12:53 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-5439cf8a-5bb2-447e-9351-06058b1fe5ef None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7fc4d4d223e0> {{(pid=75226) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:533}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-5439cf8a-5bb2-447e-9351-06058b1fe5ef None None] Starting native event thread {{(pid=75226) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-5439cf8a-5bb2-447e-9351-06058b1fe5ef None None] Starting green dispatch thread {{(pid=75226) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Nov 17 01:12:53 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-5439cf8a-5bb2-447e-9351-06058b1fe5ef None None] Starting connection event dispatch thread {{(pid=75226) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:501}}
Nov 17 01:12:53 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-5439cf8a-5bb2-447e-9351-06058b1fe5ef None None] Connection event '1' reason 'None'
Nov 17 01:12:53 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-5439cf8a-5bb2-447e-9351-06058b1fe5ef None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 17 01:12:53 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.mount [None req-5439cf8a-5bb2-447e-9351-06058b1fe5ef None None] Initialising _HostMountState generation 0 {{(pid=75226) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Nov 17 01:13:00 user nova-compute[75226]: INFO nova.virt.libvirt.host [None req-5439cf8a-5bb2-447e-9351-06058b1fe5ef None None] Libvirt host capabilities <capabilities>
Nov 17 01:13:00 user nova-compute[75226]:   <host>
Nov 17 01:13:00 user nova-compute[75226]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Nov 17 01:13:00 user nova-compute[75226]:     <cpu>
Nov 17 01:13:00 user nova-compute[75226]:       <arch>x86_64</arch>
Nov 17 01:13:00 user nova-compute[75226]:       <model>IvyBridge-IBRS</model>
Nov 17 01:13:00 user nova-compute[75226]:       <vendor>Intel</vendor>
Nov 17 01:13:00 user nova-compute[75226]:       <microcode version='1070'/>
Nov 17 01:13:00 user nova-compute[75226]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Nov 17 01:13:00 user nova-compute[75226]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Nov 17 01:13:00 user nova-compute[75226]:       <feature name='ss'/>
Nov 17 01:13:00 user nova-compute[75226]:       <feature name='vmx'/>
Nov 17 01:13:00 user nova-compute[75226]:       <feature name='pcid'/>
Nov 17 01:13:00 user nova-compute[75226]:       <feature name='osxsave'/>
Nov 17 01:13:00 user nova-compute[75226]:       <feature name='hypervisor'/>
Nov 17 01:13:00 user nova-compute[75226]:       <feature name='arat'/>
Nov 17 01:13:00 user nova-compute[75226]:       <feature name='tsc_adjust'/>
Nov 17 01:13:00 user nova-compute[75226]:       <feature name='md-clear'/>
Nov 17 01:13:00 user nova-compute[75226]:       <feature name='stibp'/>
Nov 17 01:13:00 user nova-compute[75226]:       <feature name='arch-capabilities'/>
Nov 17 01:13:00 user nova-compute[75226]:       <feature name='ssbd'/>
Nov 17 01:13:00 user nova-compute[75226]:       <feature name='invtsc'/>
Nov 17 01:13:00 user nova-compute[75226]:       <feature name='rsba'/>
Nov 17 01:13:00 user nova-compute[75226]:       <feature name='skip-l1dfl-vmentry'/>
Nov 17 01:13:00 user nova-compute[75226]:       <pages unit='KiB' size='4'/>
Nov 17 01:13:00 user nova-compute[75226]:       <pages unit='KiB' size='2048'/>
Nov 17 01:13:00 user nova-compute[75226]:     </cpu>
Nov 17 01:13:00 user nova-compute[75226]:     <power_management>
Nov 17 01:13:00 user nova-compute[75226]:       <suspend_mem/>
Nov 17 01:13:00 user nova-compute[75226]:       <suspend_disk/>
Nov 17 01:13:00 user nova-compute[75226]:       <suspend_hybrid/>
Nov 17 01:13:00 user nova-compute[75226]:     </power_management>
Nov 17 01:13:00 user nova-compute[75226]:     <iommu support='no'/>
Nov 17 01:13:00 user nova-compute[75226]:     <migration_features>
Nov 17 01:13:00 user nova-compute[75226]:       <live/>
Nov 17 01:13:00 user nova-compute[75226]:       <uri_transports>
Nov 17 01:13:00 user nova-compute[75226]:         <uri_transport>tcp</uri_transport>
Nov 17 01:13:00 user nova-compute[75226]:         <uri_transport>rdma</uri_transport>
Nov 17 01:13:00 user nova-compute[75226]:       </uri_transports>
Nov 17 01:13:00 user nova-compute[75226]:     </migration_features>
Nov 17 01:13:00 user nova-compute[75226]:     <topology>
Nov 17 01:13:00 user nova-compute[75226]:       <cells num='2'>
Nov 17 01:13:00 user nova-compute[75226]:         <cell id='0'>
Nov 17 01:13:00 user nova-compute[75226]:           <memory unit='KiB'>8189224</memory>
Nov 17 01:13:00 user nova-compute[75226]:           <pages unit='KiB' size='4'>2047306</pages>
Nov 17 01:13:00 user nova-compute[75226]:           <pages unit='KiB' size='2048'>0</pages>
Nov 17 01:13:00 user nova-compute[75226]:           <distances>
Nov 17 01:13:00 user nova-compute[75226]:             <sibling id='0' value='10'/>
Nov 17 01:13:00 user nova-compute[75226]:             <sibling id='1' value='20'/>
Nov 17 01:13:00 user nova-compute[75226]:           </distances>
Nov 17 01:13:00 user nova-compute[75226]:           <cpus num='6'>
Nov 17 01:13:00 user nova-compute[75226]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Nov 17 01:13:00 user nova-compute[75226]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Nov 17 01:13:00 user nova-compute[75226]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Nov 17 01:13:00 user nova-compute[75226]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Nov 17 01:13:00 user nova-compute[75226]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Nov 17 01:13:00 user nova-compute[75226]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Nov 17 01:13:00 user nova-compute[75226]:           </cpus>
Nov 17 01:13:00 user nova-compute[75226]:         </cell>
Nov 17 01:13:00 user nova-compute[75226]:         <cell id='1'>
Nov 17 01:13:00 user nova-compute[75226]:           <memory unit='KiB'>8206460</memory>
Nov 17 01:13:00 user nova-compute[75226]:           <pages unit='KiB' size='4'>2051615</pages>
Nov 17 01:13:00 user nova-compute[75226]:           <pages unit='KiB' size='2048'>0</pages>
Nov 17 01:13:00 user nova-compute[75226]:           <distances>
Nov 17 01:13:00 user nova-compute[75226]:             <sibling id='0' value='20'/>
Nov 17 01:13:00 user nova-compute[75226]:             <sibling id='1' value='10'/>
Nov 17 01:13:00 user nova-compute[75226]:           </distances>
Nov 17 01:13:00 user nova-compute[75226]:           <cpus num='6'>
Nov 17 01:13:00 user nova-compute[75226]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Nov 17 01:13:00 user nova-compute[75226]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Nov 17 01:13:00 user nova-compute[75226]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Nov 17 01:13:00 user nova-compute[75226]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Nov 17 01:13:00 user nova-compute[75226]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Nov 17 01:13:00 user nova-compute[75226]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Nov 17 01:13:00 user nova-compute[75226]:           </cpus>
Nov 17 01:13:00 user nova-compute[75226]:         </cell>
Nov 17 01:13:00 user nova-compute[75226]:       </cells>
Nov 17 01:13:00 user nova-compute[75226]:     </topology>
Nov 17 01:13:00 user nova-compute[75226]:     <cache>
Nov 17 01:13:00 user nova-compute[75226]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Nov 17 01:13:00 user nova-compute[75226]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Nov 17 01:13:00 user nova-compute[75226]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Nov 17 01:13:00 user nova-compute[75226]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Nov 17 01:13:00 user nova-compute[75226]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Nov 17 01:13:00 user nova-compute[75226]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Nov 17 01:13:00 user nova-compute[75226]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Nov 17 01:13:00 user nova-compute[75226]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Nov 17 01:13:00 user nova-compute[75226]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Nov 17 01:13:00 user nova-compute[75226]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Nov 17 01:13:00 user nova-compute[75226]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Nov 17 01:13:00 user nova-compute[75226]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Nov 17 01:13:00 user nova-compute[75226]:     </cache>
Nov 17 01:13:00 user nova-compute[75226]:     <secmodel>
Nov 17 01:13:00 user nova-compute[75226]:       <model>apparmor</model>
Nov 17 01:13:00 user nova-compute[75226]:       <doi>0</doi>
Nov 17 01:13:00 user nova-compute[75226]:     </secmodel>
Nov 17 01:13:00 user nova-compute[75226]:     <secmodel>
Nov 17 01:13:00 user nova-compute[75226]:       <model>dac</model>
Nov 17 01:13:00 user nova-compute[75226]:       <doi>0</doi>
Nov 17 01:13:00 user nova-compute[75226]:       <baselabel type='kvm'>+64055:+108</baselabel>
Nov 17 01:13:00 user nova-compute[75226]:       <baselabel type='qemu'>+64055:+108</baselabel>
Nov 17 01:13:00 user nova-compute[75226]:     </secmodel>
Nov 17 01:13:00 user nova-compute[75226]:   </host>
Nov 17 01:13:00 user nova-compute[75226]:   <guest>
Nov 17 01:13:00 user nova-compute[75226]:     <os_type>hvm</os_type>
Nov 17 01:13:00 user nova-compute[75226]:     <arch name='alpha'>
Nov 17 01:13:00 user nova-compute[75226]:       <wordsize>64</wordsize>
Nov 17 01:13:00 user nova-compute[75226]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='4'>clipper</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <domain type='qemu'/>
Nov 17 01:13:00 user nova-compute[75226]:     </arch>
Nov 17 01:13:00 user nova-compute[75226]:     <features>
Nov 17 01:13:00 user nova-compute[75226]:       <cpuselection/>
Nov 17 01:13:00 user nova-compute[75226]:       <deviceboot/>
Nov 17 01:13:00 user nova-compute[75226]:       <disksnapshot default='on' toggle='no'/>
Nov 17 01:13:00 user nova-compute[75226]:     </features>
Nov 17 01:13:00 user nova-compute[75226]:   </guest>
Nov 17 01:13:00 user nova-compute[75226]:   <guest>
Nov 17 01:13:00 user nova-compute[75226]:     <os_type>hvm</os_type>
Nov 17 01:13:00 user nova-compute[75226]:     <arch name='armv6l'>
Nov 17 01:13:00 user nova-compute[75226]:       <wordsize>32</wordsize>
Nov 17 01:13:00 user nova-compute[75226]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>integratorcp</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>borzoi</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>spitz</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='2'>nuri</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='2'>musca-b1</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>versatileab</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>kzm</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='2'>musca-a</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='2'>smdkc210</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>sx1</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>z2</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>tosa</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='4'>sabrelite</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>realview-eb</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>n810</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>n800</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>versatilepb</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>terrier</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>mainstone</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='4'>midway</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>musicpal</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>microbit</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>cubieboard</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>verdex</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>netduino2</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='4'>raspi2b</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>cheetah</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='4'>highbank</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>akita</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>connex</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>collie</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>raspi0</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <domain type='qemu'/>
Nov 17 01:13:00 user nova-compute[75226]:     </arch>
Nov 17 01:13:00 user nova-compute[75226]:     <features>
Nov 17 01:13:00 user nova-compute[75226]:       <cpuselection/>
Nov 17 01:13:00 user nova-compute[75226]:       <deviceboot/>
Nov 17 01:13:00 user nova-compute[75226]:       <disksnapshot default='on' toggle='no'/>
Nov 17 01:13:00 user nova-compute[75226]:     </features>
Nov 17 01:13:00 user nova-compute[75226]:   </guest>
Nov 17 01:13:00 user nova-compute[75226]:   <guest>
Nov 17 01:13:00 user nova-compute[75226]:     <os_type>hvm</os_type>
Nov 17 01:13:00 user nova-compute[75226]:     <arch name='armv7l'>
Nov 17 01:13:00 user nova-compute[75226]:       <wordsize>32</wordsize>
Nov 17 01:13:00 user nova-compute[75226]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>integratorcp</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>borzoi</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>spitz</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='2'>nuri</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='2'>musca-b1</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>versatileab</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>kzm</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='2'>musca-a</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='2'>smdkc210</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>sx1</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>z2</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>tosa</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='4'>sabrelite</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>realview-eb</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>n810</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>n800</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>versatilepb</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>terrier</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>mainstone</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='4'>midway</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>musicpal</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>microbit</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>cubieboard</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>verdex</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>netduino2</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='4'>raspi2b</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>cheetah</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='4'>highbank</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>akita</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>connex</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>collie</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>raspi0</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <domain type='qemu'/>
Nov 17 01:13:00 user nova-compute[75226]:     </arch>
Nov 17 01:13:00 user nova-compute[75226]:     <features>
Nov 17 01:13:00 user nova-compute[75226]:       <cpuselection/>
Nov 17 01:13:00 user nova-compute[75226]:       <deviceboot/>
Nov 17 01:13:00 user nova-compute[75226]:       <disksnapshot default='on' toggle='no'/>
Nov 17 01:13:00 user nova-compute[75226]:     </features>
Nov 17 01:13:00 user nova-compute[75226]:   </guest>
Nov 17 01:13:00 user nova-compute[75226]:   <guest>
Nov 17 01:13:00 user nova-compute[75226]:     <os_type>hvm</os_type>
Nov 17 01:13:00 user nova-compute[75226]:     <arch name='aarch64'>
Nov 17 01:13:00 user nova-compute[75226]:       <wordsize>64</wordsize>
Nov 17 01:13:00 user nova-compute[75226]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>integratorcp</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>borzoi</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>spitz</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='2'>nuri</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='2'>musca-b1</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>versatileab</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>kzm</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='2'>musca-a</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='2'>smdkc210</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>sx1</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>z2</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>tosa</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='4'>sabrelite</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>realview-eb</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='512'>sbsa-ref</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>n810</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>n800</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>versatilepb</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>terrier</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>mainstone</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='4'>midway</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>musicpal</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>microbit</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='4'>raspi3ap</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>cubieboard</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>verdex</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>netduino2</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='4'>raspi3b</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='4'>raspi2b</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>cheetah</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='4'>highbank</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>akita</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>connex</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>collie</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>raspi0</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <domain type='qemu'/>
Nov 17 01:13:00 user nova-compute[75226]:     </arch>
Nov 17 01:13:00 user nova-compute[75226]:     <features>
Nov 17 01:13:00 user nova-compute[75226]:       <acpi default='on' toggle='yes'/>
Nov 17 01:13:00 user nova-compute[75226]:       <cpuselection/>
Nov 17 01:13:00 user nova-compute[75226]:       <deviceboot/>
Nov 17 01:13:00 user nova-compute[75226]:       <disksnapshot default='on' toggle='no'/>
Nov 17 01:13:00 user nova-compute[75226]:     </features>
Nov 17 01:13:00 user nova-compute[75226]:   </guest>
Nov 17 01:13:00 user nova-compute[75226]:   <guest>
Nov 17 01:13:00 user nova-compute[75226]:     <os_type>hvm</os_type>
Nov 17 01:13:00 user nova-compute[75226]:     <arch name='cris'>
Nov 17 01:13:00 user nova-compute[75226]:       <wordsize>32</wordsize>
Nov 17 01:13:00 user nova-compute[75226]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>axis-dev88</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <domain type='qemu'/>
Nov 17 01:13:00 user nova-compute[75226]:     </arch>
Nov 17 01:13:00 user nova-compute[75226]:     <features>
Nov 17 01:13:00 user nova-compute[75226]:       <cpuselection/>
Nov 17 01:13:00 user nova-compute[75226]:       <deviceboot/>
Nov 17 01:13:00 user nova-compute[75226]:       <disksnapshot default='on' toggle='no'/>
Nov 17 01:13:00 user nova-compute[75226]:     </features>
Nov 17 01:13:00 user nova-compute[75226]:   </guest>
Nov 17 01:13:00 user nova-compute[75226]:   <guest>
Nov 17 01:13:00 user nova-compute[75226]:     <os_type>hvm</os_type>
Nov 17 01:13:00 user nova-compute[75226]:     <arch name='i686'>
Nov 17 01:13:00 user nova-compute[75226]:       <wordsize>32</wordsize>
Nov 17 01:13:00 user nova-compute[75226]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>x-remote</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>isapc</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='288'>microvm</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <domain type='qemu'/>
Nov 17 01:13:00 user nova-compute[75226]:       <domain type='kvm'/>
Nov 17 01:13:00 user nova-compute[75226]:     </arch>
Nov 17 01:13:00 user nova-compute[75226]:     <features>
Nov 17 01:13:00 user nova-compute[75226]:       <pae/>
Nov 17 01:13:00 user nova-compute[75226]:       <nonpae/>
Nov 17 01:13:00 user nova-compute[75226]:       <acpi default='on' toggle='yes'/>
Nov 17 01:13:00 user nova-compute[75226]:       <apic default='on' toggle='no'/>
Nov 17 01:13:00 user nova-compute[75226]:       <cpuselection/>
Nov 17 01:13:00 user nova-compute[75226]:       <deviceboot/>
Nov 17 01:13:00 user nova-compute[75226]:       <disksnapshot default='on' toggle='no'/>
Nov 17 01:13:00 user nova-compute[75226]:     </features>
Nov 17 01:13:00 user nova-compute[75226]:   </guest>
Nov 17 01:13:00 user nova-compute[75226]:   <guest>
Nov 17 01:13:00 user nova-compute[75226]:     <os_type>hvm</os_type>
Nov 17 01:13:00 user nova-compute[75226]:     <arch name='m68k'>
Nov 17 01:13:00 user nova-compute[75226]:       <wordsize>32</wordsize>
Nov 17 01:13:00 user nova-compute[75226]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>mcf5208evb</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>an5206</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>virt-6.0</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>q800</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>virt-6.2</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>next-cube</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <machine maxCpus='1'>virt-6.1</machine>
Nov 17 01:13:00 user nova-compute[75226]:       <domain type='qemu'/>
Nov 17 01:13:00 user nova-compute[75226]:     </arch>
Nov 17 01:13:00 user nova-compute[75226]:     <features>
Nov 17 01:13:00 user nova-compute[75226]:       <cpuselection/>
Nov 17 01:13:01 user nova-compute[75226]:       <deviceboot/>
Nov 17 01:13:01 user nova-compute[75226]:       <disksnapshot default='on' toggle='no'/>
Nov 17 01:13:01 user nova-compute[75226]:     </features>
Nov 17 01:13:01 user nova-compute[75226]:   </guest>
Nov 17 01:13:01 user nova-compute[75226]:   <guest>
Nov 17 01:13:01 user nova-compute[75226]:     <os_type>hvm</os_type>
Nov 17 01:13:01 user nova-compute[75226]:     <arch name='microblaze'>
Nov 17 01:13:01 user nova-compute[75226]:       <wordsize>32</wordsize>
Nov 17 01:13:01 user nova-compute[75226]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <domain type='qemu'/>
Nov 17 01:13:01 user nova-compute[75226]:     </arch>
Nov 17 01:13:01 user nova-compute[75226]:     <features>
Nov 17 01:13:01 user nova-compute[75226]:       <cpuselection/>
Nov 17 01:13:01 user nova-compute[75226]:       <deviceboot/>
Nov 17 01:13:01 user nova-compute[75226]:       <disksnapshot default='on' toggle='no'/>
Nov 17 01:13:01 user nova-compute[75226]:     </features>
Nov 17 01:13:01 user nova-compute[75226]:   </guest>
Nov 17 01:13:01 user nova-compute[75226]:   <guest>
Nov 17 01:13:01 user nova-compute[75226]:     <os_type>hvm</os_type>
Nov 17 01:13:01 user nova-compute[75226]:     <arch name='microblazeel'>
Nov 17 01:13:01 user nova-compute[75226]:       <wordsize>32</wordsize>
Nov 17 01:13:01 user nova-compute[75226]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <domain type='qemu'/>
Nov 17 01:13:01 user nova-compute[75226]:     </arch>
Nov 17 01:13:01 user nova-compute[75226]:     <features>
Nov 17 01:13:01 user nova-compute[75226]:       <cpuselection/>
Nov 17 01:13:01 user nova-compute[75226]:       <deviceboot/>
Nov 17 01:13:01 user nova-compute[75226]:       <disksnapshot default='on' toggle='no'/>
Nov 17 01:13:01 user nova-compute[75226]:     </features>
Nov 17 01:13:01 user nova-compute[75226]:   </guest>
Nov 17 01:13:01 user nova-compute[75226]:   <guest>
Nov 17 01:13:01 user nova-compute[75226]:     <os_type>hvm</os_type>
Nov 17 01:13:01 user nova-compute[75226]:     <arch name='mips'>
Nov 17 01:13:01 user nova-compute[75226]:       <wordsize>32</wordsize>
Nov 17 01:13:01 user nova-compute[75226]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='16'>malta</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='1'>mipssim</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <domain type='qemu'/>
Nov 17 01:13:01 user nova-compute[75226]:     </arch>
Nov 17 01:13:01 user nova-compute[75226]:     <features>
Nov 17 01:13:01 user nova-compute[75226]:       <cpuselection/>
Nov 17 01:13:01 user nova-compute[75226]:       <deviceboot/>
Nov 17 01:13:01 user nova-compute[75226]:       <disksnapshot default='on' toggle='no'/>
Nov 17 01:13:01 user nova-compute[75226]:     </features>
Nov 17 01:13:01 user nova-compute[75226]:   </guest>
Nov 17 01:13:01 user nova-compute[75226]:   <guest>
Nov 17 01:13:01 user nova-compute[75226]:     <os_type>hvm</os_type>
Nov 17 01:13:01 user nova-compute[75226]:     <arch name='mipsel'>
Nov 17 01:13:01 user nova-compute[75226]:       <wordsize>32</wordsize>
Nov 17 01:13:01 user nova-compute[75226]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='16'>malta</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='1'>mipssim</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <domain type='qemu'/>
Nov 17 01:13:01 user nova-compute[75226]:     </arch>
Nov 17 01:13:01 user nova-compute[75226]:     <features>
Nov 17 01:13:01 user nova-compute[75226]:       <cpuselection/>
Nov 17 01:13:01 user nova-compute[75226]:       <deviceboot/>
Nov 17 01:13:01 user nova-compute[75226]:       <disksnapshot default='on' toggle='no'/>
Nov 17 01:13:01 user nova-compute[75226]:     </features>
Nov 17 01:13:01 user nova-compute[75226]:   </guest>
Nov 17 01:13:01 user nova-compute[75226]:   <guest>
Nov 17 01:13:01 user nova-compute[75226]:     <os_type>hvm</os_type>
Nov 17 01:13:01 user nova-compute[75226]:     <arch name='mips64'>
Nov 17 01:13:01 user nova-compute[75226]:       <wordsize>64</wordsize>
Nov 17 01:13:01 user nova-compute[75226]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='16'>malta</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='1'>mipssim</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='1'>pica61</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='1'>magnum</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <domain type='qemu'/>
Nov 17 01:13:01 user nova-compute[75226]:     </arch>
Nov 17 01:13:01 user nova-compute[75226]:     <features>
Nov 17 01:13:01 user nova-compute[75226]:       <cpuselection/>
Nov 17 01:13:01 user nova-compute[75226]:       <deviceboot/>
Nov 17 01:13:01 user nova-compute[75226]:       <disksnapshot default='on' toggle='no'/>
Nov 17 01:13:01 user nova-compute[75226]:     </features>
Nov 17 01:13:01 user nova-compute[75226]:   </guest>
Nov 17 01:13:01 user nova-compute[75226]:   <guest>
Nov 17 01:13:01 user nova-compute[75226]:     <os_type>hvm</os_type>
Nov 17 01:13:01 user nova-compute[75226]:     <arch name='mips64el'>
Nov 17 01:13:01 user nova-compute[75226]:       <wordsize>64</wordsize>
Nov 17 01:13:01 user nova-compute[75226]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='16'>malta</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='16'>loongson3-virt</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='1'>mipssim</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='1'>pica61</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='1'>magnum</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='16'>boston</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='1'>fuloong2e</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <domain type='qemu'/>
Nov 17 01:13:01 user nova-compute[75226]:     </arch>
Nov 17 01:13:01 user nova-compute[75226]:     <features>
Nov 17 01:13:01 user nova-compute[75226]:       <cpuselection/>
Nov 17 01:13:01 user nova-compute[75226]:       <deviceboot/>
Nov 17 01:13:01 user nova-compute[75226]:       <disksnapshot default='on' toggle='no'/>
Nov 17 01:13:01 user nova-compute[75226]:     </features>
Nov 17 01:13:01 user nova-compute[75226]:   </guest>
Nov 17 01:13:01 user nova-compute[75226]:   <guest>
Nov 17 01:13:01 user nova-compute[75226]:     <os_type>hvm</os_type>
Nov 17 01:13:01 user nova-compute[75226]:     <arch name='ppc'>
Nov 17 01:13:01 user nova-compute[75226]:       <wordsize>32</wordsize>
Nov 17 01:13:01 user nova-compute[75226]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='1'>g3beige</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='1'>mac99</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='32'>ppce500</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='1'>pegasos2</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='1'>sam460ex</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='1'>bamboo</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='1'>40p</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='1'>ref405ep</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='1'>taihu</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <domain type='qemu'/>
Nov 17 01:13:01 user nova-compute[75226]:     </arch>
Nov 17 01:13:01 user nova-compute[75226]:     <features>
Nov 17 01:13:01 user nova-compute[75226]:       <cpuselection/>
Nov 17 01:13:01 user nova-compute[75226]:       <deviceboot/>
Nov 17 01:13:01 user nova-compute[75226]:       <disksnapshot default='on' toggle='no'/>
Nov 17 01:13:01 user nova-compute[75226]:     </features>
Nov 17 01:13:01 user nova-compute[75226]:   </guest>
Nov 17 01:13:01 user nova-compute[75226]:   <guest>
Nov 17 01:13:01 user nova-compute[75226]:     <os_type>hvm</os_type>
Nov 17 01:13:01 user nova-compute[75226]:     <arch name='ppc64'>
Nov 17 01:13:01 user nova-compute[75226]:       <wordsize>64</wordsize>
Nov 17 01:13:01 user nova-compute[75226]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='2048'>powernv9</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='1'>taihu</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='2048'>powernv10</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='32'>ppce500</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='1'>40p</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='1'>pegasos2</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='1'>bamboo</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='1'>g3beige</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='1'>mac99</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='1'>sam460ex</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='1'>ref405ep</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='2048'>powernv8</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <domain type='qemu'/>
Nov 17 01:13:01 user nova-compute[75226]:     </arch>
Nov 17 01:13:01 user nova-compute[75226]:     <features>
Nov 17 01:13:01 user nova-compute[75226]:       <cpuselection/>
Nov 17 01:13:01 user nova-compute[75226]:       <deviceboot/>
Nov 17 01:13:01 user nova-compute[75226]:       <disksnapshot default='on' toggle='no'/>
Nov 17 01:13:01 user nova-compute[75226]:     </features>
Nov 17 01:13:01 user nova-compute[75226]:   </guest>
Nov 17 01:13:01 user nova-compute[75226]:   <guest>
Nov 17 01:13:01 user nova-compute[75226]:     <os_type>hvm</os_type>
Nov 17 01:13:01 user nova-compute[75226]:     <arch name='ppc64le'>
Nov 17 01:13:01 user nova-compute[75226]:       <wordsize>64</wordsize>
Nov 17 01:13:01 user nova-compute[75226]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='2048'>powernv9</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='1'>taihu</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='2048'>powernv10</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='32'>ppce500</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='1'>40p</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='1'>pegasos2</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='1'>bamboo</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='1'>g3beige</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='1'>mac99</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='1'>sam460ex</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='1'>ref405ep</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='2048'>powernv8</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <domain type='qemu'/>
Nov 17 01:13:01 user nova-compute[75226]:     </arch>
Nov 17 01:13:01 user nova-compute[75226]:     <features>
Nov 17 01:13:01 user nova-compute[75226]:       <cpuselection/>
Nov 17 01:13:01 user nova-compute[75226]:       <deviceboot/>
Nov 17 01:13:01 user nova-compute[75226]:       <disksnapshot default='on' toggle='no'/>
Nov 17 01:13:01 user nova-compute[75226]:     </features>
Nov 17 01:13:01 user nova-compute[75226]:   </guest>
Nov 17 01:13:01 user nova-compute[75226]:   <guest>
Nov 17 01:13:01 user nova-compute[75226]:     <os_type>hvm</os_type>
Nov 17 01:13:01 user nova-compute[75226]:     <arch name='riscv32'>
Nov 17 01:13:01 user nova-compute[75226]:       <wordsize>32</wordsize>
Nov 17 01:13:01 user nova-compute[75226]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='8'>spike</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='1'>opentitan</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='5'>sifive_u</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='1'>sifive_e</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='8'>virt</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <domain type='qemu'/>
Nov 17 01:13:01 user nova-compute[75226]:     </arch>
Nov 17 01:13:01 user nova-compute[75226]:     <features>
Nov 17 01:13:01 user nova-compute[75226]:       <cpuselection/>
Nov 17 01:13:01 user nova-compute[75226]:       <deviceboot/>
Nov 17 01:13:01 user nova-compute[75226]:       <disksnapshot default='on' toggle='no'/>
Nov 17 01:13:01 user nova-compute[75226]:     </features>
Nov 17 01:13:01 user nova-compute[75226]:   </guest>
Nov 17 01:13:01 user nova-compute[75226]:   <guest>
Nov 17 01:13:01 user nova-compute[75226]:     <os_type>hvm</os_type>
Nov 17 01:13:01 user nova-compute[75226]:     <arch name='riscv64'>
Nov 17 01:13:01 user nova-compute[75226]:       <wordsize>64</wordsize>
Nov 17 01:13:01 user nova-compute[75226]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='8'>spike</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='5'>sifive_u</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='1'>shakti_c</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='1'>sifive_e</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='8'>virt</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <domain type='qemu'/>
Nov 17 01:13:01 user nova-compute[75226]:     </arch>
Nov 17 01:13:01 user nova-compute[75226]:     <features>
Nov 17 01:13:01 user nova-compute[75226]:       <cpuselection/>
Nov 17 01:13:01 user nova-compute[75226]:       <deviceboot/>
Nov 17 01:13:01 user nova-compute[75226]:       <disksnapshot default='on' toggle='no'/>
Nov 17 01:13:01 user nova-compute[75226]:     </features>
Nov 17 01:13:01 user nova-compute[75226]:   </guest>
Nov 17 01:13:01 user nova-compute[75226]:   <guest>
Nov 17 01:13:01 user nova-compute[75226]:     <os_type>hvm</os_type>
Nov 17 01:13:01 user nova-compute[75226]:     <arch name='s390x'>
Nov 17 01:13:01 user nova-compute[75226]:       <wordsize>64</wordsize>
Nov 17 01:13:01 user nova-compute[75226]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <domain type='qemu'/>
Nov 17 01:13:01 user nova-compute[75226]:     </arch>
Nov 17 01:13:01 user nova-compute[75226]:     <features>
Nov 17 01:13:01 user nova-compute[75226]:       <cpuselection/>
Nov 17 01:13:01 user nova-compute[75226]:       <deviceboot/>
Nov 17 01:13:01 user nova-compute[75226]:       <disksnapshot default='on' toggle='no'/>
Nov 17 01:13:01 user nova-compute[75226]:     </features>
Nov 17 01:13:01 user nova-compute[75226]:   </guest>
Nov 17 01:13:01 user nova-compute[75226]:   <guest>
Nov 17 01:13:01 user nova-compute[75226]:     <os_type>hvm</os_type>
Nov 17 01:13:01 user nova-compute[75226]:     <arch name='sh4'>
Nov 17 01:13:01 user nova-compute[75226]:       <wordsize>32</wordsize>
Nov 17 01:13:01 user nova-compute[75226]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='1'>shix</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='1'>r2d</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <domain type='qemu'/>
Nov 17 01:13:01 user nova-compute[75226]:     </arch>
Nov 17 01:13:01 user nova-compute[75226]:     <features>
Nov 17 01:13:01 user nova-compute[75226]:       <cpuselection/>
Nov 17 01:13:01 user nova-compute[75226]:       <deviceboot/>
Nov 17 01:13:01 user nova-compute[75226]:       <disksnapshot default='on' toggle='no'/>
Nov 17 01:13:01 user nova-compute[75226]:     </features>
Nov 17 01:13:01 user nova-compute[75226]:   </guest>
Nov 17 01:13:01 user nova-compute[75226]:   <guest>
Nov 17 01:13:01 user nova-compute[75226]:     <os_type>hvm</os_type>
Nov 17 01:13:01 user nova-compute[75226]:     <arch name='sh4eb'>
Nov 17 01:13:01 user nova-compute[75226]:       <wordsize>64</wordsize>
Nov 17 01:13:01 user nova-compute[75226]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='1'>shix</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='1'>r2d</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <domain type='qemu'/>
Nov 17 01:13:01 user nova-compute[75226]:     </arch>
Nov 17 01:13:01 user nova-compute[75226]:     <features>
Nov 17 01:13:01 user nova-compute[75226]:       <cpuselection/>
Nov 17 01:13:01 user nova-compute[75226]:       <deviceboot/>
Nov 17 01:13:01 user nova-compute[75226]:       <disksnapshot default='on' toggle='no'/>
Nov 17 01:13:01 user nova-compute[75226]:     </features>
Nov 17 01:13:01 user nova-compute[75226]:   </guest>
Nov 17 01:13:01 user nova-compute[75226]:   <guest>
Nov 17 01:13:01 user nova-compute[75226]:     <os_type>hvm</os_type>
Nov 17 01:13:01 user nova-compute[75226]:     <arch name='sparc'>
Nov 17 01:13:01 user nova-compute[75226]:       <wordsize>32</wordsize>
Nov 17 01:13:01 user nova-compute[75226]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='1'>SS-5</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='4'>SS-20</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='1'>LX</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='1'>SPARCClassic</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='1'>leon3_generic</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='1'>SPARCbook</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='1'>SS-4</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='4'>SS-600MP</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='4'>SS-10</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='1'>Voyager</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <domain type='qemu'/>
Nov 17 01:13:01 user nova-compute[75226]:     </arch>
Nov 17 01:13:01 user nova-compute[75226]:     <features>
Nov 17 01:13:01 user nova-compute[75226]:       <cpuselection/>
Nov 17 01:13:01 user nova-compute[75226]:       <deviceboot/>
Nov 17 01:13:01 user nova-compute[75226]:       <disksnapshot default='on' toggle='no'/>
Nov 17 01:13:01 user nova-compute[75226]:     </features>
Nov 17 01:13:01 user nova-compute[75226]:   </guest>
Nov 17 01:13:01 user nova-compute[75226]:   <guest>
Nov 17 01:13:01 user nova-compute[75226]:     <os_type>hvm</os_type>
Nov 17 01:13:01 user nova-compute[75226]:     <arch name='sparc64'>
Nov 17 01:13:01 user nova-compute[75226]:       <wordsize>64</wordsize>
Nov 17 01:13:01 user nova-compute[75226]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='1'>sun4u</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='1'>niagara</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='1'>sun4v</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <domain type='qemu'/>
Nov 17 01:13:01 user nova-compute[75226]:     </arch>
Nov 17 01:13:01 user nova-compute[75226]:     <features>
Nov 17 01:13:01 user nova-compute[75226]:       <cpuselection/>
Nov 17 01:13:01 user nova-compute[75226]:       <deviceboot/>
Nov 17 01:13:01 user nova-compute[75226]:       <disksnapshot default='on' toggle='no'/>
Nov 17 01:13:01 user nova-compute[75226]:     </features>
Nov 17 01:13:01 user nova-compute[75226]:   </guest>
Nov 17 01:13:01 user nova-compute[75226]:   <guest>
Nov 17 01:13:01 user nova-compute[75226]:     <os_type>hvm</os_type>
Nov 17 01:13:01 user nova-compute[75226]:     <arch name='x86_64'>
Nov 17 01:13:01 user nova-compute[75226]:       <wordsize>64</wordsize>
Nov 17 01:13:01 user nova-compute[75226]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='1'>x-remote</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='1'>isapc</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='288'>microvm</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <domain type='qemu'/>
Nov 17 01:13:01 user nova-compute[75226]:       <domain type='kvm'/>
Nov 17 01:13:01 user nova-compute[75226]:     </arch>
Nov 17 01:13:01 user nova-compute[75226]:     <features>
Nov 17 01:13:01 user nova-compute[75226]:       <acpi default='on' toggle='yes'/>
Nov 17 01:13:01 user nova-compute[75226]:       <apic default='on' toggle='no'/>
Nov 17 01:13:01 user nova-compute[75226]:       <cpuselection/>
Nov 17 01:13:01 user nova-compute[75226]:       <deviceboot/>
Nov 17 01:13:01 user nova-compute[75226]:       <disksnapshot default='on' toggle='no'/>
Nov 17 01:13:01 user nova-compute[75226]:     </features>
Nov 17 01:13:01 user nova-compute[75226]:   </guest>
Nov 17 01:13:01 user nova-compute[75226]:   <guest>
Nov 17 01:13:01 user nova-compute[75226]:     <os_type>hvm</os_type>
Nov 17 01:13:01 user nova-compute[75226]:     <arch name='xtensa'>
Nov 17 01:13:01 user nova-compute[75226]:       <wordsize>32</wordsize>
Nov 17 01:13:01 user nova-compute[75226]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='4'>sim</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='32'>kc705</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='32'>ml605</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='32'>virt</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='32'>lx200</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='32'>lx60</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <domain type='qemu'/>
Nov 17 01:13:01 user nova-compute[75226]:     </arch>
Nov 17 01:13:01 user nova-compute[75226]:     <features>
Nov 17 01:13:01 user nova-compute[75226]:       <cpuselection/>
Nov 17 01:13:01 user nova-compute[75226]:       <deviceboot/>
Nov 17 01:13:01 user nova-compute[75226]:       <disksnapshot default='on' toggle='no'/>
Nov 17 01:13:01 user nova-compute[75226]:     </features>
Nov 17 01:13:01 user nova-compute[75226]:   </guest>
Nov 17 01:13:01 user nova-compute[75226]:   <guest>
Nov 17 01:13:01 user nova-compute[75226]:     <os_type>hvm</os_type>
Nov 17 01:13:01 user nova-compute[75226]:     <arch name='xtensaeb'>
Nov 17 01:13:01 user nova-compute[75226]:       <wordsize>32</wordsize>
Nov 17 01:13:01 user nova-compute[75226]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='4'>sim</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='32'>kc705</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='32'>ml605</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='32'>virt</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='32'>lx200</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='32'>lx60</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 17 01:13:01 user nova-compute[75226]:       <domain type='qemu'/>
Nov 17 01:13:01 user nova-compute[75226]:     </arch>
Nov 17 01:13:01 user nova-compute[75226]:     <features>
Nov 17 01:13:01 user nova-compute[75226]:       <cpuselection/>
Nov 17 01:13:01 user nova-compute[75226]:       <deviceboot/>
Nov 17 01:13:01 user nova-compute[75226]:       <disksnapshot default='on' toggle='no'/>
Nov 17 01:13:01 user nova-compute[75226]:     </features>
Nov 17 01:13:01 user nova-compute[75226]:   </guest>
Nov 17 01:13:01 user nova-compute[75226]: </capabilities>
Nov 17 01:13:01 user nova-compute[75226]: 
Nov 17 01:13:01 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-5439cf8a-5bb2-447e-9351-06058b1fe5ef None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=75226) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 17 01:13:01 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-5439cf8a-5bb2-447e-9351-06058b1fe5ef None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=75226) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 17 01:13:01 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-5439cf8a-5bb2-447e-9351-06058b1fe5ef None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=75226) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 17 01:13:01 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-5439cf8a-5bb2-447e-9351-06058b1fe5ef None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75226) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 17 01:13:01 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-5439cf8a-5bb2-447e-9351-06058b1fe5ef None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75226) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 17 01:13:01 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-5439cf8a-5bb2-447e-9351-06058b1fe5ef None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=75226) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 17 01:13:01 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-5439cf8a-5bb2-447e-9351-06058b1fe5ef None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75226) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 17 01:13:01 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-5439cf8a-5bb2-447e-9351-06058b1fe5ef None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=75226) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 17 01:13:01 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-5439cf8a-5bb2-447e-9351-06058b1fe5ef None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=75226) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 17 01:13:01 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-5439cf8a-5bb2-447e-9351-06058b1fe5ef None None] Getting domain capabilities for cris via machine types: {None} {{(pid=75226) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 17 01:13:01 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-5439cf8a-5bb2-447e-9351-06058b1fe5ef None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=75226) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 17 01:13:01 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-5439cf8a-5bb2-447e-9351-06058b1fe5ef None None] Getting domain capabilities for i686 via machine types: {'pc', 'ubuntu', 'q35', 'ubuntu-q35'} {{(pid=75226) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 17 01:13:01 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-5439cf8a-5bb2-447e-9351-06058b1fe5ef None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Nov 17 01:13:01 user nova-compute[75226]: <domainCapabilities>
Nov 17 01:13:01 user nova-compute[75226]:   <path>/usr/bin/qemu-system-i386</path>
Nov 17 01:13:01 user nova-compute[75226]:   <domain>kvm</domain>
Nov 17 01:13:01 user nova-compute[75226]:   <machine>pc-i440fx-6.2</machine>
Nov 17 01:13:01 user nova-compute[75226]:   <arch>i686</arch>
Nov 17 01:13:01 user nova-compute[75226]:   <vcpu max='255'/>
Nov 17 01:13:01 user nova-compute[75226]:   <iothreads supported='yes'/>
Nov 17 01:13:01 user nova-compute[75226]:   <os supported='yes'>
Nov 17 01:13:01 user nova-compute[75226]:     <enum name='firmware'/>
Nov 17 01:13:01 user nova-compute[75226]:     <loader supported='yes'>
Nov 17 01:13:01 user nova-compute[75226]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 17 01:13:01 user nova-compute[75226]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 17 01:13:01 user nova-compute[75226]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 17 01:13:01 user nova-compute[75226]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 17 01:13:01 user nova-compute[75226]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='type'>
Nov 17 01:13:01 user nova-compute[75226]:         <value>rom</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>pflash</value>
Nov 17 01:13:01 user nova-compute[75226]:       </enum>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='readonly'>
Nov 17 01:13:01 user nova-compute[75226]:         <value>yes</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>no</value>
Nov 17 01:13:01 user nova-compute[75226]:       </enum>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='secure'>
Nov 17 01:13:01 user nova-compute[75226]:         <value>no</value>
Nov 17 01:13:01 user nova-compute[75226]:       </enum>
Nov 17 01:13:01 user nova-compute[75226]:     </loader>
Nov 17 01:13:01 user nova-compute[75226]:   </os>
Nov 17 01:13:01 user nova-compute[75226]:   <cpu>
Nov 17 01:13:01 user nova-compute[75226]:     <mode name='host-passthrough' supported='yes'>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='hostPassthroughMigratable'>
Nov 17 01:13:01 user nova-compute[75226]:         <value>off</value>
Nov 17 01:13:01 user nova-compute[75226]:       </enum>
Nov 17 01:13:01 user nova-compute[75226]:     </mode>
Nov 17 01:13:01 user nova-compute[75226]:     <mode name='maximum' supported='yes'>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='maximumMigratable'>
Nov 17 01:13:01 user nova-compute[75226]:         <value>on</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>off</value>
Nov 17 01:13:01 user nova-compute[75226]:       </enum>
Nov 17 01:13:01 user nova-compute[75226]:     </mode>
Nov 17 01:13:01 user nova-compute[75226]:     <mode name='host-model' supported='yes'>
Nov 17 01:13:01 user nova-compute[75226]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 17 01:13:01 user nova-compute[75226]:       <vendor>Intel</vendor>
Nov 17 01:13:01 user nova-compute[75226]:       <feature policy='require' name='ss'/>
Nov 17 01:13:01 user nova-compute[75226]:       <feature policy='require' name='vmx'/>
Nov 17 01:13:01 user nova-compute[75226]:       <feature policy='require' name='pcid'/>
Nov 17 01:13:01 user nova-compute[75226]:       <feature policy='require' name='hypervisor'/>
Nov 17 01:13:01 user nova-compute[75226]:       <feature policy='require' name='arat'/>
Nov 17 01:13:01 user nova-compute[75226]:       <feature policy='require' name='tsc_adjust'/>
Nov 17 01:13:01 user nova-compute[75226]:       <feature policy='require' name='umip'/>
Nov 17 01:13:01 user nova-compute[75226]:       <feature policy='require' name='md-clear'/>
Nov 17 01:13:01 user nova-compute[75226]:       <feature policy='require' name='stibp'/>
Nov 17 01:13:01 user nova-compute[75226]:       <feature policy='require' name='arch-capabilities'/>
Nov 17 01:13:01 user nova-compute[75226]:       <feature policy='require' name='ssbd'/>
Nov 17 01:13:01 user nova-compute[75226]:       <feature policy='require' name='ibpb'/>
Nov 17 01:13:01 user nova-compute[75226]:       <feature policy='require' name='ibrs'/>
Nov 17 01:13:01 user nova-compute[75226]:       <feature policy='require' name='amd-stibp'/>
Nov 17 01:13:01 user nova-compute[75226]:       <feature policy='require' name='amd-ssbd'/>
Nov 17 01:13:01 user nova-compute[75226]:       <feature policy='disable' name='erms'/>
Nov 17 01:13:01 user nova-compute[75226]:       <feature policy='disable' name='xsaveopt'/>
Nov 17 01:13:01 user nova-compute[75226]:       <feature policy='disable' name='lm'/>
Nov 17 01:13:01 user nova-compute[75226]:     </mode>
Nov 17 01:13:01 user nova-compute[75226]:     <mode name='custom' supported='yes'>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>qemu64</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='yes'>qemu32</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>phenom</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='yes'>pentium3</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='yes'>pentium2</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='yes'>pentium</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>n270</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>kvm64</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='yes'>kvm32</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='yes'>coreduo</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>core2duo</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>athlon</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Westmere-IBRS</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Westmere</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Snowridge</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Skylake-Server</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Skylake-Client</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>SandyBridge</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Penryn</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Opteron_G5</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Opteron_G4</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Opteron_G3</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Opteron_G2</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Opteron_G1</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Nehalem-IBRS</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Nehalem</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>IvyBridge</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Icelake-Server</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Haswell-noTSX</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Haswell-IBRS</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Haswell</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>EPYC-Rome</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>EPYC-Milan</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>EPYC-IBPB</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>EPYC</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Dhyana</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Cooperlake</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Conroe</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Cascadelake-Server</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Broadwell-noTSX</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Broadwell-IBRS</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Broadwell</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='yes'>486</model>
Nov 17 01:13:01 user nova-compute[75226]:     </mode>
Nov 17 01:13:01 user nova-compute[75226]:   </cpu>
Nov 17 01:13:01 user nova-compute[75226]:   <memoryBacking supported='yes'>
Nov 17 01:13:01 user nova-compute[75226]:     <enum name='sourceType'>
Nov 17 01:13:01 user nova-compute[75226]:       <value>file</value>
Nov 17 01:13:01 user nova-compute[75226]:       <value>anonymous</value>
Nov 17 01:13:01 user nova-compute[75226]:       <value>memfd</value>
Nov 17 01:13:01 user nova-compute[75226]:     </enum>
Nov 17 01:13:01 user nova-compute[75226]:   </memoryBacking>
Nov 17 01:13:01 user nova-compute[75226]:   <devices>
Nov 17 01:13:01 user nova-compute[75226]:     <disk supported='yes'>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='diskDevice'>
Nov 17 01:13:01 user nova-compute[75226]:         <value>disk</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>cdrom</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>floppy</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>lun</value>
Nov 17 01:13:01 user nova-compute[75226]:       </enum>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='bus'>
Nov 17 01:13:01 user nova-compute[75226]:         <value>ide</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>fdc</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>scsi</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>virtio</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>usb</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>sata</value>
Nov 17 01:13:01 user nova-compute[75226]:       </enum>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='model'>
Nov 17 01:13:01 user nova-compute[75226]:         <value>virtio</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>virtio-transitional</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>virtio-non-transitional</value>
Nov 17 01:13:01 user nova-compute[75226]:       </enum>
Nov 17 01:13:01 user nova-compute[75226]:     </disk>
Nov 17 01:13:01 user nova-compute[75226]:     <graphics supported='yes'>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='type'>
Nov 17 01:13:01 user nova-compute[75226]:         <value>sdl</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>vnc</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>spice</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>egl-headless</value>
Nov 17 01:13:01 user nova-compute[75226]:       </enum>
Nov 17 01:13:01 user nova-compute[75226]:     </graphics>
Nov 17 01:13:01 user nova-compute[75226]:     <video supported='yes'>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='modelType'>
Nov 17 01:13:01 user nova-compute[75226]:         <value>vga</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>cirrus</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>vmvga</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>qxl</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>virtio</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>none</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>bochs</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>ramfb</value>
Nov 17 01:13:01 user nova-compute[75226]:       </enum>
Nov 17 01:13:01 user nova-compute[75226]:     </video>
Nov 17 01:13:01 user nova-compute[75226]:     <hostdev supported='yes'>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='mode'>
Nov 17 01:13:01 user nova-compute[75226]:         <value>subsystem</value>
Nov 17 01:13:01 user nova-compute[75226]:       </enum>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='startupPolicy'>
Nov 17 01:13:01 user nova-compute[75226]:         <value>default</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>mandatory</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>requisite</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>optional</value>
Nov 17 01:13:01 user nova-compute[75226]:       </enum>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='subsysType'>
Nov 17 01:13:01 user nova-compute[75226]:         <value>usb</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>pci</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>scsi</value>
Nov 17 01:13:01 user nova-compute[75226]:       </enum>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='capsType'/>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='pciBackend'/>
Nov 17 01:13:01 user nova-compute[75226]:     </hostdev>
Nov 17 01:13:01 user nova-compute[75226]:     <rng supported='yes'>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='model'>
Nov 17 01:13:01 user nova-compute[75226]:         <value>virtio</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>virtio-transitional</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>virtio-non-transitional</value>
Nov 17 01:13:01 user nova-compute[75226]:       </enum>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='backendModel'>
Nov 17 01:13:01 user nova-compute[75226]:         <value>random</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>egd</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>builtin</value>
Nov 17 01:13:01 user nova-compute[75226]:       </enum>
Nov 17 01:13:01 user nova-compute[75226]:     </rng>
Nov 17 01:13:01 user nova-compute[75226]:     <filesystem supported='yes'>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='driverType'>
Nov 17 01:13:01 user nova-compute[75226]:         <value>path</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>handle</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>virtiofs</value>
Nov 17 01:13:01 user nova-compute[75226]:       </enum>
Nov 17 01:13:01 user nova-compute[75226]:     </filesystem>
Nov 17 01:13:01 user nova-compute[75226]:     <tpm supported='yes'>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='model'>
Nov 17 01:13:01 user nova-compute[75226]:         <value>tpm-tis</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>tpm-crb</value>
Nov 17 01:13:01 user nova-compute[75226]:       </enum>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='backendModel'>
Nov 17 01:13:01 user nova-compute[75226]:         <value>passthrough</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>emulator</value>
Nov 17 01:13:01 user nova-compute[75226]:       </enum>
Nov 17 01:13:01 user nova-compute[75226]:     </tpm>
Nov 17 01:13:01 user nova-compute[75226]:   </devices>
Nov 17 01:13:01 user nova-compute[75226]:   <features>
Nov 17 01:13:01 user nova-compute[75226]:     <gic supported='no'/>
Nov 17 01:13:01 user nova-compute[75226]:     <vmcoreinfo supported='yes'/>
Nov 17 01:13:01 user nova-compute[75226]:     <genid supported='yes'/>
Nov 17 01:13:01 user nova-compute[75226]:     <backingStoreInput supported='yes'/>
Nov 17 01:13:01 user nova-compute[75226]:     <backup supported='yes'/>
Nov 17 01:13:01 user nova-compute[75226]:     <sev supported='no'/>
Nov 17 01:13:01 user nova-compute[75226]:   </features>
Nov 17 01:13:01 user nova-compute[75226]: </domainCapabilities>
Nov 17 01:13:01 user nova-compute[75226]:  {{(pid=75226) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 17 01:13:01 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-5439cf8a-5bb2-447e-9351-06058b1fe5ef None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Nov 17 01:13:01 user nova-compute[75226]: <domainCapabilities>
Nov 17 01:13:01 user nova-compute[75226]:   <path>/usr/bin/qemu-system-i386</path>
Nov 17 01:13:01 user nova-compute[75226]:   <domain>kvm</domain>
Nov 17 01:13:01 user nova-compute[75226]:   <machine>pc-i440fx-jammy</machine>
Nov 17 01:13:01 user nova-compute[75226]:   <arch>i686</arch>
Nov 17 01:13:01 user nova-compute[75226]:   <vcpu max='255'/>
Nov 17 01:13:01 user nova-compute[75226]:   <iothreads supported='yes'/>
Nov 17 01:13:01 user nova-compute[75226]:   <os supported='yes'>
Nov 17 01:13:01 user nova-compute[75226]:     <enum name='firmware'/>
Nov 17 01:13:01 user nova-compute[75226]:     <loader supported='yes'>
Nov 17 01:13:01 user nova-compute[75226]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 17 01:13:01 user nova-compute[75226]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 17 01:13:01 user nova-compute[75226]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 17 01:13:01 user nova-compute[75226]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 17 01:13:01 user nova-compute[75226]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='type'>
Nov 17 01:13:01 user nova-compute[75226]:         <value>rom</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>pflash</value>
Nov 17 01:13:01 user nova-compute[75226]:       </enum>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='readonly'>
Nov 17 01:13:01 user nova-compute[75226]:         <value>yes</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>no</value>
Nov 17 01:13:01 user nova-compute[75226]:       </enum>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='secure'>
Nov 17 01:13:01 user nova-compute[75226]:         <value>no</value>
Nov 17 01:13:01 user nova-compute[75226]:       </enum>
Nov 17 01:13:01 user nova-compute[75226]:     </loader>
Nov 17 01:13:01 user nova-compute[75226]:   </os>
Nov 17 01:13:01 user nova-compute[75226]:   <cpu>
Nov 17 01:13:01 user nova-compute[75226]:     <mode name='host-passthrough' supported='yes'>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='hostPassthroughMigratable'>
Nov 17 01:13:01 user nova-compute[75226]:         <value>off</value>
Nov 17 01:13:01 user nova-compute[75226]:       </enum>
Nov 17 01:13:01 user nova-compute[75226]:     </mode>
Nov 17 01:13:01 user nova-compute[75226]:     <mode name='maximum' supported='yes'>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='maximumMigratable'>
Nov 17 01:13:01 user nova-compute[75226]:         <value>on</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>off</value>
Nov 17 01:13:01 user nova-compute[75226]:       </enum>
Nov 17 01:13:01 user nova-compute[75226]:     </mode>
Nov 17 01:13:01 user nova-compute[75226]:     <mode name='host-model' supported='yes'>
Nov 17 01:13:01 user nova-compute[75226]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 17 01:13:01 user nova-compute[75226]:       <vendor>Intel</vendor>
Nov 17 01:13:01 user nova-compute[75226]:       <feature policy='require' name='ss'/>
Nov 17 01:13:01 user nova-compute[75226]:       <feature policy='require' name='vmx'/>
Nov 17 01:13:01 user nova-compute[75226]:       <feature policy='require' name='pcid'/>
Nov 17 01:13:01 user nova-compute[75226]:       <feature policy='require' name='hypervisor'/>
Nov 17 01:13:01 user nova-compute[75226]:       <feature policy='require' name='arat'/>
Nov 17 01:13:01 user nova-compute[75226]:       <feature policy='require' name='tsc_adjust'/>
Nov 17 01:13:01 user nova-compute[75226]:       <feature policy='require' name='umip'/>
Nov 17 01:13:01 user nova-compute[75226]:       <feature policy='require' name='md-clear'/>
Nov 17 01:13:01 user nova-compute[75226]:       <feature policy='require' name='stibp'/>
Nov 17 01:13:01 user nova-compute[75226]:       <feature policy='require' name='arch-capabilities'/>
Nov 17 01:13:01 user nova-compute[75226]:       <feature policy='require' name='ssbd'/>
Nov 17 01:13:01 user nova-compute[75226]:       <feature policy='require' name='ibpb'/>
Nov 17 01:13:01 user nova-compute[75226]:       <feature policy='require' name='ibrs'/>
Nov 17 01:13:01 user nova-compute[75226]:       <feature policy='require' name='amd-stibp'/>
Nov 17 01:13:01 user nova-compute[75226]:       <feature policy='require' name='amd-ssbd'/>
Nov 17 01:13:01 user nova-compute[75226]:       <feature policy='disable' name='erms'/>
Nov 17 01:13:01 user nova-compute[75226]:       <feature policy='disable' name='xsaveopt'/>
Nov 17 01:13:01 user nova-compute[75226]:       <feature policy='disable' name='lm'/>
Nov 17 01:13:01 user nova-compute[75226]:     </mode>
Nov 17 01:13:01 user nova-compute[75226]:     <mode name='custom' supported='yes'>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>qemu64</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='yes'>qemu32</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>phenom</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='yes'>pentium3</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='yes'>pentium2</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='yes'>pentium</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>n270</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>kvm64</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='yes'>kvm32</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='yes'>coreduo</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>core2duo</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>athlon</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Westmere-IBRS</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Westmere</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Snowridge</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Skylake-Server</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Skylake-Client</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>SandyBridge</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Penryn</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Opteron_G5</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Opteron_G4</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Opteron_G3</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Opteron_G2</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Opteron_G1</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Nehalem-IBRS</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Nehalem</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>IvyBridge</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Icelake-Server</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Haswell-noTSX</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Haswell-IBRS</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Haswell</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>EPYC-Rome</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>EPYC-Milan</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>EPYC-IBPB</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>EPYC</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Dhyana</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Cooperlake</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Conroe</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Cascadelake-Server</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Broadwell-noTSX</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Broadwell-IBRS</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Broadwell</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='yes'>486</model>
Nov 17 01:13:01 user nova-compute[75226]:     </mode>
Nov 17 01:13:01 user nova-compute[75226]:   </cpu>
Nov 17 01:13:01 user nova-compute[75226]:   <memoryBacking supported='yes'>
Nov 17 01:13:01 user nova-compute[75226]:     <enum name='sourceType'>
Nov 17 01:13:01 user nova-compute[75226]:       <value>file</value>
Nov 17 01:13:01 user nova-compute[75226]:       <value>anonymous</value>
Nov 17 01:13:01 user nova-compute[75226]:       <value>memfd</value>
Nov 17 01:13:01 user nova-compute[75226]:     </enum>
Nov 17 01:13:01 user nova-compute[75226]:   </memoryBacking>
Nov 17 01:13:01 user nova-compute[75226]:   <devices>
Nov 17 01:13:01 user nova-compute[75226]:     <disk supported='yes'>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='diskDevice'>
Nov 17 01:13:01 user nova-compute[75226]:         <value>disk</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>cdrom</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>floppy</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>lun</value>
Nov 17 01:13:01 user nova-compute[75226]:       </enum>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='bus'>
Nov 17 01:13:01 user nova-compute[75226]:         <value>ide</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>fdc</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>scsi</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>virtio</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>usb</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>sata</value>
Nov 17 01:13:01 user nova-compute[75226]:       </enum>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='model'>
Nov 17 01:13:01 user nova-compute[75226]:         <value>virtio</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>virtio-transitional</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>virtio-non-transitional</value>
Nov 17 01:13:01 user nova-compute[75226]:       </enum>
Nov 17 01:13:01 user nova-compute[75226]:     </disk>
Nov 17 01:13:01 user nova-compute[75226]:     <graphics supported='yes'>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='type'>
Nov 17 01:13:01 user nova-compute[75226]:         <value>sdl</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>vnc</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>spice</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>egl-headless</value>
Nov 17 01:13:01 user nova-compute[75226]:       </enum>
Nov 17 01:13:01 user nova-compute[75226]:     </graphics>
Nov 17 01:13:01 user nova-compute[75226]:     <video supported='yes'>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='modelType'>
Nov 17 01:13:01 user nova-compute[75226]:         <value>vga</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>cirrus</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>vmvga</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>qxl</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>virtio</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>none</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>bochs</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>ramfb</value>
Nov 17 01:13:01 user nova-compute[75226]:       </enum>
Nov 17 01:13:01 user nova-compute[75226]:     </video>
Nov 17 01:13:01 user nova-compute[75226]:     <hostdev supported='yes'>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='mode'>
Nov 17 01:13:01 user nova-compute[75226]:         <value>subsystem</value>
Nov 17 01:13:01 user nova-compute[75226]:       </enum>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='startupPolicy'>
Nov 17 01:13:01 user nova-compute[75226]:         <value>default</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>mandatory</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>requisite</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>optional</value>
Nov 17 01:13:01 user nova-compute[75226]:       </enum>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='subsysType'>
Nov 17 01:13:01 user nova-compute[75226]:         <value>usb</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>pci</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>scsi</value>
Nov 17 01:13:01 user nova-compute[75226]:       </enum>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='capsType'/>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='pciBackend'/>
Nov 17 01:13:01 user nova-compute[75226]:     </hostdev>
Nov 17 01:13:01 user nova-compute[75226]:     <rng supported='yes'>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='model'>
Nov 17 01:13:01 user nova-compute[75226]:         <value>virtio</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>virtio-transitional</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>virtio-non-transitional</value>
Nov 17 01:13:01 user nova-compute[75226]:       </enum>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='backendModel'>
Nov 17 01:13:01 user nova-compute[75226]:         <value>random</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>egd</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>builtin</value>
Nov 17 01:13:01 user nova-compute[75226]:       </enum>
Nov 17 01:13:01 user nova-compute[75226]:     </rng>
Nov 17 01:13:01 user nova-compute[75226]:     <filesystem supported='yes'>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='driverType'>
Nov 17 01:13:01 user nova-compute[75226]:         <value>path</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>handle</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>virtiofs</value>
Nov 17 01:13:01 user nova-compute[75226]:       </enum>
Nov 17 01:13:01 user nova-compute[75226]:     </filesystem>
Nov 17 01:13:01 user nova-compute[75226]:     <tpm supported='yes'>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='model'>
Nov 17 01:13:01 user nova-compute[75226]:         <value>tpm-tis</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>tpm-crb</value>
Nov 17 01:13:01 user nova-compute[75226]:       </enum>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='backendModel'>
Nov 17 01:13:01 user nova-compute[75226]:         <value>passthrough</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>emulator</value>
Nov 17 01:13:01 user nova-compute[75226]:       </enum>
Nov 17 01:13:01 user nova-compute[75226]:     </tpm>
Nov 17 01:13:01 user nova-compute[75226]:   </devices>
Nov 17 01:13:01 user nova-compute[75226]:   <features>
Nov 17 01:13:01 user nova-compute[75226]:     <gic supported='no'/>
Nov 17 01:13:01 user nova-compute[75226]:     <vmcoreinfo supported='yes'/>
Nov 17 01:13:01 user nova-compute[75226]:     <genid supported='yes'/>
Nov 17 01:13:01 user nova-compute[75226]:     <backingStoreInput supported='yes'/>
Nov 17 01:13:01 user nova-compute[75226]:     <backup supported='yes'/>
Nov 17 01:13:01 user nova-compute[75226]:     <sev supported='no'/>
Nov 17 01:13:01 user nova-compute[75226]:   </features>
Nov 17 01:13:01 user nova-compute[75226]: </domainCapabilities>
Nov 17 01:13:01 user nova-compute[75226]:  {{(pid=75226) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 17 01:13:01 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-5439cf8a-5bb2-447e-9351-06058b1fe5ef None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Nov 17 01:13:01 user nova-compute[75226]: <domainCapabilities>
Nov 17 01:13:01 user nova-compute[75226]:   <path>/usr/bin/qemu-system-i386</path>
Nov 17 01:13:01 user nova-compute[75226]:   <domain>kvm</domain>
Nov 17 01:13:01 user nova-compute[75226]:   <machine>pc-q35-6.2</machine>
Nov 17 01:13:01 user nova-compute[75226]:   <arch>i686</arch>
Nov 17 01:13:01 user nova-compute[75226]:   <vcpu max='288'/>
Nov 17 01:13:01 user nova-compute[75226]:   <iothreads supported='yes'/>
Nov 17 01:13:01 user nova-compute[75226]:   <os supported='yes'>
Nov 17 01:13:01 user nova-compute[75226]:     <enum name='firmware'/>
Nov 17 01:13:01 user nova-compute[75226]:     <loader supported='yes'>
Nov 17 01:13:01 user nova-compute[75226]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 17 01:13:01 user nova-compute[75226]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 17 01:13:01 user nova-compute[75226]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 17 01:13:01 user nova-compute[75226]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 17 01:13:01 user nova-compute[75226]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='type'>
Nov 17 01:13:01 user nova-compute[75226]:         <value>rom</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>pflash</value>
Nov 17 01:13:01 user nova-compute[75226]:       </enum>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='readonly'>
Nov 17 01:13:01 user nova-compute[75226]:         <value>yes</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>no</value>
Nov 17 01:13:01 user nova-compute[75226]:       </enum>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='secure'>
Nov 17 01:13:01 user nova-compute[75226]:         <value>no</value>
Nov 17 01:13:01 user nova-compute[75226]:       </enum>
Nov 17 01:13:01 user nova-compute[75226]:     </loader>
Nov 17 01:13:01 user nova-compute[75226]:   </os>
Nov 17 01:13:01 user nova-compute[75226]:   <cpu>
Nov 17 01:13:01 user nova-compute[75226]:     <mode name='host-passthrough' supported='yes'>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='hostPassthroughMigratable'>
Nov 17 01:13:01 user nova-compute[75226]:         <value>off</value>
Nov 17 01:13:01 user nova-compute[75226]:       </enum>
Nov 17 01:13:01 user nova-compute[75226]:     </mode>
Nov 17 01:13:01 user nova-compute[75226]:     <mode name='maximum' supported='yes'>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='maximumMigratable'>
Nov 17 01:13:01 user nova-compute[75226]:         <value>on</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>off</value>
Nov 17 01:13:01 user nova-compute[75226]:       </enum>
Nov 17 01:13:01 user nova-compute[75226]:     </mode>
Nov 17 01:13:01 user nova-compute[75226]:     <mode name='host-model' supported='yes'>
Nov 17 01:13:01 user nova-compute[75226]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 17 01:13:01 user nova-compute[75226]:       <vendor>Intel</vendor>
Nov 17 01:13:01 user nova-compute[75226]:       <feature policy='require' name='ss'/>
Nov 17 01:13:01 user nova-compute[75226]:       <feature policy='require' name='vmx'/>
Nov 17 01:13:01 user nova-compute[75226]:       <feature policy='require' name='pcid'/>
Nov 17 01:13:01 user nova-compute[75226]:       <feature policy='require' name='hypervisor'/>
Nov 17 01:13:01 user nova-compute[75226]:       <feature policy='require' name='arat'/>
Nov 17 01:13:01 user nova-compute[75226]:       <feature policy='require' name='tsc_adjust'/>
Nov 17 01:13:01 user nova-compute[75226]:       <feature policy='require' name='umip'/>
Nov 17 01:13:01 user nova-compute[75226]:       <feature policy='require' name='md-clear'/>
Nov 17 01:13:01 user nova-compute[75226]:       <feature policy='require' name='stibp'/>
Nov 17 01:13:01 user nova-compute[75226]:       <feature policy='require' name='arch-capabilities'/>
Nov 17 01:13:01 user nova-compute[75226]:       <feature policy='require' name='ssbd'/>
Nov 17 01:13:01 user nova-compute[75226]:       <feature policy='require' name='ibpb'/>
Nov 17 01:13:01 user nova-compute[75226]:       <feature policy='require' name='ibrs'/>
Nov 17 01:13:01 user nova-compute[75226]:       <feature policy='require' name='amd-stibp'/>
Nov 17 01:13:01 user nova-compute[75226]:       <feature policy='require' name='amd-ssbd'/>
Nov 17 01:13:01 user nova-compute[75226]:       <feature policy='disable' name='erms'/>
Nov 17 01:13:01 user nova-compute[75226]:       <feature policy='disable' name='xsaveopt'/>
Nov 17 01:13:01 user nova-compute[75226]:       <feature policy='disable' name='lm'/>
Nov 17 01:13:01 user nova-compute[75226]:     </mode>
Nov 17 01:13:01 user nova-compute[75226]:     <mode name='custom' supported='yes'>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>qemu64</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='yes'>qemu32</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>phenom</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='yes'>pentium3</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='yes'>pentium2</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='yes'>pentium</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>n270</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>kvm64</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='yes'>kvm32</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='yes'>coreduo</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>core2duo</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>athlon</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Westmere-IBRS</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Westmere</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Snowridge</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Skylake-Server</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Skylake-Client</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>SandyBridge</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Penryn</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Opteron_G5</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Opteron_G4</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Opteron_G3</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Opteron_G2</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Opteron_G1</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Nehalem-IBRS</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Nehalem</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>IvyBridge</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Icelake-Server</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Haswell-noTSX</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Haswell-IBRS</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Haswell</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>EPYC-Rome</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>EPYC-Milan</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>EPYC-IBPB</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>EPYC</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Dhyana</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Cooperlake</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Conroe</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Cascadelake-Server</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Broadwell-noTSX</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Broadwell-IBRS</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Broadwell</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='yes'>486</model>
Nov 17 01:13:01 user nova-compute[75226]:     </mode>
Nov 17 01:13:01 user nova-compute[75226]:   </cpu>
Nov 17 01:13:01 user nova-compute[75226]:   <memoryBacking supported='yes'>
Nov 17 01:13:01 user nova-compute[75226]:     <enum name='sourceType'>
Nov 17 01:13:01 user nova-compute[75226]:       <value>file</value>
Nov 17 01:13:01 user nova-compute[75226]:       <value>anonymous</value>
Nov 17 01:13:01 user nova-compute[75226]:       <value>memfd</value>
Nov 17 01:13:01 user nova-compute[75226]:     </enum>
Nov 17 01:13:01 user nova-compute[75226]:   </memoryBacking>
Nov 17 01:13:01 user nova-compute[75226]:   <devices>
Nov 17 01:13:01 user nova-compute[75226]:     <disk supported='yes'>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='diskDevice'>
Nov 17 01:13:01 user nova-compute[75226]:         <value>disk</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>cdrom</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>floppy</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>lun</value>
Nov 17 01:13:01 user nova-compute[75226]:       </enum>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='bus'>
Nov 17 01:13:01 user nova-compute[75226]:         <value>fdc</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>scsi</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>virtio</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>usb</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>sata</value>
Nov 17 01:13:01 user nova-compute[75226]:       </enum>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='model'>
Nov 17 01:13:01 user nova-compute[75226]:         <value>virtio</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>virtio-transitional</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>virtio-non-transitional</value>
Nov 17 01:13:01 user nova-compute[75226]:       </enum>
Nov 17 01:13:01 user nova-compute[75226]:     </disk>
Nov 17 01:13:01 user nova-compute[75226]:     <graphics supported='yes'>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='type'>
Nov 17 01:13:01 user nova-compute[75226]:         <value>sdl</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>vnc</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>spice</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>egl-headless</value>
Nov 17 01:13:01 user nova-compute[75226]:       </enum>
Nov 17 01:13:01 user nova-compute[75226]:     </graphics>
Nov 17 01:13:01 user nova-compute[75226]:     <video supported='yes'>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='modelType'>
Nov 17 01:13:01 user nova-compute[75226]:         <value>vga</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>cirrus</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>vmvga</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>qxl</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>virtio</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>none</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>bochs</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>ramfb</value>
Nov 17 01:13:01 user nova-compute[75226]:       </enum>
Nov 17 01:13:01 user nova-compute[75226]:     </video>
Nov 17 01:13:01 user nova-compute[75226]:     <hostdev supported='yes'>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='mode'>
Nov 17 01:13:01 user nova-compute[75226]:         <value>subsystem</value>
Nov 17 01:13:01 user nova-compute[75226]:       </enum>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='startupPolicy'>
Nov 17 01:13:01 user nova-compute[75226]:         <value>default</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>mandatory</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>requisite</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>optional</value>
Nov 17 01:13:01 user nova-compute[75226]:       </enum>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='subsysType'>
Nov 17 01:13:01 user nova-compute[75226]:         <value>usb</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>pci</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>scsi</value>
Nov 17 01:13:01 user nova-compute[75226]:       </enum>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='capsType'/>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='pciBackend'/>
Nov 17 01:13:01 user nova-compute[75226]:     </hostdev>
Nov 17 01:13:01 user nova-compute[75226]:     <rng supported='yes'>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='model'>
Nov 17 01:13:01 user nova-compute[75226]:         <value>virtio</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>virtio-transitional</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>virtio-non-transitional</value>
Nov 17 01:13:01 user nova-compute[75226]:       </enum>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='backendModel'>
Nov 17 01:13:01 user nova-compute[75226]:         <value>random</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>egd</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>builtin</value>
Nov 17 01:13:01 user nova-compute[75226]:       </enum>
Nov 17 01:13:01 user nova-compute[75226]:     </rng>
Nov 17 01:13:01 user nova-compute[75226]:     <filesystem supported='yes'>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='driverType'>
Nov 17 01:13:01 user nova-compute[75226]:         <value>path</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>handle</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>virtiofs</value>
Nov 17 01:13:01 user nova-compute[75226]:       </enum>
Nov 17 01:13:01 user nova-compute[75226]:     </filesystem>
Nov 17 01:13:01 user nova-compute[75226]:     <tpm supported='yes'>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='model'>
Nov 17 01:13:01 user nova-compute[75226]:         <value>tpm-tis</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>tpm-crb</value>
Nov 17 01:13:01 user nova-compute[75226]:       </enum>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='backendModel'>
Nov 17 01:13:01 user nova-compute[75226]:         <value>passthrough</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>emulator</value>
Nov 17 01:13:01 user nova-compute[75226]:       </enum>
Nov 17 01:13:01 user nova-compute[75226]:     </tpm>
Nov 17 01:13:01 user nova-compute[75226]:   </devices>
Nov 17 01:13:01 user nova-compute[75226]:   <features>
Nov 17 01:13:01 user nova-compute[75226]:     <gic supported='no'/>
Nov 17 01:13:01 user nova-compute[75226]:     <vmcoreinfo supported='yes'/>
Nov 17 01:13:01 user nova-compute[75226]:     <genid supported='yes'/>
Nov 17 01:13:01 user nova-compute[75226]:     <backingStoreInput supported='yes'/>
Nov 17 01:13:01 user nova-compute[75226]:     <backup supported='yes'/>
Nov 17 01:13:01 user nova-compute[75226]:     <sev supported='no'/>
Nov 17 01:13:01 user nova-compute[75226]:   </features>
Nov 17 01:13:01 user nova-compute[75226]: </domainCapabilities>
Nov 17 01:13:01 user nova-compute[75226]:  {{(pid=75226) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 17 01:13:01 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-5439cf8a-5bb2-447e-9351-06058b1fe5ef None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Nov 17 01:13:01 user nova-compute[75226]: <domainCapabilities>
Nov 17 01:13:01 user nova-compute[75226]:   <path>/usr/bin/qemu-system-i386</path>
Nov 17 01:13:01 user nova-compute[75226]:   <domain>kvm</domain>
Nov 17 01:13:01 user nova-compute[75226]:   <machine>pc-q35-jammy</machine>
Nov 17 01:13:01 user nova-compute[75226]:   <arch>i686</arch>
Nov 17 01:13:01 user nova-compute[75226]:   <vcpu max='288'/>
Nov 17 01:13:01 user nova-compute[75226]:   <iothreads supported='yes'/>
Nov 17 01:13:01 user nova-compute[75226]:   <os supported='yes'>
Nov 17 01:13:01 user nova-compute[75226]:     <enum name='firmware'/>
Nov 17 01:13:01 user nova-compute[75226]:     <loader supported='yes'>
Nov 17 01:13:01 user nova-compute[75226]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 17 01:13:01 user nova-compute[75226]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 17 01:13:01 user nova-compute[75226]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 17 01:13:01 user nova-compute[75226]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 17 01:13:01 user nova-compute[75226]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='type'>
Nov 17 01:13:01 user nova-compute[75226]:         <value>rom</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>pflash</value>
Nov 17 01:13:01 user nova-compute[75226]:       </enum>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='readonly'>
Nov 17 01:13:01 user nova-compute[75226]:         <value>yes</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>no</value>
Nov 17 01:13:01 user nova-compute[75226]:       </enum>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='secure'>
Nov 17 01:13:01 user nova-compute[75226]:         <value>no</value>
Nov 17 01:13:01 user nova-compute[75226]:       </enum>
Nov 17 01:13:01 user nova-compute[75226]:     </loader>
Nov 17 01:13:01 user nova-compute[75226]:   </os>
Nov 17 01:13:01 user nova-compute[75226]:   <cpu>
Nov 17 01:13:01 user nova-compute[75226]:     <mode name='host-passthrough' supported='yes'>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='hostPassthroughMigratable'>
Nov 17 01:13:01 user nova-compute[75226]:         <value>off</value>
Nov 17 01:13:01 user nova-compute[75226]:       </enum>
Nov 17 01:13:01 user nova-compute[75226]:     </mode>
Nov 17 01:13:01 user nova-compute[75226]:     <mode name='maximum' supported='yes'>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='maximumMigratable'>
Nov 17 01:13:01 user nova-compute[75226]:         <value>on</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>off</value>
Nov 17 01:13:01 user nova-compute[75226]:       </enum>
Nov 17 01:13:01 user nova-compute[75226]:     </mode>
Nov 17 01:13:01 user nova-compute[75226]:     <mode name='host-model' supported='yes'>
Nov 17 01:13:01 user nova-compute[75226]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 17 01:13:01 user nova-compute[75226]:       <vendor>Intel</vendor>
Nov 17 01:13:01 user nova-compute[75226]:       <feature policy='require' name='ss'/>
Nov 17 01:13:01 user nova-compute[75226]:       <feature policy='require' name='vmx'/>
Nov 17 01:13:01 user nova-compute[75226]:       <feature policy='require' name='pcid'/>
Nov 17 01:13:01 user nova-compute[75226]:       <feature policy='require' name='hypervisor'/>
Nov 17 01:13:01 user nova-compute[75226]:       <feature policy='require' name='arat'/>
Nov 17 01:13:01 user nova-compute[75226]:       <feature policy='require' name='tsc_adjust'/>
Nov 17 01:13:01 user nova-compute[75226]:       <feature policy='require' name='umip'/>
Nov 17 01:13:01 user nova-compute[75226]:       <feature policy='require' name='md-clear'/>
Nov 17 01:13:01 user nova-compute[75226]:       <feature policy='require' name='stibp'/>
Nov 17 01:13:01 user nova-compute[75226]:       <feature policy='require' name='arch-capabilities'/>
Nov 17 01:13:01 user nova-compute[75226]:       <feature policy='require' name='ssbd'/>
Nov 17 01:13:01 user nova-compute[75226]:       <feature policy='require' name='ibpb'/>
Nov 17 01:13:01 user nova-compute[75226]:       <feature policy='require' name='ibrs'/>
Nov 17 01:13:01 user nova-compute[75226]:       <feature policy='require' name='amd-stibp'/>
Nov 17 01:13:01 user nova-compute[75226]:       <feature policy='require' name='amd-ssbd'/>
Nov 17 01:13:01 user nova-compute[75226]:       <feature policy='disable' name='erms'/>
Nov 17 01:13:01 user nova-compute[75226]:       <feature policy='disable' name='xsaveopt'/>
Nov 17 01:13:01 user nova-compute[75226]:       <feature policy='disable' name='lm'/>
Nov 17 01:13:01 user nova-compute[75226]:     </mode>
Nov 17 01:13:01 user nova-compute[75226]:     <mode name='custom' supported='yes'>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>qemu64</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='yes'>qemu32</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>phenom</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='yes'>pentium3</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='yes'>pentium2</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='yes'>pentium</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>n270</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>kvm64</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='yes'>kvm32</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='yes'>coreduo</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>core2duo</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>athlon</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Westmere-IBRS</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Westmere</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Snowridge</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Skylake-Server</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Skylake-Client</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>SandyBridge</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Penryn</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Opteron_G5</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Opteron_G4</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Opteron_G3</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Opteron_G2</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Opteron_G1</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Nehalem-IBRS</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Nehalem</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>IvyBridge</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Icelake-Server</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Haswell-noTSX</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Haswell-IBRS</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Haswell</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>EPYC-Rome</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>EPYC-Milan</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>EPYC-IBPB</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>EPYC</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Dhyana</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Cooperlake</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Conroe</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Cascadelake-Server</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Broadwell-noTSX</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Broadwell-IBRS</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Broadwell</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='yes'>486</model>
Nov 17 01:13:01 user nova-compute[75226]:     </mode>
Nov 17 01:13:01 user nova-compute[75226]:   </cpu>
Nov 17 01:13:01 user nova-compute[75226]:   <memoryBacking supported='yes'>
Nov 17 01:13:01 user nova-compute[75226]:     <enum name='sourceType'>
Nov 17 01:13:01 user nova-compute[75226]:       <value>file</value>
Nov 17 01:13:01 user nova-compute[75226]:       <value>anonymous</value>
Nov 17 01:13:01 user nova-compute[75226]:       <value>memfd</value>
Nov 17 01:13:01 user nova-compute[75226]:     </enum>
Nov 17 01:13:01 user nova-compute[75226]:   </memoryBacking>
Nov 17 01:13:01 user nova-compute[75226]:   <devices>
Nov 17 01:13:01 user nova-compute[75226]:     <disk supported='yes'>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='diskDevice'>
Nov 17 01:13:01 user nova-compute[75226]:         <value>disk</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>cdrom</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>floppy</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>lun</value>
Nov 17 01:13:01 user nova-compute[75226]:       </enum>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='bus'>
Nov 17 01:13:01 user nova-compute[75226]:         <value>fdc</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>scsi</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>virtio</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>usb</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>sata</value>
Nov 17 01:13:01 user nova-compute[75226]:       </enum>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='model'>
Nov 17 01:13:01 user nova-compute[75226]:         <value>virtio</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>virtio-transitional</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>virtio-non-transitional</value>
Nov 17 01:13:01 user nova-compute[75226]:       </enum>
Nov 17 01:13:01 user nova-compute[75226]:     </disk>
Nov 17 01:13:01 user nova-compute[75226]:     <graphics supported='yes'>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='type'>
Nov 17 01:13:01 user nova-compute[75226]:         <value>sdl</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>vnc</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>spice</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>egl-headless</value>
Nov 17 01:13:01 user nova-compute[75226]:       </enum>
Nov 17 01:13:01 user nova-compute[75226]:     </graphics>
Nov 17 01:13:01 user nova-compute[75226]:     <video supported='yes'>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='modelType'>
Nov 17 01:13:01 user nova-compute[75226]:         <value>vga</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>cirrus</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>vmvga</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>qxl</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>virtio</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>none</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>bochs</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>ramfb</value>
Nov 17 01:13:01 user nova-compute[75226]:       </enum>
Nov 17 01:13:01 user nova-compute[75226]:     </video>
Nov 17 01:13:01 user nova-compute[75226]:     <hostdev supported='yes'>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='mode'>
Nov 17 01:13:01 user nova-compute[75226]:         <value>subsystem</value>
Nov 17 01:13:01 user nova-compute[75226]:       </enum>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='startupPolicy'>
Nov 17 01:13:01 user nova-compute[75226]:         <value>default</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>mandatory</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>requisite</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>optional</value>
Nov 17 01:13:01 user nova-compute[75226]:       </enum>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='subsysType'>
Nov 17 01:13:01 user nova-compute[75226]:         <value>usb</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>pci</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>scsi</value>
Nov 17 01:13:01 user nova-compute[75226]:       </enum>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='capsType'/>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='pciBackend'/>
Nov 17 01:13:01 user nova-compute[75226]:     </hostdev>
Nov 17 01:13:01 user nova-compute[75226]:     <rng supported='yes'>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='model'>
Nov 17 01:13:01 user nova-compute[75226]:         <value>virtio</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>virtio-transitional</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>virtio-non-transitional</value>
Nov 17 01:13:01 user nova-compute[75226]:       </enum>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='backendModel'>
Nov 17 01:13:01 user nova-compute[75226]:         <value>random</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>egd</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>builtin</value>
Nov 17 01:13:01 user nova-compute[75226]:       </enum>
Nov 17 01:13:01 user nova-compute[75226]:     </rng>
Nov 17 01:13:01 user nova-compute[75226]:     <filesystem supported='yes'>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='driverType'>
Nov 17 01:13:01 user nova-compute[75226]:         <value>path</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>handle</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>virtiofs</value>
Nov 17 01:13:01 user nova-compute[75226]:       </enum>
Nov 17 01:13:01 user nova-compute[75226]:     </filesystem>
Nov 17 01:13:01 user nova-compute[75226]:     <tpm supported='yes'>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='model'>
Nov 17 01:13:01 user nova-compute[75226]:         <value>tpm-tis</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>tpm-crb</value>
Nov 17 01:13:01 user nova-compute[75226]:       </enum>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='backendModel'>
Nov 17 01:13:01 user nova-compute[75226]:         <value>passthrough</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>emulator</value>
Nov 17 01:13:01 user nova-compute[75226]:       </enum>
Nov 17 01:13:01 user nova-compute[75226]:     </tpm>
Nov 17 01:13:01 user nova-compute[75226]:   </devices>
Nov 17 01:13:01 user nova-compute[75226]:   <features>
Nov 17 01:13:01 user nova-compute[75226]:     <gic supported='no'/>
Nov 17 01:13:01 user nova-compute[75226]:     <vmcoreinfo supported='yes'/>
Nov 17 01:13:01 user nova-compute[75226]:     <genid supported='yes'/>
Nov 17 01:13:01 user nova-compute[75226]:     <backingStoreInput supported='yes'/>
Nov 17 01:13:01 user nova-compute[75226]:     <backup supported='yes'/>
Nov 17 01:13:01 user nova-compute[75226]:     <sev supported='no'/>
Nov 17 01:13:01 user nova-compute[75226]:   </features>
Nov 17 01:13:01 user nova-compute[75226]: </domainCapabilities>
Nov 17 01:13:01 user nova-compute[75226]:  {{(pid=75226) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 17 01:13:01 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-5439cf8a-5bb2-447e-9351-06058b1fe5ef None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=75226) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 17 01:13:01 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-5439cf8a-5bb2-447e-9351-06058b1fe5ef None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75226) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 17 01:13:01 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-5439cf8a-5bb2-447e-9351-06058b1fe5ef None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75226) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 17 01:13:01 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-5439cf8a-5bb2-447e-9351-06058b1fe5ef None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=75226) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 17 01:13:01 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-5439cf8a-5bb2-447e-9351-06058b1fe5ef None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=75226) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 17 01:13:01 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-5439cf8a-5bb2-447e-9351-06058b1fe5ef None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=75226) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 17 01:13:01 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-5439cf8a-5bb2-447e-9351-06058b1fe5ef None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=75226) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 17 01:13:01 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-5439cf8a-5bb2-447e-9351-06058b1fe5ef None None] Getting domain capabilities for mips via machine types: {None} {{(pid=75226) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 17 01:13:01 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-5439cf8a-5bb2-447e-9351-06058b1fe5ef None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=75226) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 17 01:13:01 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-5439cf8a-5bb2-447e-9351-06058b1fe5ef None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=75226) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 17 01:13:01 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-5439cf8a-5bb2-447e-9351-06058b1fe5ef None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=75226) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 17 01:13:01 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-5439cf8a-5bb2-447e-9351-06058b1fe5ef None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=75226) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 17 01:13:01 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-5439cf8a-5bb2-447e-9351-06058b1fe5ef None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=75226) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 17 01:13:01 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-5439cf8a-5bb2-447e-9351-06058b1fe5ef None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=75226) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 17 01:13:01 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-5439cf8a-5bb2-447e-9351-06058b1fe5ef None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=75226) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 17 01:13:01 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-5439cf8a-5bb2-447e-9351-06058b1fe5ef None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=75226) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 17 01:13:01 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-5439cf8a-5bb2-447e-9351-06058b1fe5ef None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=75226) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 17 01:13:01 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-5439cf8a-5bb2-447e-9351-06058b1fe5ef None None] Getting domain capabilities for ppc64 via machine types: {'powernv', None, 'pseries'} {{(pid=75226) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 17 01:13:01 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-5439cf8a-5bb2-447e-9351-06058b1fe5ef None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75226) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 17 01:13:01 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-5439cf8a-5bb2-447e-9351-06058b1fe5ef None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75226) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 17 01:13:01 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-5439cf8a-5bb2-447e-9351-06058b1fe5ef None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75226) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 17 01:13:01 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-5439cf8a-5bb2-447e-9351-06058b1fe5ef None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=75226) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 17 01:13:01 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-5439cf8a-5bb2-447e-9351-06058b1fe5ef None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75226) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 17 01:13:01 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-5439cf8a-5bb2-447e-9351-06058b1fe5ef None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75226) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 17 01:13:01 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-5439cf8a-5bb2-447e-9351-06058b1fe5ef None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=75226) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 17 01:13:01 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-5439cf8a-5bb2-447e-9351-06058b1fe5ef None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=75226) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 17 01:13:01 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-5439cf8a-5bb2-447e-9351-06058b1fe5ef None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=75226) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 17 01:13:01 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-5439cf8a-5bb2-447e-9351-06058b1fe5ef None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=75226) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 17 01:13:01 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-5439cf8a-5bb2-447e-9351-06058b1fe5ef None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=75226) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 17 01:13:01 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-5439cf8a-5bb2-447e-9351-06058b1fe5ef None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=75226) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 17 01:13:01 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-5439cf8a-5bb2-447e-9351-06058b1fe5ef None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=75226) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 17 01:13:01 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-5439cf8a-5bb2-447e-9351-06058b1fe5ef None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=75226) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 17 01:13:01 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-5439cf8a-5bb2-447e-9351-06058b1fe5ef None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=75226) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 17 01:13:01 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-5439cf8a-5bb2-447e-9351-06058b1fe5ef None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=75226) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 17 01:13:01 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-5439cf8a-5bb2-447e-9351-06058b1fe5ef None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=75226) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 17 01:13:01 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-5439cf8a-5bb2-447e-9351-06058b1fe5ef None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=75226) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 17 01:13:01 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-5439cf8a-5bb2-447e-9351-06058b1fe5ef None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=75226) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 17 01:13:01 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-5439cf8a-5bb2-447e-9351-06058b1fe5ef None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=75226) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 17 01:13:01 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-5439cf8a-5bb2-447e-9351-06058b1fe5ef None None] Getting domain capabilities for x86_64 via machine types: {'pc', 'ubuntu', 'q35', 'ubuntu-q35'} {{(pid=75226) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 17 01:13:01 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-5439cf8a-5bb2-447e-9351-06058b1fe5ef None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Nov 17 01:13:01 user nova-compute[75226]: <domainCapabilities>
Nov 17 01:13:01 user nova-compute[75226]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 17 01:13:01 user nova-compute[75226]:   <domain>kvm</domain>
Nov 17 01:13:01 user nova-compute[75226]:   <machine>pc-i440fx-6.2</machine>
Nov 17 01:13:01 user nova-compute[75226]:   <arch>x86_64</arch>
Nov 17 01:13:01 user nova-compute[75226]:   <vcpu max='255'/>
Nov 17 01:13:01 user nova-compute[75226]:   <iothreads supported='yes'/>
Nov 17 01:13:01 user nova-compute[75226]:   <os supported='yes'>
Nov 17 01:13:01 user nova-compute[75226]:     <enum name='firmware'>
Nov 17 01:13:01 user nova-compute[75226]:       <value>efi</value>
Nov 17 01:13:01 user nova-compute[75226]:     </enum>
Nov 17 01:13:01 user nova-compute[75226]:     <loader supported='yes'>
Nov 17 01:13:01 user nova-compute[75226]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='type'>
Nov 17 01:13:01 user nova-compute[75226]:         <value>rom</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>pflash</value>
Nov 17 01:13:01 user nova-compute[75226]:       </enum>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='readonly'>
Nov 17 01:13:01 user nova-compute[75226]:         <value>yes</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>no</value>
Nov 17 01:13:01 user nova-compute[75226]:       </enum>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='secure'>
Nov 17 01:13:01 user nova-compute[75226]:         <value>no</value>
Nov 17 01:13:01 user nova-compute[75226]:       </enum>
Nov 17 01:13:01 user nova-compute[75226]:     </loader>
Nov 17 01:13:01 user nova-compute[75226]:   </os>
Nov 17 01:13:01 user nova-compute[75226]:   <cpu>
Nov 17 01:13:01 user nova-compute[75226]:     <mode name='host-passthrough' supported='yes'>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='hostPassthroughMigratable'>
Nov 17 01:13:01 user nova-compute[75226]:         <value>on</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>off</value>
Nov 17 01:13:01 user nova-compute[75226]:       </enum>
Nov 17 01:13:01 user nova-compute[75226]:     </mode>
Nov 17 01:13:01 user nova-compute[75226]:     <mode name='maximum' supported='yes'>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='maximumMigratable'>
Nov 17 01:13:01 user nova-compute[75226]:         <value>on</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>off</value>
Nov 17 01:13:01 user nova-compute[75226]:       </enum>
Nov 17 01:13:01 user nova-compute[75226]:     </mode>
Nov 17 01:13:01 user nova-compute[75226]:     <mode name='host-model' supported='yes'>
Nov 17 01:13:01 user nova-compute[75226]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 17 01:13:01 user nova-compute[75226]:       <vendor>Intel</vendor>
Nov 17 01:13:01 user nova-compute[75226]:       <feature policy='require' name='ss'/>
Nov 17 01:13:01 user nova-compute[75226]:       <feature policy='require' name='vmx'/>
Nov 17 01:13:01 user nova-compute[75226]:       <feature policy='require' name='pcid'/>
Nov 17 01:13:01 user nova-compute[75226]:       <feature policy='require' name='hypervisor'/>
Nov 17 01:13:01 user nova-compute[75226]:       <feature policy='require' name='arat'/>
Nov 17 01:13:01 user nova-compute[75226]:       <feature policy='require' name='tsc_adjust'/>
Nov 17 01:13:01 user nova-compute[75226]:       <feature policy='require' name='umip'/>
Nov 17 01:13:01 user nova-compute[75226]:       <feature policy='require' name='md-clear'/>
Nov 17 01:13:01 user nova-compute[75226]:       <feature policy='require' name='stibp'/>
Nov 17 01:13:01 user nova-compute[75226]:       <feature policy='require' name='arch-capabilities'/>
Nov 17 01:13:01 user nova-compute[75226]:       <feature policy='require' name='ssbd'/>
Nov 17 01:13:01 user nova-compute[75226]:       <feature policy='require' name='invtsc'/>
Nov 17 01:13:01 user nova-compute[75226]:       <feature policy='require' name='ibpb'/>
Nov 17 01:13:01 user nova-compute[75226]:       <feature policy='require' name='ibrs'/>
Nov 17 01:13:01 user nova-compute[75226]:       <feature policy='require' name='amd-stibp'/>
Nov 17 01:13:01 user nova-compute[75226]:       <feature policy='require' name='amd-ssbd'/>
Nov 17 01:13:01 user nova-compute[75226]:       <feature policy='require' name='rsba'/>
Nov 17 01:13:01 user nova-compute[75226]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 17 01:13:01 user nova-compute[75226]:       <feature policy='require' name='pschange-mc-no'/>
Nov 17 01:13:01 user nova-compute[75226]:       <feature policy='disable' name='erms'/>
Nov 17 01:13:01 user nova-compute[75226]:       <feature policy='disable' name='xsaveopt'/>
Nov 17 01:13:01 user nova-compute[75226]:     </mode>
Nov 17 01:13:01 user nova-compute[75226]:     <mode name='custom' supported='yes'>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>qemu64</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='yes'>qemu32</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>phenom</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='yes'>pentium3</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='yes'>pentium2</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='yes'>pentium</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>n270</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='yes'>kvm64</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='yes'>kvm32</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='yes'>coreduo</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='yes'>core2duo</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>athlon</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='yes'>Westmere-IBRS</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='yes'>Westmere</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Snowridge</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Skylake-Server</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Skylake-Client</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>SandyBridge</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='yes'>Penryn</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Opteron_G5</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Opteron_G4</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Opteron_G3</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Opteron_G2</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='yes'>Opteron_G1</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='yes'>Nehalem</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>IvyBridge</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Icelake-Server</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Haswell-noTSX</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Haswell-IBRS</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Haswell</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>EPYC-Rome</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>EPYC-Milan</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>EPYC-IBPB</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>EPYC</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Dhyana</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Cooperlake</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='yes'>Conroe</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Cascadelake-Server</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Broadwell-noTSX</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Broadwell-IBRS</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Broadwell</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='yes'>486</model>
Nov 17 01:13:01 user nova-compute[75226]:     </mode>
Nov 17 01:13:01 user nova-compute[75226]:   </cpu>
Nov 17 01:13:01 user nova-compute[75226]:   <memoryBacking supported='yes'>
Nov 17 01:13:01 user nova-compute[75226]:     <enum name='sourceType'>
Nov 17 01:13:01 user nova-compute[75226]:       <value>file</value>
Nov 17 01:13:01 user nova-compute[75226]:       <value>anonymous</value>
Nov 17 01:13:01 user nova-compute[75226]:       <value>memfd</value>
Nov 17 01:13:01 user nova-compute[75226]:     </enum>
Nov 17 01:13:01 user nova-compute[75226]:   </memoryBacking>
Nov 17 01:13:01 user nova-compute[75226]:   <devices>
Nov 17 01:13:01 user nova-compute[75226]:     <disk supported='yes'>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='diskDevice'>
Nov 17 01:13:01 user nova-compute[75226]:         <value>disk</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>cdrom</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>floppy</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>lun</value>
Nov 17 01:13:01 user nova-compute[75226]:       </enum>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='bus'>
Nov 17 01:13:01 user nova-compute[75226]:         <value>ide</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>fdc</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>scsi</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>virtio</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>usb</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>sata</value>
Nov 17 01:13:01 user nova-compute[75226]:       </enum>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='model'>
Nov 17 01:13:01 user nova-compute[75226]:         <value>virtio</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>virtio-transitional</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>virtio-non-transitional</value>
Nov 17 01:13:01 user nova-compute[75226]:       </enum>
Nov 17 01:13:01 user nova-compute[75226]:     </disk>
Nov 17 01:13:01 user nova-compute[75226]:     <graphics supported='yes'>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='type'>
Nov 17 01:13:01 user nova-compute[75226]:         <value>sdl</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>vnc</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>spice</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>egl-headless</value>
Nov 17 01:13:01 user nova-compute[75226]:       </enum>
Nov 17 01:13:01 user nova-compute[75226]:     </graphics>
Nov 17 01:13:01 user nova-compute[75226]:     <video supported='yes'>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='modelType'>
Nov 17 01:13:01 user nova-compute[75226]:         <value>vga</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>cirrus</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>vmvga</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>qxl</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>virtio</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>none</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>bochs</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>ramfb</value>
Nov 17 01:13:01 user nova-compute[75226]:       </enum>
Nov 17 01:13:01 user nova-compute[75226]:     </video>
Nov 17 01:13:01 user nova-compute[75226]:     <hostdev supported='yes'>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='mode'>
Nov 17 01:13:01 user nova-compute[75226]:         <value>subsystem</value>
Nov 17 01:13:01 user nova-compute[75226]:       </enum>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='startupPolicy'>
Nov 17 01:13:01 user nova-compute[75226]:         <value>default</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>mandatory</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>requisite</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>optional</value>
Nov 17 01:13:01 user nova-compute[75226]:       </enum>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='subsysType'>
Nov 17 01:13:01 user nova-compute[75226]:         <value>usb</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>pci</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>scsi</value>
Nov 17 01:13:01 user nova-compute[75226]:       </enum>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='capsType'/>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='pciBackend'/>
Nov 17 01:13:01 user nova-compute[75226]:     </hostdev>
Nov 17 01:13:01 user nova-compute[75226]:     <rng supported='yes'>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='model'>
Nov 17 01:13:01 user nova-compute[75226]:         <value>virtio</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>virtio-transitional</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>virtio-non-transitional</value>
Nov 17 01:13:01 user nova-compute[75226]:       </enum>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='backendModel'>
Nov 17 01:13:01 user nova-compute[75226]:         <value>random</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>egd</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>builtin</value>
Nov 17 01:13:01 user nova-compute[75226]:       </enum>
Nov 17 01:13:01 user nova-compute[75226]:     </rng>
Nov 17 01:13:01 user nova-compute[75226]:     <filesystem supported='yes'>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='driverType'>
Nov 17 01:13:01 user nova-compute[75226]:         <value>path</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>handle</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>virtiofs</value>
Nov 17 01:13:01 user nova-compute[75226]:       </enum>
Nov 17 01:13:01 user nova-compute[75226]:     </filesystem>
Nov 17 01:13:01 user nova-compute[75226]:     <tpm supported='yes'>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='model'>
Nov 17 01:13:01 user nova-compute[75226]:         <value>tpm-tis</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>tpm-crb</value>
Nov 17 01:13:01 user nova-compute[75226]:       </enum>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='backendModel'>
Nov 17 01:13:01 user nova-compute[75226]:         <value>passthrough</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>emulator</value>
Nov 17 01:13:01 user nova-compute[75226]:       </enum>
Nov 17 01:13:01 user nova-compute[75226]:     </tpm>
Nov 17 01:13:01 user nova-compute[75226]:   </devices>
Nov 17 01:13:01 user nova-compute[75226]:   <features>
Nov 17 01:13:01 user nova-compute[75226]:     <gic supported='no'/>
Nov 17 01:13:01 user nova-compute[75226]:     <vmcoreinfo supported='yes'/>
Nov 17 01:13:01 user nova-compute[75226]:     <genid supported='yes'/>
Nov 17 01:13:01 user nova-compute[75226]:     <backingStoreInput supported='yes'/>
Nov 17 01:13:01 user nova-compute[75226]:     <backup supported='yes'/>
Nov 17 01:13:01 user nova-compute[75226]:     <sev supported='no'/>
Nov 17 01:13:01 user nova-compute[75226]:   </features>
Nov 17 01:13:01 user nova-compute[75226]: </domainCapabilities>
Nov 17 01:13:01 user nova-compute[75226]:  {{(pid=75226) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 17 01:13:01 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-5439cf8a-5bb2-447e-9351-06058b1fe5ef None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Nov 17 01:13:01 user nova-compute[75226]: <domainCapabilities>
Nov 17 01:13:01 user nova-compute[75226]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 17 01:13:01 user nova-compute[75226]:   <domain>kvm</domain>
Nov 17 01:13:01 user nova-compute[75226]:   <machine>pc-i440fx-jammy</machine>
Nov 17 01:13:01 user nova-compute[75226]:   <arch>x86_64</arch>
Nov 17 01:13:01 user nova-compute[75226]:   <vcpu max='255'/>
Nov 17 01:13:01 user nova-compute[75226]:   <iothreads supported='yes'/>
Nov 17 01:13:01 user nova-compute[75226]:   <os supported='yes'>
Nov 17 01:13:01 user nova-compute[75226]:     <enum name='firmware'>
Nov 17 01:13:01 user nova-compute[75226]:       <value>efi</value>
Nov 17 01:13:01 user nova-compute[75226]:     </enum>
Nov 17 01:13:01 user nova-compute[75226]:     <loader supported='yes'>
Nov 17 01:13:01 user nova-compute[75226]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='type'>
Nov 17 01:13:01 user nova-compute[75226]:         <value>rom</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>pflash</value>
Nov 17 01:13:01 user nova-compute[75226]:       </enum>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='readonly'>
Nov 17 01:13:01 user nova-compute[75226]:         <value>yes</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>no</value>
Nov 17 01:13:01 user nova-compute[75226]:       </enum>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='secure'>
Nov 17 01:13:01 user nova-compute[75226]:         <value>no</value>
Nov 17 01:13:01 user nova-compute[75226]:       </enum>
Nov 17 01:13:01 user nova-compute[75226]:     </loader>
Nov 17 01:13:01 user nova-compute[75226]:   </os>
Nov 17 01:13:01 user nova-compute[75226]:   <cpu>
Nov 17 01:13:01 user nova-compute[75226]:     <mode name='host-passthrough' supported='yes'>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='hostPassthroughMigratable'>
Nov 17 01:13:01 user nova-compute[75226]:         <value>on</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>off</value>
Nov 17 01:13:01 user nova-compute[75226]:       </enum>
Nov 17 01:13:01 user nova-compute[75226]:     </mode>
Nov 17 01:13:01 user nova-compute[75226]:     <mode name='maximum' supported='yes'>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='maximumMigratable'>
Nov 17 01:13:01 user nova-compute[75226]:         <value>on</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>off</value>
Nov 17 01:13:01 user nova-compute[75226]:       </enum>
Nov 17 01:13:01 user nova-compute[75226]:     </mode>
Nov 17 01:13:01 user nova-compute[75226]:     <mode name='host-model' supported='yes'>
Nov 17 01:13:01 user nova-compute[75226]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 17 01:13:01 user nova-compute[75226]:       <vendor>Intel</vendor>
Nov 17 01:13:01 user nova-compute[75226]:       <feature policy='require' name='ss'/>
Nov 17 01:13:01 user nova-compute[75226]:       <feature policy='require' name='vmx'/>
Nov 17 01:13:01 user nova-compute[75226]:       <feature policy='require' name='pcid'/>
Nov 17 01:13:01 user nova-compute[75226]:       <feature policy='require' name='hypervisor'/>
Nov 17 01:13:01 user nova-compute[75226]:       <feature policy='require' name='arat'/>
Nov 17 01:13:01 user nova-compute[75226]:       <feature policy='require' name='tsc_adjust'/>
Nov 17 01:13:01 user nova-compute[75226]:       <feature policy='require' name='umip'/>
Nov 17 01:13:01 user nova-compute[75226]:       <feature policy='require' name='md-clear'/>
Nov 17 01:13:01 user nova-compute[75226]:       <feature policy='require' name='stibp'/>
Nov 17 01:13:01 user nova-compute[75226]:       <feature policy='require' name='arch-capabilities'/>
Nov 17 01:13:01 user nova-compute[75226]:       <feature policy='require' name='ssbd'/>
Nov 17 01:13:01 user nova-compute[75226]:       <feature policy='require' name='invtsc'/>
Nov 17 01:13:01 user nova-compute[75226]:       <feature policy='require' name='ibpb'/>
Nov 17 01:13:01 user nova-compute[75226]:       <feature policy='require' name='ibrs'/>
Nov 17 01:13:01 user nova-compute[75226]:       <feature policy='require' name='amd-stibp'/>
Nov 17 01:13:01 user nova-compute[75226]:       <feature policy='require' name='amd-ssbd'/>
Nov 17 01:13:01 user nova-compute[75226]:       <feature policy='require' name='rsba'/>
Nov 17 01:13:01 user nova-compute[75226]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 17 01:13:01 user nova-compute[75226]:       <feature policy='require' name='pschange-mc-no'/>
Nov 17 01:13:01 user nova-compute[75226]:       <feature policy='disable' name='erms'/>
Nov 17 01:13:01 user nova-compute[75226]:       <feature policy='disable' name='xsaveopt'/>
Nov 17 01:13:01 user nova-compute[75226]:     </mode>
Nov 17 01:13:01 user nova-compute[75226]:     <mode name='custom' supported='yes'>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>qemu64</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='yes'>qemu32</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>phenom</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='yes'>pentium3</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='yes'>pentium2</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='yes'>pentium</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>n270</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='yes'>kvm64</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='yes'>kvm32</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='yes'>coreduo</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='yes'>core2duo</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>athlon</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='yes'>Westmere-IBRS</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='yes'>Westmere</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Snowridge</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Skylake-Server</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Skylake-Client</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>SandyBridge</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='yes'>Penryn</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Opteron_G5</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Opteron_G4</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Opteron_G3</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Opteron_G2</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='yes'>Opteron_G1</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='yes'>Nehalem</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>IvyBridge</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Icelake-Server</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Haswell-noTSX</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Haswell-IBRS</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Haswell</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>EPYC-Rome</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>EPYC-Milan</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>EPYC-IBPB</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>EPYC</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Dhyana</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Cooperlake</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='yes'>Conroe</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Cascadelake-Server</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Broadwell-noTSX</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Broadwell-IBRS</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Broadwell</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='yes'>486</model>
Nov 17 01:13:01 user nova-compute[75226]:     </mode>
Nov 17 01:13:01 user nova-compute[75226]:   </cpu>
Nov 17 01:13:01 user nova-compute[75226]:   <memoryBacking supported='yes'>
Nov 17 01:13:01 user nova-compute[75226]:     <enum name='sourceType'>
Nov 17 01:13:01 user nova-compute[75226]:       <value>file</value>
Nov 17 01:13:01 user nova-compute[75226]:       <value>anonymous</value>
Nov 17 01:13:01 user nova-compute[75226]:       <value>memfd</value>
Nov 17 01:13:01 user nova-compute[75226]:     </enum>
Nov 17 01:13:01 user nova-compute[75226]:   </memoryBacking>
Nov 17 01:13:01 user nova-compute[75226]:   <devices>
Nov 17 01:13:01 user nova-compute[75226]:     <disk supported='yes'>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='diskDevice'>
Nov 17 01:13:01 user nova-compute[75226]:         <value>disk</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>cdrom</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>floppy</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>lun</value>
Nov 17 01:13:01 user nova-compute[75226]:       </enum>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='bus'>
Nov 17 01:13:01 user nova-compute[75226]:         <value>ide</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>fdc</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>scsi</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>virtio</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>usb</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>sata</value>
Nov 17 01:13:01 user nova-compute[75226]:       </enum>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='model'>
Nov 17 01:13:01 user nova-compute[75226]:         <value>virtio</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>virtio-transitional</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>virtio-non-transitional</value>
Nov 17 01:13:01 user nova-compute[75226]:       </enum>
Nov 17 01:13:01 user nova-compute[75226]:     </disk>
Nov 17 01:13:01 user nova-compute[75226]:     <graphics supported='yes'>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='type'>
Nov 17 01:13:01 user nova-compute[75226]:         <value>sdl</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>vnc</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>spice</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>egl-headless</value>
Nov 17 01:13:01 user nova-compute[75226]:       </enum>
Nov 17 01:13:01 user nova-compute[75226]:     </graphics>
Nov 17 01:13:01 user nova-compute[75226]:     <video supported='yes'>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='modelType'>
Nov 17 01:13:01 user nova-compute[75226]:         <value>vga</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>cirrus</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>vmvga</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>qxl</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>virtio</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>none</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>bochs</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>ramfb</value>
Nov 17 01:13:01 user nova-compute[75226]:       </enum>
Nov 17 01:13:01 user nova-compute[75226]:     </video>
Nov 17 01:13:01 user nova-compute[75226]:     <hostdev supported='yes'>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='mode'>
Nov 17 01:13:01 user nova-compute[75226]:         <value>subsystem</value>
Nov 17 01:13:01 user nova-compute[75226]:       </enum>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='startupPolicy'>
Nov 17 01:13:01 user nova-compute[75226]:         <value>default</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>mandatory</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>requisite</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>optional</value>
Nov 17 01:13:01 user nova-compute[75226]:       </enum>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='subsysType'>
Nov 17 01:13:01 user nova-compute[75226]:         <value>usb</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>pci</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>scsi</value>
Nov 17 01:13:01 user nova-compute[75226]:       </enum>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='capsType'/>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='pciBackend'/>
Nov 17 01:13:01 user nova-compute[75226]:     </hostdev>
Nov 17 01:13:01 user nova-compute[75226]:     <rng supported='yes'>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='model'>
Nov 17 01:13:01 user nova-compute[75226]:         <value>virtio</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>virtio-transitional</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>virtio-non-transitional</value>
Nov 17 01:13:01 user nova-compute[75226]:       </enum>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='backendModel'>
Nov 17 01:13:01 user nova-compute[75226]:         <value>random</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>egd</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>builtin</value>
Nov 17 01:13:01 user nova-compute[75226]:       </enum>
Nov 17 01:13:01 user nova-compute[75226]:     </rng>
Nov 17 01:13:01 user nova-compute[75226]:     <filesystem supported='yes'>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='driverType'>
Nov 17 01:13:01 user nova-compute[75226]:         <value>path</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>handle</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>virtiofs</value>
Nov 17 01:13:01 user nova-compute[75226]:       </enum>
Nov 17 01:13:01 user nova-compute[75226]:     </filesystem>
Nov 17 01:13:01 user nova-compute[75226]:     <tpm supported='yes'>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='model'>
Nov 17 01:13:01 user nova-compute[75226]:         <value>tpm-tis</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>tpm-crb</value>
Nov 17 01:13:01 user nova-compute[75226]:       </enum>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='backendModel'>
Nov 17 01:13:01 user nova-compute[75226]:         <value>passthrough</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>emulator</value>
Nov 17 01:13:01 user nova-compute[75226]:       </enum>
Nov 17 01:13:01 user nova-compute[75226]:     </tpm>
Nov 17 01:13:01 user nova-compute[75226]:   </devices>
Nov 17 01:13:01 user nova-compute[75226]:   <features>
Nov 17 01:13:01 user nova-compute[75226]:     <gic supported='no'/>
Nov 17 01:13:01 user nova-compute[75226]:     <vmcoreinfo supported='yes'/>
Nov 17 01:13:01 user nova-compute[75226]:     <genid supported='yes'/>
Nov 17 01:13:01 user nova-compute[75226]:     <backingStoreInput supported='yes'/>
Nov 17 01:13:01 user nova-compute[75226]:     <backup supported='yes'/>
Nov 17 01:13:01 user nova-compute[75226]:     <sev supported='no'/>
Nov 17 01:13:01 user nova-compute[75226]:   </features>
Nov 17 01:13:01 user nova-compute[75226]: </domainCapabilities>
Nov 17 01:13:01 user nova-compute[75226]:  {{(pid=75226) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 17 01:13:01 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-5439cf8a-5bb2-447e-9351-06058b1fe5ef None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Nov 17 01:13:01 user nova-compute[75226]: <domainCapabilities>
Nov 17 01:13:01 user nova-compute[75226]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 17 01:13:01 user nova-compute[75226]:   <domain>kvm</domain>
Nov 17 01:13:01 user nova-compute[75226]:   <machine>pc-q35-6.2</machine>
Nov 17 01:13:01 user nova-compute[75226]:   <arch>x86_64</arch>
Nov 17 01:13:01 user nova-compute[75226]:   <vcpu max='288'/>
Nov 17 01:13:01 user nova-compute[75226]:   <iothreads supported='yes'/>
Nov 17 01:13:01 user nova-compute[75226]:   <os supported='yes'>
Nov 17 01:13:01 user nova-compute[75226]:     <enum name='firmware'>
Nov 17 01:13:01 user nova-compute[75226]:       <value>efi</value>
Nov 17 01:13:01 user nova-compute[75226]:     </enum>
Nov 17 01:13:01 user nova-compute[75226]:     <loader supported='yes'>
Nov 17 01:13:01 user nova-compute[75226]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 17 01:13:01 user nova-compute[75226]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 17 01:13:01 user nova-compute[75226]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='type'>
Nov 17 01:13:01 user nova-compute[75226]:         <value>rom</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>pflash</value>
Nov 17 01:13:01 user nova-compute[75226]:       </enum>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='readonly'>
Nov 17 01:13:01 user nova-compute[75226]:         <value>yes</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>no</value>
Nov 17 01:13:01 user nova-compute[75226]:       </enum>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='secure'>
Nov 17 01:13:01 user nova-compute[75226]:         <value>yes</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>no</value>
Nov 17 01:13:01 user nova-compute[75226]:       </enum>
Nov 17 01:13:01 user nova-compute[75226]:     </loader>
Nov 17 01:13:01 user nova-compute[75226]:   </os>
Nov 17 01:13:01 user nova-compute[75226]:   <cpu>
Nov 17 01:13:01 user nova-compute[75226]:     <mode name='host-passthrough' supported='yes'>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='hostPassthroughMigratable'>
Nov 17 01:13:01 user nova-compute[75226]:         <value>on</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>off</value>
Nov 17 01:13:01 user nova-compute[75226]:       </enum>
Nov 17 01:13:01 user nova-compute[75226]:     </mode>
Nov 17 01:13:01 user nova-compute[75226]:     <mode name='maximum' supported='yes'>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='maximumMigratable'>
Nov 17 01:13:01 user nova-compute[75226]:         <value>on</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>off</value>
Nov 17 01:13:01 user nova-compute[75226]:       </enum>
Nov 17 01:13:01 user nova-compute[75226]:     </mode>
Nov 17 01:13:01 user nova-compute[75226]:     <mode name='host-model' supported='yes'>
Nov 17 01:13:01 user nova-compute[75226]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 17 01:13:01 user nova-compute[75226]:       <vendor>Intel</vendor>
Nov 17 01:13:01 user nova-compute[75226]:       <feature policy='require' name='ss'/>
Nov 17 01:13:01 user nova-compute[75226]:       <feature policy='require' name='vmx'/>
Nov 17 01:13:01 user nova-compute[75226]:       <feature policy='require' name='pcid'/>
Nov 17 01:13:01 user nova-compute[75226]:       <feature policy='require' name='hypervisor'/>
Nov 17 01:13:01 user nova-compute[75226]:       <feature policy='require' name='arat'/>
Nov 17 01:13:01 user nova-compute[75226]:       <feature policy='require' name='tsc_adjust'/>
Nov 17 01:13:01 user nova-compute[75226]:       <feature policy='require' name='umip'/>
Nov 17 01:13:01 user nova-compute[75226]:       <feature policy='require' name='md-clear'/>
Nov 17 01:13:01 user nova-compute[75226]:       <feature policy='require' name='stibp'/>
Nov 17 01:13:01 user nova-compute[75226]:       <feature policy='require' name='arch-capabilities'/>
Nov 17 01:13:01 user nova-compute[75226]:       <feature policy='require' name='ssbd'/>
Nov 17 01:13:01 user nova-compute[75226]:       <feature policy='require' name='invtsc'/>
Nov 17 01:13:01 user nova-compute[75226]:       <feature policy='require' name='ibpb'/>
Nov 17 01:13:01 user nova-compute[75226]:       <feature policy='require' name='ibrs'/>
Nov 17 01:13:01 user nova-compute[75226]:       <feature policy='require' name='amd-stibp'/>
Nov 17 01:13:01 user nova-compute[75226]:       <feature policy='require' name='amd-ssbd'/>
Nov 17 01:13:01 user nova-compute[75226]:       <feature policy='require' name='rsba'/>
Nov 17 01:13:01 user nova-compute[75226]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 17 01:13:01 user nova-compute[75226]:       <feature policy='require' name='pschange-mc-no'/>
Nov 17 01:13:01 user nova-compute[75226]:       <feature policy='disable' name='erms'/>
Nov 17 01:13:01 user nova-compute[75226]:       <feature policy='disable' name='xsaveopt'/>
Nov 17 01:13:01 user nova-compute[75226]:     </mode>
Nov 17 01:13:01 user nova-compute[75226]:     <mode name='custom' supported='yes'>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>qemu64</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='yes'>qemu32</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>phenom</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='yes'>pentium3</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='yes'>pentium2</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='yes'>pentium</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>n270</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='yes'>kvm64</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='yes'>kvm32</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='yes'>coreduo</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='yes'>core2duo</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>athlon</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='yes'>Westmere-IBRS</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='yes'>Westmere</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Snowridge</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Skylake-Server</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Skylake-Client</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>SandyBridge</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='yes'>Penryn</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Opteron_G5</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Opteron_G4</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Opteron_G3</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Opteron_G2</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='yes'>Opteron_G1</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='yes'>Nehalem</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>IvyBridge</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Icelake-Server</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Haswell-noTSX</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Haswell-IBRS</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Haswell</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>EPYC-Rome</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>EPYC-Milan</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>EPYC-IBPB</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>EPYC</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Dhyana</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Cooperlake</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='yes'>Conroe</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Cascadelake-Server</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Broadwell-noTSX</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Broadwell-IBRS</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Broadwell</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='yes'>486</model>
Nov 17 01:13:01 user nova-compute[75226]:     </mode>
Nov 17 01:13:01 user nova-compute[75226]:   </cpu>
Nov 17 01:13:01 user nova-compute[75226]:   <memoryBacking supported='yes'>
Nov 17 01:13:01 user nova-compute[75226]:     <enum name='sourceType'>
Nov 17 01:13:01 user nova-compute[75226]:       <value>file</value>
Nov 17 01:13:01 user nova-compute[75226]:       <value>anonymous</value>
Nov 17 01:13:01 user nova-compute[75226]:       <value>memfd</value>
Nov 17 01:13:01 user nova-compute[75226]:     </enum>
Nov 17 01:13:01 user nova-compute[75226]:   </memoryBacking>
Nov 17 01:13:01 user nova-compute[75226]:   <devices>
Nov 17 01:13:01 user nova-compute[75226]:     <disk supported='yes'>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='diskDevice'>
Nov 17 01:13:01 user nova-compute[75226]:         <value>disk</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>cdrom</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>floppy</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>lun</value>
Nov 17 01:13:01 user nova-compute[75226]:       </enum>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='bus'>
Nov 17 01:13:01 user nova-compute[75226]:         <value>fdc</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>scsi</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>virtio</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>usb</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>sata</value>
Nov 17 01:13:01 user nova-compute[75226]:       </enum>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='model'>
Nov 17 01:13:01 user nova-compute[75226]:         <value>virtio</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>virtio-transitional</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>virtio-non-transitional</value>
Nov 17 01:13:01 user nova-compute[75226]:       </enum>
Nov 17 01:13:01 user nova-compute[75226]:     </disk>
Nov 17 01:13:01 user nova-compute[75226]:     <graphics supported='yes'>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='type'>
Nov 17 01:13:01 user nova-compute[75226]:         <value>sdl</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>vnc</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>spice</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>egl-headless</value>
Nov 17 01:13:01 user nova-compute[75226]:       </enum>
Nov 17 01:13:01 user nova-compute[75226]:     </graphics>
Nov 17 01:13:01 user nova-compute[75226]:     <video supported='yes'>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='modelType'>
Nov 17 01:13:01 user nova-compute[75226]:         <value>vga</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>cirrus</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>vmvga</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>qxl</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>virtio</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>none</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>bochs</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>ramfb</value>
Nov 17 01:13:01 user nova-compute[75226]:       </enum>
Nov 17 01:13:01 user nova-compute[75226]:     </video>
Nov 17 01:13:01 user nova-compute[75226]:     <hostdev supported='yes'>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='mode'>
Nov 17 01:13:01 user nova-compute[75226]:         <value>subsystem</value>
Nov 17 01:13:01 user nova-compute[75226]:       </enum>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='startupPolicy'>
Nov 17 01:13:01 user nova-compute[75226]:         <value>default</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>mandatory</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>requisite</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>optional</value>
Nov 17 01:13:01 user nova-compute[75226]:       </enum>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='subsysType'>
Nov 17 01:13:01 user nova-compute[75226]:         <value>usb</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>pci</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>scsi</value>
Nov 17 01:13:01 user nova-compute[75226]:       </enum>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='capsType'/>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='pciBackend'/>
Nov 17 01:13:01 user nova-compute[75226]:     </hostdev>
Nov 17 01:13:01 user nova-compute[75226]:     <rng supported='yes'>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='model'>
Nov 17 01:13:01 user nova-compute[75226]:         <value>virtio</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>virtio-transitional</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>virtio-non-transitional</value>
Nov 17 01:13:01 user nova-compute[75226]:       </enum>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='backendModel'>
Nov 17 01:13:01 user nova-compute[75226]:         <value>random</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>egd</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>builtin</value>
Nov 17 01:13:01 user nova-compute[75226]:       </enum>
Nov 17 01:13:01 user nova-compute[75226]:     </rng>
Nov 17 01:13:01 user nova-compute[75226]:     <filesystem supported='yes'>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='driverType'>
Nov 17 01:13:01 user nova-compute[75226]:         <value>path</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>handle</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>virtiofs</value>
Nov 17 01:13:01 user nova-compute[75226]:       </enum>
Nov 17 01:13:01 user nova-compute[75226]:     </filesystem>
Nov 17 01:13:01 user nova-compute[75226]:     <tpm supported='yes'>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='model'>
Nov 17 01:13:01 user nova-compute[75226]:         <value>tpm-tis</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>tpm-crb</value>
Nov 17 01:13:01 user nova-compute[75226]:       </enum>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='backendModel'>
Nov 17 01:13:01 user nova-compute[75226]:         <value>passthrough</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>emulator</value>
Nov 17 01:13:01 user nova-compute[75226]:       </enum>
Nov 17 01:13:01 user nova-compute[75226]:     </tpm>
Nov 17 01:13:01 user nova-compute[75226]:   </devices>
Nov 17 01:13:01 user nova-compute[75226]:   <features>
Nov 17 01:13:01 user nova-compute[75226]:     <gic supported='no'/>
Nov 17 01:13:01 user nova-compute[75226]:     <vmcoreinfo supported='yes'/>
Nov 17 01:13:01 user nova-compute[75226]:     <genid supported='yes'/>
Nov 17 01:13:01 user nova-compute[75226]:     <backingStoreInput supported='yes'/>
Nov 17 01:13:01 user nova-compute[75226]:     <backup supported='yes'/>
Nov 17 01:13:01 user nova-compute[75226]:     <sev supported='no'/>
Nov 17 01:13:01 user nova-compute[75226]:   </features>
Nov 17 01:13:01 user nova-compute[75226]: </domainCapabilities>
Nov 17 01:13:01 user nova-compute[75226]:  {{(pid=75226) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 17 01:13:01 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-5439cf8a-5bb2-447e-9351-06058b1fe5ef None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Nov 17 01:13:01 user nova-compute[75226]: <domainCapabilities>
Nov 17 01:13:01 user nova-compute[75226]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 17 01:13:01 user nova-compute[75226]:   <domain>kvm</domain>
Nov 17 01:13:01 user nova-compute[75226]:   <machine>pc-q35-jammy</machine>
Nov 17 01:13:01 user nova-compute[75226]:   <arch>x86_64</arch>
Nov 17 01:13:01 user nova-compute[75226]:   <vcpu max='288'/>
Nov 17 01:13:01 user nova-compute[75226]:   <iothreads supported='yes'/>
Nov 17 01:13:01 user nova-compute[75226]:   <os supported='yes'>
Nov 17 01:13:01 user nova-compute[75226]:     <enum name='firmware'>
Nov 17 01:13:01 user nova-compute[75226]:       <value>efi</value>
Nov 17 01:13:01 user nova-compute[75226]:     </enum>
Nov 17 01:13:01 user nova-compute[75226]:     <loader supported='yes'>
Nov 17 01:13:01 user nova-compute[75226]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 17 01:13:01 user nova-compute[75226]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 17 01:13:01 user nova-compute[75226]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='type'>
Nov 17 01:13:01 user nova-compute[75226]:         <value>rom</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>pflash</value>
Nov 17 01:13:01 user nova-compute[75226]:       </enum>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='readonly'>
Nov 17 01:13:01 user nova-compute[75226]:         <value>yes</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>no</value>
Nov 17 01:13:01 user nova-compute[75226]:       </enum>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='secure'>
Nov 17 01:13:01 user nova-compute[75226]:         <value>yes</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>no</value>
Nov 17 01:13:01 user nova-compute[75226]:       </enum>
Nov 17 01:13:01 user nova-compute[75226]:     </loader>
Nov 17 01:13:01 user nova-compute[75226]:   </os>
Nov 17 01:13:01 user nova-compute[75226]:   <cpu>
Nov 17 01:13:01 user nova-compute[75226]:     <mode name='host-passthrough' supported='yes'>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='hostPassthroughMigratable'>
Nov 17 01:13:01 user nova-compute[75226]:         <value>on</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>off</value>
Nov 17 01:13:01 user nova-compute[75226]:       </enum>
Nov 17 01:13:01 user nova-compute[75226]:     </mode>
Nov 17 01:13:01 user nova-compute[75226]:     <mode name='maximum' supported='yes'>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='maximumMigratable'>
Nov 17 01:13:01 user nova-compute[75226]:         <value>on</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>off</value>
Nov 17 01:13:01 user nova-compute[75226]:       </enum>
Nov 17 01:13:01 user nova-compute[75226]:     </mode>
Nov 17 01:13:01 user nova-compute[75226]:     <mode name='host-model' supported='yes'>
Nov 17 01:13:01 user nova-compute[75226]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 17 01:13:01 user nova-compute[75226]:       <vendor>Intel</vendor>
Nov 17 01:13:01 user nova-compute[75226]:       <feature policy='require' name='ss'/>
Nov 17 01:13:01 user nova-compute[75226]:       <feature policy='require' name='vmx'/>
Nov 17 01:13:01 user nova-compute[75226]:       <feature policy='require' name='pcid'/>
Nov 17 01:13:01 user nova-compute[75226]:       <feature policy='require' name='hypervisor'/>
Nov 17 01:13:01 user nova-compute[75226]:       <feature policy='require' name='arat'/>
Nov 17 01:13:01 user nova-compute[75226]:       <feature policy='require' name='tsc_adjust'/>
Nov 17 01:13:01 user nova-compute[75226]:       <feature policy='require' name='umip'/>
Nov 17 01:13:01 user nova-compute[75226]:       <feature policy='require' name='md-clear'/>
Nov 17 01:13:01 user nova-compute[75226]:       <feature policy='require' name='stibp'/>
Nov 17 01:13:01 user nova-compute[75226]:       <feature policy='require' name='arch-capabilities'/>
Nov 17 01:13:01 user nova-compute[75226]:       <feature policy='require' name='ssbd'/>
Nov 17 01:13:01 user nova-compute[75226]:       <feature policy='require' name='invtsc'/>
Nov 17 01:13:01 user nova-compute[75226]:       <feature policy='require' name='ibpb'/>
Nov 17 01:13:01 user nova-compute[75226]:       <feature policy='require' name='ibrs'/>
Nov 17 01:13:01 user nova-compute[75226]:       <feature policy='require' name='amd-stibp'/>
Nov 17 01:13:01 user nova-compute[75226]:       <feature policy='require' name='amd-ssbd'/>
Nov 17 01:13:01 user nova-compute[75226]:       <feature policy='require' name='rsba'/>
Nov 17 01:13:01 user nova-compute[75226]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 17 01:13:01 user nova-compute[75226]:       <feature policy='require' name='pschange-mc-no'/>
Nov 17 01:13:01 user nova-compute[75226]:       <feature policy='disable' name='erms'/>
Nov 17 01:13:01 user nova-compute[75226]:       <feature policy='disable' name='xsaveopt'/>
Nov 17 01:13:01 user nova-compute[75226]:     </mode>
Nov 17 01:13:01 user nova-compute[75226]:     <mode name='custom' supported='yes'>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>qemu64</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='yes'>qemu32</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>phenom</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='yes'>pentium3</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='yes'>pentium2</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='yes'>pentium</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>n270</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='yes'>kvm64</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='yes'>kvm32</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='yes'>coreduo</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='yes'>core2duo</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>athlon</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='yes'>Westmere-IBRS</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='yes'>Westmere</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Snowridge</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Skylake-Server</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Skylake-Client</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>SandyBridge</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='yes'>Penryn</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Opteron_G5</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Opteron_G4</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Opteron_G3</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Opteron_G2</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='yes'>Opteron_G1</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='yes'>Nehalem</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>IvyBridge</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Icelake-Server</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Haswell-noTSX</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Haswell-IBRS</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Haswell</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>EPYC-Rome</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>EPYC-Milan</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>EPYC-IBPB</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>EPYC</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Dhyana</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Cooperlake</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='yes'>Conroe</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Cascadelake-Server</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Broadwell-noTSX</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Broadwell-IBRS</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='no'>Broadwell</model>
Nov 17 01:13:01 user nova-compute[75226]:       <model usable='yes'>486</model>
Nov 17 01:13:01 user nova-compute[75226]:     </mode>
Nov 17 01:13:01 user nova-compute[75226]:   </cpu>
Nov 17 01:13:01 user nova-compute[75226]:   <memoryBacking supported='yes'>
Nov 17 01:13:01 user nova-compute[75226]:     <enum name='sourceType'>
Nov 17 01:13:01 user nova-compute[75226]:       <value>file</value>
Nov 17 01:13:01 user nova-compute[75226]:       <value>anonymous</value>
Nov 17 01:13:01 user nova-compute[75226]:       <value>memfd</value>
Nov 17 01:13:01 user nova-compute[75226]:     </enum>
Nov 17 01:13:01 user nova-compute[75226]:   </memoryBacking>
Nov 17 01:13:01 user nova-compute[75226]:   <devices>
Nov 17 01:13:01 user nova-compute[75226]:     <disk supported='yes'>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='diskDevice'>
Nov 17 01:13:01 user nova-compute[75226]:         <value>disk</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>cdrom</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>floppy</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>lun</value>
Nov 17 01:13:01 user nova-compute[75226]:       </enum>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='bus'>
Nov 17 01:13:01 user nova-compute[75226]:         <value>fdc</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>scsi</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>virtio</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>usb</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>sata</value>
Nov 17 01:13:01 user nova-compute[75226]:       </enum>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='model'>
Nov 17 01:13:01 user nova-compute[75226]:         <value>virtio</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>virtio-transitional</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>virtio-non-transitional</value>
Nov 17 01:13:01 user nova-compute[75226]:       </enum>
Nov 17 01:13:01 user nova-compute[75226]:     </disk>
Nov 17 01:13:01 user nova-compute[75226]:     <graphics supported='yes'>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='type'>
Nov 17 01:13:01 user nova-compute[75226]:         <value>sdl</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>vnc</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>spice</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>egl-headless</value>
Nov 17 01:13:01 user nova-compute[75226]:       </enum>
Nov 17 01:13:01 user nova-compute[75226]:     </graphics>
Nov 17 01:13:01 user nova-compute[75226]:     <video supported='yes'>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='modelType'>
Nov 17 01:13:01 user nova-compute[75226]:         <value>vga</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>cirrus</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>vmvga</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>qxl</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>virtio</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>none</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>bochs</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>ramfb</value>
Nov 17 01:13:01 user nova-compute[75226]:       </enum>
Nov 17 01:13:01 user nova-compute[75226]:     </video>
Nov 17 01:13:01 user nova-compute[75226]:     <hostdev supported='yes'>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='mode'>
Nov 17 01:13:01 user nova-compute[75226]:         <value>subsystem</value>
Nov 17 01:13:01 user nova-compute[75226]:       </enum>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='startupPolicy'>
Nov 17 01:13:01 user nova-compute[75226]:         <value>default</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>mandatory</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>requisite</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>optional</value>
Nov 17 01:13:01 user nova-compute[75226]:       </enum>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='subsysType'>
Nov 17 01:13:01 user nova-compute[75226]:         <value>usb</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>pci</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>scsi</value>
Nov 17 01:13:01 user nova-compute[75226]:       </enum>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='capsType'/>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='pciBackend'/>
Nov 17 01:13:01 user nova-compute[75226]:     </hostdev>
Nov 17 01:13:01 user nova-compute[75226]:     <rng supported='yes'>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='model'>
Nov 17 01:13:01 user nova-compute[75226]:         <value>virtio</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>virtio-transitional</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>virtio-non-transitional</value>
Nov 17 01:13:01 user nova-compute[75226]:       </enum>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='backendModel'>
Nov 17 01:13:01 user nova-compute[75226]:         <value>random</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>egd</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>builtin</value>
Nov 17 01:13:01 user nova-compute[75226]:       </enum>
Nov 17 01:13:01 user nova-compute[75226]:     </rng>
Nov 17 01:13:01 user nova-compute[75226]:     <filesystem supported='yes'>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='driverType'>
Nov 17 01:13:01 user nova-compute[75226]:         <value>path</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>handle</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>virtiofs</value>
Nov 17 01:13:01 user nova-compute[75226]:       </enum>
Nov 17 01:13:01 user nova-compute[75226]:     </filesystem>
Nov 17 01:13:01 user nova-compute[75226]:     <tpm supported='yes'>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='model'>
Nov 17 01:13:01 user nova-compute[75226]:         <value>tpm-tis</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>tpm-crb</value>
Nov 17 01:13:01 user nova-compute[75226]:       </enum>
Nov 17 01:13:01 user nova-compute[75226]:       <enum name='backendModel'>
Nov 17 01:13:01 user nova-compute[75226]:         <value>passthrough</value>
Nov 17 01:13:01 user nova-compute[75226]:         <value>emulator</value>
Nov 17 01:13:01 user nova-compute[75226]:       </enum>
Nov 17 01:13:01 user nova-compute[75226]:     </tpm>
Nov 17 01:13:01 user nova-compute[75226]:   </devices>
Nov 17 01:13:01 user nova-compute[75226]:   <features>
Nov 17 01:13:01 user nova-compute[75226]:     <gic supported='no'/>
Nov 17 01:13:01 user nova-compute[75226]:     <vmcoreinfo supported='yes'/>
Nov 17 01:13:01 user nova-compute[75226]:     <genid supported='yes'/>
Nov 17 01:13:01 user nova-compute[75226]:     <backingStoreInput supported='yes'/>
Nov 17 01:13:01 user nova-compute[75226]:     <backup supported='yes'/>
Nov 17 01:13:01 user nova-compute[75226]:     <sev supported='no'/>
Nov 17 01:13:01 user nova-compute[75226]:   </features>
Nov 17 01:13:01 user nova-compute[75226]: </domainCapabilities>
Nov 17 01:13:01 user nova-compute[75226]:  {{(pid=75226) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 17 01:13:01 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-5439cf8a-5bb2-447e-9351-06058b1fe5ef None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=75226) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 17 01:13:01 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-5439cf8a-5bb2-447e-9351-06058b1fe5ef None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=75226) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 17 01:13:01 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-5439cf8a-5bb2-447e-9351-06058b1fe5ef None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=75226) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 17 01:13:01 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-5439cf8a-5bb2-447e-9351-06058b1fe5ef None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=75226) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 17 01:13:01 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-5439cf8a-5bb2-447e-9351-06058b1fe5ef None None] Checking secure boot support for host arch (x86_64) {{(pid=75226) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 17 01:13:01 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-5439cf8a-5bb2-447e-9351-06058b1fe5ef None None] Checking secure boot support for host arch (x86_64) {{(pid=75226) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 17 01:13:01 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-5439cf8a-5bb2-447e-9351-06058b1fe5ef None None] Checking secure boot support for host arch (x86_64) {{(pid=75226) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 17 01:13:01 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-5439cf8a-5bb2-447e-9351-06058b1fe5ef None None] Checking secure boot support for host arch (x86_64) {{(pid=75226) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 17 01:13:01 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-5439cf8a-5bb2-447e-9351-06058b1fe5ef None None] Checking secure boot support for host arch (x86_64) {{(pid=75226) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 17 01:13:01 user nova-compute[75226]: INFO nova.virt.libvirt.host [None req-5439cf8a-5bb2-447e-9351-06058b1fe5ef None None] Secure Boot support detected
Nov 17 01:13:01 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-5439cf8a-5bb2-447e-9351-06058b1fe5ef None None] cpu compare xml: <cpu match="exact">
Nov 17 01:13:01 user nova-compute[75226]:   <model>Nehalem</model>
Nov 17 01:13:01 user nova-compute[75226]: </cpu>
Nov 17 01:13:01 user nova-compute[75226]:  {{(pid=75226) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Nov 17 01:13:01 user nova-compute[75226]: INFO nova.virt.node [None req-5439cf8a-5bb2-447e-9351-06058b1fe5ef None None] Generated node identity f431122b-abb2-4ecb-9e21-e3ec333d823b
Nov 17 01:13:01 user nova-compute[75226]: INFO nova.virt.node [None req-5439cf8a-5bb2-447e-9351-06058b1fe5ef None None] Wrote node identity f431122b-abb2-4ecb-9e21-e3ec333d823b to /opt/stack/data/nova/compute_id
Nov 17 01:13:01 user nova-compute[75226]: WARNING nova.compute.manager [None req-5439cf8a-5bb2-447e-9351-06058b1fe5ef None None] Compute nodes ['f431122b-abb2-4ecb-9e21-e3ec333d823b'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Nov 17 01:13:01 user nova-compute[75226]: INFO nova.compute.manager [None req-5439cf8a-5bb2-447e-9351-06058b1fe5ef None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Nov 17 01:13:01 user nova-compute[75226]: WARNING nova.compute.manager [None req-5439cf8a-5bb2-447e-9351-06058b1fe5ef None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 17 01:13:01 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-5439cf8a-5bb2-447e-9351-06058b1fe5ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:13:01 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-5439cf8a-5bb2-447e-9351-06058b1fe5ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:13:01 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-5439cf8a-5bb2-447e-9351-06058b1fe5ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:13:01 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-5439cf8a-5bb2-447e-9351-06058b1fe5ef None None] Auditing locally available compute resources for user (node: user) {{(pid=75226) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 17 01:13:01 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-5439cf8a-5bb2-447e-9351-06058b1fe5ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:13:01 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-5439cf8a-5bb2-447e-9351-06058b1fe5ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:13:01 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-5439cf8a-5bb2-447e-9351-06058b1fe5ef None None] Hypervisor/Node resource view: name=user free_ram=10966MB free_disk=26.188186645507812GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75226) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 17 01:13:01 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-5439cf8a-5bb2-447e-9351-06058b1fe5ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:13:01 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-5439cf8a-5bb2-447e-9351-06058b1fe5ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:13:01 user nova-compute[75226]: WARNING nova.compute.resource_tracker [None req-5439cf8a-5bb2-447e-9351-06058b1fe5ef None None] No compute node record for user:f431122b-abb2-4ecb-9e21-e3ec333d823b: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host f431122b-abb2-4ecb-9e21-e3ec333d823b could not be found.
Nov 17 01:13:01 user nova-compute[75226]: INFO nova.compute.resource_tracker [None req-5439cf8a-5bb2-447e-9351-06058b1fe5ef None None] Compute node record created for user:user with uuid: f431122b-abb2-4ecb-9e21-e3ec333d823b
Nov 17 01:13:01 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-5439cf8a-5bb2-447e-9351-06058b1fe5ef None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75226) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 17 01:13:01 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-5439cf8a-5bb2-447e-9351-06058b1fe5ef None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75226) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 17 01:13:02 user nova-compute[75226]: INFO nova.scheduler.client.report [None req-5439cf8a-5bb2-447e-9351-06058b1fe5ef None None] [req-3a254d42-891e-4c3c-b519-6f4903010e94] Created resource provider record via placement API for resource provider with UUID f431122b-abb2-4ecb-9e21-e3ec333d823b and name user.
Nov 17 01:13:02 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-5439cf8a-5bb2-447e-9351-06058b1fe5ef None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=75226) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Nov 17 01:13:02 user nova-compute[75226]: INFO nova.virt.libvirt.host [None req-5439cf8a-5bb2-447e-9351-06058b1fe5ef None None] kernel doesn't support AMD SEV
Nov 17 01:13:02 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-5439cf8a-5bb2-447e-9351-06058b1fe5ef None None] Updating inventory in ProviderTree for provider f431122b-abb2-4ecb-9e21-e3ec333d823b with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 17 01:13:02 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-5439cf8a-5bb2-447e-9351-06058b1fe5ef None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75226) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 17 01:13:02 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-5439cf8a-5bb2-447e-9351-06058b1fe5ef None None] Libvirt baseline CPU <cpu>
Nov 17 01:13:02 user nova-compute[75226]:   <arch>x86_64</arch>
Nov 17 01:13:02 user nova-compute[75226]:   <model>Nehalem</model>
Nov 17 01:13:02 user nova-compute[75226]:   <vendor>Intel</vendor>
Nov 17 01:13:02 user nova-compute[75226]:   <topology sockets="6" cores="1" threads="1"/>
Nov 17 01:13:02 user nova-compute[75226]: </cpu>
Nov 17 01:13:02 user nova-compute[75226]:  {{(pid=75226) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Nov 17 01:13:02 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-5439cf8a-5bb2-447e-9351-06058b1fe5ef None None] Updated inventory for provider f431122b-abb2-4ecb-9e21-e3ec333d823b with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Nov 17 01:13:02 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-5439cf8a-5bb2-447e-9351-06058b1fe5ef None None] Updating resource provider f431122b-abb2-4ecb-9e21-e3ec333d823b generation from 0 to 1 during operation: update_inventory {{(pid=75226) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 17 01:13:02 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-5439cf8a-5bb2-447e-9351-06058b1fe5ef None None] Updating inventory in ProviderTree for provider f431122b-abb2-4ecb-9e21-e3ec333d823b with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 17 01:13:02 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-5439cf8a-5bb2-447e-9351-06058b1fe5ef None None] Updating resource provider f431122b-abb2-4ecb-9e21-e3ec333d823b generation from 1 to 2 during operation: update_traits {{(pid=75226) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 17 01:13:02 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-5439cf8a-5bb2-447e-9351-06058b1fe5ef None None] Compute_service record updated for user:user {{(pid=75226) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 17 01:13:02 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-5439cf8a-5bb2-447e-9351-06058b1fe5ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.673s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:13:02 user nova-compute[75226]: DEBUG nova.service [None req-5439cf8a-5bb2-447e-9351-06058b1fe5ef None None] Creating RPC server for service compute {{(pid=75226) start /opt/stack/nova/nova/service.py:182}}
Nov 17 01:13:02 user nova-compute[75226]: DEBUG nova.service [None req-5439cf8a-5bb2-447e-9351-06058b1fe5ef None None] Join ServiceGroup membership for this service compute {{(pid=75226) start /opt/stack/nova/nova/service.py:199}}
Nov 17 01:13:02 user nova-compute[75226]: DEBUG nova.servicegroup.drivers.db [None req-5439cf8a-5bb2-447e-9351-06058b1fe5ef None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=75226) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Nov 17 01:13:52 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:13:52 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:13:52 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:13:52 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:13:52 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Starting heal instance info cache {{(pid=75226) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 17 01:13:52 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Rebuilding the list of instances to heal {{(pid=75226) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 17 01:13:52 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Didn't find any instances for network info cache update. {{(pid=75226) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 17 01:13:52 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:13:52 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:13:52 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:13:52 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:13:52 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:13:52 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:13:52 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75226) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 17 01:13:52 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:13:53 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:13:53 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:13:53 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:13:53 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75226) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 17 01:13:53 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:13:53 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:13:53 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Hypervisor/Node resource view: name=user free_ram=10426MB free_disk=25.960716247558594GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75226) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 17 01:13:53 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:13:53 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:13:53 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75226) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 17 01:13:53 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75226) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 17 01:13:53 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:13:53 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:13:53 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Compute_service record updated for user:user {{(pid=75226) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 17 01:13:53 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.178s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:14:53 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:14:53 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:14:53 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:14:53 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:14:53 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:14:53 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75226) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 17 01:14:53 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:14:53 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Starting heal instance info cache {{(pid=75226) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 17 01:14:53 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Rebuilding the list of instances to heal {{(pid=75226) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 17 01:14:53 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Didn't find any instances for network info cache update. {{(pid=75226) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 17 01:14:53 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:14:54 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:14:54 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:14:54 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:14:54 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:14:54 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:14:54 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:14:54 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75226) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 17 01:14:55 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:14:55 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:14:55 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Hypervisor/Node resource view: name=user free_ram=10353MB free_disk=26.025272369384766GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75226) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 17 01:14:55 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:14:55 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:14:55 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75226) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 17 01:14:55 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75226) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 17 01:14:55 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:14:55 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:14:55 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Compute_service record updated for user:user {{(pid=75226) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 17 01:14:55 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.127s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:15:53 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:15:53 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:15:54 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:15:54 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:15:54 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:15:54 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75226) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 17 01:15:55 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:15:55 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Starting heal instance info cache {{(pid=75226) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 17 01:15:55 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Rebuilding the list of instances to heal {{(pid=75226) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 17 01:15:55 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Didn't find any instances for network info cache update. {{(pid=75226) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 17 01:15:56 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:15:56 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:15:56 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:15:56 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:15:56 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:15:56 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:15:56 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75226) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 17 01:15:57 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:15:57 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:15:57 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Hypervisor/Node resource view: name=user free_ram=10397MB free_disk=25.777446746826172GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75226) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 17 01:15:57 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:15:57 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:15:57 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75226) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 17 01:15:57 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75226) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 17 01:15:57 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:15:57 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:15:57 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Compute_service record updated for user:user {{(pid=75226) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 17 01:15:57 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.116s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:16:53 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:16:53 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:16:53 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:16:54 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:16:55 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:16:55 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75226) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 17 01:16:56 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:16:56 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:16:56 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:16:56 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:16:56 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:16:56 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:16:56 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75226) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 17 01:16:57 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:16:57 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:16:57 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Hypervisor/Node resource view: name=user free_ram=9675MB free_disk=25.797836303710938GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75226) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 17 01:16:57 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:16:57 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:16:57 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75226) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 17 01:16:57 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75226) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 17 01:16:57 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:16:57 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:16:57 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Compute_service record updated for user:user {{(pid=75226) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 17 01:16:57 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.131s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:16:58 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:16:58 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Starting heal instance info cache {{(pid=75226) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 17 01:16:58 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Rebuilding the list of instances to heal {{(pid=75226) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 17 01:16:58 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Didn't find any instances for network info cache update. {{(pid=75226) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 17 01:16:58 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:17:03 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-0fa22ffc-fe17-4dad-869e-6faf857cba30 tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] Acquiring lock "19250ac2-1b3f-4fe9-80b0-406b181929b6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:17:03 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-0fa22ffc-fe17-4dad-869e-6faf857cba30 tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] Lock "19250ac2-1b3f-4fe9-80b0-406b181929b6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:17:03 user nova-compute[75226]: DEBUG nova.compute.manager [None req-0fa22ffc-fe17-4dad-869e-6faf857cba30 tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] [instance: 19250ac2-1b3f-4fe9-80b0-406b181929b6] Starting instance... {{(pid=75226) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 17 01:17:03 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-0fa22ffc-fe17-4dad-869e-6faf857cba30 tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:17:03 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-0fa22ffc-fe17-4dad-869e-6faf857cba30 tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:17:03 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-0fa22ffc-fe17-4dad-869e-6faf857cba30 tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75226) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 17 01:17:03 user nova-compute[75226]: INFO nova.compute.claims [None req-0fa22ffc-fe17-4dad-869e-6faf857cba30 tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] [instance: 19250ac2-1b3f-4fe9-80b0-406b181929b6] Claim successful on node user
Nov 17 01:17:03 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-0fa22ffc-fe17-4dad-869e-6faf857cba30 tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:17:03 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-0fa22ffc-fe17-4dad-869e-6faf857cba30 tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:17:03 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-0fa22ffc-fe17-4dad-869e-6faf857cba30 tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.322s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:17:03 user nova-compute[75226]: DEBUG nova.compute.manager [None req-0fa22ffc-fe17-4dad-869e-6faf857cba30 tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] [instance: 19250ac2-1b3f-4fe9-80b0-406b181929b6] Start building networks asynchronously for instance. {{(pid=75226) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 17 01:17:03 user nova-compute[75226]: DEBUG nova.compute.manager [None req-0fa22ffc-fe17-4dad-869e-6faf857cba30 tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] [instance: 19250ac2-1b3f-4fe9-80b0-406b181929b6] Allocating IP information in the background. {{(pid=75226) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 17 01:17:03 user nova-compute[75226]: DEBUG nova.network.neutron [None req-0fa22ffc-fe17-4dad-869e-6faf857cba30 tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] [instance: 19250ac2-1b3f-4fe9-80b0-406b181929b6] allocate_for_instance() {{(pid=75226) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 17 01:17:04 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-0fa22ffc-fe17-4dad-869e-6faf857cba30 tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] [instance: 19250ac2-1b3f-4fe9-80b0-406b181929b6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 17 01:17:04 user nova-compute[75226]: DEBUG nova.compute.manager [None req-0fa22ffc-fe17-4dad-869e-6faf857cba30 tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] [instance: 19250ac2-1b3f-4fe9-80b0-406b181929b6] Start building block device mappings for instance. {{(pid=75226) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 17 01:17:04 user nova-compute[75226]: DEBUG nova.compute.manager [None req-0fa22ffc-fe17-4dad-869e-6faf857cba30 tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] [instance: 19250ac2-1b3f-4fe9-80b0-406b181929b6] Start spawning the instance on the hypervisor. {{(pid=75226) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 17 01:17:04 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-0fa22ffc-fe17-4dad-869e-6faf857cba30 tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] [instance: 19250ac2-1b3f-4fe9-80b0-406b181929b6] Creating instance directory {{(pid=75226) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 17 01:17:04 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-0fa22ffc-fe17-4dad-869e-6faf857cba30 tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] [instance: 19250ac2-1b3f-4fe9-80b0-406b181929b6] Creating image(s)
Nov 17 01:17:04 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-0fa22ffc-fe17-4dad-869e-6faf857cba30 tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] Acquiring lock "/opt/stack/data/nova/instances/19250ac2-1b3f-4fe9-80b0-406b181929b6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:17:04 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-0fa22ffc-fe17-4dad-869e-6faf857cba30 tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] Lock "/opt/stack/data/nova/instances/19250ac2-1b3f-4fe9-80b0-406b181929b6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:17:04 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-0fa22ffc-fe17-4dad-869e-6faf857cba30 tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] Lock "/opt/stack/data/nova/instances/19250ac2-1b3f-4fe9-80b0-406b181929b6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:17:04 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-0fa22ffc-fe17-4dad-869e-6faf857cba30 tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] Acquiring lock "a8a62c2546af3a2036b853250c5ac64d4c6b4371" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:17:04 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-0fa22ffc-fe17-4dad-869e-6faf857cba30 tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] Lock "a8a62c2546af3a2036b853250c5ac64d4c6b4371" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:17:04 user nova-compute[75226]: DEBUG nova.policy [None req-0fa22ffc-fe17-4dad-869e-6faf857cba30 tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e1bdd8e75fdd44a7b5706d42e831bb82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cc9e48d967049cab3393af3f9dcbe48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75226) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 17 01:17:04 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-191b96b5-dccc-49a3-a28d-1cb312c2c5d5 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Acquiring lock "aa84e575-bdad-45b9-80ce-86b1c2826fb0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:17:04 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-191b96b5-dccc-49a3-a28d-1cb312c2c5d5 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Lock "aa84e575-bdad-45b9-80ce-86b1c2826fb0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:17:04 user nova-compute[75226]: DEBUG nova.compute.manager [None req-191b96b5-dccc-49a3-a28d-1cb312c2c5d5 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: aa84e575-bdad-45b9-80ce-86b1c2826fb0] Starting instance... {{(pid=75226) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 17 01:17:04 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-191b96b5-dccc-49a3-a28d-1cb312c2c5d5 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:17:04 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-191b96b5-dccc-49a3-a28d-1cb312c2c5d5 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:17:04 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-191b96b5-dccc-49a3-a28d-1cb312c2c5d5 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75226) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 17 01:17:04 user nova-compute[75226]: INFO nova.compute.claims [None req-191b96b5-dccc-49a3-a28d-1cb312c2c5d5 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: aa84e575-bdad-45b9-80ce-86b1c2826fb0] Claim successful on node user
Nov 17 01:17:05 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-0fa22ffc-fe17-4dad-869e-6faf857cba30 tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371.part --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:17:05 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-191b96b5-dccc-49a3-a28d-1cb312c2c5d5 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:17:05 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-191b96b5-dccc-49a3-a28d-1cb312c2c5d5 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:17:05 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-191b96b5-dccc-49a3-a28d-1cb312c2c5d5 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.674s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:17:05 user nova-compute[75226]: DEBUG nova.compute.manager [None req-191b96b5-dccc-49a3-a28d-1cb312c2c5d5 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: aa84e575-bdad-45b9-80ce-86b1c2826fb0] Start building networks asynchronously for instance. {{(pid=75226) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 17 01:17:05 user nova-compute[75226]: DEBUG nova.compute.manager [None req-191b96b5-dccc-49a3-a28d-1cb312c2c5d5 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: aa84e575-bdad-45b9-80ce-86b1c2826fb0] Allocating IP information in the background. {{(pid=75226) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 17 01:17:05 user nova-compute[75226]: DEBUG nova.network.neutron [None req-191b96b5-dccc-49a3-a28d-1cb312c2c5d5 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: aa84e575-bdad-45b9-80ce-86b1c2826fb0] allocate_for_instance() {{(pid=75226) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 17 01:17:05 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-0fa22ffc-fe17-4dad-869e-6faf857cba30 tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371.part --force-share --output=json" returned: 0 in 0.189s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:17:05 user nova-compute[75226]: DEBUG nova.virt.images [None req-0fa22ffc-fe17-4dad-869e-6faf857cba30 tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] 0b369aea-6f3f-4690-9f01-229b90ab6310 was qcow2, converting to raw {{(pid=75226) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 17 01:17:05 user nova-compute[75226]: DEBUG nova.privsep.utils [None req-0fa22ffc-fe17-4dad-869e-6faf857cba30 tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75226) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 17 01:17:05 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-0fa22ffc-fe17-4dad-869e-6faf857cba30 tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371.part /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371.converted {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:17:05 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-191b96b5-dccc-49a3-a28d-1cb312c2c5d5 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: aa84e575-bdad-45b9-80ce-86b1c2826fb0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 17 01:17:05 user nova-compute[75226]: DEBUG nova.compute.manager [None req-191b96b5-dccc-49a3-a28d-1cb312c2c5d5 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: aa84e575-bdad-45b9-80ce-86b1c2826fb0] Start building block device mappings for instance. {{(pid=75226) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 17 01:17:05 user nova-compute[75226]: DEBUG nova.policy [None req-191b96b5-dccc-49a3-a28d-1cb312c2c5d5 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1b793ce05bf44b939a9fb5a914a04cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6cb6f679ee4468d82cc7fb5d0f67be9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75226) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 17 01:17:05 user nova-compute[75226]: DEBUG nova.compute.manager [None req-191b96b5-dccc-49a3-a28d-1cb312c2c5d5 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: aa84e575-bdad-45b9-80ce-86b1c2826fb0] Start spawning the instance on the hypervisor. {{(pid=75226) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 17 01:17:05 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-191b96b5-dccc-49a3-a28d-1cb312c2c5d5 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: aa84e575-bdad-45b9-80ce-86b1c2826fb0] Creating instance directory {{(pid=75226) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 17 01:17:05 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-191b96b5-dccc-49a3-a28d-1cb312c2c5d5 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: aa84e575-bdad-45b9-80ce-86b1c2826fb0] Creating image(s)
Nov 17 01:17:05 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-191b96b5-dccc-49a3-a28d-1cb312c2c5d5 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Acquiring lock "/opt/stack/data/nova/instances/aa84e575-bdad-45b9-80ce-86b1c2826fb0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:17:05 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-191b96b5-dccc-49a3-a28d-1cb312c2c5d5 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Lock "/opt/stack/data/nova/instances/aa84e575-bdad-45b9-80ce-86b1c2826fb0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:17:05 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-191b96b5-dccc-49a3-a28d-1cb312c2c5d5 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Lock "/opt/stack/data/nova/instances/aa84e575-bdad-45b9-80ce-86b1c2826fb0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:17:05 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-191b96b5-dccc-49a3-a28d-1cb312c2c5d5 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Acquiring lock "a8a62c2546af3a2036b853250c5ac64d4c6b4371" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:17:05 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-0fa22ffc-fe17-4dad-869e-6faf857cba30 tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371.part /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371.converted" returned: 0 in 0.334s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:17:05 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-0fa22ffc-fe17-4dad-869e-6faf857cba30 tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371.converted --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:17:05 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-0fa22ffc-fe17-4dad-869e-6faf857cba30 tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371.converted --force-share --output=json" returned: 0 in 0.152s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:17:05 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-0fa22ffc-fe17-4dad-869e-6faf857cba30 tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] Lock "a8a62c2546af3a2036b853250c5ac64d4c6b4371" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.519s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:17:05 user nova-compute[75226]: INFO oslo.privsep.daemon [None req-0fa22ffc-fe17-4dad-869e-6faf857cba30 tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp07fd3k9_/privsep.sock']
Nov 17 01:17:05 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-191b96b5-dccc-49a3-a28d-1cb312c2c5d5 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Lock "a8a62c2546af3a2036b853250c5ac64d4c6b4371" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.187s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:17:05 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-191b96b5-dccc-49a3-a28d-1cb312c2c5d5 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Lock "a8a62c2546af3a2036b853250c5ac64d4c6b4371" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:17:05 user sudo[84502]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp07fd3k9_/privsep.sock
Nov 17 01:17:05 user sudo[84502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 17 01:17:06 user nova-compute[75226]: DEBUG nova.network.neutron [None req-0fa22ffc-fe17-4dad-869e-6faf857cba30 tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] [instance: 19250ac2-1b3f-4fe9-80b0-406b181929b6] Successfully created port: 093abf0b-d4eb-4be3-bda0-4a7d19fe6ac2 {{(pid=75226) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 17 01:17:07 user nova-compute[75226]: DEBUG nova.network.neutron [None req-191b96b5-dccc-49a3-a28d-1cb312c2c5d5 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: aa84e575-bdad-45b9-80ce-86b1c2826fb0] Successfully created port: 734a9e23-26e5-4282-b842-62e0bb37c782 {{(pid=75226) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 17 01:17:07 user sudo[84502]: pam_unix(sudo:session): session closed for user root
Nov 17 01:17:07 user nova-compute[75226]: INFO oslo.privsep.daemon [None req-0fa22ffc-fe17-4dad-869e-6faf857cba30 tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] Spawned new privsep daemon via rootwrap
Nov 17 01:17:07 user nova-compute[75226]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 17 01:17:07 user nova-compute[75226]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 17 01:17:07 user nova-compute[75226]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Nov 17 01:17:07 user nova-compute[75226]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84507
Nov 17 01:17:07 user nova-compute[75226]: WARNING oslo_privsep.priv_context [None req-191b96b5-dccc-49a3-a28d-1cb312c2c5d5 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] privsep daemon already running
Nov 17 01:17:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-0fa22ffc-fe17-4dad-869e-6faf857cba30 tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:17:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-191b96b5-dccc-49a3-a28d-1cb312c2c5d5 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:17:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-191b96b5-dccc-49a3-a28d-1cb312c2c5d5 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json" returned: 0 in 0.179s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:17:07 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-191b96b5-dccc-49a3-a28d-1cb312c2c5d5 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Acquiring lock "a8a62c2546af3a2036b853250c5ac64d4c6b4371" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:17:07 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-191b96b5-dccc-49a3-a28d-1cb312c2c5d5 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Lock "a8a62c2546af3a2036b853250c5ac64d4c6b4371" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:17:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-191b96b5-dccc-49a3-a28d-1cb312c2c5d5 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:17:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-0fa22ffc-fe17-4dad-869e-6faf857cba30 tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json" returned: 0 in 0.238s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:17:07 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-0fa22ffc-fe17-4dad-869e-6faf857cba30 tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] Acquiring lock "a8a62c2546af3a2036b853250c5ac64d4c6b4371" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:17:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-191b96b5-dccc-49a3-a28d-1cb312c2c5d5 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json" returned: 0 in 0.214s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:17:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-191b96b5-dccc-49a3-a28d-1cb312c2c5d5 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371,backing_fmt=raw /opt/stack/data/nova/instances/aa84e575-bdad-45b9-80ce-86b1c2826fb0/disk 1073741824 {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:17:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-191b96b5-dccc-49a3-a28d-1cb312c2c5d5 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371,backing_fmt=raw /opt/stack/data/nova/instances/aa84e575-bdad-45b9-80ce-86b1c2826fb0/disk 1073741824" returned: 0 in 0.046s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:17:07 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-191b96b5-dccc-49a3-a28d-1cb312c2c5d5 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Lock "a8a62c2546af3a2036b853250c5ac64d4c6b4371" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.264s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:17:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-191b96b5-dccc-49a3-a28d-1cb312c2c5d5 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:17:07 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-0fa22ffc-fe17-4dad-869e-6faf857cba30 tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] Lock "a8a62c2546af3a2036b853250c5ac64d4c6b4371" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.258s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:17:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-0fa22ffc-fe17-4dad-869e-6faf857cba30 tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:17:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-191b96b5-dccc-49a3-a28d-1cb312c2c5d5 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json" returned: 0 in 0.173s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:17:08 user nova-compute[75226]: DEBUG nova.virt.disk.api [None req-191b96b5-dccc-49a3-a28d-1cb312c2c5d5 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Checking if we can resize image /opt/stack/data/nova/instances/aa84e575-bdad-45b9-80ce-86b1c2826fb0/disk. size=1073741824 {{(pid=75226) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 17 01:17:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-191b96b5-dccc-49a3-a28d-1cb312c2c5d5 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa84e575-bdad-45b9-80ce-86b1c2826fb0/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:17:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-0fa22ffc-fe17-4dad-869e-6faf857cba30 tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json" returned: 0 in 0.212s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:17:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-0fa22ffc-fe17-4dad-869e-6faf857cba30 tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371,backing_fmt=raw /opt/stack/data/nova/instances/19250ac2-1b3f-4fe9-80b0-406b181929b6/disk 1073741824 {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:17:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-0fa22ffc-fe17-4dad-869e-6faf857cba30 tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371,backing_fmt=raw /opt/stack/data/nova/instances/19250ac2-1b3f-4fe9-80b0-406b181929b6/disk 1073741824" returned: 0 in 0.061s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:17:08 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-0fa22ffc-fe17-4dad-869e-6faf857cba30 tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] Lock "a8a62c2546af3a2036b853250c5ac64d4c6b4371" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.280s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:17:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-0fa22ffc-fe17-4dad-869e-6faf857cba30 tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:17:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-191b96b5-dccc-49a3-a28d-1cb312c2c5d5 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa84e575-bdad-45b9-80ce-86b1c2826fb0/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:17:08 user nova-compute[75226]: DEBUG nova.virt.disk.api [None req-191b96b5-dccc-49a3-a28d-1cb312c2c5d5 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Cannot resize image /opt/stack/data/nova/instances/aa84e575-bdad-45b9-80ce-86b1c2826fb0/disk to a smaller size. {{(pid=75226) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 17 01:17:08 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-191b96b5-dccc-49a3-a28d-1cb312c2c5d5 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: aa84e575-bdad-45b9-80ce-86b1c2826fb0] Created local disks {{(pid=75226) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 17 01:17:08 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-191b96b5-dccc-49a3-a28d-1cb312c2c5d5 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: aa84e575-bdad-45b9-80ce-86b1c2826fb0] Ensure instance console log exists: /opt/stack/data/nova/instances/aa84e575-bdad-45b9-80ce-86b1c2826fb0/console.log {{(pid=75226) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 17 01:17:08 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-191b96b5-dccc-49a3-a28d-1cb312c2c5d5 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:17:08 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-191b96b5-dccc-49a3-a28d-1cb312c2c5d5 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.003s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:17:08 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-191b96b5-dccc-49a3-a28d-1cb312c2c5d5 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:17:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-0fa22ffc-fe17-4dad-869e-6faf857cba30 tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json" returned: 0 in 0.227s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:17:08 user nova-compute[75226]: DEBUG nova.virt.disk.api [None req-0fa22ffc-fe17-4dad-869e-6faf857cba30 tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] Checking if we can resize image /opt/stack/data/nova/instances/19250ac2-1b3f-4fe9-80b0-406b181929b6/disk. size=1073741824 {{(pid=75226) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 17 01:17:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-0fa22ffc-fe17-4dad-869e-6faf857cba30 tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19250ac2-1b3f-4fe9-80b0-406b181929b6/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:17:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-0fa22ffc-fe17-4dad-869e-6faf857cba30 tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19250ac2-1b3f-4fe9-80b0-406b181929b6/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:17:08 user nova-compute[75226]: DEBUG nova.virt.disk.api [None req-0fa22ffc-fe17-4dad-869e-6faf857cba30 tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] Cannot resize image /opt/stack/data/nova/instances/19250ac2-1b3f-4fe9-80b0-406b181929b6/disk to a smaller size. {{(pid=75226) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 17 01:17:08 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-0fa22ffc-fe17-4dad-869e-6faf857cba30 tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] [instance: 19250ac2-1b3f-4fe9-80b0-406b181929b6] Created local disks {{(pid=75226) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 17 01:17:08 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-0fa22ffc-fe17-4dad-869e-6faf857cba30 tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] [instance: 19250ac2-1b3f-4fe9-80b0-406b181929b6] Ensure instance console log exists: /opt/stack/data/nova/instances/19250ac2-1b3f-4fe9-80b0-406b181929b6/console.log {{(pid=75226) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 17 01:17:08 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-0fa22ffc-fe17-4dad-869e-6faf857cba30 tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:17:08 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-0fa22ffc-fe17-4dad-869e-6faf857cba30 tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:17:08 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-0fa22ffc-fe17-4dad-869e-6faf857cba30 tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:17:09 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-fbf61825-46c4-4952-b6b3-a359039308d2 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Acquiring lock "ddfecefc-1e9b-4e6e-9995-855c8a061084" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:17:09 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-fbf61825-46c4-4952-b6b3-a359039308d2 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Lock "ddfecefc-1e9b-4e6e-9995-855c8a061084" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:17:09 user nova-compute[75226]: DEBUG nova.compute.manager [None req-fbf61825-46c4-4952-b6b3-a359039308d2 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] [instance: ddfecefc-1e9b-4e6e-9995-855c8a061084] Starting instance... {{(pid=75226) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 17 01:17:09 user nova-compute[75226]: DEBUG nova.network.neutron [None req-191b96b5-dccc-49a3-a28d-1cb312c2c5d5 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: aa84e575-bdad-45b9-80ce-86b1c2826fb0] Successfully updated port: 734a9e23-26e5-4282-b842-62e0bb37c782 {{(pid=75226) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 17 01:17:09 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-191b96b5-dccc-49a3-a28d-1cb312c2c5d5 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Acquiring lock "refresh_cache-aa84e575-bdad-45b9-80ce-86b1c2826fb0" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:17:09 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-191b96b5-dccc-49a3-a28d-1cb312c2c5d5 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Acquired lock "refresh_cache-aa84e575-bdad-45b9-80ce-86b1c2826fb0" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:17:09 user nova-compute[75226]: DEBUG nova.network.neutron [None req-191b96b5-dccc-49a3-a28d-1cb312c2c5d5 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: aa84e575-bdad-45b9-80ce-86b1c2826fb0] Building network info cache for instance {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 01:17:09 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-fbf61825-46c4-4952-b6b3-a359039308d2 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:17:09 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-fbf61825-46c4-4952-b6b3-a359039308d2 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:17:09 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-fbf61825-46c4-4952-b6b3-a359039308d2 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75226) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 17 01:17:09 user nova-compute[75226]: INFO nova.compute.claims [None req-fbf61825-46c4-4952-b6b3-a359039308d2 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] [instance: ddfecefc-1e9b-4e6e-9995-855c8a061084] Claim successful on node user
Nov 17 01:17:09 user nova-compute[75226]: DEBUG nova.network.neutron [None req-0fa22ffc-fe17-4dad-869e-6faf857cba30 tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] [instance: 19250ac2-1b3f-4fe9-80b0-406b181929b6] Successfully updated port: 093abf0b-d4eb-4be3-bda0-4a7d19fe6ac2 {{(pid=75226) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 17 01:17:09 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-0fa22ffc-fe17-4dad-869e-6faf857cba30 tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] Acquiring lock "refresh_cache-19250ac2-1b3f-4fe9-80b0-406b181929b6" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:17:09 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-0fa22ffc-fe17-4dad-869e-6faf857cba30 tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] Acquired lock "refresh_cache-19250ac2-1b3f-4fe9-80b0-406b181929b6" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:17:09 user nova-compute[75226]: DEBUG nova.network.neutron [None req-0fa22ffc-fe17-4dad-869e-6faf857cba30 tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] [instance: 19250ac2-1b3f-4fe9-80b0-406b181929b6] Building network info cache for instance {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 01:17:09 user nova-compute[75226]: DEBUG nova.network.neutron [None req-191b96b5-dccc-49a3-a28d-1cb312c2c5d5 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: aa84e575-bdad-45b9-80ce-86b1c2826fb0] Instance cache missing network info. {{(pid=75226) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 17 01:17:09 user nova-compute[75226]: DEBUG nova.network.neutron [None req-0fa22ffc-fe17-4dad-869e-6faf857cba30 tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] [instance: 19250ac2-1b3f-4fe9-80b0-406b181929b6] Instance cache missing network info. {{(pid=75226) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 17 01:17:09 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-fbf61825-46c4-4952-b6b3-a359039308d2 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:17:10 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-fbf61825-46c4-4952-b6b3-a359039308d2 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:17:10 user nova-compute[75226]: DEBUG nova.compute.manager [req-779b75aa-bdfd-4858-8fa8-b44548077944 req-1b611baf-34f7-4aff-93ed-1ce281be3818 service nova] [instance: aa84e575-bdad-45b9-80ce-86b1c2826fb0] Received event network-changed-734a9e23-26e5-4282-b842-62e0bb37c782 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:17:10 user nova-compute[75226]: DEBUG nova.compute.manager [req-779b75aa-bdfd-4858-8fa8-b44548077944 req-1b611baf-34f7-4aff-93ed-1ce281be3818 service nova] [instance: aa84e575-bdad-45b9-80ce-86b1c2826fb0] Refreshing instance network info cache due to event network-changed-734a9e23-26e5-4282-b842-62e0bb37c782. {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 01:17:10 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-779b75aa-bdfd-4858-8fa8-b44548077944 req-1b611baf-34f7-4aff-93ed-1ce281be3818 service nova] Acquiring lock "refresh_cache-aa84e575-bdad-45b9-80ce-86b1c2826fb0" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:17:10 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-fbf61825-46c4-4952-b6b3-a359039308d2 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.339s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:17:10 user nova-compute[75226]: DEBUG nova.compute.manager [None req-fbf61825-46c4-4952-b6b3-a359039308d2 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] [instance: ddfecefc-1e9b-4e6e-9995-855c8a061084] Start building networks asynchronously for instance. {{(pid=75226) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 17 01:17:10 user nova-compute[75226]: DEBUG nova.compute.manager [req-d52a6d46-0e66-4d60-9d46-430f14fffb5a req-bda8fb6f-3ffd-4ec9-a0c4-cae3fbbfca0f service nova] [instance: 19250ac2-1b3f-4fe9-80b0-406b181929b6] Received event network-changed-093abf0b-d4eb-4be3-bda0-4a7d19fe6ac2 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:17:10 user nova-compute[75226]: DEBUG nova.compute.manager [req-d52a6d46-0e66-4d60-9d46-430f14fffb5a req-bda8fb6f-3ffd-4ec9-a0c4-cae3fbbfca0f service nova] [instance: 19250ac2-1b3f-4fe9-80b0-406b181929b6] Refreshing instance network info cache due to event network-changed-093abf0b-d4eb-4be3-bda0-4a7d19fe6ac2. {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 01:17:10 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-d52a6d46-0e66-4d60-9d46-430f14fffb5a req-bda8fb6f-3ffd-4ec9-a0c4-cae3fbbfca0f service nova] Acquiring lock "refresh_cache-19250ac2-1b3f-4fe9-80b0-406b181929b6" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:17:10 user nova-compute[75226]: DEBUG nova.compute.manager [None req-fbf61825-46c4-4952-b6b3-a359039308d2 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] [instance: ddfecefc-1e9b-4e6e-9995-855c8a061084] Allocating IP information in the background. {{(pid=75226) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 17 01:17:10 user nova-compute[75226]: DEBUG nova.network.neutron [None req-fbf61825-46c4-4952-b6b3-a359039308d2 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] [instance: ddfecefc-1e9b-4e6e-9995-855c8a061084] allocate_for_instance() {{(pid=75226) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 17 01:17:10 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-fbf61825-46c4-4952-b6b3-a359039308d2 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] [instance: ddfecefc-1e9b-4e6e-9995-855c8a061084] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 17 01:17:10 user nova-compute[75226]: DEBUG nova.compute.manager [None req-fbf61825-46c4-4952-b6b3-a359039308d2 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] [instance: ddfecefc-1e9b-4e6e-9995-855c8a061084] Start building block device mappings for instance. {{(pid=75226) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 17 01:17:10 user nova-compute[75226]: DEBUG nova.compute.manager [None req-fbf61825-46c4-4952-b6b3-a359039308d2 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] [instance: ddfecefc-1e9b-4e6e-9995-855c8a061084] Start spawning the instance on the hypervisor. {{(pid=75226) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 17 01:17:10 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-fbf61825-46c4-4952-b6b3-a359039308d2 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] [instance: ddfecefc-1e9b-4e6e-9995-855c8a061084] Creating instance directory {{(pid=75226) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 17 01:17:10 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-fbf61825-46c4-4952-b6b3-a359039308d2 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] [instance: ddfecefc-1e9b-4e6e-9995-855c8a061084] Creating image(s)
Nov 17 01:17:10 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-fbf61825-46c4-4952-b6b3-a359039308d2 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Acquiring lock "/opt/stack/data/nova/instances/ddfecefc-1e9b-4e6e-9995-855c8a061084/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:17:10 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-fbf61825-46c4-4952-b6b3-a359039308d2 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Lock "/opt/stack/data/nova/instances/ddfecefc-1e9b-4e6e-9995-855c8a061084/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:17:10 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-fbf61825-46c4-4952-b6b3-a359039308d2 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Lock "/opt/stack/data/nova/instances/ddfecefc-1e9b-4e6e-9995-855c8a061084/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:17:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-fbf61825-46c4-4952-b6b3-a359039308d2 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:17:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-fbf61825-46c4-4952-b6b3-a359039308d2 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json" returned: 0 in 0.172s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:17:10 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-fbf61825-46c4-4952-b6b3-a359039308d2 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Acquiring lock "a8a62c2546af3a2036b853250c5ac64d4c6b4371" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:17:10 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-fbf61825-46c4-4952-b6b3-a359039308d2 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Lock "a8a62c2546af3a2036b853250c5ac64d4c6b4371" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:17:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-fbf61825-46c4-4952-b6b3-a359039308d2 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:17:10 user nova-compute[75226]: DEBUG nova.policy [None req-fbf61825-46c4-4952-b6b3-a359039308d2 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0a9b03e89f164c23a6e8e4d1b75ba07b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869af66e0cc47bf9cca02ea9b688a6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75226) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 17 01:17:10 user nova-compute[75226]: DEBUG nova.network.neutron [None req-191b96b5-dccc-49a3-a28d-1cb312c2c5d5 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: aa84e575-bdad-45b9-80ce-86b1c2826fb0] Updating instance_info_cache with network_info: [{"id": "734a9e23-26e5-4282-b842-62e0bb37c782", "address": "fa:16:3e:60:90:47", "network": {"id": "450540a3-ff7e-42fb-a0a6-808acd749943", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1503678778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6cb6f679ee4468d82cc7fb5d0f67be9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap734a9e23-26", "ovs_interfaceid": "734a9e23-26e5-4282-b842-62e0bb37c782", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:17:10 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-191b96b5-dccc-49a3-a28d-1cb312c2c5d5 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Releasing lock "refresh_cache-aa84e575-bdad-45b9-80ce-86b1c2826fb0" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:17:10 user nova-compute[75226]: DEBUG nova.compute.manager [None req-191b96b5-dccc-49a3-a28d-1cb312c2c5d5 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: aa84e575-bdad-45b9-80ce-86b1c2826fb0] Instance network_info: |[{"id": "734a9e23-26e5-4282-b842-62e0bb37c782", "address": "fa:16:3e:60:90:47", "network": {"id": "450540a3-ff7e-42fb-a0a6-808acd749943", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1503678778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6cb6f679ee4468d82cc7fb5d0f67be9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap734a9e23-26", "ovs_interfaceid": "734a9e23-26e5-4282-b842-62e0bb37c782", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75226) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 17 01:17:10 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-779b75aa-bdfd-4858-8fa8-b44548077944 req-1b611baf-34f7-4aff-93ed-1ce281be3818 service nova] Acquired lock "refresh_cache-aa84e575-bdad-45b9-80ce-86b1c2826fb0" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:17:10 user nova-compute[75226]: DEBUG nova.network.neutron [req-779b75aa-bdfd-4858-8fa8-b44548077944 req-1b611baf-34f7-4aff-93ed-1ce281be3818 service nova] [instance: aa84e575-bdad-45b9-80ce-86b1c2826fb0] Refreshing network info cache for port 734a9e23-26e5-4282-b842-62e0bb37c782 {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 01:17:10 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-191b96b5-dccc-49a3-a28d-1cb312c2c5d5 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: aa84e575-bdad-45b9-80ce-86b1c2826fb0] Start _get_guest_xml network_info=[{"id": "734a9e23-26e5-4282-b842-62e0bb37c782", "address": "fa:16:3e:60:90:47", "network": {"id": "450540a3-ff7e-42fb-a0a6-808acd749943", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1503678778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6cb6f679ee4468d82cc7fb5d0f67be9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap734a9e23-26", "ovs_interfaceid": "734a9e23-26e5-4282-b842-62e0bb37c782", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T01:13:22Z,direct_url=<?>,disk_format='qcow2',id=0b369aea-6f3f-4690-9f01-229b90ab6310,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4e110cbf9a84362a6864a7732c435a1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T01:13:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '0b369aea-6f3f-4690-9f01-229b90ab6310'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75226) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 17 01:17:10 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-191b96b5-dccc-49a3-a28d-1cb312c2c5d5 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:17:10 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-191b96b5-dccc-49a3-a28d-1cb312c2c5d5 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:17:10 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-191b96b5-dccc-49a3-a28d-1cb312c2c5d5 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75226) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 17 01:17:10 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-191b96b5-dccc-49a3-a28d-1cb312c2c5d5 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] CPU controller missing on host. {{(pid=75226) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 17 01:17:10 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-191b96b5-dccc-49a3-a28d-1cb312c2c5d5 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75226) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 17 01:17:10 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-191b96b5-dccc-49a3-a28d-1cb312c2c5d5 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] CPU controller found on host. {{(pid=75226) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 17 01:17:10 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-191b96b5-dccc-49a3-a28d-1cb312c2c5d5 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75226) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 17 01:17:10 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-191b96b5-dccc-49a3-a28d-1cb312c2c5d5 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-17T01:13:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T01:13:22Z,direct_url=<?>,disk_format='qcow2',id=0b369aea-6f3f-4690-9f01-229b90ab6310,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4e110cbf9a84362a6864a7732c435a1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T01:13:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 17 01:17:10 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-191b96b5-dccc-49a3-a28d-1cb312c2c5d5 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Flavor limits 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 17 01:17:10 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-191b96b5-dccc-49a3-a28d-1cb312c2c5d5 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Image limits 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 17 01:17:10 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-191b96b5-dccc-49a3-a28d-1cb312c2c5d5 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Flavor pref 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 17 01:17:10 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-191b96b5-dccc-49a3-a28d-1cb312c2c5d5 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Image pref 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 17 01:17:10 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-191b96b5-dccc-49a3-a28d-1cb312c2c5d5 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 17 01:17:10 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-191b96b5-dccc-49a3-a28d-1cb312c2c5d5 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 17 01:17:10 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-191b96b5-dccc-49a3-a28d-1cb312c2c5d5 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75226) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 17 01:17:10 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-191b96b5-dccc-49a3-a28d-1cb312c2c5d5 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Got 1 possible topologies {{(pid=75226) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 17 01:17:10 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-191b96b5-dccc-49a3-a28d-1cb312c2c5d5 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 17 01:17:10 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-191b96b5-dccc-49a3-a28d-1cb312c2c5d5 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 17 01:17:10 user nova-compute[75226]: DEBUG nova.privsep.utils [None req-191b96b5-dccc-49a3-a28d-1cb312c2c5d5 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75226) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 17 01:17:10 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-191b96b5-dccc-49a3-a28d-1cb312c2c5d5 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:17:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1718702311',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1718702311',id=2,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e6cb6f679ee4468d82cc7fb5d0f67be9',ramdisk_id='',reservation_id='r-nhu0m49b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-76498640',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T01:17:05Z,user_data=None,user_id='1b793ce05bf44b939a9fb5a914a04cb0',uuid=aa84e575-bdad-45b9-80ce-86b1c2826fb0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "734a9e23-26e5-4282-b842-62e0bb37c782", "address": "fa:16:3e:60:90:47", "network": {"id": "450540a3-ff7e-42fb-a0a6-808acd749943", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1503678778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6cb6f679ee4468d82cc7fb5d0f67be9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap734a9e23-26", "ovs_interfaceid": "734a9e23-26e5-4282-b842-62e0bb37c782", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75226) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 01:17:10 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-191b96b5-dccc-49a3-a28d-1cb312c2c5d5 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Converting VIF {"id": "734a9e23-26e5-4282-b842-62e0bb37c782", "address": "fa:16:3e:60:90:47", "network": {"id": "450540a3-ff7e-42fb-a0a6-808acd749943", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1503678778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6cb6f679ee4468d82cc7fb5d0f67be9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap734a9e23-26", "ovs_interfaceid": "734a9e23-26e5-4282-b842-62e0bb37c782", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:17:10 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-191b96b5-dccc-49a3-a28d-1cb312c2c5d5 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:90:47,bridge_name='br-int',has_traffic_filtering=True,id=734a9e23-26e5-4282-b842-62e0bb37c782,network=Network(450540a3-ff7e-42fb-a0a6-808acd749943),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap734a9e23-26') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:17:10 user nova-compute[75226]: DEBUG nova.objects.instance [None req-191b96b5-dccc-49a3-a28d-1cb312c2c5d5 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Lazy-loading 'pci_devices' on Instance uuid aa84e575-bdad-45b9-80ce-86b1c2826fb0 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:17:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-fbf61825-46c4-4952-b6b3-a359039308d2 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json" returned: 0 in 0.238s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:17:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-fbf61825-46c4-4952-b6b3-a359039308d2 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371,backing_fmt=raw /opt/stack/data/nova/instances/ddfecefc-1e9b-4e6e-9995-855c8a061084/disk 1073741824 {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:17:10 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-191b96b5-dccc-49a3-a28d-1cb312c2c5d5 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: aa84e575-bdad-45b9-80ce-86b1c2826fb0] End _get_guest_xml xml=<domain type="kvm">
Nov 17 01:17:10 user nova-compute[75226]:   <uuid>aa84e575-bdad-45b9-80ce-86b1c2826fb0</uuid>
Nov 17 01:17:10 user nova-compute[75226]:   <name>instance-00000002</name>
Nov 17 01:17:10 user nova-compute[75226]:   <memory>524288</memory>
Nov 17 01:17:10 user nova-compute[75226]:   <vcpu>1</vcpu>
Nov 17 01:17:10 user nova-compute[75226]:   <metadata>
Nov 17 01:17:10 user nova-compute[75226]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 17 01:17:10 user nova-compute[75226]:       <nova:package version="0.0.0"/>
Nov 17 01:17:10 user nova-compute[75226]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1718702311</nova:name>
Nov 17 01:17:10 user nova-compute[75226]:       <nova:creationTime>2023-11-17 01:17:10</nova:creationTime>
Nov 17 01:17:10 user nova-compute[75226]:       <nova:flavor name="m1.tiny">
Nov 17 01:17:10 user nova-compute[75226]:         <nova:memory>512</nova:memory>
Nov 17 01:17:10 user nova-compute[75226]:         <nova:disk>1</nova:disk>
Nov 17 01:17:10 user nova-compute[75226]:         <nova:swap>0</nova:swap>
Nov 17 01:17:10 user nova-compute[75226]:         <nova:ephemeral>0</nova:ephemeral>
Nov 17 01:17:10 user nova-compute[75226]:         <nova:vcpus>1</nova:vcpus>
Nov 17 01:17:10 user nova-compute[75226]:       </nova:flavor>
Nov 17 01:17:10 user nova-compute[75226]:       <nova:owner>
Nov 17 01:17:10 user nova-compute[75226]:         <nova:user uuid="1b793ce05bf44b939a9fb5a914a04cb0">tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member</nova:user>
Nov 17 01:17:10 user nova-compute[75226]:         <nova:project uuid="e6cb6f679ee4468d82cc7fb5d0f67be9">tempest-ServerBootFromVolumeStableRescueTest-76498640</nova:project>
Nov 17 01:17:10 user nova-compute[75226]:       </nova:owner>
Nov 17 01:17:10 user nova-compute[75226]:       <nova:root type="image" uuid="0b369aea-6f3f-4690-9f01-229b90ab6310"/>
Nov 17 01:17:10 user nova-compute[75226]:       <nova:ports>
Nov 17 01:17:10 user nova-compute[75226]:         <nova:port uuid="734a9e23-26e5-4282-b842-62e0bb37c782">
Nov 17 01:17:10 user nova-compute[75226]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 17 01:17:10 user nova-compute[75226]:         </nova:port>
Nov 17 01:17:10 user nova-compute[75226]:       </nova:ports>
Nov 17 01:17:10 user nova-compute[75226]:     </nova:instance>
Nov 17 01:17:10 user nova-compute[75226]:   </metadata>
Nov 17 01:17:10 user nova-compute[75226]:   <sysinfo type="smbios">
Nov 17 01:17:10 user nova-compute[75226]:     <system>
Nov 17 01:17:10 user nova-compute[75226]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 17 01:17:10 user nova-compute[75226]:       <entry name="product">OpenStack Nova</entry>
Nov 17 01:17:10 user nova-compute[75226]:       <entry name="version">0.0.0</entry>
Nov 17 01:17:10 user nova-compute[75226]:       <entry name="serial">aa84e575-bdad-45b9-80ce-86b1c2826fb0</entry>
Nov 17 01:17:10 user nova-compute[75226]:       <entry name="uuid">aa84e575-bdad-45b9-80ce-86b1c2826fb0</entry>
Nov 17 01:17:10 user nova-compute[75226]:       <entry name="family">Virtual Machine</entry>
Nov 17 01:17:10 user nova-compute[75226]:     </system>
Nov 17 01:17:10 user nova-compute[75226]:   </sysinfo>
Nov 17 01:17:10 user nova-compute[75226]:   <os>
Nov 17 01:17:10 user nova-compute[75226]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 17 01:17:10 user nova-compute[75226]:     <boot dev="hd"/>
Nov 17 01:17:10 user nova-compute[75226]:     <smbios mode="sysinfo"/>
Nov 17 01:17:10 user nova-compute[75226]:   </os>
Nov 17 01:17:10 user nova-compute[75226]:   <features>
Nov 17 01:17:10 user nova-compute[75226]:     <acpi/>
Nov 17 01:17:10 user nova-compute[75226]:     <apic/>
Nov 17 01:17:10 user nova-compute[75226]:     <vmcoreinfo/>
Nov 17 01:17:10 user nova-compute[75226]:   </features>
Nov 17 01:17:10 user nova-compute[75226]:   <clock offset="utc">
Nov 17 01:17:10 user nova-compute[75226]:     <timer name="pit" tickpolicy="delay"/>
Nov 17 01:17:10 user nova-compute[75226]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 17 01:17:10 user nova-compute[75226]:     <timer name="hpet" present="no"/>
Nov 17 01:17:10 user nova-compute[75226]:   </clock>
Nov 17 01:17:10 user nova-compute[75226]:   <cpu mode="custom" match="exact">
Nov 17 01:17:10 user nova-compute[75226]:     <model>Nehalem</model>
Nov 17 01:17:10 user nova-compute[75226]:     <topology sockets="1" cores="1" threads="1"/>
Nov 17 01:17:10 user nova-compute[75226]:   </cpu>
Nov 17 01:17:10 user nova-compute[75226]:   <devices>
Nov 17 01:17:10 user nova-compute[75226]:     <disk type="file" device="disk">
Nov 17 01:17:10 user nova-compute[75226]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 17 01:17:10 user nova-compute[75226]:       <source file="/opt/stack/data/nova/instances/aa84e575-bdad-45b9-80ce-86b1c2826fb0/disk"/>
Nov 17 01:17:10 user nova-compute[75226]:       <target dev="vda" bus="virtio"/>
Nov 17 01:17:10 user nova-compute[75226]:     </disk>
Nov 17 01:17:10 user nova-compute[75226]:     <interface type="ethernet">
Nov 17 01:17:10 user nova-compute[75226]:       <mac address="fa:16:3e:60:90:47"/>
Nov 17 01:17:10 user nova-compute[75226]:       <model type="virtio"/>
Nov 17 01:17:10 user nova-compute[75226]:       <mtu size="1442"/>
Nov 17 01:17:10 user nova-compute[75226]:       <target dev="tap734a9e23-26"/>
Nov 17 01:17:10 user nova-compute[75226]:     </interface>
Nov 17 01:17:10 user nova-compute[75226]:     <serial type="pty">
Nov 17 01:17:10 user nova-compute[75226]:       <log file="/opt/stack/data/nova/instances/aa84e575-bdad-45b9-80ce-86b1c2826fb0/console.log" append="off"/>
Nov 17 01:17:10 user nova-compute[75226]:     </serial>
Nov 17 01:17:10 user nova-compute[75226]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 17 01:17:10 user nova-compute[75226]:     <video>
Nov 17 01:17:10 user nova-compute[75226]:       <model type="virtio"/>
Nov 17 01:17:10 user nova-compute[75226]:     </video>
Nov 17 01:17:10 user nova-compute[75226]:     <rng model="virtio">
Nov 17 01:17:10 user nova-compute[75226]:       <backend model="random">/dev/urandom</backend>
Nov 17 01:17:10 user nova-compute[75226]:     </rng>
Nov 17 01:17:10 user nova-compute[75226]:     <controller type="usb" index="0" model="none"/>
Nov 17 01:17:10 user nova-compute[75226]:     <memballoon model="virtio">
Nov 17 01:17:10 user nova-compute[75226]:       <stats period="10"/>
Nov 17 01:17:10 user nova-compute[75226]:     </memballoon>
Nov 17 01:17:10 user nova-compute[75226]:   </devices>
Nov 17 01:17:10 user nova-compute[75226]: </domain>
Nov 17 01:17:10 user nova-compute[75226]:  {{(pid=75226) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 17 01:17:10 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-191b96b5-dccc-49a3-a28d-1cb312c2c5d5 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:17:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1718702311',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1718702311',id=2,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e6cb6f679ee4468d82cc7fb5d0f67be9',ramdisk_id='',reservation_id='r-nhu0m49b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-76498640',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T01:17:05Z,user_data=None,user_id='1b793ce05bf44b939a9fb5a914a04cb0',uuid=aa84e575-bdad-45b9-80ce-86b1c2826fb0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "734a9e23-26e5-4282-b842-62e0bb37c782", "address": "fa:16:3e:60:90:47", "network": {"id": "450540a3-ff7e-42fb-a0a6-808acd749943", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1503678778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6cb6f679ee4468d82cc7fb5d0f67be9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap734a9e23-26", "ovs_interfaceid": "734a9e23-26e5-4282-b842-62e0bb37c782", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 17 01:17:10 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-191b96b5-dccc-49a3-a28d-1cb312c2c5d5 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Converting VIF {"id": "734a9e23-26e5-4282-b842-62e0bb37c782", "address": "fa:16:3e:60:90:47", "network": {"id": "450540a3-ff7e-42fb-a0a6-808acd749943", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1503678778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6cb6f679ee4468d82cc7fb5d0f67be9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap734a9e23-26", "ovs_interfaceid": "734a9e23-26e5-4282-b842-62e0bb37c782", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:17:10 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-191b96b5-dccc-49a3-a28d-1cb312c2c5d5 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:90:47,bridge_name='br-int',has_traffic_filtering=True,id=734a9e23-26e5-4282-b842-62e0bb37c782,network=Network(450540a3-ff7e-42fb-a0a6-808acd749943),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap734a9e23-26') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:17:10 user nova-compute[75226]: DEBUG os_vif [None req-191b96b5-dccc-49a3-a28d-1cb312c2c5d5 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:90:47,bridge_name='br-int',has_traffic_filtering=True,id=734a9e23-26e5-4282-b842-62e0bb37c782,network=Network(450540a3-ff7e-42fb-a0a6-808acd749943),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap734a9e23-26') {{(pid=75226) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 17 01:17:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-fbf61825-46c4-4952-b6b3-a359039308d2 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371,backing_fmt=raw /opt/stack/data/nova/instances/ddfecefc-1e9b-4e6e-9995-855c8a061084/disk 1073741824" returned: 0 in 0.100s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:17:10 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-fbf61825-46c4-4952-b6b3-a359039308d2 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Lock "a8a62c2546af3a2036b853250c5ac64d4c6b4371" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.340s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:17:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-fbf61825-46c4-4952-b6b3-a359039308d2 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:17:10 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl [None req-191b96b5-dccc-49a3-a28d-1cb312c2c5d5 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Created schema index Interface.name {{(pid=75226) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 17 01:17:10 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl [None req-191b96b5-dccc-49a3-a28d-1cb312c2c5d5 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Created schema index Port.name {{(pid=75226) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 17 01:17:10 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl [None req-191b96b5-dccc-49a3-a28d-1cb312c2c5d5 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Created schema index Bridge.name {{(pid=75226) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 17 01:17:10 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-191b96b5-dccc-49a3-a28d-1cb312c2c5d5 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=75226) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 01:17:10 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-191b96b5-dccc-49a3-a28d-1cb312c2c5d5 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [POLLOUT] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:17:10 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-191b96b5-dccc-49a3-a28d-1cb312c2c5d5 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75226) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 01:17:10 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-191b96b5-dccc-49a3-a28d-1cb312c2c5d5 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:17:10 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-191b96b5-dccc-49a3-a28d-1cb312c2c5d5 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:17:10 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-191b96b5-dccc-49a3-a28d-1cb312c2c5d5 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:17:10 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:17:10 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:17:10 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 17 01:17:10 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:17:10 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cf4a265a-b301-5c73-86fa-920811228ca0', '_type': 'linux-noop'}}, row=False) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:17:10 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:17:10 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:17:10 user nova-compute[75226]: INFO oslo.privsep.daemon [None req-191b96b5-dccc-49a3-a28d-1cb312c2c5d5 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpika7mrik/privsep.sock']
Nov 17 01:17:11 user sudo[84589]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpika7mrik/privsep.sock
Nov 17 01:17:11 user sudo[84589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 17 01:17:11 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-fbf61825-46c4-4952-b6b3-a359039308d2 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json" returned: 0 in 0.213s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:17:11 user nova-compute[75226]: DEBUG nova.virt.disk.api [None req-fbf61825-46c4-4952-b6b3-a359039308d2 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ddfecefc-1e9b-4e6e-9995-855c8a061084/disk. size=1073741824 {{(pid=75226) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 17 01:17:11 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-fbf61825-46c4-4952-b6b3-a359039308d2 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddfecefc-1e9b-4e6e-9995-855c8a061084/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:17:11 user nova-compute[75226]: DEBUG nova.network.neutron [None req-0fa22ffc-fe17-4dad-869e-6faf857cba30 tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] [instance: 19250ac2-1b3f-4fe9-80b0-406b181929b6] Updating instance_info_cache with network_info: [{"id": "093abf0b-d4eb-4be3-bda0-4a7d19fe6ac2", "address": "fa:16:3e:44:7e:c6", "network": {"id": "3dcb272c-6114-40d2-8236-2deea2de36cf", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-883099730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cc9e48d967049cab3393af3f9dcbe48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap093abf0b-d4", "ovs_interfaceid": "093abf0b-d4eb-4be3-bda0-4a7d19fe6ac2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:17:11 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-fbf61825-46c4-4952-b6b3-a359039308d2 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddfecefc-1e9b-4e6e-9995-855c8a061084/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:17:11 user nova-compute[75226]: DEBUG nova.virt.disk.api [None req-fbf61825-46c4-4952-b6b3-a359039308d2 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Cannot resize image /opt/stack/data/nova/instances/ddfecefc-1e9b-4e6e-9995-855c8a061084/disk to a smaller size. {{(pid=75226) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 17 01:17:11 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-fbf61825-46c4-4952-b6b3-a359039308d2 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] [instance: ddfecefc-1e9b-4e6e-9995-855c8a061084] Created local disks {{(pid=75226) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 17 01:17:11 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-fbf61825-46c4-4952-b6b3-a359039308d2 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] [instance: ddfecefc-1e9b-4e6e-9995-855c8a061084] Ensure instance console log exists: /opt/stack/data/nova/instances/ddfecefc-1e9b-4e6e-9995-855c8a061084/console.log {{(pid=75226) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 17 01:17:11 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-fbf61825-46c4-4952-b6b3-a359039308d2 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:17:11 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-fbf61825-46c4-4952-b6b3-a359039308d2 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:17:11 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-fbf61825-46c4-4952-b6b3-a359039308d2 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:17:11 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-0fa22ffc-fe17-4dad-869e-6faf857cba30 tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] Releasing lock "refresh_cache-19250ac2-1b3f-4fe9-80b0-406b181929b6" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:17:11 user nova-compute[75226]: DEBUG nova.compute.manager [None req-0fa22ffc-fe17-4dad-869e-6faf857cba30 tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] [instance: 19250ac2-1b3f-4fe9-80b0-406b181929b6] Instance network_info: |[{"id": "093abf0b-d4eb-4be3-bda0-4a7d19fe6ac2", "address": "fa:16:3e:44:7e:c6", "network": {"id": "3dcb272c-6114-40d2-8236-2deea2de36cf", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-883099730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cc9e48d967049cab3393af3f9dcbe48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap093abf0b-d4", "ovs_interfaceid": "093abf0b-d4eb-4be3-bda0-4a7d19fe6ac2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75226) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 17 01:17:11 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-d52a6d46-0e66-4d60-9d46-430f14fffb5a req-bda8fb6f-3ffd-4ec9-a0c4-cae3fbbfca0f service nova] Acquired lock "refresh_cache-19250ac2-1b3f-4fe9-80b0-406b181929b6" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:17:11 user nova-compute[75226]: DEBUG nova.network.neutron [req-d52a6d46-0e66-4d60-9d46-430f14fffb5a req-bda8fb6f-3ffd-4ec9-a0c4-cae3fbbfca0f service nova] [instance: 19250ac2-1b3f-4fe9-80b0-406b181929b6] Refreshing network info cache for port 093abf0b-d4eb-4be3-bda0-4a7d19fe6ac2 {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 01:17:11 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-0fa22ffc-fe17-4dad-869e-6faf857cba30 tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] [instance: 19250ac2-1b3f-4fe9-80b0-406b181929b6] Start _get_guest_xml network_info=[{"id": "093abf0b-d4eb-4be3-bda0-4a7d19fe6ac2", "address": "fa:16:3e:44:7e:c6", "network": {"id": "3dcb272c-6114-40d2-8236-2deea2de36cf", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-883099730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cc9e48d967049cab3393af3f9dcbe48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap093abf0b-d4", "ovs_interfaceid": "093abf0b-d4eb-4be3-bda0-4a7d19fe6ac2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T01:13:22Z,direct_url=<?>,disk_format='qcow2',id=0b369aea-6f3f-4690-9f01-229b90ab6310,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4e110cbf9a84362a6864a7732c435a1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T01:13:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '0b369aea-6f3f-4690-9f01-229b90ab6310'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75226) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 17 01:17:11 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-0fa22ffc-fe17-4dad-869e-6faf857cba30 tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:17:11 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-0fa22ffc-fe17-4dad-869e-6faf857cba30 tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:17:11 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-0fa22ffc-fe17-4dad-869e-6faf857cba30 tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75226) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 17 01:17:11 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-0fa22ffc-fe17-4dad-869e-6faf857cba30 tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] CPU controller missing on host. {{(pid=75226) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 17 01:17:11 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-0fa22ffc-fe17-4dad-869e-6faf857cba30 tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75226) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 17 01:17:11 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-0fa22ffc-fe17-4dad-869e-6faf857cba30 tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] CPU controller found on host. {{(pid=75226) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 17 01:17:11 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-0fa22ffc-fe17-4dad-869e-6faf857cba30 tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75226) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 17 01:17:11 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-0fa22ffc-fe17-4dad-869e-6faf857cba30 tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-17T01:13:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T01:13:22Z,direct_url=<?>,disk_format='qcow2',id=0b369aea-6f3f-4690-9f01-229b90ab6310,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4e110cbf9a84362a6864a7732c435a1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T01:13:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 17 01:17:11 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-0fa22ffc-fe17-4dad-869e-6faf857cba30 tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] Flavor limits 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 17 01:17:11 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-0fa22ffc-fe17-4dad-869e-6faf857cba30 tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] Image limits 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 17 01:17:11 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-0fa22ffc-fe17-4dad-869e-6faf857cba30 tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] Flavor pref 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 17 01:17:11 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-0fa22ffc-fe17-4dad-869e-6faf857cba30 tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] Image pref 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 17 01:17:11 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-0fa22ffc-fe17-4dad-869e-6faf857cba30 tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 17 01:17:11 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-0fa22ffc-fe17-4dad-869e-6faf857cba30 tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 17 01:17:11 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-0fa22ffc-fe17-4dad-869e-6faf857cba30 tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75226) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 17 01:17:11 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-0fa22ffc-fe17-4dad-869e-6faf857cba30 tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] Got 1 possible topologies {{(pid=75226) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 17 01:17:11 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-0fa22ffc-fe17-4dad-869e-6faf857cba30 tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 17 01:17:11 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-0fa22ffc-fe17-4dad-869e-6faf857cba30 tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 17 01:17:11 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-0fa22ffc-fe17-4dad-869e-6faf857cba30 tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:17:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-703343217',display_name='tempest-DeleteServersTestJSON-server-703343217',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-703343217',id=1,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2cc9e48d967049cab3393af3f9dcbe48',ramdisk_id='',reservation_id='r-0el1cq47',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-117486716',owner_user_name='tempest-DeleteServersTestJSON-117486716-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T01:17:04Z,user_data=None,user_id='e1bdd8e75fdd44a7b5706d42e831bb82',uuid=19250ac2-1b3f-4fe9-80b0-406b181929b6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "093abf0b-d4eb-4be3-bda0-4a7d19fe6ac2", "address": "fa:16:3e:44:7e:c6", "network": {"id": "3dcb272c-6114-40d2-8236-2deea2de36cf", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-883099730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cc9e48d967049cab3393af3f9dcbe48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap093abf0b-d4", "ovs_interfaceid": "093abf0b-d4eb-4be3-bda0-4a7d19fe6ac2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75226) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 01:17:11 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-0fa22ffc-fe17-4dad-869e-6faf857cba30 tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] Converting VIF {"id": "093abf0b-d4eb-4be3-bda0-4a7d19fe6ac2", "address": "fa:16:3e:44:7e:c6", "network": {"id": "3dcb272c-6114-40d2-8236-2deea2de36cf", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-883099730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cc9e48d967049cab3393af3f9dcbe48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap093abf0b-d4", "ovs_interfaceid": "093abf0b-d4eb-4be3-bda0-4a7d19fe6ac2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:17:11 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-0fa22ffc-fe17-4dad-869e-6faf857cba30 tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:7e:c6,bridge_name='br-int',has_traffic_filtering=True,id=093abf0b-d4eb-4be3-bda0-4a7d19fe6ac2,network=Network(3dcb272c-6114-40d2-8236-2deea2de36cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap093abf0b-d4') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:17:11 user nova-compute[75226]: DEBUG nova.objects.instance [None req-0fa22ffc-fe17-4dad-869e-6faf857cba30 tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] Lazy-loading 'pci_devices' on Instance uuid 19250ac2-1b3f-4fe9-80b0-406b181929b6 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:17:11 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-0fa22ffc-fe17-4dad-869e-6faf857cba30 tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] [instance: 19250ac2-1b3f-4fe9-80b0-406b181929b6] End _get_guest_xml xml=<domain type="kvm">
Nov 17 01:17:11 user nova-compute[75226]:   <uuid>19250ac2-1b3f-4fe9-80b0-406b181929b6</uuid>
Nov 17 01:17:11 user nova-compute[75226]:   <name>instance-00000001</name>
Nov 17 01:17:11 user nova-compute[75226]:   <memory>524288</memory>
Nov 17 01:17:11 user nova-compute[75226]:   <vcpu>1</vcpu>
Nov 17 01:17:11 user nova-compute[75226]:   <metadata>
Nov 17 01:17:11 user nova-compute[75226]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 17 01:17:11 user nova-compute[75226]:       <nova:package version="0.0.0"/>
Nov 17 01:17:11 user nova-compute[75226]:       <nova:name>tempest-DeleteServersTestJSON-server-703343217</nova:name>
Nov 17 01:17:11 user nova-compute[75226]:       <nova:creationTime>2023-11-17 01:17:11</nova:creationTime>
Nov 17 01:17:11 user nova-compute[75226]:       <nova:flavor name="m1.tiny">
Nov 17 01:17:11 user nova-compute[75226]:         <nova:memory>512</nova:memory>
Nov 17 01:17:11 user nova-compute[75226]:         <nova:disk>1</nova:disk>
Nov 17 01:17:11 user nova-compute[75226]:         <nova:swap>0</nova:swap>
Nov 17 01:17:11 user nova-compute[75226]:         <nova:ephemeral>0</nova:ephemeral>
Nov 17 01:17:11 user nova-compute[75226]:         <nova:vcpus>1</nova:vcpus>
Nov 17 01:17:11 user nova-compute[75226]:       </nova:flavor>
Nov 17 01:17:11 user nova-compute[75226]:       <nova:owner>
Nov 17 01:17:11 user nova-compute[75226]:         <nova:user uuid="e1bdd8e75fdd44a7b5706d42e831bb82">tempest-DeleteServersTestJSON-117486716-project-member</nova:user>
Nov 17 01:17:11 user nova-compute[75226]:         <nova:project uuid="2cc9e48d967049cab3393af3f9dcbe48">tempest-DeleteServersTestJSON-117486716</nova:project>
Nov 17 01:17:11 user nova-compute[75226]:       </nova:owner>
Nov 17 01:17:11 user nova-compute[75226]:       <nova:root type="image" uuid="0b369aea-6f3f-4690-9f01-229b90ab6310"/>
Nov 17 01:17:11 user nova-compute[75226]:       <nova:ports>
Nov 17 01:17:11 user nova-compute[75226]:         <nova:port uuid="093abf0b-d4eb-4be3-bda0-4a7d19fe6ac2">
Nov 17 01:17:11 user nova-compute[75226]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 17 01:17:11 user nova-compute[75226]:         </nova:port>
Nov 17 01:17:11 user nova-compute[75226]:       </nova:ports>
Nov 17 01:17:11 user nova-compute[75226]:     </nova:instance>
Nov 17 01:17:11 user nova-compute[75226]:   </metadata>
Nov 17 01:17:11 user nova-compute[75226]:   <sysinfo type="smbios">
Nov 17 01:17:11 user nova-compute[75226]:     <system>
Nov 17 01:17:11 user nova-compute[75226]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 17 01:17:11 user nova-compute[75226]:       <entry name="product">OpenStack Nova</entry>
Nov 17 01:17:11 user nova-compute[75226]:       <entry name="version">0.0.0</entry>
Nov 17 01:17:11 user nova-compute[75226]:       <entry name="serial">19250ac2-1b3f-4fe9-80b0-406b181929b6</entry>
Nov 17 01:17:11 user nova-compute[75226]:       <entry name="uuid">19250ac2-1b3f-4fe9-80b0-406b181929b6</entry>
Nov 17 01:17:11 user nova-compute[75226]:       <entry name="family">Virtual Machine</entry>
Nov 17 01:17:11 user nova-compute[75226]:     </system>
Nov 17 01:17:11 user nova-compute[75226]:   </sysinfo>
Nov 17 01:17:11 user nova-compute[75226]:   <os>
Nov 17 01:17:11 user nova-compute[75226]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 17 01:17:11 user nova-compute[75226]:     <boot dev="hd"/>
Nov 17 01:17:11 user nova-compute[75226]:     <smbios mode="sysinfo"/>
Nov 17 01:17:11 user nova-compute[75226]:   </os>
Nov 17 01:17:11 user nova-compute[75226]:   <features>
Nov 17 01:17:11 user nova-compute[75226]:     <acpi/>
Nov 17 01:17:11 user nova-compute[75226]:     <apic/>
Nov 17 01:17:11 user nova-compute[75226]:     <vmcoreinfo/>
Nov 17 01:17:11 user nova-compute[75226]:   </features>
Nov 17 01:17:11 user nova-compute[75226]:   <clock offset="utc">
Nov 17 01:17:11 user nova-compute[75226]:     <timer name="pit" tickpolicy="delay"/>
Nov 17 01:17:11 user nova-compute[75226]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 17 01:17:11 user nova-compute[75226]:     <timer name="hpet" present="no"/>
Nov 17 01:17:11 user nova-compute[75226]:   </clock>
Nov 17 01:17:11 user nova-compute[75226]:   <cpu mode="custom" match="exact">
Nov 17 01:17:11 user nova-compute[75226]:     <model>Nehalem</model>
Nov 17 01:17:11 user nova-compute[75226]:     <topology sockets="1" cores="1" threads="1"/>
Nov 17 01:17:11 user nova-compute[75226]:   </cpu>
Nov 17 01:17:11 user nova-compute[75226]:   <devices>
Nov 17 01:17:11 user nova-compute[75226]:     <disk type="file" device="disk">
Nov 17 01:17:11 user nova-compute[75226]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 17 01:17:11 user nova-compute[75226]:       <source file="/opt/stack/data/nova/instances/19250ac2-1b3f-4fe9-80b0-406b181929b6/disk"/>
Nov 17 01:17:11 user nova-compute[75226]:       <target dev="vda" bus="virtio"/>
Nov 17 01:17:11 user nova-compute[75226]:     </disk>
Nov 17 01:17:11 user nova-compute[75226]:     <interface type="ethernet">
Nov 17 01:17:11 user nova-compute[75226]:       <mac address="fa:16:3e:44:7e:c6"/>
Nov 17 01:17:11 user nova-compute[75226]:       <model type="virtio"/>
Nov 17 01:17:11 user nova-compute[75226]:       <mtu size="1442"/>
Nov 17 01:17:11 user nova-compute[75226]:       <target dev="tap093abf0b-d4"/>
Nov 17 01:17:11 user nova-compute[75226]:     </interface>
Nov 17 01:17:11 user nova-compute[75226]:     <serial type="pty">
Nov 17 01:17:11 user nova-compute[75226]:       <log file="/opt/stack/data/nova/instances/19250ac2-1b3f-4fe9-80b0-406b181929b6/console.log" append="off"/>
Nov 17 01:17:11 user nova-compute[75226]:     </serial>
Nov 17 01:17:11 user nova-compute[75226]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 17 01:17:11 user nova-compute[75226]:     <video>
Nov 17 01:17:11 user nova-compute[75226]:       <model type="virtio"/>
Nov 17 01:17:11 user nova-compute[75226]:     </video>
Nov 17 01:17:11 user nova-compute[75226]:     <rng model="virtio">
Nov 17 01:17:11 user nova-compute[75226]:       <backend model="random">/dev/urandom</backend>
Nov 17 01:17:11 user nova-compute[75226]:     </rng>
Nov 17 01:17:11 user nova-compute[75226]:     <controller type="usb" index="0" model="none"/>
Nov 17 01:17:11 user nova-compute[75226]:     <memballoon model="virtio">
Nov 17 01:17:11 user nova-compute[75226]:       <stats period="10"/>
Nov 17 01:17:11 user nova-compute[75226]:     </memballoon>
Nov 17 01:17:11 user nova-compute[75226]:   </devices>
Nov 17 01:17:11 user nova-compute[75226]: </domain>
Nov 17 01:17:11 user nova-compute[75226]:  {{(pid=75226) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 17 01:17:11 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-0fa22ffc-fe17-4dad-869e-6faf857cba30 tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:17:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-703343217',display_name='tempest-DeleteServersTestJSON-server-703343217',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-703343217',id=1,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2cc9e48d967049cab3393af3f9dcbe48',ramdisk_id='',reservation_id='r-0el1cq47',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-117486716',owner_user_name='tempest-DeleteServersTestJSON-117486716-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T01:17:04Z,user_data=None,user_id='e1bdd8e75fdd44a7b5706d42e831bb82',uuid=19250ac2-1b3f-4fe9-80b0-406b181929b6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "093abf0b-d4eb-4be3-bda0-4a7d19fe6ac2", "address": "fa:16:3e:44:7e:c6", "network": {"id": "3dcb272c-6114-40d2-8236-2deea2de36cf", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-883099730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cc9e48d967049cab3393af3f9dcbe48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap093abf0b-d4", "ovs_interfaceid": "093abf0b-d4eb-4be3-bda0-4a7d19fe6ac2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 17 01:17:11 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-0fa22ffc-fe17-4dad-869e-6faf857cba30 tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] Converting VIF {"id": "093abf0b-d4eb-4be3-bda0-4a7d19fe6ac2", "address": "fa:16:3e:44:7e:c6", "network": {"id": "3dcb272c-6114-40d2-8236-2deea2de36cf", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-883099730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cc9e48d967049cab3393af3f9dcbe48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap093abf0b-d4", "ovs_interfaceid": "093abf0b-d4eb-4be3-bda0-4a7d19fe6ac2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:17:11 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-0fa22ffc-fe17-4dad-869e-6faf857cba30 tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:7e:c6,bridge_name='br-int',has_traffic_filtering=True,id=093abf0b-d4eb-4be3-bda0-4a7d19fe6ac2,network=Network(3dcb272c-6114-40d2-8236-2deea2de36cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap093abf0b-d4') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:17:11 user nova-compute[75226]: DEBUG os_vif [None req-0fa22ffc-fe17-4dad-869e-6faf857cba30 tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:7e:c6,bridge_name='br-int',has_traffic_filtering=True,id=093abf0b-d4eb-4be3-bda0-4a7d19fe6ac2,network=Network(3dcb272c-6114-40d2-8236-2deea2de36cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap093abf0b-d4') {{(pid=75226) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 17 01:17:11 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:17:11 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:17:11 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 17 01:17:11 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:17:11 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c4bf44bf-f5f7-5df0-8a78-dfbf28d91b17', '_type': 'linux-noop'}}, row=False) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:17:11 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:17:11 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:17:11 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:17:12 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:17:12 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:17:12 user sudo[84589]: pam_unix(sudo:session): session closed for user root
Nov 17 01:17:12 user nova-compute[75226]: INFO oslo.privsep.daemon [None req-191b96b5-dccc-49a3-a28d-1cb312c2c5d5 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Spawned new privsep daemon via rootwrap
Nov 17 01:17:12 user nova-compute[75226]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 17 01:17:12 user nova-compute[75226]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 17 01:17:12 user nova-compute[75226]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Nov 17 01:17:12 user nova-compute[75226]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84599
Nov 17 01:17:12 user nova-compute[75226]: DEBUG nova.network.neutron [req-779b75aa-bdfd-4858-8fa8-b44548077944 req-1b611baf-34f7-4aff-93ed-1ce281be3818 service nova] [instance: aa84e575-bdad-45b9-80ce-86b1c2826fb0] Updated VIF entry in instance network info cache for port 734a9e23-26e5-4282-b842-62e0bb37c782. {{(pid=75226) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 01:17:12 user nova-compute[75226]: DEBUG nova.network.neutron [req-779b75aa-bdfd-4858-8fa8-b44548077944 req-1b611baf-34f7-4aff-93ed-1ce281be3818 service nova] [instance: aa84e575-bdad-45b9-80ce-86b1c2826fb0] Updating instance_info_cache with network_info: [{"id": "734a9e23-26e5-4282-b842-62e0bb37c782", "address": "fa:16:3e:60:90:47", "network": {"id": "450540a3-ff7e-42fb-a0a6-808acd749943", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1503678778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6cb6f679ee4468d82cc7fb5d0f67be9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap734a9e23-26", "ovs_interfaceid": "734a9e23-26e5-4282-b842-62e0bb37c782", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:17:12 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-779b75aa-bdfd-4858-8fa8-b44548077944 req-1b611baf-34f7-4aff-93ed-1ce281be3818 service nova] Releasing lock "refresh_cache-aa84e575-bdad-45b9-80ce-86b1c2826fb0" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:17:12 user nova-compute[75226]: WARNING oslo_privsep.priv_context [None req-0fa22ffc-fe17-4dad-869e-6faf857cba30 tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] privsep daemon already running
Nov 17 01:17:12 user nova-compute[75226]: DEBUG nova.network.neutron [req-d52a6d46-0e66-4d60-9d46-430f14fffb5a req-bda8fb6f-3ffd-4ec9-a0c4-cae3fbbfca0f service nova] [instance: 19250ac2-1b3f-4fe9-80b0-406b181929b6] Updated VIF entry in instance network info cache for port 093abf0b-d4eb-4be3-bda0-4a7d19fe6ac2. {{(pid=75226) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 01:17:12 user nova-compute[75226]: DEBUG nova.network.neutron [req-d52a6d46-0e66-4d60-9d46-430f14fffb5a req-bda8fb6f-3ffd-4ec9-a0c4-cae3fbbfca0f service nova] [instance: 19250ac2-1b3f-4fe9-80b0-406b181929b6] Updating instance_info_cache with network_info: [{"id": "093abf0b-d4eb-4be3-bda0-4a7d19fe6ac2", "address": "fa:16:3e:44:7e:c6", "network": {"id": "3dcb272c-6114-40d2-8236-2deea2de36cf", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-883099730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cc9e48d967049cab3393af3f9dcbe48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap093abf0b-d4", "ovs_interfaceid": "093abf0b-d4eb-4be3-bda0-4a7d19fe6ac2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:17:12 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-d52a6d46-0e66-4d60-9d46-430f14fffb5a req-bda8fb6f-3ffd-4ec9-a0c4-cae3fbbfca0f service nova] Releasing lock "refresh_cache-19250ac2-1b3f-4fe9-80b0-406b181929b6" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:17:13 user nova-compute[75226]: DEBUG nova.network.neutron [None req-fbf61825-46c4-4952-b6b3-a359039308d2 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] [instance: ddfecefc-1e9b-4e6e-9995-855c8a061084] Successfully created port: f9a7562b-de63-4374-b43b-18e3cb3af710 {{(pid=75226) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 17 01:17:13 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:17:13 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap734a9e23-26, may_exist=True, interface_attrs={}) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:17:13 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap734a9e23-26, col_values=(('qos', UUID('2d4d87ee-55d6-433d-96f8-4c6284fece25')),), if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:17:13 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap734a9e23-26, col_values=(('external_ids', {'iface-id': '734a9e23-26e5-4282-b842-62e0bb37c782', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:60:90:47', 'vm-uuid': 'aa84e575-bdad-45b9-80ce-86b1c2826fb0'}),), if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:17:13 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:17:13 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:17:13 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:17:13 user nova-compute[75226]: INFO os_vif [None req-191b96b5-dccc-49a3-a28d-1cb312c2c5d5 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:90:47,bridge_name='br-int',has_traffic_filtering=True,id=734a9e23-26e5-4282-b842-62e0bb37c782,network=Network(450540a3-ff7e-42fb-a0a6-808acd749943),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap734a9e23-26')
Nov 17 01:17:13 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:17:13 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap093abf0b-d4, may_exist=True, interface_attrs={}) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:17:13 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap093abf0b-d4, col_values=(('qos', UUID('f86a2b1d-ea95-4ed9-9227-13fa34201d7f')),), if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:17:13 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap093abf0b-d4, col_values=(('external_ids', {'iface-id': '093abf0b-d4eb-4be3-bda0-4a7d19fe6ac2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:44:7e:c6', 'vm-uuid': '19250ac2-1b3f-4fe9-80b0-406b181929b6'}),), if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:17:13 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:17:13 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:17:13 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:17:13 user nova-compute[75226]: INFO os_vif [None req-0fa22ffc-fe17-4dad-869e-6faf857cba30 tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:7e:c6,bridge_name='br-int',has_traffic_filtering=True,id=093abf0b-d4eb-4be3-bda0-4a7d19fe6ac2,network=Network(3dcb272c-6114-40d2-8236-2deea2de36cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap093abf0b-d4')
Nov 17 01:17:13 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-191b96b5-dccc-49a3-a28d-1cb312c2c5d5 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] No BDM found with device name vda, not building metadata. {{(pid=75226) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 01:17:13 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-191b96b5-dccc-49a3-a28d-1cb312c2c5d5 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] No VIF found with MAC fa:16:3e:60:90:47, not building metadata {{(pid=75226) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 01:17:13 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-0fa22ffc-fe17-4dad-869e-6faf857cba30 tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] No BDM found with device name vda, not building metadata. {{(pid=75226) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 01:17:13 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-0fa22ffc-fe17-4dad-869e-6faf857cba30 tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] No VIF found with MAC fa:16:3e:44:7e:c6, not building metadata {{(pid=75226) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 01:17:13 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:17:14 user nova-compute[75226]: DEBUG nova.network.neutron [None req-fbf61825-46c4-4952-b6b3-a359039308d2 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] [instance: ddfecefc-1e9b-4e6e-9995-855c8a061084] Successfully updated port: f9a7562b-de63-4374-b43b-18e3cb3af710 {{(pid=75226) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 17 01:17:14 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-fbf61825-46c4-4952-b6b3-a359039308d2 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Acquiring lock "refresh_cache-ddfecefc-1e9b-4e6e-9995-855c8a061084" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:17:14 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-fbf61825-46c4-4952-b6b3-a359039308d2 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Acquired lock "refresh_cache-ddfecefc-1e9b-4e6e-9995-855c8a061084" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:17:14 user nova-compute[75226]: DEBUG nova.network.neutron [None req-fbf61825-46c4-4952-b6b3-a359039308d2 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] [instance: ddfecefc-1e9b-4e6e-9995-855c8a061084] Building network info cache for instance {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 01:17:14 user nova-compute[75226]: DEBUG nova.compute.manager [req-f8476b7d-0949-4524-a16c-9638cad803c1 req-b0048276-74fe-45c3-bfcc-183487cd0c8c service nova] [instance: ddfecefc-1e9b-4e6e-9995-855c8a061084] Received event network-changed-f9a7562b-de63-4374-b43b-18e3cb3af710 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:17:14 user nova-compute[75226]: DEBUG nova.compute.manager [req-f8476b7d-0949-4524-a16c-9638cad803c1 req-b0048276-74fe-45c3-bfcc-183487cd0c8c service nova] [instance: ddfecefc-1e9b-4e6e-9995-855c8a061084] Refreshing instance network info cache due to event network-changed-f9a7562b-de63-4374-b43b-18e3cb3af710. {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 01:17:14 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-f8476b7d-0949-4524-a16c-9638cad803c1 req-b0048276-74fe-45c3-bfcc-183487cd0c8c service nova] Acquiring lock "refresh_cache-ddfecefc-1e9b-4e6e-9995-855c8a061084" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:17:14 user nova-compute[75226]: DEBUG nova.network.neutron [None req-fbf61825-46c4-4952-b6b3-a359039308d2 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] [instance: ddfecefc-1e9b-4e6e-9995-855c8a061084] Instance cache missing network info. {{(pid=75226) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 17 01:17:15 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:17:15 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:17:15 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:17:15 user nova-compute[75226]: DEBUG nova.network.neutron [None req-fbf61825-46c4-4952-b6b3-a359039308d2 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] [instance: ddfecefc-1e9b-4e6e-9995-855c8a061084] Updating instance_info_cache with network_info: [{"id": "f9a7562b-de63-4374-b43b-18e3cb3af710", "address": "fa:16:3e:94:21:00", "network": {"id": "8450ab2c-4f24-46cc-a6ec-644c02e2b3da", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-385219532-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6869af66e0cc47bf9cca02ea9b688a6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9a7562b-de", "ovs_interfaceid": "f9a7562b-de63-4374-b43b-18e3cb3af710", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:17:15 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:17:15 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-fbf61825-46c4-4952-b6b3-a359039308d2 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Releasing lock "refresh_cache-ddfecefc-1e9b-4e6e-9995-855c8a061084" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:17:15 user nova-compute[75226]: DEBUG nova.compute.manager [None req-fbf61825-46c4-4952-b6b3-a359039308d2 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] [instance: ddfecefc-1e9b-4e6e-9995-855c8a061084] Instance network_info: |[{"id": "f9a7562b-de63-4374-b43b-18e3cb3af710", "address": "fa:16:3e:94:21:00", "network": {"id": "8450ab2c-4f24-46cc-a6ec-644c02e2b3da", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-385219532-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6869af66e0cc47bf9cca02ea9b688a6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9a7562b-de", "ovs_interfaceid": "f9a7562b-de63-4374-b43b-18e3cb3af710", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75226) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 17 01:17:15 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-f8476b7d-0949-4524-a16c-9638cad803c1 req-b0048276-74fe-45c3-bfcc-183487cd0c8c service nova] Acquired lock "refresh_cache-ddfecefc-1e9b-4e6e-9995-855c8a061084" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:17:15 user nova-compute[75226]: DEBUG nova.network.neutron [req-f8476b7d-0949-4524-a16c-9638cad803c1 req-b0048276-74fe-45c3-bfcc-183487cd0c8c service nova] [instance: ddfecefc-1e9b-4e6e-9995-855c8a061084] Refreshing network info cache for port f9a7562b-de63-4374-b43b-18e3cb3af710 {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 01:17:15 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-fbf61825-46c4-4952-b6b3-a359039308d2 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] [instance: ddfecefc-1e9b-4e6e-9995-855c8a061084] Start _get_guest_xml network_info=[{"id": "f9a7562b-de63-4374-b43b-18e3cb3af710", "address": "fa:16:3e:94:21:00", "network": {"id": "8450ab2c-4f24-46cc-a6ec-644c02e2b3da", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-385219532-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6869af66e0cc47bf9cca02ea9b688a6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9a7562b-de", "ovs_interfaceid": "f9a7562b-de63-4374-b43b-18e3cb3af710", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T01:13:22Z,direct_url=<?>,disk_format='qcow2',id=0b369aea-6f3f-4690-9f01-229b90ab6310,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4e110cbf9a84362a6864a7732c435a1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T01:13:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '0b369aea-6f3f-4690-9f01-229b90ab6310'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75226) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 17 01:17:15 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-fbf61825-46c4-4952-b6b3-a359039308d2 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:17:15 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-fbf61825-46c4-4952-b6b3-a359039308d2 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:17:15 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-fbf61825-46c4-4952-b6b3-a359039308d2 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75226) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 17 01:17:15 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-fbf61825-46c4-4952-b6b3-a359039308d2 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] CPU controller missing on host. {{(pid=75226) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 17 01:17:15 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-fbf61825-46c4-4952-b6b3-a359039308d2 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75226) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 17 01:17:15 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-fbf61825-46c4-4952-b6b3-a359039308d2 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] CPU controller found on host. {{(pid=75226) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 17 01:17:15 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-fbf61825-46c4-4952-b6b3-a359039308d2 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75226) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 17 01:17:15 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-fbf61825-46c4-4952-b6b3-a359039308d2 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-17T01:13:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T01:13:22Z,direct_url=<?>,disk_format='qcow2',id=0b369aea-6f3f-4690-9f01-229b90ab6310,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4e110cbf9a84362a6864a7732c435a1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T01:13:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 17 01:17:15 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-fbf61825-46c4-4952-b6b3-a359039308d2 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Flavor limits 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 17 01:17:15 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-fbf61825-46c4-4952-b6b3-a359039308d2 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Image limits 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 17 01:17:15 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-fbf61825-46c4-4952-b6b3-a359039308d2 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Flavor pref 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 17 01:17:15 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-fbf61825-46c4-4952-b6b3-a359039308d2 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Image pref 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 17 01:17:15 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-fbf61825-46c4-4952-b6b3-a359039308d2 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 17 01:17:15 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-fbf61825-46c4-4952-b6b3-a359039308d2 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 17 01:17:15 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-fbf61825-46c4-4952-b6b3-a359039308d2 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75226) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 17 01:17:15 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-fbf61825-46c4-4952-b6b3-a359039308d2 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Got 1 possible topologies {{(pid=75226) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 17 01:17:15 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-fbf61825-46c4-4952-b6b3-a359039308d2 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 17 01:17:15 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-fbf61825-46c4-4952-b6b3-a359039308d2 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 17 01:17:15 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-fbf61825-46c4-4952-b6b3-a359039308d2 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:17:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1305430160',display_name='tempest-ServerStableDeviceRescueTest-server-1305430160',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1305430160',id=3,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMpvCGoDARt2nfeOrZzYRwVyzyxP/aG4WAR20CLnxUZStgu3wTBvwojfCRlppCSQBs5b3NyOL+sqX0v7IlA3zj/BimKWwl8Hmvj+spsaJeKGpvZAX8jZPtApeiUgJwdeig==',key_name='tempest-keypair-904701876',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6869af66e0cc47bf9cca02ea9b688a6d',ramdisk_id='',reservation_id='r-oy7hjp6e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-358573654',owner_user_name='tempest-ServerStableDeviceRescueTest-358573654-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T01:17:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0a9b03e89f164c23a6e8e4d1b75ba07b',uuid=ddfecefc-1e9b-4e6e-9995-855c8a061084,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f9a7562b-de63-4374-b43b-18e3cb3af710", "address": "fa:16:3e:94:21:00", "network": {"id": "8450ab2c-4f24-46cc-a6ec-644c02e2b3da", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-385219532-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6869af66e0cc47bf9cca02ea9b688a6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9a7562b-de", "ovs_interfaceid": "f9a7562b-de63-4374-b43b-18e3cb3af710", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75226) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 01:17:15 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-fbf61825-46c4-4952-b6b3-a359039308d2 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Converting VIF {"id": "f9a7562b-de63-4374-b43b-18e3cb3af710", "address": "fa:16:3e:94:21:00", "network": {"id": "8450ab2c-4f24-46cc-a6ec-644c02e2b3da", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-385219532-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6869af66e0cc47bf9cca02ea9b688a6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9a7562b-de", "ovs_interfaceid": "f9a7562b-de63-4374-b43b-18e3cb3af710", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:17:15 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-fbf61825-46c4-4952-b6b3-a359039308d2 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:21:00,bridge_name='br-int',has_traffic_filtering=True,id=f9a7562b-de63-4374-b43b-18e3cb3af710,network=Network(8450ab2c-4f24-46cc-a6ec-644c02e2b3da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9a7562b-de') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:17:15 user nova-compute[75226]: DEBUG nova.objects.instance [None req-fbf61825-46c4-4952-b6b3-a359039308d2 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Lazy-loading 'pci_devices' on Instance uuid ddfecefc-1e9b-4e6e-9995-855c8a061084 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:17:15 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-fbf61825-46c4-4952-b6b3-a359039308d2 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] [instance: ddfecefc-1e9b-4e6e-9995-855c8a061084] End _get_guest_xml xml=<domain type="kvm">
Nov 17 01:17:15 user nova-compute[75226]:   <uuid>ddfecefc-1e9b-4e6e-9995-855c8a061084</uuid>
Nov 17 01:17:15 user nova-compute[75226]:   <name>instance-00000003</name>
Nov 17 01:17:15 user nova-compute[75226]:   <memory>524288</memory>
Nov 17 01:17:15 user nova-compute[75226]:   <vcpu>1</vcpu>
Nov 17 01:17:15 user nova-compute[75226]:   <metadata>
Nov 17 01:17:15 user nova-compute[75226]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 17 01:17:15 user nova-compute[75226]:       <nova:package version="0.0.0"/>
Nov 17 01:17:15 user nova-compute[75226]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1305430160</nova:name>
Nov 17 01:17:15 user nova-compute[75226]:       <nova:creationTime>2023-11-17 01:17:15</nova:creationTime>
Nov 17 01:17:15 user nova-compute[75226]:       <nova:flavor name="m1.tiny">
Nov 17 01:17:15 user nova-compute[75226]:         <nova:memory>512</nova:memory>
Nov 17 01:17:15 user nova-compute[75226]:         <nova:disk>1</nova:disk>
Nov 17 01:17:15 user nova-compute[75226]:         <nova:swap>0</nova:swap>
Nov 17 01:17:15 user nova-compute[75226]:         <nova:ephemeral>0</nova:ephemeral>
Nov 17 01:17:15 user nova-compute[75226]:         <nova:vcpus>1</nova:vcpus>
Nov 17 01:17:15 user nova-compute[75226]:       </nova:flavor>
Nov 17 01:17:15 user nova-compute[75226]:       <nova:owner>
Nov 17 01:17:15 user nova-compute[75226]:         <nova:user uuid="0a9b03e89f164c23a6e8e4d1b75ba07b">tempest-ServerStableDeviceRescueTest-358573654-project-member</nova:user>
Nov 17 01:17:15 user nova-compute[75226]:         <nova:project uuid="6869af66e0cc47bf9cca02ea9b688a6d">tempest-ServerStableDeviceRescueTest-358573654</nova:project>
Nov 17 01:17:15 user nova-compute[75226]:       </nova:owner>
Nov 17 01:17:15 user nova-compute[75226]:       <nova:root type="image" uuid="0b369aea-6f3f-4690-9f01-229b90ab6310"/>
Nov 17 01:17:15 user nova-compute[75226]:       <nova:ports>
Nov 17 01:17:15 user nova-compute[75226]:         <nova:port uuid="f9a7562b-de63-4374-b43b-18e3cb3af710">
Nov 17 01:17:15 user nova-compute[75226]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 17 01:17:15 user nova-compute[75226]:         </nova:port>
Nov 17 01:17:15 user nova-compute[75226]:       </nova:ports>
Nov 17 01:17:15 user nova-compute[75226]:     </nova:instance>
Nov 17 01:17:15 user nova-compute[75226]:   </metadata>
Nov 17 01:17:15 user nova-compute[75226]:   <sysinfo type="smbios">
Nov 17 01:17:15 user nova-compute[75226]:     <system>
Nov 17 01:17:15 user nova-compute[75226]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 17 01:17:15 user nova-compute[75226]:       <entry name="product">OpenStack Nova</entry>
Nov 17 01:17:15 user nova-compute[75226]:       <entry name="version">0.0.0</entry>
Nov 17 01:17:15 user nova-compute[75226]:       <entry name="serial">ddfecefc-1e9b-4e6e-9995-855c8a061084</entry>
Nov 17 01:17:15 user nova-compute[75226]:       <entry name="uuid">ddfecefc-1e9b-4e6e-9995-855c8a061084</entry>
Nov 17 01:17:15 user nova-compute[75226]:       <entry name="family">Virtual Machine</entry>
Nov 17 01:17:15 user nova-compute[75226]:     </system>
Nov 17 01:17:15 user nova-compute[75226]:   </sysinfo>
Nov 17 01:17:15 user nova-compute[75226]:   <os>
Nov 17 01:17:15 user nova-compute[75226]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 17 01:17:15 user nova-compute[75226]:     <boot dev="hd"/>
Nov 17 01:17:15 user nova-compute[75226]:     <smbios mode="sysinfo"/>
Nov 17 01:17:15 user nova-compute[75226]:   </os>
Nov 17 01:17:15 user nova-compute[75226]:   <features>
Nov 17 01:17:15 user nova-compute[75226]:     <acpi/>
Nov 17 01:17:15 user nova-compute[75226]:     <apic/>
Nov 17 01:17:15 user nova-compute[75226]:     <vmcoreinfo/>
Nov 17 01:17:15 user nova-compute[75226]:   </features>
Nov 17 01:17:15 user nova-compute[75226]:   <clock offset="utc">
Nov 17 01:17:15 user nova-compute[75226]:     <timer name="pit" tickpolicy="delay"/>
Nov 17 01:17:15 user nova-compute[75226]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 17 01:17:15 user nova-compute[75226]:     <timer name="hpet" present="no"/>
Nov 17 01:17:15 user nova-compute[75226]:   </clock>
Nov 17 01:17:15 user nova-compute[75226]:   <cpu mode="custom" match="exact">
Nov 17 01:17:15 user nova-compute[75226]:     <model>Nehalem</model>
Nov 17 01:17:15 user nova-compute[75226]:     <topology sockets="1" cores="1" threads="1"/>
Nov 17 01:17:15 user nova-compute[75226]:   </cpu>
Nov 17 01:17:15 user nova-compute[75226]:   <devices>
Nov 17 01:17:15 user nova-compute[75226]:     <disk type="file" device="disk">
Nov 17 01:17:15 user nova-compute[75226]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 17 01:17:15 user nova-compute[75226]:       <source file="/opt/stack/data/nova/instances/ddfecefc-1e9b-4e6e-9995-855c8a061084/disk"/>
Nov 17 01:17:15 user nova-compute[75226]:       <target dev="vda" bus="virtio"/>
Nov 17 01:17:15 user nova-compute[75226]:     </disk>
Nov 17 01:17:15 user nova-compute[75226]:     <interface type="ethernet">
Nov 17 01:17:15 user nova-compute[75226]:       <mac address="fa:16:3e:94:21:00"/>
Nov 17 01:17:15 user nova-compute[75226]:       <model type="virtio"/>
Nov 17 01:17:15 user nova-compute[75226]:       <mtu size="1442"/>
Nov 17 01:17:15 user nova-compute[75226]:       <target dev="tapf9a7562b-de"/>
Nov 17 01:17:15 user nova-compute[75226]:     </interface>
Nov 17 01:17:15 user nova-compute[75226]:     <serial type="pty">
Nov 17 01:17:15 user nova-compute[75226]:       <log file="/opt/stack/data/nova/instances/ddfecefc-1e9b-4e6e-9995-855c8a061084/console.log" append="off"/>
Nov 17 01:17:15 user nova-compute[75226]:     </serial>
Nov 17 01:17:15 user nova-compute[75226]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 17 01:17:15 user nova-compute[75226]:     <video>
Nov 17 01:17:15 user nova-compute[75226]:       <model type="virtio"/>
Nov 17 01:17:15 user nova-compute[75226]:     </video>
Nov 17 01:17:15 user nova-compute[75226]:     <rng model="virtio">
Nov 17 01:17:15 user nova-compute[75226]:       <backend model="random">/dev/urandom</backend>
Nov 17 01:17:15 user nova-compute[75226]:     </rng>
Nov 17 01:17:15 user nova-compute[75226]:     <controller type="usb" index="0" model="none"/>
Nov 17 01:17:15 user nova-compute[75226]:     <memballoon model="virtio">
Nov 17 01:17:15 user nova-compute[75226]:       <stats period="10"/>
Nov 17 01:17:15 user nova-compute[75226]:     </memballoon>
Nov 17 01:17:15 user nova-compute[75226]:   </devices>
Nov 17 01:17:15 user nova-compute[75226]: </domain>
Nov 17 01:17:15 user nova-compute[75226]:  {{(pid=75226) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 17 01:17:15 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-fbf61825-46c4-4952-b6b3-a359039308d2 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:17:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1305430160',display_name='tempest-ServerStableDeviceRescueTest-server-1305430160',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1305430160',id=3,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMpvCGoDARt2nfeOrZzYRwVyzyxP/aG4WAR20CLnxUZStgu3wTBvwojfCRlppCSQBs5b3NyOL+sqX0v7IlA3zj/BimKWwl8Hmvj+spsaJeKGpvZAX8jZPtApeiUgJwdeig==',key_name='tempest-keypair-904701876',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6869af66e0cc47bf9cca02ea9b688a6d',ramdisk_id='',reservation_id='r-oy7hjp6e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-358573654',owner_user_name='tempest-ServerStableDeviceRescueTest-358573654-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T01:17:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0a9b03e89f164c23a6e8e4d1b75ba07b',uuid=ddfecefc-1e9b-4e6e-9995-855c8a061084,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f9a7562b-de63-4374-b43b-18e3cb3af710", "address": "fa:16:3e:94:21:00", "network": {"id": "8450ab2c-4f24-46cc-a6ec-644c02e2b3da", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-385219532-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6869af66e0cc47bf9cca02ea9b688a6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9a7562b-de", "ovs_interfaceid": "f9a7562b-de63-4374-b43b-18e3cb3af710", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 17 01:17:15 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-fbf61825-46c4-4952-b6b3-a359039308d2 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Converting VIF {"id": "f9a7562b-de63-4374-b43b-18e3cb3af710", "address": "fa:16:3e:94:21:00", "network": {"id": "8450ab2c-4f24-46cc-a6ec-644c02e2b3da", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-385219532-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6869af66e0cc47bf9cca02ea9b688a6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9a7562b-de", "ovs_interfaceid": "f9a7562b-de63-4374-b43b-18e3cb3af710", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:17:15 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-fbf61825-46c4-4952-b6b3-a359039308d2 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:21:00,bridge_name='br-int',has_traffic_filtering=True,id=f9a7562b-de63-4374-b43b-18e3cb3af710,network=Network(8450ab2c-4f24-46cc-a6ec-644c02e2b3da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9a7562b-de') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:17:15 user nova-compute[75226]: DEBUG os_vif [None req-fbf61825-46c4-4952-b6b3-a359039308d2 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:21:00,bridge_name='br-int',has_traffic_filtering=True,id=f9a7562b-de63-4374-b43b-18e3cb3af710,network=Network(8450ab2c-4f24-46cc-a6ec-644c02e2b3da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9a7562b-de') {{(pid=75226) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 17 01:17:15 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:17:15 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:17:15 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 17 01:17:15 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:17:15 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b225e3ef-bbce-57f9-b128-8db1bfeec7a8', '_type': 'linux-noop'}}, row=False) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:17:15 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:17:15 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:17:15 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:17:15 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf9a7562b-de, may_exist=True, interface_attrs={}) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:17:15 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf9a7562b-de, col_values=(('qos', UUID('6e27b8bd-397b-41ac-80ba-5df9a7ede753')),), if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:17:15 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf9a7562b-de, col_values=(('external_ids', {'iface-id': 'f9a7562b-de63-4374-b43b-18e3cb3af710', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:94:21:00', 'vm-uuid': 'ddfecefc-1e9b-4e6e-9995-855c8a061084'}),), if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:17:15 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:17:15 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:17:15 user nova-compute[75226]: INFO os_vif [None req-fbf61825-46c4-4952-b6b3-a359039308d2 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:21:00,bridge_name='br-int',has_traffic_filtering=True,id=f9a7562b-de63-4374-b43b-18e3cb3af710,network=Network(8450ab2c-4f24-46cc-a6ec-644c02e2b3da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9a7562b-de')
Nov 17 01:17:15 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:17:15 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:17:15 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-fbf61825-46c4-4952-b6b3-a359039308d2 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] No BDM found with device name vda, not building metadata. {{(pid=75226) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 01:17:15 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-fbf61825-46c4-4952-b6b3-a359039308d2 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] No VIF found with MAC fa:16:3e:94:21:00, not building metadata {{(pid=75226) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 01:17:15 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:17:15 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:17:16 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:17:16 user nova-compute[75226]: DEBUG nova.network.neutron [req-f8476b7d-0949-4524-a16c-9638cad803c1 req-b0048276-74fe-45c3-bfcc-183487cd0c8c service nova] [instance: ddfecefc-1e9b-4e6e-9995-855c8a061084] Updated VIF entry in instance network info cache for port f9a7562b-de63-4374-b43b-18e3cb3af710. {{(pid=75226) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 01:17:16 user nova-compute[75226]: DEBUG nova.network.neutron [req-f8476b7d-0949-4524-a16c-9638cad803c1 req-b0048276-74fe-45c3-bfcc-183487cd0c8c service nova] [instance: ddfecefc-1e9b-4e6e-9995-855c8a061084] Updating instance_info_cache with network_info: [{"id": "f9a7562b-de63-4374-b43b-18e3cb3af710", "address": "fa:16:3e:94:21:00", "network": {"id": "8450ab2c-4f24-46cc-a6ec-644c02e2b3da", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-385219532-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6869af66e0cc47bf9cca02ea9b688a6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9a7562b-de", "ovs_interfaceid": "f9a7562b-de63-4374-b43b-18e3cb3af710", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:17:16 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-f8476b7d-0949-4524-a16c-9638cad803c1 req-b0048276-74fe-45c3-bfcc-183487cd0c8c service nova] Releasing lock "refresh_cache-ddfecefc-1e9b-4e6e-9995-855c8a061084" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:17:16 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:17:16 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:17:17 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:17:17 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:17:17 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:17:17 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:17:17 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:17:18 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:17:18 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:17:18 user nova-compute[75226]: DEBUG nova.compute.manager [None req-0fa22ffc-fe17-4dad-869e-6faf857cba30 tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] [instance: 19250ac2-1b3f-4fe9-80b0-406b181929b6] Instance event wait completed in 0 seconds for  {{(pid=75226) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 17 01:17:18 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-0fa22ffc-fe17-4dad-869e-6faf857cba30 tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] [instance: 19250ac2-1b3f-4fe9-80b0-406b181929b6] Guest created on hypervisor {{(pid=75226) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 17 01:17:18 user nova-compute[75226]: INFO nova.virt.libvirt.driver [-] [instance: 19250ac2-1b3f-4fe9-80b0-406b181929b6] Instance spawned successfully.
Nov 17 01:17:18 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-0fa22ffc-fe17-4dad-869e-6faf857cba30 tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] [instance: 19250ac2-1b3f-4fe9-80b0-406b181929b6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 17 01:17:19 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-0fa22ffc-fe17-4dad-869e-6faf857cba30 tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] [instance: 19250ac2-1b3f-4fe9-80b0-406b181929b6] Found default for hw_cdrom_bus of ide {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:17:19 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-0fa22ffc-fe17-4dad-869e-6faf857cba30 tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] [instance: 19250ac2-1b3f-4fe9-80b0-406b181929b6] Found default for hw_disk_bus of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:17:19 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-0fa22ffc-fe17-4dad-869e-6faf857cba30 tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] [instance: 19250ac2-1b3f-4fe9-80b0-406b181929b6] Found default for hw_input_bus of None {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:17:19 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-0fa22ffc-fe17-4dad-869e-6faf857cba30 tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] [instance: 19250ac2-1b3f-4fe9-80b0-406b181929b6] Found default for hw_pointer_model of None {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:17:19 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-0fa22ffc-fe17-4dad-869e-6faf857cba30 tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] [instance: 19250ac2-1b3f-4fe9-80b0-406b181929b6] Found default for hw_video_model of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:17:19 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-0fa22ffc-fe17-4dad-869e-6faf857cba30 tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] [instance: 19250ac2-1b3f-4fe9-80b0-406b181929b6] Found default for hw_vif_model of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:17:19 user nova-compute[75226]: DEBUG nova.compute.manager [None req-191b96b5-dccc-49a3-a28d-1cb312c2c5d5 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: aa84e575-bdad-45b9-80ce-86b1c2826fb0] Instance event wait completed in 0 seconds for  {{(pid=75226) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 17 01:17:19 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-191b96b5-dccc-49a3-a28d-1cb312c2c5d5 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: aa84e575-bdad-45b9-80ce-86b1c2826fb0] Guest created on hypervisor {{(pid=75226) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 17 01:17:19 user nova-compute[75226]: INFO nova.virt.libvirt.driver [-] [instance: aa84e575-bdad-45b9-80ce-86b1c2826fb0] Instance spawned successfully.
Nov 17 01:17:19 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-191b96b5-dccc-49a3-a28d-1cb312c2c5d5 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: aa84e575-bdad-45b9-80ce-86b1c2826fb0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 17 01:17:19 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-191b96b5-dccc-49a3-a28d-1cb312c2c5d5 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: aa84e575-bdad-45b9-80ce-86b1c2826fb0] Found default for hw_cdrom_bus of ide {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:17:19 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-191b96b5-dccc-49a3-a28d-1cb312c2c5d5 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: aa84e575-bdad-45b9-80ce-86b1c2826fb0] Found default for hw_disk_bus of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:17:19 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-191b96b5-dccc-49a3-a28d-1cb312c2c5d5 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: aa84e575-bdad-45b9-80ce-86b1c2826fb0] Found default for hw_input_bus of None {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:17:19 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-191b96b5-dccc-49a3-a28d-1cb312c2c5d5 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: aa84e575-bdad-45b9-80ce-86b1c2826fb0] Found default for hw_pointer_model of None {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:17:19 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-191b96b5-dccc-49a3-a28d-1cb312c2c5d5 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: aa84e575-bdad-45b9-80ce-86b1c2826fb0] Found default for hw_video_model of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:17:19 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-191b96b5-dccc-49a3-a28d-1cb312c2c5d5 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: aa84e575-bdad-45b9-80ce-86b1c2826fb0] Found default for hw_vif_model of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:17:19 user nova-compute[75226]: INFO nova.compute.manager [None req-0fa22ffc-fe17-4dad-869e-6faf857cba30 tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] [instance: 19250ac2-1b3f-4fe9-80b0-406b181929b6] Took 15.07 seconds to spawn the instance on the hypervisor.
Nov 17 01:17:19 user nova-compute[75226]: DEBUG nova.compute.manager [None req-0fa22ffc-fe17-4dad-869e-6faf857cba30 tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] [instance: 19250ac2-1b3f-4fe9-80b0-406b181929b6] Checking state {{(pid=75226) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 01:17:19 user nova-compute[75226]: INFO nova.compute.manager [None req-191b96b5-dccc-49a3-a28d-1cb312c2c5d5 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: aa84e575-bdad-45b9-80ce-86b1c2826fb0] Took 13.85 seconds to spawn the instance on the hypervisor.
Nov 17 01:17:19 user nova-compute[75226]: DEBUG nova.compute.manager [None req-191b96b5-dccc-49a3-a28d-1cb312c2c5d5 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: aa84e575-bdad-45b9-80ce-86b1c2826fb0] Checking state {{(pid=75226) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 01:17:19 user nova-compute[75226]: INFO nova.compute.manager [None req-0fa22ffc-fe17-4dad-869e-6faf857cba30 tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] [instance: 19250ac2-1b3f-4fe9-80b0-406b181929b6] Took 16.18 seconds to build instance.
Nov 17 01:17:19 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-0fa22ffc-fe17-4dad-869e-6faf857cba30 tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] Lock "19250ac2-1b3f-4fe9-80b0-406b181929b6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.413s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:17:19 user nova-compute[75226]: INFO nova.compute.manager [None req-191b96b5-dccc-49a3-a28d-1cb312c2c5d5 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: aa84e575-bdad-45b9-80ce-86b1c2826fb0] Took 15.22 seconds to build instance.
Nov 17 01:17:19 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-191b96b5-dccc-49a3-a28d-1cb312c2c5d5 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Lock "aa84e575-bdad-45b9-80ce-86b1c2826fb0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.356s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:17:19 user nova-compute[75226]: DEBUG nova.compute.manager [None req-fbf61825-46c4-4952-b6b3-a359039308d2 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] [instance: ddfecefc-1e9b-4e6e-9995-855c8a061084] Instance event wait completed in 0 seconds for  {{(pid=75226) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 17 01:17:20 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-fbf61825-46c4-4952-b6b3-a359039308d2 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] [instance: ddfecefc-1e9b-4e6e-9995-855c8a061084] Guest created on hypervisor {{(pid=75226) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 17 01:17:20 user nova-compute[75226]: INFO nova.virt.libvirt.driver [-] [instance: ddfecefc-1e9b-4e6e-9995-855c8a061084] Instance spawned successfully.
Nov 17 01:17:20 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-fbf61825-46c4-4952-b6b3-a359039308d2 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] [instance: ddfecefc-1e9b-4e6e-9995-855c8a061084] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 17 01:17:20 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-fbf61825-46c4-4952-b6b3-a359039308d2 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] [instance: ddfecefc-1e9b-4e6e-9995-855c8a061084] Found default for hw_cdrom_bus of ide {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:17:20 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-fbf61825-46c4-4952-b6b3-a359039308d2 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] [instance: ddfecefc-1e9b-4e6e-9995-855c8a061084] Found default for hw_disk_bus of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:17:20 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-fbf61825-46c4-4952-b6b3-a359039308d2 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] [instance: ddfecefc-1e9b-4e6e-9995-855c8a061084] Found default for hw_input_bus of None {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:17:20 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-fbf61825-46c4-4952-b6b3-a359039308d2 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] [instance: ddfecefc-1e9b-4e6e-9995-855c8a061084] Found default for hw_pointer_model of None {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:17:20 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-fbf61825-46c4-4952-b6b3-a359039308d2 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] [instance: ddfecefc-1e9b-4e6e-9995-855c8a061084] Found default for hw_video_model of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:17:20 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-fbf61825-46c4-4952-b6b3-a359039308d2 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] [instance: ddfecefc-1e9b-4e6e-9995-855c8a061084] Found default for hw_vif_model of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:17:20 user nova-compute[75226]: INFO nova.compute.manager [None req-fbf61825-46c4-4952-b6b3-a359039308d2 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] [instance: ddfecefc-1e9b-4e6e-9995-855c8a061084] Took 9.91 seconds to spawn the instance on the hypervisor.
Nov 17 01:17:20 user nova-compute[75226]: DEBUG nova.compute.manager [None req-fbf61825-46c4-4952-b6b3-a359039308d2 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] [instance: ddfecefc-1e9b-4e6e-9995-855c8a061084] Checking state {{(pid=75226) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 01:17:20 user nova-compute[75226]: INFO nova.compute.manager [None req-fbf61825-46c4-4952-b6b3-a359039308d2 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] [instance: ddfecefc-1e9b-4e6e-9995-855c8a061084] Took 10.73 seconds to build instance.
Nov 17 01:17:20 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-fbf61825-46c4-4952-b6b3-a359039308d2 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Lock "ddfecefc-1e9b-4e6e-9995-855c8a061084" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.942s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:17:20 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:17:22 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:17:22 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:17:22 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:17:22 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:17:22 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:17:24 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:17:24 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:17:24 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:17:24 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:17:24 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:17:25 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-615bbbf5-25e3-4644-ad65-daa2b2d0c059 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Acquiring lock "724b81dd-4531-4c99-850d-0bfcbfdf7bd4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:17:25 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-615bbbf5-25e3-4644-ad65-daa2b2d0c059 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Lock "724b81dd-4531-4c99-850d-0bfcbfdf7bd4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:17:25 user nova-compute[75226]: DEBUG nova.compute.manager [None req-615bbbf5-25e3-4644-ad65-daa2b2d0c059 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] [instance: 724b81dd-4531-4c99-850d-0bfcbfdf7bd4] Starting instance... {{(pid=75226) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 17 01:17:25 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-615bbbf5-25e3-4644-ad65-daa2b2d0c059 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:17:25 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-615bbbf5-25e3-4644-ad65-daa2b2d0c059 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:17:25 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-615bbbf5-25e3-4644-ad65-daa2b2d0c059 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75226) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 17 01:17:25 user nova-compute[75226]: INFO nova.compute.claims [None req-615bbbf5-25e3-4644-ad65-daa2b2d0c059 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] [instance: 724b81dd-4531-4c99-850d-0bfcbfdf7bd4] Claim successful on node user
Nov 17 01:17:25 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:17:25 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:17:25 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:17:25 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:17:25 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:17:25 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-615bbbf5-25e3-4644-ad65-daa2b2d0c059 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:17:25 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-615bbbf5-25e3-4644-ad65-daa2b2d0c059 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:17:25 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-615bbbf5-25e3-4644-ad65-daa2b2d0c059 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.566s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:17:25 user nova-compute[75226]: DEBUG nova.compute.manager [None req-615bbbf5-25e3-4644-ad65-daa2b2d0c059 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] [instance: 724b81dd-4531-4c99-850d-0bfcbfdf7bd4] Start building networks asynchronously for instance. {{(pid=75226) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 17 01:17:26 user nova-compute[75226]: DEBUG nova.compute.manager [None req-615bbbf5-25e3-4644-ad65-daa2b2d0c059 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] [instance: 724b81dd-4531-4c99-850d-0bfcbfdf7bd4] Allocating IP information in the background. {{(pid=75226) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 17 01:17:26 user nova-compute[75226]: DEBUG nova.network.neutron [None req-615bbbf5-25e3-4644-ad65-daa2b2d0c059 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] [instance: 724b81dd-4531-4c99-850d-0bfcbfdf7bd4] allocate_for_instance() {{(pid=75226) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 17 01:17:26 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-615bbbf5-25e3-4644-ad65-daa2b2d0c059 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] [instance: 724b81dd-4531-4c99-850d-0bfcbfdf7bd4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 17 01:17:26 user nova-compute[75226]: DEBUG nova.compute.manager [None req-615bbbf5-25e3-4644-ad65-daa2b2d0c059 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] [instance: 724b81dd-4531-4c99-850d-0bfcbfdf7bd4] Start building block device mappings for instance. {{(pid=75226) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 17 01:17:26 user nova-compute[75226]: DEBUG nova.policy [None req-615bbbf5-25e3-4644-ad65-daa2b2d0c059 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5f6fd5dfdd9a4a36b6965ffab1b7c1e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a364d502d8948ff8b255dd2531b6218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75226) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 17 01:17:26 user nova-compute[75226]: DEBUG nova.compute.manager [None req-615bbbf5-25e3-4644-ad65-daa2b2d0c059 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] [instance: 724b81dd-4531-4c99-850d-0bfcbfdf7bd4] Start spawning the instance on the hypervisor. {{(pid=75226) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 17 01:17:26 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-615bbbf5-25e3-4644-ad65-daa2b2d0c059 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] [instance: 724b81dd-4531-4c99-850d-0bfcbfdf7bd4] Creating instance directory {{(pid=75226) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 17 01:17:26 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-615bbbf5-25e3-4644-ad65-daa2b2d0c059 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] [instance: 724b81dd-4531-4c99-850d-0bfcbfdf7bd4] Creating image(s)
Nov 17 01:17:26 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-615bbbf5-25e3-4644-ad65-daa2b2d0c059 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Acquiring lock "/opt/stack/data/nova/instances/724b81dd-4531-4c99-850d-0bfcbfdf7bd4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:17:26 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-615bbbf5-25e3-4644-ad65-daa2b2d0c059 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Lock "/opt/stack/data/nova/instances/724b81dd-4531-4c99-850d-0bfcbfdf7bd4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:17:26 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-615bbbf5-25e3-4644-ad65-daa2b2d0c059 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Lock "/opt/stack/data/nova/instances/724b81dd-4531-4c99-850d-0bfcbfdf7bd4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:17:26 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-615bbbf5-25e3-4644-ad65-daa2b2d0c059 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:17:26 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-615bbbf5-25e3-4644-ad65-daa2b2d0c059 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json" returned: 0 in 0.230s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:17:26 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-615bbbf5-25e3-4644-ad65-daa2b2d0c059 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Acquiring lock "a8a62c2546af3a2036b853250c5ac64d4c6b4371" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:17:26 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-615bbbf5-25e3-4644-ad65-daa2b2d0c059 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Lock "a8a62c2546af3a2036b853250c5ac64d4c6b4371" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:17:26 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-615bbbf5-25e3-4644-ad65-daa2b2d0c059 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:17:27 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-615bbbf5-25e3-4644-ad65-daa2b2d0c059 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json" returned: 0 in 0.229s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:17:27 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-615bbbf5-25e3-4644-ad65-daa2b2d0c059 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371,backing_fmt=raw /opt/stack/data/nova/instances/724b81dd-4531-4c99-850d-0bfcbfdf7bd4/disk 1073741824 {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:17:27 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:17:27 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-615bbbf5-25e3-4644-ad65-daa2b2d0c059 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371,backing_fmt=raw /opt/stack/data/nova/instances/724b81dd-4531-4c99-850d-0bfcbfdf7bd4/disk 1073741824" returned: 0 in 0.122s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:17:27 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-615bbbf5-25e3-4644-ad65-daa2b2d0c059 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Lock "a8a62c2546af3a2036b853250c5ac64d4c6b4371" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.357s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:17:27 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-615bbbf5-25e3-4644-ad65-daa2b2d0c059 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:17:27 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-615bbbf5-25e3-4644-ad65-daa2b2d0c059 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json" returned: 0 in 0.214s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:17:27 user nova-compute[75226]: DEBUG nova.virt.disk.api [None req-615bbbf5-25e3-4644-ad65-daa2b2d0c059 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Checking if we can resize image /opt/stack/data/nova/instances/724b81dd-4531-4c99-850d-0bfcbfdf7bd4/disk. size=1073741824 {{(pid=75226) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 17 01:17:27 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-615bbbf5-25e3-4644-ad65-daa2b2d0c059 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/724b81dd-4531-4c99-850d-0bfcbfdf7bd4/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:17:27 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-615bbbf5-25e3-4644-ad65-daa2b2d0c059 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/724b81dd-4531-4c99-850d-0bfcbfdf7bd4/disk --force-share --output=json" returned: 0 in 0.288s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:17:27 user nova-compute[75226]: DEBUG nova.virt.disk.api [None req-615bbbf5-25e3-4644-ad65-daa2b2d0c059 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Cannot resize image /opt/stack/data/nova/instances/724b81dd-4531-4c99-850d-0bfcbfdf7bd4/disk to a smaller size. {{(pid=75226) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 17 01:17:27 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-615bbbf5-25e3-4644-ad65-daa2b2d0c059 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] [instance: 724b81dd-4531-4c99-850d-0bfcbfdf7bd4] Created local disks {{(pid=75226) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 17 01:17:27 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-615bbbf5-25e3-4644-ad65-daa2b2d0c059 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] [instance: 724b81dd-4531-4c99-850d-0bfcbfdf7bd4] Ensure instance console log exists: /opt/stack/data/nova/instances/724b81dd-4531-4c99-850d-0bfcbfdf7bd4/console.log {{(pid=75226) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 17 01:17:27 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-615bbbf5-25e3-4644-ad65-daa2b2d0c059 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:17:27 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-615bbbf5-25e3-4644-ad65-daa2b2d0c059 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:17:27 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-615bbbf5-25e3-4644-ad65-daa2b2d0c059 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:17:28 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-84b5e452-4390-4592-b05f-8e18af5f564c tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] Acquiring lock "75b1cabe-ba15-4851-9140-5949afc33005" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:17:28 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-84b5e452-4390-4592-b05f-8e18af5f564c tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] Lock "75b1cabe-ba15-4851-9140-5949afc33005" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:17:28 user nova-compute[75226]: DEBUG nova.compute.manager [None req-84b5e452-4390-4592-b05f-8e18af5f564c tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] [instance: 75b1cabe-ba15-4851-9140-5949afc33005] Starting instance... {{(pid=75226) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 17 01:17:28 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-84b5e452-4390-4592-b05f-8e18af5f564c tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:17:28 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-84b5e452-4390-4592-b05f-8e18af5f564c tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:17:28 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-84b5e452-4390-4592-b05f-8e18af5f564c tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75226) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 17 01:17:28 user nova-compute[75226]: INFO nova.compute.claims [None req-84b5e452-4390-4592-b05f-8e18af5f564c tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] [instance: 75b1cabe-ba15-4851-9140-5949afc33005] Claim successful on node user
Nov 17 01:17:29 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:17:29 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-84b5e452-4390-4592-b05f-8e18af5f564c tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:17:29 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-84b5e452-4390-4592-b05f-8e18af5f564c tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:17:29 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-84b5e452-4390-4592-b05f-8e18af5f564c tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.508s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:17:29 user nova-compute[75226]: DEBUG nova.compute.manager [None req-84b5e452-4390-4592-b05f-8e18af5f564c tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] [instance: 75b1cabe-ba15-4851-9140-5949afc33005] Start building networks asynchronously for instance. {{(pid=75226) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 17 01:17:29 user nova-compute[75226]: DEBUG nova.compute.manager [None req-84b5e452-4390-4592-b05f-8e18af5f564c tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] [instance: 75b1cabe-ba15-4851-9140-5949afc33005] Allocating IP information in the background. {{(pid=75226) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 17 01:17:29 user nova-compute[75226]: DEBUG nova.network.neutron [None req-84b5e452-4390-4592-b05f-8e18af5f564c tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] [instance: 75b1cabe-ba15-4851-9140-5949afc33005] allocate_for_instance() {{(pid=75226) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 17 01:17:29 user nova-compute[75226]: DEBUG nova.network.neutron [None req-615bbbf5-25e3-4644-ad65-daa2b2d0c059 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] [instance: 724b81dd-4531-4c99-850d-0bfcbfdf7bd4] Successfully created port: f9692d93-cc90-464e-a8ef-abb2a5bb8fe0 {{(pid=75226) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 17 01:17:29 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-84b5e452-4390-4592-b05f-8e18af5f564c tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] [instance: 75b1cabe-ba15-4851-9140-5949afc33005] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 17 01:17:29 user nova-compute[75226]: DEBUG nova.compute.manager [None req-84b5e452-4390-4592-b05f-8e18af5f564c tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] [instance: 75b1cabe-ba15-4851-9140-5949afc33005] Start building block device mappings for instance. {{(pid=75226) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 17 01:17:29 user nova-compute[75226]: DEBUG nova.compute.manager [None req-84b5e452-4390-4592-b05f-8e18af5f564c tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] [instance: 75b1cabe-ba15-4851-9140-5949afc33005] Start spawning the instance on the hypervisor. {{(pid=75226) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 17 01:17:29 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-84b5e452-4390-4592-b05f-8e18af5f564c tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] [instance: 75b1cabe-ba15-4851-9140-5949afc33005] Creating instance directory {{(pid=75226) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 17 01:17:29 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-84b5e452-4390-4592-b05f-8e18af5f564c tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] [instance: 75b1cabe-ba15-4851-9140-5949afc33005] Creating image(s)
Nov 17 01:17:29 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-84b5e452-4390-4592-b05f-8e18af5f564c tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] Acquiring lock "/opt/stack/data/nova/instances/75b1cabe-ba15-4851-9140-5949afc33005/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:17:29 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-84b5e452-4390-4592-b05f-8e18af5f564c tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] Lock "/opt/stack/data/nova/instances/75b1cabe-ba15-4851-9140-5949afc33005/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:17:29 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-84b5e452-4390-4592-b05f-8e18af5f564c tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] Lock "/opt/stack/data/nova/instances/75b1cabe-ba15-4851-9140-5949afc33005/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.017s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:17:29 user nova-compute[75226]: DEBUG nova.policy [None req-84b5e452-4390-4592-b05f-8e18af5f564c tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cd3334c6476249beab82ac7c6df39afe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abb76252c4f437b9cb23db20136262c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75226) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 17 01:17:29 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-84b5e452-4390-4592-b05f-8e18af5f564c tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:17:29 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-f18e0a3b-5f90-438a-9720-c142fe497569 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] Acquiring lock "b054a557-dff6-49f8-9300-1307f8433567" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:17:29 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-f18e0a3b-5f90-438a-9720-c142fe497569 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] Lock "b054a557-dff6-49f8-9300-1307f8433567" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:17:29 user nova-compute[75226]: DEBUG nova.compute.manager [None req-f18e0a3b-5f90-438a-9720-c142fe497569 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] [instance: b054a557-dff6-49f8-9300-1307f8433567] Starting instance... {{(pid=75226) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 17 01:17:29 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-84b5e452-4390-4592-b05f-8e18af5f564c tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json" returned: 0 in 0.216s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:17:29 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-84b5e452-4390-4592-b05f-8e18af5f564c tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] Acquiring lock "a8a62c2546af3a2036b853250c5ac64d4c6b4371" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:17:29 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-84b5e452-4390-4592-b05f-8e18af5f564c tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] Lock "a8a62c2546af3a2036b853250c5ac64d4c6b4371" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:17:29 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-84b5e452-4390-4592-b05f-8e18af5f564c tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:17:30 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-f18e0a3b-5f90-438a-9720-c142fe497569 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:17:30 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-f18e0a3b-5f90-438a-9720-c142fe497569 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:17:30 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-f18e0a3b-5f90-438a-9720-c142fe497569 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75226) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 17 01:17:30 user nova-compute[75226]: INFO nova.compute.claims [None req-f18e0a3b-5f90-438a-9720-c142fe497569 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] [instance: b054a557-dff6-49f8-9300-1307f8433567] Claim successful on node user
Nov 17 01:17:30 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-84b5e452-4390-4592-b05f-8e18af5f564c tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json" returned: 0 in 0.247s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:17:30 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-84b5e452-4390-4592-b05f-8e18af5f564c tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371,backing_fmt=raw /opt/stack/data/nova/instances/75b1cabe-ba15-4851-9140-5949afc33005/disk 1073741824 {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:17:30 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-84b5e452-4390-4592-b05f-8e18af5f564c tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371,backing_fmt=raw /opt/stack/data/nova/instances/75b1cabe-ba15-4851-9140-5949afc33005/disk 1073741824" returned: 0 in 0.069s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:17:30 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-84b5e452-4390-4592-b05f-8e18af5f564c tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] Lock "a8a62c2546af3a2036b853250c5ac64d4c6b4371" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.324s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:17:30 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-84b5e452-4390-4592-b05f-8e18af5f564c tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:17:30 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-84b5e452-4390-4592-b05f-8e18af5f564c tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json" returned: 0 in 0.253s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:17:30 user nova-compute[75226]: DEBUG nova.virt.disk.api [None req-84b5e452-4390-4592-b05f-8e18af5f564c tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] Checking if we can resize image /opt/stack/data/nova/instances/75b1cabe-ba15-4851-9140-5949afc33005/disk. size=1073741824 {{(pid=75226) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 17 01:17:30 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-84b5e452-4390-4592-b05f-8e18af5f564c tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75b1cabe-ba15-4851-9140-5949afc33005/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:17:30 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-f18e0a3b-5f90-438a-9720-c142fe497569 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:17:30 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-f18e0a3b-5f90-438a-9720-c142fe497569 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:17:30 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:17:30 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-f18e0a3b-5f90-438a-9720-c142fe497569 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.657s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:17:30 user nova-compute[75226]: DEBUG nova.compute.manager [None req-f18e0a3b-5f90-438a-9720-c142fe497569 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] [instance: b054a557-dff6-49f8-9300-1307f8433567] Start building networks asynchronously for instance. {{(pid=75226) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 17 01:17:30 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-84b5e452-4390-4592-b05f-8e18af5f564c tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75b1cabe-ba15-4851-9140-5949afc33005/disk --force-share --output=json" returned: 0 in 0.260s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:17:30 user nova-compute[75226]: DEBUG nova.virt.disk.api [None req-84b5e452-4390-4592-b05f-8e18af5f564c tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] Cannot resize image /opt/stack/data/nova/instances/75b1cabe-ba15-4851-9140-5949afc33005/disk to a smaller size. {{(pid=75226) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 17 01:17:30 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-84b5e452-4390-4592-b05f-8e18af5f564c tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] [instance: 75b1cabe-ba15-4851-9140-5949afc33005] Created local disks {{(pid=75226) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 17 01:17:30 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-84b5e452-4390-4592-b05f-8e18af5f564c tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] [instance: 75b1cabe-ba15-4851-9140-5949afc33005] Ensure instance console log exists: /opt/stack/data/nova/instances/75b1cabe-ba15-4851-9140-5949afc33005/console.log {{(pid=75226) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 17 01:17:30 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-84b5e452-4390-4592-b05f-8e18af5f564c tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:17:30 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-84b5e452-4390-4592-b05f-8e18af5f564c tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.003s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:17:30 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-84b5e452-4390-4592-b05f-8e18af5f564c tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:17:30 user nova-compute[75226]: DEBUG nova.compute.manager [None req-f18e0a3b-5f90-438a-9720-c142fe497569 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] [instance: b054a557-dff6-49f8-9300-1307f8433567] Allocating IP information in the background. {{(pid=75226) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 17 01:17:30 user nova-compute[75226]: DEBUG nova.network.neutron [None req-f18e0a3b-5f90-438a-9720-c142fe497569 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] [instance: b054a557-dff6-49f8-9300-1307f8433567] allocate_for_instance() {{(pid=75226) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 17 01:17:30 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-f18e0a3b-5f90-438a-9720-c142fe497569 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] [instance: b054a557-dff6-49f8-9300-1307f8433567] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 17 01:17:30 user nova-compute[75226]: DEBUG nova.compute.manager [None req-f18e0a3b-5f90-438a-9720-c142fe497569 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] [instance: b054a557-dff6-49f8-9300-1307f8433567] Start building block device mappings for instance. {{(pid=75226) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 17 01:17:31 user nova-compute[75226]: DEBUG nova.compute.manager [None req-f18e0a3b-5f90-438a-9720-c142fe497569 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] [instance: b054a557-dff6-49f8-9300-1307f8433567] Start spawning the instance on the hypervisor. {{(pid=75226) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 17 01:17:31 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-f18e0a3b-5f90-438a-9720-c142fe497569 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] [instance: b054a557-dff6-49f8-9300-1307f8433567] Creating instance directory {{(pid=75226) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 17 01:17:31 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-f18e0a3b-5f90-438a-9720-c142fe497569 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] [instance: b054a557-dff6-49f8-9300-1307f8433567] Creating image(s)
Nov 17 01:17:31 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-f18e0a3b-5f90-438a-9720-c142fe497569 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] Acquiring lock "/opt/stack/data/nova/instances/b054a557-dff6-49f8-9300-1307f8433567/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:17:31 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-f18e0a3b-5f90-438a-9720-c142fe497569 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] Lock "/opt/stack/data/nova/instances/b054a557-dff6-49f8-9300-1307f8433567/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:17:31 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-f18e0a3b-5f90-438a-9720-c142fe497569 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] Lock "/opt/stack/data/nova/instances/b054a557-dff6-49f8-9300-1307f8433567/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:17:31 user nova-compute[75226]: DEBUG nova.policy [None req-f18e0a3b-5f90-438a-9720-c142fe497569 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b59a9221aae44dcbb688294a0483b715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f5190e0bff4cbb9384c0fb4faf54d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75226) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 17 01:17:31 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-f18e0a3b-5f90-438a-9720-c142fe497569 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:17:31 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-bf96017e-d4d1-42b2-b4a2-1c2e4f1f75f3 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] Acquiring lock "e7830f7a-80f1-4c2f-bd64-363e6dd9114a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:17:31 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-bf96017e-d4d1-42b2-b4a2-1c2e4f1f75f3 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] Lock "e7830f7a-80f1-4c2f-bd64-363e6dd9114a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:17:31 user nova-compute[75226]: DEBUG nova.compute.manager [None req-bf96017e-d4d1-42b2-b4a2-1c2e4f1f75f3 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] [instance: e7830f7a-80f1-4c2f-bd64-363e6dd9114a] Starting instance... {{(pid=75226) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 17 01:17:31 user nova-compute[75226]: DEBUG nova.network.neutron [None req-615bbbf5-25e3-4644-ad65-daa2b2d0c059 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] [instance: 724b81dd-4531-4c99-850d-0bfcbfdf7bd4] Successfully updated port: f9692d93-cc90-464e-a8ef-abb2a5bb8fe0 {{(pid=75226) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 17 01:17:31 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-615bbbf5-25e3-4644-ad65-daa2b2d0c059 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Acquiring lock "refresh_cache-724b81dd-4531-4c99-850d-0bfcbfdf7bd4" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:17:31 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-615bbbf5-25e3-4644-ad65-daa2b2d0c059 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Acquired lock "refresh_cache-724b81dd-4531-4c99-850d-0bfcbfdf7bd4" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:17:31 user nova-compute[75226]: DEBUG nova.network.neutron [None req-615bbbf5-25e3-4644-ad65-daa2b2d0c059 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] [instance: 724b81dd-4531-4c99-850d-0bfcbfdf7bd4] Building network info cache for instance {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 01:17:31 user nova-compute[75226]: DEBUG nova.compute.manager [req-47e4d5a3-2b8d-4d2b-ae20-105cb83ef3fe req-78ac9eac-69cd-43f2-979f-2654a32217c9 service nova] [instance: 724b81dd-4531-4c99-850d-0bfcbfdf7bd4] Received event network-changed-f9692d93-cc90-464e-a8ef-abb2a5bb8fe0 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:17:31 user nova-compute[75226]: DEBUG nova.compute.manager [req-47e4d5a3-2b8d-4d2b-ae20-105cb83ef3fe req-78ac9eac-69cd-43f2-979f-2654a32217c9 service nova] [instance: 724b81dd-4531-4c99-850d-0bfcbfdf7bd4] Refreshing instance network info cache due to event network-changed-f9692d93-cc90-464e-a8ef-abb2a5bb8fe0. {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 01:17:31 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-47e4d5a3-2b8d-4d2b-ae20-105cb83ef3fe req-78ac9eac-69cd-43f2-979f-2654a32217c9 service nova] Acquiring lock "refresh_cache-724b81dd-4531-4c99-850d-0bfcbfdf7bd4" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:17:31 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-f18e0a3b-5f90-438a-9720-c142fe497569 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json" returned: 0 in 0.286s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:17:31 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-f18e0a3b-5f90-438a-9720-c142fe497569 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] Acquiring lock "a8a62c2546af3a2036b853250c5ac64d4c6b4371" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:17:31 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-f18e0a3b-5f90-438a-9720-c142fe497569 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] Lock "a8a62c2546af3a2036b853250c5ac64d4c6b4371" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:17:31 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-f18e0a3b-5f90-438a-9720-c142fe497569 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:17:31 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-bf96017e-d4d1-42b2-b4a2-1c2e4f1f75f3 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:17:31 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-bf96017e-d4d1-42b2-b4a2-1c2e4f1f75f3 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.005s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:17:31 user nova-compute[75226]: DEBUG nova.network.neutron [None req-615bbbf5-25e3-4644-ad65-daa2b2d0c059 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] [instance: 724b81dd-4531-4c99-850d-0bfcbfdf7bd4] Instance cache missing network info. {{(pid=75226) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 17 01:17:31 user nova-compute[75226]: DEBUG nova.network.neutron [None req-84b5e452-4390-4592-b05f-8e18af5f564c tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] [instance: 75b1cabe-ba15-4851-9140-5949afc33005] Successfully created port: 8e47eaef-6e73-4c79-973d-31f6481368be {{(pid=75226) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 17 01:17:31 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-bf96017e-d4d1-42b2-b4a2-1c2e4f1f75f3 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75226) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 17 01:17:31 user nova-compute[75226]: INFO nova.compute.claims [None req-bf96017e-d4d1-42b2-b4a2-1c2e4f1f75f3 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] [instance: e7830f7a-80f1-4c2f-bd64-363e6dd9114a] Claim successful on node user
Nov 17 01:17:31 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-f18e0a3b-5f90-438a-9720-c142fe497569 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json" returned: 0 in 0.259s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:17:31 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-f18e0a3b-5f90-438a-9720-c142fe497569 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371,backing_fmt=raw /opt/stack/data/nova/instances/b054a557-dff6-49f8-9300-1307f8433567/disk 1073741824 {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:17:31 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-f18e0a3b-5f90-438a-9720-c142fe497569 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371,backing_fmt=raw /opt/stack/data/nova/instances/b054a557-dff6-49f8-9300-1307f8433567/disk 1073741824" returned: 0 in 0.066s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:17:31 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-f18e0a3b-5f90-438a-9720-c142fe497569 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] Lock "a8a62c2546af3a2036b853250c5ac64d4c6b4371" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.330s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:17:31 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-f18e0a3b-5f90-438a-9720-c142fe497569 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:17:32 user nova-compute[75226]: DEBUG nova.network.neutron [None req-f18e0a3b-5f90-438a-9720-c142fe497569 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] [instance: b054a557-dff6-49f8-9300-1307f8433567] Successfully created port: 9be521ab-d517-4746-b6b3-1e4930610165 {{(pid=75226) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 17 01:17:32 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-f18e0a3b-5f90-438a-9720-c142fe497569 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json" returned: 0 in 0.300s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:17:32 user nova-compute[75226]: DEBUG nova.virt.disk.api [None req-f18e0a3b-5f90-438a-9720-c142fe497569 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b054a557-dff6-49f8-9300-1307f8433567/disk. size=1073741824 {{(pid=75226) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 17 01:17:32 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-f18e0a3b-5f90-438a-9720-c142fe497569 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b054a557-dff6-49f8-9300-1307f8433567/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:17:32 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-bf96017e-d4d1-42b2-b4a2-1c2e4f1f75f3 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:17:32 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-bf96017e-d4d1-42b2-b4a2-1c2e4f1f75f3 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:17:32 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:17:32 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-bf96017e-d4d1-42b2-b4a2-1c2e4f1f75f3 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.753s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:17:32 user nova-compute[75226]: DEBUG nova.compute.manager [None req-bf96017e-d4d1-42b2-b4a2-1c2e4f1f75f3 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] [instance: e7830f7a-80f1-4c2f-bd64-363e6dd9114a] Start building networks asynchronously for instance. {{(pid=75226) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 17 01:17:32 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-f18e0a3b-5f90-438a-9720-c142fe497569 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b054a557-dff6-49f8-9300-1307f8433567/disk --force-share --output=json" returned: 0 in 0.262s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:17:32 user nova-compute[75226]: DEBUG nova.virt.disk.api [None req-f18e0a3b-5f90-438a-9720-c142fe497569 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] Cannot resize image /opt/stack/data/nova/instances/b054a557-dff6-49f8-9300-1307f8433567/disk to a smaller size. {{(pid=75226) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 17 01:17:32 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-f18e0a3b-5f90-438a-9720-c142fe497569 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] [instance: b054a557-dff6-49f8-9300-1307f8433567] Created local disks {{(pid=75226) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 17 01:17:32 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-f18e0a3b-5f90-438a-9720-c142fe497569 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] [instance: b054a557-dff6-49f8-9300-1307f8433567] Ensure instance console log exists: /opt/stack/data/nova/instances/b054a557-dff6-49f8-9300-1307f8433567/console.log {{(pid=75226) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 17 01:17:32 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-f18e0a3b-5f90-438a-9720-c142fe497569 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:17:32 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-f18e0a3b-5f90-438a-9720-c142fe497569 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:17:32 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-f18e0a3b-5f90-438a-9720-c142fe497569 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:17:32 user nova-compute[75226]: DEBUG nova.compute.manager [None req-bf96017e-d4d1-42b2-b4a2-1c2e4f1f75f3 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] [instance: e7830f7a-80f1-4c2f-bd64-363e6dd9114a] Allocating IP information in the background. {{(pid=75226) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 17 01:17:32 user nova-compute[75226]: DEBUG nova.network.neutron [None req-bf96017e-d4d1-42b2-b4a2-1c2e4f1f75f3 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] [instance: e7830f7a-80f1-4c2f-bd64-363e6dd9114a] allocate_for_instance() {{(pid=75226) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 17 01:17:32 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-bf96017e-d4d1-42b2-b4a2-1c2e4f1f75f3 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] [instance: e7830f7a-80f1-4c2f-bd64-363e6dd9114a] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Nov 17 01:17:32 user nova-compute[75226]: DEBUG nova.compute.manager [None req-bf96017e-d4d1-42b2-b4a2-1c2e4f1f75f3 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] [instance: e7830f7a-80f1-4c2f-bd64-363e6dd9114a] Start building block device mappings for instance. {{(pid=75226) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 17 01:17:32 user nova-compute[75226]: DEBUG nova.policy [None req-bf96017e-d4d1-42b2-b4a2-1c2e4f1f75f3 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bab86e39396b4da7888f2f1b9959ffb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32bfc0cc503b45f7b2ebb10fd934b630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75226) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 17 01:17:32 user nova-compute[75226]: DEBUG nova.network.neutron [None req-615bbbf5-25e3-4644-ad65-daa2b2d0c059 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] [instance: 724b81dd-4531-4c99-850d-0bfcbfdf7bd4] Updating instance_info_cache with network_info: [{"id": "f9692d93-cc90-464e-a8ef-abb2a5bb8fe0", "address": "fa:16:3e:ac:88:c8", "network": {"id": "1c1e8b70-ab07-4bf6-896b-f8779c33ac07", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1634201097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a364d502d8948ff8b255dd2531b6218", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9692d93-cc", "ovs_interfaceid": "f9692d93-cc90-464e-a8ef-abb2a5bb8fe0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:17:32 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-615bbbf5-25e3-4644-ad65-daa2b2d0c059 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Releasing lock "refresh_cache-724b81dd-4531-4c99-850d-0bfcbfdf7bd4" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:17:32 user nova-compute[75226]: DEBUG nova.compute.manager [None req-615bbbf5-25e3-4644-ad65-daa2b2d0c059 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] [instance: 724b81dd-4531-4c99-850d-0bfcbfdf7bd4] Instance network_info: |[{"id": "f9692d93-cc90-464e-a8ef-abb2a5bb8fe0", "address": "fa:16:3e:ac:88:c8", "network": {"id": "1c1e8b70-ab07-4bf6-896b-f8779c33ac07", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1634201097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a364d502d8948ff8b255dd2531b6218", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9692d93-cc", "ovs_interfaceid": "f9692d93-cc90-464e-a8ef-abb2a5bb8fe0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75226) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 17 01:17:32 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-47e4d5a3-2b8d-4d2b-ae20-105cb83ef3fe req-78ac9eac-69cd-43f2-979f-2654a32217c9 service nova] Acquired lock "refresh_cache-724b81dd-4531-4c99-850d-0bfcbfdf7bd4" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:17:32 user nova-compute[75226]: DEBUG nova.network.neutron [req-47e4d5a3-2b8d-4d2b-ae20-105cb83ef3fe req-78ac9eac-69cd-43f2-979f-2654a32217c9 service nova] [instance: 724b81dd-4531-4c99-850d-0bfcbfdf7bd4] Refreshing network info cache for port f9692d93-cc90-464e-a8ef-abb2a5bb8fe0 {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 01:17:32 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-615bbbf5-25e3-4644-ad65-daa2b2d0c059 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] [instance: 724b81dd-4531-4c99-850d-0bfcbfdf7bd4] Start _get_guest_xml network_info=[{"id": "f9692d93-cc90-464e-a8ef-abb2a5bb8fe0", "address": "fa:16:3e:ac:88:c8", "network": {"id": "1c1e8b70-ab07-4bf6-896b-f8779c33ac07", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1634201097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a364d502d8948ff8b255dd2531b6218", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9692d93-cc", "ovs_interfaceid": "f9692d93-cc90-464e-a8ef-abb2a5bb8fe0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T01:13:22Z,direct_url=<?>,disk_format='qcow2',id=0b369aea-6f3f-4690-9f01-229b90ab6310,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4e110cbf9a84362a6864a7732c435a1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T01:13:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '0b369aea-6f3f-4690-9f01-229b90ab6310'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75226) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 17 01:17:32 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-615bbbf5-25e3-4644-ad65-daa2b2d0c059 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:17:32 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-615bbbf5-25e3-4644-ad65-daa2b2d0c059 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:17:32 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-615bbbf5-25e3-4644-ad65-daa2b2d0c059 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75226) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 17 01:17:32 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-615bbbf5-25e3-4644-ad65-daa2b2d0c059 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] CPU controller missing on host. {{(pid=75226) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 17 01:17:32 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-615bbbf5-25e3-4644-ad65-daa2b2d0c059 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75226) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 17 01:17:32 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-615bbbf5-25e3-4644-ad65-daa2b2d0c059 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] CPU controller found on host. {{(pid=75226) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 17 01:17:32 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-615bbbf5-25e3-4644-ad65-daa2b2d0c059 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75226) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 17 01:17:32 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-615bbbf5-25e3-4644-ad65-daa2b2d0c059 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-17T01:13:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T01:13:22Z,direct_url=<?>,disk_format='qcow2',id=0b369aea-6f3f-4690-9f01-229b90ab6310,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4e110cbf9a84362a6864a7732c435a1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T01:13:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 17 01:17:32 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-615bbbf5-25e3-4644-ad65-daa2b2d0c059 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Flavor limits 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 17 01:17:32 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-615bbbf5-25e3-4644-ad65-daa2b2d0c059 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Image limits 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 17 01:17:32 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-615bbbf5-25e3-4644-ad65-daa2b2d0c059 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Flavor pref 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 17 01:17:32 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-615bbbf5-25e3-4644-ad65-daa2b2d0c059 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Image pref 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 17 01:17:32 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-615bbbf5-25e3-4644-ad65-daa2b2d0c059 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 17 01:17:32 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-615bbbf5-25e3-4644-ad65-daa2b2d0c059 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 17 01:17:32 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-615bbbf5-25e3-4644-ad65-daa2b2d0c059 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75226) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 17 01:17:32 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-615bbbf5-25e3-4644-ad65-daa2b2d0c059 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Got 1 possible topologies {{(pid=75226) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 17 01:17:32 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-615bbbf5-25e3-4644-ad65-daa2b2d0c059 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 17 01:17:32 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-615bbbf5-25e3-4644-ad65-daa2b2d0c059 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 17 01:17:32 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-615bbbf5-25e3-4644-ad65-daa2b2d0c059 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:17:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1918757108',display_name='tempest-VolumesAdminNegativeTest-server-1918757108',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1918757108',id=4,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHz/4AeNYrJq3cjVcgbBFarFf/Y7cQqWDHHJVWLY2sAub0fsGTBcyR/kVR5FsLYCcm5VzBe4Kv/JoK/QFqqSbbW4dmwRj+kh+mvVyJu+Kyh26865sDa0LIqYImKwHwHIJQ==',key_name='tempest-keypair-1102038973',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8a364d502d8948ff8b255dd2531b6218',ramdisk_id='',reservation_id='r-ff0hq3ec',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-2120834708',owner_user_name='tempest-VolumesAdminNegativeTest-2120834708-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T01:17:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5f6fd5dfdd9a4a36b6965ffab1b7c1e4',uuid=724b81dd-4531-4c99-850d-0bfcbfdf7bd4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f9692d93-cc90-464e-a8ef-abb2a5bb8fe0", "address": "fa:16:3e:ac:88:c8", "network": {"id": "1c1e8b70-ab07-4bf6-896b-f8779c33ac07", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1634201097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a364d502d8948ff8b255dd2531b6218", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9692d93-cc", "ovs_interfaceid": "f9692d93-cc90-464e-a8ef-abb2a5bb8fe0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75226) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 01:17:32 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-615bbbf5-25e3-4644-ad65-daa2b2d0c059 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Converting VIF {"id": "f9692d93-cc90-464e-a8ef-abb2a5bb8fe0", "address": "fa:16:3e:ac:88:c8", "network": {"id": "1c1e8b70-ab07-4bf6-896b-f8779c33ac07", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1634201097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a364d502d8948ff8b255dd2531b6218", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9692d93-cc", "ovs_interfaceid": "f9692d93-cc90-464e-a8ef-abb2a5bb8fe0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:17:32 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-615bbbf5-25e3-4644-ad65-daa2b2d0c059 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:88:c8,bridge_name='br-int',has_traffic_filtering=True,id=f9692d93-cc90-464e-a8ef-abb2a5bb8fe0,network=Network(1c1e8b70-ab07-4bf6-896b-f8779c33ac07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9692d93-cc') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:17:32 user nova-compute[75226]: DEBUG nova.objects.instance [None req-615bbbf5-25e3-4644-ad65-daa2b2d0c059 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Lazy-loading 'pci_devices' on Instance uuid 724b81dd-4531-4c99-850d-0bfcbfdf7bd4 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:17:32 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-615bbbf5-25e3-4644-ad65-daa2b2d0c059 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] [instance: 724b81dd-4531-4c99-850d-0bfcbfdf7bd4] End _get_guest_xml xml=<domain type="kvm">
Nov 17 01:17:32 user nova-compute[75226]:   <uuid>724b81dd-4531-4c99-850d-0bfcbfdf7bd4</uuid>
Nov 17 01:17:32 user nova-compute[75226]:   <name>instance-00000004</name>
Nov 17 01:17:32 user nova-compute[75226]:   <memory>524288</memory>
Nov 17 01:17:32 user nova-compute[75226]:   <vcpu>1</vcpu>
Nov 17 01:17:32 user nova-compute[75226]:   <metadata>
Nov 17 01:17:32 user nova-compute[75226]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 17 01:17:32 user nova-compute[75226]:       <nova:package version="0.0.0"/>
Nov 17 01:17:32 user nova-compute[75226]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1918757108</nova:name>
Nov 17 01:17:32 user nova-compute[75226]:       <nova:creationTime>2023-11-17 01:17:32</nova:creationTime>
Nov 17 01:17:32 user nova-compute[75226]:       <nova:flavor name="m1.tiny">
Nov 17 01:17:32 user nova-compute[75226]:         <nova:memory>512</nova:memory>
Nov 17 01:17:32 user nova-compute[75226]:         <nova:disk>1</nova:disk>
Nov 17 01:17:32 user nova-compute[75226]:         <nova:swap>0</nova:swap>
Nov 17 01:17:32 user nova-compute[75226]:         <nova:ephemeral>0</nova:ephemeral>
Nov 17 01:17:32 user nova-compute[75226]:         <nova:vcpus>1</nova:vcpus>
Nov 17 01:17:32 user nova-compute[75226]:       </nova:flavor>
Nov 17 01:17:32 user nova-compute[75226]:       <nova:owner>
Nov 17 01:17:32 user nova-compute[75226]:         <nova:user uuid="5f6fd5dfdd9a4a36b6965ffab1b7c1e4">tempest-VolumesAdminNegativeTest-2120834708-project-member</nova:user>
Nov 17 01:17:32 user nova-compute[75226]:         <nova:project uuid="8a364d502d8948ff8b255dd2531b6218">tempest-VolumesAdminNegativeTest-2120834708</nova:project>
Nov 17 01:17:32 user nova-compute[75226]:       </nova:owner>
Nov 17 01:17:32 user nova-compute[75226]:       <nova:root type="image" uuid="0b369aea-6f3f-4690-9f01-229b90ab6310"/>
Nov 17 01:17:32 user nova-compute[75226]:       <nova:ports>
Nov 17 01:17:32 user nova-compute[75226]:         <nova:port uuid="f9692d93-cc90-464e-a8ef-abb2a5bb8fe0">
Nov 17 01:17:32 user nova-compute[75226]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 17 01:17:32 user nova-compute[75226]:         </nova:port>
Nov 17 01:17:32 user nova-compute[75226]:       </nova:ports>
Nov 17 01:17:32 user nova-compute[75226]:     </nova:instance>
Nov 17 01:17:32 user nova-compute[75226]:   </metadata>
Nov 17 01:17:32 user nova-compute[75226]:   <sysinfo type="smbios">
Nov 17 01:17:32 user nova-compute[75226]:     <system>
Nov 17 01:17:32 user nova-compute[75226]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 17 01:17:32 user nova-compute[75226]:       <entry name="product">OpenStack Nova</entry>
Nov 17 01:17:32 user nova-compute[75226]:       <entry name="version">0.0.0</entry>
Nov 17 01:17:32 user nova-compute[75226]:       <entry name="serial">724b81dd-4531-4c99-850d-0bfcbfdf7bd4</entry>
Nov 17 01:17:32 user nova-compute[75226]:       <entry name="uuid">724b81dd-4531-4c99-850d-0bfcbfdf7bd4</entry>
Nov 17 01:17:32 user nova-compute[75226]:       <entry name="family">Virtual Machine</entry>
Nov 17 01:17:32 user nova-compute[75226]:     </system>
Nov 17 01:17:32 user nova-compute[75226]:   </sysinfo>
Nov 17 01:17:32 user nova-compute[75226]:   <os>
Nov 17 01:17:32 user nova-compute[75226]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 17 01:17:32 user nova-compute[75226]:     <boot dev="hd"/>
Nov 17 01:17:32 user nova-compute[75226]:     <smbios mode="sysinfo"/>
Nov 17 01:17:32 user nova-compute[75226]:   </os>
Nov 17 01:17:32 user nova-compute[75226]:   <features>
Nov 17 01:17:32 user nova-compute[75226]:     <acpi/>
Nov 17 01:17:32 user nova-compute[75226]:     <apic/>
Nov 17 01:17:32 user nova-compute[75226]:     <vmcoreinfo/>
Nov 17 01:17:32 user nova-compute[75226]:   </features>
Nov 17 01:17:32 user nova-compute[75226]:   <clock offset="utc">
Nov 17 01:17:32 user nova-compute[75226]:     <timer name="pit" tickpolicy="delay"/>
Nov 17 01:17:32 user nova-compute[75226]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 17 01:17:32 user nova-compute[75226]:     <timer name="hpet" present="no"/>
Nov 17 01:17:32 user nova-compute[75226]:   </clock>
Nov 17 01:17:32 user nova-compute[75226]:   <cpu mode="custom" match="exact">
Nov 17 01:17:32 user nova-compute[75226]:     <model>Nehalem</model>
Nov 17 01:17:32 user nova-compute[75226]:     <topology sockets="1" cores="1" threads="1"/>
Nov 17 01:17:32 user nova-compute[75226]:   </cpu>
Nov 17 01:17:32 user nova-compute[75226]:   <devices>
Nov 17 01:17:32 user nova-compute[75226]:     <disk type="file" device="disk">
Nov 17 01:17:32 user nova-compute[75226]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 17 01:17:32 user nova-compute[75226]:       <source file="/opt/stack/data/nova/instances/724b81dd-4531-4c99-850d-0bfcbfdf7bd4/disk"/>
Nov 17 01:17:32 user nova-compute[75226]:       <target dev="vda" bus="virtio"/>
Nov 17 01:17:32 user nova-compute[75226]:     </disk>
Nov 17 01:17:32 user nova-compute[75226]:     <interface type="ethernet">
Nov 17 01:17:32 user nova-compute[75226]:       <mac address="fa:16:3e:ac:88:c8"/>
Nov 17 01:17:32 user nova-compute[75226]:       <model type="virtio"/>
Nov 17 01:17:32 user nova-compute[75226]:       <mtu size="1442"/>
Nov 17 01:17:32 user nova-compute[75226]:       <target dev="tapf9692d93-cc"/>
Nov 17 01:17:32 user nova-compute[75226]:     </interface>
Nov 17 01:17:32 user nova-compute[75226]:     <serial type="pty">
Nov 17 01:17:32 user nova-compute[75226]:       <log file="/opt/stack/data/nova/instances/724b81dd-4531-4c99-850d-0bfcbfdf7bd4/console.log" append="off"/>
Nov 17 01:17:32 user nova-compute[75226]:     </serial>
Nov 17 01:17:32 user nova-compute[75226]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 17 01:17:32 user nova-compute[75226]:     <video>
Nov 17 01:17:32 user nova-compute[75226]:       <model type="virtio"/>
Nov 17 01:17:32 user nova-compute[75226]:     </video>
Nov 17 01:17:32 user nova-compute[75226]:     <rng model="virtio">
Nov 17 01:17:32 user nova-compute[75226]:       <backend model="random">/dev/urandom</backend>
Nov 17 01:17:32 user nova-compute[75226]:     </rng>
Nov 17 01:17:32 user nova-compute[75226]:     <controller type="usb" index="0" model="none"/>
Nov 17 01:17:32 user nova-compute[75226]:     <memballoon model="virtio">
Nov 17 01:17:32 user nova-compute[75226]:       <stats period="10"/>
Nov 17 01:17:32 user nova-compute[75226]:     </memballoon>
Nov 17 01:17:32 user nova-compute[75226]:   </devices>
Nov 17 01:17:32 user nova-compute[75226]: </domain>
Nov 17 01:17:32 user nova-compute[75226]:  {{(pid=75226) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 17 01:17:32 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-615bbbf5-25e3-4644-ad65-daa2b2d0c059 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:17:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1918757108',display_name='tempest-VolumesAdminNegativeTest-server-1918757108',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1918757108',id=4,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHz/4AeNYrJq3cjVcgbBFarFf/Y7cQqWDHHJVWLY2sAub0fsGTBcyR/kVR5FsLYCcm5VzBe4Kv/JoK/QFqqSbbW4dmwRj+kh+mvVyJu+Kyh26865sDa0LIqYImKwHwHIJQ==',key_name='tempest-keypair-1102038973',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8a364d502d8948ff8b255dd2531b6218',ramdisk_id='',reservation_id='r-ff0hq3ec',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-2120834708',owner_user_name='tempest-VolumesAdminNegativeTest-2120834708-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T01:17:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5f6fd5dfdd9a4a36b6965ffab1b7c1e4',uuid=724b81dd-4531-4c99-850d-0bfcbfdf7bd4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f9692d93-cc90-464e-a8ef-abb2a5bb8fe0", "address": "fa:16:3e:ac:88:c8", "network": {"id": "1c1e8b70-ab07-4bf6-896b-f8779c33ac07", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1634201097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a364d502d8948ff8b255dd2531b6218", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9692d93-cc", "ovs_interfaceid": "f9692d93-cc90-464e-a8ef-abb2a5bb8fe0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 17 01:17:32 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-615bbbf5-25e3-4644-ad65-daa2b2d0c059 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Converting VIF {"id": "f9692d93-cc90-464e-a8ef-abb2a5bb8fe0", "address": "fa:16:3e:ac:88:c8", "network": {"id": "1c1e8b70-ab07-4bf6-896b-f8779c33ac07", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1634201097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a364d502d8948ff8b255dd2531b6218", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9692d93-cc", "ovs_interfaceid": "f9692d93-cc90-464e-a8ef-abb2a5bb8fe0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:17:32 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-615bbbf5-25e3-4644-ad65-daa2b2d0c059 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:88:c8,bridge_name='br-int',has_traffic_filtering=True,id=f9692d93-cc90-464e-a8ef-abb2a5bb8fe0,network=Network(1c1e8b70-ab07-4bf6-896b-f8779c33ac07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9692d93-cc') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:17:32 user nova-compute[75226]: DEBUG os_vif [None req-615bbbf5-25e3-4644-ad65-daa2b2d0c059 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:88:c8,bridge_name='br-int',has_traffic_filtering=True,id=f9692d93-cc90-464e-a8ef-abb2a5bb8fe0,network=Network(1c1e8b70-ab07-4bf6-896b-f8779c33ac07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9692d93-cc') {{(pid=75226) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 17 01:17:32 user nova-compute[75226]: DEBUG nova.compute.manager [None req-bf96017e-d4d1-42b2-b4a2-1c2e4f1f75f3 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] [instance: e7830f7a-80f1-4c2f-bd64-363e6dd9114a] Start spawning the instance on the hypervisor. {{(pid=75226) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 17 01:17:32 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-bf96017e-d4d1-42b2-b4a2-1c2e4f1f75f3 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] [instance: e7830f7a-80f1-4c2f-bd64-363e6dd9114a] Creating instance directory {{(pid=75226) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 17 01:17:32 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-bf96017e-d4d1-42b2-b4a2-1c2e4f1f75f3 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] [instance: e7830f7a-80f1-4c2f-bd64-363e6dd9114a] Creating image(s)
Nov 17 01:17:32 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-bf96017e-d4d1-42b2-b4a2-1c2e4f1f75f3 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] Acquiring lock "/opt/stack/data/nova/instances/e7830f7a-80f1-4c2f-bd64-363e6dd9114a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:17:32 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-bf96017e-d4d1-42b2-b4a2-1c2e4f1f75f3 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] Lock "/opt/stack/data/nova/instances/e7830f7a-80f1-4c2f-bd64-363e6dd9114a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:17:32 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-bf96017e-d4d1-42b2-b4a2-1c2e4f1f75f3 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] Lock "/opt/stack/data/nova/instances/e7830f7a-80f1-4c2f-bd64-363e6dd9114a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:17:32 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-bf96017e-d4d1-42b2-b4a2-1c2e4f1f75f3 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] Acquiring lock "f98cc1a7de4561ff4f2045cea2489811672b1b01" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:17:32 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-bf96017e-d4d1-42b2-b4a2-1c2e4f1f75f3 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] Lock "f98cc1a7de4561ff4f2045cea2489811672b1b01" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:17:32 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:17:32 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:17:32 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 17 01:17:32 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:17:32 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd997852a-b4bf-5c06-b954-5ba1143d0585', '_type': 'linux-noop'}}, row=False) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:17:32 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:17:32 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:17:32 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:17:32 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf9692d93-cc, may_exist=True, interface_attrs={}) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:17:32 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf9692d93-cc, col_values=(('qos', UUID('b5d59dcc-ee24-4aeb-8ab4-a98d96e4e219')),), if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:17:32 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf9692d93-cc, col_values=(('external_ids', {'iface-id': 'f9692d93-cc90-464e-a8ef-abb2a5bb8fe0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ac:88:c8', 'vm-uuid': '724b81dd-4531-4c99-850d-0bfcbfdf7bd4'}),), if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:17:32 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:17:32 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:17:32 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:17:32 user nova-compute[75226]: INFO os_vif [None req-615bbbf5-25e3-4644-ad65-daa2b2d0c059 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:88:c8,bridge_name='br-int',has_traffic_filtering=True,id=f9692d93-cc90-464e-a8ef-abb2a5bb8fe0,network=Network(1c1e8b70-ab07-4bf6-896b-f8779c33ac07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9692d93-cc')
Nov 17 01:17:33 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-bf96017e-d4d1-42b2-b4a2-1c2e4f1f75f3 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f98cc1a7de4561ff4f2045cea2489811672b1b01.part --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:17:33 user nova-compute[75226]: DEBUG nova.network.neutron [None req-f18e0a3b-5f90-438a-9720-c142fe497569 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] [instance: b054a557-dff6-49f8-9300-1307f8433567] Successfully updated port: 9be521ab-d517-4746-b6b3-1e4930610165 {{(pid=75226) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 17 01:17:33 user nova-compute[75226]: DEBUG nova.network.neutron [None req-84b5e452-4390-4592-b05f-8e18af5f564c tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] [instance: 75b1cabe-ba15-4851-9140-5949afc33005] Successfully updated port: 8e47eaef-6e73-4c79-973d-31f6481368be {{(pid=75226) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 17 01:17:33 user nova-compute[75226]: DEBUG nova.compute.manager [req-8ac79a3f-fc6c-4da5-853e-2fba3eecf31e req-f0e436c8-827e-4e42-a14e-dcd1cd413b40 service nova] [instance: b054a557-dff6-49f8-9300-1307f8433567] Received event network-changed-9be521ab-d517-4746-b6b3-1e4930610165 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:17:33 user nova-compute[75226]: DEBUG nova.compute.manager [req-8ac79a3f-fc6c-4da5-853e-2fba3eecf31e req-f0e436c8-827e-4e42-a14e-dcd1cd413b40 service nova] [instance: b054a557-dff6-49f8-9300-1307f8433567] Refreshing instance network info cache due to event network-changed-9be521ab-d517-4746-b6b3-1e4930610165. {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 01:17:33 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-8ac79a3f-fc6c-4da5-853e-2fba3eecf31e req-f0e436c8-827e-4e42-a14e-dcd1cd413b40 service nova] Acquiring lock "refresh_cache-b054a557-dff6-49f8-9300-1307f8433567" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:17:33 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-8ac79a3f-fc6c-4da5-853e-2fba3eecf31e req-f0e436c8-827e-4e42-a14e-dcd1cd413b40 service nova] Acquired lock "refresh_cache-b054a557-dff6-49f8-9300-1307f8433567" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:17:33 user nova-compute[75226]: DEBUG nova.network.neutron [req-8ac79a3f-fc6c-4da5-853e-2fba3eecf31e req-f0e436c8-827e-4e42-a14e-dcd1cd413b40 service nova] [instance: b054a557-dff6-49f8-9300-1307f8433567] Refreshing network info cache for port 9be521ab-d517-4746-b6b3-1e4930610165 {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 01:17:33 user nova-compute[75226]: DEBUG nova.compute.manager [req-7f888e92-e8ed-41cb-b27a-1d577d972b1a req-b2a175ff-7690-41a5-86eb-531db0c7a6ac service nova] [instance: 75b1cabe-ba15-4851-9140-5949afc33005] Received event network-changed-8e47eaef-6e73-4c79-973d-31f6481368be {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:17:33 user nova-compute[75226]: DEBUG nova.compute.manager [req-7f888e92-e8ed-41cb-b27a-1d577d972b1a req-b2a175ff-7690-41a5-86eb-531db0c7a6ac service nova] [instance: 75b1cabe-ba15-4851-9140-5949afc33005] Refreshing instance network info cache due to event network-changed-8e47eaef-6e73-4c79-973d-31f6481368be. {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 01:17:33 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-7f888e92-e8ed-41cb-b27a-1d577d972b1a req-b2a175ff-7690-41a5-86eb-531db0c7a6ac service nova] Acquiring lock "refresh_cache-75b1cabe-ba15-4851-9140-5949afc33005" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:17:33 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-7f888e92-e8ed-41cb-b27a-1d577d972b1a req-b2a175ff-7690-41a5-86eb-531db0c7a6ac service nova] Acquired lock "refresh_cache-75b1cabe-ba15-4851-9140-5949afc33005" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:17:33 user nova-compute[75226]: DEBUG nova.network.neutron [req-7f888e92-e8ed-41cb-b27a-1d577d972b1a req-b2a175ff-7690-41a5-86eb-531db0c7a6ac service nova] [instance: 75b1cabe-ba15-4851-9140-5949afc33005] Refreshing network info cache for port 8e47eaef-6e73-4c79-973d-31f6481368be {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 01:17:33 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-f18e0a3b-5f90-438a-9720-c142fe497569 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] Acquiring lock "refresh_cache-b054a557-dff6-49f8-9300-1307f8433567" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:17:33 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-84b5e452-4390-4592-b05f-8e18af5f564c tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] Acquiring lock "refresh_cache-75b1cabe-ba15-4851-9140-5949afc33005" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:17:33 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-615bbbf5-25e3-4644-ad65-daa2b2d0c059 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] No BDM found with device name vda, not building metadata. {{(pid=75226) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 01:17:33 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-615bbbf5-25e3-4644-ad65-daa2b2d0c059 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] No VIF found with MAC fa:16:3e:ac:88:c8, not building metadata {{(pid=75226) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 01:17:33 user nova-compute[75226]: DEBUG nova.network.neutron [req-7f888e92-e8ed-41cb-b27a-1d577d972b1a req-b2a175ff-7690-41a5-86eb-531db0c7a6ac service nova] [instance: 75b1cabe-ba15-4851-9140-5949afc33005] Instance cache missing network info. {{(pid=75226) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 17 01:17:33 user nova-compute[75226]: DEBUG nova.network.neutron [req-8ac79a3f-fc6c-4da5-853e-2fba3eecf31e req-f0e436c8-827e-4e42-a14e-dcd1cd413b40 service nova] [instance: b054a557-dff6-49f8-9300-1307f8433567] Instance cache missing network info. {{(pid=75226) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 17 01:17:33 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-bf96017e-d4d1-42b2-b4a2-1c2e4f1f75f3 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f98cc1a7de4561ff4f2045cea2489811672b1b01.part --force-share --output=json" returned: 0 in 0.301s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:17:33 user nova-compute[75226]: DEBUG nova.virt.images [None req-bf96017e-d4d1-42b2-b4a2-1c2e4f1f75f3 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] d512d3f5-0961-48fa-a7c4-4be85445b5e2 was qcow2, converting to raw {{(pid=75226) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 17 01:17:33 user nova-compute[75226]: DEBUG nova.privsep.utils [None req-bf96017e-d4d1-42b2-b4a2-1c2e4f1f75f3 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75226) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 17 01:17:33 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-bf96017e-d4d1-42b2-b4a2-1c2e4f1f75f3 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f98cc1a7de4561ff4f2045cea2489811672b1b01.part /opt/stack/data/nova/instances/_base/f98cc1a7de4561ff4f2045cea2489811672b1b01.converted {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:17:34 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-bf96017e-d4d1-42b2-b4a2-1c2e4f1f75f3 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f98cc1a7de4561ff4f2045cea2489811672b1b01.part /opt/stack/data/nova/instances/_base/f98cc1a7de4561ff4f2045cea2489811672b1b01.converted" returned: 0 in 0.398s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:17:34 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-bf96017e-d4d1-42b2-b4a2-1c2e4f1f75f3 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f98cc1a7de4561ff4f2045cea2489811672b1b01.converted --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:17:34 user nova-compute[75226]: DEBUG nova.network.neutron [req-8ac79a3f-fc6c-4da5-853e-2fba3eecf31e req-f0e436c8-827e-4e42-a14e-dcd1cd413b40 service nova] [instance: b054a557-dff6-49f8-9300-1307f8433567] Updating instance_info_cache with network_info: [] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:17:34 user nova-compute[75226]: DEBUG nova.network.neutron [req-47e4d5a3-2b8d-4d2b-ae20-105cb83ef3fe req-78ac9eac-69cd-43f2-979f-2654a32217c9 service nova] [instance: 724b81dd-4531-4c99-850d-0bfcbfdf7bd4] Updated VIF entry in instance network info cache for port f9692d93-cc90-464e-a8ef-abb2a5bb8fe0. {{(pid=75226) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 01:17:34 user nova-compute[75226]: DEBUG nova.network.neutron [req-47e4d5a3-2b8d-4d2b-ae20-105cb83ef3fe req-78ac9eac-69cd-43f2-979f-2654a32217c9 service nova] [instance: 724b81dd-4531-4c99-850d-0bfcbfdf7bd4] Updating instance_info_cache with network_info: [{"id": "f9692d93-cc90-464e-a8ef-abb2a5bb8fe0", "address": "fa:16:3e:ac:88:c8", "network": {"id": "1c1e8b70-ab07-4bf6-896b-f8779c33ac07", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1634201097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a364d502d8948ff8b255dd2531b6218", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9692d93-cc", "ovs_interfaceid": "f9692d93-cc90-464e-a8ef-abb2a5bb8fe0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:17:34 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-8ac79a3f-fc6c-4da5-853e-2fba3eecf31e req-f0e436c8-827e-4e42-a14e-dcd1cd413b40 service nova] Releasing lock "refresh_cache-b054a557-dff6-49f8-9300-1307f8433567" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:17:34 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-f18e0a3b-5f90-438a-9720-c142fe497569 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] Acquired lock "refresh_cache-b054a557-dff6-49f8-9300-1307f8433567" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:17:34 user nova-compute[75226]: DEBUG nova.network.neutron [None req-f18e0a3b-5f90-438a-9720-c142fe497569 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] [instance: b054a557-dff6-49f8-9300-1307f8433567] Building network info cache for instance {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 01:17:34 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-47e4d5a3-2b8d-4d2b-ae20-105cb83ef3fe req-78ac9eac-69cd-43f2-979f-2654a32217c9 service nova] Releasing lock "refresh_cache-724b81dd-4531-4c99-850d-0bfcbfdf7bd4" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:17:34 user nova-compute[75226]: DEBUG nova.network.neutron [None req-f18e0a3b-5f90-438a-9720-c142fe497569 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] [instance: b054a557-dff6-49f8-9300-1307f8433567] Instance cache missing network info. {{(pid=75226) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 17 01:17:34 user nova-compute[75226]: DEBUG nova.network.neutron [None req-bf96017e-d4d1-42b2-b4a2-1c2e4f1f75f3 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] [instance: e7830f7a-80f1-4c2f-bd64-363e6dd9114a] Successfully created port: b273b468-b80c-435e-bae6-9cbbcf617110 {{(pid=75226) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 17 01:17:34 user nova-compute[75226]: DEBUG nova.network.neutron [req-7f888e92-e8ed-41cb-b27a-1d577d972b1a req-b2a175ff-7690-41a5-86eb-531db0c7a6ac service nova] [instance: 75b1cabe-ba15-4851-9140-5949afc33005] Updating instance_info_cache with network_info: [] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:17:34 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-bf96017e-d4d1-42b2-b4a2-1c2e4f1f75f3 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f98cc1a7de4561ff4f2045cea2489811672b1b01.converted --force-share --output=json" returned: 0 in 0.266s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:17:34 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-bf96017e-d4d1-42b2-b4a2-1c2e4f1f75f3 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] Lock "f98cc1a7de4561ff4f2045cea2489811672b1b01" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.639s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:17:34 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-bf96017e-d4d1-42b2-b4a2-1c2e4f1f75f3 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f98cc1a7de4561ff4f2045cea2489811672b1b01 --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:17:34 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-7f888e92-e8ed-41cb-b27a-1d577d972b1a req-b2a175ff-7690-41a5-86eb-531db0c7a6ac service nova] Releasing lock "refresh_cache-75b1cabe-ba15-4851-9140-5949afc33005" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:17:34 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-84b5e452-4390-4592-b05f-8e18af5f564c tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] Acquired lock "refresh_cache-75b1cabe-ba15-4851-9140-5949afc33005" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:17:34 user nova-compute[75226]: DEBUG nova.network.neutron [None req-84b5e452-4390-4592-b05f-8e18af5f564c tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] [instance: 75b1cabe-ba15-4851-9140-5949afc33005] Building network info cache for instance {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 01:17:34 user nova-compute[75226]: DEBUG nova.network.neutron [None req-84b5e452-4390-4592-b05f-8e18af5f564c tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] [instance: 75b1cabe-ba15-4851-9140-5949afc33005] Instance cache missing network info. {{(pid=75226) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 17 01:17:34 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-bf96017e-d4d1-42b2-b4a2-1c2e4f1f75f3 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f98cc1a7de4561ff4f2045cea2489811672b1b01 --force-share --output=json" returned: 0 in 0.256s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:17:34 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-bf96017e-d4d1-42b2-b4a2-1c2e4f1f75f3 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] Acquiring lock "f98cc1a7de4561ff4f2045cea2489811672b1b01" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:17:34 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-bf96017e-d4d1-42b2-b4a2-1c2e4f1f75f3 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] Lock "f98cc1a7de4561ff4f2045cea2489811672b1b01" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:17:34 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-bf96017e-d4d1-42b2-b4a2-1c2e4f1f75f3 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f98cc1a7de4561ff4f2045cea2489811672b1b01 --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:17:34 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-bf96017e-d4d1-42b2-b4a2-1c2e4f1f75f3 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f98cc1a7de4561ff4f2045cea2489811672b1b01 --force-share --output=json" returned: 0 in 0.193s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:17:34 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-bf96017e-d4d1-42b2-b4a2-1c2e4f1f75f3 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f98cc1a7de4561ff4f2045cea2489811672b1b01,backing_fmt=raw /opt/stack/data/nova/instances/e7830f7a-80f1-4c2f-bd64-363e6dd9114a/disk 1073741824 {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:17:34 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-bf96017e-d4d1-42b2-b4a2-1c2e4f1f75f3 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f98cc1a7de4561ff4f2045cea2489811672b1b01,backing_fmt=raw /opt/stack/data/nova/instances/e7830f7a-80f1-4c2f-bd64-363e6dd9114a/disk 1073741824" returned: 0 in 0.066s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:17:34 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-bf96017e-d4d1-42b2-b4a2-1c2e4f1f75f3 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] Lock "f98cc1a7de4561ff4f2045cea2489811672b1b01" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.266s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:17:34 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-bf96017e-d4d1-42b2-b4a2-1c2e4f1f75f3 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f98cc1a7de4561ff4f2045cea2489811672b1b01 --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:17:35 user nova-compute[75226]: DEBUG nova.network.neutron [None req-f18e0a3b-5f90-438a-9720-c142fe497569 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] [instance: b054a557-dff6-49f8-9300-1307f8433567] Updating instance_info_cache with network_info: [{"id": "9be521ab-d517-4746-b6b3-1e4930610165", "address": "fa:16:3e:c9:37:0f", "network": {"id": "126149e3-f0c6-483c-a0b4-4fd1dcd1a390", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1008205473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8f5190e0bff4cbb9384c0fb4faf54d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9be521ab-d5", "ovs_interfaceid": "9be521ab-d517-4746-b6b3-1e4930610165", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:17:35 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-f18e0a3b-5f90-438a-9720-c142fe497569 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] Releasing lock "refresh_cache-b054a557-dff6-49f8-9300-1307f8433567" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:17:35 user nova-compute[75226]: DEBUG nova.compute.manager [None req-f18e0a3b-5f90-438a-9720-c142fe497569 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] [instance: b054a557-dff6-49f8-9300-1307f8433567] Instance network_info: |[{"id": "9be521ab-d517-4746-b6b3-1e4930610165", "address": "fa:16:3e:c9:37:0f", "network": {"id": "126149e3-f0c6-483c-a0b4-4fd1dcd1a390", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1008205473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8f5190e0bff4cbb9384c0fb4faf54d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9be521ab-d5", "ovs_interfaceid": "9be521ab-d517-4746-b6b3-1e4930610165", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75226) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 17 01:17:35 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-f18e0a3b-5f90-438a-9720-c142fe497569 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] [instance: b054a557-dff6-49f8-9300-1307f8433567] Start _get_guest_xml network_info=[{"id": "9be521ab-d517-4746-b6b3-1e4930610165", "address": "fa:16:3e:c9:37:0f", "network": {"id": "126149e3-f0c6-483c-a0b4-4fd1dcd1a390", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1008205473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8f5190e0bff4cbb9384c0fb4faf54d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9be521ab-d5", "ovs_interfaceid": "9be521ab-d517-4746-b6b3-1e4930610165", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T01:13:22Z,direct_url=<?>,disk_format='qcow2',id=0b369aea-6f3f-4690-9f01-229b90ab6310,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4e110cbf9a84362a6864a7732c435a1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T01:13:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '0b369aea-6f3f-4690-9f01-229b90ab6310'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75226) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 17 01:17:35 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-f18e0a3b-5f90-438a-9720-c142fe497569 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:17:35 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-f18e0a3b-5f90-438a-9720-c142fe497569 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:17:35 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-f18e0a3b-5f90-438a-9720-c142fe497569 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75226) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 17 01:17:35 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-f18e0a3b-5f90-438a-9720-c142fe497569 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] CPU controller missing on host. {{(pid=75226) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 17 01:17:35 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-f18e0a3b-5f90-438a-9720-c142fe497569 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75226) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 17 01:17:35 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-f18e0a3b-5f90-438a-9720-c142fe497569 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] CPU controller found on host. {{(pid=75226) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 17 01:17:35 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-f18e0a3b-5f90-438a-9720-c142fe497569 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75226) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 17 01:17:35 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-f18e0a3b-5f90-438a-9720-c142fe497569 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-17T01:13:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T01:13:22Z,direct_url=<?>,disk_format='qcow2',id=0b369aea-6f3f-4690-9f01-229b90ab6310,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4e110cbf9a84362a6864a7732c435a1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T01:13:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 17 01:17:35 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-f18e0a3b-5f90-438a-9720-c142fe497569 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] Flavor limits 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 17 01:17:35 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-f18e0a3b-5f90-438a-9720-c142fe497569 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] Image limits 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 17 01:17:35 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-f18e0a3b-5f90-438a-9720-c142fe497569 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] Flavor pref 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 17 01:17:35 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-f18e0a3b-5f90-438a-9720-c142fe497569 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] Image pref 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 17 01:17:35 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-f18e0a3b-5f90-438a-9720-c142fe497569 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 17 01:17:35 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-f18e0a3b-5f90-438a-9720-c142fe497569 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 17 01:17:35 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-f18e0a3b-5f90-438a-9720-c142fe497569 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75226) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 17 01:17:35 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-f18e0a3b-5f90-438a-9720-c142fe497569 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] Got 1 possible topologies {{(pid=75226) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 17 01:17:35 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-f18e0a3b-5f90-438a-9720-c142fe497569 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 17 01:17:35 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-f18e0a3b-5f90-438a-9720-c142fe497569 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 17 01:17:35 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-f18e0a3b-5f90-438a-9720-c142fe497569 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-17T01:17:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-670055725',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-670055725',id=6,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLQTkAEsiD7vZkLRChcVhMfcWUFr+J4uCStAPtsh5EcOj4Y0TqNu0/N7e0AK98CTHsomeIYjTkrU/pTyfUW55cXvLwMkYssMQNhMJgsr816svkjbGW+OPHRqanQu9/VlCw==',key_name='tempest-keypair-2003198946',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f8f5190e0bff4cbb9384c0fb4faf54d4',ramdisk_id='',reservation_id='r-icespjka',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-177886932',owner_user_name='tempest-TaggedAttachmentsTest-177886932-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T01:17:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b59a9221aae44dcbb688294a0483b715',uuid=b054a557-dff6-49f8-9300-1307f8433567,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9be521ab-d517-4746-b6b3-1e4930610165", "address": "fa:16:3e:c9:37:0f", "network": {"id": "126149e3-f0c6-483c-a0b4-4fd1dcd1a390", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1008205473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8f5190e0bff4cbb9384c0fb4faf54d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9be521ab-d5", "ovs_interfaceid": "9be521ab-d517-4746-b6b3-1e4930610165", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75226) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 01:17:35 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-f18e0a3b-5f90-438a-9720-c142fe497569 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] Converting VIF {"id": "9be521ab-d517-4746-b6b3-1e4930610165", "address": "fa:16:3e:c9:37:0f", "network": {"id": "126149e3-f0c6-483c-a0b4-4fd1dcd1a390", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1008205473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8f5190e0bff4cbb9384c0fb4faf54d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9be521ab-d5", "ovs_interfaceid": "9be521ab-d517-4746-b6b3-1e4930610165", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:17:35 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-f18e0a3b-5f90-438a-9720-c142fe497569 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:37:0f,bridge_name='br-int',has_traffic_filtering=True,id=9be521ab-d517-4746-b6b3-1e4930610165,network=Network(126149e3-f0c6-483c-a0b4-4fd1dcd1a390),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9be521ab-d5') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:17:35 user nova-compute[75226]: DEBUG nova.objects.instance [None req-f18e0a3b-5f90-438a-9720-c142fe497569 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] Lazy-loading 'pci_devices' on Instance uuid b054a557-dff6-49f8-9300-1307f8433567 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:17:35 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-bf96017e-d4d1-42b2-b4a2-1c2e4f1f75f3 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f98cc1a7de4561ff4f2045cea2489811672b1b01 --force-share --output=json" returned: 0 in 0.316s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:17:35 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-f18e0a3b-5f90-438a-9720-c142fe497569 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] [instance: b054a557-dff6-49f8-9300-1307f8433567] End _get_guest_xml xml=<domain type="kvm">
Nov 17 01:17:35 user nova-compute[75226]:   <uuid>b054a557-dff6-49f8-9300-1307f8433567</uuid>
Nov 17 01:17:35 user nova-compute[75226]:   <name>instance-00000006</name>
Nov 17 01:17:35 user nova-compute[75226]:   <memory>524288</memory>
Nov 17 01:17:35 user nova-compute[75226]:   <vcpu>1</vcpu>
Nov 17 01:17:35 user nova-compute[75226]:   <metadata>
Nov 17 01:17:35 user nova-compute[75226]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 17 01:17:35 user nova-compute[75226]:       <nova:package version="0.0.0"/>
Nov 17 01:17:35 user nova-compute[75226]:       <nova:name>tempest-device-tagging-server-670055725</nova:name>
Nov 17 01:17:35 user nova-compute[75226]:       <nova:creationTime>2023-11-17 01:17:35</nova:creationTime>
Nov 17 01:17:35 user nova-compute[75226]:       <nova:flavor name="m1.tiny">
Nov 17 01:17:35 user nova-compute[75226]:         <nova:memory>512</nova:memory>
Nov 17 01:17:35 user nova-compute[75226]:         <nova:disk>1</nova:disk>
Nov 17 01:17:35 user nova-compute[75226]:         <nova:swap>0</nova:swap>
Nov 17 01:17:35 user nova-compute[75226]:         <nova:ephemeral>0</nova:ephemeral>
Nov 17 01:17:35 user nova-compute[75226]:         <nova:vcpus>1</nova:vcpus>
Nov 17 01:17:35 user nova-compute[75226]:       </nova:flavor>
Nov 17 01:17:35 user nova-compute[75226]:       <nova:owner>
Nov 17 01:17:35 user nova-compute[75226]:         <nova:user uuid="b59a9221aae44dcbb688294a0483b715">tempest-TaggedAttachmentsTest-177886932-project-member</nova:user>
Nov 17 01:17:35 user nova-compute[75226]:         <nova:project uuid="f8f5190e0bff4cbb9384c0fb4faf54d4">tempest-TaggedAttachmentsTest-177886932</nova:project>
Nov 17 01:17:35 user nova-compute[75226]:       </nova:owner>
Nov 17 01:17:35 user nova-compute[75226]:       <nova:root type="image" uuid="0b369aea-6f3f-4690-9f01-229b90ab6310"/>
Nov 17 01:17:35 user nova-compute[75226]:       <nova:ports>
Nov 17 01:17:35 user nova-compute[75226]:         <nova:port uuid="9be521ab-d517-4746-b6b3-1e4930610165">
Nov 17 01:17:35 user nova-compute[75226]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 17 01:17:35 user nova-compute[75226]:         </nova:port>
Nov 17 01:17:35 user nova-compute[75226]:       </nova:ports>
Nov 17 01:17:35 user nova-compute[75226]:     </nova:instance>
Nov 17 01:17:35 user nova-compute[75226]:   </metadata>
Nov 17 01:17:35 user nova-compute[75226]:   <sysinfo type="smbios">
Nov 17 01:17:35 user nova-compute[75226]:     <system>
Nov 17 01:17:35 user nova-compute[75226]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 17 01:17:35 user nova-compute[75226]:       <entry name="product">OpenStack Nova</entry>
Nov 17 01:17:35 user nova-compute[75226]:       <entry name="version">0.0.0</entry>
Nov 17 01:17:35 user nova-compute[75226]:       <entry name="serial">b054a557-dff6-49f8-9300-1307f8433567</entry>
Nov 17 01:17:35 user nova-compute[75226]:       <entry name="uuid">b054a557-dff6-49f8-9300-1307f8433567</entry>
Nov 17 01:17:35 user nova-compute[75226]:       <entry name="family">Virtual Machine</entry>
Nov 17 01:17:35 user nova-compute[75226]:     </system>
Nov 17 01:17:35 user nova-compute[75226]:   </sysinfo>
Nov 17 01:17:35 user nova-compute[75226]:   <os>
Nov 17 01:17:35 user nova-compute[75226]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 17 01:17:35 user nova-compute[75226]:     <boot dev="hd"/>
Nov 17 01:17:35 user nova-compute[75226]:     <smbios mode="sysinfo"/>
Nov 17 01:17:35 user nova-compute[75226]:   </os>
Nov 17 01:17:35 user nova-compute[75226]:   <features>
Nov 17 01:17:35 user nova-compute[75226]:     <acpi/>
Nov 17 01:17:35 user nova-compute[75226]:     <apic/>
Nov 17 01:17:35 user nova-compute[75226]:     <vmcoreinfo/>
Nov 17 01:17:35 user nova-compute[75226]:   </features>
Nov 17 01:17:35 user nova-compute[75226]:   <clock offset="utc">
Nov 17 01:17:35 user nova-compute[75226]:     <timer name="pit" tickpolicy="delay"/>
Nov 17 01:17:35 user nova-compute[75226]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 17 01:17:35 user nova-compute[75226]:     <timer name="hpet" present="no"/>
Nov 17 01:17:35 user nova-compute[75226]:   </clock>
Nov 17 01:17:35 user nova-compute[75226]:   <cpu mode="custom" match="exact">
Nov 17 01:17:35 user nova-compute[75226]:     <model>Nehalem</model>
Nov 17 01:17:35 user nova-compute[75226]:     <topology sockets="1" cores="1" threads="1"/>
Nov 17 01:17:35 user nova-compute[75226]:   </cpu>
Nov 17 01:17:35 user nova-compute[75226]:   <devices>
Nov 17 01:17:35 user nova-compute[75226]:     <disk type="file" device="disk">
Nov 17 01:17:35 user nova-compute[75226]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 17 01:17:35 user nova-compute[75226]:       <source file="/opt/stack/data/nova/instances/b054a557-dff6-49f8-9300-1307f8433567/disk"/>
Nov 17 01:17:35 user nova-compute[75226]:       <target dev="vda" bus="virtio"/>
Nov 17 01:17:35 user nova-compute[75226]:     </disk>
Nov 17 01:17:35 user nova-compute[75226]:     <disk type="file" device="cdrom">
Nov 17 01:17:35 user nova-compute[75226]:       <driver name="qemu" type="raw" cache="none"/>
Nov 17 01:17:35 user nova-compute[75226]:       <source file="/opt/stack/data/nova/instances/b054a557-dff6-49f8-9300-1307f8433567/disk.config"/>
Nov 17 01:17:35 user nova-compute[75226]:       <target dev="hda" bus="ide"/>
Nov 17 01:17:35 user nova-compute[75226]:     </disk>
Nov 17 01:17:35 user nova-compute[75226]:     <interface type="ethernet">
Nov 17 01:17:35 user nova-compute[75226]:       <mac address="fa:16:3e:c9:37:0f"/>
Nov 17 01:17:35 user nova-compute[75226]:       <model type="virtio"/>
Nov 17 01:17:35 user nova-compute[75226]:       <mtu size="1442"/>
Nov 17 01:17:35 user nova-compute[75226]:       <target dev="tap9be521ab-d5"/>
Nov 17 01:17:35 user nova-compute[75226]:     </interface>
Nov 17 01:17:35 user nova-compute[75226]:     <serial type="pty">
Nov 17 01:17:35 user nova-compute[75226]:       <log file="/opt/stack/data/nova/instances/b054a557-dff6-49f8-9300-1307f8433567/console.log" append="off"/>
Nov 17 01:17:35 user nova-compute[75226]:     </serial>
Nov 17 01:17:35 user nova-compute[75226]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 17 01:17:35 user nova-compute[75226]:     <video>
Nov 17 01:17:35 user nova-compute[75226]:       <model type="virtio"/>
Nov 17 01:17:35 user nova-compute[75226]:     </video>
Nov 17 01:17:35 user nova-compute[75226]:     <rng model="virtio">
Nov 17 01:17:35 user nova-compute[75226]:       <backend model="random">/dev/urandom</backend>
Nov 17 01:17:35 user nova-compute[75226]:     </rng>
Nov 17 01:17:35 user nova-compute[75226]:     <controller type="usb" index="0" model="none"/>
Nov 17 01:17:35 user nova-compute[75226]:     <memballoon model="virtio">
Nov 17 01:17:35 user nova-compute[75226]:       <stats period="10"/>
Nov 17 01:17:35 user nova-compute[75226]:     </memballoon>
Nov 17 01:17:35 user nova-compute[75226]:   </devices>
Nov 17 01:17:35 user nova-compute[75226]: </domain>
Nov 17 01:17:35 user nova-compute[75226]:  {{(pid=75226) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 17 01:17:35 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-f18e0a3b-5f90-438a-9720-c142fe497569 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-17T01:17:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-670055725',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-670055725',id=6,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLQTkAEsiD7vZkLRChcVhMfcWUFr+J4uCStAPtsh5EcOj4Y0TqNu0/N7e0AK98CTHsomeIYjTkrU/pTyfUW55cXvLwMkYssMQNhMJgsr816svkjbGW+OPHRqanQu9/VlCw==',key_name='tempest-keypair-2003198946',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f8f5190e0bff4cbb9384c0fb4faf54d4',ramdisk_id='',reservation_id='r-icespjka',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-177886932',owner_user_name='tempest-TaggedAttachmentsTest-177886932-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T01:17:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b59a9221aae44dcbb688294a0483b715',uuid=b054a557-dff6-49f8-9300-1307f8433567,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9be521ab-d517-4746-b6b3-1e4930610165", "address": "fa:16:3e:c9:37:0f", "network": {"id": "126149e3-f0c6-483c-a0b4-4fd1dcd1a390", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1008205473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8f5190e0bff4cbb9384c0fb4faf54d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9be521ab-d5", "ovs_interfaceid": "9be521ab-d517-4746-b6b3-1e4930610165", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 17 01:17:35 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-f18e0a3b-5f90-438a-9720-c142fe497569 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] Converting VIF {"id": "9be521ab-d517-4746-b6b3-1e4930610165", "address": "fa:16:3e:c9:37:0f", "network": {"id": "126149e3-f0c6-483c-a0b4-4fd1dcd1a390", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1008205473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8f5190e0bff4cbb9384c0fb4faf54d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9be521ab-d5", "ovs_interfaceid": "9be521ab-d517-4746-b6b3-1e4930610165", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:17:35 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-f18e0a3b-5f90-438a-9720-c142fe497569 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:37:0f,bridge_name='br-int',has_traffic_filtering=True,id=9be521ab-d517-4746-b6b3-1e4930610165,network=Network(126149e3-f0c6-483c-a0b4-4fd1dcd1a390),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9be521ab-d5') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:17:35 user nova-compute[75226]: DEBUG os_vif [None req-f18e0a3b-5f90-438a-9720-c142fe497569 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:37:0f,bridge_name='br-int',has_traffic_filtering=True,id=9be521ab-d517-4746-b6b3-1e4930610165,network=Network(126149e3-f0c6-483c-a0b4-4fd1dcd1a390),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9be521ab-d5') {{(pid=75226) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 17 01:17:35 user nova-compute[75226]: DEBUG nova.network.neutron [None req-84b5e452-4390-4592-b05f-8e18af5f564c tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] [instance: 75b1cabe-ba15-4851-9140-5949afc33005] Updating instance_info_cache with network_info: [{"id": "8e47eaef-6e73-4c79-973d-31f6481368be", "address": "fa:16:3e:43:38:6f", "network": {"id": "343b2264-f73a-436f-9588-6532711956ca", "bridge": "br-int", "label": "tempest-TestVolumeSwap-926357821-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1abb76252c4f437b9cb23db20136262c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e47eaef-6e", "ovs_interfaceid": "8e47eaef-6e73-4c79-973d-31f6481368be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:17:35 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:17:35 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:17:35 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 17 01:17:35 user nova-compute[75226]: DEBUG nova.virt.disk.api [None req-bf96017e-d4d1-42b2-b4a2-1c2e4f1f75f3 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e7830f7a-80f1-4c2f-bd64-363e6dd9114a/disk. size=1073741824 {{(pid=75226) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 17 01:17:35 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-bf96017e-d4d1-42b2-b4a2-1c2e4f1f75f3 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7830f7a-80f1-4c2f-bd64-363e6dd9114a/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:17:35 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:17:35 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3fd5a477-3071-5387-98c1-78e32815bdf7', '_type': 'linux-noop'}}, row=False) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:17:35 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:17:35 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-84b5e452-4390-4592-b05f-8e18af5f564c tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] Releasing lock "refresh_cache-75b1cabe-ba15-4851-9140-5949afc33005" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:17:35 user nova-compute[75226]: DEBUG nova.compute.manager [None req-84b5e452-4390-4592-b05f-8e18af5f564c tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] [instance: 75b1cabe-ba15-4851-9140-5949afc33005] Instance network_info: |[{"id": "8e47eaef-6e73-4c79-973d-31f6481368be", "address": "fa:16:3e:43:38:6f", "network": {"id": "343b2264-f73a-436f-9588-6532711956ca", "bridge": "br-int", "label": "tempest-TestVolumeSwap-926357821-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1abb76252c4f437b9cb23db20136262c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e47eaef-6e", "ovs_interfaceid": "8e47eaef-6e73-4c79-973d-31f6481368be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75226) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 17 01:17:35 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-84b5e452-4390-4592-b05f-8e18af5f564c tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] [instance: 75b1cabe-ba15-4851-9140-5949afc33005] Start _get_guest_xml network_info=[{"id": "8e47eaef-6e73-4c79-973d-31f6481368be", "address": "fa:16:3e:43:38:6f", "network": {"id": "343b2264-f73a-436f-9588-6532711956ca", "bridge": "br-int", "label": "tempest-TestVolumeSwap-926357821-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1abb76252c4f437b9cb23db20136262c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e47eaef-6e", "ovs_interfaceid": "8e47eaef-6e73-4c79-973d-31f6481368be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T01:13:22Z,direct_url=<?>,disk_format='qcow2',id=0b369aea-6f3f-4690-9f01-229b90ab6310,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4e110cbf9a84362a6864a7732c435a1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T01:13:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '0b369aea-6f3f-4690-9f01-229b90ab6310'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75226) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 17 01:17:35 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:17:35 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:17:35 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9be521ab-d5, may_exist=True, interface_attrs={}) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:17:35 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9be521ab-d5, col_values=(('qos', UUID('d1afbd9c-b126-452e-a959-aa1ddfb26ce7')),), if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:17:35 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9be521ab-d5, col_values=(('external_ids', {'iface-id': '9be521ab-d517-4746-b6b3-1e4930610165', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c9:37:0f', 'vm-uuid': 'b054a557-dff6-49f8-9300-1307f8433567'}),), if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:17:35 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:17:35 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:17:35 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:17:35 user nova-compute[75226]: INFO os_vif [None req-f18e0a3b-5f90-438a-9720-c142fe497569 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:37:0f,bridge_name='br-int',has_traffic_filtering=True,id=9be521ab-d517-4746-b6b3-1e4930610165,network=Network(126149e3-f0c6-483c-a0b4-4fd1dcd1a390),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9be521ab-d5')
Nov 17 01:17:35 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-84b5e452-4390-4592-b05f-8e18af5f564c tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:17:35 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-84b5e452-4390-4592-b05f-8e18af5f564c tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:17:35 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-84b5e452-4390-4592-b05f-8e18af5f564c tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75226) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 17 01:17:35 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-84b5e452-4390-4592-b05f-8e18af5f564c tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] CPU controller missing on host. {{(pid=75226) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 17 01:17:35 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-84b5e452-4390-4592-b05f-8e18af5f564c tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75226) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 17 01:17:35 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-84b5e452-4390-4592-b05f-8e18af5f564c tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] CPU controller found on host. {{(pid=75226) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 17 01:17:35 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-84b5e452-4390-4592-b05f-8e18af5f564c tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75226) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 17 01:17:35 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-84b5e452-4390-4592-b05f-8e18af5f564c tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-17T01:13:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T01:13:22Z,direct_url=<?>,disk_format='qcow2',id=0b369aea-6f3f-4690-9f01-229b90ab6310,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4e110cbf9a84362a6864a7732c435a1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T01:13:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 17 01:17:35 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-84b5e452-4390-4592-b05f-8e18af5f564c tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] Flavor limits 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 17 01:17:35 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-84b5e452-4390-4592-b05f-8e18af5f564c tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] Image limits 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 17 01:17:35 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-84b5e452-4390-4592-b05f-8e18af5f564c tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] Flavor pref 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 17 01:17:35 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-84b5e452-4390-4592-b05f-8e18af5f564c tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] Image pref 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 17 01:17:35 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-84b5e452-4390-4592-b05f-8e18af5f564c tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 17 01:17:35 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-84b5e452-4390-4592-b05f-8e18af5f564c tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 17 01:17:35 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-84b5e452-4390-4592-b05f-8e18af5f564c tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75226) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 17 01:17:35 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-84b5e452-4390-4592-b05f-8e18af5f564c tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] Got 1 possible topologies {{(pid=75226) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 17 01:17:35 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-84b5e452-4390-4592-b05f-8e18af5f564c tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 17 01:17:35 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-84b5e452-4390-4592-b05f-8e18af5f564c tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 17 01:17:35 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-84b5e452-4390-4592-b05f-8e18af5f564c tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:17:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1789442028',display_name='tempest-TestVolumeSwap-server-1789442028',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1789442028',id=5,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBGdgEhsAQqzlHMqVa3uvgZ2wMKsXi+U6v0PTYrZZdvqXgf5RhML9/5l4IK+m2ego8dF6p13DlEHVrQfBH3tafvGrfNFAWDKMQK3LJGRiq7HZc27y3eq0IkTBO9dsZj2Sg==',key_name='tempest-keypair-2092853100',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1abb76252c4f437b9cb23db20136262c',ramdisk_id='',reservation_id='r-v7toeb7g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-281843478',owner_user_name='tempest-TestVolumeSwap-281843478-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T01:17:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cd3334c6476249beab82ac7c6df39afe',uuid=75b1cabe-ba15-4851-9140-5949afc33005,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8e47eaef-6e73-4c79-973d-31f6481368be", "address": "fa:16:3e:43:38:6f", "network": {"id": "343b2264-f73a-436f-9588-6532711956ca", "bridge": "br-int", "label": "tempest-TestVolumeSwap-926357821-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1abb76252c4f437b9cb23db20136262c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e47eaef-6e", "ovs_interfaceid": "8e47eaef-6e73-4c79-973d-31f6481368be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75226) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 01:17:35 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-84b5e452-4390-4592-b05f-8e18af5f564c tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] Converting VIF {"id": "8e47eaef-6e73-4c79-973d-31f6481368be", "address": "fa:16:3e:43:38:6f", "network": {"id": "343b2264-f73a-436f-9588-6532711956ca", "bridge": "br-int", "label": "tempest-TestVolumeSwap-926357821-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1abb76252c4f437b9cb23db20136262c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e47eaef-6e", "ovs_interfaceid": "8e47eaef-6e73-4c79-973d-31f6481368be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:17:35 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-84b5e452-4390-4592-b05f-8e18af5f564c tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:38:6f,bridge_name='br-int',has_traffic_filtering=True,id=8e47eaef-6e73-4c79-973d-31f6481368be,network=Network(343b2264-f73a-436f-9588-6532711956ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e47eaef-6e') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:17:35 user nova-compute[75226]: DEBUG nova.objects.instance [None req-84b5e452-4390-4592-b05f-8e18af5f564c tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] Lazy-loading 'pci_devices' on Instance uuid 75b1cabe-ba15-4851-9140-5949afc33005 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:17:35 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-84b5e452-4390-4592-b05f-8e18af5f564c tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] [instance: 75b1cabe-ba15-4851-9140-5949afc33005] End _get_guest_xml xml=<domain type="kvm">
Nov 17 01:17:35 user nova-compute[75226]:   <uuid>75b1cabe-ba15-4851-9140-5949afc33005</uuid>
Nov 17 01:17:35 user nova-compute[75226]:   <name>instance-00000005</name>
Nov 17 01:17:35 user nova-compute[75226]:   <memory>524288</memory>
Nov 17 01:17:35 user nova-compute[75226]:   <vcpu>1</vcpu>
Nov 17 01:17:35 user nova-compute[75226]:   <metadata>
Nov 17 01:17:35 user nova-compute[75226]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 17 01:17:35 user nova-compute[75226]:       <nova:package version="0.0.0"/>
Nov 17 01:17:35 user nova-compute[75226]:       <nova:name>tempest-TestVolumeSwap-server-1789442028</nova:name>
Nov 17 01:17:35 user nova-compute[75226]:       <nova:creationTime>2023-11-17 01:17:35</nova:creationTime>
Nov 17 01:17:35 user nova-compute[75226]:       <nova:flavor name="m1.tiny">
Nov 17 01:17:35 user nova-compute[75226]:         <nova:memory>512</nova:memory>
Nov 17 01:17:35 user nova-compute[75226]:         <nova:disk>1</nova:disk>
Nov 17 01:17:35 user nova-compute[75226]:         <nova:swap>0</nova:swap>
Nov 17 01:17:35 user nova-compute[75226]:         <nova:ephemeral>0</nova:ephemeral>
Nov 17 01:17:35 user nova-compute[75226]:         <nova:vcpus>1</nova:vcpus>
Nov 17 01:17:35 user nova-compute[75226]:       </nova:flavor>
Nov 17 01:17:35 user nova-compute[75226]:       <nova:owner>
Nov 17 01:17:35 user nova-compute[75226]:         <nova:user uuid="cd3334c6476249beab82ac7c6df39afe">tempest-TestVolumeSwap-281843478-project-member</nova:user>
Nov 17 01:17:35 user nova-compute[75226]:         <nova:project uuid="1abb76252c4f437b9cb23db20136262c">tempest-TestVolumeSwap-281843478</nova:project>
Nov 17 01:17:35 user nova-compute[75226]:       </nova:owner>
Nov 17 01:17:35 user nova-compute[75226]:       <nova:root type="image" uuid="0b369aea-6f3f-4690-9f01-229b90ab6310"/>
Nov 17 01:17:35 user nova-compute[75226]:       <nova:ports>
Nov 17 01:17:35 user nova-compute[75226]:         <nova:port uuid="8e47eaef-6e73-4c79-973d-31f6481368be">
Nov 17 01:17:35 user nova-compute[75226]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 17 01:17:35 user nova-compute[75226]:         </nova:port>
Nov 17 01:17:35 user nova-compute[75226]:       </nova:ports>
Nov 17 01:17:35 user nova-compute[75226]:     </nova:instance>
Nov 17 01:17:35 user nova-compute[75226]:   </metadata>
Nov 17 01:17:35 user nova-compute[75226]:   <sysinfo type="smbios">
Nov 17 01:17:35 user nova-compute[75226]:     <system>
Nov 17 01:17:35 user nova-compute[75226]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 17 01:17:35 user nova-compute[75226]:       <entry name="product">OpenStack Nova</entry>
Nov 17 01:17:35 user nova-compute[75226]:       <entry name="version">0.0.0</entry>
Nov 17 01:17:35 user nova-compute[75226]:       <entry name="serial">75b1cabe-ba15-4851-9140-5949afc33005</entry>
Nov 17 01:17:35 user nova-compute[75226]:       <entry name="uuid">75b1cabe-ba15-4851-9140-5949afc33005</entry>
Nov 17 01:17:35 user nova-compute[75226]:       <entry name="family">Virtual Machine</entry>
Nov 17 01:17:35 user nova-compute[75226]:     </system>
Nov 17 01:17:35 user nova-compute[75226]:   </sysinfo>
Nov 17 01:17:35 user nova-compute[75226]:   <os>
Nov 17 01:17:35 user nova-compute[75226]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 17 01:17:35 user nova-compute[75226]:     <boot dev="hd"/>
Nov 17 01:17:35 user nova-compute[75226]:     <smbios mode="sysinfo"/>
Nov 17 01:17:35 user nova-compute[75226]:   </os>
Nov 17 01:17:35 user nova-compute[75226]:   <features>
Nov 17 01:17:35 user nova-compute[75226]:     <acpi/>
Nov 17 01:17:35 user nova-compute[75226]:     <apic/>
Nov 17 01:17:35 user nova-compute[75226]:     <vmcoreinfo/>
Nov 17 01:17:35 user nova-compute[75226]:   </features>
Nov 17 01:17:35 user nova-compute[75226]:   <clock offset="utc">
Nov 17 01:17:35 user nova-compute[75226]:     <timer name="pit" tickpolicy="delay"/>
Nov 17 01:17:35 user nova-compute[75226]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 17 01:17:35 user nova-compute[75226]:     <timer name="hpet" present="no"/>
Nov 17 01:17:35 user nova-compute[75226]:   </clock>
Nov 17 01:17:35 user nova-compute[75226]:   <cpu mode="custom" match="exact">
Nov 17 01:17:35 user nova-compute[75226]:     <model>Nehalem</model>
Nov 17 01:17:35 user nova-compute[75226]:     <topology sockets="1" cores="1" threads="1"/>
Nov 17 01:17:35 user nova-compute[75226]:   </cpu>
Nov 17 01:17:35 user nova-compute[75226]:   <devices>
Nov 17 01:17:35 user nova-compute[75226]:     <disk type="file" device="disk">
Nov 17 01:17:35 user nova-compute[75226]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 17 01:17:35 user nova-compute[75226]:       <source file="/opt/stack/data/nova/instances/75b1cabe-ba15-4851-9140-5949afc33005/disk"/>
Nov 17 01:17:35 user nova-compute[75226]:       <target dev="vda" bus="virtio"/>
Nov 17 01:17:35 user nova-compute[75226]:     </disk>
Nov 17 01:17:35 user nova-compute[75226]:     <interface type="ethernet">
Nov 17 01:17:35 user nova-compute[75226]:       <mac address="fa:16:3e:43:38:6f"/>
Nov 17 01:17:35 user nova-compute[75226]:       <model type="virtio"/>
Nov 17 01:17:35 user nova-compute[75226]:       <mtu size="1442"/>
Nov 17 01:17:35 user nova-compute[75226]:       <target dev="tap8e47eaef-6e"/>
Nov 17 01:17:35 user nova-compute[75226]:     </interface>
Nov 17 01:17:35 user nova-compute[75226]:     <serial type="pty">
Nov 17 01:17:35 user nova-compute[75226]:       <log file="/opt/stack/data/nova/instances/75b1cabe-ba15-4851-9140-5949afc33005/console.log" append="off"/>
Nov 17 01:17:35 user nova-compute[75226]:     </serial>
Nov 17 01:17:35 user nova-compute[75226]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 17 01:17:35 user nova-compute[75226]:     <video>
Nov 17 01:17:35 user nova-compute[75226]:       <model type="virtio"/>
Nov 17 01:17:35 user nova-compute[75226]:     </video>
Nov 17 01:17:35 user nova-compute[75226]:     <rng model="virtio">
Nov 17 01:17:35 user nova-compute[75226]:       <backend model="random">/dev/urandom</backend>
Nov 17 01:17:35 user nova-compute[75226]:     </rng>
Nov 17 01:17:35 user nova-compute[75226]:     <controller type="usb" index="0" model="none"/>
Nov 17 01:17:35 user nova-compute[75226]:     <memballoon model="virtio">
Nov 17 01:17:35 user nova-compute[75226]:       <stats period="10"/>
Nov 17 01:17:35 user nova-compute[75226]:     </memballoon>
Nov 17 01:17:35 user nova-compute[75226]:   </devices>
Nov 17 01:17:35 user nova-compute[75226]: </domain>
Nov 17 01:17:35 user nova-compute[75226]:  {{(pid=75226) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 17 01:17:35 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-84b5e452-4390-4592-b05f-8e18af5f564c tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:17:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1789442028',display_name='tempest-TestVolumeSwap-server-1789442028',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1789442028',id=5,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBGdgEhsAQqzlHMqVa3uvgZ2wMKsXi+U6v0PTYrZZdvqXgf5RhML9/5l4IK+m2ego8dF6p13DlEHVrQfBH3tafvGrfNFAWDKMQK3LJGRiq7HZc27y3eq0IkTBO9dsZj2Sg==',key_name='tempest-keypair-2092853100',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1abb76252c4f437b9cb23db20136262c',ramdisk_id='',reservation_id='r-v7toeb7g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-281843478',owner_user_name='tempest-TestVolumeSwap-281843478-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T01:17:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cd3334c6476249beab82ac7c6df39afe',uuid=75b1cabe-ba15-4851-9140-5949afc33005,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8e47eaef-6e73-4c79-973d-31f6481368be", "address": "fa:16:3e:43:38:6f", "network": {"id": "343b2264-f73a-436f-9588-6532711956ca", "bridge": "br-int", "label": "tempest-TestVolumeSwap-926357821-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1abb76252c4f437b9cb23db20136262c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e47eaef-6e", "ovs_interfaceid": "8e47eaef-6e73-4c79-973d-31f6481368be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 17 01:17:35 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-84b5e452-4390-4592-b05f-8e18af5f564c tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] Converting VIF {"id": "8e47eaef-6e73-4c79-973d-31f6481368be", "address": "fa:16:3e:43:38:6f", "network": {"id": "343b2264-f73a-436f-9588-6532711956ca", "bridge": "br-int", "label": "tempest-TestVolumeSwap-926357821-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1abb76252c4f437b9cb23db20136262c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e47eaef-6e", "ovs_interfaceid": "8e47eaef-6e73-4c79-973d-31f6481368be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:17:35 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-84b5e452-4390-4592-b05f-8e18af5f564c tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:38:6f,bridge_name='br-int',has_traffic_filtering=True,id=8e47eaef-6e73-4c79-973d-31f6481368be,network=Network(343b2264-f73a-436f-9588-6532711956ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e47eaef-6e') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:17:35 user nova-compute[75226]: DEBUG os_vif [None req-84b5e452-4390-4592-b05f-8e18af5f564c tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:38:6f,bridge_name='br-int',has_traffic_filtering=True,id=8e47eaef-6e73-4c79-973d-31f6481368be,network=Network(343b2264-f73a-436f-9588-6532711956ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e47eaef-6e') {{(pid=75226) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 17 01:17:35 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:17:35 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:17:35 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 17 01:17:35 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:17:35 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd974ac09-041e-5a3b-a48b-a2dcf87b05e1', '_type': 'linux-noop'}}, row=False) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:17:35 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:17:35 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-bf96017e-d4d1-42b2-b4a2-1c2e4f1f75f3 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7830f7a-80f1-4c2f-bd64-363e6dd9114a/disk --force-share --output=json" returned: 0 in 0.446s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:17:35 user nova-compute[75226]: DEBUG nova.virt.disk.api [None req-bf96017e-d4d1-42b2-b4a2-1c2e4f1f75f3 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] Cannot resize image /opt/stack/data/nova/instances/e7830f7a-80f1-4c2f-bd64-363e6dd9114a/disk to a smaller size. {{(pid=75226) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 17 01:17:35 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-bf96017e-d4d1-42b2-b4a2-1c2e4f1f75f3 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] [instance: e7830f7a-80f1-4c2f-bd64-363e6dd9114a] Created local disks {{(pid=75226) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 17 01:17:35 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-bf96017e-d4d1-42b2-b4a2-1c2e4f1f75f3 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] [instance: e7830f7a-80f1-4c2f-bd64-363e6dd9114a] Ensure instance console log exists: /opt/stack/data/nova/instances/e7830f7a-80f1-4c2f-bd64-363e6dd9114a/console.log {{(pid=75226) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 17 01:17:35 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-bf96017e-d4d1-42b2-b4a2-1c2e4f1f75f3 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:17:35 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-bf96017e-d4d1-42b2-b4a2-1c2e4f1f75f3 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:17:35 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-bf96017e-d4d1-42b2-b4a2-1c2e4f1f75f3 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:17:35 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:17:35 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:17:35 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:17:35 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8e47eaef-6e, may_exist=True, interface_attrs={}) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:17:35 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8e47eaef-6e, col_values=(('qos', UUID('02c7df97-c958-4da2-b8f0-0a7555933300')),), if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:17:35 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8e47eaef-6e, col_values=(('external_ids', {'iface-id': '8e47eaef-6e73-4c79-973d-31f6481368be', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:43:38:6f', 'vm-uuid': '75b1cabe-ba15-4851-9140-5949afc33005'}),), if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:17:35 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:17:35 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-f18e0a3b-5f90-438a-9720-c142fe497569 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] No BDM found with device name vda, not building metadata. {{(pid=75226) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 01:17:35 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-f18e0a3b-5f90-438a-9720-c142fe497569 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] No BDM found with device name hda, not building metadata. {{(pid=75226) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 01:17:35 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-f18e0a3b-5f90-438a-9720-c142fe497569 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] No VIF found with MAC fa:16:3e:c9:37:0f, not building metadata {{(pid=75226) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 01:17:35 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-f18e0a3b-5f90-438a-9720-c142fe497569 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] [instance: b054a557-dff6-49f8-9300-1307f8433567] Using config drive
Nov 17 01:17:35 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:17:35 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:17:35 user nova-compute[75226]: INFO os_vif [None req-84b5e452-4390-4592-b05f-8e18af5f564c tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:38:6f,bridge_name='br-int',has_traffic_filtering=True,id=8e47eaef-6e73-4c79-973d-31f6481368be,network=Network(343b2264-f73a-436f-9588-6532711956ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e47eaef-6e')
Nov 17 01:17:35 user nova-compute[75226]: DEBUG nova.compute.manager [req-01c15bf6-2a32-4cf7-b513-7b219cc34862 req-c50494aa-8138-47b2-80c3-0d33443712f2 service nova] [instance: 19250ac2-1b3f-4fe9-80b0-406b181929b6] Received event network-vif-plugged-093abf0b-d4eb-4be3-bda0-4a7d19fe6ac2 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:17:35 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-01c15bf6-2a32-4cf7-b513-7b219cc34862 req-c50494aa-8138-47b2-80c3-0d33443712f2 service nova] Acquiring lock "19250ac2-1b3f-4fe9-80b0-406b181929b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:17:35 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-01c15bf6-2a32-4cf7-b513-7b219cc34862 req-c50494aa-8138-47b2-80c3-0d33443712f2 service nova] Lock "19250ac2-1b3f-4fe9-80b0-406b181929b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:17:35 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-01c15bf6-2a32-4cf7-b513-7b219cc34862 req-c50494aa-8138-47b2-80c3-0d33443712f2 service nova] Lock "19250ac2-1b3f-4fe9-80b0-406b181929b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:17:35 user nova-compute[75226]: DEBUG nova.compute.manager [req-01c15bf6-2a32-4cf7-b513-7b219cc34862 req-c50494aa-8138-47b2-80c3-0d33443712f2 service nova] [instance: 19250ac2-1b3f-4fe9-80b0-406b181929b6] No waiting events found dispatching network-vif-plugged-093abf0b-d4eb-4be3-bda0-4a7d19fe6ac2 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:17:35 user nova-compute[75226]: WARNING nova.compute.manager [req-01c15bf6-2a32-4cf7-b513-7b219cc34862 req-c50494aa-8138-47b2-80c3-0d33443712f2 service nova] [instance: 19250ac2-1b3f-4fe9-80b0-406b181929b6] Received unexpected event network-vif-plugged-093abf0b-d4eb-4be3-bda0-4a7d19fe6ac2 for instance with vm_state active and task_state None.
Nov 17 01:17:35 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-84b5e452-4390-4592-b05f-8e18af5f564c tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] No BDM found with device name vda, not building metadata. {{(pid=75226) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 01:17:35 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-84b5e452-4390-4592-b05f-8e18af5f564c tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] No VIF found with MAC fa:16:3e:43:38:6f, not building metadata {{(pid=75226) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 01:17:36 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:17:36 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:17:36 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:17:36 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:17:36 user nova-compute[75226]: DEBUG nova.network.neutron [None req-bf96017e-d4d1-42b2-b4a2-1c2e4f1f75f3 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] [instance: e7830f7a-80f1-4c2f-bd64-363e6dd9114a] Successfully updated port: b273b468-b80c-435e-bae6-9cbbcf617110 {{(pid=75226) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 17 01:17:36 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-bf96017e-d4d1-42b2-b4a2-1c2e4f1f75f3 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] Acquiring lock "refresh_cache-e7830f7a-80f1-4c2f-bd64-363e6dd9114a" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:17:36 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-bf96017e-d4d1-42b2-b4a2-1c2e4f1f75f3 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] Acquired lock "refresh_cache-e7830f7a-80f1-4c2f-bd64-363e6dd9114a" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:17:36 user nova-compute[75226]: DEBUG nova.network.neutron [None req-bf96017e-d4d1-42b2-b4a2-1c2e4f1f75f3 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] [instance: e7830f7a-80f1-4c2f-bd64-363e6dd9114a] Building network info cache for instance {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 01:17:37 user nova-compute[75226]: DEBUG nova.compute.manager [req-cd6e53df-01a7-4e56-84ae-b1eeda1e598e req-4da4d8f4-e4c3-4663-9e50-ce7d83b6dd49 service nova] [instance: e7830f7a-80f1-4c2f-bd64-363e6dd9114a] Received event network-changed-b273b468-b80c-435e-bae6-9cbbcf617110 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:17:37 user nova-compute[75226]: DEBUG nova.compute.manager [req-cd6e53df-01a7-4e56-84ae-b1eeda1e598e req-4da4d8f4-e4c3-4663-9e50-ce7d83b6dd49 service nova] [instance: e7830f7a-80f1-4c2f-bd64-363e6dd9114a] Refreshing instance network info cache due to event network-changed-b273b468-b80c-435e-bae6-9cbbcf617110. {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 01:17:37 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-cd6e53df-01a7-4e56-84ae-b1eeda1e598e req-4da4d8f4-e4c3-4663-9e50-ce7d83b6dd49 service nova] Acquiring lock "refresh_cache-e7830f7a-80f1-4c2f-bd64-363e6dd9114a" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:17:37 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:17:37 user nova-compute[75226]: DEBUG nova.network.neutron [None req-bf96017e-d4d1-42b2-b4a2-1c2e4f1f75f3 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] [instance: e7830f7a-80f1-4c2f-bd64-363e6dd9114a] Instance cache missing network info. {{(pid=75226) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 17 01:17:37 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-f18e0a3b-5f90-438a-9720-c142fe497569 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] [instance: b054a557-dff6-49f8-9300-1307f8433567] Creating config drive at /opt/stack/data/nova/instances/b054a557-dff6-49f8-9300-1307f8433567/disk.config
Nov 17 01:17:37 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-f18e0a3b-5f90-438a-9720-c142fe497569 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/b054a557-dff6-49f8-9300-1307f8433567/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpxli2p5yj {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:17:37 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-f18e0a3b-5f90-438a-9720-c142fe497569 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/b054a557-dff6-49f8-9300-1307f8433567/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpxli2p5yj" returned: 0 in 0.080s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:17:38 user nova-compute[75226]: DEBUG nova.compute.manager [req-d1dc92a0-2764-473d-9799-7a4159826ac2 req-bface96e-fe79-42ca-b7c9-e77e1fe5de16 service nova] [instance: 19250ac2-1b3f-4fe9-80b0-406b181929b6] Received event network-vif-plugged-093abf0b-d4eb-4be3-bda0-4a7d19fe6ac2 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:17:38 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-d1dc92a0-2764-473d-9799-7a4159826ac2 req-bface96e-fe79-42ca-b7c9-e77e1fe5de16 service nova] Acquiring lock "19250ac2-1b3f-4fe9-80b0-406b181929b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:17:38 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-d1dc92a0-2764-473d-9799-7a4159826ac2 req-bface96e-fe79-42ca-b7c9-e77e1fe5de16 service nova] Lock "19250ac2-1b3f-4fe9-80b0-406b181929b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:17:38 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-d1dc92a0-2764-473d-9799-7a4159826ac2 req-bface96e-fe79-42ca-b7c9-e77e1fe5de16 service nova] Lock "19250ac2-1b3f-4fe9-80b0-406b181929b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:17:38 user nova-compute[75226]: DEBUG nova.compute.manager [req-d1dc92a0-2764-473d-9799-7a4159826ac2 req-bface96e-fe79-42ca-b7c9-e77e1fe5de16 service nova] [instance: 19250ac2-1b3f-4fe9-80b0-406b181929b6] No waiting events found dispatching network-vif-plugged-093abf0b-d4eb-4be3-bda0-4a7d19fe6ac2 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:17:38 user nova-compute[75226]: WARNING nova.compute.manager [req-d1dc92a0-2764-473d-9799-7a4159826ac2 req-bface96e-fe79-42ca-b7c9-e77e1fe5de16 service nova] [instance: 19250ac2-1b3f-4fe9-80b0-406b181929b6] Received unexpected event network-vif-plugged-093abf0b-d4eb-4be3-bda0-4a7d19fe6ac2 for instance with vm_state active and task_state None.
Nov 17 01:17:38 user nova-compute[75226]: DEBUG nova.network.neutron [None req-bf96017e-d4d1-42b2-b4a2-1c2e4f1f75f3 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] [instance: e7830f7a-80f1-4c2f-bd64-363e6dd9114a] Updating instance_info_cache with network_info: [{"id": "b273b468-b80c-435e-bae6-9cbbcf617110", "address": "fa:16:3e:29:76:3a", "network": {"id": "dbec5c0d-6e91-420e-a351-6aeaccb8253c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2034589845-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32bfc0cc503b45f7b2ebb10fd934b630", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb273b468-b8", "ovs_interfaceid": "b273b468-b80c-435e-bae6-9cbbcf617110", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:17:38 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:17:38 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:17:38 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:17:38 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-bf96017e-d4d1-42b2-b4a2-1c2e4f1f75f3 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] Releasing lock "refresh_cache-e7830f7a-80f1-4c2f-bd64-363e6dd9114a" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:17:38 user nova-compute[75226]: DEBUG nova.compute.manager [None req-bf96017e-d4d1-42b2-b4a2-1c2e4f1f75f3 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] [instance: e7830f7a-80f1-4c2f-bd64-363e6dd9114a] Instance network_info: |[{"id": "b273b468-b80c-435e-bae6-9cbbcf617110", "address": "fa:16:3e:29:76:3a", "network": {"id": "dbec5c0d-6e91-420e-a351-6aeaccb8253c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2034589845-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32bfc0cc503b45f7b2ebb10fd934b630", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb273b468-b8", "ovs_interfaceid": "b273b468-b80c-435e-bae6-9cbbcf617110", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75226) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 17 01:17:38 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-cd6e53df-01a7-4e56-84ae-b1eeda1e598e req-4da4d8f4-e4c3-4663-9e50-ce7d83b6dd49 service nova] Acquired lock "refresh_cache-e7830f7a-80f1-4c2f-bd64-363e6dd9114a" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:17:38 user nova-compute[75226]: DEBUG nova.network.neutron [req-cd6e53df-01a7-4e56-84ae-b1eeda1e598e req-4da4d8f4-e4c3-4663-9e50-ce7d83b6dd49 service nova] [instance: e7830f7a-80f1-4c2f-bd64-363e6dd9114a] Refreshing network info cache for port b273b468-b80c-435e-bae6-9cbbcf617110 {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 01:17:38 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-bf96017e-d4d1-42b2-b4a2-1c2e4f1f75f3 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] [instance: e7830f7a-80f1-4c2f-bd64-363e6dd9114a] Start _get_guest_xml network_info=[{"id": "b273b468-b80c-435e-bae6-9cbbcf617110", "address": "fa:16:3e:29:76:3a", "network": {"id": "dbec5c0d-6e91-420e-a351-6aeaccb8253c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2034589845-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32bfc0cc503b45f7b2ebb10fd934b630", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb273b468-b8", "ovs_interfaceid": "b273b468-b80c-435e-bae6-9cbbcf617110", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T01:17:21Z,direct_url=<?>,disk_format='qcow2',id=d512d3f5-0961-48fa-a7c4-4be85445b5e2,min_disk=0,min_ram=0,name='',owner='38459ad70b104964b2bd8842dd27af40',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T01:17:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'encryption_options': None, 'size': 0, 'encryption_format': None, 'disk_bus': 'scsi', 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/sda', 'encrypted': False, 'image_id': 'd512d3f5-0961-48fa-a7c4-4be85445b5e2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75226) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 17 01:17:38 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:17:38 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-bf96017e-d4d1-42b2-b4a2-1c2e4f1f75f3 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:17:38 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-bf96017e-d4d1-42b2-b4a2-1c2e4f1f75f3 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:17:38 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-bf96017e-d4d1-42b2-b4a2-1c2e4f1f75f3 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75226) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 17 01:17:38 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-bf96017e-d4d1-42b2-b4a2-1c2e4f1f75f3 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] CPU controller missing on host. {{(pid=75226) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 17 01:17:38 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-bf96017e-d4d1-42b2-b4a2-1c2e4f1f75f3 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75226) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 17 01:17:38 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-bf96017e-d4d1-42b2-b4a2-1c2e4f1f75f3 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] CPU controller found on host. {{(pid=75226) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 17 01:17:38 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-bf96017e-d4d1-42b2-b4a2-1c2e4f1f75f3 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75226) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 17 01:17:38 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-bf96017e-d4d1-42b2-b4a2-1c2e4f1f75f3 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-17T01:13:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T01:17:21Z,direct_url=<?>,disk_format='qcow2',id=d512d3f5-0961-48fa-a7c4-4be85445b5e2,min_disk=0,min_ram=0,name='',owner='38459ad70b104964b2bd8842dd27af40',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T01:17:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 17 01:17:38 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-bf96017e-d4d1-42b2-b4a2-1c2e4f1f75f3 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] Flavor limits 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 17 01:17:38 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-bf96017e-d4d1-42b2-b4a2-1c2e4f1f75f3 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] Image limits 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 17 01:17:38 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-bf96017e-d4d1-42b2-b4a2-1c2e4f1f75f3 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] Flavor pref 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 17 01:17:38 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-bf96017e-d4d1-42b2-b4a2-1c2e4f1f75f3 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] Image pref 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 17 01:17:38 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-bf96017e-d4d1-42b2-b4a2-1c2e4f1f75f3 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 17 01:17:38 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-bf96017e-d4d1-42b2-b4a2-1c2e4f1f75f3 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 17 01:17:38 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-bf96017e-d4d1-42b2-b4a2-1c2e4f1f75f3 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75226) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 17 01:17:38 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-bf96017e-d4d1-42b2-b4a2-1c2e4f1f75f3 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] Got 1 possible topologies {{(pid=75226) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 17 01:17:38 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-bf96017e-d4d1-42b2-b4a2-1c2e4f1f75f3 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 17 01:17:38 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-bf96017e-d4d1-42b2-b4a2-1c2e4f1f75f3 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 17 01:17:38 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-bf96017e-d4d1-42b2-b4a2-1c2e4f1f75f3 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-17T01:17:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-666317814',display_name='tempest-AttachSCSIVolumeTestJSON-server-666317814',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-666317814',id=7,image_ref='d512d3f5-0961-48fa-a7c4-4be85445b5e2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMak35wEy5X4htll6OcRNRmmRqqhnqK1vJiFU6fJ+f5y6zGodYL7EUlkS9aJRdrgjNBKi28+u7AsckbU5VHkSXj15M0dtBjswbbdbAbodAm60L+PyJJOuybgoepdT7QJmg==',key_name='tempest-keypair-414562692',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='32bfc0cc503b45f7b2ebb10fd934b630',ramdisk_id='',reservation_id='r-goyx788k',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d512d3f5-0961-48fa-a7c4-4be85445b5e2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1545096268',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1545096268-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T01:17:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bab86e39396b4da7888f2f1b9959ffb0',uuid=e7830f7a-80f1-4c2f-bd64-363e6dd9114a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b273b468-b80c-435e-bae6-9cbbcf617110", "address": "fa:16:3e:29:76:3a", "network": {"id": "dbec5c0d-6e91-420e-a351-6aeaccb8253c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2034589845-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32bfc0cc503b45f7b2ebb10fd934b630", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb273b468-b8", "ovs_interfaceid": "b273b468-b80c-435e-bae6-9cbbcf617110", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75226) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 01:17:38 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-bf96017e-d4d1-42b2-b4a2-1c2e4f1f75f3 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] Converting VIF {"id": "b273b468-b80c-435e-bae6-9cbbcf617110", "address": "fa:16:3e:29:76:3a", "network": {"id": "dbec5c0d-6e91-420e-a351-6aeaccb8253c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2034589845-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32bfc0cc503b45f7b2ebb10fd934b630", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb273b468-b8", "ovs_interfaceid": "b273b468-b80c-435e-bae6-9cbbcf617110", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:17:38 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-bf96017e-d4d1-42b2-b4a2-1c2e4f1f75f3 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:76:3a,bridge_name='br-int',has_traffic_filtering=True,id=b273b468-b80c-435e-bae6-9cbbcf617110,network=Network(dbec5c0d-6e91-420e-a351-6aeaccb8253c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb273b468-b8') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:17:38 user nova-compute[75226]: DEBUG nova.objects.instance [None req-bf96017e-d4d1-42b2-b4a2-1c2e4f1f75f3 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] Lazy-loading 'pci_devices' on Instance uuid e7830f7a-80f1-4c2f-bd64-363e6dd9114a {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:17:38 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-bf96017e-d4d1-42b2-b4a2-1c2e4f1f75f3 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] [instance: e7830f7a-80f1-4c2f-bd64-363e6dd9114a] End _get_guest_xml xml=<domain type="kvm">
Nov 17 01:17:38 user nova-compute[75226]:   <uuid>e7830f7a-80f1-4c2f-bd64-363e6dd9114a</uuid>
Nov 17 01:17:38 user nova-compute[75226]:   <name>instance-00000007</name>
Nov 17 01:17:38 user nova-compute[75226]:   <memory>524288</memory>
Nov 17 01:17:38 user nova-compute[75226]:   <vcpu>1</vcpu>
Nov 17 01:17:38 user nova-compute[75226]:   <metadata>
Nov 17 01:17:38 user nova-compute[75226]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 17 01:17:38 user nova-compute[75226]:       <nova:package version="0.0.0"/>
Nov 17 01:17:38 user nova-compute[75226]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-666317814</nova:name>
Nov 17 01:17:38 user nova-compute[75226]:       <nova:creationTime>2023-11-17 01:17:38</nova:creationTime>
Nov 17 01:17:38 user nova-compute[75226]:       <nova:flavor name="m1.tiny">
Nov 17 01:17:38 user nova-compute[75226]:         <nova:memory>512</nova:memory>
Nov 17 01:17:38 user nova-compute[75226]:         <nova:disk>1</nova:disk>
Nov 17 01:17:38 user nova-compute[75226]:         <nova:swap>0</nova:swap>
Nov 17 01:17:38 user nova-compute[75226]:         <nova:ephemeral>0</nova:ephemeral>
Nov 17 01:17:38 user nova-compute[75226]:         <nova:vcpus>1</nova:vcpus>
Nov 17 01:17:38 user nova-compute[75226]:       </nova:flavor>
Nov 17 01:17:38 user nova-compute[75226]:       <nova:owner>
Nov 17 01:17:38 user nova-compute[75226]:         <nova:user uuid="bab86e39396b4da7888f2f1b9959ffb0">tempest-AttachSCSIVolumeTestJSON-1545096268-project-member</nova:user>
Nov 17 01:17:38 user nova-compute[75226]:         <nova:project uuid="32bfc0cc503b45f7b2ebb10fd934b630">tempest-AttachSCSIVolumeTestJSON-1545096268</nova:project>
Nov 17 01:17:38 user nova-compute[75226]:       </nova:owner>
Nov 17 01:17:38 user nova-compute[75226]:       <nova:root type="image" uuid="d512d3f5-0961-48fa-a7c4-4be85445b5e2"/>
Nov 17 01:17:38 user nova-compute[75226]:       <nova:ports>
Nov 17 01:17:38 user nova-compute[75226]:         <nova:port uuid="b273b468-b80c-435e-bae6-9cbbcf617110">
Nov 17 01:17:38 user nova-compute[75226]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 17 01:17:38 user nova-compute[75226]:         </nova:port>
Nov 17 01:17:38 user nova-compute[75226]:       </nova:ports>
Nov 17 01:17:38 user nova-compute[75226]:     </nova:instance>
Nov 17 01:17:38 user nova-compute[75226]:   </metadata>
Nov 17 01:17:38 user nova-compute[75226]:   <sysinfo type="smbios">
Nov 17 01:17:38 user nova-compute[75226]:     <system>
Nov 17 01:17:38 user nova-compute[75226]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 17 01:17:38 user nova-compute[75226]:       <entry name="product">OpenStack Nova</entry>
Nov 17 01:17:38 user nova-compute[75226]:       <entry name="version">0.0.0</entry>
Nov 17 01:17:38 user nova-compute[75226]:       <entry name="serial">e7830f7a-80f1-4c2f-bd64-363e6dd9114a</entry>
Nov 17 01:17:38 user nova-compute[75226]:       <entry name="uuid">e7830f7a-80f1-4c2f-bd64-363e6dd9114a</entry>
Nov 17 01:17:38 user nova-compute[75226]:       <entry name="family">Virtual Machine</entry>
Nov 17 01:17:38 user nova-compute[75226]:     </system>
Nov 17 01:17:38 user nova-compute[75226]:   </sysinfo>
Nov 17 01:17:38 user nova-compute[75226]:   <os>
Nov 17 01:17:38 user nova-compute[75226]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 17 01:17:38 user nova-compute[75226]:     <boot dev="hd"/>
Nov 17 01:17:38 user nova-compute[75226]:     <smbios mode="sysinfo"/>
Nov 17 01:17:38 user nova-compute[75226]:   </os>
Nov 17 01:17:38 user nova-compute[75226]:   <features>
Nov 17 01:17:38 user nova-compute[75226]:     <acpi/>
Nov 17 01:17:38 user nova-compute[75226]:     <apic/>
Nov 17 01:17:38 user nova-compute[75226]:     <vmcoreinfo/>
Nov 17 01:17:38 user nova-compute[75226]:   </features>
Nov 17 01:17:38 user nova-compute[75226]:   <clock offset="utc">
Nov 17 01:17:38 user nova-compute[75226]:     <timer name="pit" tickpolicy="delay"/>
Nov 17 01:17:38 user nova-compute[75226]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 17 01:17:38 user nova-compute[75226]:     <timer name="hpet" present="no"/>
Nov 17 01:17:38 user nova-compute[75226]:   </clock>
Nov 17 01:17:38 user nova-compute[75226]:   <cpu mode="custom" match="exact">
Nov 17 01:17:38 user nova-compute[75226]:     <model>Nehalem</model>
Nov 17 01:17:38 user nova-compute[75226]:     <topology sockets="1" cores="1" threads="1"/>
Nov 17 01:17:38 user nova-compute[75226]:   </cpu>
Nov 17 01:17:38 user nova-compute[75226]:   <devices>
Nov 17 01:17:38 user nova-compute[75226]:     <disk type="file" device="disk">
Nov 17 01:17:38 user nova-compute[75226]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 17 01:17:38 user nova-compute[75226]:       <source file="/opt/stack/data/nova/instances/e7830f7a-80f1-4c2f-bd64-363e6dd9114a/disk"/>
Nov 17 01:17:38 user nova-compute[75226]:       <target dev="sda" bus="scsi"/>
Nov 17 01:17:38 user nova-compute[75226]:       <address type="drive" controller="0" unit="0"/>
Nov 17 01:17:38 user nova-compute[75226]:     </disk>
Nov 17 01:17:38 user nova-compute[75226]:     <disk type="file" device="cdrom">
Nov 17 01:17:38 user nova-compute[75226]:       <driver name="qemu" type="raw" cache="none"/>
Nov 17 01:17:38 user nova-compute[75226]:       <source file="/opt/stack/data/nova/instances/e7830f7a-80f1-4c2f-bd64-363e6dd9114a/disk.config"/>
Nov 17 01:17:38 user nova-compute[75226]:       <target dev="sdb" bus="scsi"/>
Nov 17 01:17:38 user nova-compute[75226]:       <address type="drive" controller="0" unit="1"/>
Nov 17 01:17:38 user nova-compute[75226]:     </disk>
Nov 17 01:17:38 user nova-compute[75226]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Nov 17 01:17:38 user nova-compute[75226]:     <interface type="ethernet">
Nov 17 01:17:38 user nova-compute[75226]:       <mac address="fa:16:3e:29:76:3a"/>
Nov 17 01:17:38 user nova-compute[75226]:       <model type="virtio"/>
Nov 17 01:17:38 user nova-compute[75226]:       <mtu size="1442"/>
Nov 17 01:17:38 user nova-compute[75226]:       <target dev="tapb273b468-b8"/>
Nov 17 01:17:38 user nova-compute[75226]:     </interface>
Nov 17 01:17:38 user nova-compute[75226]:     <serial type="pty">
Nov 17 01:17:38 user nova-compute[75226]:       <log file="/opt/stack/data/nova/instances/e7830f7a-80f1-4c2f-bd64-363e6dd9114a/console.log" append="off"/>
Nov 17 01:17:38 user nova-compute[75226]:     </serial>
Nov 17 01:17:38 user nova-compute[75226]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 17 01:17:38 user nova-compute[75226]:     <video>
Nov 17 01:17:38 user nova-compute[75226]:       <model type="virtio"/>
Nov 17 01:17:38 user nova-compute[75226]:     </video>
Nov 17 01:17:38 user nova-compute[75226]:     <rng model="virtio">
Nov 17 01:17:38 user nova-compute[75226]:       <backend model="random">/dev/urandom</backend>
Nov 17 01:17:38 user nova-compute[75226]:     </rng>
Nov 17 01:17:38 user nova-compute[75226]:     <controller type="usb" index="0" model="none"/>
Nov 17 01:17:38 user nova-compute[75226]:     <memballoon model="virtio">
Nov 17 01:17:38 user nova-compute[75226]:       <stats period="10"/>
Nov 17 01:17:38 user nova-compute[75226]:     </memballoon>
Nov 17 01:17:38 user nova-compute[75226]:   </devices>
Nov 17 01:17:38 user nova-compute[75226]: </domain>
Nov 17 01:17:38 user nova-compute[75226]:  {{(pid=75226) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 17 01:17:38 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-bf96017e-d4d1-42b2-b4a2-1c2e4f1f75f3 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-17T01:17:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-666317814',display_name='tempest-AttachSCSIVolumeTestJSON-server-666317814',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-666317814',id=7,image_ref='d512d3f5-0961-48fa-a7c4-4be85445b5e2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMak35wEy5X4htll6OcRNRmmRqqhnqK1vJiFU6fJ+f5y6zGodYL7EUlkS9aJRdrgjNBKi28+u7AsckbU5VHkSXj15M0dtBjswbbdbAbodAm60L+PyJJOuybgoepdT7QJmg==',key_name='tempest-keypair-414562692',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='32bfc0cc503b45f7b2ebb10fd934b630',ramdisk_id='',reservation_id='r-goyx788k',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d512d3f5-0961-48fa-a7c4-4be85445b5e2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1545096268',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1545096268-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T01:17:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bab86e39396b4da7888f2f1b9959ffb0',uuid=e7830f7a-80f1-4c2f-bd64-363e6dd9114a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b273b468-b80c-435e-bae6-9cbbcf617110", "address": "fa:16:3e:29:76:3a", "network": {"id": "dbec5c0d-6e91-420e-a351-6aeaccb8253c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2034589845-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32bfc0cc503b45f7b2ebb10fd934b630", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb273b468-b8", "ovs_interfaceid": "b273b468-b80c-435e-bae6-9cbbcf617110", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 17 01:17:38 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-bf96017e-d4d1-42b2-b4a2-1c2e4f1f75f3 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] Converting VIF {"id": "b273b468-b80c-435e-bae6-9cbbcf617110", "address": "fa:16:3e:29:76:3a", "network": {"id": "dbec5c0d-6e91-420e-a351-6aeaccb8253c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2034589845-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32bfc0cc503b45f7b2ebb10fd934b630", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb273b468-b8", "ovs_interfaceid": "b273b468-b80c-435e-bae6-9cbbcf617110", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:17:38 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-bf96017e-d4d1-42b2-b4a2-1c2e4f1f75f3 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:76:3a,bridge_name='br-int',has_traffic_filtering=True,id=b273b468-b80c-435e-bae6-9cbbcf617110,network=Network(dbec5c0d-6e91-420e-a351-6aeaccb8253c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb273b468-b8') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:17:38 user nova-compute[75226]: DEBUG os_vif [None req-bf96017e-d4d1-42b2-b4a2-1c2e4f1f75f3 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:76:3a,bridge_name='br-int',has_traffic_filtering=True,id=b273b468-b80c-435e-bae6-9cbbcf617110,network=Network(dbec5c0d-6e91-420e-a351-6aeaccb8253c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb273b468-b8') {{(pid=75226) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 17 01:17:38 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:17:38 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:17:38 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 17 01:17:38 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:17:38 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '01f4021d-6b12-53cb-a953-7c4c31cc8c89', '_type': 'linux-noop'}}, row=False) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:17:38 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:17:38 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:17:38 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:17:38 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:17:38 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb273b468-b8, may_exist=True, interface_attrs={}) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:17:38 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb273b468-b8, col_values=(('qos', UUID('079824ee-cac6-46f8-945b-95f9e7f10c46')),), if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:17:38 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb273b468-b8, col_values=(('external_ids', {'iface-id': 'b273b468-b80c-435e-bae6-9cbbcf617110', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:29:76:3a', 'vm-uuid': 'e7830f7a-80f1-4c2f-bd64-363e6dd9114a'}),), if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:17:38 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:17:38 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:17:38 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:17:38 user nova-compute[75226]: INFO os_vif [None req-bf96017e-d4d1-42b2-b4a2-1c2e4f1f75f3 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:76:3a,bridge_name='br-int',has_traffic_filtering=True,id=b273b468-b80c-435e-bae6-9cbbcf617110,network=Network(dbec5c0d-6e91-420e-a351-6aeaccb8253c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb273b468-b8')
Nov 17 01:17:39 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-bf96017e-d4d1-42b2-b4a2-1c2e4f1f75f3 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] No BDM found with device name sda, not building metadata. {{(pid=75226) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 01:17:39 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-bf96017e-d4d1-42b2-b4a2-1c2e4f1f75f3 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75226) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 01:17:39 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-bf96017e-d4d1-42b2-b4a2-1c2e4f1f75f3 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] No VIF found with MAC fa:16:3e:29:76:3a, not building metadata {{(pid=75226) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 01:17:39 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-bf96017e-d4d1-42b2-b4a2-1c2e4f1f75f3 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] [instance: e7830f7a-80f1-4c2f-bd64-363e6dd9114a] Using config drive
Nov 17 01:17:39 user nova-compute[75226]: DEBUG nova.compute.manager [req-8fb9d0ef-3367-4808-8073-5049e6be07f7 req-27be30de-0c03-4a4b-b807-06e4792e0078 service nova] [instance: aa84e575-bdad-45b9-80ce-86b1c2826fb0] Received event network-vif-plugged-734a9e23-26e5-4282-b842-62e0bb37c782 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:17:39 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-8fb9d0ef-3367-4808-8073-5049e6be07f7 req-27be30de-0c03-4a4b-b807-06e4792e0078 service nova] Acquiring lock "aa84e575-bdad-45b9-80ce-86b1c2826fb0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:17:39 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-8fb9d0ef-3367-4808-8073-5049e6be07f7 req-27be30de-0c03-4a4b-b807-06e4792e0078 service nova] Lock "aa84e575-bdad-45b9-80ce-86b1c2826fb0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:17:39 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-8fb9d0ef-3367-4808-8073-5049e6be07f7 req-27be30de-0c03-4a4b-b807-06e4792e0078 service nova] Lock "aa84e575-bdad-45b9-80ce-86b1c2826fb0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:17:39 user nova-compute[75226]: DEBUG nova.compute.manager [req-8fb9d0ef-3367-4808-8073-5049e6be07f7 req-27be30de-0c03-4a4b-b807-06e4792e0078 service nova] [instance: aa84e575-bdad-45b9-80ce-86b1c2826fb0] No waiting events found dispatching network-vif-plugged-734a9e23-26e5-4282-b842-62e0bb37c782 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:17:39 user nova-compute[75226]: WARNING nova.compute.manager [req-8fb9d0ef-3367-4808-8073-5049e6be07f7 req-27be30de-0c03-4a4b-b807-06e4792e0078 service nova] [instance: aa84e575-bdad-45b9-80ce-86b1c2826fb0] Received unexpected event network-vif-plugged-734a9e23-26e5-4282-b842-62e0bb37c782 for instance with vm_state active and task_state None.
Nov 17 01:17:39 user nova-compute[75226]: DEBUG nova.compute.manager [req-8fb9d0ef-3367-4808-8073-5049e6be07f7 req-27be30de-0c03-4a4b-b807-06e4792e0078 service nova] [instance: aa84e575-bdad-45b9-80ce-86b1c2826fb0] Received event network-vif-plugged-734a9e23-26e5-4282-b842-62e0bb37c782 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:17:39 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-8fb9d0ef-3367-4808-8073-5049e6be07f7 req-27be30de-0c03-4a4b-b807-06e4792e0078 service nova] Acquiring lock "aa84e575-bdad-45b9-80ce-86b1c2826fb0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:17:39 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-8fb9d0ef-3367-4808-8073-5049e6be07f7 req-27be30de-0c03-4a4b-b807-06e4792e0078 service nova] Lock "aa84e575-bdad-45b9-80ce-86b1c2826fb0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:17:39 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-8fb9d0ef-3367-4808-8073-5049e6be07f7 req-27be30de-0c03-4a4b-b807-06e4792e0078 service nova] Lock "aa84e575-bdad-45b9-80ce-86b1c2826fb0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:17:39 user nova-compute[75226]: DEBUG nova.compute.manager [req-8fb9d0ef-3367-4808-8073-5049e6be07f7 req-27be30de-0c03-4a4b-b807-06e4792e0078 service nova] [instance: aa84e575-bdad-45b9-80ce-86b1c2826fb0] No waiting events found dispatching network-vif-plugged-734a9e23-26e5-4282-b842-62e0bb37c782 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:17:39 user nova-compute[75226]: WARNING nova.compute.manager [req-8fb9d0ef-3367-4808-8073-5049e6be07f7 req-27be30de-0c03-4a4b-b807-06e4792e0078 service nova] [instance: aa84e575-bdad-45b9-80ce-86b1c2826fb0] Received unexpected event network-vif-plugged-734a9e23-26e5-4282-b842-62e0bb37c782 for instance with vm_state active and task_state None.
Nov 17 01:17:39 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-58c48fa2-f165-4cc2-9b83-936ab0427491 tempest-VolumesAssistedSnapshotsTest-244184502 tempest-VolumesAssistedSnapshotsTest-244184502-project-member] Acquiring lock "1c505f8d-09e0-41bc-ba3a-89bde1646613" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:17:39 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-58c48fa2-f165-4cc2-9b83-936ab0427491 tempest-VolumesAssistedSnapshotsTest-244184502 tempest-VolumesAssistedSnapshotsTest-244184502-project-member] Lock "1c505f8d-09e0-41bc-ba3a-89bde1646613" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:17:39 user nova-compute[75226]: DEBUG nova.compute.manager [None req-58c48fa2-f165-4cc2-9b83-936ab0427491 tempest-VolumesAssistedSnapshotsTest-244184502 tempest-VolumesAssistedSnapshotsTest-244184502-project-member] [instance: 1c505f8d-09e0-41bc-ba3a-89bde1646613] Starting instance... {{(pid=75226) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 17 01:17:39 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-58c48fa2-f165-4cc2-9b83-936ab0427491 tempest-VolumesAssistedSnapshotsTest-244184502 tempest-VolumesAssistedSnapshotsTest-244184502-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:17:39 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-58c48fa2-f165-4cc2-9b83-936ab0427491 tempest-VolumesAssistedSnapshotsTest-244184502 tempest-VolumesAssistedSnapshotsTest-244184502-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:17:39 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-58c48fa2-f165-4cc2-9b83-936ab0427491 tempest-VolumesAssistedSnapshotsTest-244184502 tempest-VolumesAssistedSnapshotsTest-244184502-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75226) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 17 01:17:39 user nova-compute[75226]: INFO nova.compute.claims [None req-58c48fa2-f165-4cc2-9b83-936ab0427491 tempest-VolumesAssistedSnapshotsTest-244184502 tempest-VolumesAssistedSnapshotsTest-244184502-project-member] [instance: 1c505f8d-09e0-41bc-ba3a-89bde1646613] Claim successful on node user
Nov 17 01:17:39 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-bf96017e-d4d1-42b2-b4a2-1c2e4f1f75f3 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] [instance: e7830f7a-80f1-4c2f-bd64-363e6dd9114a] Creating config drive at /opt/stack/data/nova/instances/e7830f7a-80f1-4c2f-bd64-363e6dd9114a/disk.config
Nov 17 01:17:39 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-bf96017e-d4d1-42b2-b4a2-1c2e4f1f75f3 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/e7830f7a-80f1-4c2f-bd64-363e6dd9114a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp63lxiyzl {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:17:39 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:17:39 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-bf96017e-d4d1-42b2-b4a2-1c2e4f1f75f3 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/e7830f7a-80f1-4c2f-bd64-363e6dd9114a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp63lxiyzl" returned: 0 in 0.074s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:17:39 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:17:39 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:17:39 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:17:39 user nova-compute[75226]: DEBUG nova.compute.manager [None req-615bbbf5-25e3-4644-ad65-daa2b2d0c059 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] [instance: 724b81dd-4531-4c99-850d-0bfcbfdf7bd4] Instance event wait completed in 0 seconds for  {{(pid=75226) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 17 01:17:39 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-615bbbf5-25e3-4644-ad65-daa2b2d0c059 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] [instance: 724b81dd-4531-4c99-850d-0bfcbfdf7bd4] Guest created on hypervisor {{(pid=75226) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 17 01:17:39 user nova-compute[75226]: INFO nova.virt.libvirt.driver [-] [instance: 724b81dd-4531-4c99-850d-0bfcbfdf7bd4] Instance spawned successfully.
Nov 17 01:17:39 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-615bbbf5-25e3-4644-ad65-daa2b2d0c059 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] [instance: 724b81dd-4531-4c99-850d-0bfcbfdf7bd4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 17 01:17:39 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-46c2f725-5e40-4a05-8748-c94c869b1fe9 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] Acquiring lock "262eb845-eebe-4ffb-bc49-dcaca53ad7b8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:17:39 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-46c2f725-5e40-4a05-8748-c94c869b1fe9 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] Lock "262eb845-eebe-4ffb-bc49-dcaca53ad7b8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:17:40 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-615bbbf5-25e3-4644-ad65-daa2b2d0c059 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] [instance: 724b81dd-4531-4c99-850d-0bfcbfdf7bd4] Found default for hw_cdrom_bus of ide {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:17:40 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-615bbbf5-25e3-4644-ad65-daa2b2d0c059 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] [instance: 724b81dd-4531-4c99-850d-0bfcbfdf7bd4] Found default for hw_disk_bus of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:17:40 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-615bbbf5-25e3-4644-ad65-daa2b2d0c059 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] [instance: 724b81dd-4531-4c99-850d-0bfcbfdf7bd4] Found default for hw_input_bus of None {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:17:40 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-615bbbf5-25e3-4644-ad65-daa2b2d0c059 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] [instance: 724b81dd-4531-4c99-850d-0bfcbfdf7bd4] Found default for hw_pointer_model of None {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:17:40 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-615bbbf5-25e3-4644-ad65-daa2b2d0c059 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] [instance: 724b81dd-4531-4c99-850d-0bfcbfdf7bd4] Found default for hw_video_model of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:17:40 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-615bbbf5-25e3-4644-ad65-daa2b2d0c059 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] [instance: 724b81dd-4531-4c99-850d-0bfcbfdf7bd4] Found default for hw_vif_model of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:17:40 user nova-compute[75226]: DEBUG nova.compute.manager [None req-46c2f725-5e40-4a05-8748-c94c869b1fe9 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] [instance: 262eb845-eebe-4ffb-bc49-dcaca53ad7b8] Starting instance... {{(pid=75226) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 17 01:17:40 user nova-compute[75226]: DEBUG nova.network.neutron [req-cd6e53df-01a7-4e56-84ae-b1eeda1e598e req-4da4d8f4-e4c3-4663-9e50-ce7d83b6dd49 service nova] [instance: e7830f7a-80f1-4c2f-bd64-363e6dd9114a] Updated VIF entry in instance network info cache for port b273b468-b80c-435e-bae6-9cbbcf617110. {{(pid=75226) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 01:17:40 user nova-compute[75226]: DEBUG nova.network.neutron [req-cd6e53df-01a7-4e56-84ae-b1eeda1e598e req-4da4d8f4-e4c3-4663-9e50-ce7d83b6dd49 service nova] [instance: e7830f7a-80f1-4c2f-bd64-363e6dd9114a] Updating instance_info_cache with network_info: [{"id": "b273b468-b80c-435e-bae6-9cbbcf617110", "address": "fa:16:3e:29:76:3a", "network": {"id": "dbec5c0d-6e91-420e-a351-6aeaccb8253c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2034589845-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32bfc0cc503b45f7b2ebb10fd934b630", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb273b468-b8", "ovs_interfaceid": "b273b468-b80c-435e-bae6-9cbbcf617110", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:17:40 user nova-compute[75226]: INFO nova.compute.manager [None req-615bbbf5-25e3-4644-ad65-daa2b2d0c059 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] [instance: 724b81dd-4531-4c99-850d-0bfcbfdf7bd4] Took 13.61 seconds to spawn the instance on the hypervisor.
Nov 17 01:17:40 user nova-compute[75226]: DEBUG nova.compute.manager [None req-615bbbf5-25e3-4644-ad65-daa2b2d0c059 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] [instance: 724b81dd-4531-4c99-850d-0bfcbfdf7bd4] Checking state {{(pid=75226) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 01:17:40 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-cd6e53df-01a7-4e56-84ae-b1eeda1e598e req-4da4d8f4-e4c3-4663-9e50-ce7d83b6dd49 service nova] Releasing lock "refresh_cache-e7830f7a-80f1-4c2f-bd64-363e6dd9114a" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:17:40 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-58c48fa2-f165-4cc2-9b83-936ab0427491 tempest-VolumesAssistedSnapshotsTest-244184502 tempest-VolumesAssistedSnapshotsTest-244184502-project-member] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:17:40 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-46c2f725-5e40-4a05-8748-c94c869b1fe9 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:17:40 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-58c48fa2-f165-4cc2-9b83-936ab0427491 tempest-VolumesAssistedSnapshotsTest-244184502 tempest-VolumesAssistedSnapshotsTest-244184502-project-member] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:17:40 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-58c48fa2-f165-4cc2-9b83-936ab0427491 tempest-VolumesAssistedSnapshotsTest-244184502 tempest-VolumesAssistedSnapshotsTest-244184502-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.922s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:17:40 user nova-compute[75226]: DEBUG nova.compute.manager [None req-58c48fa2-f165-4cc2-9b83-936ab0427491 tempest-VolumesAssistedSnapshotsTest-244184502 tempest-VolumesAssistedSnapshotsTest-244184502-project-member] [instance: 1c505f8d-09e0-41bc-ba3a-89bde1646613] Start building networks asynchronously for instance. {{(pid=75226) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 17 01:17:40 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-46c2f725-5e40-4a05-8748-c94c869b1fe9 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.093s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:17:40 user nova-compute[75226]: INFO nova.compute.manager [None req-615bbbf5-25e3-4644-ad65-daa2b2d0c059 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] [instance: 724b81dd-4531-4c99-850d-0bfcbfdf7bd4] Took 15.13 seconds to build instance.
Nov 17 01:17:40 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-46c2f725-5e40-4a05-8748-c94c869b1fe9 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75226) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 17 01:17:40 user nova-compute[75226]: INFO nova.compute.claims [None req-46c2f725-5e40-4a05-8748-c94c869b1fe9 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] [instance: 262eb845-eebe-4ffb-bc49-dcaca53ad7b8] Claim successful on node user
Nov 17 01:17:40 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-615bbbf5-25e3-4644-ad65-daa2b2d0c059 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Lock "724b81dd-4531-4c99-850d-0bfcbfdf7bd4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.387s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:17:40 user nova-compute[75226]: DEBUG nova.compute.manager [None req-58c48fa2-f165-4cc2-9b83-936ab0427491 tempest-VolumesAssistedSnapshotsTest-244184502 tempest-VolumesAssistedSnapshotsTest-244184502-project-member] [instance: 1c505f8d-09e0-41bc-ba3a-89bde1646613] Allocating IP information in the background. {{(pid=75226) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 17 01:17:40 user nova-compute[75226]: DEBUG nova.network.neutron [None req-58c48fa2-f165-4cc2-9b83-936ab0427491 tempest-VolumesAssistedSnapshotsTest-244184502 tempest-VolumesAssistedSnapshotsTest-244184502-project-member] [instance: 1c505f8d-09e0-41bc-ba3a-89bde1646613] allocate_for_instance() {{(pid=75226) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 17 01:17:40 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-58c48fa2-f165-4cc2-9b83-936ab0427491 tempest-VolumesAssistedSnapshotsTest-244184502 tempest-VolumesAssistedSnapshotsTest-244184502-project-member] [instance: 1c505f8d-09e0-41bc-ba3a-89bde1646613] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 17 01:17:40 user nova-compute[75226]: DEBUG nova.compute.manager [None req-58c48fa2-f165-4cc2-9b83-936ab0427491 tempest-VolumesAssistedSnapshotsTest-244184502 tempest-VolumesAssistedSnapshotsTest-244184502-project-member] [instance: 1c505f8d-09e0-41bc-ba3a-89bde1646613] Start building block device mappings for instance. {{(pid=75226) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 17 01:17:40 user nova-compute[75226]: DEBUG nova.policy [None req-58c48fa2-f165-4cc2-9b83-936ab0427491 tempest-VolumesAssistedSnapshotsTest-244184502 tempest-VolumesAssistedSnapshotsTest-244184502-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '95cb1198a0c24bc6acf389d90595ab5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26a1467375947e9b71d9a2c61127e2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75226) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 17 01:17:40 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:17:40 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:17:40 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:17:40 user nova-compute[75226]: DEBUG nova.compute.manager [None req-58c48fa2-f165-4cc2-9b83-936ab0427491 tempest-VolumesAssistedSnapshotsTest-244184502 tempest-VolumesAssistedSnapshotsTest-244184502-project-member] [instance: 1c505f8d-09e0-41bc-ba3a-89bde1646613] Start spawning the instance on the hypervisor. {{(pid=75226) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 17 01:17:40 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-58c48fa2-f165-4cc2-9b83-936ab0427491 tempest-VolumesAssistedSnapshotsTest-244184502 tempest-VolumesAssistedSnapshotsTest-244184502-project-member] [instance: 1c505f8d-09e0-41bc-ba3a-89bde1646613] Creating instance directory {{(pid=75226) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 17 01:17:40 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-58c48fa2-f165-4cc2-9b83-936ab0427491 tempest-VolumesAssistedSnapshotsTest-244184502 tempest-VolumesAssistedSnapshotsTest-244184502-project-member] [instance: 1c505f8d-09e0-41bc-ba3a-89bde1646613] Creating image(s)
Nov 17 01:17:40 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-58c48fa2-f165-4cc2-9b83-936ab0427491 tempest-VolumesAssistedSnapshotsTest-244184502 tempest-VolumesAssistedSnapshotsTest-244184502-project-member] Acquiring lock "/opt/stack/data/nova/instances/1c505f8d-09e0-41bc-ba3a-89bde1646613/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:17:40 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-58c48fa2-f165-4cc2-9b83-936ab0427491 tempest-VolumesAssistedSnapshotsTest-244184502 tempest-VolumesAssistedSnapshotsTest-244184502-project-member] Lock "/opt/stack/data/nova/instances/1c505f8d-09e0-41bc-ba3a-89bde1646613/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:17:40 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-58c48fa2-f165-4cc2-9b83-936ab0427491 tempest-VolumesAssistedSnapshotsTest-244184502 tempest-VolumesAssistedSnapshotsTest-244184502-project-member] Lock "/opt/stack/data/nova/instances/1c505f8d-09e0-41bc-ba3a-89bde1646613/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:17:40 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-58c48fa2-f165-4cc2-9b83-936ab0427491 tempest-VolumesAssistedSnapshotsTest-244184502 tempest-VolumesAssistedSnapshotsTest-244184502-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:17:40 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-46c2f725-5e40-4a05-8748-c94c869b1fe9 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:17:40 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-58c48fa2-f165-4cc2-9b83-936ab0427491 tempest-VolumesAssistedSnapshotsTest-244184502 tempest-VolumesAssistedSnapshotsTest-244184502-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json" returned: 0 in 0.265s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:17:40 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-58c48fa2-f165-4cc2-9b83-936ab0427491 tempest-VolumesAssistedSnapshotsTest-244184502 tempest-VolumesAssistedSnapshotsTest-244184502-project-member] Acquiring lock "a8a62c2546af3a2036b853250c5ac64d4c6b4371" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:17:40 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-58c48fa2-f165-4cc2-9b83-936ab0427491 tempest-VolumesAssistedSnapshotsTest-244184502 tempest-VolumesAssistedSnapshotsTest-244184502-project-member] Lock "a8a62c2546af3a2036b853250c5ac64d4c6b4371" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:17:40 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-58c48fa2-f165-4cc2-9b83-936ab0427491 tempest-VolumesAssistedSnapshotsTest-244184502 tempest-VolumesAssistedSnapshotsTest-244184502-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:17:41 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-46c2f725-5e40-4a05-8748-c94c869b1fe9 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:17:41 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-46c2f725-5e40-4a05-8748-c94c869b1fe9 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.733s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:17:41 user nova-compute[75226]: DEBUG nova.compute.manager [None req-46c2f725-5e40-4a05-8748-c94c869b1fe9 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] [instance: 262eb845-eebe-4ffb-bc49-dcaca53ad7b8] Start building networks asynchronously for instance. {{(pid=75226) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 17 01:17:41 user nova-compute[75226]: DEBUG nova.compute.manager [None req-46c2f725-5e40-4a05-8748-c94c869b1fe9 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] [instance: 262eb845-eebe-4ffb-bc49-dcaca53ad7b8] Allocating IP information in the background. {{(pid=75226) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 17 01:17:41 user nova-compute[75226]: DEBUG nova.network.neutron [None req-46c2f725-5e40-4a05-8748-c94c869b1fe9 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] [instance: 262eb845-eebe-4ffb-bc49-dcaca53ad7b8] allocate_for_instance() {{(pid=75226) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 17 01:17:41 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-46c2f725-5e40-4a05-8748-c94c869b1fe9 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] [instance: 262eb845-eebe-4ffb-bc49-dcaca53ad7b8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 17 01:17:41 user nova-compute[75226]: DEBUG nova.compute.manager [None req-46c2f725-5e40-4a05-8748-c94c869b1fe9 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] [instance: 262eb845-eebe-4ffb-bc49-dcaca53ad7b8] Start building block device mappings for instance. {{(pid=75226) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 17 01:17:41 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-58c48fa2-f165-4cc2-9b83-936ab0427491 tempest-VolumesAssistedSnapshotsTest-244184502 tempest-VolumesAssistedSnapshotsTest-244184502-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json" returned: 0 in 0.315s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:17:41 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-58c48fa2-f165-4cc2-9b83-936ab0427491 tempest-VolumesAssistedSnapshotsTest-244184502 tempest-VolumesAssistedSnapshotsTest-244184502-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371,backing_fmt=raw /opt/stack/data/nova/instances/1c505f8d-09e0-41bc-ba3a-89bde1646613/disk 1073741824 {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:17:41 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-58c48fa2-f165-4cc2-9b83-936ab0427491 tempest-VolumesAssistedSnapshotsTest-244184502 tempest-VolumesAssistedSnapshotsTest-244184502-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371,backing_fmt=raw /opt/stack/data/nova/instances/1c505f8d-09e0-41bc-ba3a-89bde1646613/disk 1073741824" returned: 0 in 0.062s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:17:41 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-58c48fa2-f165-4cc2-9b83-936ab0427491 tempest-VolumesAssistedSnapshotsTest-244184502 tempest-VolumesAssistedSnapshotsTest-244184502-project-member] Lock "a8a62c2546af3a2036b853250c5ac64d4c6b4371" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.382s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:17:41 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-58c48fa2-f165-4cc2-9b83-936ab0427491 tempest-VolumesAssistedSnapshotsTest-244184502 tempest-VolumesAssistedSnapshotsTest-244184502-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:17:41 user nova-compute[75226]: DEBUG nova.policy [None req-46c2f725-5e40-4a05-8748-c94c869b1fe9 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2c4b7f0453ec4ef5940b4bdf32bdf6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25ffeaafcdca494eb7550cec5b100051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75226) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 17 01:17:41 user nova-compute[75226]: INFO nova.virt.block_device [None req-46c2f725-5e40-4a05-8748-c94c869b1fe9 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] [instance: 262eb845-eebe-4ffb-bc49-dcaca53ad7b8] Booting with volume 2ca02b15-b2b8-4e45-9d87-54886c2568a2 at /dev/vda
Nov 17 01:17:41 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:17:41 user nova-compute[75226]: DEBUG nova.compute.manager [req-02a20ad7-891f-4201-b402-f751ee28d878 req-6767c9c4-57c5-4086-a98c-a24d1f04b872 service nova] [instance: 724b81dd-4531-4c99-850d-0bfcbfdf7bd4] Received event network-vif-plugged-f9692d93-cc90-464e-a8ef-abb2a5bb8fe0 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:17:41 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-02a20ad7-891f-4201-b402-f751ee28d878 req-6767c9c4-57c5-4086-a98c-a24d1f04b872 service nova] Acquiring lock "724b81dd-4531-4c99-850d-0bfcbfdf7bd4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:17:41 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-02a20ad7-891f-4201-b402-f751ee28d878 req-6767c9c4-57c5-4086-a98c-a24d1f04b872 service nova] Lock "724b81dd-4531-4c99-850d-0bfcbfdf7bd4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:17:41 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-02a20ad7-891f-4201-b402-f751ee28d878 req-6767c9c4-57c5-4086-a98c-a24d1f04b872 service nova] Lock "724b81dd-4531-4c99-850d-0bfcbfdf7bd4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:17:41 user nova-compute[75226]: DEBUG nova.compute.manager [req-02a20ad7-891f-4201-b402-f751ee28d878 req-6767c9c4-57c5-4086-a98c-a24d1f04b872 service nova] [instance: 724b81dd-4531-4c99-850d-0bfcbfdf7bd4] No waiting events found dispatching network-vif-plugged-f9692d93-cc90-464e-a8ef-abb2a5bb8fe0 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:17:41 user nova-compute[75226]: WARNING nova.compute.manager [req-02a20ad7-891f-4201-b402-f751ee28d878 req-6767c9c4-57c5-4086-a98c-a24d1f04b872 service nova] [instance: 724b81dd-4531-4c99-850d-0bfcbfdf7bd4] Received unexpected event network-vif-plugged-f9692d93-cc90-464e-a8ef-abb2a5bb8fe0 for instance with vm_state active and task_state None.
Nov 17 01:17:41 user nova-compute[75226]: DEBUG nova.compute.manager [req-02a20ad7-891f-4201-b402-f751ee28d878 req-6767c9c4-57c5-4086-a98c-a24d1f04b872 service nova] [instance: 724b81dd-4531-4c99-850d-0bfcbfdf7bd4] Received event network-vif-plugged-f9692d93-cc90-464e-a8ef-abb2a5bb8fe0 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:17:41 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-02a20ad7-891f-4201-b402-f751ee28d878 req-6767c9c4-57c5-4086-a98c-a24d1f04b872 service nova] Acquiring lock "724b81dd-4531-4c99-850d-0bfcbfdf7bd4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:17:41 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-02a20ad7-891f-4201-b402-f751ee28d878 req-6767c9c4-57c5-4086-a98c-a24d1f04b872 service nova] Lock "724b81dd-4531-4c99-850d-0bfcbfdf7bd4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:17:41 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-02a20ad7-891f-4201-b402-f751ee28d878 req-6767c9c4-57c5-4086-a98c-a24d1f04b872 service nova] Lock "724b81dd-4531-4c99-850d-0bfcbfdf7bd4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:17:41 user nova-compute[75226]: DEBUG nova.compute.manager [req-02a20ad7-891f-4201-b402-f751ee28d878 req-6767c9c4-57c5-4086-a98c-a24d1f04b872 service nova] [instance: 724b81dd-4531-4c99-850d-0bfcbfdf7bd4] No waiting events found dispatching network-vif-plugged-f9692d93-cc90-464e-a8ef-abb2a5bb8fe0 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:17:41 user nova-compute[75226]: WARNING nova.compute.manager [req-02a20ad7-891f-4201-b402-f751ee28d878 req-6767c9c4-57c5-4086-a98c-a24d1f04b872 service nova] [instance: 724b81dd-4531-4c99-850d-0bfcbfdf7bd4] Received unexpected event network-vif-plugged-f9692d93-cc90-464e-a8ef-abb2a5bb8fe0 for instance with vm_state active and task_state None.
Nov 17 01:17:41 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:17:41 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-58c48fa2-f165-4cc2-9b83-936ab0427491 tempest-VolumesAssistedSnapshotsTest-244184502 tempest-VolumesAssistedSnapshotsTest-244184502-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json" returned: 0 in 0.217s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:17:41 user nova-compute[75226]: DEBUG nova.virt.disk.api [None req-58c48fa2-f165-4cc2-9b83-936ab0427491 tempest-VolumesAssistedSnapshotsTest-244184502 tempest-VolumesAssistedSnapshotsTest-244184502-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1c505f8d-09e0-41bc-ba3a-89bde1646613/disk. size=1073741824 {{(pid=75226) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 17 01:17:41 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-58c48fa2-f165-4cc2-9b83-936ab0427491 tempest-VolumesAssistedSnapshotsTest-244184502 tempest-VolumesAssistedSnapshotsTest-244184502-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c505f8d-09e0-41bc-ba3a-89bde1646613/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:17:41 user nova-compute[75226]: DEBUG os_brick.utils [None req-46c2f725-5e40-4a05-8748-c94c869b1fe9 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:17:41 user nova-compute[75226]: INFO oslo.privsep.daemon [None req-46c2f725-5e40-4a05-8748-c94c869b1fe9 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpblfyviwb/privsep.sock']
Nov 17 01:17:41 user sudo[85745]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpblfyviwb/privsep.sock
Nov 17 01:17:41 user sudo[85745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 17 01:17:41 user nova-compute[75226]: DEBUG nova.network.neutron [None req-58c48fa2-f165-4cc2-9b83-936ab0427491 tempest-VolumesAssistedSnapshotsTest-244184502 tempest-VolumesAssistedSnapshotsTest-244184502-project-member] [instance: 1c505f8d-09e0-41bc-ba3a-89bde1646613] Successfully created port: 6c56f715-bdcb-4a40-b922-3081a6457c31 {{(pid=75226) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 17 01:17:41 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-58c48fa2-f165-4cc2-9b83-936ab0427491 tempest-VolumesAssistedSnapshotsTest-244184502 tempest-VolumesAssistedSnapshotsTest-244184502-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c505f8d-09e0-41bc-ba3a-89bde1646613/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:17:41 user nova-compute[75226]: DEBUG nova.virt.disk.api [None req-58c48fa2-f165-4cc2-9b83-936ab0427491 tempest-VolumesAssistedSnapshotsTest-244184502 tempest-VolumesAssistedSnapshotsTest-244184502-project-member] Cannot resize image /opt/stack/data/nova/instances/1c505f8d-09e0-41bc-ba3a-89bde1646613/disk to a smaller size. {{(pid=75226) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 17 01:17:41 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-58c48fa2-f165-4cc2-9b83-936ab0427491 tempest-VolumesAssistedSnapshotsTest-244184502 tempest-VolumesAssistedSnapshotsTest-244184502-project-member] [instance: 1c505f8d-09e0-41bc-ba3a-89bde1646613] Created local disks {{(pid=75226) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 17 01:17:41 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-58c48fa2-f165-4cc2-9b83-936ab0427491 tempest-VolumesAssistedSnapshotsTest-244184502 tempest-VolumesAssistedSnapshotsTest-244184502-project-member] [instance: 1c505f8d-09e0-41bc-ba3a-89bde1646613] Ensure instance console log exists: /opt/stack/data/nova/instances/1c505f8d-09e0-41bc-ba3a-89bde1646613/console.log {{(pid=75226) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 17 01:17:41 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-58c48fa2-f165-4cc2-9b83-936ab0427491 tempest-VolumesAssistedSnapshotsTest-244184502 tempest-VolumesAssistedSnapshotsTest-244184502-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:17:41 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-58c48fa2-f165-4cc2-9b83-936ab0427491 tempest-VolumesAssistedSnapshotsTest-244184502 tempest-VolumesAssistedSnapshotsTest-244184502-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:17:41 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-58c48fa2-f165-4cc2-9b83-936ab0427491 tempest-VolumesAssistedSnapshotsTest-244184502 tempest-VolumesAssistedSnapshotsTest-244184502-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:17:42 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:17:42 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:17:42 user nova-compute[75226]: DEBUG nova.network.neutron [None req-46c2f725-5e40-4a05-8748-c94c869b1fe9 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] [instance: 262eb845-eebe-4ffb-bc49-dcaca53ad7b8] Successfully created port: ca3803cf-fc7f-4233-8afa-1806c73156be {{(pid=75226) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 17 01:17:43 user nova-compute[75226]: DEBUG nova.compute.manager [req-b360b3c1-9ecc-4447-9761-561e60e98352 req-c704f511-64be-4fa7-bb50-6bdea3ec31a2 service nova] [instance: 75b1cabe-ba15-4851-9140-5949afc33005] Received event network-vif-plugged-8e47eaef-6e73-4c79-973d-31f6481368be {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:17:43 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-b360b3c1-9ecc-4447-9761-561e60e98352 req-c704f511-64be-4fa7-bb50-6bdea3ec31a2 service nova] Acquiring lock "75b1cabe-ba15-4851-9140-5949afc33005-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:17:43 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-b360b3c1-9ecc-4447-9761-561e60e98352 req-c704f511-64be-4fa7-bb50-6bdea3ec31a2 service nova] Lock "75b1cabe-ba15-4851-9140-5949afc33005-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:17:43 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-b360b3c1-9ecc-4447-9761-561e60e98352 req-c704f511-64be-4fa7-bb50-6bdea3ec31a2 service nova] Lock "75b1cabe-ba15-4851-9140-5949afc33005-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:17:43 user nova-compute[75226]: DEBUG nova.compute.manager [req-b360b3c1-9ecc-4447-9761-561e60e98352 req-c704f511-64be-4fa7-bb50-6bdea3ec31a2 service nova] [instance: 75b1cabe-ba15-4851-9140-5949afc33005] No waiting events found dispatching network-vif-plugged-8e47eaef-6e73-4c79-973d-31f6481368be {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:17:43 user nova-compute[75226]: WARNING nova.compute.manager [req-b360b3c1-9ecc-4447-9761-561e60e98352 req-c704f511-64be-4fa7-bb50-6bdea3ec31a2 service nova] [instance: 75b1cabe-ba15-4851-9140-5949afc33005] Received unexpected event network-vif-plugged-8e47eaef-6e73-4c79-973d-31f6481368be for instance with vm_state building and task_state spawning.
Nov 17 01:17:43 user nova-compute[75226]: DEBUG nova.network.neutron [None req-58c48fa2-f165-4cc2-9b83-936ab0427491 tempest-VolumesAssistedSnapshotsTest-244184502 tempest-VolumesAssistedSnapshotsTest-244184502-project-member] [instance: 1c505f8d-09e0-41bc-ba3a-89bde1646613] Successfully updated port: 6c56f715-bdcb-4a40-b922-3081a6457c31 {{(pid=75226) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 17 01:17:43 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:17:43 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:17:43 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:17:43 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-58c48fa2-f165-4cc2-9b83-936ab0427491 tempest-VolumesAssistedSnapshotsTest-244184502 tempest-VolumesAssistedSnapshotsTest-244184502-project-member] Acquiring lock "refresh_cache-1c505f8d-09e0-41bc-ba3a-89bde1646613" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:17:43 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-58c48fa2-f165-4cc2-9b83-936ab0427491 tempest-VolumesAssistedSnapshotsTest-244184502 tempest-VolumesAssistedSnapshotsTest-244184502-project-member] Acquired lock "refresh_cache-1c505f8d-09e0-41bc-ba3a-89bde1646613" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:17:43 user nova-compute[75226]: DEBUG nova.network.neutron [None req-58c48fa2-f165-4cc2-9b83-936ab0427491 tempest-VolumesAssistedSnapshotsTest-244184502 tempest-VolumesAssistedSnapshotsTest-244184502-project-member] [instance: 1c505f8d-09e0-41bc-ba3a-89bde1646613] Building network info cache for instance {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 01:17:43 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:17:43 user nova-compute[75226]: DEBUG nova.compute.manager [req-c0c98f20-66cd-4d27-bca5-42605798aa34 req-aa486f0c-35f7-4e4c-b20a-23e75740c975 service nova] [instance: e7830f7a-80f1-4c2f-bd64-363e6dd9114a] Received event network-vif-plugged-b273b468-b80c-435e-bae6-9cbbcf617110 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:17:43 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-c0c98f20-66cd-4d27-bca5-42605798aa34 req-aa486f0c-35f7-4e4c-b20a-23e75740c975 service nova] Acquiring lock "e7830f7a-80f1-4c2f-bd64-363e6dd9114a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:17:43 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-c0c98f20-66cd-4d27-bca5-42605798aa34 req-aa486f0c-35f7-4e4c-b20a-23e75740c975 service nova] Lock "e7830f7a-80f1-4c2f-bd64-363e6dd9114a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:17:43 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-c0c98f20-66cd-4d27-bca5-42605798aa34 req-aa486f0c-35f7-4e4c-b20a-23e75740c975 service nova] Lock "e7830f7a-80f1-4c2f-bd64-363e6dd9114a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:17:43 user nova-compute[75226]: DEBUG nova.compute.manager [req-c0c98f20-66cd-4d27-bca5-42605798aa34 req-aa486f0c-35f7-4e4c-b20a-23e75740c975 service nova] [instance: e7830f7a-80f1-4c2f-bd64-363e6dd9114a] No waiting events found dispatching network-vif-plugged-b273b468-b80c-435e-bae6-9cbbcf617110 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:17:43 user nova-compute[75226]: WARNING nova.compute.manager [req-c0c98f20-66cd-4d27-bca5-42605798aa34 req-aa486f0c-35f7-4e4c-b20a-23e75740c975 service nova] [instance: e7830f7a-80f1-4c2f-bd64-363e6dd9114a] Received unexpected event network-vif-plugged-b273b468-b80c-435e-bae6-9cbbcf617110 for instance with vm_state building and task_state spawning.
Nov 17 01:17:43 user nova-compute[75226]: DEBUG nova.compute.manager [req-c0c98f20-66cd-4d27-bca5-42605798aa34 req-aa486f0c-35f7-4e4c-b20a-23e75740c975 service nova] [instance: 1c505f8d-09e0-41bc-ba3a-89bde1646613] Received event network-changed-6c56f715-bdcb-4a40-b922-3081a6457c31 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:17:43 user nova-compute[75226]: DEBUG nova.compute.manager [req-c0c98f20-66cd-4d27-bca5-42605798aa34 req-aa486f0c-35f7-4e4c-b20a-23e75740c975 service nova] [instance: 1c505f8d-09e0-41bc-ba3a-89bde1646613] Refreshing instance network info cache due to event network-changed-6c56f715-bdcb-4a40-b922-3081a6457c31. {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 01:17:43 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-c0c98f20-66cd-4d27-bca5-42605798aa34 req-aa486f0c-35f7-4e4c-b20a-23e75740c975 service nova] Acquiring lock "refresh_cache-1c505f8d-09e0-41bc-ba3a-89bde1646613" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:17:43 user sudo[85745]: pam_unix(sudo:session): session closed for user root
Nov 17 01:17:43 user nova-compute[75226]: INFO oslo.privsep.daemon [None req-46c2f725-5e40-4a05-8748-c94c869b1fe9 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] Spawned new privsep daemon via rootwrap
Nov 17 01:17:43 user nova-compute[75226]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 17 01:17:43 user nova-compute[75226]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 17 01:17:43 user nova-compute[75226]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Nov 17 01:17:43 user nova-compute[75226]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 85818
Nov 17 01:17:43 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d548a90-dd6a-40fa-be88-5a2a56a541dc]: (2,) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:17:43 user nova-compute[75226]: DEBUG nova.compute.manager [None req-84b5e452-4390-4592-b05f-8e18af5f564c tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] [instance: 75b1cabe-ba15-4851-9140-5949afc33005] Instance event wait completed in 0 seconds for  {{(pid=75226) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 17 01:17:43 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-84b5e452-4390-4592-b05f-8e18af5f564c tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] [instance: 75b1cabe-ba15-4851-9140-5949afc33005] Guest created on hypervisor {{(pid=75226) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 17 01:17:43 user nova-compute[75226]: INFO nova.virt.libvirt.driver [-] [instance: 75b1cabe-ba15-4851-9140-5949afc33005] Instance spawned successfully.
Nov 17 01:17:43 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-84b5e452-4390-4592-b05f-8e18af5f564c tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] [instance: 75b1cabe-ba15-4851-9140-5949afc33005] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 17 01:17:43 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-84b5e452-4390-4592-b05f-8e18af5f564c tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] [instance: 75b1cabe-ba15-4851-9140-5949afc33005] Found default for hw_cdrom_bus of ide {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:17:43 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-84b5e452-4390-4592-b05f-8e18af5f564c tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] [instance: 75b1cabe-ba15-4851-9140-5949afc33005] Found default for hw_disk_bus of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:17:43 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-84b5e452-4390-4592-b05f-8e18af5f564c tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] [instance: 75b1cabe-ba15-4851-9140-5949afc33005] Found default for hw_input_bus of None {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:17:43 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-84b5e452-4390-4592-b05f-8e18af5f564c tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] [instance: 75b1cabe-ba15-4851-9140-5949afc33005] Found default for hw_pointer_model of None {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:17:43 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-84b5e452-4390-4592-b05f-8e18af5f564c tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] [instance: 75b1cabe-ba15-4851-9140-5949afc33005] Found default for hw_video_model of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:17:43 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-84b5e452-4390-4592-b05f-8e18af5f564c tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] [instance: 75b1cabe-ba15-4851-9140-5949afc33005] Found default for hw_vif_model of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:17:43 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:17:43 user nova-compute[75226]: DEBUG nova.network.neutron [None req-58c48fa2-f165-4cc2-9b83-936ab0427491 tempest-VolumesAssistedSnapshotsTest-244184502 tempest-VolumesAssistedSnapshotsTest-244184502-project-member] [instance: 1c505f8d-09e0-41bc-ba3a-89bde1646613] Instance cache missing network info. {{(pid=75226) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 17 01:17:43 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:17:43 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.029s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:17:43 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[695b5751-52f8-4333-9841-185d0e3ecd0e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f62857db69\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:17:43 user nova-compute[75226]: WARNING os_brick.initiator.connectors.nvmeof [None req-46c2f725-5e40-4a05-8748-c94c869b1fe9 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Nov 17 01:17:43 user nova-compute[75226]: INFO nova.compute.manager [None req-84b5e452-4390-4592-b05f-8e18af5f564c tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] [instance: 75b1cabe-ba15-4851-9140-5949afc33005] Took 14.32 seconds to spawn the instance on the hypervisor.
Nov 17 01:17:44 user nova-compute[75226]: DEBUG nova.compute.manager [None req-84b5e452-4390-4592-b05f-8e18af5f564c tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] [instance: 75b1cabe-ba15-4851-9140-5949afc33005] Checking state {{(pid=75226) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 01:17:44 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:17:44 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:17:44 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.032s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:17:44 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[58fefc81-4e82-4a5e-be2b-01490eb5efdd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:17:44 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:17:44 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:17:44 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[da9a0fce-7367-457a-b9a1-007231063303]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:17:44 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[114bb55d-9510-45a4-883b-78f1fc2fceb5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:17:44 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-46c2f725-5e40-4a05-8748-c94c869b1fe9 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] Running cmd (subprocess): nvme version {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:17:44 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-46c2f725-5e40-4a05-8748-c94c869b1fe9 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] 'nvme version' failed. Not Retrying. {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 01:17:44 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.nvmeof [None req-46c2f725-5e40-4a05-8748-c94c869b1fe9 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] nvme not present on system {{(pid=75226) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 17 01:17:44 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:17:44 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 01:17:44 user nova-compute[75226]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 17 01:17:44 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f5fb513-5c17-4c55-a3d3-983becca3215]: (4, '') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:17:44 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-46c2f725-5e40-4a05-8748-c94c869b1fe9 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75226) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 17 01:17:44 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-46c2f725-5e40-4a05-8748-c94c869b1fe9 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75226) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 17 01:17:44 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-46c2f725-5e40-4a05-8748-c94c869b1fe9 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] LIGHTOS: no hostnqn found. {{(pid=75226) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 17 01:17:44 user nova-compute[75226]: DEBUG os_brick.utils [None req-46c2f725-5e40-4a05-8748-c94c869b1fe9 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] <== get_connector_properties: return (2524ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f62857db69', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:17:44 user nova-compute[75226]: DEBUG nova.virt.block_device [None req-46c2f725-5e40-4a05-8748-c94c869b1fe9 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] [instance: 262eb845-eebe-4ffb-bc49-dcaca53ad7b8] Updating existing volume attachment record: 87e44c10-b1f1-4e08-895d-d038fcf349aa {{(pid=75226) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 17 01:17:44 user nova-compute[75226]: INFO nova.compute.manager [None req-84b5e452-4390-4592-b05f-8e18af5f564c tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] [instance: 75b1cabe-ba15-4851-9140-5949afc33005] Took 15.46 seconds to build instance.
Nov 17 01:17:44 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-84b5e452-4390-4592-b05f-8e18af5f564c tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] Lock "75b1cabe-ba15-4851-9140-5949afc33005" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.586s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:17:44 user nova-compute[75226]: DEBUG nova.network.neutron [None req-58c48fa2-f165-4cc2-9b83-936ab0427491 tempest-VolumesAssistedSnapshotsTest-244184502 tempest-VolumesAssistedSnapshotsTest-244184502-project-member] [instance: 1c505f8d-09e0-41bc-ba3a-89bde1646613] Updating instance_info_cache with network_info: [{"id": "6c56f715-bdcb-4a40-b922-3081a6457c31", "address": "fa:16:3e:63:16:60", "network": {"id": "d3de5b6b-3c29-4aeb-b4ec-59dca1237cb5", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1649442166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a26a1467375947e9b71d9a2c61127e2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c56f715-bd", "ovs_interfaceid": "6c56f715-bdcb-4a40-b922-3081a6457c31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:17:44 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-58c48fa2-f165-4cc2-9b83-936ab0427491 tempest-VolumesAssistedSnapshotsTest-244184502 tempest-VolumesAssistedSnapshotsTest-244184502-project-member] Releasing lock "refresh_cache-1c505f8d-09e0-41bc-ba3a-89bde1646613" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:17:44 user nova-compute[75226]: DEBUG nova.compute.manager [None req-58c48fa2-f165-4cc2-9b83-936ab0427491 tempest-VolumesAssistedSnapshotsTest-244184502 tempest-VolumesAssistedSnapshotsTest-244184502-project-member] [instance: 1c505f8d-09e0-41bc-ba3a-89bde1646613] Instance network_info: |[{"id": "6c56f715-bdcb-4a40-b922-3081a6457c31", "address": "fa:16:3e:63:16:60", "network": {"id": "d3de5b6b-3c29-4aeb-b4ec-59dca1237cb5", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1649442166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a26a1467375947e9b71d9a2c61127e2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c56f715-bd", "ovs_interfaceid": "6c56f715-bdcb-4a40-b922-3081a6457c31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75226) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 17 01:17:44 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-c0c98f20-66cd-4d27-bca5-42605798aa34 req-aa486f0c-35f7-4e4c-b20a-23e75740c975 service nova] Acquired lock "refresh_cache-1c505f8d-09e0-41bc-ba3a-89bde1646613" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:17:44 user nova-compute[75226]: DEBUG nova.network.neutron [req-c0c98f20-66cd-4d27-bca5-42605798aa34 req-aa486f0c-35f7-4e4c-b20a-23e75740c975 service nova] [instance: 1c505f8d-09e0-41bc-ba3a-89bde1646613] Refreshing network info cache for port 6c56f715-bdcb-4a40-b922-3081a6457c31 {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 01:17:44 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-58c48fa2-f165-4cc2-9b83-936ab0427491 tempest-VolumesAssistedSnapshotsTest-244184502 tempest-VolumesAssistedSnapshotsTest-244184502-project-member] [instance: 1c505f8d-09e0-41bc-ba3a-89bde1646613] Start _get_guest_xml network_info=[{"id": "6c56f715-bdcb-4a40-b922-3081a6457c31", "address": "fa:16:3e:63:16:60", "network": {"id": "d3de5b6b-3c29-4aeb-b4ec-59dca1237cb5", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1649442166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a26a1467375947e9b71d9a2c61127e2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c56f715-bd", "ovs_interfaceid": "6c56f715-bdcb-4a40-b922-3081a6457c31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T01:13:22Z,direct_url=<?>,disk_format='qcow2',id=0b369aea-6f3f-4690-9f01-229b90ab6310,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4e110cbf9a84362a6864a7732c435a1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T01:13:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '0b369aea-6f3f-4690-9f01-229b90ab6310'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75226) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 17 01:17:44 user nova-compute[75226]: DEBUG nova.network.neutron [None req-46c2f725-5e40-4a05-8748-c94c869b1fe9 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] [instance: 262eb845-eebe-4ffb-bc49-dcaca53ad7b8] Successfully updated port: ca3803cf-fc7f-4233-8afa-1806c73156be {{(pid=75226) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 17 01:17:44 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-58c48fa2-f165-4cc2-9b83-936ab0427491 tempest-VolumesAssistedSnapshotsTest-244184502 tempest-VolumesAssistedSnapshotsTest-244184502-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:17:44 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-58c48fa2-f165-4cc2-9b83-936ab0427491 tempest-VolumesAssistedSnapshotsTest-244184502 tempest-VolumesAssistedSnapshotsTest-244184502-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:17:44 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-46c2f725-5e40-4a05-8748-c94c869b1fe9 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] Acquiring lock "refresh_cache-262eb845-eebe-4ffb-bc49-dcaca53ad7b8" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:17:44 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-46c2f725-5e40-4a05-8748-c94c869b1fe9 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] Acquired lock "refresh_cache-262eb845-eebe-4ffb-bc49-dcaca53ad7b8" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:17:44 user nova-compute[75226]: DEBUG nova.network.neutron [None req-46c2f725-5e40-4a05-8748-c94c869b1fe9 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] [instance: 262eb845-eebe-4ffb-bc49-dcaca53ad7b8] Building network info cache for instance {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 01:17:44 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-58c48fa2-f165-4cc2-9b83-936ab0427491 tempest-VolumesAssistedSnapshotsTest-244184502 tempest-VolumesAssistedSnapshotsTest-244184502-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75226) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 17 01:17:44 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-58c48fa2-f165-4cc2-9b83-936ab0427491 tempest-VolumesAssistedSnapshotsTest-244184502 tempest-VolumesAssistedSnapshotsTest-244184502-project-member] CPU controller missing on host. {{(pid=75226) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 17 01:17:44 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-58c48fa2-f165-4cc2-9b83-936ab0427491 tempest-VolumesAssistedSnapshotsTest-244184502 tempest-VolumesAssistedSnapshotsTest-244184502-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75226) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 17 01:17:44 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-58c48fa2-f165-4cc2-9b83-936ab0427491 tempest-VolumesAssistedSnapshotsTest-244184502 tempest-VolumesAssistedSnapshotsTest-244184502-project-member] CPU controller found on host. {{(pid=75226) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 17 01:17:44 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-58c48fa2-f165-4cc2-9b83-936ab0427491 tempest-VolumesAssistedSnapshotsTest-244184502 tempest-VolumesAssistedSnapshotsTest-244184502-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75226) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 17 01:17:44 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-58c48fa2-f165-4cc2-9b83-936ab0427491 tempest-VolumesAssistedSnapshotsTest-244184502 tempest-VolumesAssistedSnapshotsTest-244184502-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-17T01:13:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T01:13:22Z,direct_url=<?>,disk_format='qcow2',id=0b369aea-6f3f-4690-9f01-229b90ab6310,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4e110cbf9a84362a6864a7732c435a1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T01:13:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 17 01:17:44 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-58c48fa2-f165-4cc2-9b83-936ab0427491 tempest-VolumesAssistedSnapshotsTest-244184502 tempest-VolumesAssistedSnapshotsTest-244184502-project-member] Flavor limits 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 17 01:17:44 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-58c48fa2-f165-4cc2-9b83-936ab0427491 tempest-VolumesAssistedSnapshotsTest-244184502 tempest-VolumesAssistedSnapshotsTest-244184502-project-member] Image limits 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 17 01:17:44 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-58c48fa2-f165-4cc2-9b83-936ab0427491 tempest-VolumesAssistedSnapshotsTest-244184502 tempest-VolumesAssistedSnapshotsTest-244184502-project-member] Flavor pref 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 17 01:17:44 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-58c48fa2-f165-4cc2-9b83-936ab0427491 tempest-VolumesAssistedSnapshotsTest-244184502 tempest-VolumesAssistedSnapshotsTest-244184502-project-member] Image pref 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 17 01:17:44 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-58c48fa2-f165-4cc2-9b83-936ab0427491 tempest-VolumesAssistedSnapshotsTest-244184502 tempest-VolumesAssistedSnapshotsTest-244184502-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 17 01:17:44 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-58c48fa2-f165-4cc2-9b83-936ab0427491 tempest-VolumesAssistedSnapshotsTest-244184502 tempest-VolumesAssistedSnapshotsTest-244184502-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 17 01:17:44 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-58c48fa2-f165-4cc2-9b83-936ab0427491 tempest-VolumesAssistedSnapshotsTest-244184502 tempest-VolumesAssistedSnapshotsTest-244184502-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75226) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 17 01:17:44 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-58c48fa2-f165-4cc2-9b83-936ab0427491 tempest-VolumesAssistedSnapshotsTest-244184502 tempest-VolumesAssistedSnapshotsTest-244184502-project-member] Got 1 possible topologies {{(pid=75226) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 17 01:17:44 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-58c48fa2-f165-4cc2-9b83-936ab0427491 tempest-VolumesAssistedSnapshotsTest-244184502 tempest-VolumesAssistedSnapshotsTest-244184502-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 17 01:17:44 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-58c48fa2-f165-4cc2-9b83-936ab0427491 tempest-VolumesAssistedSnapshotsTest-244184502 tempest-VolumesAssistedSnapshotsTest-244184502-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 17 01:17:44 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-58c48fa2-f165-4cc2-9b83-936ab0427491 tempest-VolumesAssistedSnapshotsTest-244184502 tempest-VolumesAssistedSnapshotsTest-244184502-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:17:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-570930396',display_name='tempest-VolumesAssistedSnapshotsTest-server-570930396',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-570930396',id=8,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJlfqV6RKTcGPsTVJ/7zZdekCYJssU5KvEtDm7p/yfUDtE3w49cLW1kEDdi+lHiyKVwB4aKUI8Mr44DzIxpjzLd8+iuQMcBuHn67m90G/oq+hLDEoNSv0U7784Ke8OOWlQ==',key_name='tempest-keypair-36891835',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a26a1467375947e9b71d9a2c61127e2b',ramdisk_id='',reservation_id='r-ghx0jkmy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-244184502',owner_user_name='tempest-VolumesAssistedSnapshotsTest-244184502-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T01:17:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='95cb1198a0c24bc6acf389d90595ab5a',uuid=1c505f8d-09e0-41bc-ba3a-89bde1646613,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6c56f715-bdcb-4a40-b922-3081a6457c31", "address": "fa:16:3e:63:16:60", "network": {"id": "d3de5b6b-3c29-4aeb-b4ec-59dca1237cb5", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1649442166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a26a1467375947e9b71d9a2c61127e2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c56f715-bd", "ovs_interfaceid": "6c56f715-bdcb-4a40-b922-3081a6457c31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75226) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 01:17:44 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-58c48fa2-f165-4cc2-9b83-936ab0427491 tempest-VolumesAssistedSnapshotsTest-244184502 tempest-VolumesAssistedSnapshotsTest-244184502-project-member] Converting VIF {"id": "6c56f715-bdcb-4a40-b922-3081a6457c31", "address": "fa:16:3e:63:16:60", "network": {"id": "d3de5b6b-3c29-4aeb-b4ec-59dca1237cb5", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1649442166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a26a1467375947e9b71d9a2c61127e2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c56f715-bd", "ovs_interfaceid": "6c56f715-bdcb-4a40-b922-3081a6457c31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:17:44 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-58c48fa2-f165-4cc2-9b83-936ab0427491 tempest-VolumesAssistedSnapshotsTest-244184502 tempest-VolumesAssistedSnapshotsTest-244184502-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:16:60,bridge_name='br-int',has_traffic_filtering=True,id=6c56f715-bdcb-4a40-b922-3081a6457c31,network=Network(d3de5b6b-3c29-4aeb-b4ec-59dca1237cb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c56f715-bd') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:17:44 user nova-compute[75226]: DEBUG nova.objects.instance [None req-58c48fa2-f165-4cc2-9b83-936ab0427491 tempest-VolumesAssistedSnapshotsTest-244184502 tempest-VolumesAssistedSnapshotsTest-244184502-project-member] Lazy-loading 'pci_devices' on Instance uuid 1c505f8d-09e0-41bc-ba3a-89bde1646613 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:17:44 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-58c48fa2-f165-4cc2-9b83-936ab0427491 tempest-VolumesAssistedSnapshotsTest-244184502 tempest-VolumesAssistedSnapshotsTest-244184502-project-member] [instance: 1c505f8d-09e0-41bc-ba3a-89bde1646613] End _get_guest_xml xml=<domain type="kvm">
Nov 17 01:17:44 user nova-compute[75226]:   <uuid>1c505f8d-09e0-41bc-ba3a-89bde1646613</uuid>
Nov 17 01:17:44 user nova-compute[75226]:   <name>instance-00000008</name>
Nov 17 01:17:44 user nova-compute[75226]:   <memory>524288</memory>
Nov 17 01:17:44 user nova-compute[75226]:   <vcpu>1</vcpu>
Nov 17 01:17:44 user nova-compute[75226]:   <metadata>
Nov 17 01:17:44 user nova-compute[75226]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 17 01:17:44 user nova-compute[75226]:       <nova:package version="0.0.0"/>
Nov 17 01:17:44 user nova-compute[75226]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-570930396</nova:name>
Nov 17 01:17:44 user nova-compute[75226]:       <nova:creationTime>2023-11-17 01:17:44</nova:creationTime>
Nov 17 01:17:44 user nova-compute[75226]:       <nova:flavor name="m1.tiny">
Nov 17 01:17:44 user nova-compute[75226]:         <nova:memory>512</nova:memory>
Nov 17 01:17:44 user nova-compute[75226]:         <nova:disk>1</nova:disk>
Nov 17 01:17:44 user nova-compute[75226]:         <nova:swap>0</nova:swap>
Nov 17 01:17:44 user nova-compute[75226]:         <nova:ephemeral>0</nova:ephemeral>
Nov 17 01:17:44 user nova-compute[75226]:         <nova:vcpus>1</nova:vcpus>
Nov 17 01:17:44 user nova-compute[75226]:       </nova:flavor>
Nov 17 01:17:44 user nova-compute[75226]:       <nova:owner>
Nov 17 01:17:44 user nova-compute[75226]:         <nova:user uuid="95cb1198a0c24bc6acf389d90595ab5a">tempest-VolumesAssistedSnapshotsTest-244184502-project-member</nova:user>
Nov 17 01:17:44 user nova-compute[75226]:         <nova:project uuid="a26a1467375947e9b71d9a2c61127e2b">tempest-VolumesAssistedSnapshotsTest-244184502</nova:project>
Nov 17 01:17:44 user nova-compute[75226]:       </nova:owner>
Nov 17 01:17:44 user nova-compute[75226]:       <nova:root type="image" uuid="0b369aea-6f3f-4690-9f01-229b90ab6310"/>
Nov 17 01:17:44 user nova-compute[75226]:       <nova:ports>
Nov 17 01:17:44 user nova-compute[75226]:         <nova:port uuid="6c56f715-bdcb-4a40-b922-3081a6457c31">
Nov 17 01:17:44 user nova-compute[75226]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 17 01:17:44 user nova-compute[75226]:         </nova:port>
Nov 17 01:17:44 user nova-compute[75226]:       </nova:ports>
Nov 17 01:17:44 user nova-compute[75226]:     </nova:instance>
Nov 17 01:17:44 user nova-compute[75226]:   </metadata>
Nov 17 01:17:44 user nova-compute[75226]:   <sysinfo type="smbios">
Nov 17 01:17:44 user nova-compute[75226]:     <system>
Nov 17 01:17:44 user nova-compute[75226]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 17 01:17:44 user nova-compute[75226]:       <entry name="product">OpenStack Nova</entry>
Nov 17 01:17:44 user nova-compute[75226]:       <entry name="version">0.0.0</entry>
Nov 17 01:17:44 user nova-compute[75226]:       <entry name="serial">1c505f8d-09e0-41bc-ba3a-89bde1646613</entry>
Nov 17 01:17:44 user nova-compute[75226]:       <entry name="uuid">1c505f8d-09e0-41bc-ba3a-89bde1646613</entry>
Nov 17 01:17:44 user nova-compute[75226]:       <entry name="family">Virtual Machine</entry>
Nov 17 01:17:44 user nova-compute[75226]:     </system>
Nov 17 01:17:44 user nova-compute[75226]:   </sysinfo>
Nov 17 01:17:44 user nova-compute[75226]:   <os>
Nov 17 01:17:44 user nova-compute[75226]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 17 01:17:44 user nova-compute[75226]:     <boot dev="hd"/>
Nov 17 01:17:44 user nova-compute[75226]:     <smbios mode="sysinfo"/>
Nov 17 01:17:44 user nova-compute[75226]:   </os>
Nov 17 01:17:44 user nova-compute[75226]:   <features>
Nov 17 01:17:44 user nova-compute[75226]:     <acpi/>
Nov 17 01:17:44 user nova-compute[75226]:     <apic/>
Nov 17 01:17:44 user nova-compute[75226]:     <vmcoreinfo/>
Nov 17 01:17:44 user nova-compute[75226]:   </features>
Nov 17 01:17:44 user nova-compute[75226]:   <clock offset="utc">
Nov 17 01:17:44 user nova-compute[75226]:     <timer name="pit" tickpolicy="delay"/>
Nov 17 01:17:44 user nova-compute[75226]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 17 01:17:44 user nova-compute[75226]:     <timer name="hpet" present="no"/>
Nov 17 01:17:44 user nova-compute[75226]:   </clock>
Nov 17 01:17:44 user nova-compute[75226]:   <cpu mode="custom" match="exact">
Nov 17 01:17:44 user nova-compute[75226]:     <model>Nehalem</model>
Nov 17 01:17:44 user nova-compute[75226]:     <topology sockets="1" cores="1" threads="1"/>
Nov 17 01:17:44 user nova-compute[75226]:   </cpu>
Nov 17 01:17:44 user nova-compute[75226]:   <devices>
Nov 17 01:17:44 user nova-compute[75226]:     <disk type="file" device="disk">
Nov 17 01:17:44 user nova-compute[75226]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 17 01:17:44 user nova-compute[75226]:       <source file="/opt/stack/data/nova/instances/1c505f8d-09e0-41bc-ba3a-89bde1646613/disk"/>
Nov 17 01:17:44 user nova-compute[75226]:       <target dev="vda" bus="virtio"/>
Nov 17 01:17:44 user nova-compute[75226]:     </disk>
Nov 17 01:17:44 user nova-compute[75226]:     <interface type="ethernet">
Nov 17 01:17:44 user nova-compute[75226]:       <mac address="fa:16:3e:63:16:60"/>
Nov 17 01:17:44 user nova-compute[75226]:       <model type="virtio"/>
Nov 17 01:17:44 user nova-compute[75226]:       <mtu size="1442"/>
Nov 17 01:17:44 user nova-compute[75226]:       <target dev="tap6c56f715-bd"/>
Nov 17 01:17:44 user nova-compute[75226]:     </interface>
Nov 17 01:17:44 user nova-compute[75226]:     <serial type="pty">
Nov 17 01:17:44 user nova-compute[75226]:       <log file="/opt/stack/data/nova/instances/1c505f8d-09e0-41bc-ba3a-89bde1646613/console.log" append="off"/>
Nov 17 01:17:44 user nova-compute[75226]:     </serial>
Nov 17 01:17:44 user nova-compute[75226]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 17 01:17:44 user nova-compute[75226]:     <video>
Nov 17 01:17:44 user nova-compute[75226]:       <model type="virtio"/>
Nov 17 01:17:44 user nova-compute[75226]:     </video>
Nov 17 01:17:44 user nova-compute[75226]:     <rng model="virtio">
Nov 17 01:17:44 user nova-compute[75226]:       <backend model="random">/dev/urandom</backend>
Nov 17 01:17:44 user nova-compute[75226]:     </rng>
Nov 17 01:17:44 user nova-compute[75226]:     <controller type="usb" index="0" model="none"/>
Nov 17 01:17:44 user nova-compute[75226]:     <memballoon model="virtio">
Nov 17 01:17:44 user nova-compute[75226]:       <stats period="10"/>
Nov 17 01:17:44 user nova-compute[75226]:     </memballoon>
Nov 17 01:17:44 user nova-compute[75226]:   </devices>
Nov 17 01:17:44 user nova-compute[75226]: </domain>
Nov 17 01:17:44 user nova-compute[75226]:  {{(pid=75226) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 17 01:17:44 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-58c48fa2-f165-4cc2-9b83-936ab0427491 tempest-VolumesAssistedSnapshotsTest-244184502 tempest-VolumesAssistedSnapshotsTest-244184502-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:17:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-570930396',display_name='tempest-VolumesAssistedSnapshotsTest-server-570930396',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-570930396',id=8,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJlfqV6RKTcGPsTVJ/7zZdekCYJssU5KvEtDm7p/yfUDtE3w49cLW1kEDdi+lHiyKVwB4aKUI8Mr44DzIxpjzLd8+iuQMcBuHn67m90G/oq+hLDEoNSv0U7784Ke8OOWlQ==',key_name='tempest-keypair-36891835',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a26a1467375947e9b71d9a2c61127e2b',ramdisk_id='',reservation_id='r-ghx0jkmy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-244184502',owner_user_name='tempest-VolumesAssistedSnapshotsTest-244184502-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T01:17:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='95cb1198a0c24bc6acf389d90595ab5a',uuid=1c505f8d-09e0-41bc-ba3a-89bde1646613,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6c56f715-bdcb-4a40-b922-3081a6457c31", "address": "fa:16:3e:63:16:60", "network": {"id": "d3de5b6b-3c29-4aeb-b4ec-59dca1237cb5", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1649442166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a26a1467375947e9b71d9a2c61127e2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c56f715-bd", "ovs_interfaceid": "6c56f715-bdcb-4a40-b922-3081a6457c31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 17 01:17:44 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-58c48fa2-f165-4cc2-9b83-936ab0427491 tempest-VolumesAssistedSnapshotsTest-244184502 tempest-VolumesAssistedSnapshotsTest-244184502-project-member] Converting VIF {"id": "6c56f715-bdcb-4a40-b922-3081a6457c31", "address": "fa:16:3e:63:16:60", "network": {"id": "d3de5b6b-3c29-4aeb-b4ec-59dca1237cb5", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1649442166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a26a1467375947e9b71d9a2c61127e2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c56f715-bd", "ovs_interfaceid": "6c56f715-bdcb-4a40-b922-3081a6457c31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:17:44 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-58c48fa2-f165-4cc2-9b83-936ab0427491 tempest-VolumesAssistedSnapshotsTest-244184502 tempest-VolumesAssistedSnapshotsTest-244184502-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:16:60,bridge_name='br-int',has_traffic_filtering=True,id=6c56f715-bdcb-4a40-b922-3081a6457c31,network=Network(d3de5b6b-3c29-4aeb-b4ec-59dca1237cb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c56f715-bd') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:17:44 user nova-compute[75226]: DEBUG os_vif [None req-58c48fa2-f165-4cc2-9b83-936ab0427491 tempest-VolumesAssistedSnapshotsTest-244184502 tempest-VolumesAssistedSnapshotsTest-244184502-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:16:60,bridge_name='br-int',has_traffic_filtering=True,id=6c56f715-bdcb-4a40-b922-3081a6457c31,network=Network(d3de5b6b-3c29-4aeb-b4ec-59dca1237cb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c56f715-bd') {{(pid=75226) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 17 01:17:44 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:17:44 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:17:44 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 17 01:17:44 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:17:44 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ca83402c-6f19-5e26-8bd9-7c88e06cde97', '_type': 'linux-noop'}}, row=False) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:17:44 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:17:44 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:17:44 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:17:44 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6c56f715-bd, may_exist=True, interface_attrs={}) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:17:44 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6c56f715-bd, col_values=(('qos', UUID('390abc60-c324-4820-aec4-a17a304a6f00')),), if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:17:44 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6c56f715-bd, col_values=(('external_ids', {'iface-id': '6c56f715-bdcb-4a40-b922-3081a6457c31', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:63:16:60', 'vm-uuid': '1c505f8d-09e0-41bc-ba3a-89bde1646613'}),), if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:17:44 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:17:44 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:17:44 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:17:44 user nova-compute[75226]: INFO os_vif [None req-58c48fa2-f165-4cc2-9b83-936ab0427491 tempest-VolumesAssistedSnapshotsTest-244184502 tempest-VolumesAssistedSnapshotsTest-244184502-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:16:60,bridge_name='br-int',has_traffic_filtering=True,id=6c56f715-bdcb-4a40-b922-3081a6457c31,network=Network(d3de5b6b-3c29-4aeb-b4ec-59dca1237cb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c56f715-bd')
Nov 17 01:17:44 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-58c48fa2-f165-4cc2-9b83-936ab0427491 tempest-VolumesAssistedSnapshotsTest-244184502 tempest-VolumesAssistedSnapshotsTest-244184502-project-member] No BDM found with device name vda, not building metadata. {{(pid=75226) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 01:17:44 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-58c48fa2-f165-4cc2-9b83-936ab0427491 tempest-VolumesAssistedSnapshotsTest-244184502 tempest-VolumesAssistedSnapshotsTest-244184502-project-member] No VIF found with MAC fa:16:3e:63:16:60, not building metadata {{(pid=75226) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 01:17:44 user nova-compute[75226]: DEBUG nova.network.neutron [None req-46c2f725-5e40-4a05-8748-c94c869b1fe9 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] [instance: 262eb845-eebe-4ffb-bc49-dcaca53ad7b8] Instance cache missing network info. {{(pid=75226) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 17 01:17:45 user nova-compute[75226]: DEBUG nova.compute.manager [req-73bd7fce-979b-4b45-a653-75924cc78d3c req-cbd4bdac-67d8-43bd-b609-dd64ade016ff service nova] [instance: 75b1cabe-ba15-4851-9140-5949afc33005] Received event network-vif-plugged-8e47eaef-6e73-4c79-973d-31f6481368be {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:17:45 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-73bd7fce-979b-4b45-a653-75924cc78d3c req-cbd4bdac-67d8-43bd-b609-dd64ade016ff service nova] Acquiring lock "75b1cabe-ba15-4851-9140-5949afc33005-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:17:45 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-73bd7fce-979b-4b45-a653-75924cc78d3c req-cbd4bdac-67d8-43bd-b609-dd64ade016ff service nova] Lock "75b1cabe-ba15-4851-9140-5949afc33005-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:17:45 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-73bd7fce-979b-4b45-a653-75924cc78d3c req-cbd4bdac-67d8-43bd-b609-dd64ade016ff service nova] Lock "75b1cabe-ba15-4851-9140-5949afc33005-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:17:45 user nova-compute[75226]: DEBUG nova.compute.manager [req-73bd7fce-979b-4b45-a653-75924cc78d3c req-cbd4bdac-67d8-43bd-b609-dd64ade016ff service nova] [instance: 75b1cabe-ba15-4851-9140-5949afc33005] No waiting events found dispatching network-vif-plugged-8e47eaef-6e73-4c79-973d-31f6481368be {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:17:45 user nova-compute[75226]: WARNING nova.compute.manager [req-73bd7fce-979b-4b45-a653-75924cc78d3c req-cbd4bdac-67d8-43bd-b609-dd64ade016ff service nova] [instance: 75b1cabe-ba15-4851-9140-5949afc33005] Received unexpected event network-vif-plugged-8e47eaef-6e73-4c79-973d-31f6481368be for instance with vm_state active and task_state None.
Nov 17 01:17:45 user nova-compute[75226]: DEBUG nova.compute.manager [req-73bd7fce-979b-4b45-a653-75924cc78d3c req-cbd4bdac-67d8-43bd-b609-dd64ade016ff service nova] [instance: b054a557-dff6-49f8-9300-1307f8433567] Received event network-vif-plugged-9be521ab-d517-4746-b6b3-1e4930610165 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:17:45 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-73bd7fce-979b-4b45-a653-75924cc78d3c req-cbd4bdac-67d8-43bd-b609-dd64ade016ff service nova] Acquiring lock "b054a557-dff6-49f8-9300-1307f8433567-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:17:45 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-73bd7fce-979b-4b45-a653-75924cc78d3c req-cbd4bdac-67d8-43bd-b609-dd64ade016ff service nova] Lock "b054a557-dff6-49f8-9300-1307f8433567-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:17:45 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-73bd7fce-979b-4b45-a653-75924cc78d3c req-cbd4bdac-67d8-43bd-b609-dd64ade016ff service nova] Lock "b054a557-dff6-49f8-9300-1307f8433567-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:17:45 user nova-compute[75226]: DEBUG nova.compute.manager [req-73bd7fce-979b-4b45-a653-75924cc78d3c req-cbd4bdac-67d8-43bd-b609-dd64ade016ff service nova] [instance: b054a557-dff6-49f8-9300-1307f8433567] No waiting events found dispatching network-vif-plugged-9be521ab-d517-4746-b6b3-1e4930610165 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:17:45 user nova-compute[75226]: WARNING nova.compute.manager [req-73bd7fce-979b-4b45-a653-75924cc78d3c req-cbd4bdac-67d8-43bd-b609-dd64ade016ff service nova] [instance: b054a557-dff6-49f8-9300-1307f8433567] Received unexpected event network-vif-plugged-9be521ab-d517-4746-b6b3-1e4930610165 for instance with vm_state building and task_state spawning.
Nov 17 01:17:45 user nova-compute[75226]: DEBUG nova.compute.manager [req-73bd7fce-979b-4b45-a653-75924cc78d3c req-cbd4bdac-67d8-43bd-b609-dd64ade016ff service nova] [instance: b054a557-dff6-49f8-9300-1307f8433567] Received event network-vif-plugged-9be521ab-d517-4746-b6b3-1e4930610165 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:17:45 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-73bd7fce-979b-4b45-a653-75924cc78d3c req-cbd4bdac-67d8-43bd-b609-dd64ade016ff service nova] Acquiring lock "b054a557-dff6-49f8-9300-1307f8433567-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:17:45 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-73bd7fce-979b-4b45-a653-75924cc78d3c req-cbd4bdac-67d8-43bd-b609-dd64ade016ff service nova] Lock "b054a557-dff6-49f8-9300-1307f8433567-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:17:45 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-73bd7fce-979b-4b45-a653-75924cc78d3c req-cbd4bdac-67d8-43bd-b609-dd64ade016ff service nova] Lock "b054a557-dff6-49f8-9300-1307f8433567-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:17:45 user nova-compute[75226]: DEBUG nova.compute.manager [req-73bd7fce-979b-4b45-a653-75924cc78d3c req-cbd4bdac-67d8-43bd-b609-dd64ade016ff service nova] [instance: b054a557-dff6-49f8-9300-1307f8433567] No waiting events found dispatching network-vif-plugged-9be521ab-d517-4746-b6b3-1e4930610165 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:17:45 user nova-compute[75226]: WARNING nova.compute.manager [req-73bd7fce-979b-4b45-a653-75924cc78d3c req-cbd4bdac-67d8-43bd-b609-dd64ade016ff service nova] [instance: b054a557-dff6-49f8-9300-1307f8433567] Received unexpected event network-vif-plugged-9be521ab-d517-4746-b6b3-1e4930610165 for instance with vm_state building and task_state spawning.
Nov 17 01:17:45 user nova-compute[75226]: DEBUG nova.compute.manager [None req-f18e0a3b-5f90-438a-9720-c142fe497569 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] [instance: b054a557-dff6-49f8-9300-1307f8433567] Instance event wait completed in 0 seconds for  {{(pid=75226) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 17 01:17:45 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-f18e0a3b-5f90-438a-9720-c142fe497569 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] [instance: b054a557-dff6-49f8-9300-1307f8433567] Guest created on hypervisor {{(pid=75226) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 17 01:17:45 user nova-compute[75226]: INFO nova.virt.libvirt.driver [-] [instance: b054a557-dff6-49f8-9300-1307f8433567] Instance spawned successfully.
Nov 17 01:17:45 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-f18e0a3b-5f90-438a-9720-c142fe497569 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] [instance: b054a557-dff6-49f8-9300-1307f8433567] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 17 01:17:45 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-f18e0a3b-5f90-438a-9720-c142fe497569 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] [instance: b054a557-dff6-49f8-9300-1307f8433567] Found default for hw_cdrom_bus of ide {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:17:45 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-f18e0a3b-5f90-438a-9720-c142fe497569 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] [instance: b054a557-dff6-49f8-9300-1307f8433567] Found default for hw_disk_bus of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:17:45 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-f18e0a3b-5f90-438a-9720-c142fe497569 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] [instance: b054a557-dff6-49f8-9300-1307f8433567] Found default for hw_input_bus of None {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:17:45 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-f18e0a3b-5f90-438a-9720-c142fe497569 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] [instance: b054a557-dff6-49f8-9300-1307f8433567] Found default for hw_pointer_model of None {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:17:45 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-f18e0a3b-5f90-438a-9720-c142fe497569 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] [instance: b054a557-dff6-49f8-9300-1307f8433567] Found default for hw_video_model of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:17:45 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-f18e0a3b-5f90-438a-9720-c142fe497569 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] [instance: b054a557-dff6-49f8-9300-1307f8433567] Found default for hw_vif_model of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:17:45 user nova-compute[75226]: DEBUG nova.network.neutron [None req-46c2f725-5e40-4a05-8748-c94c869b1fe9 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] [instance: 262eb845-eebe-4ffb-bc49-dcaca53ad7b8] Updating instance_info_cache with network_info: [{"id": "ca3803cf-fc7f-4233-8afa-1806c73156be", "address": "fa:16:3e:d9:19:6e", "network": {"id": "432afb25-848f-4ef8-8436-11db949783e6", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1854406043-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25ffeaafcdca494eb7550cec5b100051", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca3803cf-fc", "ovs_interfaceid": "ca3803cf-fc7f-4233-8afa-1806c73156be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:17:45 user nova-compute[75226]: DEBUG nova.network.neutron [req-c0c98f20-66cd-4d27-bca5-42605798aa34 req-aa486f0c-35f7-4e4c-b20a-23e75740c975 service nova] [instance: 1c505f8d-09e0-41bc-ba3a-89bde1646613] Updated VIF entry in instance network info cache for port 6c56f715-bdcb-4a40-b922-3081a6457c31. {{(pid=75226) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 01:17:45 user nova-compute[75226]: DEBUG nova.network.neutron [req-c0c98f20-66cd-4d27-bca5-42605798aa34 req-aa486f0c-35f7-4e4c-b20a-23e75740c975 service nova] [instance: 1c505f8d-09e0-41bc-ba3a-89bde1646613] Updating instance_info_cache with network_info: [{"id": "6c56f715-bdcb-4a40-b922-3081a6457c31", "address": "fa:16:3e:63:16:60", "network": {"id": "d3de5b6b-3c29-4aeb-b4ec-59dca1237cb5", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1649442166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a26a1467375947e9b71d9a2c61127e2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c56f715-bd", "ovs_interfaceid": "6c56f715-bdcb-4a40-b922-3081a6457c31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:17:45 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-46c2f725-5e40-4a05-8748-c94c869b1fe9 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] Releasing lock "refresh_cache-262eb845-eebe-4ffb-bc49-dcaca53ad7b8" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:17:45 user nova-compute[75226]: DEBUG nova.compute.manager [None req-46c2f725-5e40-4a05-8748-c94c869b1fe9 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] [instance: 262eb845-eebe-4ffb-bc49-dcaca53ad7b8] Instance network_info: |[{"id": "ca3803cf-fc7f-4233-8afa-1806c73156be", "address": "fa:16:3e:d9:19:6e", "network": {"id": "432afb25-848f-4ef8-8436-11db949783e6", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1854406043-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25ffeaafcdca494eb7550cec5b100051", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca3803cf-fc", "ovs_interfaceid": "ca3803cf-fc7f-4233-8afa-1806c73156be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75226) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 17 01:17:45 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-c0c98f20-66cd-4d27-bca5-42605798aa34 req-aa486f0c-35f7-4e4c-b20a-23e75740c975 service nova] Releasing lock "refresh_cache-1c505f8d-09e0-41bc-ba3a-89bde1646613" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:17:45 user nova-compute[75226]: INFO nova.compute.manager [None req-f18e0a3b-5f90-438a-9720-c142fe497569 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] [instance: b054a557-dff6-49f8-9300-1307f8433567] Took 14.30 seconds to spawn the instance on the hypervisor.
Nov 17 01:17:45 user nova-compute[75226]: DEBUG nova.compute.manager [None req-f18e0a3b-5f90-438a-9720-c142fe497569 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] [instance: b054a557-dff6-49f8-9300-1307f8433567] Checking state {{(pid=75226) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 01:17:45 user nova-compute[75226]: DEBUG nova.compute.manager [None req-bf96017e-d4d1-42b2-b4a2-1c2e4f1f75f3 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] [instance: e7830f7a-80f1-4c2f-bd64-363e6dd9114a] Instance event wait completed in 0 seconds for  {{(pid=75226) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 17 01:17:45 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-bf96017e-d4d1-42b2-b4a2-1c2e4f1f75f3 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] [instance: e7830f7a-80f1-4c2f-bd64-363e6dd9114a] Guest created on hypervisor {{(pid=75226) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 17 01:17:45 user nova-compute[75226]: INFO nova.virt.libvirt.driver [-] [instance: e7830f7a-80f1-4c2f-bd64-363e6dd9114a] Instance spawned successfully.
Nov 17 01:17:45 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-bf96017e-d4d1-42b2-b4a2-1c2e4f1f75f3 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] [instance: e7830f7a-80f1-4c2f-bd64-363e6dd9114a] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 17 01:17:45 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-bf96017e-d4d1-42b2-b4a2-1c2e4f1f75f3 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] [instance: e7830f7a-80f1-4c2f-bd64-363e6dd9114a] Found default for hw_input_bus of None {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:17:45 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-bf96017e-d4d1-42b2-b4a2-1c2e4f1f75f3 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] [instance: e7830f7a-80f1-4c2f-bd64-363e6dd9114a] Found default for hw_pointer_model of None {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:17:45 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-bf96017e-d4d1-42b2-b4a2-1c2e4f1f75f3 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] [instance: e7830f7a-80f1-4c2f-bd64-363e6dd9114a] Found default for hw_video_model of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:17:45 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-bf96017e-d4d1-42b2-b4a2-1c2e4f1f75f3 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] [instance: e7830f7a-80f1-4c2f-bd64-363e6dd9114a] Found default for hw_vif_model of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:17:45 user nova-compute[75226]: INFO nova.compute.manager [None req-f18e0a3b-5f90-438a-9720-c142fe497569 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] [instance: b054a557-dff6-49f8-9300-1307f8433567] Took 15.58 seconds to build instance.
Nov 17 01:17:45 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-f18e0a3b-5f90-438a-9720-c142fe497569 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] Lock "b054a557-dff6-49f8-9300-1307f8433567" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.729s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:17:45 user nova-compute[75226]: INFO nova.compute.manager [None req-bf96017e-d4d1-42b2-b4a2-1c2e4f1f75f3 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] [instance: e7830f7a-80f1-4c2f-bd64-363e6dd9114a] Took 12.96 seconds to spawn the instance on the hypervisor.
Nov 17 01:17:45 user nova-compute[75226]: DEBUG nova.compute.manager [None req-bf96017e-d4d1-42b2-b4a2-1c2e4f1f75f3 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] [instance: e7830f7a-80f1-4c2f-bd64-363e6dd9114a] Checking state {{(pid=75226) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 01:17:45 user nova-compute[75226]: INFO nova.compute.manager [None req-bf96017e-d4d1-42b2-b4a2-1c2e4f1f75f3 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] [instance: e7830f7a-80f1-4c2f-bd64-363e6dd9114a] Took 14.49 seconds to build instance.
Nov 17 01:17:45 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-bf96017e-d4d1-42b2-b4a2-1c2e4f1f75f3 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] Lock "e7830f7a-80f1-4c2f-bd64-363e6dd9114a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.655s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:17:46 user nova-compute[75226]: DEBUG nova.compute.manager [req-cef56368-fef4-468e-a33c-a93c274e965a req-2288cd56-e48f-41fb-b75e-b87e456c29f5 service nova] [instance: e7830f7a-80f1-4c2f-bd64-363e6dd9114a] Received event network-vif-plugged-b273b468-b80c-435e-bae6-9cbbcf617110 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:17:46 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-cef56368-fef4-468e-a33c-a93c274e965a req-2288cd56-e48f-41fb-b75e-b87e456c29f5 service nova] Acquiring lock "e7830f7a-80f1-4c2f-bd64-363e6dd9114a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:17:46 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-cef56368-fef4-468e-a33c-a93c274e965a req-2288cd56-e48f-41fb-b75e-b87e456c29f5 service nova] Lock "e7830f7a-80f1-4c2f-bd64-363e6dd9114a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:17:46 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-cef56368-fef4-468e-a33c-a93c274e965a req-2288cd56-e48f-41fb-b75e-b87e456c29f5 service nova] Lock "e7830f7a-80f1-4c2f-bd64-363e6dd9114a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:17:46 user nova-compute[75226]: DEBUG nova.compute.manager [req-cef56368-fef4-468e-a33c-a93c274e965a req-2288cd56-e48f-41fb-b75e-b87e456c29f5 service nova] [instance: e7830f7a-80f1-4c2f-bd64-363e6dd9114a] No waiting events found dispatching network-vif-plugged-b273b468-b80c-435e-bae6-9cbbcf617110 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:17:46 user nova-compute[75226]: WARNING nova.compute.manager [req-cef56368-fef4-468e-a33c-a93c274e965a req-2288cd56-e48f-41fb-b75e-b87e456c29f5 service nova] [instance: e7830f7a-80f1-4c2f-bd64-363e6dd9114a] Received unexpected event network-vif-plugged-b273b468-b80c-435e-bae6-9cbbcf617110 for instance with vm_state building and task_state spawning.
Nov 17 01:17:46 user nova-compute[75226]: DEBUG nova.compute.manager [req-cef56368-fef4-468e-a33c-a93c274e965a req-2288cd56-e48f-41fb-b75e-b87e456c29f5 service nova] [instance: 262eb845-eebe-4ffb-bc49-dcaca53ad7b8] Received event network-changed-ca3803cf-fc7f-4233-8afa-1806c73156be {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:17:46 user nova-compute[75226]: DEBUG nova.compute.manager [req-cef56368-fef4-468e-a33c-a93c274e965a req-2288cd56-e48f-41fb-b75e-b87e456c29f5 service nova] [instance: 262eb845-eebe-4ffb-bc49-dcaca53ad7b8] Refreshing instance network info cache due to event network-changed-ca3803cf-fc7f-4233-8afa-1806c73156be. {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 01:17:46 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-cef56368-fef4-468e-a33c-a93c274e965a req-2288cd56-e48f-41fb-b75e-b87e456c29f5 service nova] Acquiring lock "refresh_cache-262eb845-eebe-4ffb-bc49-dcaca53ad7b8" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:17:46 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-cef56368-fef4-468e-a33c-a93c274e965a req-2288cd56-e48f-41fb-b75e-b87e456c29f5 service nova] Acquired lock "refresh_cache-262eb845-eebe-4ffb-bc49-dcaca53ad7b8" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:17:46 user nova-compute[75226]: DEBUG nova.network.neutron [req-cef56368-fef4-468e-a33c-a93c274e965a req-2288cd56-e48f-41fb-b75e-b87e456c29f5 service nova] [instance: 262eb845-eebe-4ffb-bc49-dcaca53ad7b8] Refreshing network info cache for port ca3803cf-fc7f-4233-8afa-1806c73156be {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 01:17:46 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:17:46 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:17:46 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:17:47 user nova-compute[75226]: DEBUG nova.network.neutron [req-cef56368-fef4-468e-a33c-a93c274e965a req-2288cd56-e48f-41fb-b75e-b87e456c29f5 service nova] [instance: 262eb845-eebe-4ffb-bc49-dcaca53ad7b8] Updated VIF entry in instance network info cache for port ca3803cf-fc7f-4233-8afa-1806c73156be. {{(pid=75226) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 01:17:47 user nova-compute[75226]: DEBUG nova.network.neutron [req-cef56368-fef4-468e-a33c-a93c274e965a req-2288cd56-e48f-41fb-b75e-b87e456c29f5 service nova] [instance: 262eb845-eebe-4ffb-bc49-dcaca53ad7b8] Updating instance_info_cache with network_info: [{"id": "ca3803cf-fc7f-4233-8afa-1806c73156be", "address": "fa:16:3e:d9:19:6e", "network": {"id": "432afb25-848f-4ef8-8436-11db949783e6", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1854406043-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25ffeaafcdca494eb7550cec5b100051", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca3803cf-fc", "ovs_interfaceid": "ca3803cf-fc7f-4233-8afa-1806c73156be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:17:47 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-cef56368-fef4-468e-a33c-a93c274e965a req-2288cd56-e48f-41fb-b75e-b87e456c29f5 service nova] Releasing lock "refresh_cache-262eb845-eebe-4ffb-bc49-dcaca53ad7b8" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:17:47 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:17:47 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:17:47 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:17:47 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:17:49 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:17:50 user nova-compute[75226]: DEBUG nova.compute.manager [req-71d86419-715b-42f7-94d0-f94fccc702a0 req-93163930-3d1e-479f-99e3-adf29081df01 service nova] [instance: ddfecefc-1e9b-4e6e-9995-855c8a061084] Received event network-vif-plugged-f9a7562b-de63-4374-b43b-18e3cb3af710 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:17:50 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-71d86419-715b-42f7-94d0-f94fccc702a0 req-93163930-3d1e-479f-99e3-adf29081df01 service nova] Acquiring lock "ddfecefc-1e9b-4e6e-9995-855c8a061084-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:17:50 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-71d86419-715b-42f7-94d0-f94fccc702a0 req-93163930-3d1e-479f-99e3-adf29081df01 service nova] Lock "ddfecefc-1e9b-4e6e-9995-855c8a061084-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:17:50 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-71d86419-715b-42f7-94d0-f94fccc702a0 req-93163930-3d1e-479f-99e3-adf29081df01 service nova] Lock "ddfecefc-1e9b-4e6e-9995-855c8a061084-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:17:50 user nova-compute[75226]: DEBUG nova.compute.manager [req-71d86419-715b-42f7-94d0-f94fccc702a0 req-93163930-3d1e-479f-99e3-adf29081df01 service nova] [instance: ddfecefc-1e9b-4e6e-9995-855c8a061084] No waiting events found dispatching network-vif-plugged-f9a7562b-de63-4374-b43b-18e3cb3af710 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:17:50 user nova-compute[75226]: WARNING nova.compute.manager [req-71d86419-715b-42f7-94d0-f94fccc702a0 req-93163930-3d1e-479f-99e3-adf29081df01 service nova] [instance: ddfecefc-1e9b-4e6e-9995-855c8a061084] Received unexpected event network-vif-plugged-f9a7562b-de63-4374-b43b-18e3cb3af710 for instance with vm_state active and task_state None.
Nov 17 01:17:50 user nova-compute[75226]: DEBUG nova.compute.manager [None req-58c48fa2-f165-4cc2-9b83-936ab0427491 tempest-VolumesAssistedSnapshotsTest-244184502 tempest-VolumesAssistedSnapshotsTest-244184502-project-member] [instance: 1c505f8d-09e0-41bc-ba3a-89bde1646613] Instance event wait completed in 0 seconds for  {{(pid=75226) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 17 01:17:50 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-58c48fa2-f165-4cc2-9b83-936ab0427491 tempest-VolumesAssistedSnapshotsTest-244184502 tempest-VolumesAssistedSnapshotsTest-244184502-project-member] [instance: 1c505f8d-09e0-41bc-ba3a-89bde1646613] Guest created on hypervisor {{(pid=75226) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 17 01:17:50 user nova-compute[75226]: INFO nova.virt.libvirt.driver [-] [instance: 1c505f8d-09e0-41bc-ba3a-89bde1646613] Instance spawned successfully.
Nov 17 01:17:50 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-58c48fa2-f165-4cc2-9b83-936ab0427491 tempest-VolumesAssistedSnapshotsTest-244184502 tempest-VolumesAssistedSnapshotsTest-244184502-project-member] [instance: 1c505f8d-09e0-41bc-ba3a-89bde1646613] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 17 01:17:50 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-58c48fa2-f165-4cc2-9b83-936ab0427491 tempest-VolumesAssistedSnapshotsTest-244184502 tempest-VolumesAssistedSnapshotsTest-244184502-project-member] [instance: 1c505f8d-09e0-41bc-ba3a-89bde1646613] Found default for hw_cdrom_bus of ide {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:17:50 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-58c48fa2-f165-4cc2-9b83-936ab0427491 tempest-VolumesAssistedSnapshotsTest-244184502 tempest-VolumesAssistedSnapshotsTest-244184502-project-member] [instance: 1c505f8d-09e0-41bc-ba3a-89bde1646613] Found default for hw_disk_bus of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:17:50 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-58c48fa2-f165-4cc2-9b83-936ab0427491 tempest-VolumesAssistedSnapshotsTest-244184502 tempest-VolumesAssistedSnapshotsTest-244184502-project-member] [instance: 1c505f8d-09e0-41bc-ba3a-89bde1646613] Found default for hw_input_bus of None {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:17:50 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-58c48fa2-f165-4cc2-9b83-936ab0427491 tempest-VolumesAssistedSnapshotsTest-244184502 tempest-VolumesAssistedSnapshotsTest-244184502-project-member] [instance: 1c505f8d-09e0-41bc-ba3a-89bde1646613] Found default for hw_pointer_model of None {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:17:50 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-58c48fa2-f165-4cc2-9b83-936ab0427491 tempest-VolumesAssistedSnapshotsTest-244184502 tempest-VolumesAssistedSnapshotsTest-244184502-project-member] [instance: 1c505f8d-09e0-41bc-ba3a-89bde1646613] Found default for hw_video_model of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:17:50 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-58c48fa2-f165-4cc2-9b83-936ab0427491 tempest-VolumesAssistedSnapshotsTest-244184502 tempest-VolumesAssistedSnapshotsTest-244184502-project-member] [instance: 1c505f8d-09e0-41bc-ba3a-89bde1646613] Found default for hw_vif_model of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:17:50 user nova-compute[75226]: INFO nova.compute.manager [None req-58c48fa2-f165-4cc2-9b83-936ab0427491 tempest-VolumesAssistedSnapshotsTest-244184502 tempest-VolumesAssistedSnapshotsTest-244184502-project-member] [instance: 1c505f8d-09e0-41bc-ba3a-89bde1646613] Took 9.66 seconds to spawn the instance on the hypervisor.
Nov 17 01:17:50 user nova-compute[75226]: DEBUG nova.compute.manager [None req-58c48fa2-f165-4cc2-9b83-936ab0427491 tempest-VolumesAssistedSnapshotsTest-244184502 tempest-VolumesAssistedSnapshotsTest-244184502-project-member] [instance: 1c505f8d-09e0-41bc-ba3a-89bde1646613] Checking state {{(pid=75226) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 01:17:50 user nova-compute[75226]: INFO nova.compute.manager [None req-58c48fa2-f165-4cc2-9b83-936ab0427491 tempest-VolumesAssistedSnapshotsTest-244184502 tempest-VolumesAssistedSnapshotsTest-244184502-project-member] [instance: 1c505f8d-09e0-41bc-ba3a-89bde1646613] Took 11.15 seconds to build instance.
Nov 17 01:17:50 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-58c48fa2-f165-4cc2-9b83-936ab0427491 tempest-VolumesAssistedSnapshotsTest-244184502 tempest-VolumesAssistedSnapshotsTest-244184502-project-member] Lock "1c505f8d-09e0-41bc-ba3a-89bde1646613" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.411s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:17:52 user nova-compute[75226]: DEBUG nova.compute.manager [req-03070675-3fda-4d84-a351-e9a08fe243d8 req-4f431709-348b-4a7f-ae28-78dacacde10d service nova] [instance: ddfecefc-1e9b-4e6e-9995-855c8a061084] Received event network-vif-plugged-f9a7562b-de63-4374-b43b-18e3cb3af710 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:17:52 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-03070675-3fda-4d84-a351-e9a08fe243d8 req-4f431709-348b-4a7f-ae28-78dacacde10d service nova] Acquiring lock "ddfecefc-1e9b-4e6e-9995-855c8a061084-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:17:52 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-03070675-3fda-4d84-a351-e9a08fe243d8 req-4f431709-348b-4a7f-ae28-78dacacde10d service nova] Lock "ddfecefc-1e9b-4e6e-9995-855c8a061084-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:17:52 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-03070675-3fda-4d84-a351-e9a08fe243d8 req-4f431709-348b-4a7f-ae28-78dacacde10d service nova] Lock "ddfecefc-1e9b-4e6e-9995-855c8a061084-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:17:52 user nova-compute[75226]: DEBUG nova.compute.manager [req-03070675-3fda-4d84-a351-e9a08fe243d8 req-4f431709-348b-4a7f-ae28-78dacacde10d service nova] [instance: ddfecefc-1e9b-4e6e-9995-855c8a061084] No waiting events found dispatching network-vif-plugged-f9a7562b-de63-4374-b43b-18e3cb3af710 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:17:52 user nova-compute[75226]: WARNING nova.compute.manager [req-03070675-3fda-4d84-a351-e9a08fe243d8 req-4f431709-348b-4a7f-ae28-78dacacde10d service nova] [instance: ddfecefc-1e9b-4e6e-9995-855c8a061084] Received unexpected event network-vif-plugged-f9a7562b-de63-4374-b43b-18e3cb3af710 for instance with vm_state active and task_state None.
Nov 17 01:17:52 user nova-compute[75226]: DEBUG nova.compute.manager [req-03070675-3fda-4d84-a351-e9a08fe243d8 req-4f431709-348b-4a7f-ae28-78dacacde10d service nova] [instance: 1c505f8d-09e0-41bc-ba3a-89bde1646613] Received event network-vif-plugged-6c56f715-bdcb-4a40-b922-3081a6457c31 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:17:52 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-03070675-3fda-4d84-a351-e9a08fe243d8 req-4f431709-348b-4a7f-ae28-78dacacde10d service nova] Acquiring lock "1c505f8d-09e0-41bc-ba3a-89bde1646613-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:17:52 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-03070675-3fda-4d84-a351-e9a08fe243d8 req-4f431709-348b-4a7f-ae28-78dacacde10d service nova] Lock "1c505f8d-09e0-41bc-ba3a-89bde1646613-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:17:52 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-03070675-3fda-4d84-a351-e9a08fe243d8 req-4f431709-348b-4a7f-ae28-78dacacde10d service nova] Lock "1c505f8d-09e0-41bc-ba3a-89bde1646613-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:17:52 user nova-compute[75226]: DEBUG nova.compute.manager [req-03070675-3fda-4d84-a351-e9a08fe243d8 req-4f431709-348b-4a7f-ae28-78dacacde10d service nova] [instance: 1c505f8d-09e0-41bc-ba3a-89bde1646613] No waiting events found dispatching network-vif-plugged-6c56f715-bdcb-4a40-b922-3081a6457c31 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:17:52 user nova-compute[75226]: WARNING nova.compute.manager [req-03070675-3fda-4d84-a351-e9a08fe243d8 req-4f431709-348b-4a7f-ae28-78dacacde10d service nova] [instance: 1c505f8d-09e0-41bc-ba3a-89bde1646613] Received unexpected event network-vif-plugged-6c56f715-bdcb-4a40-b922-3081a6457c31 for instance with vm_state active and task_state None.
Nov 17 01:17:52 user nova-compute[75226]: DEBUG nova.compute.manager [req-03070675-3fda-4d84-a351-e9a08fe243d8 req-4f431709-348b-4a7f-ae28-78dacacde10d service nova] [instance: 1c505f8d-09e0-41bc-ba3a-89bde1646613] Received event network-vif-plugged-6c56f715-bdcb-4a40-b922-3081a6457c31 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:17:52 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-03070675-3fda-4d84-a351-e9a08fe243d8 req-4f431709-348b-4a7f-ae28-78dacacde10d service nova] Acquiring lock "1c505f8d-09e0-41bc-ba3a-89bde1646613-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:17:52 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-03070675-3fda-4d84-a351-e9a08fe243d8 req-4f431709-348b-4a7f-ae28-78dacacde10d service nova] Lock "1c505f8d-09e0-41bc-ba3a-89bde1646613-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:17:52 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-03070675-3fda-4d84-a351-e9a08fe243d8 req-4f431709-348b-4a7f-ae28-78dacacde10d service nova] Lock "1c505f8d-09e0-41bc-ba3a-89bde1646613-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:17:52 user nova-compute[75226]: DEBUG nova.compute.manager [req-03070675-3fda-4d84-a351-e9a08fe243d8 req-4f431709-348b-4a7f-ae28-78dacacde10d service nova] [instance: 1c505f8d-09e0-41bc-ba3a-89bde1646613] No waiting events found dispatching network-vif-plugged-6c56f715-bdcb-4a40-b922-3081a6457c31 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:17:52 user nova-compute[75226]: WARNING nova.compute.manager [req-03070675-3fda-4d84-a351-e9a08fe243d8 req-4f431709-348b-4a7f-ae28-78dacacde10d service nova] [instance: 1c505f8d-09e0-41bc-ba3a-89bde1646613] Received unexpected event network-vif-plugged-6c56f715-bdcb-4a40-b922-3081a6457c31 for instance with vm_state active and task_state None.
Nov 17 01:17:52 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:17:52 user nova-compute[75226]: DEBUG nova.compute.manager [None req-46c2f725-5e40-4a05-8748-c94c869b1fe9 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] [instance: 262eb845-eebe-4ffb-bc49-dcaca53ad7b8] Start spawning the instance on the hypervisor. {{(pid=75226) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 17 01:17:52 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-46c2f725-5e40-4a05-8748-c94c869b1fe9 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] [instance: 262eb845-eebe-4ffb-bc49-dcaca53ad7b8] Creating instance directory {{(pid=75226) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 17 01:17:52 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-46c2f725-5e40-4a05-8748-c94c869b1fe9 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] [instance: 262eb845-eebe-4ffb-bc49-dcaca53ad7b8] Creating image(s)
Nov 17 01:17:52 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-46c2f725-5e40-4a05-8748-c94c869b1fe9 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] [instance: 262eb845-eebe-4ffb-bc49-dcaca53ad7b8] Did not create local disks {{(pid=75226) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 17 01:17:52 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-46c2f725-5e40-4a05-8748-c94c869b1fe9 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] [instance: 262eb845-eebe-4ffb-bc49-dcaca53ad7b8] Ensure instance console log exists: /opt/stack/data/nova/instances/262eb845-eebe-4ffb-bc49-dcaca53ad7b8/console.log {{(pid=75226) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 17 01:17:52 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-46c2f725-5e40-4a05-8748-c94c869b1fe9 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:17:52 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-46c2f725-5e40-4a05-8748-c94c869b1fe9 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:17:52 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-46c2f725-5e40-4a05-8748-c94c869b1fe9 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:17:52 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-46c2f725-5e40-4a05-8748-c94c869b1fe9 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] [instance: 262eb845-eebe-4ffb-bc49-dcaca53ad7b8] Start _get_guest_xml network_info=[{"id": "ca3803cf-fc7f-4233-8afa-1806c73156be", "address": "fa:16:3e:d9:19:6e", "network": {"id": "432afb25-848f-4ef8-8436-11db949783e6", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1854406043-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25ffeaafcdca494eb7550cec5b100051", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca3803cf-fc", "ovs_interfaceid": "ca3803cf-fc7f-4233-8afa-1806c73156be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iChyRSBt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '262eb845-eebe-4ffb-bc49-dcaca53ad7b8', 'attached_at': '', 'detached_at': '', 'volume_id': '2ca02b15-b2b8-4e45-9d87-54886c2568a2', 'serial': '2ca02b15-b2b8-4e45-9d87-54886c2568a2'}, 'attachment_id': '87e44c10-b1f1-4e08-895d-d038fcf349aa', 'device_type': 'disk', 'volume_type': None} {{(pid=75226) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 17 01:17:52 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-46c2f725-5e40-4a05-8748-c94c869b1fe9 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:17:52 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-46c2f725-5e40-4a05-8748-c94c869b1fe9 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:17:52 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-46c2f725-5e40-4a05-8748-c94c869b1fe9 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75226) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 17 01:17:52 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-46c2f725-5e40-4a05-8748-c94c869b1fe9 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] CPU controller missing on host. {{(pid=75226) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 17 01:17:52 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-46c2f725-5e40-4a05-8748-c94c869b1fe9 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75226) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 17 01:17:52 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-46c2f725-5e40-4a05-8748-c94c869b1fe9 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] CPU controller found on host. {{(pid=75226) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 17 01:17:52 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-46c2f725-5e40-4a05-8748-c94c869b1fe9 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75226) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 17 01:17:52 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-46c2f725-5e40-4a05-8748-c94c869b1fe9 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-17T01:13:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 17 01:17:52 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-46c2f725-5e40-4a05-8748-c94c869b1fe9 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] Flavor limits 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 17 01:17:52 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-46c2f725-5e40-4a05-8748-c94c869b1fe9 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] Image limits 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 17 01:17:52 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-46c2f725-5e40-4a05-8748-c94c869b1fe9 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] Flavor pref 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 17 01:17:52 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-46c2f725-5e40-4a05-8748-c94c869b1fe9 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] Image pref 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 17 01:17:52 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-46c2f725-5e40-4a05-8748-c94c869b1fe9 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 17 01:17:52 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-46c2f725-5e40-4a05-8748-c94c869b1fe9 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 17 01:17:52 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-46c2f725-5e40-4a05-8748-c94c869b1fe9 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75226) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 17 01:17:52 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-46c2f725-5e40-4a05-8748-c94c869b1fe9 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] Got 1 possible topologies {{(pid=75226) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 17 01:17:52 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-46c2f725-5e40-4a05-8748-c94c869b1fe9 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 17 01:17:52 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-46c2f725-5e40-4a05-8748-c94c869b1fe9 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 17 01:17:52 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-46c2f725-5e40-4a05-8748-c94c869b1fe9 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:17:52 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-46c2f725-5e40-4a05-8748-c94c869b1fe9 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:17:52 user nova-compute[75226]: DEBUG os_brick.initiator.connector [None req-46c2f725-5e40-4a05-8748-c94c869b1fe9 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] Factory for ISCSI on None {{(pid=75226) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Nov 17 01:17:52 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-46c2f725-5e40-4a05-8748-c94c869b1fe9 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.006s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:17:52 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46c2f725-5e40-4a05-8748-c94c869b1fe9 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] [instance: 262eb845-eebe-4ffb-bc49-dcaca53ad7b8] Calling os-brick to attach iSCSI Volume {{(pid=75226) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 17 01:17:52 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-46c2f725-5e40-4a05-8748-c94c869b1fe9 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc4cc36b490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iChyRSBt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:17:52 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-46c2f725-5e40-4a05-8748-c94c869b1fe9 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:17:52 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-46c2f725-5e40-4a05-8748-c94c869b1fe9 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:17:52 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-46c2f725-5e40-4a05-8748-c94c869b1fe9 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:17:52 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-46c2f725-5e40-4a05-8748-c94c869b1fe9 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:17:52 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-46c2f725-5e40-4a05-8748-c94c869b1fe9 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:17:52 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-46c2f725-5e40-4a05-8748-c94c869b1fe9 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.005s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:17:52 user nova-compute[75226]: INFO os_brick.initiator.connectors.iscsi [None req-46c2f725-5e40-4a05-8748-c94c869b1fe9 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 17 01:17:52 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2 -p 172.16.0.220:3260 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:17:52 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:17:52 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb1a10eb-e427-47db-8922-9954b46f9a08]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:17:52 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-46c2f725-5e40-4a05-8748-c94c869b1fe9 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 17 01:17:52 user nova-compute[75226]:  {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:17:52 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2 -p 172.16.0.220:3260 --interface default --op new {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:17:52 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:17:52 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e3c2a52-a255-4619-b097-b95be5174c76]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2] added\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:17:52 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-46c2f725-5e40-4a05-8748-c94c869b1fe9 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2] added
Nov 17 01:17:52 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:17:52 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:17:52 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:17:52 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[96734f05-bbd1-40f9-b855-e4bf1f261a0f]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:17:52 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-46c2f725-5e40-4a05-8748-c94c869b1fe9 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:17:52 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:17:52 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:17:52 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc04945e-985e-474d-8633-5900492b09c6]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:17:52 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-46c2f725-5e40-4a05-8748-c94c869b1fe9 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:17:52 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iChyRSBt {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:17:52 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iChyRSBt" returned: 0 in 0.023s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:17:52 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[23658160-21d3-4ab2-8695-f28bb7e028fa]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:17:52 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-46c2f725-5e40-4a05-8748-c94c869b1fe9 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iChyRSBt'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:17:52 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:17:53 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:17:53 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:17:53 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Cleaning up deleted instances {{(pid=75226) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 17 01:17:53 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.064s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:17:53 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c1ded73-a404-4edc-ac28-729d67928f33]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:17:53 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-46c2f725-5e40-4a05-8748-c94c869b1fe9 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:17:53 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:17:53 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:17:53 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4ac53bf-a40d-4b04-b497-d8110a65fd5c]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:17:53 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-46c2f725-5e40-4a05-8748-c94c869b1fe9 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 17 01:17:53 user nova-compute[75226]:  {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:17:53 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-46c2f725-5e40-4a05-8748-c94c869b1fe9 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 17 01:17:53 user nova-compute[75226]:  {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:17:53 user nova-compute[75226]: WARNING os_brick.initiator.connectors.iscsi [None req-46c2f725-5e40-4a05-8748-c94c869b1fe9 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 17 01:17:53 user nova-compute[75226]: 
Nov 17 01:17:53 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] There are 0 instances to clean {{(pid=75226) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 17 01:17:53 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2 -p 172.16.0.220:3260 --login {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:17:53 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:17:53 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75226) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 17 01:17:53 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:17:53 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2 -p 172.16.0.220:3260 --login" returned: 0 in 0.083s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:17:53 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[657cd7c4-5235-4b6c-8267-180e1866ca25]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:17:53 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-46c2f725-5e40-4a05-8748-c94c869b1fe9 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2, portal: 172.16.0.220,3260]
Nov 17 01:17:53 user nova-compute[75226]: Login to [iface: default, target: iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2, portal: 172.16.0.220,3260] successful.
Nov 17 01:17:53 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:17:53 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:17:53 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:17:53 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[4364f3ca-08e2-4060-9850-151ddfe92f97]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:17:53 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-46c2f725-5e40-4a05-8748-c94c869b1fe9 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:17:53 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:17:53 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:17:53 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bd9e787-536b-4300-b0f0-24bb74198be4]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:17:53 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-46c2f725-5e40-4a05-8748-c94c869b1fe9 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2 (non-flash)
Nov 17 01:17:53 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:17:53 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-46c2f725-5e40-4a05-8748-c94c869b1fe9 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2 (non-flash)
Nov 17 01:17:53 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:17:53 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-46c2f725-5e40-4a05-8748-c94c869b1fe9 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.439s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:17:53 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-46c2f725-5e40-4a05-8748-c94c869b1fe9 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] Connected to 172.16.0.220:3260 {{(pid=75226) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 17 01:17:53 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-46c2f725-5e40-4a05-8748-c94c869b1fe9 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=75226) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 17 01:17:53 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-46c2f725-5e40-4a05-8748-c94c869b1fe9 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75226) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 17 01:17:53 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:17:53 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.043s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:17:53 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[2db79499-a2f0-4a40-87cb-90ee0c2696f8]: (4, ('- - 0', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:17:53 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-46c2f725-5e40-4a05-8748-c94c869b1fe9 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75226) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 01:17:53 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-46c2f725-5e40-4a05-8748-c94c869b1fe9 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iChyRSBt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75226) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 17 01:17:54 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-46c2f725-5e40-4a05-8748-c94c869b1fe9 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.510s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:17:54 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-46c2f725-5e40-4a05-8748-c94c869b1fe9 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] <== connect_volume: return (1513ms) {'type': 'block', 'scsi_wwn': '23461386330356436', 'path': '/dev/sdb'} {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:17:54 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46c2f725-5e40-4a05-8748-c94c869b1fe9 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] [instance: 262eb845-eebe-4ffb-bc49-dcaca53ad7b8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23461386330356436', 'path': '/dev/sdb'} {{(pid=75226) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 17 01:17:54 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-46c2f725-5e40-4a05-8748-c94c869b1fe9 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:17:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-2087129181',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-2087129181',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKV3eUaLv1Nf2GbMurBwqVCKHkTHGINwHn9NxIQT1HFJaTPcIhblv549UYBEzh8qzhRSlfco2n2Ir3Yj2M5HfVEZNDfmX2UBxm0ZhLW7VwOddfd0Muufn03LFhj/HJg0+w==',key_name='tempest-keypair-214561330',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='25ffeaafcdca494eb7550cec5b100051',ramdisk_id='',reservation_id='r-7fgkbn6g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1243685842',owner_user_name='tempest-ServerActionsV293TestJSON-1243685842-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T01:17:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2c4b7f0453ec4ef5940b4bdf32bdf6f4',uuid=262eb845-eebe-4ffb-bc49-dcaca53ad7b8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ca3803cf-fc7f-4233-8afa-1806c73156be", "address": "fa:16:3e:d9:19:6e", "network": {"id": "432afb25-848f-4ef8-8436-11db949783e6", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1854406043-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25ffeaafcdca494eb7550cec5b100051", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca3803cf-fc", "ovs_interfaceid": "ca3803cf-fc7f-4233-8afa-1806c73156be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75226) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 01:17:54 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-46c2f725-5e40-4a05-8748-c94c869b1fe9 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] Converting VIF {"id": "ca3803cf-fc7f-4233-8afa-1806c73156be", "address": "fa:16:3e:d9:19:6e", "network": {"id": "432afb25-848f-4ef8-8436-11db949783e6", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1854406043-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25ffeaafcdca494eb7550cec5b100051", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca3803cf-fc", "ovs_interfaceid": "ca3803cf-fc7f-4233-8afa-1806c73156be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:17:54 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-46c2f725-5e40-4a05-8748-c94c869b1fe9 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:19:6e,bridge_name='br-int',has_traffic_filtering=True,id=ca3803cf-fc7f-4233-8afa-1806c73156be,network=Network(432afb25-848f-4ef8-8436-11db949783e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca3803cf-fc') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:17:54 user nova-compute[75226]: DEBUG nova.objects.instance [None req-46c2f725-5e40-4a05-8748-c94c869b1fe9 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] Lazy-loading 'pci_devices' on Instance uuid 262eb845-eebe-4ffb-bc49-dcaca53ad7b8 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:17:54 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-46c2f725-5e40-4a05-8748-c94c869b1fe9 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] [instance: 262eb845-eebe-4ffb-bc49-dcaca53ad7b8] End _get_guest_xml xml=<domain type="kvm">
Nov 17 01:17:54 user nova-compute[75226]:   <uuid>262eb845-eebe-4ffb-bc49-dcaca53ad7b8</uuid>
Nov 17 01:17:54 user nova-compute[75226]:   <name>instance-00000009</name>
Nov 17 01:17:54 user nova-compute[75226]:   <memory>524288</memory>
Nov 17 01:17:54 user nova-compute[75226]:   <vcpu>1</vcpu>
Nov 17 01:17:54 user nova-compute[75226]:   <metadata>
Nov 17 01:17:54 user nova-compute[75226]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 17 01:17:54 user nova-compute[75226]:       <nova:package version="0.0.0"/>
Nov 17 01:17:54 user nova-compute[75226]:       <nova:name>tempest-ServerActionsV293TestJSON-server-2087129181</nova:name>
Nov 17 01:17:54 user nova-compute[75226]:       <nova:creationTime>2023-11-17 01:17:52</nova:creationTime>
Nov 17 01:17:54 user nova-compute[75226]:       <nova:flavor name="m1.tiny">
Nov 17 01:17:54 user nova-compute[75226]:         <nova:memory>512</nova:memory>
Nov 17 01:17:54 user nova-compute[75226]:         <nova:disk>1</nova:disk>
Nov 17 01:17:54 user nova-compute[75226]:         <nova:swap>0</nova:swap>
Nov 17 01:17:54 user nova-compute[75226]:         <nova:ephemeral>0</nova:ephemeral>
Nov 17 01:17:54 user nova-compute[75226]:         <nova:vcpus>1</nova:vcpus>
Nov 17 01:17:54 user nova-compute[75226]:       </nova:flavor>
Nov 17 01:17:54 user nova-compute[75226]:       <nova:owner>
Nov 17 01:17:54 user nova-compute[75226]:         <nova:user uuid="2c4b7f0453ec4ef5940b4bdf32bdf6f4">tempest-ServerActionsV293TestJSON-1243685842-project-member</nova:user>
Nov 17 01:17:54 user nova-compute[75226]:         <nova:project uuid="25ffeaafcdca494eb7550cec5b100051">tempest-ServerActionsV293TestJSON-1243685842</nova:project>
Nov 17 01:17:54 user nova-compute[75226]:       </nova:owner>
Nov 17 01:17:54 user nova-compute[75226]:       <nova:ports>
Nov 17 01:17:54 user nova-compute[75226]:         <nova:port uuid="ca3803cf-fc7f-4233-8afa-1806c73156be">
Nov 17 01:17:54 user nova-compute[75226]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 17 01:17:54 user nova-compute[75226]:         </nova:port>
Nov 17 01:17:54 user nova-compute[75226]:       </nova:ports>
Nov 17 01:17:54 user nova-compute[75226]:     </nova:instance>
Nov 17 01:17:54 user nova-compute[75226]:   </metadata>
Nov 17 01:17:54 user nova-compute[75226]:   <sysinfo type="smbios">
Nov 17 01:17:54 user nova-compute[75226]:     <system>
Nov 17 01:17:54 user nova-compute[75226]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 17 01:17:54 user nova-compute[75226]:       <entry name="product">OpenStack Nova</entry>
Nov 17 01:17:54 user nova-compute[75226]:       <entry name="version">0.0.0</entry>
Nov 17 01:17:54 user nova-compute[75226]:       <entry name="serial">262eb845-eebe-4ffb-bc49-dcaca53ad7b8</entry>
Nov 17 01:17:54 user nova-compute[75226]:       <entry name="uuid">262eb845-eebe-4ffb-bc49-dcaca53ad7b8</entry>
Nov 17 01:17:54 user nova-compute[75226]:       <entry name="family">Virtual Machine</entry>
Nov 17 01:17:54 user nova-compute[75226]:     </system>
Nov 17 01:17:54 user nova-compute[75226]:   </sysinfo>
Nov 17 01:17:54 user nova-compute[75226]:   <os>
Nov 17 01:17:54 user nova-compute[75226]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 17 01:17:54 user nova-compute[75226]:     <boot dev="hd"/>
Nov 17 01:17:54 user nova-compute[75226]:     <smbios mode="sysinfo"/>
Nov 17 01:17:54 user nova-compute[75226]:   </os>
Nov 17 01:17:54 user nova-compute[75226]:   <features>
Nov 17 01:17:54 user nova-compute[75226]:     <acpi/>
Nov 17 01:17:54 user nova-compute[75226]:     <apic/>
Nov 17 01:17:54 user nova-compute[75226]:     <vmcoreinfo/>
Nov 17 01:17:54 user nova-compute[75226]:   </features>
Nov 17 01:17:54 user nova-compute[75226]:   <clock offset="utc">
Nov 17 01:17:54 user nova-compute[75226]:     <timer name="pit" tickpolicy="delay"/>
Nov 17 01:17:54 user nova-compute[75226]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 17 01:17:54 user nova-compute[75226]:     <timer name="hpet" present="no"/>
Nov 17 01:17:54 user nova-compute[75226]:   </clock>
Nov 17 01:17:54 user nova-compute[75226]:   <cpu mode="custom" match="exact">
Nov 17 01:17:54 user nova-compute[75226]:     <model>Nehalem</model>
Nov 17 01:17:54 user nova-compute[75226]:     <topology sockets="1" cores="1" threads="1"/>
Nov 17 01:17:54 user nova-compute[75226]:   </cpu>
Nov 17 01:17:54 user nova-compute[75226]:   <devices>
Nov 17 01:17:54 user nova-compute[75226]:     <disk type="block" device="disk">
Nov 17 01:17:54 user nova-compute[75226]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 01:17:54 user nova-compute[75226]:       <source dev="/dev/sdb"/>
Nov 17 01:17:54 user nova-compute[75226]:       <target dev="vda" bus="virtio"/>
Nov 17 01:17:54 user nova-compute[75226]:       <serial>2ca02b15-b2b8-4e45-9d87-54886c2568a2</serial>
Nov 17 01:17:54 user nova-compute[75226]:     </disk>
Nov 17 01:17:54 user nova-compute[75226]:     <interface type="ethernet">
Nov 17 01:17:54 user nova-compute[75226]:       <mac address="fa:16:3e:d9:19:6e"/>
Nov 17 01:17:54 user nova-compute[75226]:       <model type="virtio"/>
Nov 17 01:17:54 user nova-compute[75226]:       <mtu size="1442"/>
Nov 17 01:17:54 user nova-compute[75226]:       <target dev="tapca3803cf-fc"/>
Nov 17 01:17:54 user nova-compute[75226]:     </interface>
Nov 17 01:17:54 user nova-compute[75226]:     <serial type="pty">
Nov 17 01:17:54 user nova-compute[75226]:       <log file="/opt/stack/data/nova/instances/262eb845-eebe-4ffb-bc49-dcaca53ad7b8/console.log" append="off"/>
Nov 17 01:17:54 user nova-compute[75226]:     </serial>
Nov 17 01:17:54 user nova-compute[75226]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 17 01:17:54 user nova-compute[75226]:     <video>
Nov 17 01:17:54 user nova-compute[75226]:       <model type="virtio"/>
Nov 17 01:17:54 user nova-compute[75226]:     </video>
Nov 17 01:17:54 user nova-compute[75226]:     <rng model="virtio">
Nov 17 01:17:54 user nova-compute[75226]:       <backend model="random">/dev/urandom</backend>
Nov 17 01:17:54 user nova-compute[75226]:     </rng>
Nov 17 01:17:54 user nova-compute[75226]:     <controller type="usb" index="0" model="none"/>
Nov 17 01:17:54 user nova-compute[75226]:     <memballoon model="virtio">
Nov 17 01:17:54 user nova-compute[75226]:       <stats period="10"/>
Nov 17 01:17:54 user nova-compute[75226]:     </memballoon>
Nov 17 01:17:54 user nova-compute[75226]:   </devices>
Nov 17 01:17:54 user nova-compute[75226]: </domain>
Nov 17 01:17:54 user nova-compute[75226]:  {{(pid=75226) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 17 01:17:54 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-46c2f725-5e40-4a05-8748-c94c869b1fe9 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:17:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-2087129181',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-2087129181',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKV3eUaLv1Nf2GbMurBwqVCKHkTHGINwHn9NxIQT1HFJaTPcIhblv549UYBEzh8qzhRSlfco2n2Ir3Yj2M5HfVEZNDfmX2UBxm0ZhLW7VwOddfd0Muufn03LFhj/HJg0+w==',key_name='tempest-keypair-214561330',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='25ffeaafcdca494eb7550cec5b100051',ramdisk_id='',reservation_id='r-7fgkbn6g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1243685842',owner_user_name='tempest-ServerActionsV293TestJSON-1243685842-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T01:17:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2c4b7f0453ec4ef5940b4bdf32bdf6f4',uuid=262eb845-eebe-4ffb-bc49-dcaca53ad7b8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ca3803cf-fc7f-4233-8afa-1806c73156be", "address": "fa:16:3e:d9:19:6e", "network": {"id": "432afb25-848f-4ef8-8436-11db949783e6", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1854406043-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25ffeaafcdca494eb7550cec5b100051", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca3803cf-fc", "ovs_interfaceid": "ca3803cf-fc7f-4233-8afa-1806c73156be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 17 01:17:54 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-46c2f725-5e40-4a05-8748-c94c869b1fe9 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] Converting VIF {"id": "ca3803cf-fc7f-4233-8afa-1806c73156be", "address": "fa:16:3e:d9:19:6e", "network": {"id": "432afb25-848f-4ef8-8436-11db949783e6", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1854406043-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25ffeaafcdca494eb7550cec5b100051", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca3803cf-fc", "ovs_interfaceid": "ca3803cf-fc7f-4233-8afa-1806c73156be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:17:54 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-46c2f725-5e40-4a05-8748-c94c869b1fe9 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:19:6e,bridge_name='br-int',has_traffic_filtering=True,id=ca3803cf-fc7f-4233-8afa-1806c73156be,network=Network(432afb25-848f-4ef8-8436-11db949783e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca3803cf-fc') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:17:54 user nova-compute[75226]: DEBUG os_vif [None req-46c2f725-5e40-4a05-8748-c94c869b1fe9 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:19:6e,bridge_name='br-int',has_traffic_filtering=True,id=ca3803cf-fc7f-4233-8afa-1806c73156be,network=Network(432afb25-848f-4ef8-8436-11db949783e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca3803cf-fc') {{(pid=75226) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 17 01:17:54 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:17:54 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:17:54 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 17 01:17:54 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:17:54 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3117021c-5a10-553d-bdc0-0b97d683e12f', '_type': 'linux-noop'}}, row=False) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:17:54 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:17:54 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:17:54 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:17:54 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapca3803cf-fc, may_exist=True, interface_attrs={}) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:17:54 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapca3803cf-fc, col_values=(('qos', UUID('f4ba6023-7aec-408a-a3dc-6ffef405f157')),), if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:17:54 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapca3803cf-fc, col_values=(('external_ids', {'iface-id': 'ca3803cf-fc7f-4233-8afa-1806c73156be', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d9:19:6e', 'vm-uuid': '262eb845-eebe-4ffb-bc49-dcaca53ad7b8'}),), if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:17:54 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:17:54 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:17:54 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:17:54 user nova-compute[75226]: INFO os_vif [None req-46c2f725-5e40-4a05-8748-c94c869b1fe9 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:19:6e,bridge_name='br-int',has_traffic_filtering=True,id=ca3803cf-fc7f-4233-8afa-1806c73156be,network=Network(432afb25-848f-4ef8-8436-11db949783e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca3803cf-fc')
Nov 17 01:17:54 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-46c2f725-5e40-4a05-8748-c94c869b1fe9 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] No BDM found with device name vda, not building metadata. {{(pid=75226) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 01:17:54 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-46c2f725-5e40-4a05-8748-c94c869b1fe9 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] No VIF found with MAC fa:16:3e:d9:19:6e, not building metadata {{(pid=75226) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 01:17:55 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:17:55 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:17:55 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:17:55 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75226) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 17 01:17:56 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:17:56 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:17:56 user nova-compute[75226]: DEBUG nova.compute.manager [req-9d864905-7d6c-4723-94ee-895d495e71f8 req-b4d1a041-e45a-4fcc-8760-5f4cec12b2ab service nova] [instance: 262eb845-eebe-4ffb-bc49-dcaca53ad7b8] Received event network-vif-plugged-ca3803cf-fc7f-4233-8afa-1806c73156be {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:17:56 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-9d864905-7d6c-4723-94ee-895d495e71f8 req-b4d1a041-e45a-4fcc-8760-5f4cec12b2ab service nova] Acquiring lock "262eb845-eebe-4ffb-bc49-dcaca53ad7b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:17:56 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-9d864905-7d6c-4723-94ee-895d495e71f8 req-b4d1a041-e45a-4fcc-8760-5f4cec12b2ab service nova] Lock "262eb845-eebe-4ffb-bc49-dcaca53ad7b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:17:56 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-9d864905-7d6c-4723-94ee-895d495e71f8 req-b4d1a041-e45a-4fcc-8760-5f4cec12b2ab service nova] Lock "262eb845-eebe-4ffb-bc49-dcaca53ad7b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:17:56 user nova-compute[75226]: DEBUG nova.compute.manager [req-9d864905-7d6c-4723-94ee-895d495e71f8 req-b4d1a041-e45a-4fcc-8760-5f4cec12b2ab service nova] [instance: 262eb845-eebe-4ffb-bc49-dcaca53ad7b8] No waiting events found dispatching network-vif-plugged-ca3803cf-fc7f-4233-8afa-1806c73156be {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:17:56 user nova-compute[75226]: WARNING nova.compute.manager [req-9d864905-7d6c-4723-94ee-895d495e71f8 req-b4d1a041-e45a-4fcc-8760-5f4cec12b2ab service nova] [instance: 262eb845-eebe-4ffb-bc49-dcaca53ad7b8] Received unexpected event network-vif-plugged-ca3803cf-fc7f-4233-8afa-1806c73156be for instance with vm_state building and task_state spawning.
Nov 17 01:17:56 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:17:57 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:17:57 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:17:57 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:17:57 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:17:57 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:17:57 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:17:57 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:17:58 user nova-compute[75226]: DEBUG nova.compute.manager [req-818ba6e7-6b53-4394-a041-5c37fe6f01b0 req-9d493462-a7f3-4555-a9d0-6ee0de00d483 service nova] [instance: 262eb845-eebe-4ffb-bc49-dcaca53ad7b8] Received event network-vif-plugged-ca3803cf-fc7f-4233-8afa-1806c73156be {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:17:58 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-818ba6e7-6b53-4394-a041-5c37fe6f01b0 req-9d493462-a7f3-4555-a9d0-6ee0de00d483 service nova] Acquiring lock "262eb845-eebe-4ffb-bc49-dcaca53ad7b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:17:58 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-818ba6e7-6b53-4394-a041-5c37fe6f01b0 req-9d493462-a7f3-4555-a9d0-6ee0de00d483 service nova] Lock "262eb845-eebe-4ffb-bc49-dcaca53ad7b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:17:58 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-818ba6e7-6b53-4394-a041-5c37fe6f01b0 req-9d493462-a7f3-4555-a9d0-6ee0de00d483 service nova] Lock "262eb845-eebe-4ffb-bc49-dcaca53ad7b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:17:58 user nova-compute[75226]: DEBUG nova.compute.manager [req-818ba6e7-6b53-4394-a041-5c37fe6f01b0 req-9d493462-a7f3-4555-a9d0-6ee0de00d483 service nova] [instance: 262eb845-eebe-4ffb-bc49-dcaca53ad7b8] No waiting events found dispatching network-vif-plugged-ca3803cf-fc7f-4233-8afa-1806c73156be {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:17:58 user nova-compute[75226]: WARNING nova.compute.manager [req-818ba6e7-6b53-4394-a041-5c37fe6f01b0 req-9d493462-a7f3-4555-a9d0-6ee0de00d483 service nova] [instance: 262eb845-eebe-4ffb-bc49-dcaca53ad7b8] Received unexpected event network-vif-plugged-ca3803cf-fc7f-4233-8afa-1806c73156be for instance with vm_state building and task_state spawning.
Nov 17 01:17:58 user nova-compute[75226]: DEBUG nova.compute.manager [None req-46c2f725-5e40-4a05-8748-c94c869b1fe9 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] [instance: 262eb845-eebe-4ffb-bc49-dcaca53ad7b8] Instance event wait completed in 0 seconds for  {{(pid=75226) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 17 01:17:58 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-46c2f725-5e40-4a05-8748-c94c869b1fe9 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] [instance: 262eb845-eebe-4ffb-bc49-dcaca53ad7b8] Guest created on hypervisor {{(pid=75226) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 17 01:17:58 user nova-compute[75226]: INFO nova.virt.libvirt.driver [-] [instance: 262eb845-eebe-4ffb-bc49-dcaca53ad7b8] Instance spawned successfully.
Nov 17 01:17:58 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-46c2f725-5e40-4a05-8748-c94c869b1fe9 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] [instance: 262eb845-eebe-4ffb-bc49-dcaca53ad7b8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 17 01:17:58 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-46c2f725-5e40-4a05-8748-c94c869b1fe9 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] [instance: 262eb845-eebe-4ffb-bc49-dcaca53ad7b8] Found default for hw_cdrom_bus of ide {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:17:58 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-46c2f725-5e40-4a05-8748-c94c869b1fe9 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] [instance: 262eb845-eebe-4ffb-bc49-dcaca53ad7b8] Found default for hw_disk_bus of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:17:58 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-46c2f725-5e40-4a05-8748-c94c869b1fe9 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] [instance: 262eb845-eebe-4ffb-bc49-dcaca53ad7b8] Found default for hw_input_bus of None {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:17:58 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-46c2f725-5e40-4a05-8748-c94c869b1fe9 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] [instance: 262eb845-eebe-4ffb-bc49-dcaca53ad7b8] Found default for hw_pointer_model of None {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:17:58 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-46c2f725-5e40-4a05-8748-c94c869b1fe9 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] [instance: 262eb845-eebe-4ffb-bc49-dcaca53ad7b8] Found default for hw_video_model of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:17:58 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-46c2f725-5e40-4a05-8748-c94c869b1fe9 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] [instance: 262eb845-eebe-4ffb-bc49-dcaca53ad7b8] Found default for hw_vif_model of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:17:58 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:17:58 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Starting heal instance info cache {{(pid=75226) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 17 01:17:58 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Rebuilding the list of instances to heal {{(pid=75226) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 17 01:17:59 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] [instance: 262eb845-eebe-4ffb-bc49-dcaca53ad7b8] Skipping network cache update for instance because it is Building. {{(pid=75226) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 17 01:17:59 user nova-compute[75226]: INFO nova.compute.manager [None req-46c2f725-5e40-4a05-8748-c94c869b1fe9 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] [instance: 262eb845-eebe-4ffb-bc49-dcaca53ad7b8] Took 6.43 seconds to spawn the instance on the hypervisor.
Nov 17 01:17:59 user nova-compute[75226]: DEBUG nova.compute.manager [None req-46c2f725-5e40-4a05-8748-c94c869b1fe9 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] [instance: 262eb845-eebe-4ffb-bc49-dcaca53ad7b8] Checking state {{(pid=75226) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 01:17:59 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "refresh_cache-19250ac2-1b3f-4fe9-80b0-406b181929b6" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:17:59 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquired lock "refresh_cache-19250ac2-1b3f-4fe9-80b0-406b181929b6" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:17:59 user nova-compute[75226]: DEBUG nova.network.neutron [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] [instance: 19250ac2-1b3f-4fe9-80b0-406b181929b6] Forcefully refreshing network info cache for instance {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 17 01:17:59 user nova-compute[75226]: DEBUG nova.objects.instance [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lazy-loading 'info_cache' on Instance uuid 19250ac2-1b3f-4fe9-80b0-406b181929b6 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:17:59 user nova-compute[75226]: INFO nova.compute.manager [None req-46c2f725-5e40-4a05-8748-c94c869b1fe9 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] [instance: 262eb845-eebe-4ffb-bc49-dcaca53ad7b8] Took 19.01 seconds to build instance.
Nov 17 01:17:59 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-46c2f725-5e40-4a05-8748-c94c869b1fe9 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] Lock "262eb845-eebe-4ffb-bc49-dcaca53ad7b8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.294s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:17:59 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:17:59 user nova-compute[75226]: DEBUG nova.network.neutron [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] [instance: 19250ac2-1b3f-4fe9-80b0-406b181929b6] Updating instance_info_cache with network_info: [{"id": "093abf0b-d4eb-4be3-bda0-4a7d19fe6ac2", "address": "fa:16:3e:44:7e:c6", "network": {"id": "3dcb272c-6114-40d2-8236-2deea2de36cf", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-883099730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cc9e48d967049cab3393af3f9dcbe48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap093abf0b-d4", "ovs_interfaceid": "093abf0b-d4eb-4be3-bda0-4a7d19fe6ac2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:17:59 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Releasing lock "refresh_cache-19250ac2-1b3f-4fe9-80b0-406b181929b6" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:17:59 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] [instance: 19250ac2-1b3f-4fe9-80b0-406b181929b6] Updated the network info_cache for instance {{(pid=75226) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 17 01:17:59 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:17:59 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:17:59 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:17:59 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:17:59 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:17:59 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75226) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 17 01:18:00 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75226) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 01:18:00 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddfecefc-1e9b-4e6e-9995-855c8a061084/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:18:00 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Acquiring lock "27342ec6-7a03-4f99-8056-5cb56794aa41" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:18:00 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Lock "27342ec6-7a03-4f99-8056-5cb56794aa41" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:18:00 user nova-compute[75226]: DEBUG nova.compute.manager [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Starting instance... {{(pid=75226) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 17 01:18:00 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddfecefc-1e9b-4e6e-9995-855c8a061084/disk --force-share --output=json" returned: 0 in 0.284s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:18:00 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddfecefc-1e9b-4e6e-9995-855c8a061084/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:18:00 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:18:00 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:18:00 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75226) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 17 01:18:00 user nova-compute[75226]: INFO nova.compute.claims [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Claim successful on node user
Nov 17 01:18:00 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddfecefc-1e9b-4e6e-9995-855c8a061084/disk --force-share --output=json" returned: 0 in 0.318s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:18:00 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19250ac2-1b3f-4fe9-80b0-406b181929b6/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:18:00 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19250ac2-1b3f-4fe9-80b0-406b181929b6/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:18:00 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19250ac2-1b3f-4fe9-80b0-406b181929b6/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:18:01 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:18:01 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19250ac2-1b3f-4fe9-80b0-406b181929b6/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:18:01 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:18:01 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b054a557-dff6-49f8-9300-1307f8433567/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:18:01 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.768s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:18:01 user nova-compute[75226]: DEBUG nova.compute.manager [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Start building networks asynchronously for instance. {{(pid=75226) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 17 01:18:01 user nova-compute[75226]: DEBUG nova.compute.manager [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Allocating IP information in the background. {{(pid=75226) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 17 01:18:01 user nova-compute[75226]: DEBUG nova.network.neutron [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] allocate_for_instance() {{(pid=75226) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 17 01:18:01 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b054a557-dff6-49f8-9300-1307f8433567/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:18:01 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b054a557-dff6-49f8-9300-1307f8433567/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:18:01 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 17 01:18:01 user nova-compute[75226]: DEBUG nova.compute.manager [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Start building block device mappings for instance. {{(pid=75226) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 17 01:18:01 user nova-compute[75226]: INFO nova.virt.block_device [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Booting with volume 02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae at /dev/vda
Nov 17 01:18:01 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b054a557-dff6-49f8-9300-1307f8433567/disk --force-share --output=json" returned: 0 in 0.339s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:18:01 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa84e575-bdad-45b9-80ce-86b1c2826fb0/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:18:01 user nova-compute[75226]: DEBUG nova.policy [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0b54686e817042a28596953dde26d329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '871db3f789ac470c877456108324c68c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75226) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 17 01:18:01 user nova-compute[75226]: DEBUG os_brick.utils [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:18:01 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:18:01 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:18:01 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2b9d08f-abf4-4242-b4ff-4389f5551592]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f62857db69\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:18:01 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:18:01 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:18:01 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ab5833a-9207-41e8-aafb-7e83cc124336]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:18:01 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:18:01 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:18:01 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[83f68f7b-f0a6-476c-b758-787c1b8b97ef]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:18:01 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[16490c66-df35-4cbd-aaf3-2d989235d627]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:18:01 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Running cmd (subprocess): nvme version {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:18:01 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] 'nvme version' failed. Not Retrying. {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 01:18:01 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.nvmeof [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] nvme not present on system {{(pid=75226) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 17 01:18:01 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:18:01 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 01:18:01 user nova-compute[75226]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 17 01:18:01 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[1152e004-46c3-4f68-9299-53107c5413c7]: (4, '') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:18:01 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75226) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 17 01:18:01 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75226) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 17 01:18:01 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] LIGHTOS: no hostnqn found. {{(pid=75226) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 17 01:18:01 user nova-compute[75226]: DEBUG os_brick.utils [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f62857db69', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:18:01 user nova-compute[75226]: DEBUG nova.virt.block_device [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Updating existing volume attachment record: d53f9d4f-a088-4ece-a744-802ef9cffcd3 {{(pid=75226) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 17 01:18:01 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa84e575-bdad-45b9-80ce-86b1c2826fb0/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:18:01 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa84e575-bdad-45b9-80ce-86b1c2826fb0/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:18:02 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa84e575-bdad-45b9-80ce-86b1c2826fb0/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:18:02 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c505f8d-09e0-41bc-ba3a-89bde1646613/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:18:02 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:18:02 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c505f8d-09e0-41bc-ba3a-89bde1646613/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:18:02 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c505f8d-09e0-41bc-ba3a-89bde1646613/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:18:02 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c505f8d-09e0-41bc-ba3a-89bde1646613/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:18:02 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7830f7a-80f1-4c2f-bd64-363e6dd9114a/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:18:02 user nova-compute[75226]: DEBUG nova.network.neutron [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Successfully created port: 6337887b-565a-4dc6-9a4f-4c8d9ac1c901 {{(pid=75226) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 17 01:18:02 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7830f7a-80f1-4c2f-bd64-363e6dd9114a/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:18:02 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7830f7a-80f1-4c2f-bd64-363e6dd9114a/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:18:02 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7830f7a-80f1-4c2f-bd64-363e6dd9114a/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:18:02 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75b1cabe-ba15-4851-9140-5949afc33005/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:18:03 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75b1cabe-ba15-4851-9140-5949afc33005/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:18:03 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75b1cabe-ba15-4851-9140-5949afc33005/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:18:03 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75b1cabe-ba15-4851-9140-5949afc33005/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:18:03 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/724b81dd-4531-4c99-850d-0bfcbfdf7bd4/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:18:03 user nova-compute[75226]: DEBUG nova.network.neutron [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Successfully created port: 3e4d946c-158b-49e8-a349-44da4864f830 {{(pid=75226) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 17 01:18:03 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/724b81dd-4531-4c99-850d-0bfcbfdf7bd4/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:18:03 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/724b81dd-4531-4c99-850d-0bfcbfdf7bd4/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:18:03 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/724b81dd-4531-4c99-850d-0bfcbfdf7bd4/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:18:04 user nova-compute[75226]: DEBUG nova.network.neutron [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Successfully created port: 3b1855a6-8a37-47af-b3e6-86e60eb05a1d {{(pid=75226) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 17 01:18:04 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:18:04 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:18:04 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Hypervisor/Node resource view: name=user free_ram=7567MB free_disk=25.549335479736328GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75226) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 17 01:18:04 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:18:04 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.006s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:18:04 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:18:04 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 19250ac2-1b3f-4fe9-80b0-406b181929b6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:18:04 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance aa84e575-bdad-45b9-80ce-86b1c2826fb0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:18:04 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance ddfecefc-1e9b-4e6e-9995-855c8a061084 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:18:04 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 724b81dd-4531-4c99-850d-0bfcbfdf7bd4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:18:04 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 75b1cabe-ba15-4851-9140-5949afc33005 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:18:04 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance b054a557-dff6-49f8-9300-1307f8433567 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:18:04 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance e7830f7a-80f1-4c2f-bd64-363e6dd9114a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:18:04 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 1c505f8d-09e0-41bc-ba3a-89bde1646613 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:18:04 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 262eb845-eebe-4ffb-bc49-dcaca53ad7b8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:18:04 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 27342ec6-7a03-4f99-8056-5cb56794aa41 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:18:04 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75226) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 17 01:18:04 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75226) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 17 01:18:04 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Refreshing inventories for resource provider f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 17 01:18:04 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Updating ProviderTree inventory for provider f431122b-abb2-4ecb-9e21-e3ec333d823b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 17 01:18:04 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Updating inventory in ProviderTree for provider f431122b-abb2-4ecb-9e21-e3ec333d823b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 17 01:18:04 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Refreshing aggregate associations for resource provider f431122b-abb2-4ecb-9e21-e3ec333d823b, aggregates: None {{(pid=75226) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 17 01:18:05 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Refreshing trait associations for resource provider f431122b-abb2-4ecb-9e21-e3ec333d823b, traits: COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE42,HW_CPU_X86_SSE,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSSE3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_SATA {{(pid=75226) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 17 01:18:05 user nova-compute[75226]: DEBUG nova.network.neutron [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Successfully created port: 3c1a838d-e1c6-44d3-ab8a-a545044545a3 {{(pid=75226) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 17 01:18:05 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:18:05 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:18:05 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Compute_service record updated for user:user {{(pid=75226) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 17 01:18:05 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.170s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:18:05 user nova-compute[75226]: DEBUG nova.network.neutron [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Successfully created port: 11a81061-cde2-4e09-88e4-678aead09ad5 {{(pid=75226) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 17 01:18:06 user nova-compute[75226]: DEBUG nova.network.neutron [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Successfully updated port: 6337887b-565a-4dc6-9a4f-4c8d9ac1c901 {{(pid=75226) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 17 01:18:06 user nova-compute[75226]: DEBUG nova.compute.manager [req-4f2bd6dc-0863-4d5a-9e83-ad3fb5abc2f3 req-c2a72ab0-1c3e-4b5f-a4c4-c270fc341bc8 service nova] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Received event network-changed-6337887b-565a-4dc6-9a4f-4c8d9ac1c901 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:18:06 user nova-compute[75226]: DEBUG nova.compute.manager [req-4f2bd6dc-0863-4d5a-9e83-ad3fb5abc2f3 req-c2a72ab0-1c3e-4b5f-a4c4-c270fc341bc8 service nova] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Refreshing instance network info cache due to event network-changed-6337887b-565a-4dc6-9a4f-4c8d9ac1c901. {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 01:18:06 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-4f2bd6dc-0863-4d5a-9e83-ad3fb5abc2f3 req-c2a72ab0-1c3e-4b5f-a4c4-c270fc341bc8 service nova] Acquiring lock "refresh_cache-27342ec6-7a03-4f99-8056-5cb56794aa41" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:18:06 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-4f2bd6dc-0863-4d5a-9e83-ad3fb5abc2f3 req-c2a72ab0-1c3e-4b5f-a4c4-c270fc341bc8 service nova] Acquired lock "refresh_cache-27342ec6-7a03-4f99-8056-5cb56794aa41" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:18:06 user nova-compute[75226]: DEBUG nova.network.neutron [req-4f2bd6dc-0863-4d5a-9e83-ad3fb5abc2f3 req-c2a72ab0-1c3e-4b5f-a4c4-c270fc341bc8 service nova] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Refreshing network info cache for port 6337887b-565a-4dc6-9a4f-4c8d9ac1c901 {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 01:18:06 user nova-compute[75226]: DEBUG nova.network.neutron [req-4f2bd6dc-0863-4d5a-9e83-ad3fb5abc2f3 req-c2a72ab0-1c3e-4b5f-a4c4-c270fc341bc8 service nova] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Instance cache missing network info. {{(pid=75226) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 17 01:18:07 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:18:07 user nova-compute[75226]: DEBUG nova.network.neutron [req-4f2bd6dc-0863-4d5a-9e83-ad3fb5abc2f3 req-c2a72ab0-1c3e-4b5f-a4c4-c270fc341bc8 service nova] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Updating instance_info_cache with network_info: [] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:18:07 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-4f2bd6dc-0863-4d5a-9e83-ad3fb5abc2f3 req-c2a72ab0-1c3e-4b5f-a4c4-c270fc341bc8 service nova] Releasing lock "refresh_cache-27342ec6-7a03-4f99-8056-5cb56794aa41" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:18:07 user nova-compute[75226]: DEBUG nova.network.neutron [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Successfully updated port: 8a548a9b-874e-4c7c-bf06-6896dd773ce4 {{(pid=75226) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 17 01:18:08 user nova-compute[75226]: DEBUG nova.network.neutron [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Successfully updated port: 01625fc1-9bbc-4edc-b594-78658e91edd9 {{(pid=75226) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 17 01:18:08 user nova-compute[75226]: DEBUG nova.compute.manager [req-aefec10c-69df-416e-8901-86905c3009aa req-2c8ce7c2-c8ff-4d05-b0ee-ac8a1c2b1193 service nova] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Received event network-changed-8a548a9b-874e-4c7c-bf06-6896dd773ce4 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:18:08 user nova-compute[75226]: DEBUG nova.compute.manager [req-aefec10c-69df-416e-8901-86905c3009aa req-2c8ce7c2-c8ff-4d05-b0ee-ac8a1c2b1193 service nova] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Refreshing instance network info cache due to event network-changed-8a548a9b-874e-4c7c-bf06-6896dd773ce4. {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 01:18:08 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-aefec10c-69df-416e-8901-86905c3009aa req-2c8ce7c2-c8ff-4d05-b0ee-ac8a1c2b1193 service nova] Acquiring lock "refresh_cache-27342ec6-7a03-4f99-8056-5cb56794aa41" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:18:08 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-aefec10c-69df-416e-8901-86905c3009aa req-2c8ce7c2-c8ff-4d05-b0ee-ac8a1c2b1193 service nova] Acquired lock "refresh_cache-27342ec6-7a03-4f99-8056-5cb56794aa41" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:18:08 user nova-compute[75226]: DEBUG nova.network.neutron [req-aefec10c-69df-416e-8901-86905c3009aa req-2c8ce7c2-c8ff-4d05-b0ee-ac8a1c2b1193 service nova] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Refreshing network info cache for port 8a548a9b-874e-4c7c-bf06-6896dd773ce4 {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 01:18:09 user nova-compute[75226]: DEBUG nova.network.neutron [req-aefec10c-69df-416e-8901-86905c3009aa req-2c8ce7c2-c8ff-4d05-b0ee-ac8a1c2b1193 service nova] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Instance cache missing network info. {{(pid=75226) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 17 01:18:09 user nova-compute[75226]: DEBUG nova.network.neutron [req-aefec10c-69df-416e-8901-86905c3009aa req-2c8ce7c2-c8ff-4d05-b0ee-ac8a1c2b1193 service nova] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Updating instance_info_cache with network_info: [] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:18:09 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-aefec10c-69df-416e-8901-86905c3009aa req-2c8ce7c2-c8ff-4d05-b0ee-ac8a1c2b1193 service nova] Releasing lock "refresh_cache-27342ec6-7a03-4f99-8056-5cb56794aa41" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:18:09 user nova-compute[75226]: DEBUG nova.compute.manager [req-aefec10c-69df-416e-8901-86905c3009aa req-2c8ce7c2-c8ff-4d05-b0ee-ac8a1c2b1193 service nova] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Received event network-changed-01625fc1-9bbc-4edc-b594-78658e91edd9 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:18:09 user nova-compute[75226]: DEBUG nova.compute.manager [req-aefec10c-69df-416e-8901-86905c3009aa req-2c8ce7c2-c8ff-4d05-b0ee-ac8a1c2b1193 service nova] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Refreshing instance network info cache due to event network-changed-01625fc1-9bbc-4edc-b594-78658e91edd9. {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 01:18:09 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-aefec10c-69df-416e-8901-86905c3009aa req-2c8ce7c2-c8ff-4d05-b0ee-ac8a1c2b1193 service nova] Acquiring lock "refresh_cache-27342ec6-7a03-4f99-8056-5cb56794aa41" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:18:09 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-aefec10c-69df-416e-8901-86905c3009aa req-2c8ce7c2-c8ff-4d05-b0ee-ac8a1c2b1193 service nova] Acquired lock "refresh_cache-27342ec6-7a03-4f99-8056-5cb56794aa41" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:18:09 user nova-compute[75226]: DEBUG nova.network.neutron [req-aefec10c-69df-416e-8901-86905c3009aa req-2c8ce7c2-c8ff-4d05-b0ee-ac8a1c2b1193 service nova] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Refreshing network info cache for port 01625fc1-9bbc-4edc-b594-78658e91edd9 {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 01:18:09 user nova-compute[75226]: DEBUG nova.network.neutron [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Successfully updated port: 3e4d946c-158b-49e8-a349-44da4864f830 {{(pid=75226) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 17 01:18:09 user nova-compute[75226]: DEBUG nova.network.neutron [req-aefec10c-69df-416e-8901-86905c3009aa req-2c8ce7c2-c8ff-4d05-b0ee-ac8a1c2b1193 service nova] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Instance cache missing network info. {{(pid=75226) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 17 01:18:09 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:18:09 user nova-compute[75226]: DEBUG nova.network.neutron [req-aefec10c-69df-416e-8901-86905c3009aa req-2c8ce7c2-c8ff-4d05-b0ee-ac8a1c2b1193 service nova] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Updating instance_info_cache with network_info: [] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:18:09 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-aefec10c-69df-416e-8901-86905c3009aa req-2c8ce7c2-c8ff-4d05-b0ee-ac8a1c2b1193 service nova] Releasing lock "refresh_cache-27342ec6-7a03-4f99-8056-5cb56794aa41" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:18:09 user nova-compute[75226]: INFO nova.virt.block_device [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Booting with volume 324e7042-63b3-44d8-b18d-8201b88923a1 at /dev/vdb
Nov 17 01:18:09 user nova-compute[75226]: DEBUG os_brick.utils [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:18:09 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:18:09 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:18:09 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fa18811-ee3d-4056-9835-9d3c4b797a6a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f62857db69\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:18:09 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:18:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:18:10 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a0217ad-7cbc-4f75-a687-7f631938debc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:18:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:18:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:18:10 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[181b154c-0dd4-4681-8c28-cc49ed43374a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:18:10 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef5a7983-0505-42d3-9e41-2367dde65103]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:18:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Running cmd (subprocess): nvme version {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:18:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] 'nvme version' failed. Not Retrying. {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 01:18:10 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.nvmeof [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] nvme not present on system {{(pid=75226) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 17 01:18:10 user nova-compute[75226]: DEBUG nova.network.neutron [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Successfully updated port: 3b1855a6-8a37-47af-b3e6-86e60eb05a1d {{(pid=75226) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 17 01:18:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:18:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 01:18:10 user nova-compute[75226]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 17 01:18:10 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb4b56a1-2d9b-47e4-a05c-c7c45e2afcef]: (4, '') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:18:10 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75226) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 17 01:18:10 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75226) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 17 01:18:10 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] LIGHTOS: no hostnqn found. {{(pid=75226) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 17 01:18:10 user nova-compute[75226]: DEBUG os_brick.utils [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f62857db69', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:18:10 user nova-compute[75226]: DEBUG nova.virt.block_device [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Updating existing volume attachment record: 7d2420a8-f7ac-409a-89c5-fc27c754866b {{(pid=75226) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 17 01:18:10 user nova-compute[75226]: DEBUG nova.compute.manager [req-2e344cd1-a4a7-40c0-9289-012625443e5d req-355ddb36-a7e5-4308-8fcb-ca8dfd809f76 service nova] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Received event network-changed-3e4d946c-158b-49e8-a349-44da4864f830 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:18:10 user nova-compute[75226]: DEBUG nova.compute.manager [req-2e344cd1-a4a7-40c0-9289-012625443e5d req-355ddb36-a7e5-4308-8fcb-ca8dfd809f76 service nova] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Refreshing instance network info cache due to event network-changed-3e4d946c-158b-49e8-a349-44da4864f830. {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 01:18:10 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-2e344cd1-a4a7-40c0-9289-012625443e5d req-355ddb36-a7e5-4308-8fcb-ca8dfd809f76 service nova] Acquiring lock "refresh_cache-27342ec6-7a03-4f99-8056-5cb56794aa41" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:18:10 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-2e344cd1-a4a7-40c0-9289-012625443e5d req-355ddb36-a7e5-4308-8fcb-ca8dfd809f76 service nova] Acquired lock "refresh_cache-27342ec6-7a03-4f99-8056-5cb56794aa41" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:18:10 user nova-compute[75226]: DEBUG nova.network.neutron [req-2e344cd1-a4a7-40c0-9289-012625443e5d req-355ddb36-a7e5-4308-8fcb-ca8dfd809f76 service nova] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Refreshing network info cache for port 3e4d946c-158b-49e8-a349-44da4864f830 {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 01:18:11 user nova-compute[75226]: DEBUG nova.network.neutron [req-2e344cd1-a4a7-40c0-9289-012625443e5d req-355ddb36-a7e5-4308-8fcb-ca8dfd809f76 service nova] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Instance cache missing network info. {{(pid=75226) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 17 01:18:11 user nova-compute[75226]: DEBUG nova.network.neutron [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Successfully updated port: 3c1a838d-e1c6-44d3-ab8a-a545044545a3 {{(pid=75226) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 17 01:18:11 user nova-compute[75226]: DEBUG nova.network.neutron [req-2e344cd1-a4a7-40c0-9289-012625443e5d req-355ddb36-a7e5-4308-8fcb-ca8dfd809f76 service nova] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Updating instance_info_cache with network_info: [] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:18:11 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-2e344cd1-a4a7-40c0-9289-012625443e5d req-355ddb36-a7e5-4308-8fcb-ca8dfd809f76 service nova] Releasing lock "refresh_cache-27342ec6-7a03-4f99-8056-5cb56794aa41" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:18:11 user nova-compute[75226]: DEBUG nova.compute.manager [req-2e344cd1-a4a7-40c0-9289-012625443e5d req-355ddb36-a7e5-4308-8fcb-ca8dfd809f76 service nova] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Received event network-changed-3b1855a6-8a37-47af-b3e6-86e60eb05a1d {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:18:11 user nova-compute[75226]: DEBUG nova.compute.manager [req-2e344cd1-a4a7-40c0-9289-012625443e5d req-355ddb36-a7e5-4308-8fcb-ca8dfd809f76 service nova] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Refreshing instance network info cache due to event network-changed-3b1855a6-8a37-47af-b3e6-86e60eb05a1d. {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 01:18:11 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-2e344cd1-a4a7-40c0-9289-012625443e5d req-355ddb36-a7e5-4308-8fcb-ca8dfd809f76 service nova] Acquiring lock "refresh_cache-27342ec6-7a03-4f99-8056-5cb56794aa41" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:18:11 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-2e344cd1-a4a7-40c0-9289-012625443e5d req-355ddb36-a7e5-4308-8fcb-ca8dfd809f76 service nova] Acquired lock "refresh_cache-27342ec6-7a03-4f99-8056-5cb56794aa41" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:18:11 user nova-compute[75226]: DEBUG nova.network.neutron [req-2e344cd1-a4a7-40c0-9289-012625443e5d req-355ddb36-a7e5-4308-8fcb-ca8dfd809f76 service nova] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Refreshing network info cache for port 3b1855a6-8a37-47af-b3e6-86e60eb05a1d {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 01:18:11 user nova-compute[75226]: DEBUG nova.network.neutron [req-2e344cd1-a4a7-40c0-9289-012625443e5d req-355ddb36-a7e5-4308-8fcb-ca8dfd809f76 service nova] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Instance cache missing network info. {{(pid=75226) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 17 01:18:11 user nova-compute[75226]: DEBUG nova.network.neutron [req-2e344cd1-a4a7-40c0-9289-012625443e5d req-355ddb36-a7e5-4308-8fcb-ca8dfd809f76 service nova] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Updating instance_info_cache with network_info: [] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:18:11 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-2e344cd1-a4a7-40c0-9289-012625443e5d req-355ddb36-a7e5-4308-8fcb-ca8dfd809f76 service nova] Releasing lock "refresh_cache-27342ec6-7a03-4f99-8056-5cb56794aa41" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:18:12 user nova-compute[75226]: DEBUG nova.network.neutron [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Successfully updated port: 11a81061-cde2-4e09-88e4-678aead09ad5 {{(pid=75226) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 17 01:18:12 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Acquiring lock "refresh_cache-27342ec6-7a03-4f99-8056-5cb56794aa41" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:18:12 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Acquired lock "refresh_cache-27342ec6-7a03-4f99-8056-5cb56794aa41" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:18:12 user nova-compute[75226]: DEBUG nova.network.neutron [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Building network info cache for instance {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 01:18:12 user nova-compute[75226]: DEBUG nova.network.neutron [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Instance cache missing network info. {{(pid=75226) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 17 01:18:12 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:18:13 user nova-compute[75226]: DEBUG nova.compute.manager [req-1209192d-569c-4e62-bf1c-5de5d78602c1 req-10dfe4b2-a2b1-43ef-a9a5-0c49fc9f9352 service nova] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Received event network-changed-3c1a838d-e1c6-44d3-ab8a-a545044545a3 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:18:13 user nova-compute[75226]: DEBUG nova.compute.manager [req-1209192d-569c-4e62-bf1c-5de5d78602c1 req-10dfe4b2-a2b1-43ef-a9a5-0c49fc9f9352 service nova] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Refreshing instance network info cache due to event network-changed-3c1a838d-e1c6-44d3-ab8a-a545044545a3. {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 01:18:13 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-1209192d-569c-4e62-bf1c-5de5d78602c1 req-10dfe4b2-a2b1-43ef-a9a5-0c49fc9f9352 service nova] Acquiring lock "refresh_cache-27342ec6-7a03-4f99-8056-5cb56794aa41" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:18:14 user nova-compute[75226]: DEBUG nova.network.neutron [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Updating instance_info_cache with network_info: [{"id": "6337887b-565a-4dc6-9a4f-4c8d9ac1c901", "address": "fa:16:3e:fc:8e:ff", "network": {"id": "4d03345a-3dc2-4436-a30b-30b8015b649e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2116320858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "871db3f789ac470c877456108324c68c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6337887b-56", "ovs_interfaceid": "6337887b-565a-4dc6-9a4f-4c8d9ac1c901", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8a548a9b-874e-4c7c-bf06-6896dd773ce4", "address": "fa:16:3e:5b:b6:0c", "network": {"id": "df3c1bab-64f6-49c0-b35a-396881f5862f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1354339680", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "871db3f789ac470c877456108324c68c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a548a9b-87", "ovs_interfaceid": "8a548a9b-874e-4c7c-bf06-6896dd773ce4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "01625fc1-9bbc-4edc-b594-78658e91edd9", "address": "fa:16:3e:13:8d:33", "network": {"id": "df3c1bab-64f6-49c0-b35a-396881f5862f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1354339680", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.68", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "871db3f789ac470c877456108324c68c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01625fc1-9b", "ovs_interfaceid": "01625fc1-9bbc-4edc-b594-78658e91edd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3e4d946c-158b-49e8-a349-44da4864f830", "address": "fa:16:3e:65:64:f1", "network": {"id": "df3c1bab-64f6-49c0-b35a-396881f5862f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1354339680", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "871db3f789ac470c877456108324c68c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e4d946c-15", "ovs_interfaceid": "3e4d946c-158b-49e8-a349-44da4864f830", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3b1855a6-8a37-47af-b3e6-86e60eb05a1d", "address": "fa:16:3e:5e:6d:29", "network": {"id": "df3c1bab-64f6-49c0-b35a-396881f5862f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1354339680", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "871db3f789ac470c877456108324c68c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b1855a6-8a", "ovs_interfaceid": "3b1855a6-8a37-47af-b3e6-86e60eb05a1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3c1a838d-e1c6-44d3-ab8a-a545044545a3", "address": "fa:16:3e:47:9b:84", "network": {"id": "b92e4d90-c7bd-45d6-a9db-d4b27ce718c5", "bridge": "br-int", "label": "tempest-device-tagging-net2-541044549", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "871db3f789ac470c877456108324c68c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c1a838d-e1", "ovs_interfaceid": "3c1a838d-e1c6-44d3-ab8a-a545044545a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "11a81061-cde2-4e09-88e4-678aead09ad5", "address": "fa:16:3e:77:77:72", "network": {"id": "b92e4d90-c7bd-45d6-a9db-d4b27ce718c5", "bridge": "br-int", "label": "tempest-device-tagging-net2-541044549", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "871db3f789ac470c877456108324c68c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11a81061-cd", "ovs_interfaceid": "11a81061-cde2-4e09-88e4-678aead09ad5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:18:14 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Releasing lock "refresh_cache-27342ec6-7a03-4f99-8056-5cb56794aa41" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:18:14 user nova-compute[75226]: DEBUG nova.compute.manager [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Instance network_info: |[{"id": "6337887b-565a-4dc6-9a4f-4c8d9ac1c901", "address": "fa:16:3e:fc:8e:ff", "network": {"id": "4d03345a-3dc2-4436-a30b-30b8015b649e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2116320858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "871db3f789ac470c877456108324c68c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6337887b-56", "ovs_interfaceid": "6337887b-565a-4dc6-9a4f-4c8d9ac1c901", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8a548a9b-874e-4c7c-bf06-6896dd773ce4", "address": "fa:16:3e:5b:b6:0c", "network": {"id": "df3c1bab-64f6-49c0-b35a-396881f5862f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1354339680", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "871db3f789ac470c877456108324c68c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a548a9b-87", "ovs_interfaceid": "8a548a9b-874e-4c7c-bf06-6896dd773ce4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "01625fc1-9bbc-4edc-b594-78658e91edd9", "address": "fa:16:3e:13:8d:33", "network": {"id": "df3c1bab-64f6-49c0-b35a-396881f5862f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1354339680", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.68", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "871db3f789ac470c877456108324c68c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01625fc1-9b", "ovs_interfaceid": "01625fc1-9bbc-4edc-b594-78658e91edd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3e4d946c-158b-49e8-a349-44da4864f830", "address": "fa:16:3e:65:64:f1", "network": {"id": "df3c1bab-64f6-49c0-b35a-396881f5862f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1354339680", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "871db3f789ac470c877456108324c68c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e4d946c-15", "ovs_interfaceid": "3e4d946c-158b-49e8-a349-44da4864f830", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3b1855a6-8a37-47af-b3e6-86e60eb05a1d", "address": "fa:16:3e:5e:6d:29", "network": {"id": "df3c1bab-64f6-49c0-b35a-396881f5862f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1354339680", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "871db3f789ac470c877456108324c68c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b1855a6-8a", "ovs_interfaceid": "3b1855a6-8a37-47af-b3e6-86e60eb05a1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3c1a838d-e1c6-44d3-ab8a-a545044545a3", "address": "fa:16:3e:47:9b:84", "network": {"id": "b92e4d90-c7bd-45d6-a9db-d4b27ce718c5", "bridge": "br-int", "label": "tempest-device-tagging-net2-541044549", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "871db3f789ac470c877456108324c68c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c1a838d-e1", "ovs_interfaceid": "3c1a838d-e1c6-44d3-ab8a-a545044545a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "11a81061-cde2-4e09-88e4-678aead09ad5", "address": "fa:16:3e:77:77:72", "network": {"id": "b92e4d90-c7bd-45d6-a9db-d4b27ce718c5", "bridge": "br-int", "label": "tempest-device-tagging-net2-541044549", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "871db3f789ac470c877456108324c68c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11a81061-cd", "ovs_interfaceid": "11a81061-cde2-4e09-88e4-678aead09ad5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75226) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 17 01:18:14 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-1209192d-569c-4e62-bf1c-5de5d78602c1 req-10dfe4b2-a2b1-43ef-a9a5-0c49fc9f9352 service nova] Acquired lock "refresh_cache-27342ec6-7a03-4f99-8056-5cb56794aa41" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:18:14 user nova-compute[75226]: DEBUG nova.network.neutron [req-1209192d-569c-4e62-bf1c-5de5d78602c1 req-10dfe4b2-a2b1-43ef-a9a5-0c49fc9f9352 service nova] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Refreshing network info cache for port 3c1a838d-e1c6-44d3-ab8a-a545044545a3 {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 01:18:14 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:18:14 user nova-compute[75226]: DEBUG nova.network.neutron [req-1209192d-569c-4e62-bf1c-5de5d78602c1 req-10dfe4b2-a2b1-43ef-a9a5-0c49fc9f9352 service nova] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Updated VIF entry in instance network info cache for port 3c1a838d-e1c6-44d3-ab8a-a545044545a3. {{(pid=75226) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 01:18:14 user nova-compute[75226]: DEBUG nova.network.neutron [req-1209192d-569c-4e62-bf1c-5de5d78602c1 req-10dfe4b2-a2b1-43ef-a9a5-0c49fc9f9352 service nova] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Updating instance_info_cache with network_info: [{"id": "6337887b-565a-4dc6-9a4f-4c8d9ac1c901", "address": "fa:16:3e:fc:8e:ff", "network": {"id": "4d03345a-3dc2-4436-a30b-30b8015b649e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2116320858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "871db3f789ac470c877456108324c68c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6337887b-56", "ovs_interfaceid": "6337887b-565a-4dc6-9a4f-4c8d9ac1c901", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8a548a9b-874e-4c7c-bf06-6896dd773ce4", "address": "fa:16:3e:5b:b6:0c", "network": {"id": "df3c1bab-64f6-49c0-b35a-396881f5862f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1354339680", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "871db3f789ac470c877456108324c68c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a548a9b-87", "ovs_interfaceid": "8a548a9b-874e-4c7c-bf06-6896dd773ce4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "01625fc1-9bbc-4edc-b594-78658e91edd9", "address": "fa:16:3e:13:8d:33", "network": {"id": "df3c1bab-64f6-49c0-b35a-396881f5862f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1354339680", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.68", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "871db3f789ac470c877456108324c68c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01625fc1-9b", "ovs_interfaceid": "01625fc1-9bbc-4edc-b594-78658e91edd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3e4d946c-158b-49e8-a349-44da4864f830", "address": "fa:16:3e:65:64:f1", "network": {"id": "df3c1bab-64f6-49c0-b35a-396881f5862f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1354339680", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "871db3f789ac470c877456108324c68c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e4d946c-15", "ovs_interfaceid": "3e4d946c-158b-49e8-a349-44da4864f830", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3b1855a6-8a37-47af-b3e6-86e60eb05a1d", "address": "fa:16:3e:5e:6d:29", "network": {"id": "df3c1bab-64f6-49c0-b35a-396881f5862f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1354339680", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "871db3f789ac470c877456108324c68c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b1855a6-8a", "ovs_interfaceid": "3b1855a6-8a37-47af-b3e6-86e60eb05a1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3c1a838d-e1c6-44d3-ab8a-a545044545a3", "address": "fa:16:3e:47:9b:84", "network": {"id": "b92e4d90-c7bd-45d6-a9db-d4b27ce718c5", "bridge": "br-int", "label": "tempest-device-tagging-net2-541044549", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "871db3f789ac470c877456108324c68c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c1a838d-e1", "ovs_interfaceid": "3c1a838d-e1c6-44d3-ab8a-a545044545a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "11a81061-cde2-4e09-88e4-678aead09ad5", "address": "fa:16:3e:77:77:72", "network": {"id": "b92e4d90-c7bd-45d6-a9db-d4b27ce718c5", "bridge": "br-int", "label": "tempest-device-tagging-net2-541044549", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "871db3f789ac470c877456108324c68c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11a81061-cd", "ovs_interfaceid": "11a81061-cde2-4e09-88e4-678aead09ad5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:18:14 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-1209192d-569c-4e62-bf1c-5de5d78602c1 req-10dfe4b2-a2b1-43ef-a9a5-0c49fc9f9352 service nova] Releasing lock "refresh_cache-27342ec6-7a03-4f99-8056-5cb56794aa41" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:18:14 user nova-compute[75226]: DEBUG nova.compute.manager [req-1209192d-569c-4e62-bf1c-5de5d78602c1 req-10dfe4b2-a2b1-43ef-a9a5-0c49fc9f9352 service nova] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Received event network-changed-11a81061-cde2-4e09-88e4-678aead09ad5 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:18:14 user nova-compute[75226]: DEBUG nova.compute.manager [req-1209192d-569c-4e62-bf1c-5de5d78602c1 req-10dfe4b2-a2b1-43ef-a9a5-0c49fc9f9352 service nova] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Refreshing instance network info cache due to event network-changed-11a81061-cde2-4e09-88e4-678aead09ad5. {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 01:18:14 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-1209192d-569c-4e62-bf1c-5de5d78602c1 req-10dfe4b2-a2b1-43ef-a9a5-0c49fc9f9352 service nova] Acquiring lock "refresh_cache-27342ec6-7a03-4f99-8056-5cb56794aa41" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:18:14 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-1209192d-569c-4e62-bf1c-5de5d78602c1 req-10dfe4b2-a2b1-43ef-a9a5-0c49fc9f9352 service nova] Acquired lock "refresh_cache-27342ec6-7a03-4f99-8056-5cb56794aa41" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:18:14 user nova-compute[75226]: DEBUG nova.network.neutron [req-1209192d-569c-4e62-bf1c-5de5d78602c1 req-10dfe4b2-a2b1-43ef-a9a5-0c49fc9f9352 service nova] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Refreshing network info cache for port 11a81061-cde2-4e09-88e4-678aead09ad5 {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 01:18:14 user nova-compute[75226]: DEBUG nova.network.neutron [req-1209192d-569c-4e62-bf1c-5de5d78602c1 req-10dfe4b2-a2b1-43ef-a9a5-0c49fc9f9352 service nova] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Updated VIF entry in instance network info cache for port 11a81061-cde2-4e09-88e4-678aead09ad5. {{(pid=75226) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 01:18:14 user nova-compute[75226]: DEBUG nova.network.neutron [req-1209192d-569c-4e62-bf1c-5de5d78602c1 req-10dfe4b2-a2b1-43ef-a9a5-0c49fc9f9352 service nova] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Updating instance_info_cache with network_info: [{"id": "6337887b-565a-4dc6-9a4f-4c8d9ac1c901", "address": "fa:16:3e:fc:8e:ff", "network": {"id": "4d03345a-3dc2-4436-a30b-30b8015b649e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2116320858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "871db3f789ac470c877456108324c68c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6337887b-56", "ovs_interfaceid": "6337887b-565a-4dc6-9a4f-4c8d9ac1c901", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8a548a9b-874e-4c7c-bf06-6896dd773ce4", "address": "fa:16:3e:5b:b6:0c", "network": {"id": "df3c1bab-64f6-49c0-b35a-396881f5862f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1354339680", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "871db3f789ac470c877456108324c68c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a548a9b-87", "ovs_interfaceid": "8a548a9b-874e-4c7c-bf06-6896dd773ce4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "01625fc1-9bbc-4edc-b594-78658e91edd9", "address": "fa:16:3e:13:8d:33", "network": {"id": "df3c1bab-64f6-49c0-b35a-396881f5862f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1354339680", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.68", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "871db3f789ac470c877456108324c68c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01625fc1-9b", "ovs_interfaceid": "01625fc1-9bbc-4edc-b594-78658e91edd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3e4d946c-158b-49e8-a349-44da4864f830", "address": "fa:16:3e:65:64:f1", "network": {"id": "df3c1bab-64f6-49c0-b35a-396881f5862f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1354339680", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "871db3f789ac470c877456108324c68c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e4d946c-15", "ovs_interfaceid": "3e4d946c-158b-49e8-a349-44da4864f830", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3b1855a6-8a37-47af-b3e6-86e60eb05a1d", "address": "fa:16:3e:5e:6d:29", "network": {"id": "df3c1bab-64f6-49c0-b35a-396881f5862f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1354339680", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "871db3f789ac470c877456108324c68c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b1855a6-8a", "ovs_interfaceid": "3b1855a6-8a37-47af-b3e6-86e60eb05a1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3c1a838d-e1c6-44d3-ab8a-a545044545a3", "address": "fa:16:3e:47:9b:84", "network": {"id": "b92e4d90-c7bd-45d6-a9db-d4b27ce718c5", "bridge": "br-int", "label": "tempest-device-tagging-net2-541044549", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "871db3f789ac470c877456108324c68c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c1a838d-e1", "ovs_interfaceid": "3c1a838d-e1c6-44d3-ab8a-a545044545a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "11a81061-cde2-4e09-88e4-678aead09ad5", "address": "fa:16:3e:77:77:72", "network": {"id": "b92e4d90-c7bd-45d6-a9db-d4b27ce718c5", "bridge": "br-int", "label": "tempest-device-tagging-net2-541044549", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "871db3f789ac470c877456108324c68c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11a81061-cd", "ovs_interfaceid": "11a81061-cde2-4e09-88e4-678aead09ad5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:18:14 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-1209192d-569c-4e62-bf1c-5de5d78602c1 req-10dfe4b2-a2b1-43ef-a9a5-0c49fc9f9352 service nova] Releasing lock "refresh_cache-27342ec6-7a03-4f99-8056-5cb56794aa41" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:18:17 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:18:19 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:18:19 user nova-compute[75226]: INFO nova.virt.block_device [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Booting with volume d528018e-00b4-4d76-ae6d-5e3a0c863ed6 at /dev/vdc
Nov 17 01:18:20 user nova-compute[75226]: DEBUG os_brick.utils [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:18:20 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:18:20 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:18:20 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eae9f29-3c8a-4661-afc2-a6b02f9ff919]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f62857db69\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:18:20 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:18:20 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:18:20 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f4e7076-aab0-403a-9442-3d7dfbbbda55]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:18:20 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:18:20 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:18:20 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[797b9382-39d2-487a-8176-90fdee520a2c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:18:20 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4fc1e14-7bf1-4e00-9593-d0977d76cdca]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:18:20 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Running cmd (subprocess): nvme version {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:18:20 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] 'nvme version' failed. Not Retrying. {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 01:18:20 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.nvmeof [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] nvme not present on system {{(pid=75226) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 17 01:18:20 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:18:20 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 01:18:20 user nova-compute[75226]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 17 01:18:20 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9818bea-cc8e-4555-8a1c-da650d52ba34]: (4, '') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:18:20 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75226) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 17 01:18:20 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75226) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 17 01:18:20 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] LIGHTOS: no hostnqn found. {{(pid=75226) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 17 01:18:20 user nova-compute[75226]: DEBUG os_brick.utils [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f62857db69', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:18:20 user nova-compute[75226]: DEBUG nova.virt.block_device [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Updating existing volume attachment record: 0415f90c-2241-4b1f-90c5-0ec2100b6b39 {{(pid=75226) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 17 01:18:22 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:18:24 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:18:25 user nova-compute[75226]: DEBUG nova.compute.manager [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Start spawning the instance on the hypervisor. {{(pid=75226) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 17 01:18:25 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Creating instance directory {{(pid=75226) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 17 01:18:25 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Creating image(s)
Nov 17 01:18:25 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Did not create local disks {{(pid=75226) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 17 01:18:25 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Ensure instance console log exists: /opt/stack/data/nova/instances/27342ec6-7a03-4f99-8056-5cb56794aa41/console.log {{(pid=75226) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 17 01:18:25 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:18:25 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:18:25 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:18:25 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Start _get_guest_xml network_info=[{"id": "6337887b-565a-4dc6-9a4f-4c8d9ac1c901", "address": "fa:16:3e:fc:8e:ff", "network": {"id": "4d03345a-3dc2-4436-a30b-30b8015b649e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2116320858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "871db3f789ac470c877456108324c68c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6337887b-56", "ovs_interfaceid": "6337887b-565a-4dc6-9a4f-4c8d9ac1c901", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8a548a9b-874e-4c7c-bf06-6896dd773ce4", "address": "fa:16:3e:5b:b6:0c", "network": {"id": "df3c1bab-64f6-49c0-b35a-396881f5862f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1354339680", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "871db3f789ac470c877456108324c68c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a548a9b-87", "ovs_interfaceid": "8a548a9b-874e-4c7c-bf06-6896dd773ce4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "01625fc1-9bbc-4edc-b594-78658e91edd9", "address": "fa:16:3e:13:8d:33", "network": {"id": "df3c1bab-64f6-49c0-b35a-396881f5862f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1354339680", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.68", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "871db3f789ac470c877456108324c68c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01625fc1-9b", "ovs_interfaceid": "01625fc1-9bbc-4edc-b594-78658e91edd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3e4d946c-158b-49e8-a349-44da4864f830", "address": "fa:16:3e:65:64:f1", "network": {"id": "df3c1bab-64f6-49c0-b35a-396881f5862f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1354339680", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "871db3f789ac470c877456108324c68c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e4d946c-15", "ovs_interfaceid": "3e4d946c-158b-49e8-a349-44da4864f830", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3b1855a6-8a37-47af-b3e6-86e60eb05a1d", "address": "fa:16:3e:5e:6d:29", "network": {"id": "df3c1bab-64f6-49c0-b35a-396881f5862f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1354339680", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "871db3f789ac470c877456108324c68c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b1855a6-8a", "ovs_interfaceid": "3b1855a6-8a37-47af-b3e6-86e60eb05a1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3c1a838d-e1c6-44d3-ab8a-a545044545a3", "address": "fa:16:3e:47:9b:84", "network": {"id": "b92e4d90-c7bd-45d6-a9db-d4b27ce718c5", "bridge": "br-int", "label": "tempest-device-tagging-net2-541044549", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "871db3f789ac470c877456108324c68c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c1a838d-e1", "ovs_interfaceid": "3c1a838d-e1c6-44d3-ab8a-a545044545a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "11a81061-cde2-4e09-88e4-678aead09ad5", "address": "fa:16:3e:77:77:72", "network": {"id": "b92e4d90-c7bd-45d6-a9db-d4b27ce718c5", "bridge": "br-int", "label": "tempest-device-tagging-net2-541044549", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "871db3f789ac470c877456108324c68c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11a81061-cd", "ovs_interfaceid": "11a81061-cde2-4e09-88e4-678aead09ad5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T01:13:22Z,direct_url=<?>,disk_format='qcow2',id=0b369aea-6f3f-4690-9f01-229b90ab6310,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4e110cbf9a84362a6864a7732c435a1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T01:13:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LvBusbOF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '27342ec6-7a03-4f99-8056-5cb56794aa41', 'attached_at': '', 'detached_at': '', 'volume_id': '02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae', 'serial': '02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae'}, 'attachment_id': 'd53f9d4f-a088-4ece-a744-802ef9cffcd3', 'device_type': 'disk', 'volume_type': None}, {'delete_on_termination': False, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'boot_index': 1, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fHjPumtD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '27342ec6-7a03-4f99-8056-5cb56794aa41', 'attached_at': '', 'detached_at': '', 'volume_id': '324e7042-63b3-44d8-b18d-8201b88923a1', 'serial': '324e7042-63b3-44d8-b18d-8201b88923a1'}, 'attachment_id': '7d2420a8-f7ac-409a-89c5-fc27c754866b', 'device_type': 'disk', 'volume_type': None}, {'delete_on_termination': False, 'mount_device': '/dev/vdc', 'disk_bus': 'virtio', 'boot_index': 2, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TrwJzOak', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '27342ec6-7a03-4f99-8056-5cb56794aa41', 'attached_at': '', 'detached_at': '', 'volume_id': 'd528018e-00b4-4d76-ae6d-5e3a0c863ed6', 'serial': 'd528018e-00b4-4d76-ae6d-5e3a0c863ed6'}, 'attachment_id': '0415f90c-2241-4b1f-90c5-0ec2100b6b39', 'device_type': 'disk', 'volume_type': None} {{(pid=75226) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 17 01:18:25 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:18:25 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:18:25 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75226) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 17 01:18:25 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] CPU controller missing on host. {{(pid=75226) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 17 01:18:25 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75226) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 17 01:18:25 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] CPU controller found on host. {{(pid=75226) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 17 01:18:25 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75226) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 17 01:18:25 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-17T01:13:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T01:13:22Z,direct_url=<?>,disk_format='qcow2',id=0b369aea-6f3f-4690-9f01-229b90ab6310,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4e110cbf9a84362a6864a7732c435a1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T01:13:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 17 01:18:25 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Flavor limits 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 17 01:18:25 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Image limits 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 17 01:18:25 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Flavor pref 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 17 01:18:25 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Image pref 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 17 01:18:25 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 17 01:18:25 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 17 01:18:25 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75226) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 17 01:18:25 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Got 1 possible topologies {{(pid=75226) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 17 01:18:25 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 17 01:18:25 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 17 01:18:25 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Calling os-brick to attach iSCSI Volume {{(pid=75226) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 17 01:18:25 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc4cc36b490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LvBusbOF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:18:25 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:18:25 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:18:25 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:18:25 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:18:25 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:18:25 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:18:25 user nova-compute[75226]: INFO os_brick.initiator.connectors.iscsi [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 17 01:18:25 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae -p 172.16.0.220:3260 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:18:25 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:18:25 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ad57d39-92e5-4c80-a298-2bc91ece7ce4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:18:25 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 17 01:18:25 user nova-compute[75226]:  {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:18:25 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae -p 172.16.0.220:3260 --interface default --op new {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:18:25 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:18:25 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e243363-1cc4-40d8-a8e8-6e86e6fe613b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae] added\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:18:25 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae] added
Nov 17 01:18:25 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:18:25 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:18:25 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:18:25 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2e9b22e-4b18-49dc-a12b-b30c25e45aa6]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:18:25 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:18:25 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:18:26 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:18:26 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e289623-2284-44dd-9000-48f85143b36c]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:18:26 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:18:26 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LvBusbOF {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:18:26 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LvBusbOF" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:18:26 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d2871fd-ef16-4e00-a5ed-dde405741e0b]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:18:26 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LvBusbOF'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:18:26 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:18:26 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:18:26 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1a1360c-69e3-45ef-9552-7df248e01a9f]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:18:26 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:18:26 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:18:26 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:18:26 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3e46e78-237e-45af-ae3b-1961441fa228]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:18:26 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2 (non-flash)
Nov 17 01:18:26 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:18:26 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2 (non-flash)
Nov 17 01:18:26 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:18:26 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae -p 172.16.0.220:3260 --login {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:18:26 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:18:26 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[60c3acf3-266f-46d0-9cbf-41e19b31b3df]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:18:26 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae, portal: 172.16.0.220,3260]
Nov 17 01:18:26 user nova-compute[75226]: Login to [iface: default, target: iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae, portal: 172.16.0.220,3260] successful.
Nov 17 01:18:26 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:18:26 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:18:26 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:18:26 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7147710-6b81-44d8-8453-1f239ba4796e]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:18:26 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:18:26 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:18:26 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:18:26 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[967906d0-6ba2-4f5b-87dd-9a4a6ecec4f3]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:18:26 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2 (non-flash)
Nov 17 01:18:26 user nova-compute[75226]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae (non-flash)
Nov 17 01:18:26 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:18:26 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2 (non-flash)
Nov 17 01:18:26 user nova-compute[75226]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae (non-flash)
Nov 17 01:18:26 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:18:26 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.243s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:18:26 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Connected to 172.16.0.220:3260 {{(pid=75226) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 17 01:18:26 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=75226) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 17 01:18:26 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75226) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 17 01:18:26 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:18:26 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:18:26 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[98515a39-8125-4ee3-9685-ef1df8c79ad1]: (4, ('- - 0', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:18:26 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75226) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 01:18:26 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LvBusbOF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75226) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 17 01:18:27 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.276s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:18:27 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] <== connect_volume: return (1278ms) {'type': 'block', 'scsi_wwn': '23164663265366435', 'path': '/dev/sdc'} {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:18:27 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23164663265366435', 'path': '/dev/sdc'} {{(pid=75226) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 17 01:18:27 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Calling os-brick to attach iSCSI Volume {{(pid=75226) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 17 01:18:27 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc4cc36b490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fHjPumtD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:18:27 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:18:27 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:18:27 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:18:27 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:18:27 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:18:27 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:18:27 user nova-compute[75226]: INFO os_brick.initiator.connectors.iscsi [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 17 01:18:27 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1 -p 172.16.0.220:3260 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:18:27 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:18:27 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3ce0c49-4052-49cb-89f6-5cbc19313f0e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:18:27 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 17 01:18:27 user nova-compute[75226]:  {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:18:27 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1 -p 172.16.0.220:3260 --interface default --op new {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:18:27 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:18:27 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3b889fe-e24d-4320-8cb4-76571c671daf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1] added\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:18:27 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1] added
Nov 17 01:18:27 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:18:27 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:18:27 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:18:27 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2926721-fe4f-448c-8960-afbfcaa9417e]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:18:27 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:18:27 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:18:27 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:18:27 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:18:27 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[6607b8ed-3edb-4ef8-ae02-6dde32257c57]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:18:27 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:18:27 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fHjPumtD {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:18:27 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fHjPumtD" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:18:27 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[87ba30c9-c9fc-4832-880c-52aaff1ffa8d]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:18:27 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fHjPumtD'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:18:27 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:18:27 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:18:27 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fa90840-7885-43f4-9089-9d0b6363b93b]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:18:27 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:18:27 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:18:27 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:18:27 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[1da4fd0a-a06f-44d6-9ab8-46931ba2dc39]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:18:27 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2 (non-flash)
Nov 17 01:18:27 user nova-compute[75226]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae (non-flash)
Nov 17 01:18:27 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:18:27 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2 (non-flash)
Nov 17 01:18:27 user nova-compute[75226]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae (non-flash)
Nov 17 01:18:27 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:18:27 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1 -p 172.16.0.220:3260 --login {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:18:27 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:18:27 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[87b151b5-7dbb-40b0-b613-da0dbae73703]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:18:27 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1, portal: 172.16.0.220,3260]
Nov 17 01:18:27 user nova-compute[75226]: Login to [iface: default, target: iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1, portal: 172.16.0.220,3260] successful.
Nov 17 01:18:27 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:18:27 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:18:27 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:18:27 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ca59003-4b01-4bbe-bc9f-f6fc389352fd]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:18:27 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:18:27 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:18:27 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:18:27 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7d22d9f-00ed-4040-9419-52883a13166e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:18:27 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2 (non-flash)
Nov 17 01:18:27 user nova-compute[75226]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae (non-flash)
Nov 17 01:18:27 user nova-compute[75226]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1 (non-flash)
Nov 17 01:18:27 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:18:27 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2 (non-flash)
Nov 17 01:18:27 user nova-compute[75226]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae (non-flash)
Nov 17 01:18:27 user nova-compute[75226]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1 (non-flash)
Nov 17 01:18:27 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:18:27 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:18:27 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Connected to 172.16.0.220:3260 {{(pid=75226) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 17 01:18:27 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=75226) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 17 01:18:27 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75226) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 17 01:18:27 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:18:27 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.014s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:18:27 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbeade73-0328-4785-926e-b4714e9ccb7a]: (4, ('- - 0', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:18:27 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: None {{(pid=75226) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 01:18:28 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75226) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 01:18:28 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fHjPumtD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75226) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 17 01:18:28 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.309s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:18:28 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] <== connect_volume: return (1310ms) {'type': 'block', 'scsi_wwn': '26637323965353664', 'path': '/dev/sdd'} {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:18:28 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26637323965353664', 'path': '/dev/sdd'} {{(pid=75226) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 17 01:18:28 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Calling os-brick to attach iSCSI Volume {{(pid=75226) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 17 01:18:28 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc4cc36b490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TrwJzOak', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:18:28 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:18:28 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:18:28 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:18:28 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:18:28 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:18:28 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:18:28 user nova-compute[75226]: INFO os_brick.initiator.connectors.iscsi [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 17 01:18:28 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6 -p 172.16.0.220:3260 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:18:28 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:18:28 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cd2c82e-ca70-48ec-9f12-3efeb66c347a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:18:28 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 17 01:18:28 user nova-compute[75226]:  {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:18:28 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6 -p 172.16.0.220:3260 --interface default --op new {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:18:28 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:18:28 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca8c0c15-da60-42cf-8bfb-ce2da2f66004]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6] added\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:18:28 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6] added
Nov 17 01:18:28 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:18:28 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:18:28 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:18:28 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[e727ee68-be06-45b5-9549-face1924833e]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:18:28 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:18:28 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:18:28 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:18:28 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[76fa4864-d4d4-41cb-aee2-f9ffac195511]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:18:28 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:18:28 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TrwJzOak {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:18:28 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TrwJzOak" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:18:28 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[f16d938f-94d8-4ec3-997a-9dd38488f161]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:18:28 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TrwJzOak'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:18:28 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:18:28 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:18:28 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[24d87fbc-c31f-4f0b-92f6-bf443c2d843a]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:18:28 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:18:28 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:18:28 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:18:28 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a95601b-a248-4b96-a11f-df0054c16c6f]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:18:28 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2 (non-flash)
Nov 17 01:18:28 user nova-compute[75226]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae (non-flash)
Nov 17 01:18:28 user nova-compute[75226]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1 (non-flash)
Nov 17 01:18:28 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:18:28 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2 (non-flash)
Nov 17 01:18:28 user nova-compute[75226]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae (non-flash)
Nov 17 01:18:28 user nova-compute[75226]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1 (non-flash)
Nov 17 01:18:28 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:18:28 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6 -p 172.16.0.220:3260 --login {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:18:28 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:18:28 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[2504d873-799b-423f-a858-11ce5eda6a61]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:18:28 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6, portal: 172.16.0.220,3260]
Nov 17 01:18:28 user nova-compute[75226]: Login to [iface: default, target: iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6, portal: 172.16.0.220,3260] successful.
Nov 17 01:18:28 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:18:28 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:18:28 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:18:28 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[09e4ecba-73e3-442c-9192-c33b5a067c4c]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:18:28 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:18:28 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:18:28 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:18:28 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b19b909-cdbf-4fcf-903e-9eebc3025de3]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:18:28 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2 (non-flash)
Nov 17 01:18:28 user nova-compute[75226]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae (non-flash)
Nov 17 01:18:28 user nova-compute[75226]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1 (non-flash)
Nov 17 01:18:28 user nova-compute[75226]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6 (non-flash)
Nov 17 01:18:28 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:18:28 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2 (non-flash)
Nov 17 01:18:28 user nova-compute[75226]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae (non-flash)
Nov 17 01:18:28 user nova-compute[75226]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1 (non-flash)
Nov 17 01:18:28 user nova-compute[75226]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6 (non-flash)
Nov 17 01:18:28 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:18:28 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.271s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:18:28 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Connected to 172.16.0.220:3260 {{(pid=75226) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 17 01:18:28 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=75226) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 17 01:18:28 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75226) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 17 01:18:28 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:18:28 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:18:28 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[73814a1f-c78d-49bb-87e5-baa1356a8b77]: (4, ('- - 0', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:18:28 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75226) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 01:18:28 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TrwJzOak', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75226) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 17 01:18:29 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:18:29 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.305s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:18:29 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] <== connect_volume: return (1306ms) {'type': 'block', 'scsi_wwn': '26532373036366331', 'path': '/dev/sde'} {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:18:29 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26532373036366331', 'path': '/dev/sde'} {{(pid=75226) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 17 01:18:29 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-17T01:17:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1660208825',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1660208825',id=10,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO4+E9QOiUnWNUKrI+j17EMQbFyLd21Wqpo/hRvSEijsTxwF94lMxe3826dGGI7fte9gqEiKOU9O8ocJVagllay2w4NWQRzLkq112cs0QLNwHnmiDDocCj/FpieRw6NKiw==',key_name='tempest-keypair-413268072',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='871db3f789ac470c877456108324c68c',ramdisk_id='',reservation_id='r-e00nhfhr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1790286385',owner_user_name='tempest-TaggedBootDevicesTest-1790286385-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T01:18:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b54686e817042a28596953dde26d329',uuid=27342ec6-7a03-4f99-8056-5cb56794aa41,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6337887b-565a-4dc6-9a4f-4c8d9ac1c901", "address": "fa:16:3e:fc:8e:ff", "network": {"id": "4d03345a-3dc2-4436-a30b-30b8015b649e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2116320858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "871db3f789ac470c877456108324c68c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6337887b-56", "ovs_interfaceid": "6337887b-565a-4dc6-9a4f-4c8d9ac1c901", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75226) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 01:18:29 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Converting VIF {"id": "6337887b-565a-4dc6-9a4f-4c8d9ac1c901", "address": "fa:16:3e:fc:8e:ff", "network": {"id": "4d03345a-3dc2-4436-a30b-30b8015b649e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2116320858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "871db3f789ac470c877456108324c68c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6337887b-56", "ovs_interfaceid": "6337887b-565a-4dc6-9a4f-4c8d9ac1c901", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:18:29 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:8e:ff,bridge_name='br-int',has_traffic_filtering=True,id=6337887b-565a-4dc6-9a4f-4c8d9ac1c901,network=Network(4d03345a-3dc2-4436-a30b-30b8015b649e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6337887b-56') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:18:29 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-17T01:17:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1660208825',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1660208825',id=10,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO4+E9QOiUnWNUKrI+j17EMQbFyLd21Wqpo/hRvSEijsTxwF94lMxe3826dGGI7fte9gqEiKOU9O8ocJVagllay2w4NWQRzLkq112cs0QLNwHnmiDDocCj/FpieRw6NKiw==',key_name='tempest-keypair-413268072',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='871db3f789ac470c877456108324c68c',ramdisk_id='',reservation_id='r-e00nhfhr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1790286385',owner_user_name='tempest-TaggedBootDevicesTest-1790286385-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T01:18:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b54686e817042a28596953dde26d329',uuid=27342ec6-7a03-4f99-8056-5cb56794aa41,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8a548a9b-874e-4c7c-bf06-6896dd773ce4", "address": "fa:16:3e:5b:b6:0c", "network": {"id": "df3c1bab-64f6-49c0-b35a-396881f5862f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1354339680", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "871db3f789ac470c877456108324c68c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a548a9b-87", "ovs_interfaceid": "8a548a9b-874e-4c7c-bf06-6896dd773ce4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75226) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 01:18:29 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Converting VIF {"id": "8a548a9b-874e-4c7c-bf06-6896dd773ce4", "address": "fa:16:3e:5b:b6:0c", "network": {"id": "df3c1bab-64f6-49c0-b35a-396881f5862f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1354339680", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "871db3f789ac470c877456108324c68c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a548a9b-87", "ovs_interfaceid": "8a548a9b-874e-4c7c-bf06-6896dd773ce4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:18:29 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:b6:0c,bridge_name='br-int',has_traffic_filtering=True,id=8a548a9b-874e-4c7c-bf06-6896dd773ce4,network=Network(df3c1bab-64f6-49c0-b35a-396881f5862f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8a548a9b-87') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:18:29 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-17T01:17:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1660208825',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1660208825',id=10,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO4+E9QOiUnWNUKrI+j17EMQbFyLd21Wqpo/hRvSEijsTxwF94lMxe3826dGGI7fte9gqEiKOU9O8ocJVagllay2w4NWQRzLkq112cs0QLNwHnmiDDocCj/FpieRw6NKiw==',key_name='tempest-keypair-413268072',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='871db3f789ac470c877456108324c68c',ramdisk_id='',reservation_id='r-e00nhfhr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1790286385',owner_user_name='tempest-TaggedBootDevicesTest-1790286385-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T01:18:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b54686e817042a28596953dde26d329',uuid=27342ec6-7a03-4f99-8056-5cb56794aa41,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "01625fc1-9bbc-4edc-b594-78658e91edd9", "address": "fa:16:3e:13:8d:33", "network": {"id": "df3c1bab-64f6-49c0-b35a-396881f5862f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1354339680", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.68", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "871db3f789ac470c877456108324c68c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01625fc1-9b", "ovs_interfaceid": "01625fc1-9bbc-4edc-b594-78658e91edd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75226) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 01:18:29 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Converting VIF {"id": "01625fc1-9bbc-4edc-b594-78658e91edd9", "address": "fa:16:3e:13:8d:33", "network": {"id": "df3c1bab-64f6-49c0-b35a-396881f5862f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1354339680", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.68", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "871db3f789ac470c877456108324c68c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01625fc1-9b", "ovs_interfaceid": "01625fc1-9bbc-4edc-b594-78658e91edd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:18:29 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:8d:33,bridge_name='br-int',has_traffic_filtering=True,id=01625fc1-9bbc-4edc-b594-78658e91edd9,network=Network(df3c1bab-64f6-49c0-b35a-396881f5862f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap01625fc1-9b') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:18:29 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-17T01:17:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1660208825',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1660208825',id=10,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO4+E9QOiUnWNUKrI+j17EMQbFyLd21Wqpo/hRvSEijsTxwF94lMxe3826dGGI7fte9gqEiKOU9O8ocJVagllay2w4NWQRzLkq112cs0QLNwHnmiDDocCj/FpieRw6NKiw==',key_name='tempest-keypair-413268072',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='871db3f789ac470c877456108324c68c',ramdisk_id='',reservation_id='r-e00nhfhr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1790286385',owner_user_name='tempest-TaggedBootDevicesTest-1790286385-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T01:18:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b54686e817042a28596953dde26d329',uuid=27342ec6-7a03-4f99-8056-5cb56794aa41,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3e4d946c-158b-49e8-a349-44da4864f830", "address": "fa:16:3e:65:64:f1", "network": {"id": "df3c1bab-64f6-49c0-b35a-396881f5862f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1354339680", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "871db3f789ac470c877456108324c68c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e4d946c-15", "ovs_interfaceid": "3e4d946c-158b-49e8-a349-44da4864f830", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75226) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 01:18:29 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Converting VIF {"id": "3e4d946c-158b-49e8-a349-44da4864f830", "address": "fa:16:3e:65:64:f1", "network": {"id": "df3c1bab-64f6-49c0-b35a-396881f5862f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1354339680", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "871db3f789ac470c877456108324c68c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e4d946c-15", "ovs_interfaceid": "3e4d946c-158b-49e8-a349-44da4864f830", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:18:29 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:64:f1,bridge_name='br-int',has_traffic_filtering=True,id=3e4d946c-158b-49e8-a349-44da4864f830,network=Network(df3c1bab-64f6-49c0-b35a-396881f5862f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e4d946c-15') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:18:29 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-17T01:17:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1660208825',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1660208825',id=10,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO4+E9QOiUnWNUKrI+j17EMQbFyLd21Wqpo/hRvSEijsTxwF94lMxe3826dGGI7fte9gqEiKOU9O8ocJVagllay2w4NWQRzLkq112cs0QLNwHnmiDDocCj/FpieRw6NKiw==',key_name='tempest-keypair-413268072',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='871db3f789ac470c877456108324c68c',ramdisk_id='',reservation_id='r-e00nhfhr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1790286385',owner_user_name='tempest-TaggedBootDevicesTest-1790286385-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T01:18:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b54686e817042a28596953dde26d329',uuid=27342ec6-7a03-4f99-8056-5cb56794aa41,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3b1855a6-8a37-47af-b3e6-86e60eb05a1d", "address": "fa:16:3e:5e:6d:29", "network": {"id": "df3c1bab-64f6-49c0-b35a-396881f5862f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1354339680", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "871db3f789ac470c877456108324c68c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b1855a6-8a", "ovs_interfaceid": "3b1855a6-8a37-47af-b3e6-86e60eb05a1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75226) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 01:18:29 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Converting VIF {"id": "3b1855a6-8a37-47af-b3e6-86e60eb05a1d", "address": "fa:16:3e:5e:6d:29", "network": {"id": "df3c1bab-64f6-49c0-b35a-396881f5862f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1354339680", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "871db3f789ac470c877456108324c68c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b1855a6-8a", "ovs_interfaceid": "3b1855a6-8a37-47af-b3e6-86e60eb05a1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:18:29 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:6d:29,bridge_name='br-int',has_traffic_filtering=True,id=3b1855a6-8a37-47af-b3e6-86e60eb05a1d,network=Network(df3c1bab-64f6-49c0-b35a-396881f5862f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b1855a6-8a') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:18:29 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-17T01:17:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1660208825',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1660208825',id=10,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO4+E9QOiUnWNUKrI+j17EMQbFyLd21Wqpo/hRvSEijsTxwF94lMxe3826dGGI7fte9gqEiKOU9O8ocJVagllay2w4NWQRzLkq112cs0QLNwHnmiDDocCj/FpieRw6NKiw==',key_name='tempest-keypair-413268072',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='871db3f789ac470c877456108324c68c',ramdisk_id='',reservation_id='r-e00nhfhr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1790286385',owner_user_name='tempest-TaggedBootDevicesTest-1790286385-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T01:18:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b54686e817042a28596953dde26d329',uuid=27342ec6-7a03-4f99-8056-5cb56794aa41,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3c1a838d-e1c6-44d3-ab8a-a545044545a3", "address": "fa:16:3e:47:9b:84", "network": {"id": "b92e4d90-c7bd-45d6-a9db-d4b27ce718c5", "bridge": "br-int", "label": "tempest-device-tagging-net2-541044549", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "871db3f789ac470c877456108324c68c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c1a838d-e1", "ovs_interfaceid": "3c1a838d-e1c6-44d3-ab8a-a545044545a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75226) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 01:18:29 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Converting VIF {"id": "3c1a838d-e1c6-44d3-ab8a-a545044545a3", "address": "fa:16:3e:47:9b:84", "network": {"id": "b92e4d90-c7bd-45d6-a9db-d4b27ce718c5", "bridge": "br-int", "label": "tempest-device-tagging-net2-541044549", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "871db3f789ac470c877456108324c68c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c1a838d-e1", "ovs_interfaceid": "3c1a838d-e1c6-44d3-ab8a-a545044545a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:18:29 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:9b:84,bridge_name='br-int',has_traffic_filtering=True,id=3c1a838d-e1c6-44d3-ab8a-a545044545a3,network=Network(b92e4d90-c7bd-45d6-a9db-d4b27ce718c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c1a838d-e1') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:18:29 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-17T01:17:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1660208825',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1660208825',id=10,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO4+E9QOiUnWNUKrI+j17EMQbFyLd21Wqpo/hRvSEijsTxwF94lMxe3826dGGI7fte9gqEiKOU9O8ocJVagllay2w4NWQRzLkq112cs0QLNwHnmiDDocCj/FpieRw6NKiw==',key_name='tempest-keypair-413268072',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='871db3f789ac470c877456108324c68c',ramdisk_id='',reservation_id='r-e00nhfhr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1790286385',owner_user_name='tempest-TaggedBootDevicesTest-1790286385-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T01:18:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b54686e817042a28596953dde26d329',uuid=27342ec6-7a03-4f99-8056-5cb56794aa41,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "11a81061-cde2-4e09-88e4-678aead09ad5", "address": "fa:16:3e:77:77:72", "network": {"id": "b92e4d90-c7bd-45d6-a9db-d4b27ce718c5", "bridge": "br-int", "label": "tempest-device-tagging-net2-541044549", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "871db3f789ac470c877456108324c68c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11a81061-cd", "ovs_interfaceid": "11a81061-cde2-4e09-88e4-678aead09ad5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75226) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 01:18:29 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Converting VIF {"id": "11a81061-cde2-4e09-88e4-678aead09ad5", "address": "fa:16:3e:77:77:72", "network": {"id": "b92e4d90-c7bd-45d6-a9db-d4b27ce718c5", "bridge": "br-int", "label": "tempest-device-tagging-net2-541044549", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "871db3f789ac470c877456108324c68c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11a81061-cd", "ovs_interfaceid": "11a81061-cde2-4e09-88e4-678aead09ad5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:18:29 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:77:72,bridge_name='br-int',has_traffic_filtering=True,id=11a81061-cde2-4e09-88e4-678aead09ad5,network=Network(b92e4d90-c7bd-45d6-a9db-d4b27ce718c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11a81061-cd') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:18:29 user nova-compute[75226]: DEBUG nova.objects.instance [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Lazy-loading 'pci_devices' on Instance uuid 27342ec6-7a03-4f99-8056-5cb56794aa41 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:18:29 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] End _get_guest_xml xml=<domain type="kvm">
Nov 17 01:18:29 user nova-compute[75226]:   <uuid>27342ec6-7a03-4f99-8056-5cb56794aa41</uuid>
Nov 17 01:18:29 user nova-compute[75226]:   <name>instance-0000000a</name>
Nov 17 01:18:29 user nova-compute[75226]:   <memory>524288</memory>
Nov 17 01:18:29 user nova-compute[75226]:   <vcpu>1</vcpu>
Nov 17 01:18:29 user nova-compute[75226]:   <metadata>
Nov 17 01:18:29 user nova-compute[75226]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 17 01:18:29 user nova-compute[75226]:       <nova:package version="0.0.0"/>
Nov 17 01:18:29 user nova-compute[75226]:       <nova:name>tempest-device-tagging-server-1660208825</nova:name>
Nov 17 01:18:29 user nova-compute[75226]:       <nova:creationTime>2023-11-17 01:18:25</nova:creationTime>
Nov 17 01:18:29 user nova-compute[75226]:       <nova:flavor name="m1.tiny">
Nov 17 01:18:29 user nova-compute[75226]:         <nova:memory>512</nova:memory>
Nov 17 01:18:29 user nova-compute[75226]:         <nova:disk>1</nova:disk>
Nov 17 01:18:29 user nova-compute[75226]:         <nova:swap>0</nova:swap>
Nov 17 01:18:29 user nova-compute[75226]:         <nova:ephemeral>0</nova:ephemeral>
Nov 17 01:18:29 user nova-compute[75226]:         <nova:vcpus>1</nova:vcpus>
Nov 17 01:18:29 user nova-compute[75226]:       </nova:flavor>
Nov 17 01:18:29 user nova-compute[75226]:       <nova:owner>
Nov 17 01:18:29 user nova-compute[75226]:         <nova:user uuid="0b54686e817042a28596953dde26d329">tempest-TaggedBootDevicesTest-1790286385-project-member</nova:user>
Nov 17 01:18:29 user nova-compute[75226]:         <nova:project uuid="871db3f789ac470c877456108324c68c">tempest-TaggedBootDevicesTest-1790286385</nova:project>
Nov 17 01:18:29 user nova-compute[75226]:       </nova:owner>
Nov 17 01:18:29 user nova-compute[75226]:       <nova:root type="image" uuid="0b369aea-6f3f-4690-9f01-229b90ab6310"/>
Nov 17 01:18:29 user nova-compute[75226]:       <nova:ports>
Nov 17 01:18:29 user nova-compute[75226]:         <nova:port uuid="6337887b-565a-4dc6-9a4f-4c8d9ac1c901">
Nov 17 01:18:29 user nova-compute[75226]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 17 01:18:29 user nova-compute[75226]:         </nova:port>
Nov 17 01:18:29 user nova-compute[75226]:         <nova:port uuid="8a548a9b-874e-4c7c-bf06-6896dd773ce4">
Nov 17 01:18:29 user nova-compute[75226]:           <nova:ip type="fixed" address="10.1.1.32" ipVersion="4"/>
Nov 17 01:18:29 user nova-compute[75226]:         </nova:port>
Nov 17 01:18:29 user nova-compute[75226]:         <nova:port uuid="01625fc1-9bbc-4edc-b594-78658e91edd9">
Nov 17 01:18:29 user nova-compute[75226]:           <nova:ip type="fixed" address="10.1.1.68" ipVersion="4"/>
Nov 17 01:18:29 user nova-compute[75226]:         </nova:port>
Nov 17 01:18:29 user nova-compute[75226]:         <nova:port uuid="3e4d946c-158b-49e8-a349-44da4864f830">
Nov 17 01:18:29 user nova-compute[75226]:           <nova:ip type="fixed" address="10.1.1.70" ipVersion="4"/>
Nov 17 01:18:29 user nova-compute[75226]:         </nova:port>
Nov 17 01:18:29 user nova-compute[75226]:         <nova:port uuid="3b1855a6-8a37-47af-b3e6-86e60eb05a1d">
Nov 17 01:18:29 user nova-compute[75226]:           <nova:ip type="fixed" address="10.1.1.16" ipVersion="4"/>
Nov 17 01:18:29 user nova-compute[75226]:         </nova:port>
Nov 17 01:18:29 user nova-compute[75226]:         <nova:port uuid="3c1a838d-e1c6-44d3-ab8a-a545044545a3">
Nov 17 01:18:29 user nova-compute[75226]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 17 01:18:29 user nova-compute[75226]:         </nova:port>
Nov 17 01:18:29 user nova-compute[75226]:         <nova:port uuid="11a81061-cde2-4e09-88e4-678aead09ad5">
Nov 17 01:18:29 user nova-compute[75226]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 17 01:18:29 user nova-compute[75226]:         </nova:port>
Nov 17 01:18:29 user nova-compute[75226]:       </nova:ports>
Nov 17 01:18:29 user nova-compute[75226]:     </nova:instance>
Nov 17 01:18:29 user nova-compute[75226]:   </metadata>
Nov 17 01:18:29 user nova-compute[75226]:   <sysinfo type="smbios">
Nov 17 01:18:29 user nova-compute[75226]:     <system>
Nov 17 01:18:29 user nova-compute[75226]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 17 01:18:29 user nova-compute[75226]:       <entry name="product">OpenStack Nova</entry>
Nov 17 01:18:29 user nova-compute[75226]:       <entry name="version">0.0.0</entry>
Nov 17 01:18:29 user nova-compute[75226]:       <entry name="serial">27342ec6-7a03-4f99-8056-5cb56794aa41</entry>
Nov 17 01:18:29 user nova-compute[75226]:       <entry name="uuid">27342ec6-7a03-4f99-8056-5cb56794aa41</entry>
Nov 17 01:18:29 user nova-compute[75226]:       <entry name="family">Virtual Machine</entry>
Nov 17 01:18:29 user nova-compute[75226]:     </system>
Nov 17 01:18:29 user nova-compute[75226]:   </sysinfo>
Nov 17 01:18:29 user nova-compute[75226]:   <os>
Nov 17 01:18:29 user nova-compute[75226]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 17 01:18:29 user nova-compute[75226]:     <boot dev="hd"/>
Nov 17 01:18:29 user nova-compute[75226]:     <smbios mode="sysinfo"/>
Nov 17 01:18:29 user nova-compute[75226]:   </os>
Nov 17 01:18:29 user nova-compute[75226]:   <features>
Nov 17 01:18:29 user nova-compute[75226]:     <acpi/>
Nov 17 01:18:29 user nova-compute[75226]:     <apic/>
Nov 17 01:18:29 user nova-compute[75226]:     <vmcoreinfo/>
Nov 17 01:18:29 user nova-compute[75226]:   </features>
Nov 17 01:18:29 user nova-compute[75226]:   <clock offset="utc">
Nov 17 01:18:29 user nova-compute[75226]:     <timer name="pit" tickpolicy="delay"/>
Nov 17 01:18:29 user nova-compute[75226]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 17 01:18:29 user nova-compute[75226]:     <timer name="hpet" present="no"/>
Nov 17 01:18:29 user nova-compute[75226]:   </clock>
Nov 17 01:18:29 user nova-compute[75226]:   <cpu mode="custom" match="exact">
Nov 17 01:18:29 user nova-compute[75226]:     <model>Nehalem</model>
Nov 17 01:18:29 user nova-compute[75226]:     <topology sockets="1" cores="1" threads="1"/>
Nov 17 01:18:29 user nova-compute[75226]:   </cpu>
Nov 17 01:18:29 user nova-compute[75226]:   <devices>
Nov 17 01:18:29 user nova-compute[75226]:     <disk type="file" device="cdrom">
Nov 17 01:18:29 user nova-compute[75226]:       <driver name="qemu" type="raw" cache="none"/>
Nov 17 01:18:29 user nova-compute[75226]:       <source file="/opt/stack/data/nova/instances/27342ec6-7a03-4f99-8056-5cb56794aa41/disk.config"/>
Nov 17 01:18:29 user nova-compute[75226]:       <target dev="hda" bus="ide"/>
Nov 17 01:18:29 user nova-compute[75226]:     </disk>
Nov 17 01:18:29 user nova-compute[75226]:     <disk type="block" device="disk">
Nov 17 01:18:29 user nova-compute[75226]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 01:18:29 user nova-compute[75226]:       <source dev="/dev/sdc"/>
Nov 17 01:18:29 user nova-compute[75226]:       <target dev="vda" bus="virtio"/>
Nov 17 01:18:29 user nova-compute[75226]:       <serial>02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae</serial>
Nov 17 01:18:29 user nova-compute[75226]:     </disk>
Nov 17 01:18:29 user nova-compute[75226]:     <disk type="block" device="disk">
Nov 17 01:18:29 user nova-compute[75226]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 01:18:29 user nova-compute[75226]:       <source dev="/dev/sdd"/>
Nov 17 01:18:29 user nova-compute[75226]:       <target dev="vdb" bus="virtio"/>
Nov 17 01:18:29 user nova-compute[75226]:       <serial>324e7042-63b3-44d8-b18d-8201b88923a1</serial>
Nov 17 01:18:29 user nova-compute[75226]:     </disk>
Nov 17 01:18:29 user nova-compute[75226]:     <disk type="block" device="disk">
Nov 17 01:18:29 user nova-compute[75226]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 01:18:29 user nova-compute[75226]:       <source dev="/dev/sde"/>
Nov 17 01:18:29 user nova-compute[75226]:       <target dev="vdc" bus="virtio"/>
Nov 17 01:18:29 user nova-compute[75226]:       <serial>d528018e-00b4-4d76-ae6d-5e3a0c863ed6</serial>
Nov 17 01:18:29 user nova-compute[75226]:     </disk>
Nov 17 01:18:29 user nova-compute[75226]:     <interface type="ethernet">
Nov 17 01:18:29 user nova-compute[75226]:       <mac address="fa:16:3e:fc:8e:ff"/>
Nov 17 01:18:29 user nova-compute[75226]:       <model type="virtio"/>
Nov 17 01:18:29 user nova-compute[75226]:       <mtu size="1442"/>
Nov 17 01:18:29 user nova-compute[75226]:       <target dev="tap6337887b-56"/>
Nov 17 01:18:29 user nova-compute[75226]:     </interface>
Nov 17 01:18:29 user nova-compute[75226]:     <interface type="ethernet">
Nov 17 01:18:29 user nova-compute[75226]:       <mac address="fa:16:3e:5b:b6:0c"/>
Nov 17 01:18:29 user nova-compute[75226]:       <model type="virtio"/>
Nov 17 01:18:29 user nova-compute[75226]:       <mtu size="1442"/>
Nov 17 01:18:29 user nova-compute[75226]:       <target dev="tap8a548a9b-87"/>
Nov 17 01:18:29 user nova-compute[75226]:     </interface>
Nov 17 01:18:29 user nova-compute[75226]:     <interface type="ethernet">
Nov 17 01:18:29 user nova-compute[75226]:       <mac address="fa:16:3e:13:8d:33"/>
Nov 17 01:18:29 user nova-compute[75226]:       <model type="virtio"/>
Nov 17 01:18:29 user nova-compute[75226]:       <mtu size="1442"/>
Nov 17 01:18:29 user nova-compute[75226]:       <target dev="tap01625fc1-9b"/>
Nov 17 01:18:29 user nova-compute[75226]:     </interface>
Nov 17 01:18:29 user nova-compute[75226]:     <interface type="ethernet">
Nov 17 01:18:29 user nova-compute[75226]:       <mac address="fa:16:3e:65:64:f1"/>
Nov 17 01:18:29 user nova-compute[75226]:       <model type="virtio"/>
Nov 17 01:18:29 user nova-compute[75226]:       <mtu size="1442"/>
Nov 17 01:18:29 user nova-compute[75226]:       <target dev="tap3e4d946c-15"/>
Nov 17 01:18:29 user nova-compute[75226]:     </interface>
Nov 17 01:18:29 user nova-compute[75226]:     <interface type="ethernet">
Nov 17 01:18:29 user nova-compute[75226]:       <mac address="fa:16:3e:5e:6d:29"/>
Nov 17 01:18:29 user nova-compute[75226]:       <model type="virtio"/>
Nov 17 01:18:29 user nova-compute[75226]:       <mtu size="1442"/>
Nov 17 01:18:29 user nova-compute[75226]:       <target dev="tap3b1855a6-8a"/>
Nov 17 01:18:29 user nova-compute[75226]:     </interface>
Nov 17 01:18:29 user nova-compute[75226]:     <interface type="ethernet">
Nov 17 01:18:29 user nova-compute[75226]:       <mac address="fa:16:3e:47:9b:84"/>
Nov 17 01:18:29 user nova-compute[75226]:       <model type="virtio"/>
Nov 17 01:18:29 user nova-compute[75226]:       <mtu size="1442"/>
Nov 17 01:18:29 user nova-compute[75226]:       <target dev="tap3c1a838d-e1"/>
Nov 17 01:18:29 user nova-compute[75226]:     </interface>
Nov 17 01:18:29 user nova-compute[75226]:     <interface type="ethernet">
Nov 17 01:18:29 user nova-compute[75226]:       <mac address="fa:16:3e:77:77:72"/>
Nov 17 01:18:29 user nova-compute[75226]:       <model type="virtio"/>
Nov 17 01:18:29 user nova-compute[75226]:       <mtu size="1442"/>
Nov 17 01:18:29 user nova-compute[75226]:       <target dev="tap11a81061-cd"/>
Nov 17 01:18:29 user nova-compute[75226]:     </interface>
Nov 17 01:18:29 user nova-compute[75226]:     <serial type="pty">
Nov 17 01:18:29 user nova-compute[75226]:       <log file="/opt/stack/data/nova/instances/27342ec6-7a03-4f99-8056-5cb56794aa41/console.log" append="off"/>
Nov 17 01:18:29 user nova-compute[75226]:     </serial>
Nov 17 01:18:29 user nova-compute[75226]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 17 01:18:29 user nova-compute[75226]:     <video>
Nov 17 01:18:29 user nova-compute[75226]:       <model type="virtio"/>
Nov 17 01:18:29 user nova-compute[75226]:     </video>
Nov 17 01:18:29 user nova-compute[75226]:     <rng model="virtio">
Nov 17 01:18:29 user nova-compute[75226]:       <backend model="random">/dev/urandom</backend>
Nov 17 01:18:29 user nova-compute[75226]:     </rng>
Nov 17 01:18:29 user nova-compute[75226]:     <controller type="usb" index="0" model="none"/>
Nov 17 01:18:29 user nova-compute[75226]:     <memballoon model="virtio">
Nov 17 01:18:29 user nova-compute[75226]:       <stats period="10"/>
Nov 17 01:18:29 user nova-compute[75226]:     </memballoon>
Nov 17 01:18:29 user nova-compute[75226]:   </devices>
Nov 17 01:18:29 user nova-compute[75226]: </domain>
Nov 17 01:18:29 user nova-compute[75226]:  {{(pid=75226) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 17 01:18:29 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-17T01:17:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1660208825',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1660208825',id=10,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO4+E9QOiUnWNUKrI+j17EMQbFyLd21Wqpo/hRvSEijsTxwF94lMxe3826dGGI7fte9gqEiKOU9O8ocJVagllay2w4NWQRzLkq112cs0QLNwHnmiDDocCj/FpieRw6NKiw==',key_name='tempest-keypair-413268072',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='871db3f789ac470c877456108324c68c',ramdisk_id='',reservation_id='r-e00nhfhr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1790286385',owner_user_name='tempest-TaggedBootDevicesTest-1790286385-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T01:18:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b54686e817042a28596953dde26d329',uuid=27342ec6-7a03-4f99-8056-5cb56794aa41,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6337887b-565a-4dc6-9a4f-4c8d9ac1c901", "address": "fa:16:3e:fc:8e:ff", "network": {"id": "4d03345a-3dc2-4436-a30b-30b8015b649e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2116320858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "871db3f789ac470c877456108324c68c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6337887b-56", "ovs_interfaceid": "6337887b-565a-4dc6-9a4f-4c8d9ac1c901", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 17 01:18:29 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Converting VIF {"id": "6337887b-565a-4dc6-9a4f-4c8d9ac1c901", "address": "fa:16:3e:fc:8e:ff", "network": {"id": "4d03345a-3dc2-4436-a30b-30b8015b649e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2116320858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "871db3f789ac470c877456108324c68c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6337887b-56", "ovs_interfaceid": "6337887b-565a-4dc6-9a4f-4c8d9ac1c901", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:18:29 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:8e:ff,bridge_name='br-int',has_traffic_filtering=True,id=6337887b-565a-4dc6-9a4f-4c8d9ac1c901,network=Network(4d03345a-3dc2-4436-a30b-30b8015b649e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6337887b-56') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:18:29 user nova-compute[75226]: DEBUG os_vif [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:8e:ff,bridge_name='br-int',has_traffic_filtering=True,id=6337887b-565a-4dc6-9a4f-4c8d9ac1c901,network=Network(4d03345a-3dc2-4436-a30b-30b8015b649e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6337887b-56') {{(pid=75226) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 17 01:18:29 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:18:29 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:18:29 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 17 01:18:29 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:18:29 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e22410de-0f23-5cd4-9c14-8b82a3ff36a3', '_type': 'linux-noop'}}, row=False) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:18:29 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:18:29 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:18:29 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:18:29 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6337887b-56, may_exist=True, interface_attrs={}) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:18:29 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6337887b-56, col_values=(('qos', UUID('3c58ae96-38a8-4eea-a17b-b300dc623e5b')),), if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:18:29 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6337887b-56, col_values=(('external_ids', {'iface-id': '6337887b-565a-4dc6-9a4f-4c8d9ac1c901', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fc:8e:ff', 'vm-uuid': '27342ec6-7a03-4f99-8056-5cb56794aa41'}),), if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:18:29 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:18:29 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:18:29 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:18:29 user nova-compute[75226]: INFO os_vif [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:8e:ff,bridge_name='br-int',has_traffic_filtering=True,id=6337887b-565a-4dc6-9a4f-4c8d9ac1c901,network=Network(4d03345a-3dc2-4436-a30b-30b8015b649e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6337887b-56')
Nov 17 01:18:29 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-17T01:17:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1660208825',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1660208825',id=10,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO4+E9QOiUnWNUKrI+j17EMQbFyLd21Wqpo/hRvSEijsTxwF94lMxe3826dGGI7fte9gqEiKOU9O8ocJVagllay2w4NWQRzLkq112cs0QLNwHnmiDDocCj/FpieRw6NKiw==',key_name='tempest-keypair-413268072',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='871db3f789ac470c877456108324c68c',ramdisk_id='',reservation_id='r-e00nhfhr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1790286385',owner_user_name='tempest-TaggedBootDevicesTest-1790286385-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T01:18:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b54686e817042a28596953dde26d329',uuid=27342ec6-7a03-4f99-8056-5cb56794aa41,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8a548a9b-874e-4c7c-bf06-6896dd773ce4", "address": "fa:16:3e:5b:b6:0c", "network": {"id": "df3c1bab-64f6-49c0-b35a-396881f5862f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1354339680", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "871db3f789ac470c877456108324c68c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a548a9b-87", "ovs_interfaceid": "8a548a9b-874e-4c7c-bf06-6896dd773ce4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75226) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 17 01:18:29 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Converting VIF {"id": "8a548a9b-874e-4c7c-bf06-6896dd773ce4", "address": "fa:16:3e:5b:b6:0c", "network": {"id": "df3c1bab-64f6-49c0-b35a-396881f5862f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1354339680", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "871db3f789ac470c877456108324c68c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a548a9b-87", "ovs_interfaceid": "8a548a9b-874e-4c7c-bf06-6896dd773ce4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:18:29 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:b6:0c,bridge_name='br-int',has_traffic_filtering=True,id=8a548a9b-874e-4c7c-bf06-6896dd773ce4,network=Network(df3c1bab-64f6-49c0-b35a-396881f5862f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8a548a9b-87') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:18:29 user nova-compute[75226]: DEBUG os_vif [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:b6:0c,bridge_name='br-int',has_traffic_filtering=True,id=8a548a9b-874e-4c7c-bf06-6896dd773ce4,network=Network(df3c1bab-64f6-49c0-b35a-396881f5862f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8a548a9b-87') {{(pid=75226) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 17 01:18:29 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:18:29 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:18:29 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 17 01:18:29 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:18:29 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '77535246-ba66-577a-ba57-1168ee5391ea', '_type': 'linux-noop'}}, row=False) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:18:29 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:18:29 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:18:29 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:18:29 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:18:29 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8a548a9b-87, may_exist=True, interface_attrs={}) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:18:29 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8a548a9b-87, col_values=(('qos', UUID('19ab5b1d-3481-4ff4-afa0-c39d098bd729')),), if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:18:29 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8a548a9b-87, col_values=(('external_ids', {'iface-id': '8a548a9b-874e-4c7c-bf06-6896dd773ce4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5b:b6:0c', 'vm-uuid': '27342ec6-7a03-4f99-8056-5cb56794aa41'}),), if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:18:29 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:18:29 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:18:30 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:18:30 user nova-compute[75226]: INFO os_vif [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:b6:0c,bridge_name='br-int',has_traffic_filtering=True,id=8a548a9b-874e-4c7c-bf06-6896dd773ce4,network=Network(df3c1bab-64f6-49c0-b35a-396881f5862f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8a548a9b-87')
Nov 17 01:18:30 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-17T01:17:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1660208825',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1660208825',id=10,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO4+E9QOiUnWNUKrI+j17EMQbFyLd21Wqpo/hRvSEijsTxwF94lMxe3826dGGI7fte9gqEiKOU9O8ocJVagllay2w4NWQRzLkq112cs0QLNwHnmiDDocCj/FpieRw6NKiw==',key_name='tempest-keypair-413268072',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='871db3f789ac470c877456108324c68c',ramdisk_id='',reservation_id='r-e00nhfhr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1790286385',owner_user_name='tempest-TaggedBootDevicesTest-1790286385-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T01:18:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b54686e817042a28596953dde26d329',uuid=27342ec6-7a03-4f99-8056-5cb56794aa41,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "01625fc1-9bbc-4edc-b594-78658e91edd9", "address": "fa:16:3e:13:8d:33", "network": {"id": "df3c1bab-64f6-49c0-b35a-396881f5862f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1354339680", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.68", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "871db3f789ac470c877456108324c68c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01625fc1-9b", "ovs_interfaceid": "01625fc1-9bbc-4edc-b594-78658e91edd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75226) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 17 01:18:30 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Converting VIF {"id": "01625fc1-9bbc-4edc-b594-78658e91edd9", "address": "fa:16:3e:13:8d:33", "network": {"id": "df3c1bab-64f6-49c0-b35a-396881f5862f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1354339680", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.68", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "871db3f789ac470c877456108324c68c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01625fc1-9b", "ovs_interfaceid": "01625fc1-9bbc-4edc-b594-78658e91edd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:18:30 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:8d:33,bridge_name='br-int',has_traffic_filtering=True,id=01625fc1-9bbc-4edc-b594-78658e91edd9,network=Network(df3c1bab-64f6-49c0-b35a-396881f5862f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap01625fc1-9b') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:18:30 user nova-compute[75226]: DEBUG os_vif [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:8d:33,bridge_name='br-int',has_traffic_filtering=True,id=01625fc1-9bbc-4edc-b594-78658e91edd9,network=Network(df3c1bab-64f6-49c0-b35a-396881f5862f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap01625fc1-9b') {{(pid=75226) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 17 01:18:30 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:18:30 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:18:30 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 17 01:18:30 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:18:30 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a6642508-149a-5851-a16f-8439481744c1', '_type': 'linux-noop'}}, row=False) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:18:30 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:18:30 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:18:30 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:18:30 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:18:30 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap01625fc1-9b, may_exist=True, interface_attrs={}) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:18:30 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap01625fc1-9b, col_values=(('qos', UUID('82f8950a-5aea-476d-85e7-267f79a87075')),), if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:18:30 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap01625fc1-9b, col_values=(('external_ids', {'iface-id': '01625fc1-9bbc-4edc-b594-78658e91edd9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:13:8d:33', 'vm-uuid': '27342ec6-7a03-4f99-8056-5cb56794aa41'}),), if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:18:30 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:18:30 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:18:30 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:18:30 user nova-compute[75226]: INFO os_vif [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:8d:33,bridge_name='br-int',has_traffic_filtering=True,id=01625fc1-9bbc-4edc-b594-78658e91edd9,network=Network(df3c1bab-64f6-49c0-b35a-396881f5862f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap01625fc1-9b')
Nov 17 01:18:30 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-17T01:17:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1660208825',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1660208825',id=10,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO4+E9QOiUnWNUKrI+j17EMQbFyLd21Wqpo/hRvSEijsTxwF94lMxe3826dGGI7fte9gqEiKOU9O8ocJVagllay2w4NWQRzLkq112cs0QLNwHnmiDDocCj/FpieRw6NKiw==',key_name='tempest-keypair-413268072',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='871db3f789ac470c877456108324c68c',ramdisk_id='',reservation_id='r-e00nhfhr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1790286385',owner_user_name='tempest-TaggedBootDevicesTest-1790286385-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T01:18:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b54686e817042a28596953dde26d329',uuid=27342ec6-7a03-4f99-8056-5cb56794aa41,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3e4d946c-158b-49e8-a349-44da4864f830", "address": "fa:16:3e:65:64:f1", "network": {"id": "df3c1bab-64f6-49c0-b35a-396881f5862f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1354339680", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "871db3f789ac470c877456108324c68c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e4d946c-15", "ovs_interfaceid": "3e4d946c-158b-49e8-a349-44da4864f830", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 17 01:18:30 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Converting VIF {"id": "3e4d946c-158b-49e8-a349-44da4864f830", "address": "fa:16:3e:65:64:f1", "network": {"id": "df3c1bab-64f6-49c0-b35a-396881f5862f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1354339680", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "871db3f789ac470c877456108324c68c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e4d946c-15", "ovs_interfaceid": "3e4d946c-158b-49e8-a349-44da4864f830", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:18:30 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:64:f1,bridge_name='br-int',has_traffic_filtering=True,id=3e4d946c-158b-49e8-a349-44da4864f830,network=Network(df3c1bab-64f6-49c0-b35a-396881f5862f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e4d946c-15') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:18:30 user nova-compute[75226]: DEBUG os_vif [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:64:f1,bridge_name='br-int',has_traffic_filtering=True,id=3e4d946c-158b-49e8-a349-44da4864f830,network=Network(df3c1bab-64f6-49c0-b35a-396881f5862f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e4d946c-15') {{(pid=75226) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 17 01:18:30 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:18:30 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:18:30 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 17 01:18:30 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:18:30 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2f49d980-7946-5736-9e35-fd61190a4e37', '_type': 'linux-noop'}}, row=False) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:18:30 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:18:30 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:18:30 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:18:30 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:18:30 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3e4d946c-15, may_exist=True, interface_attrs={}) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:18:30 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3e4d946c-15, col_values=(('qos', UUID('5e68d517-90e1-4ac6-810e-934a48b3fe72')),), if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:18:30 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3e4d946c-15, col_values=(('external_ids', {'iface-id': '3e4d946c-158b-49e8-a349-44da4864f830', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:65:64:f1', 'vm-uuid': '27342ec6-7a03-4f99-8056-5cb56794aa41'}),), if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:18:30 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:18:30 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:18:30 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:18:30 user nova-compute[75226]: INFO os_vif [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:64:f1,bridge_name='br-int',has_traffic_filtering=True,id=3e4d946c-158b-49e8-a349-44da4864f830,network=Network(df3c1bab-64f6-49c0-b35a-396881f5862f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e4d946c-15')
Nov 17 01:18:30 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-17T01:17:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1660208825',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1660208825',id=10,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO4+E9QOiUnWNUKrI+j17EMQbFyLd21Wqpo/hRvSEijsTxwF94lMxe3826dGGI7fte9gqEiKOU9O8ocJVagllay2w4NWQRzLkq112cs0QLNwHnmiDDocCj/FpieRw6NKiw==',key_name='tempest-keypair-413268072',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='871db3f789ac470c877456108324c68c',ramdisk_id='',reservation_id='r-e00nhfhr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1790286385',owner_user_name='tempest-TaggedBootDevicesTest-1790286385-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T01:18:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b54686e817042a28596953dde26d329',uuid=27342ec6-7a03-4f99-8056-5cb56794aa41,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3b1855a6-8a37-47af-b3e6-86e60eb05a1d", "address": "fa:16:3e:5e:6d:29", "network": {"id": "df3c1bab-64f6-49c0-b35a-396881f5862f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1354339680", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "871db3f789ac470c877456108324c68c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b1855a6-8a", "ovs_interfaceid": "3b1855a6-8a37-47af-b3e6-86e60eb05a1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 17 01:18:30 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Converting VIF {"id": "3b1855a6-8a37-47af-b3e6-86e60eb05a1d", "address": "fa:16:3e:5e:6d:29", "network": {"id": "df3c1bab-64f6-49c0-b35a-396881f5862f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1354339680", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "871db3f789ac470c877456108324c68c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b1855a6-8a", "ovs_interfaceid": "3b1855a6-8a37-47af-b3e6-86e60eb05a1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:18:30 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:6d:29,bridge_name='br-int',has_traffic_filtering=True,id=3b1855a6-8a37-47af-b3e6-86e60eb05a1d,network=Network(df3c1bab-64f6-49c0-b35a-396881f5862f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b1855a6-8a') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:18:30 user nova-compute[75226]: DEBUG os_vif [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:6d:29,bridge_name='br-int',has_traffic_filtering=True,id=3b1855a6-8a37-47af-b3e6-86e60eb05a1d,network=Network(df3c1bab-64f6-49c0-b35a-396881f5862f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b1855a6-8a') {{(pid=75226) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 17 01:18:30 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:18:30 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:18:30 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 17 01:18:30 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:18:30 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '91c3fca0-db32-5b6f-85d1-317f62e5947c', '_type': 'linux-noop'}}, row=False) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:18:30 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:18:30 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:18:30 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:18:30 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:18:30 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3b1855a6-8a, may_exist=True, interface_attrs={}) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:18:30 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3b1855a6-8a, col_values=(('qos', UUID('8b3ff028-68a8-40bc-a7fb-18ecec4978d2')),), if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:18:30 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3b1855a6-8a, col_values=(('external_ids', {'iface-id': '3b1855a6-8a37-47af-b3e6-86e60eb05a1d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5e:6d:29', 'vm-uuid': '27342ec6-7a03-4f99-8056-5cb56794aa41'}),), if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:18:30 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:18:30 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:18:30 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:18:30 user nova-compute[75226]: INFO os_vif [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:6d:29,bridge_name='br-int',has_traffic_filtering=True,id=3b1855a6-8a37-47af-b3e6-86e60eb05a1d,network=Network(df3c1bab-64f6-49c0-b35a-396881f5862f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b1855a6-8a')
Nov 17 01:18:30 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-17T01:17:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1660208825',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1660208825',id=10,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO4+E9QOiUnWNUKrI+j17EMQbFyLd21Wqpo/hRvSEijsTxwF94lMxe3826dGGI7fte9gqEiKOU9O8ocJVagllay2w4NWQRzLkq112cs0QLNwHnmiDDocCj/FpieRw6NKiw==',key_name='tempest-keypair-413268072',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='871db3f789ac470c877456108324c68c',ramdisk_id='',reservation_id='r-e00nhfhr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1790286385',owner_user_name='tempest-TaggedBootDevicesTest-1790286385-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T01:18:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b54686e817042a28596953dde26d329',uuid=27342ec6-7a03-4f99-8056-5cb56794aa41,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3c1a838d-e1c6-44d3-ab8a-a545044545a3", "address": "fa:16:3e:47:9b:84", "network": {"id": "b92e4d90-c7bd-45d6-a9db-d4b27ce718c5", "bridge": "br-int", "label": "tempest-device-tagging-net2-541044549", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "871db3f789ac470c877456108324c68c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c1a838d-e1", "ovs_interfaceid": "3c1a838d-e1c6-44d3-ab8a-a545044545a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 17 01:18:30 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Converting VIF {"id": "3c1a838d-e1c6-44d3-ab8a-a545044545a3", "address": "fa:16:3e:47:9b:84", "network": {"id": "b92e4d90-c7bd-45d6-a9db-d4b27ce718c5", "bridge": "br-int", "label": "tempest-device-tagging-net2-541044549", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "871db3f789ac470c877456108324c68c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c1a838d-e1", "ovs_interfaceid": "3c1a838d-e1c6-44d3-ab8a-a545044545a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:18:30 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:9b:84,bridge_name='br-int',has_traffic_filtering=True,id=3c1a838d-e1c6-44d3-ab8a-a545044545a3,network=Network(b92e4d90-c7bd-45d6-a9db-d4b27ce718c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c1a838d-e1') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:18:30 user nova-compute[75226]: DEBUG os_vif [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:9b:84,bridge_name='br-int',has_traffic_filtering=True,id=3c1a838d-e1c6-44d3-ab8a-a545044545a3,network=Network(b92e4d90-c7bd-45d6-a9db-d4b27ce718c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c1a838d-e1') {{(pid=75226) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 17 01:18:30 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:18:30 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:18:30 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 17 01:18:30 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:18:30 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd5c443a2-8608-585a-8b91-1f2230f0c4d7', '_type': 'linux-noop'}}, row=False) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:18:30 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:18:30 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:18:30 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:18:30 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3c1a838d-e1, may_exist=True, interface_attrs={}) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:18:30 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3c1a838d-e1, col_values=(('qos', UUID('59e01836-dd96-451c-a518-b99bb9c155d0')),), if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:18:30 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3c1a838d-e1, col_values=(('external_ids', {'iface-id': '3c1a838d-e1c6-44d3-ab8a-a545044545a3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:47:9b:84', 'vm-uuid': '27342ec6-7a03-4f99-8056-5cb56794aa41'}),), if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:18:30 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:18:30 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:18:30 user nova-compute[75226]: INFO os_vif [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:9b:84,bridge_name='br-int',has_traffic_filtering=True,id=3c1a838d-e1c6-44d3-ab8a-a545044545a3,network=Network(b92e4d90-c7bd-45d6-a9db-d4b27ce718c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c1a838d-e1')
Nov 17 01:18:30 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-17T01:17:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1660208825',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1660208825',id=10,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO4+E9QOiUnWNUKrI+j17EMQbFyLd21Wqpo/hRvSEijsTxwF94lMxe3826dGGI7fte9gqEiKOU9O8ocJVagllay2w4NWQRzLkq112cs0QLNwHnmiDDocCj/FpieRw6NKiw==',key_name='tempest-keypair-413268072',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='871db3f789ac470c877456108324c68c',ramdisk_id='',reservation_id='r-e00nhfhr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1790286385',owner_user_name='tempest-TaggedBootDevicesTest-1790286385-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T01:18:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b54686e817042a28596953dde26d329',uuid=27342ec6-7a03-4f99-8056-5cb56794aa41,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "11a81061-cde2-4e09-88e4-678aead09ad5", "address": "fa:16:3e:77:77:72", "network": {"id": "b92e4d90-c7bd-45d6-a9db-d4b27ce718c5", "bridge": "br-int", "label": "tempest-device-tagging-net2-541044549", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "871db3f789ac470c877456108324c68c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11a81061-cd", "ovs_interfaceid": "11a81061-cde2-4e09-88e4-678aead09ad5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 17 01:18:30 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Converting VIF {"id": "11a81061-cde2-4e09-88e4-678aead09ad5", "address": "fa:16:3e:77:77:72", "network": {"id": "b92e4d90-c7bd-45d6-a9db-d4b27ce718c5", "bridge": "br-int", "label": "tempest-device-tagging-net2-541044549", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "871db3f789ac470c877456108324c68c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11a81061-cd", "ovs_interfaceid": "11a81061-cde2-4e09-88e4-678aead09ad5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:18:30 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:77:72,bridge_name='br-int',has_traffic_filtering=True,id=11a81061-cde2-4e09-88e4-678aead09ad5,network=Network(b92e4d90-c7bd-45d6-a9db-d4b27ce718c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11a81061-cd') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:18:30 user nova-compute[75226]: DEBUG os_vif [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:77:72,bridge_name='br-int',has_traffic_filtering=True,id=11a81061-cde2-4e09-88e4-678aead09ad5,network=Network(b92e4d90-c7bd-45d6-a9db-d4b27ce718c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11a81061-cd') {{(pid=75226) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 17 01:18:30 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:18:30 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:18:30 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 17 01:18:30 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:18:30 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'af2eb10e-fa47-52ff-b09d-3705f71d1df1', '_type': 'linux-noop'}}, row=False) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:18:30 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:18:30 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:18:30 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:18:30 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:18:30 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap11a81061-cd, may_exist=True, interface_attrs={}) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:18:30 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap11a81061-cd, col_values=(('qos', UUID('8b44fe87-c611-4675-99df-4493d2f4ffae')),), if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:18:30 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap11a81061-cd, col_values=(('external_ids', {'iface-id': '11a81061-cde2-4e09-88e4-678aead09ad5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:77:77:72', 'vm-uuid': '27342ec6-7a03-4f99-8056-5cb56794aa41'}),), if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:18:30 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:18:30 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:18:30 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:18:30 user nova-compute[75226]: INFO os_vif [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:77:72,bridge_name='br-int',has_traffic_filtering=True,id=11a81061-cde2-4e09-88e4-678aead09ad5,network=Network(b92e4d90-c7bd-45d6-a9db-d4b27ce718c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11a81061-cd')
Nov 17 01:18:30 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] No BDM found with device name hda, not building metadata. {{(pid=75226) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 01:18:30 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75226) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 01:18:30 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] No VIF found with MAC fa:16:3e:fc:8e:ff, not building metadata {{(pid=75226) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 01:18:30 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] No VIF found with MAC fa:16:3e:5e:6d:29, not building metadata {{(pid=75226) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 01:18:30 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Using config drive
Nov 17 01:18:30 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Creating config drive at /opt/stack/data/nova/instances/27342ec6-7a03-4f99-8056-5cb56794aa41/disk.config
Nov 17 01:18:30 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/27342ec6-7a03-4f99-8056-5cb56794aa41/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpvfkz6nf1 {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:18:30 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/27342ec6-7a03-4f99-8056-5cb56794aa41/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpvfkz6nf1" returned: 0 in 0.049s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:18:32 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:18:32 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:18:32 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:18:32 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:18:32 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:18:32 user nova-compute[75226]: DEBUG nova.compute.manager [req-8733cfbc-f6cc-4de5-84f6-3dd0e44f2c48 req-fbb8cefc-a5b1-4f7f-a31b-9d819e75b42c service nova] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Received event network-vif-plugged-6337887b-565a-4dc6-9a4f-4c8d9ac1c901 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:18:32 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-8733cfbc-f6cc-4de5-84f6-3dd0e44f2c48 req-fbb8cefc-a5b1-4f7f-a31b-9d819e75b42c service nova] Acquiring lock "27342ec6-7a03-4f99-8056-5cb56794aa41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:18:32 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-8733cfbc-f6cc-4de5-84f6-3dd0e44f2c48 req-fbb8cefc-a5b1-4f7f-a31b-9d819e75b42c service nova] Lock "27342ec6-7a03-4f99-8056-5cb56794aa41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:18:32 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-8733cfbc-f6cc-4de5-84f6-3dd0e44f2c48 req-fbb8cefc-a5b1-4f7f-a31b-9d819e75b42c service nova] Lock "27342ec6-7a03-4f99-8056-5cb56794aa41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:18:32 user nova-compute[75226]: DEBUG nova.compute.manager [req-8733cfbc-f6cc-4de5-84f6-3dd0e44f2c48 req-fbb8cefc-a5b1-4f7f-a31b-9d819e75b42c service nova] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] No waiting events found dispatching network-vif-plugged-6337887b-565a-4dc6-9a4f-4c8d9ac1c901 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:18:32 user nova-compute[75226]: WARNING nova.compute.manager [req-8733cfbc-f6cc-4de5-84f6-3dd0e44f2c48 req-fbb8cefc-a5b1-4f7f-a31b-9d819e75b42c service nova] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Received unexpected event network-vif-plugged-6337887b-565a-4dc6-9a4f-4c8d9ac1c901 for instance with vm_state building and task_state spawning.
Nov 17 01:18:32 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:18:32 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:18:32 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:18:32 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:18:32 user nova-compute[75226]: DEBUG nova.compute.manager [req-7a72fcf9-f0cf-4791-af7f-38e2512619e1 req-6b475f97-911e-4410-9faa-8858f1a1f082 service nova] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Received event network-vif-plugged-8a548a9b-874e-4c7c-bf06-6896dd773ce4 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:18:32 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-7a72fcf9-f0cf-4791-af7f-38e2512619e1 req-6b475f97-911e-4410-9faa-8858f1a1f082 service nova] Acquiring lock "27342ec6-7a03-4f99-8056-5cb56794aa41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:18:32 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-7a72fcf9-f0cf-4791-af7f-38e2512619e1 req-6b475f97-911e-4410-9faa-8858f1a1f082 service nova] Lock "27342ec6-7a03-4f99-8056-5cb56794aa41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:18:32 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-7a72fcf9-f0cf-4791-af7f-38e2512619e1 req-6b475f97-911e-4410-9faa-8858f1a1f082 service nova] Lock "27342ec6-7a03-4f99-8056-5cb56794aa41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:18:32 user nova-compute[75226]: DEBUG nova.compute.manager [req-7a72fcf9-f0cf-4791-af7f-38e2512619e1 req-6b475f97-911e-4410-9faa-8858f1a1f082 service nova] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] No waiting events found dispatching network-vif-plugged-8a548a9b-874e-4c7c-bf06-6896dd773ce4 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:18:32 user nova-compute[75226]: WARNING nova.compute.manager [req-7a72fcf9-f0cf-4791-af7f-38e2512619e1 req-6b475f97-911e-4410-9faa-8858f1a1f082 service nova] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Received unexpected event network-vif-plugged-8a548a9b-874e-4c7c-bf06-6896dd773ce4 for instance with vm_state building and task_state spawning.
Nov 17 01:18:32 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:18:33 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:18:33 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:18:33 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:18:33 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:18:33 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:18:33 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:18:33 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:18:33 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:18:33 user nova-compute[75226]: DEBUG nova.compute.manager [req-a627fa65-a0ed-469f-bb37-ce3a0b3e3235 req-d5b9c95b-63d4-4659-8466-aa7fa948d42a service nova] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Received event network-vif-plugged-01625fc1-9bbc-4edc-b594-78658e91edd9 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:18:33 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-a627fa65-a0ed-469f-bb37-ce3a0b3e3235 req-d5b9c95b-63d4-4659-8466-aa7fa948d42a service nova] Acquiring lock "27342ec6-7a03-4f99-8056-5cb56794aa41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:18:33 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-a627fa65-a0ed-469f-bb37-ce3a0b3e3235 req-d5b9c95b-63d4-4659-8466-aa7fa948d42a service nova] Lock "27342ec6-7a03-4f99-8056-5cb56794aa41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:18:33 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-a627fa65-a0ed-469f-bb37-ce3a0b3e3235 req-d5b9c95b-63d4-4659-8466-aa7fa948d42a service nova] Lock "27342ec6-7a03-4f99-8056-5cb56794aa41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:18:33 user nova-compute[75226]: DEBUG nova.compute.manager [req-a627fa65-a0ed-469f-bb37-ce3a0b3e3235 req-d5b9c95b-63d4-4659-8466-aa7fa948d42a service nova] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] No waiting events found dispatching network-vif-plugged-01625fc1-9bbc-4edc-b594-78658e91edd9 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:18:33 user nova-compute[75226]: WARNING nova.compute.manager [req-a627fa65-a0ed-469f-bb37-ce3a0b3e3235 req-d5b9c95b-63d4-4659-8466-aa7fa948d42a service nova] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Received unexpected event network-vif-plugged-01625fc1-9bbc-4edc-b594-78658e91edd9 for instance with vm_state building and task_state spawning.
Nov 17 01:18:33 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:18:33 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:18:33 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:18:33 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:18:33 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:18:33 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:18:33 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:18:33 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:18:34 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:18:34 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:18:34 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:18:34 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:18:34 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:18:34 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:18:34 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:18:34 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:18:34 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:18:34 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:18:34 user nova-compute[75226]: DEBUG nova.compute.manager [req-1ac33f03-e3fb-49e1-8907-8fc185b33825 req-324a2f36-e88b-4973-9b2f-db52b80ec409 service nova] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Received event network-vif-plugged-6337887b-565a-4dc6-9a4f-4c8d9ac1c901 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:18:34 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-1ac33f03-e3fb-49e1-8907-8fc185b33825 req-324a2f36-e88b-4973-9b2f-db52b80ec409 service nova] Acquiring lock "27342ec6-7a03-4f99-8056-5cb56794aa41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:18:34 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-1ac33f03-e3fb-49e1-8907-8fc185b33825 req-324a2f36-e88b-4973-9b2f-db52b80ec409 service nova] Lock "27342ec6-7a03-4f99-8056-5cb56794aa41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:18:34 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-1ac33f03-e3fb-49e1-8907-8fc185b33825 req-324a2f36-e88b-4973-9b2f-db52b80ec409 service nova] Lock "27342ec6-7a03-4f99-8056-5cb56794aa41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:18:34 user nova-compute[75226]: DEBUG nova.compute.manager [req-1ac33f03-e3fb-49e1-8907-8fc185b33825 req-324a2f36-e88b-4973-9b2f-db52b80ec409 service nova] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] No waiting events found dispatching network-vif-plugged-6337887b-565a-4dc6-9a4f-4c8d9ac1c901 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:18:34 user nova-compute[75226]: WARNING nova.compute.manager [req-1ac33f03-e3fb-49e1-8907-8fc185b33825 req-324a2f36-e88b-4973-9b2f-db52b80ec409 service nova] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Received unexpected event network-vif-plugged-6337887b-565a-4dc6-9a4f-4c8d9ac1c901 for instance with vm_state building and task_state spawning.
Nov 17 01:18:34 user nova-compute[75226]: DEBUG nova.compute.manager [req-1ac33f03-e3fb-49e1-8907-8fc185b33825 req-324a2f36-e88b-4973-9b2f-db52b80ec409 service nova] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Received event network-vif-plugged-3b1855a6-8a37-47af-b3e6-86e60eb05a1d {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:18:34 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-1ac33f03-e3fb-49e1-8907-8fc185b33825 req-324a2f36-e88b-4973-9b2f-db52b80ec409 service nova] Acquiring lock "27342ec6-7a03-4f99-8056-5cb56794aa41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:18:34 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-1ac33f03-e3fb-49e1-8907-8fc185b33825 req-324a2f36-e88b-4973-9b2f-db52b80ec409 service nova] Lock "27342ec6-7a03-4f99-8056-5cb56794aa41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:18:34 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-1ac33f03-e3fb-49e1-8907-8fc185b33825 req-324a2f36-e88b-4973-9b2f-db52b80ec409 service nova] Lock "27342ec6-7a03-4f99-8056-5cb56794aa41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:18:34 user nova-compute[75226]: DEBUG nova.compute.manager [req-1ac33f03-e3fb-49e1-8907-8fc185b33825 req-324a2f36-e88b-4973-9b2f-db52b80ec409 service nova] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] No waiting events found dispatching network-vif-plugged-3b1855a6-8a37-47af-b3e6-86e60eb05a1d {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:18:34 user nova-compute[75226]: WARNING nova.compute.manager [req-1ac33f03-e3fb-49e1-8907-8fc185b33825 req-324a2f36-e88b-4973-9b2f-db52b80ec409 service nova] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Received unexpected event network-vif-plugged-3b1855a6-8a37-47af-b3e6-86e60eb05a1d for instance with vm_state building and task_state spawning.
Nov 17 01:18:34 user nova-compute[75226]: DEBUG nova.compute.manager [req-1ac33f03-e3fb-49e1-8907-8fc185b33825 req-324a2f36-e88b-4973-9b2f-db52b80ec409 service nova] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Received event network-vif-plugged-3b1855a6-8a37-47af-b3e6-86e60eb05a1d {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:18:34 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-1ac33f03-e3fb-49e1-8907-8fc185b33825 req-324a2f36-e88b-4973-9b2f-db52b80ec409 service nova] Acquiring lock "27342ec6-7a03-4f99-8056-5cb56794aa41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:18:34 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-1ac33f03-e3fb-49e1-8907-8fc185b33825 req-324a2f36-e88b-4973-9b2f-db52b80ec409 service nova] Lock "27342ec6-7a03-4f99-8056-5cb56794aa41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:18:34 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-1ac33f03-e3fb-49e1-8907-8fc185b33825 req-324a2f36-e88b-4973-9b2f-db52b80ec409 service nova] Lock "27342ec6-7a03-4f99-8056-5cb56794aa41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:18:34 user nova-compute[75226]: DEBUG nova.compute.manager [req-1ac33f03-e3fb-49e1-8907-8fc185b33825 req-324a2f36-e88b-4973-9b2f-db52b80ec409 service nova] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] No waiting events found dispatching network-vif-plugged-3b1855a6-8a37-47af-b3e6-86e60eb05a1d {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:18:34 user nova-compute[75226]: WARNING nova.compute.manager [req-1ac33f03-e3fb-49e1-8907-8fc185b33825 req-324a2f36-e88b-4973-9b2f-db52b80ec409 service nova] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Received unexpected event network-vif-plugged-3b1855a6-8a37-47af-b3e6-86e60eb05a1d for instance with vm_state building and task_state spawning.
Nov 17 01:18:34 user nova-compute[75226]: DEBUG nova.compute.manager [req-1ac33f03-e3fb-49e1-8907-8fc185b33825 req-324a2f36-e88b-4973-9b2f-db52b80ec409 service nova] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Received event network-vif-plugged-11a81061-cde2-4e09-88e4-678aead09ad5 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:18:34 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-1ac33f03-e3fb-49e1-8907-8fc185b33825 req-324a2f36-e88b-4973-9b2f-db52b80ec409 service nova] Acquiring lock "27342ec6-7a03-4f99-8056-5cb56794aa41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:18:34 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-1ac33f03-e3fb-49e1-8907-8fc185b33825 req-324a2f36-e88b-4973-9b2f-db52b80ec409 service nova] Lock "27342ec6-7a03-4f99-8056-5cb56794aa41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:18:34 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-1ac33f03-e3fb-49e1-8907-8fc185b33825 req-324a2f36-e88b-4973-9b2f-db52b80ec409 service nova] Lock "27342ec6-7a03-4f99-8056-5cb56794aa41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:18:34 user nova-compute[75226]: DEBUG nova.compute.manager [req-1ac33f03-e3fb-49e1-8907-8fc185b33825 req-324a2f36-e88b-4973-9b2f-db52b80ec409 service nova] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] No waiting events found dispatching network-vif-plugged-11a81061-cde2-4e09-88e4-678aead09ad5 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:18:34 user nova-compute[75226]: WARNING nova.compute.manager [req-1ac33f03-e3fb-49e1-8907-8fc185b33825 req-324a2f36-e88b-4973-9b2f-db52b80ec409 service nova] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Received unexpected event network-vif-plugged-11a81061-cde2-4e09-88e4-678aead09ad5 for instance with vm_state building and task_state spawning.
Nov 17 01:18:34 user nova-compute[75226]: DEBUG nova.compute.manager [req-1ac33f03-e3fb-49e1-8907-8fc185b33825 req-324a2f36-e88b-4973-9b2f-db52b80ec409 service nova] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Received event network-vif-plugged-11a81061-cde2-4e09-88e4-678aead09ad5 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:18:34 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-1ac33f03-e3fb-49e1-8907-8fc185b33825 req-324a2f36-e88b-4973-9b2f-db52b80ec409 service nova] Acquiring lock "27342ec6-7a03-4f99-8056-5cb56794aa41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:18:34 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-1ac33f03-e3fb-49e1-8907-8fc185b33825 req-324a2f36-e88b-4973-9b2f-db52b80ec409 service nova] Lock "27342ec6-7a03-4f99-8056-5cb56794aa41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:18:34 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-1ac33f03-e3fb-49e1-8907-8fc185b33825 req-324a2f36-e88b-4973-9b2f-db52b80ec409 service nova] Lock "27342ec6-7a03-4f99-8056-5cb56794aa41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:18:34 user nova-compute[75226]: DEBUG nova.compute.manager [req-1ac33f03-e3fb-49e1-8907-8fc185b33825 req-324a2f36-e88b-4973-9b2f-db52b80ec409 service nova] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] No waiting events found dispatching network-vif-plugged-11a81061-cde2-4e09-88e4-678aead09ad5 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:18:34 user nova-compute[75226]: WARNING nova.compute.manager [req-1ac33f03-e3fb-49e1-8907-8fc185b33825 req-324a2f36-e88b-4973-9b2f-db52b80ec409 service nova] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Received unexpected event network-vif-plugged-11a81061-cde2-4e09-88e4-678aead09ad5 for instance with vm_state building and task_state spawning.
Nov 17 01:18:34 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:18:34 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:18:35 user nova-compute[75226]: DEBUG nova.compute.manager [req-8280b51c-fd0b-4552-9bd6-1eb8235eda8d req-f4a98f13-c9ec-438d-ab53-64694e92f366 service nova] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Received event network-vif-plugged-8a548a9b-874e-4c7c-bf06-6896dd773ce4 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:18:35 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-8280b51c-fd0b-4552-9bd6-1eb8235eda8d req-f4a98f13-c9ec-438d-ab53-64694e92f366 service nova] Acquiring lock "27342ec6-7a03-4f99-8056-5cb56794aa41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:18:35 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-8280b51c-fd0b-4552-9bd6-1eb8235eda8d req-f4a98f13-c9ec-438d-ab53-64694e92f366 service nova] Lock "27342ec6-7a03-4f99-8056-5cb56794aa41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:18:35 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-8280b51c-fd0b-4552-9bd6-1eb8235eda8d req-f4a98f13-c9ec-438d-ab53-64694e92f366 service nova] Lock "27342ec6-7a03-4f99-8056-5cb56794aa41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:18:35 user nova-compute[75226]: DEBUG nova.compute.manager [req-8280b51c-fd0b-4552-9bd6-1eb8235eda8d req-f4a98f13-c9ec-438d-ab53-64694e92f366 service nova] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] No waiting events found dispatching network-vif-plugged-8a548a9b-874e-4c7c-bf06-6896dd773ce4 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:18:35 user nova-compute[75226]: WARNING nova.compute.manager [req-8280b51c-fd0b-4552-9bd6-1eb8235eda8d req-f4a98f13-c9ec-438d-ab53-64694e92f366 service nova] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Received unexpected event network-vif-plugged-8a548a9b-874e-4c7c-bf06-6896dd773ce4 for instance with vm_state building and task_state spawning.
Nov 17 01:18:35 user nova-compute[75226]: DEBUG nova.compute.manager [req-8280b51c-fd0b-4552-9bd6-1eb8235eda8d req-f4a98f13-c9ec-438d-ab53-64694e92f366 service nova] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Received event network-vif-plugged-3c1a838d-e1c6-44d3-ab8a-a545044545a3 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:18:35 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-8280b51c-fd0b-4552-9bd6-1eb8235eda8d req-f4a98f13-c9ec-438d-ab53-64694e92f366 service nova] Acquiring lock "27342ec6-7a03-4f99-8056-5cb56794aa41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:18:35 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-8280b51c-fd0b-4552-9bd6-1eb8235eda8d req-f4a98f13-c9ec-438d-ab53-64694e92f366 service nova] Lock "27342ec6-7a03-4f99-8056-5cb56794aa41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:18:35 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-8280b51c-fd0b-4552-9bd6-1eb8235eda8d req-f4a98f13-c9ec-438d-ab53-64694e92f366 service nova] Lock "27342ec6-7a03-4f99-8056-5cb56794aa41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:18:35 user nova-compute[75226]: DEBUG nova.compute.manager [req-8280b51c-fd0b-4552-9bd6-1eb8235eda8d req-f4a98f13-c9ec-438d-ab53-64694e92f366 service nova] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] No waiting events found dispatching network-vif-plugged-3c1a838d-e1c6-44d3-ab8a-a545044545a3 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:18:35 user nova-compute[75226]: WARNING nova.compute.manager [req-8280b51c-fd0b-4552-9bd6-1eb8235eda8d req-f4a98f13-c9ec-438d-ab53-64694e92f366 service nova] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Received unexpected event network-vif-plugged-3c1a838d-e1c6-44d3-ab8a-a545044545a3 for instance with vm_state building and task_state spawning.
Nov 17 01:18:35 user nova-compute[75226]: DEBUG nova.compute.manager [req-8280b51c-fd0b-4552-9bd6-1eb8235eda8d req-f4a98f13-c9ec-438d-ab53-64694e92f366 service nova] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Received event network-vif-plugged-3c1a838d-e1c6-44d3-ab8a-a545044545a3 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:18:35 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-8280b51c-fd0b-4552-9bd6-1eb8235eda8d req-f4a98f13-c9ec-438d-ab53-64694e92f366 service nova] Acquiring lock "27342ec6-7a03-4f99-8056-5cb56794aa41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:18:35 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-8280b51c-fd0b-4552-9bd6-1eb8235eda8d req-f4a98f13-c9ec-438d-ab53-64694e92f366 service nova] Lock "27342ec6-7a03-4f99-8056-5cb56794aa41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:18:35 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-8280b51c-fd0b-4552-9bd6-1eb8235eda8d req-f4a98f13-c9ec-438d-ab53-64694e92f366 service nova] Lock "27342ec6-7a03-4f99-8056-5cb56794aa41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:18:35 user nova-compute[75226]: DEBUG nova.compute.manager [req-8280b51c-fd0b-4552-9bd6-1eb8235eda8d req-f4a98f13-c9ec-438d-ab53-64694e92f366 service nova] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] No waiting events found dispatching network-vif-plugged-3c1a838d-e1c6-44d3-ab8a-a545044545a3 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:18:35 user nova-compute[75226]: WARNING nova.compute.manager [req-8280b51c-fd0b-4552-9bd6-1eb8235eda8d req-f4a98f13-c9ec-438d-ab53-64694e92f366 service nova] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Received unexpected event network-vif-plugged-3c1a838d-e1c6-44d3-ab8a-a545044545a3 for instance with vm_state building and task_state spawning.
Nov 17 01:18:35 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:18:35 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:18:35 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:18:35 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:18:35 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:18:35 user nova-compute[75226]: DEBUG nova.compute.manager [req-aa04acf4-48a4-4838-b3cd-04feb85594bb req-0ece63b8-af1a-4d1a-8500-0229470f5119 service nova] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Received event network-vif-plugged-01625fc1-9bbc-4edc-b594-78658e91edd9 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:18:35 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-aa04acf4-48a4-4838-b3cd-04feb85594bb req-0ece63b8-af1a-4d1a-8500-0229470f5119 service nova] Acquiring lock "27342ec6-7a03-4f99-8056-5cb56794aa41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:18:35 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-aa04acf4-48a4-4838-b3cd-04feb85594bb req-0ece63b8-af1a-4d1a-8500-0229470f5119 service nova] Lock "27342ec6-7a03-4f99-8056-5cb56794aa41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:18:35 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-aa04acf4-48a4-4838-b3cd-04feb85594bb req-0ece63b8-af1a-4d1a-8500-0229470f5119 service nova] Lock "27342ec6-7a03-4f99-8056-5cb56794aa41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:18:35 user nova-compute[75226]: DEBUG nova.compute.manager [req-aa04acf4-48a4-4838-b3cd-04feb85594bb req-0ece63b8-af1a-4d1a-8500-0229470f5119 service nova] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] No waiting events found dispatching network-vif-plugged-01625fc1-9bbc-4edc-b594-78658e91edd9 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:18:35 user nova-compute[75226]: WARNING nova.compute.manager [req-aa04acf4-48a4-4838-b3cd-04feb85594bb req-0ece63b8-af1a-4d1a-8500-0229470f5119 service nova] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Received unexpected event network-vif-plugged-01625fc1-9bbc-4edc-b594-78658e91edd9 for instance with vm_state building and task_state spawning.
Nov 17 01:18:35 user nova-compute[75226]: DEBUG nova.compute.manager [req-aa04acf4-48a4-4838-b3cd-04feb85594bb req-0ece63b8-af1a-4d1a-8500-0229470f5119 service nova] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Received event network-vif-plugged-3e4d946c-158b-49e8-a349-44da4864f830 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:18:35 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-aa04acf4-48a4-4838-b3cd-04feb85594bb req-0ece63b8-af1a-4d1a-8500-0229470f5119 service nova] Acquiring lock "27342ec6-7a03-4f99-8056-5cb56794aa41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:18:35 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-aa04acf4-48a4-4838-b3cd-04feb85594bb req-0ece63b8-af1a-4d1a-8500-0229470f5119 service nova] Lock "27342ec6-7a03-4f99-8056-5cb56794aa41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:18:35 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-aa04acf4-48a4-4838-b3cd-04feb85594bb req-0ece63b8-af1a-4d1a-8500-0229470f5119 service nova] Lock "27342ec6-7a03-4f99-8056-5cb56794aa41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:18:35 user nova-compute[75226]: DEBUG nova.compute.manager [req-aa04acf4-48a4-4838-b3cd-04feb85594bb req-0ece63b8-af1a-4d1a-8500-0229470f5119 service nova] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] No waiting events found dispatching network-vif-plugged-3e4d946c-158b-49e8-a349-44da4864f830 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:18:35 user nova-compute[75226]: WARNING nova.compute.manager [req-aa04acf4-48a4-4838-b3cd-04feb85594bb req-0ece63b8-af1a-4d1a-8500-0229470f5119 service nova] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Received unexpected event network-vif-plugged-3e4d946c-158b-49e8-a349-44da4864f830 for instance with vm_state building and task_state spawning.
Nov 17 01:18:35 user nova-compute[75226]: DEBUG nova.compute.manager [req-aa04acf4-48a4-4838-b3cd-04feb85594bb req-0ece63b8-af1a-4d1a-8500-0229470f5119 service nova] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Received event network-vif-plugged-3e4d946c-158b-49e8-a349-44da4864f830 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:18:35 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-aa04acf4-48a4-4838-b3cd-04feb85594bb req-0ece63b8-af1a-4d1a-8500-0229470f5119 service nova] Acquiring lock "27342ec6-7a03-4f99-8056-5cb56794aa41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:18:35 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-aa04acf4-48a4-4838-b3cd-04feb85594bb req-0ece63b8-af1a-4d1a-8500-0229470f5119 service nova] Lock "27342ec6-7a03-4f99-8056-5cb56794aa41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:18:35 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-aa04acf4-48a4-4838-b3cd-04feb85594bb req-0ece63b8-af1a-4d1a-8500-0229470f5119 service nova] Lock "27342ec6-7a03-4f99-8056-5cb56794aa41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:18:35 user nova-compute[75226]: DEBUG nova.compute.manager [req-aa04acf4-48a4-4838-b3cd-04feb85594bb req-0ece63b8-af1a-4d1a-8500-0229470f5119 service nova] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] No waiting events found dispatching network-vif-plugged-3e4d946c-158b-49e8-a349-44da4864f830 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:18:35 user nova-compute[75226]: WARNING nova.compute.manager [req-aa04acf4-48a4-4838-b3cd-04feb85594bb req-0ece63b8-af1a-4d1a-8500-0229470f5119 service nova] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Received unexpected event network-vif-plugged-3e4d946c-158b-49e8-a349-44da4864f830 for instance with vm_state building and task_state spawning.
Nov 17 01:18:35 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:18:35 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:18:36 user nova-compute[75226]: DEBUG nova.compute.manager [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Instance event wait completed in 0 seconds for  {{(pid=75226) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 17 01:18:36 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Guest created on hypervisor {{(pid=75226) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 17 01:18:36 user nova-compute[75226]: INFO nova.virt.libvirt.driver [-] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Instance spawned successfully.
Nov 17 01:18:36 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 17 01:18:36 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Found default for hw_cdrom_bus of ide {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:18:36 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Found default for hw_disk_bus of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:18:36 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Found default for hw_input_bus of None {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:18:36 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Found default for hw_pointer_model of None {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:18:36 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Found default for hw_video_model of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:18:36 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Found default for hw_vif_model of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:18:36 user nova-compute[75226]: INFO nova.compute.manager [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Took 10.89 seconds to spawn the instance on the hypervisor.
Nov 17 01:18:36 user nova-compute[75226]: DEBUG nova.compute.manager [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Checking state {{(pid=75226) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 01:18:36 user nova-compute[75226]: INFO nova.compute.manager [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Took 36.53 seconds to build instance.
Nov 17 01:18:36 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-df6efd67-f5db-49b4-88dd-d29b593e01f4 tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Lock "27342ec6-7a03-4f99-8056-5cb56794aa41" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 36.712s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:18:37 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:18:40 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:18:42 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:18:45 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:18:50 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:18:50 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:18:50 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75226) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 17 01:18:50 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75226) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 01:18:50 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75226) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 01:18:50 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:18:52 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:18:55 user nova-compute[75226]: DEBUG nova.compute.manager [None req-f16b382f-d3f7-46cf-9812-7361b202e15c tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: aa84e575-bdad-45b9-80ce-86b1c2826fb0] Checking state {{(pid=75226) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 01:18:55 user nova-compute[75226]: INFO nova.compute.manager [None req-f16b382f-d3f7-46cf-9812-7361b202e15c tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: aa84e575-bdad-45b9-80ce-86b1c2826fb0] instance snapshotting
Nov 17 01:18:55 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:18:55 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-f16b382f-d3f7-46cf-9812-7361b202e15c tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: aa84e575-bdad-45b9-80ce-86b1c2826fb0] Beginning live snapshot process
Nov 17 01:18:55 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-62d19fd0-6ac1-4a36-b396-2148f1539cde tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] Acquiring lock "19250ac2-1b3f-4fe9-80b0-406b181929b6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:18:55 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-62d19fd0-6ac1-4a36-b396-2148f1539cde tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] Lock "19250ac2-1b3f-4fe9-80b0-406b181929b6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:18:55 user nova-compute[75226]: DEBUG nova.objects.instance [None req-62d19fd0-6ac1-4a36-b396-2148f1539cde tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] Lazy-loading 'flavor' on Instance uuid 19250ac2-1b3f-4fe9-80b0-406b181929b6 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:18:55 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-f16b382f-d3f7-46cf-9812-7361b202e15c tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa84e575-bdad-45b9-80ce-86b1c2826fb0/disk --force-share --output=json -f qcow2 {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:18:55 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-62d19fd0-6ac1-4a36-b396-2148f1539cde tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] Lock "19250ac2-1b3f-4fe9-80b0-406b181929b6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.132s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:18:55 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-f16b382f-d3f7-46cf-9812-7361b202e15c tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa84e575-bdad-45b9-80ce-86b1c2826fb0/disk --force-share --output=json -f qcow2" returned: 0 in 0.184s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:18:55 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-f16b382f-d3f7-46cf-9812-7361b202e15c tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa84e575-bdad-45b9-80ce-86b1c2826fb0/disk --force-share --output=json -f qcow2 {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:18:55 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-62d19fd0-6ac1-4a36-b396-2148f1539cde tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] Acquiring lock "19250ac2-1b3f-4fe9-80b0-406b181929b6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:18:55 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-62d19fd0-6ac1-4a36-b396-2148f1539cde tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] Lock "19250ac2-1b3f-4fe9-80b0-406b181929b6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:18:55 user nova-compute[75226]: INFO nova.compute.manager [None req-62d19fd0-6ac1-4a36-b396-2148f1539cde tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] [instance: 19250ac2-1b3f-4fe9-80b0-406b181929b6] Attaching volume f37fc37f-fd78-4093-aad3-102ec16fb30d to /dev/vdb
Nov 17 01:18:56 user nova-compute[75226]: DEBUG os_brick.utils [None req-62d19fd0-6ac1-4a36-b396-2148f1539cde tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:18:56 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:18:56 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:18:56 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[fee7d27d-a44a-496b-b659-ced8a9832770]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f62857db69\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:18:56 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:18:56 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:18:56 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[31e6b622-b95f-477c-b7fe-b4a23894855f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:18:56 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-f16b382f-d3f7-46cf-9812-7361b202e15c tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa84e575-bdad-45b9-80ce-86b1c2826fb0/disk --force-share --output=json -f qcow2" returned: 0 in 0.177s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:18:56 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-f16b382f-d3f7-46cf-9812-7361b202e15c tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:18:56 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:18:56 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:18:56 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[f92aa052-ed63-4c30-bee8-0d069f898b12]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:18:56 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[befa54dc-f5a3-4988-8a0f-81e2d3d68193]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:18:56 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-62d19fd0-6ac1-4a36-b396-2148f1539cde tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] Running cmd (subprocess): nvme version {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:18:56 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-62d19fd0-6ac1-4a36-b396-2148f1539cde tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] 'nvme version' failed. Not Retrying. {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 01:18:56 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.nvmeof [None req-62d19fd0-6ac1-4a36-b396-2148f1539cde tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] nvme not present on system {{(pid=75226) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 17 01:18:56 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:18:56 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 01:18:56 user nova-compute[75226]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 17 01:18:56 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[8df466f9-d0bf-4405-b780-5c60f618d1c6]: (4, '') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:18:56 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-62d19fd0-6ac1-4a36-b396-2148f1539cde tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75226) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 17 01:18:56 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-62d19fd0-6ac1-4a36-b396-2148f1539cde tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75226) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 17 01:18:56 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-62d19fd0-6ac1-4a36-b396-2148f1539cde tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] LIGHTOS: no hostnqn found. {{(pid=75226) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 17 01:18:56 user nova-compute[75226]: DEBUG os_brick.utils [None req-62d19fd0-6ac1-4a36-b396-2148f1539cde tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f62857db69', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:18:56 user nova-compute[75226]: DEBUG nova.virt.block_device [None req-62d19fd0-6ac1-4a36-b396-2148f1539cde tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] [instance: 19250ac2-1b3f-4fe9-80b0-406b181929b6] Updating existing volume attachment record: 6f4875f7-0c45-4153-a00d-d89582dc0f8a {{(pid=75226) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 17 01:18:56 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-f16b382f-d3f7-46cf-9812-7361b202e15c tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json" returned: 0 in 0.173s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:18:56 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-f16b382f-d3f7-46cf-9812-7361b202e15c tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpcd6xzfij/0ee49dbfb6ac402ea433c987d5a331c1.delta 1073741824 {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:18:56 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-f16b382f-d3f7-46cf-9812-7361b202e15c tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpcd6xzfij/0ee49dbfb6ac402ea433c987d5a331c1.delta 1073741824" returned: 0 in 0.089s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:18:56 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-f16b382f-d3f7-46cf-9812-7361b202e15c tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: aa84e575-bdad-45b9-80ce-86b1c2826fb0] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 17 01:18:56 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-f16b382f-d3f7-46cf-9812-7361b202e15c tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Checking UEFI support for host arch (x86_64) {{(pid=75226) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Nov 17 01:18:56 user nova-compute[75226]: INFO nova.virt.libvirt.host [None req-f16b382f-d3f7-46cf-9812-7361b202e15c tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] UEFI support detected
Nov 17 01:18:57 user nova-compute[75226]: DEBUG nova.virt.libvirt.guest [None req-f16b382f-d3f7-46cf-9812-7361b202e15c tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] COPY block job progress, current cursor: 458752 final cursor: 75563008 {{(pid=75226) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 17 01:18:57 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:18:57 user nova-compute[75226]: DEBUG nova.virt.libvirt.guest [None req-f16b382f-d3f7-46cf-9812-7361b202e15c tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=75226) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 17 01:18:57 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-f16b382f-d3f7-46cf-9812-7361b202e15c tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: aa84e575-bdad-45b9-80ce-86b1c2826fb0] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 17 01:18:57 user nova-compute[75226]: DEBUG nova.privsep.utils [None req-f16b382f-d3f7-46cf-9812-7361b202e15c tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75226) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 17 01:18:57 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-f16b382f-d3f7-46cf-9812-7361b202e15c tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpcd6xzfij/0ee49dbfb6ac402ea433c987d5a331c1.delta /opt/stack/data/nova/instances/snapshots/tmpcd6xzfij/0ee49dbfb6ac402ea433c987d5a331c1 {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:18:58 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-f16b382f-d3f7-46cf-9812-7361b202e15c tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpcd6xzfij/0ee49dbfb6ac402ea433c987d5a331c1.delta /opt/stack/data/nova/instances/snapshots/tmpcd6xzfij/0ee49dbfb6ac402ea433c987d5a331c1" returned: 0 in 0.566s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:18:58 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-f16b382f-d3f7-46cf-9812-7361b202e15c tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: aa84e575-bdad-45b9-80ce-86b1c2826fb0] Snapshot extracted, beginning image upload
Nov 17 01:19:00 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:19:00 user nova-compute[75226]: DEBUG nova.compute.manager [req-51e7850f-f72f-4df4-a740-f4f3795e10da req-4ac30134-1ad7-4cd5-9d1c-f9752db5965c service nova] [instance: ddfecefc-1e9b-4e6e-9995-855c8a061084] Received event network-changed-f9a7562b-de63-4374-b43b-18e3cb3af710 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:19:00 user nova-compute[75226]: DEBUG nova.compute.manager [req-51e7850f-f72f-4df4-a740-f4f3795e10da req-4ac30134-1ad7-4cd5-9d1c-f9752db5965c service nova] [instance: ddfecefc-1e9b-4e6e-9995-855c8a061084] Refreshing instance network info cache due to event network-changed-f9a7562b-de63-4374-b43b-18e3cb3af710. {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 01:19:00 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-51e7850f-f72f-4df4-a740-f4f3795e10da req-4ac30134-1ad7-4cd5-9d1c-f9752db5965c service nova] Acquiring lock "refresh_cache-ddfecefc-1e9b-4e6e-9995-855c8a061084" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:19:00 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-51e7850f-f72f-4df4-a740-f4f3795e10da req-4ac30134-1ad7-4cd5-9d1c-f9752db5965c service nova] Acquired lock "refresh_cache-ddfecefc-1e9b-4e6e-9995-855c8a061084" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:19:00 user nova-compute[75226]: DEBUG nova.network.neutron [req-51e7850f-f72f-4df4-a740-f4f3795e10da req-4ac30134-1ad7-4cd5-9d1c-f9752db5965c service nova] [instance: ddfecefc-1e9b-4e6e-9995-855c8a061084] Refreshing network info cache for port f9a7562b-de63-4374-b43b-18e3cb3af710 {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 01:19:00 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:19:00 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:19:00 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:19:00 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Starting heal instance info cache {{(pid=75226) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 17 01:19:00 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "refresh_cache-aa84e575-bdad-45b9-80ce-86b1c2826fb0" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:19:00 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquired lock "refresh_cache-aa84e575-bdad-45b9-80ce-86b1c2826fb0" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:19:00 user nova-compute[75226]: DEBUG nova.network.neutron [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] [instance: aa84e575-bdad-45b9-80ce-86b1c2826fb0] Forcefully refreshing network info cache for instance {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 17 01:19:01 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-f16b382f-d3f7-46cf-9812-7361b202e15c tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: aa84e575-bdad-45b9-80ce-86b1c2826fb0] Snapshot image upload complete
Nov 17 01:19:01 user nova-compute[75226]: INFO nova.compute.manager [None req-f16b382f-d3f7-46cf-9812-7361b202e15c tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: aa84e575-bdad-45b9-80ce-86b1c2826fb0] Took 5.63 seconds to snapshot the instance on the hypervisor.
Nov 17 01:19:01 user nova-compute[75226]: DEBUG nova.network.neutron [req-51e7850f-f72f-4df4-a740-f4f3795e10da req-4ac30134-1ad7-4cd5-9d1c-f9752db5965c service nova] [instance: ddfecefc-1e9b-4e6e-9995-855c8a061084] Updated VIF entry in instance network info cache for port f9a7562b-de63-4374-b43b-18e3cb3af710. {{(pid=75226) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 01:19:01 user nova-compute[75226]: DEBUG nova.network.neutron [req-51e7850f-f72f-4df4-a740-f4f3795e10da req-4ac30134-1ad7-4cd5-9d1c-f9752db5965c service nova] [instance: ddfecefc-1e9b-4e6e-9995-855c8a061084] Updating instance_info_cache with network_info: [{"id": "f9a7562b-de63-4374-b43b-18e3cb3af710", "address": "fa:16:3e:94:21:00", "network": {"id": "8450ab2c-4f24-46cc-a6ec-644c02e2b3da", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-385219532-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6869af66e0cc47bf9cca02ea9b688a6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9a7562b-de", "ovs_interfaceid": "f9a7562b-de63-4374-b43b-18e3cb3af710", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:19:01 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-51e7850f-f72f-4df4-a740-f4f3795e10da req-4ac30134-1ad7-4cd5-9d1c-f9752db5965c service nova] Releasing lock "refresh_cache-ddfecefc-1e9b-4e6e-9995-855c8a061084" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:19:01 user nova-compute[75226]: DEBUG nova.network.neutron [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] [instance: aa84e575-bdad-45b9-80ce-86b1c2826fb0] Updating instance_info_cache with network_info: [{"id": "734a9e23-26e5-4282-b842-62e0bb37c782", "address": "fa:16:3e:60:90:47", "network": {"id": "450540a3-ff7e-42fb-a0a6-808acd749943", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1503678778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6cb6f679ee4468d82cc7fb5d0f67be9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap734a9e23-26", "ovs_interfaceid": "734a9e23-26e5-4282-b842-62e0bb37c782", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:19:01 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Releasing lock "refresh_cache-aa84e575-bdad-45b9-80ce-86b1c2826fb0" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:19:01 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] [instance: aa84e575-bdad-45b9-80ce-86b1c2826fb0] Updated the network info_cache for instance {{(pid=75226) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 17 01:19:01 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:19:01 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:19:01 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:19:01 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:19:01 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:19:01 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:19:01 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75226) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 17 01:19:01 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:19:01 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:19:01 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:19:01 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:19:01 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75226) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 17 01:19:01 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75226) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 01:19:01 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddfecefc-1e9b-4e6e-9995-855c8a061084/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:01 user nova-compute[75226]: DEBUG nova.compute.manager [None req-7e9125b8-4d9e-45a9-ac4a-9ab94a29f3be tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] [instance: ddfecefc-1e9b-4e6e-9995-855c8a061084] Checking state {{(pid=75226) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 01:19:01 user nova-compute[75226]: INFO nova.compute.manager [None req-7e9125b8-4d9e-45a9-ac4a-9ab94a29f3be tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] [instance: ddfecefc-1e9b-4e6e-9995-855c8a061084] instance snapshotting
Nov 17 01:19:01 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddfecefc-1e9b-4e6e-9995-855c8a061084/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:01 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddfecefc-1e9b-4e6e-9995-855c8a061084/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:01 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-7e9125b8-4d9e-45a9-ac4a-9ab94a29f3be tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] [instance: ddfecefc-1e9b-4e6e-9995-855c8a061084] Beginning live snapshot process
Nov 17 01:19:02 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-62d19fd0-6ac1-4a36-b396-2148f1539cde tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] [instance: 19250ac2-1b3f-4fe9-80b0-406b181929b6] Calling os-brick to attach iSCSI Volume {{(pid=75226) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 17 01:19:02 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d19fd0-6ac1-4a36-b396-2148f1539cde tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc4cc36b490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f37fc37f-fd78-4093-aad3-102ec16fb30d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UJXQRSwH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:19:02 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-62d19fd0-6ac1-4a36-b396-2148f1539cde tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:19:02 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-62d19fd0-6ac1-4a36-b396-2148f1539cde tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:19:02 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-62d19fd0-6ac1-4a36-b396-2148f1539cde tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:19:02 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-62d19fd0-6ac1-4a36-b396-2148f1539cde tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:19:02 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-62d19fd0-6ac1-4a36-b396-2148f1539cde tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f37fc37f-fd78-4093-aad3-102ec16fb30d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:19:02 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-62d19fd0-6ac1-4a36-b396-2148f1539cde tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f37fc37f-fd78-4093-aad3-102ec16fb30d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:19:02 user nova-compute[75226]: INFO os_brick.initiator.connectors.iscsi [None req-62d19fd0-6ac1-4a36-b396-2148f1539cde tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 17 01:19:02 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f37fc37f-fd78-4093-aad3-102ec16fb30d -p 172.16.0.220:3260 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:02 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f37fc37f-fd78-4093-aad3-102ec16fb30d -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:02 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[b991090c-a33a-4ebd-ac0b-8e512bb08d90]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:02 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d19fd0-6ac1-4a36-b396-2148f1539cde tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 17 01:19:02 user nova-compute[75226]:  {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:19:02 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f37fc37f-fd78-4093-aad3-102ec16fb30d -p 172.16.0.220:3260 --interface default --op new {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:02 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f37fc37f-fd78-4093-aad3-102ec16fb30d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:02 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[4376eab5-51cf-4b2f-9445-8365819dc712]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f37fc37f-fd78-4093-aad3-102ec16fb30d] added\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:02 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d19fd0-6ac1-4a36-b396-2148f1539cde tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f37fc37f-fd78-4093-aad3-102ec16fb30d] added
Nov 17 01:19:02 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:19:02 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f37fc37f-fd78-4093-aad3-102ec16fb30d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:02 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddfecefc-1e9b-4e6e-9995-855c8a061084/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:02 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19250ac2-1b3f-4fe9-80b0-406b181929b6/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:02 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f37fc37f-fd78-4093-aad3-102ec16fb30d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:02 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5756625-179b-477d-acc6-a4f3533c3818]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:02 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d19fd0-6ac1-4a36-b396-2148f1539cde tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:19:02 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f37fc37f-fd78-4093-aad3-102ec16fb30d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:02 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-7e9125b8-4d9e-45a9-ac4a-9ab94a29f3be tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddfecefc-1e9b-4e6e-9995-855c8a061084/disk --force-share --output=json -f qcow2 {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:02 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f37fc37f-fd78-4093-aad3-102ec16fb30d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.045s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:02 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[e16d3648-f94d-4c02-85cc-7f570d2a30ae]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:02 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d19fd0-6ac1-4a36-b396-2148f1539cde tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:19:02 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f37fc37f-fd78-4093-aad3-102ec16fb30d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UJXQRSwH {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:02 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f37fc37f-fd78-4093-aad3-102ec16fb30d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UJXQRSwH" returned: 0 in 0.053s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:02 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3b1bea4-8e10-4497-b7d5-c25d23533c65]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:02 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d19fd0-6ac1-4a36-b396-2148f1539cde tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UJXQRSwH'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:19:02 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f37fc37f-fd78-4093-aad3-102ec16fb30d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:02 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19250ac2-1b3f-4fe9-80b0-406b181929b6/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:02 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19250ac2-1b3f-4fe9-80b0-406b181929b6/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:02 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f37fc37f-fd78-4093-aad3-102ec16fb30d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:02 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[9860fa61-ccc6-4681-8733-c95000f3175a]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:02 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d19fd0-6ac1-4a36-b396-2148f1539cde tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:19:02 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:02 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-7e9125b8-4d9e-45a9-ac4a-9ab94a29f3be tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddfecefc-1e9b-4e6e-9995-855c8a061084/disk --force-share --output=json -f qcow2" returned: 0 in 0.184s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:02 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-7e9125b8-4d9e-45a9-ac4a-9ab94a29f3be tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddfecefc-1e9b-4e6e-9995-855c8a061084/disk --force-share --output=json -f qcow2 {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:02 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:02 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[f63b086f-0c3c-4a1f-b95e-7ab00c4bfed9]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:02 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d19fd0-6ac1-4a36-b396-2148f1539cde tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2 (non-flash)
Nov 17 01:19:02 user nova-compute[75226]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae (non-flash)
Nov 17 01:19:02 user nova-compute[75226]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1 (non-flash)
Nov 17 01:19:02 user nova-compute[75226]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6 (non-flash)
Nov 17 01:19:02 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:19:02 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d19fd0-6ac1-4a36-b396-2148f1539cde tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2 (non-flash)
Nov 17 01:19:02 user nova-compute[75226]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae (non-flash)
Nov 17 01:19:02 user nova-compute[75226]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1 (non-flash)
Nov 17 01:19:02 user nova-compute[75226]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6 (non-flash)
Nov 17 01:19:02 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:19:02 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f37fc37f-fd78-4093-aad3-102ec16fb30d -p 172.16.0.220:3260 --login {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:02 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:19:02 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f37fc37f-fd78-4093-aad3-102ec16fb30d -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:02 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7784935-de17-4c89-89b5-cb3456c1de77]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f37fc37f-fd78-4093-aad3-102ec16fb30d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f37fc37f-fd78-4093-aad3-102ec16fb30d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:02 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d19fd0-6ac1-4a36-b396-2148f1539cde tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f37fc37f-fd78-4093-aad3-102ec16fb30d, portal: 172.16.0.220,3260]
Nov 17 01:19:02 user nova-compute[75226]: Login to [iface: default, target: iqn.2010-10.org.openstack:f37fc37f-fd78-4093-aad3-102ec16fb30d, portal: 172.16.0.220,3260] successful.
Nov 17 01:19:02 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:19:02 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f37fc37f-fd78-4093-aad3-102ec16fb30d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:02 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19250ac2-1b3f-4fe9-80b0-406b181929b6/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:02 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f37fc37f-fd78-4093-aad3-102ec16fb30d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:02 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ccdf618-8449-4c81-80ce-63ffdc6259f9]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:02 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d19fd0-6ac1-4a36-b396-2148f1539cde tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:19:02 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:02 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b054a557-dff6-49f8-9300-1307f8433567/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:02 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:02 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[b77ecc82-29c2-4443-a81b-d07b8a68ea93]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37fc37f-fd78-4093-aad3-102ec16fb30d (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:02 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d19fd0-6ac1-4a36-b396-2148f1539cde tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2 (non-flash)
Nov 17 01:19:02 user nova-compute[75226]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae (non-flash)
Nov 17 01:19:02 user nova-compute[75226]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1 (non-flash)
Nov 17 01:19:02 user nova-compute[75226]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6 (non-flash)
Nov 17 01:19:02 user nova-compute[75226]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37fc37f-fd78-4093-aad3-102ec16fb30d (non-flash)
Nov 17 01:19:02 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:19:02 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d19fd0-6ac1-4a36-b396-2148f1539cde tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2 (non-flash)
Nov 17 01:19:02 user nova-compute[75226]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae (non-flash)
Nov 17 01:19:02 user nova-compute[75226]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1 (non-flash)
Nov 17 01:19:02 user nova-compute[75226]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6 (non-flash)
Nov 17 01:19:02 user nova-compute[75226]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37fc37f-fd78-4093-aad3-102ec16fb30d (non-flash)
Nov 17 01:19:02 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:19:02 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-62d19fd0-6ac1-4a36-b396-2148f1539cde tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f37fc37f-fd78-4093-aad3-102ec16fb30d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.464s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:19:02 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d19fd0-6ac1-4a36-b396-2148f1539cde tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] Connected to 172.16.0.220:3260 {{(pid=75226) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 17 01:19:02 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-62d19fd0-6ac1-4a36-b396-2148f1539cde tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] HCTL ('37', '-', '-', 0) found on session 6 with lun 0 {{(pid=75226) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 17 01:19:02 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-62d19fd0-6ac1-4a36-b396-2148f1539cde tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75226) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 17 01:19:02 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:02 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-7e9125b8-4d9e-45a9-ac4a-9ab94a29f3be tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddfecefc-1e9b-4e6e-9995-855c8a061084/disk --force-share --output=json -f qcow2" returned: 0 in 0.175s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:02 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-7e9125b8-4d9e-45a9-ac4a-9ab94a29f3be tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:02 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:02 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d97b16f-7e0e-4678-a732-650803e44a3c]: (4, ('- - 0', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:02 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-62d19fd0-6ac1-4a36-b396-2148f1539cde tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75226) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 01:19:02 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d19fd0-6ac1-4a36-b396-2148f1539cde tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:f37fc37f-fd78-4093-aad3-102ec16fb30d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UJXQRSwH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75226) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 17 01:19:02 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b054a557-dff6-49f8-9300-1307f8433567/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:02 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b054a557-dff6-49f8-9300-1307f8433567/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:02 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-7e9125b8-4d9e-45a9-ac4a-9ab94a29f3be tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json" returned: 0 in 0.169s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:02 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-7e9125b8-4d9e-45a9-ac4a-9ab94a29f3be tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpe74_0twt/11edd8c491534ddda2d209853ef98ed7.delta 1073741824 {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:02 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-7e9125b8-4d9e-45a9-ac4a-9ab94a29f3be tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpe74_0twt/11edd8c491534ddda2d209853ef98ed7.delta 1073741824" returned: 0 in 0.045s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:02 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-7e9125b8-4d9e-45a9-ac4a-9ab94a29f3be tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] [instance: ddfecefc-1e9b-4e6e-9995-855c8a061084] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 17 01:19:02 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b054a557-dff6-49f8-9300-1307f8433567/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:02 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa84e575-bdad-45b9-80ce-86b1c2826fb0/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:03 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa84e575-bdad-45b9-80ce-86b1c2826fb0/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:03 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa84e575-bdad-45b9-80ce-86b1c2826fb0/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:03 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa84e575-bdad-45b9-80ce-86b1c2826fb0/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:03 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c505f8d-09e0-41bc-ba3a-89bde1646613/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:03 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c505f8d-09e0-41bc-ba3a-89bde1646613/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:03 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c505f8d-09e0-41bc-ba3a-89bde1646613/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:03 user nova-compute[75226]: DEBUG nova.virt.libvirt.guest [None req-7e9125b8-4d9e-45a9-ac4a-9ab94a29f3be tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75226) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 17 01:19:03 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c505f8d-09e0-41bc-ba3a-89bde1646613/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:03 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-62d19fd0-6ac1-4a36-b396-2148f1539cde tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.522s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:19:03 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d19fd0-6ac1-4a36-b396-2148f1539cde tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] <== connect_volume: return (1523ms) {'type': 'block', 'scsi_wwn': '26436386331636336', 'path': '/dev/sdf'} {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:19:03 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-62d19fd0-6ac1-4a36-b396-2148f1539cde tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] [instance: 19250ac2-1b3f-4fe9-80b0-406b181929b6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26436386331636336', 'path': '/dev/sdf'} {{(pid=75226) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 17 01:19:03 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7830f7a-80f1-4c2f-bd64-363e6dd9114a/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:03 user nova-compute[75226]: DEBUG nova.objects.instance [None req-62d19fd0-6ac1-4a36-b396-2148f1539cde tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] Lazy-loading 'flavor' on Instance uuid 19250ac2-1b3f-4fe9-80b0-406b181929b6 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:19:03 user nova-compute[75226]: DEBUG nova.virt.libvirt.guest [None req-62d19fd0-6ac1-4a36-b396-2148f1539cde tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] attach device xml: <disk type="block" device="disk">
Nov 17 01:19:03 user nova-compute[75226]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 01:19:03 user nova-compute[75226]:   <source dev="/dev/sdf"/>
Nov 17 01:19:03 user nova-compute[75226]:   <target dev="vdb" bus="virtio"/>
Nov 17 01:19:03 user nova-compute[75226]:   <serial>f37fc37f-fd78-4093-aad3-102ec16fb30d</serial>
Nov 17 01:19:03 user nova-compute[75226]: </disk>
Nov 17 01:19:03 user nova-compute[75226]:  {{(pid=75226) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 17 01:19:03 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7830f7a-80f1-4c2f-bd64-363e6dd9114a/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:03 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7830f7a-80f1-4c2f-bd64-363e6dd9114a/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:03 user nova-compute[75226]: DEBUG nova.virt.libvirt.guest [None req-7e9125b8-4d9e-45a9-ac4a-9ab94a29f3be tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] COPY block job progress, current cursor: 75431936 final cursor: 75497472 {{(pid=75226) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 17 01:19:04 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7830f7a-80f1-4c2f-bd64-363e6dd9114a/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:04 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75226) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 01:19:04 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75226) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 01:19:04 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=75226) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 01:19:04 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75b1cabe-ba15-4851-9140-5949afc33005/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:04 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-62d19fd0-6ac1-4a36-b396-2148f1539cde tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] No BDM found with device name vda, not building metadata. {{(pid=75226) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 01:19:04 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-62d19fd0-6ac1-4a36-b396-2148f1539cde tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75226) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 01:19:04 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-62d19fd0-6ac1-4a36-b396-2148f1539cde tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] No VIF found with MAC fa:16:3e:44:7e:c6, not building metadata {{(pid=75226) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 01:19:04 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75b1cabe-ba15-4851-9140-5949afc33005/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:04 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75b1cabe-ba15-4851-9140-5949afc33005/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:04 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-62d19fd0-6ac1-4a36-b396-2148f1539cde tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] Lock "19250ac2-1b3f-4fe9-80b0-406b181929b6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.431s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:19:04 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75b1cabe-ba15-4851-9140-5949afc33005/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:04 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/724b81dd-4531-4c99-850d-0bfcbfdf7bd4/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:04 user nova-compute[75226]: DEBUG nova.virt.libvirt.guest [None req-7e9125b8-4d9e-45a9-ac4a-9ab94a29f3be tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75226) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 17 01:19:04 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-7e9125b8-4d9e-45a9-ac4a-9ab94a29f3be tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] [instance: ddfecefc-1e9b-4e6e-9995-855c8a061084] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 17 01:19:04 user nova-compute[75226]: DEBUG nova.privsep.utils [None req-7e9125b8-4d9e-45a9-ac4a-9ab94a29f3be tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75226) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 17 01:19:04 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-7e9125b8-4d9e-45a9-ac4a-9ab94a29f3be tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpe74_0twt/11edd8c491534ddda2d209853ef98ed7.delta /opt/stack/data/nova/instances/snapshots/tmpe74_0twt/11edd8c491534ddda2d209853ef98ed7 {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:04 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/724b81dd-4531-4c99-850d-0bfcbfdf7bd4/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:04 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/724b81dd-4531-4c99-850d-0bfcbfdf7bd4/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:04 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-76c6e99c-54a6-4bbb-9643-6963c500d53a tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] Acquiring lock "19250ac2-1b3f-4fe9-80b0-406b181929b6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:19:04 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-76c6e99c-54a6-4bbb-9643-6963c500d53a tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] Lock "19250ac2-1b3f-4fe9-80b0-406b181929b6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:19:04 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-76c6e99c-54a6-4bbb-9643-6963c500d53a tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] Acquiring lock "19250ac2-1b3f-4fe9-80b0-406b181929b6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:19:04 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-76c6e99c-54a6-4bbb-9643-6963c500d53a tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] Lock "19250ac2-1b3f-4fe9-80b0-406b181929b6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:19:04 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-76c6e99c-54a6-4bbb-9643-6963c500d53a tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] Lock "19250ac2-1b3f-4fe9-80b0-406b181929b6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:19:04 user nova-compute[75226]: INFO nova.compute.manager [None req-76c6e99c-54a6-4bbb-9643-6963c500d53a tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] [instance: 19250ac2-1b3f-4fe9-80b0-406b181929b6] Terminating instance
Nov 17 01:19:04 user nova-compute[75226]: DEBUG nova.compute.manager [None req-76c6e99c-54a6-4bbb-9643-6963c500d53a tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] [instance: 19250ac2-1b3f-4fe9-80b0-406b181929b6] Start destroying the instance on the hypervisor. {{(pid=75226) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 17 01:19:04 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/724b81dd-4531-4c99-850d-0bfcbfdf7bd4/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:04 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-7e9125b8-4d9e-45a9-ac4a-9ab94a29f3be tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpe74_0twt/11edd8c491534ddda2d209853ef98ed7.delta /opt/stack/data/nova/instances/snapshots/tmpe74_0twt/11edd8c491534ddda2d209853ef98ed7" returned: 0 in 0.235s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:04 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-7e9125b8-4d9e-45a9-ac4a-9ab94a29f3be tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] [instance: ddfecefc-1e9b-4e6e-9995-855c8a061084] Snapshot extracted, beginning image upload
Nov 17 01:19:05 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:19:05 user nova-compute[75226]: DEBUG nova.compute.manager [req-9f705f0d-d9ca-4496-ba31-24f9cd4dc20a req-934c9a69-f4f3-46c2-84c6-4914e23c3ab7 service nova] [instance: 19250ac2-1b3f-4fe9-80b0-406b181929b6] Received event network-vif-unplugged-093abf0b-d4eb-4be3-bda0-4a7d19fe6ac2 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:19:05 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-9f705f0d-d9ca-4496-ba31-24f9cd4dc20a req-934c9a69-f4f3-46c2-84c6-4914e23c3ab7 service nova] Acquiring lock "19250ac2-1b3f-4fe9-80b0-406b181929b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:19:05 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-9f705f0d-d9ca-4496-ba31-24f9cd4dc20a req-934c9a69-f4f3-46c2-84c6-4914e23c3ab7 service nova] Lock "19250ac2-1b3f-4fe9-80b0-406b181929b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:19:05 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-9f705f0d-d9ca-4496-ba31-24f9cd4dc20a req-934c9a69-f4f3-46c2-84c6-4914e23c3ab7 service nova] Lock "19250ac2-1b3f-4fe9-80b0-406b181929b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:19:05 user nova-compute[75226]: DEBUG nova.compute.manager [req-9f705f0d-d9ca-4496-ba31-24f9cd4dc20a req-934c9a69-f4f3-46c2-84c6-4914e23c3ab7 service nova] [instance: 19250ac2-1b3f-4fe9-80b0-406b181929b6] No waiting events found dispatching network-vif-unplugged-093abf0b-d4eb-4be3-bda0-4a7d19fe6ac2 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:19:05 user nova-compute[75226]: DEBUG nova.compute.manager [req-9f705f0d-d9ca-4496-ba31-24f9cd4dc20a req-934c9a69-f4f3-46c2-84c6-4914e23c3ab7 service nova] [instance: 19250ac2-1b3f-4fe9-80b0-406b181929b6] Received event network-vif-unplugged-093abf0b-d4eb-4be3-bda0-4a7d19fe6ac2 for instance with task_state deleting. {{(pid=75226) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 17 01:19:05 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:19:05 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:19:05 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Hypervisor/Node resource view: name=user free_ram=7104MB free_disk=25.373565673828125GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75226) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 17 01:19:05 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:19:05 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:19:05 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:19:05 user nova-compute[75226]: INFO nova.virt.libvirt.driver [-] [instance: 19250ac2-1b3f-4fe9-80b0-406b181929b6] Instance destroyed successfully.
Nov 17 01:19:05 user nova-compute[75226]: DEBUG nova.objects.instance [None req-76c6e99c-54a6-4bbb-9643-6963c500d53a tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] Lazy-loading 'resources' on Instance uuid 19250ac2-1b3f-4fe9-80b0-406b181929b6 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:19:05 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-76c6e99c-54a6-4bbb-9643-6963c500d53a tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:17:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-703343217',display_name='tempest-DeleteServersTestJSON-server-703343217',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-703343217',id=1,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-17T01:17:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2cc9e48d967049cab3393af3f9dcbe48',ramdisk_id='',reservation_id='r-0el1cq47',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-117486716',owner_user_name='tempest-DeleteServersTestJSON-117486716-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T01:17:19Z,user_data=None,user_id='e1bdd8e75fdd44a7b5706d42e831bb82',uuid=19250ac2-1b3f-4fe9-80b0-406b181929b6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "093abf0b-d4eb-4be3-bda0-4a7d19fe6ac2", "address": "fa:16:3e:44:7e:c6", "network": {"id": "3dcb272c-6114-40d2-8236-2deea2de36cf", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-883099730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cc9e48d967049cab3393af3f9dcbe48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap093abf0b-d4", "ovs_interfaceid": "093abf0b-d4eb-4be3-bda0-4a7d19fe6ac2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 17 01:19:05 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-76c6e99c-54a6-4bbb-9643-6963c500d53a tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] Converting VIF {"id": "093abf0b-d4eb-4be3-bda0-4a7d19fe6ac2", "address": "fa:16:3e:44:7e:c6", "network": {"id": "3dcb272c-6114-40d2-8236-2deea2de36cf", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-883099730-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cc9e48d967049cab3393af3f9dcbe48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap093abf0b-d4", "ovs_interfaceid": "093abf0b-d4eb-4be3-bda0-4a7d19fe6ac2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:19:05 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-76c6e99c-54a6-4bbb-9643-6963c500d53a tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:44:7e:c6,bridge_name='br-int',has_traffic_filtering=True,id=093abf0b-d4eb-4be3-bda0-4a7d19fe6ac2,network=Network(3dcb272c-6114-40d2-8236-2deea2de36cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap093abf0b-d4') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:19:05 user nova-compute[75226]: DEBUG os_vif [None req-76c6e99c-54a6-4bbb-9643-6963c500d53a tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:44:7e:c6,bridge_name='br-int',has_traffic_filtering=True,id=093abf0b-d4eb-4be3-bda0-4a7d19fe6ac2,network=Network(3dcb272c-6114-40d2-8236-2deea2de36cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap093abf0b-d4') {{(pid=75226) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 17 01:19:05 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:19:05 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap093abf0b-d4, bridge=br-int, if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:19:05 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:19:05 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:19:05 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f86a2b1d-ea95-4ed9-9227-13fa34201d7f) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:19:05 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:19:05 user nova-compute[75226]: INFO os_vif [None req-76c6e99c-54a6-4bbb-9643-6963c500d53a tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:44:7e:c6,bridge_name='br-int',has_traffic_filtering=True,id=093abf0b-d4eb-4be3-bda0-4a7d19fe6ac2,network=Network(3dcb272c-6114-40d2-8236-2deea2de36cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap093abf0b-d4')
Nov 17 01:19:05 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76c6e99c-54a6-4bbb-9643-6963c500d53a tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] [instance: 19250ac2-1b3f-4fe9-80b0-406b181929b6] calling os-brick to detach iSCSI Volume {{(pid=75226) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 17 01:19:05 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-76c6e99c-54a6-4bbb-9643-6963c500d53a tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc4cc36b490>, {'target_iqn': 'iqn.2010-10.org.openstack:f37fc37f-fd78-4093-aad3-102ec16fb30d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UJXQRSwH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:19:05 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-76c6e99c-54a6-4bbb-9643-6963c500d53a tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:19:05 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-76c6e99c-54a6-4bbb-9643-6963c500d53a tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:19:05 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-76c6e99c-54a6-4bbb-9643-6963c500d53a tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:19:05 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 19250ac2-1b3f-4fe9-80b0-406b181929b6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:19:05 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance aa84e575-bdad-45b9-80ce-86b1c2826fb0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:19:05 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance ddfecefc-1e9b-4e6e-9995-855c8a061084 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:19:05 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 724b81dd-4531-4c99-850d-0bfcbfdf7bd4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:19:05 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 75b1cabe-ba15-4851-9140-5949afc33005 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:19:05 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance b054a557-dff6-49f8-9300-1307f8433567 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:19:05 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance e7830f7a-80f1-4c2f-bd64-363e6dd9114a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:19:05 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 1c505f8d-09e0-41bc-ba3a-89bde1646613 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:19:05 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 262eb845-eebe-4ffb-bc49-dcaca53ad7b8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:19:05 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 27342ec6-7a03-4f99-8056-5cb56794aa41 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:19:05 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75226) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 17 01:19:05 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75226) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 17 01:19:05 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:05 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:05 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a7ef4cf-1c5e-45b2-9708-f2812d1ba526]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f37fc37f-fd78-4093-aad3-102ec16fb30d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:05 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-76c6e99c-54a6-4bbb-9643-6963c500d53a tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 17 01:19:05 user nova-compute[75226]: No targets found.
Nov 17 01:19:05 user nova-compute[75226]: iSNS:
Nov 17 01:19:05 user nova-compute[75226]: No targets found.
Nov 17 01:19:05 user nova-compute[75226]: STATIC:
Nov 17 01:19:05 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae
Nov 17 01:19:05 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:19:05 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:19:05 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:f37fc37f-fd78-4093-aad3-102ec16fb30d
Nov 17 01:19:05 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:19:05 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:19:05 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1
Nov 17 01:19:05 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:19:05 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:19:05 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2
Nov 17 01:19:05 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:19:05 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:19:05 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6
Nov 17 01:19:05 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:19:05 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:19:05 user nova-compute[75226]: FIRMWARE:
Nov 17 01:19:05 user nova-compute[75226]: No targets found.
Nov 17 01:19:05 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:19:05 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-76c6e99c-54a6-4bbb-9643-6963c500d53a tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 17 01:19:05 user nova-compute[75226]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 17 01:19:05 user nova-compute[75226]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75226) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 17 01:19:05 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-76c6e99c-54a6-4bbb-9643-6963c500d53a tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f37fc37f-fd78-4093-aad3-102ec16fb30d', 0)] {{(pid=75226) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 17 01:19:05 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:05 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:05 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0480e29-80ec-4f37-852a-be35c59246ef]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f37fc37f-fd78-4093-aad3-102ec16fb30d\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:05 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:05 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:05 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[1281a825-c40a-45d2-8b2a-d7dcfa19b2d8]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37fc37f-fd78-4093-aad3-102ec16fb30d (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:05 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-76c6e99c-54a6-4bbb-9643-6963c500d53a tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2 (non-flash)
Nov 17 01:19:05 user nova-compute[75226]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae (non-flash)
Nov 17 01:19:05 user nova-compute[75226]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1 (non-flash)
Nov 17 01:19:05 user nova-compute[75226]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6 (non-flash)
Nov 17 01:19:05 user nova-compute[75226]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37fc37f-fd78-4093-aad3-102ec16fb30d (non-flash)
Nov 17 01:19:05 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:19:05 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-76c6e99c-54a6-4bbb-9643-6963c500d53a tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2 (non-flash)
Nov 17 01:19:05 user nova-compute[75226]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae (non-flash)
Nov 17 01:19:05 user nova-compute[75226]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1 (non-flash)
Nov 17 01:19:05 user nova-compute[75226]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6 (non-flash)
Nov 17 01:19:05 user nova-compute[75226]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37fc37f-fd78-4093-aad3-102ec16fb30d (non-flash)
Nov 17 01:19:05 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:19:05 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-76c6e99c-54a6-4bbb-9643-6963c500d53a tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc4d4163f40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f37fc37f-fd78-4093-aad3-102ec16fb30d'): ({'sdf'}, set())}) {{(pid=75226) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 17 01:19:05 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-76c6e99c-54a6-4bbb-9643-6963c500d53a tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] Removing single pathed devices sdf {{(pid=75226) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 17 01:19:05 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:05 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:05 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[7298daab-0584-4a55-bc2a-54fa669389e3]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:05 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:05 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:05 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffc76138-13a3-4f50-ae5d-499f4c4166f2]: (4, ('ok\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:05 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-76c6e99c-54a6-4bbb-9643-6963c500d53a tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] Flushing IO for device /dev/sdf {{(pid=75226) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 17 01:19:05 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:05 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.012s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:05 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc411392-67a6-445e-8dd0-c0208c9aa9c8]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:05 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-76c6e99c-54a6-4bbb-9643-6963c500d53a tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75226) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 17 01:19:05 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:05 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.032s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:05 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[70411a27-1b6e-4a2f-b995-1b3ca3167ce2]: (4, ('1', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:05 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-76c6e99c-54a6-4bbb-9643-6963c500d53a tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75226) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 17 01:19:05 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-76c6e99c-54a6-4bbb-9643-6963c500d53a tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] SCSI volumes sdf have been removed. {{(pid=75226) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 17 01:19:05 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-76c6e99c-54a6-4bbb-9643-6963c500d53a tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f37fc37f-fd78-4093-aad3-102ec16fb30d')] {{(pid=75226) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 17 01:19:05 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f37fc37f-fd78-4093-aad3-102ec16fb30d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:05 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f37fc37f-fd78-4093-aad3-102ec16fb30d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:05 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd1413f7-861c-4d14-8447-d3b1ae026f4e]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:05 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-76c6e99c-54a6-4bbb-9643-6963c500d53a tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:19:05 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f37fc37f-fd78-4093-aad3-102ec16fb30d -p 172.16.0.220:3260 --logout {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:05 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f37fc37f-fd78-4093-aad3-102ec16fb30d -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:05 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[eebbacd4-34c1-4a19-ae6a-47485545831a]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:f37fc37f-fd78-4093-aad3-102ec16fb30d, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:f37fc37f-fd78-4093-aad3-102ec16fb30d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:05 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-76c6e99c-54a6-4bbb-9643-6963c500d53a tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:f37fc37f-fd78-4093-aad3-102ec16fb30d, portal: 172.16.0.220,3260]
Nov 17 01:19:05 user nova-compute[75226]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:f37fc37f-fd78-4093-aad3-102ec16fb30d, portal: 172.16.0.220,3260] successful.
Nov 17 01:19:05 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:19:05 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f37fc37f-fd78-4093-aad3-102ec16fb30d -p 172.16.0.220:3260 --op delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:05 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:19:05 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f37fc37f-fd78-4093-aad3-102ec16fb30d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:05 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[44615b71-8d85-474f-a0bf-85cba646291b]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:05 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-76c6e99c-54a6-4bbb-9643-6963c500d53a tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:19:05 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-76c6e99c-54a6-4bbb-9643-6963c500d53a tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.318s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:19:05 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-76c6e99c-54a6-4bbb-9643-6963c500d53a tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] <== disconnect_volume: return (319ms) None {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:19:05 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76c6e99c-54a6-4bbb-9643-6963c500d53a tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] [instance: 19250ac2-1b3f-4fe9-80b0-406b181929b6] Disconnected iSCSI Volume {{(pid=75226) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 17 01:19:05 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-76c6e99c-54a6-4bbb-9643-6963c500d53a tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] [instance: 19250ac2-1b3f-4fe9-80b0-406b181929b6] Deleting instance files /opt/stack/data/nova/instances/19250ac2-1b3f-4fe9-80b0-406b181929b6_del
Nov 17 01:19:05 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-76c6e99c-54a6-4bbb-9643-6963c500d53a tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] [instance: 19250ac2-1b3f-4fe9-80b0-406b181929b6] Deletion of /opt/stack/data/nova/instances/19250ac2-1b3f-4fe9-80b0-406b181929b6_del complete
Nov 17 01:19:05 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:19:05 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Compute_service record updated for user:user {{(pid=75226) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 17 01:19:05 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.534s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:19:05 user nova-compute[75226]: INFO nova.compute.manager [None req-76c6e99c-54a6-4bbb-9643-6963c500d53a tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] [instance: 19250ac2-1b3f-4fe9-80b0-406b181929b6] Took 1.22 seconds to destroy the instance on the hypervisor.
Nov 17 01:19:05 user nova-compute[75226]: DEBUG oslo.service.loopingcall [None req-76c6e99c-54a6-4bbb-9643-6963c500d53a tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75226) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 17 01:19:05 user nova-compute[75226]: DEBUG nova.compute.manager [-] [instance: 19250ac2-1b3f-4fe9-80b0-406b181929b6] Deallocating network for instance {{(pid=75226) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 17 01:19:05 user nova-compute[75226]: DEBUG nova.network.neutron [-] [instance: 19250ac2-1b3f-4fe9-80b0-406b181929b6] deallocate_for_instance() {{(pid=75226) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 17 01:19:06 user nova-compute[75226]: DEBUG nova.network.neutron [-] [instance: 19250ac2-1b3f-4fe9-80b0-406b181929b6] Updating instance_info_cache with network_info: [] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:19:06 user nova-compute[75226]: INFO nova.compute.manager [-] [instance: 19250ac2-1b3f-4fe9-80b0-406b181929b6] Took 0.58 seconds to deallocate network for instance.
Nov 17 01:19:06 user nova-compute[75226]: DEBUG nova.compute.manager [req-17901ef7-a764-4590-9134-b9411dc28a8a req-c9b60303-f5ee-4f2f-868e-3e061186eaf4 service nova] [instance: 19250ac2-1b3f-4fe9-80b0-406b181929b6] Received event network-vif-deleted-093abf0b-d4eb-4be3-bda0-4a7d19fe6ac2 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:19:06 user nova-compute[75226]: INFO nova.compute.manager [req-17901ef7-a764-4590-9134-b9411dc28a8a req-c9b60303-f5ee-4f2f-868e-3e061186eaf4 service nova] [instance: 19250ac2-1b3f-4fe9-80b0-406b181929b6] Neutron deleted interface 093abf0b-d4eb-4be3-bda0-4a7d19fe6ac2; detaching it from the instance and deleting it from the info cache
Nov 17 01:19:06 user nova-compute[75226]: DEBUG nova.network.neutron [req-17901ef7-a764-4590-9134-b9411dc28a8a req-c9b60303-f5ee-4f2f-868e-3e061186eaf4 service nova] [instance: 19250ac2-1b3f-4fe9-80b0-406b181929b6] Updating instance_info_cache with network_info: [] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:19:06 user nova-compute[75226]: DEBUG nova.compute.manager [req-17901ef7-a764-4590-9134-b9411dc28a8a req-c9b60303-f5ee-4f2f-868e-3e061186eaf4 service nova] [instance: 19250ac2-1b3f-4fe9-80b0-406b181929b6] Detach interface failed, port_id=093abf0b-d4eb-4be3-bda0-4a7d19fe6ac2, reason: Instance 19250ac2-1b3f-4fe9-80b0-406b181929b6 could not be found. {{(pid=75226) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 17 01:19:07 user nova-compute[75226]: DEBUG nova.compute.manager [req-81a764d1-b6e7-4983-ad3b-d5cf396ec22a req-8e39d9d3-6b9f-4d65-9bd6-fdb151f500e8 service nova] [instance: 19250ac2-1b3f-4fe9-80b0-406b181929b6] Received event network-vif-plugged-093abf0b-d4eb-4be3-bda0-4a7d19fe6ac2 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:19:07 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-81a764d1-b6e7-4983-ad3b-d5cf396ec22a req-8e39d9d3-6b9f-4d65-9bd6-fdb151f500e8 service nova] Acquiring lock "19250ac2-1b3f-4fe9-80b0-406b181929b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:19:07 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-81a764d1-b6e7-4983-ad3b-d5cf396ec22a req-8e39d9d3-6b9f-4d65-9bd6-fdb151f500e8 service nova] Lock "19250ac2-1b3f-4fe9-80b0-406b181929b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:19:07 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-81a764d1-b6e7-4983-ad3b-d5cf396ec22a req-8e39d9d3-6b9f-4d65-9bd6-fdb151f500e8 service nova] Lock "19250ac2-1b3f-4fe9-80b0-406b181929b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:19:07 user nova-compute[75226]: DEBUG nova.compute.manager [req-81a764d1-b6e7-4983-ad3b-d5cf396ec22a req-8e39d9d3-6b9f-4d65-9bd6-fdb151f500e8 service nova] [instance: 19250ac2-1b3f-4fe9-80b0-406b181929b6] No waiting events found dispatching network-vif-plugged-093abf0b-d4eb-4be3-bda0-4a7d19fe6ac2 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:19:07 user nova-compute[75226]: WARNING nova.compute.manager [req-81a764d1-b6e7-4983-ad3b-d5cf396ec22a req-8e39d9d3-6b9f-4d65-9bd6-fdb151f500e8 service nova] [instance: 19250ac2-1b3f-4fe9-80b0-406b181929b6] Received unexpected event network-vif-plugged-093abf0b-d4eb-4be3-bda0-4a7d19fe6ac2 for instance with vm_state active and task_state deleting.
Nov 17 01:19:07 user nova-compute[75226]: INFO nova.compute.manager [None req-76c6e99c-54a6-4bbb-9643-6963c500d53a tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] [instance: 19250ac2-1b3f-4fe9-80b0-406b181929b6] Took 0.74 seconds to detach 1 volumes for instance.
Nov 17 01:19:07 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-76c6e99c-54a6-4bbb-9643-6963c500d53a tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:19:07 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-76c6e99c-54a6-4bbb-9643-6963c500d53a tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:19:07 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:19:07 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-76c6e99c-54a6-4bbb-9643-6963c500d53a tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:19:07 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-76c6e99c-54a6-4bbb-9643-6963c500d53a tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:19:07 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-76c6e99c-54a6-4bbb-9643-6963c500d53a tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.331s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:19:07 user nova-compute[75226]: INFO nova.scheduler.client.report [None req-76c6e99c-54a6-4bbb-9643-6963c500d53a tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] Deleted allocations for instance 19250ac2-1b3f-4fe9-80b0-406b181929b6
Nov 17 01:19:07 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-76c6e99c-54a6-4bbb-9643-6963c500d53a tempest-DeleteServersTestJSON-117486716 tempest-DeleteServersTestJSON-117486716-project-member] Lock "19250ac2-1b3f-4fe9-80b0-406b181929b6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.127s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:19:08 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-7e9125b8-4d9e-45a9-ac4a-9ab94a29f3be tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] [instance: ddfecefc-1e9b-4e6e-9995-855c8a061084] Snapshot image upload complete
Nov 17 01:19:08 user nova-compute[75226]: INFO nova.compute.manager [None req-7e9125b8-4d9e-45a9-ac4a-9ab94a29f3be tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] [instance: ddfecefc-1e9b-4e6e-9995-855c8a061084] Took 6.41 seconds to snapshot the instance on the hypervisor.
Nov 17 01:19:10 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:19:12 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:19:15 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:19:15 user nova-compute[75226]: DEBUG nova.compute.manager [req-6885a24e-4924-4c76-9b65-7ea24f367338 req-1980a089-349e-492c-ac1b-1ace2ddcc4ab service nova] [instance: 724b81dd-4531-4c99-850d-0bfcbfdf7bd4] Received event network-changed-f9692d93-cc90-464e-a8ef-abb2a5bb8fe0 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:19:15 user nova-compute[75226]: DEBUG nova.compute.manager [req-6885a24e-4924-4c76-9b65-7ea24f367338 req-1980a089-349e-492c-ac1b-1ace2ddcc4ab service nova] [instance: 724b81dd-4531-4c99-850d-0bfcbfdf7bd4] Refreshing instance network info cache due to event network-changed-f9692d93-cc90-464e-a8ef-abb2a5bb8fe0. {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 01:19:15 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-6885a24e-4924-4c76-9b65-7ea24f367338 req-1980a089-349e-492c-ac1b-1ace2ddcc4ab service nova] Acquiring lock "refresh_cache-724b81dd-4531-4c99-850d-0bfcbfdf7bd4" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:19:15 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-6885a24e-4924-4c76-9b65-7ea24f367338 req-1980a089-349e-492c-ac1b-1ace2ddcc4ab service nova] Acquired lock "refresh_cache-724b81dd-4531-4c99-850d-0bfcbfdf7bd4" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:19:15 user nova-compute[75226]: DEBUG nova.network.neutron [req-6885a24e-4924-4c76-9b65-7ea24f367338 req-1980a089-349e-492c-ac1b-1ace2ddcc4ab service nova] [instance: 724b81dd-4531-4c99-850d-0bfcbfdf7bd4] Refreshing network info cache for port f9692d93-cc90-464e-a8ef-abb2a5bb8fe0 {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 01:19:16 user nova-compute[75226]: DEBUG nova.network.neutron [req-6885a24e-4924-4c76-9b65-7ea24f367338 req-1980a089-349e-492c-ac1b-1ace2ddcc4ab service nova] [instance: 724b81dd-4531-4c99-850d-0bfcbfdf7bd4] Updated VIF entry in instance network info cache for port f9692d93-cc90-464e-a8ef-abb2a5bb8fe0. {{(pid=75226) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 01:19:16 user nova-compute[75226]: DEBUG nova.network.neutron [req-6885a24e-4924-4c76-9b65-7ea24f367338 req-1980a089-349e-492c-ac1b-1ace2ddcc4ab service nova] [instance: 724b81dd-4531-4c99-850d-0bfcbfdf7bd4] Updating instance_info_cache with network_info: [{"id": "f9692d93-cc90-464e-a8ef-abb2a5bb8fe0", "address": "fa:16:3e:ac:88:c8", "network": {"id": "1c1e8b70-ab07-4bf6-896b-f8779c33ac07", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1634201097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a364d502d8948ff8b255dd2531b6218", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9692d93-cc", "ovs_interfaceid": "f9692d93-cc90-464e-a8ef-abb2a5bb8fe0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:19:16 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-6885a24e-4924-4c76-9b65-7ea24f367338 req-1980a089-349e-492c-ac1b-1ace2ddcc4ab service nova] Releasing lock "refresh_cache-724b81dd-4531-4c99-850d-0bfcbfdf7bd4" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:19:17 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:19:18 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-2397a5a7-bff3-4fa5-bda6-dc7090ee964a tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Acquiring lock "724b81dd-4531-4c99-850d-0bfcbfdf7bd4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:19:18 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-2397a5a7-bff3-4fa5-bda6-dc7090ee964a tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Lock "724b81dd-4531-4c99-850d-0bfcbfdf7bd4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:19:18 user nova-compute[75226]: DEBUG nova.objects.instance [None req-2397a5a7-bff3-4fa5-bda6-dc7090ee964a tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Lazy-loading 'flavor' on Instance uuid 724b81dd-4531-4c99-850d-0bfcbfdf7bd4 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:19:18 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-2397a5a7-bff3-4fa5-bda6-dc7090ee964a tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Lock "724b81dd-4531-4c99-850d-0bfcbfdf7bd4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:19:18 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-2397a5a7-bff3-4fa5-bda6-dc7090ee964a tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Acquiring lock "724b81dd-4531-4c99-850d-0bfcbfdf7bd4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:19:18 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-2397a5a7-bff3-4fa5-bda6-dc7090ee964a tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Lock "724b81dd-4531-4c99-850d-0bfcbfdf7bd4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:19:18 user nova-compute[75226]: INFO nova.compute.manager [None req-2397a5a7-bff3-4fa5-bda6-dc7090ee964a tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] [instance: 724b81dd-4531-4c99-850d-0bfcbfdf7bd4] Attaching volume 642eafe0-08e5-4d34-a949-c1704d63b132 to /dev/vdb
Nov 17 01:19:18 user nova-compute[75226]: DEBUG os_brick.utils [None req-2397a5a7-bff3-4fa5-bda6-dc7090ee964a tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:19:18 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:18 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:18 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4346f87-9f8b-49ff-b85b-f2bafecb1cf9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f62857db69\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:18 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:18 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:18 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[64bb92cc-a863-42a9-b093-41a2b210c267]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:18 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:18 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:18 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f347545-0d88-4b9f-9eff-ed581f77ae59]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:18 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[07cd2acb-61d5-40dc-b155-80f371128cbb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:18 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-2397a5a7-bff3-4fa5-bda6-dc7090ee964a tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Running cmd (subprocess): nvme version {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:18 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-2397a5a7-bff3-4fa5-bda6-dc7090ee964a tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] 'nvme version' failed. Not Retrying. {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 01:19:18 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2397a5a7-bff3-4fa5-bda6-dc7090ee964a tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] nvme not present on system {{(pid=75226) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 17 01:19:18 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:18 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 01:19:18 user nova-compute[75226]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 17 01:19:18 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[f691bbc6-7ee5-4fc4-916b-d19eef61796a]: (4, '') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:18 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-2397a5a7-bff3-4fa5-bda6-dc7090ee964a tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75226) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 17 01:19:18 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-2397a5a7-bff3-4fa5-bda6-dc7090ee964a tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75226) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 17 01:19:18 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-2397a5a7-bff3-4fa5-bda6-dc7090ee964a tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] LIGHTOS: no hostnqn found. {{(pid=75226) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 17 01:19:18 user nova-compute[75226]: DEBUG os_brick.utils [None req-2397a5a7-bff3-4fa5-bda6-dc7090ee964a tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] <== get_connector_properties: return (108ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f62857db69', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:19:18 user nova-compute[75226]: DEBUG nova.virt.block_device [None req-2397a5a7-bff3-4fa5-bda6-dc7090ee964a tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] [instance: 724b81dd-4531-4c99-850d-0bfcbfdf7bd4] Updating existing volume attachment record: a345d5d1-2951-4f28-94c4-96421b5d84d4 {{(pid=75226) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 17 01:19:19 user nova-compute[75226]: DEBUG nova.compute.manager [req-4faf5560-279f-44c2-99ad-aab3891a5bd9 req-f45e78fc-7731-4a5d-bdc4-2e8896916b81 service nova] [instance: 75b1cabe-ba15-4851-9140-5949afc33005] Received event network-changed-8e47eaef-6e73-4c79-973d-31f6481368be {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:19:19 user nova-compute[75226]: DEBUG nova.compute.manager [req-4faf5560-279f-44c2-99ad-aab3891a5bd9 req-f45e78fc-7731-4a5d-bdc4-2e8896916b81 service nova] [instance: 75b1cabe-ba15-4851-9140-5949afc33005] Refreshing instance network info cache due to event network-changed-8e47eaef-6e73-4c79-973d-31f6481368be. {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 01:19:19 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-4faf5560-279f-44c2-99ad-aab3891a5bd9 req-f45e78fc-7731-4a5d-bdc4-2e8896916b81 service nova] Acquiring lock "refresh_cache-75b1cabe-ba15-4851-9140-5949afc33005" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:19:19 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-4faf5560-279f-44c2-99ad-aab3891a5bd9 req-f45e78fc-7731-4a5d-bdc4-2e8896916b81 service nova] Acquired lock "refresh_cache-75b1cabe-ba15-4851-9140-5949afc33005" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:19:19 user nova-compute[75226]: DEBUG nova.network.neutron [req-4faf5560-279f-44c2-99ad-aab3891a5bd9 req-f45e78fc-7731-4a5d-bdc4-2e8896916b81 service nova] [instance: 75b1cabe-ba15-4851-9140-5949afc33005] Refreshing network info cache for port 8e47eaef-6e73-4c79-973d-31f6481368be {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 01:19:19 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-6fd6e57b-5024-454c-b424-d95036794484 tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] Acquiring lock "75b1cabe-ba15-4851-9140-5949afc33005" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:19:19 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-6fd6e57b-5024-454c-b424-d95036794484 tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] Lock "75b1cabe-ba15-4851-9140-5949afc33005" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:19:19 user nova-compute[75226]: DEBUG nova.objects.instance [None req-6fd6e57b-5024-454c-b424-d95036794484 tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] Lazy-loading 'flavor' on Instance uuid 75b1cabe-ba15-4851-9140-5949afc33005 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:19:19 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-6fd6e57b-5024-454c-b424-d95036794484 tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] Lock "75b1cabe-ba15-4851-9140-5949afc33005" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:19:19 user nova-compute[75226]: DEBUG nova.network.neutron [req-4faf5560-279f-44c2-99ad-aab3891a5bd9 req-f45e78fc-7731-4a5d-bdc4-2e8896916b81 service nova] [instance: 75b1cabe-ba15-4851-9140-5949afc33005] Updated VIF entry in instance network info cache for port 8e47eaef-6e73-4c79-973d-31f6481368be. {{(pid=75226) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 01:19:19 user nova-compute[75226]: DEBUG nova.network.neutron [req-4faf5560-279f-44c2-99ad-aab3891a5bd9 req-f45e78fc-7731-4a5d-bdc4-2e8896916b81 service nova] [instance: 75b1cabe-ba15-4851-9140-5949afc33005] Updating instance_info_cache with network_info: [{"id": "8e47eaef-6e73-4c79-973d-31f6481368be", "address": "fa:16:3e:43:38:6f", "network": {"id": "343b2264-f73a-436f-9588-6532711956ca", "bridge": "br-int", "label": "tempest-TestVolumeSwap-926357821-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1abb76252c4f437b9cb23db20136262c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e47eaef-6e", "ovs_interfaceid": "8e47eaef-6e73-4c79-973d-31f6481368be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:19:19 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-6fd6e57b-5024-454c-b424-d95036794484 tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] Acquiring lock "75b1cabe-ba15-4851-9140-5949afc33005" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:19:19 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-6fd6e57b-5024-454c-b424-d95036794484 tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] Lock "75b1cabe-ba15-4851-9140-5949afc33005" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:19:19 user nova-compute[75226]: INFO nova.compute.manager [None req-6fd6e57b-5024-454c-b424-d95036794484 tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] [instance: 75b1cabe-ba15-4851-9140-5949afc33005] Attaching volume ac3239e4-20ce-43ca-84b3-f5f0a5ffff95 to /dev/vdb
Nov 17 01:19:19 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-4faf5560-279f-44c2-99ad-aab3891a5bd9 req-f45e78fc-7731-4a5d-bdc4-2e8896916b81 service nova] Releasing lock "refresh_cache-75b1cabe-ba15-4851-9140-5949afc33005" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:19:19 user nova-compute[75226]: DEBUG os_brick.utils [None req-6fd6e57b-5024-454c-b424-d95036794484 tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:19:19 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:19 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:19 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a523b36-cad7-4200-ab63-7bab18eb076e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f62857db69\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:19 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:19 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:19 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ebc52c3-8ab8-43f3-9899-3654e3e56c5c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:19 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:19 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.012s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:19 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[c786c0b8-b029-4c84-9dbe-18559d4a97e9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:19 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2846811-7fd7-4f6a-8402-4d404baaac92]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:19 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-6fd6e57b-5024-454c-b424-d95036794484 tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] Running cmd (subprocess): nvme version {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:19 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-6fd6e57b-5024-454c-b424-d95036794484 tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] 'nvme version' failed. Not Retrying. {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 01:19:19 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6fd6e57b-5024-454c-b424-d95036794484 tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] nvme not present on system {{(pid=75226) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 17 01:19:19 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:19 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 01:19:19 user nova-compute[75226]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 17 01:19:19 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[4033b5a4-36a9-4002-be03-b0a2df8132ad]: (4, '') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:19 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-6fd6e57b-5024-454c-b424-d95036794484 tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75226) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 17 01:19:19 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-6fd6e57b-5024-454c-b424-d95036794484 tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75226) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 17 01:19:19 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-6fd6e57b-5024-454c-b424-d95036794484 tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] LIGHTOS: no hostnqn found. {{(pid=75226) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 17 01:19:19 user nova-compute[75226]: DEBUG os_brick.utils [None req-6fd6e57b-5024-454c-b424-d95036794484 tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] <== get_connector_properties: return (104ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f62857db69', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:19:19 user nova-compute[75226]: DEBUG nova.virt.block_device [None req-6fd6e57b-5024-454c-b424-d95036794484 tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] [instance: 75b1cabe-ba15-4851-9140-5949afc33005] Updating existing volume attachment record: 6e2725d9-05c1-4fc6-8742-bc90b314b8ae {{(pid=75226) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 17 01:19:20 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:19:20 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-1f8a6ed7-a3d0-46fc-a88f-20f3d34002f6 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] Acquiring lock "interface-b054a557-dff6-49f8-9300-1307f8433567-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:19:20 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-1f8a6ed7-a3d0-46fc-a88f-20f3d34002f6 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] Lock "interface-b054a557-dff6-49f8-9300-1307f8433567-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:19:20 user nova-compute[75226]: DEBUG nova.objects.instance [None req-1f8a6ed7-a3d0-46fc-a88f-20f3d34002f6 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] Lazy-loading 'flavor' on Instance uuid b054a557-dff6-49f8-9300-1307f8433567 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:19:21 user nova-compute[75226]: DEBUG nova.objects.instance [None req-1f8a6ed7-a3d0-46fc-a88f-20f3d34002f6 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] Lazy-loading 'pci_requests' on Instance uuid b054a557-dff6-49f8-9300-1307f8433567 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:19:21 user nova-compute[75226]: DEBUG nova.objects.base [None req-1f8a6ed7-a3d0-46fc-a88f-20f3d34002f6 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] Object Instance<b054a557-dff6-49f8-9300-1307f8433567> lazy-loaded attributes: flavor,pci_requests {{(pid=75226) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 17 01:19:21 user nova-compute[75226]: DEBUG nova.network.neutron [None req-1f8a6ed7-a3d0-46fc-a88f-20f3d34002f6 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] [instance: b054a557-dff6-49f8-9300-1307f8433567] allocate_for_instance() {{(pid=75226) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 17 01:19:21 user nova-compute[75226]: DEBUG nova.compute.manager [req-fc41f5ce-ca88-4fe4-b9ad-2573fc6f2c5f req-978d1519-1879-45ef-8fcc-d52ffd782d14 service nova] [instance: b054a557-dff6-49f8-9300-1307f8433567] Received event network-changed-9be521ab-d517-4746-b6b3-1e4930610165 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:19:21 user nova-compute[75226]: DEBUG nova.compute.manager [req-fc41f5ce-ca88-4fe4-b9ad-2573fc6f2c5f req-978d1519-1879-45ef-8fcc-d52ffd782d14 service nova] [instance: b054a557-dff6-49f8-9300-1307f8433567] Refreshing instance network info cache due to event network-changed-9be521ab-d517-4746-b6b3-1e4930610165. {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 01:19:21 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-fc41f5ce-ca88-4fe4-b9ad-2573fc6f2c5f req-978d1519-1879-45ef-8fcc-d52ffd782d14 service nova] Acquiring lock "refresh_cache-b054a557-dff6-49f8-9300-1307f8433567" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:19:21 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-fc41f5ce-ca88-4fe4-b9ad-2573fc6f2c5f req-978d1519-1879-45ef-8fcc-d52ffd782d14 service nova] Acquired lock "refresh_cache-b054a557-dff6-49f8-9300-1307f8433567" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:19:21 user nova-compute[75226]: DEBUG nova.network.neutron [req-fc41f5ce-ca88-4fe4-b9ad-2573fc6f2c5f req-978d1519-1879-45ef-8fcc-d52ffd782d14 service nova] [instance: b054a557-dff6-49f8-9300-1307f8433567] Refreshing network info cache for port 9be521ab-d517-4746-b6b3-1e4930610165 {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 01:19:21 user nova-compute[75226]: DEBUG nova.policy [None req-1f8a6ed7-a3d0-46fc-a88f-20f3d34002f6 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b59a9221aae44dcbb688294a0483b715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8f5190e0bff4cbb9384c0fb4faf54d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75226) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 17 01:19:21 user nova-compute[75226]: DEBUG nova.network.neutron [req-fc41f5ce-ca88-4fe4-b9ad-2573fc6f2c5f req-978d1519-1879-45ef-8fcc-d52ffd782d14 service nova] [instance: b054a557-dff6-49f8-9300-1307f8433567] Updated VIF entry in instance network info cache for port 9be521ab-d517-4746-b6b3-1e4930610165. {{(pid=75226) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 01:19:21 user nova-compute[75226]: DEBUG nova.network.neutron [req-fc41f5ce-ca88-4fe4-b9ad-2573fc6f2c5f req-978d1519-1879-45ef-8fcc-d52ffd782d14 service nova] [instance: b054a557-dff6-49f8-9300-1307f8433567] Updating instance_info_cache with network_info: [{"id": "9be521ab-d517-4746-b6b3-1e4930610165", "address": "fa:16:3e:c9:37:0f", "network": {"id": "126149e3-f0c6-483c-a0b4-4fd1dcd1a390", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1008205473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8f5190e0bff4cbb9384c0fb4faf54d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9be521ab-d5", "ovs_interfaceid": "9be521ab-d517-4746-b6b3-1e4930610165", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:19:21 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-fc41f5ce-ca88-4fe4-b9ad-2573fc6f2c5f req-978d1519-1879-45ef-8fcc-d52ffd782d14 service nova] Releasing lock "refresh_cache-b054a557-dff6-49f8-9300-1307f8433567" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:19:21 user nova-compute[75226]: DEBUG nova.network.neutron [None req-1f8a6ed7-a3d0-46fc-a88f-20f3d34002f6 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] [instance: b054a557-dff6-49f8-9300-1307f8433567] Successfully created port: 902fc99d-3d0f-4ce4-8502-b4c2f7617163 {{(pid=75226) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 17 01:19:22 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:19:22 user nova-compute[75226]: DEBUG nova.network.neutron [None req-1f8a6ed7-a3d0-46fc-a88f-20f3d34002f6 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] [instance: b054a557-dff6-49f8-9300-1307f8433567] Successfully updated port: 902fc99d-3d0f-4ce4-8502-b4c2f7617163 {{(pid=75226) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 17 01:19:22 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-1f8a6ed7-a3d0-46fc-a88f-20f3d34002f6 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] Acquiring lock "refresh_cache-b054a557-dff6-49f8-9300-1307f8433567" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:19:22 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-1f8a6ed7-a3d0-46fc-a88f-20f3d34002f6 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] Acquired lock "refresh_cache-b054a557-dff6-49f8-9300-1307f8433567" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:19:22 user nova-compute[75226]: DEBUG nova.network.neutron [None req-1f8a6ed7-a3d0-46fc-a88f-20f3d34002f6 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] [instance: b054a557-dff6-49f8-9300-1307f8433567] Building network info cache for instance {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 01:19:22 user nova-compute[75226]: DEBUG nova.compute.manager [req-9322d7de-1080-4b38-ab70-b983bcf1d6d5 req-49710496-0047-4754-a465-ca8c12d02834 service nova] [instance: b054a557-dff6-49f8-9300-1307f8433567] Received event network-changed-902fc99d-3d0f-4ce4-8502-b4c2f7617163 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:19:22 user nova-compute[75226]: DEBUG nova.compute.manager [req-9322d7de-1080-4b38-ab70-b983bcf1d6d5 req-49710496-0047-4754-a465-ca8c12d02834 service nova] [instance: b054a557-dff6-49f8-9300-1307f8433567] Refreshing instance network info cache due to event network-changed-902fc99d-3d0f-4ce4-8502-b4c2f7617163. {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 01:19:22 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-9322d7de-1080-4b38-ab70-b983bcf1d6d5 req-49710496-0047-4754-a465-ca8c12d02834 service nova] Acquiring lock "refresh_cache-b054a557-dff6-49f8-9300-1307f8433567" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:19:23 user nova-compute[75226]: DEBUG nova.compute.manager [req-653ec750-9d6e-498c-8923-f8950a24c047 req-726c3c7a-97c8-44c3-94a0-37fa21f2caad service nova] [instance: e7830f7a-80f1-4c2f-bd64-363e6dd9114a] Received event network-changed-b273b468-b80c-435e-bae6-9cbbcf617110 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:19:23 user nova-compute[75226]: DEBUG nova.compute.manager [req-653ec750-9d6e-498c-8923-f8950a24c047 req-726c3c7a-97c8-44c3-94a0-37fa21f2caad service nova] [instance: e7830f7a-80f1-4c2f-bd64-363e6dd9114a] Refreshing instance network info cache due to event network-changed-b273b468-b80c-435e-bae6-9cbbcf617110. {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 01:19:23 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-653ec750-9d6e-498c-8923-f8950a24c047 req-726c3c7a-97c8-44c3-94a0-37fa21f2caad service nova] Acquiring lock "refresh_cache-e7830f7a-80f1-4c2f-bd64-363e6dd9114a" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:19:23 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-653ec750-9d6e-498c-8923-f8950a24c047 req-726c3c7a-97c8-44c3-94a0-37fa21f2caad service nova] Acquired lock "refresh_cache-e7830f7a-80f1-4c2f-bd64-363e6dd9114a" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:19:23 user nova-compute[75226]: DEBUG nova.network.neutron [req-653ec750-9d6e-498c-8923-f8950a24c047 req-726c3c7a-97c8-44c3-94a0-37fa21f2caad service nova] [instance: e7830f7a-80f1-4c2f-bd64-363e6dd9114a] Refreshing network info cache for port b273b468-b80c-435e-bae6-9cbbcf617110 {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 01:19:23 user nova-compute[75226]: DEBUG nova.network.neutron [None req-1f8a6ed7-a3d0-46fc-a88f-20f3d34002f6 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] [instance: b054a557-dff6-49f8-9300-1307f8433567] Updating instance_info_cache with network_info: [{"id": "9be521ab-d517-4746-b6b3-1e4930610165", "address": "fa:16:3e:c9:37:0f", "network": {"id": "126149e3-f0c6-483c-a0b4-4fd1dcd1a390", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1008205473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8f5190e0bff4cbb9384c0fb4faf54d4", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9be521ab-d5", "ovs_interfaceid": "9be521ab-d517-4746-b6b3-1e4930610165", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "902fc99d-3d0f-4ce4-8502-b4c2f7617163", "address": "fa:16:3e:4c:39:60", "network": {"id": "ad4f167b-03ad-46dd-b568-d8478a055559", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1332712448", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f8f5190e0bff4cbb9384c0fb4faf54d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap902fc99d-3d", "ovs_interfaceid": "902fc99d-3d0f-4ce4-8502-b4c2f7617163", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:19:23 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-1f8a6ed7-a3d0-46fc-a88f-20f3d34002f6 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] Releasing lock "refresh_cache-b054a557-dff6-49f8-9300-1307f8433567" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:19:23 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-9322d7de-1080-4b38-ab70-b983bcf1d6d5 req-49710496-0047-4754-a465-ca8c12d02834 service nova] Acquired lock "refresh_cache-b054a557-dff6-49f8-9300-1307f8433567" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:19:23 user nova-compute[75226]: DEBUG nova.network.neutron [req-9322d7de-1080-4b38-ab70-b983bcf1d6d5 req-49710496-0047-4754-a465-ca8c12d02834 service nova] [instance: b054a557-dff6-49f8-9300-1307f8433567] Refreshing network info cache for port 902fc99d-3d0f-4ce4-8502-b4c2f7617163 {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 01:19:23 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-1f8a6ed7-a3d0-46fc-a88f-20f3d34002f6 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-17T01:17:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-670055725',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-670055725',id=6,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLQTkAEsiD7vZkLRChcVhMfcWUFr+J4uCStAPtsh5EcOj4Y0TqNu0/N7e0AK98CTHsomeIYjTkrU/pTyfUW55cXvLwMkYssMQNhMJgsr816svkjbGW+OPHRqanQu9/VlCw==',key_name='tempest-keypair-2003198946',keypairs=<?>,launch_index=0,launched_at=2023-11-17T01:17:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f8f5190e0bff4cbb9384c0fb4faf54d4',ramdisk_id='',reservation_id='r-icespjka',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-177886932',owner_user_name='tempest-TaggedAttachmentsTest-177886932-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T01:17:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b59a9221aae44dcbb688294a0483b715',uuid=b054a557-dff6-49f8-9300-1307f8433567,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "902fc99d-3d0f-4ce4-8502-b4c2f7617163", "address": "fa:16:3e:4c:39:60", "network": {"id": "ad4f167b-03ad-46dd-b568-d8478a055559", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1332712448", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f8f5190e0bff4cbb9384c0fb4faf54d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap902fc99d-3d", "ovs_interfaceid": "902fc99d-3d0f-4ce4-8502-b4c2f7617163", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 17 01:19:23 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-1f8a6ed7-a3d0-46fc-a88f-20f3d34002f6 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] Converting VIF {"id": "902fc99d-3d0f-4ce4-8502-b4c2f7617163", "address": "fa:16:3e:4c:39:60", "network": {"id": "ad4f167b-03ad-46dd-b568-d8478a055559", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1332712448", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f8f5190e0bff4cbb9384c0fb4faf54d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap902fc99d-3d", "ovs_interfaceid": "902fc99d-3d0f-4ce4-8502-b4c2f7617163", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:19:23 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-1f8a6ed7-a3d0-46fc-a88f-20f3d34002f6 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:39:60,bridge_name='br-int',has_traffic_filtering=True,id=902fc99d-3d0f-4ce4-8502-b4c2f7617163,network=Network(ad4f167b-03ad-46dd-b568-d8478a055559),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap902fc99d-3d') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:19:23 user nova-compute[75226]: DEBUG os_vif [None req-1f8a6ed7-a3d0-46fc-a88f-20f3d34002f6 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:39:60,bridge_name='br-int',has_traffic_filtering=True,id=902fc99d-3d0f-4ce4-8502-b4c2f7617163,network=Network(ad4f167b-03ad-46dd-b568-d8478a055559),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap902fc99d-3d') {{(pid=75226) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 17 01:19:23 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:19:23 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:19:23 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 17 01:19:23 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:19:23 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7cc20737-ab81-5c3c-82f6-a4bec80a7dae', '_type': 'linux-noop'}}, row=False) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:19:23 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:19:23 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:19:23 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:19:23 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap902fc99d-3d, may_exist=True, interface_attrs={}) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:19:23 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap902fc99d-3d, col_values=(('qos', UUID('cd581523-7dd4-462c-951d-57884b2411fe')),), if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:19:23 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap902fc99d-3d, col_values=(('external_ids', {'iface-id': '902fc99d-3d0f-4ce4-8502-b4c2f7617163', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4c:39:60', 'vm-uuid': 'b054a557-dff6-49f8-9300-1307f8433567'}),), if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:19:23 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:19:23 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:19:23 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:19:23 user nova-compute[75226]: INFO os_vif [None req-1f8a6ed7-a3d0-46fc-a88f-20f3d34002f6 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:39:60,bridge_name='br-int',has_traffic_filtering=True,id=902fc99d-3d0f-4ce4-8502-b4c2f7617163,network=Network(ad4f167b-03ad-46dd-b568-d8478a055559),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap902fc99d-3d')
Nov 17 01:19:23 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-1f8a6ed7-a3d0-46fc-a88f-20f3d34002f6 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-17T01:17:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-670055725',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-670055725',id=6,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLQTkAEsiD7vZkLRChcVhMfcWUFr+J4uCStAPtsh5EcOj4Y0TqNu0/N7e0AK98CTHsomeIYjTkrU/pTyfUW55cXvLwMkYssMQNhMJgsr816svkjbGW+OPHRqanQu9/VlCw==',key_name='tempest-keypair-2003198946',keypairs=<?>,launch_index=0,launched_at=2023-11-17T01:17:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f8f5190e0bff4cbb9384c0fb4faf54d4',ramdisk_id='',reservation_id='r-icespjka',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-177886932',owner_user_name='tempest-TaggedAttachmentsTest-177886932-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T01:17:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b59a9221aae44dcbb688294a0483b715',uuid=b054a557-dff6-49f8-9300-1307f8433567,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "902fc99d-3d0f-4ce4-8502-b4c2f7617163", "address": "fa:16:3e:4c:39:60", "network": {"id": "ad4f167b-03ad-46dd-b568-d8478a055559", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1332712448", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f8f5190e0bff4cbb9384c0fb4faf54d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap902fc99d-3d", "ovs_interfaceid": "902fc99d-3d0f-4ce4-8502-b4c2f7617163", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75226) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 01:19:23 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-1f8a6ed7-a3d0-46fc-a88f-20f3d34002f6 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] Converting VIF {"id": "902fc99d-3d0f-4ce4-8502-b4c2f7617163", "address": "fa:16:3e:4c:39:60", "network": {"id": "ad4f167b-03ad-46dd-b568-d8478a055559", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1332712448", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f8f5190e0bff4cbb9384c0fb4faf54d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap902fc99d-3d", "ovs_interfaceid": "902fc99d-3d0f-4ce4-8502-b4c2f7617163", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:19:23 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-1f8a6ed7-a3d0-46fc-a88f-20f3d34002f6 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:39:60,bridge_name='br-int',has_traffic_filtering=True,id=902fc99d-3d0f-4ce4-8502-b4c2f7617163,network=Network(ad4f167b-03ad-46dd-b568-d8478a055559),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap902fc99d-3d') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:19:23 user nova-compute[75226]: DEBUG nova.virt.libvirt.guest [None req-1f8a6ed7-a3d0-46fc-a88f-20f3d34002f6 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] attach device xml: <interface type="ethernet">
Nov 17 01:19:23 user nova-compute[75226]:   <mac address="fa:16:3e:4c:39:60"/>
Nov 17 01:19:23 user nova-compute[75226]:   <model type="virtio"/>
Nov 17 01:19:23 user nova-compute[75226]:   <mtu size="1442"/>
Nov 17 01:19:23 user nova-compute[75226]:   <target dev="tap902fc99d-3d"/>
Nov 17 01:19:23 user nova-compute[75226]: </interface>
Nov 17 01:19:23 user nova-compute[75226]:  {{(pid=75226) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 17 01:19:23 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:19:23 user nova-compute[75226]: DEBUG nova.network.neutron [req-653ec750-9d6e-498c-8923-f8950a24c047 req-726c3c7a-97c8-44c3-94a0-37fa21f2caad service nova] [instance: e7830f7a-80f1-4c2f-bd64-363e6dd9114a] Updated VIF entry in instance network info cache for port b273b468-b80c-435e-bae6-9cbbcf617110. {{(pid=75226) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 01:19:23 user nova-compute[75226]: DEBUG nova.network.neutron [req-653ec750-9d6e-498c-8923-f8950a24c047 req-726c3c7a-97c8-44c3-94a0-37fa21f2caad service nova] [instance: e7830f7a-80f1-4c2f-bd64-363e6dd9114a] Updating instance_info_cache with network_info: [{"id": "b273b468-b80c-435e-bae6-9cbbcf617110", "address": "fa:16:3e:29:76:3a", "network": {"id": "dbec5c0d-6e91-420e-a351-6aeaccb8253c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2034589845-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32bfc0cc503b45f7b2ebb10fd934b630", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb273b468-b8", "ovs_interfaceid": "b273b468-b80c-435e-bae6-9cbbcf617110", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:19:23 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:19:23 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-653ec750-9d6e-498c-8923-f8950a24c047 req-726c3c7a-97c8-44c3-94a0-37fa21f2caad service nova] Releasing lock "refresh_cache-e7830f7a-80f1-4c2f-bd64-363e6dd9114a" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:19:23 user nova-compute[75226]: DEBUG nova.compute.manager [req-a9ad5fff-0b37-4c2a-af2b-8e632cf584c4 req-8eda52b1-fcd4-48bf-ba00-2480d276bd8d service nova] [instance: b054a557-dff6-49f8-9300-1307f8433567] Received event network-vif-plugged-902fc99d-3d0f-4ce4-8502-b4c2f7617163 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:19:23 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-a9ad5fff-0b37-4c2a-af2b-8e632cf584c4 req-8eda52b1-fcd4-48bf-ba00-2480d276bd8d service nova] Acquiring lock "b054a557-dff6-49f8-9300-1307f8433567-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:19:23 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-a9ad5fff-0b37-4c2a-af2b-8e632cf584c4 req-8eda52b1-fcd4-48bf-ba00-2480d276bd8d service nova] Lock "b054a557-dff6-49f8-9300-1307f8433567-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:19:23 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-a9ad5fff-0b37-4c2a-af2b-8e632cf584c4 req-8eda52b1-fcd4-48bf-ba00-2480d276bd8d service nova] Lock "b054a557-dff6-49f8-9300-1307f8433567-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:19:23 user nova-compute[75226]: DEBUG nova.compute.manager [req-a9ad5fff-0b37-4c2a-af2b-8e632cf584c4 req-8eda52b1-fcd4-48bf-ba00-2480d276bd8d service nova] [instance: b054a557-dff6-49f8-9300-1307f8433567] No waiting events found dispatching network-vif-plugged-902fc99d-3d0f-4ce4-8502-b4c2f7617163 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:19:23 user nova-compute[75226]: WARNING nova.compute.manager [req-a9ad5fff-0b37-4c2a-af2b-8e632cf584c4 req-8eda52b1-fcd4-48bf-ba00-2480d276bd8d service nova] [instance: b054a557-dff6-49f8-9300-1307f8433567] Received unexpected event network-vif-plugged-902fc99d-3d0f-4ce4-8502-b4c2f7617163 for instance with vm_state active and task_state None.
Nov 17 01:19:23 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-1f8a6ed7-a3d0-46fc-a88f-20f3d34002f6 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] No BDM found with device name vda, not building metadata. {{(pid=75226) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 01:19:23 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-1f8a6ed7-a3d0-46fc-a88f-20f3d34002f6 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] No BDM found with device name hda, not building metadata. {{(pid=75226) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 01:19:23 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-1f8a6ed7-a3d0-46fc-a88f-20f3d34002f6 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] No VIF found with MAC fa:16:3e:c9:37:0f, not building metadata {{(pid=75226) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 01:19:24 user nova-compute[75226]: DEBUG nova.virt.libvirt.guest [None req-1f8a6ed7-a3d0-46fc-a88f-20f3d34002f6 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 17 01:19:24 user nova-compute[75226]:   <nova:package version="0.0.0"/>
Nov 17 01:19:24 user nova-compute[75226]:   <nova:name>tempest-device-tagging-server-670055725</nova:name>
Nov 17 01:19:24 user nova-compute[75226]:   <nova:creationTime>2023-11-17 01:19:24</nova:creationTime>
Nov 17 01:19:24 user nova-compute[75226]:   <nova:flavor name="m1.tiny">
Nov 17 01:19:24 user nova-compute[75226]:     <nova:memory>512</nova:memory>
Nov 17 01:19:24 user nova-compute[75226]:     <nova:disk>1</nova:disk>
Nov 17 01:19:24 user nova-compute[75226]:     <nova:swap>0</nova:swap>
Nov 17 01:19:24 user nova-compute[75226]:     <nova:ephemeral>0</nova:ephemeral>
Nov 17 01:19:24 user nova-compute[75226]:     <nova:vcpus>1</nova:vcpus>
Nov 17 01:19:24 user nova-compute[75226]:   </nova:flavor>
Nov 17 01:19:24 user nova-compute[75226]:   <nova:owner>
Nov 17 01:19:24 user nova-compute[75226]:     <nova:user uuid="b59a9221aae44dcbb688294a0483b715">tempest-TaggedAttachmentsTest-177886932-project-member</nova:user>
Nov 17 01:19:24 user nova-compute[75226]:     <nova:project uuid="f8f5190e0bff4cbb9384c0fb4faf54d4">tempest-TaggedAttachmentsTest-177886932</nova:project>
Nov 17 01:19:24 user nova-compute[75226]:   </nova:owner>
Nov 17 01:19:24 user nova-compute[75226]:   <nova:root type="image" uuid="0b369aea-6f3f-4690-9f01-229b90ab6310"/>
Nov 17 01:19:24 user nova-compute[75226]:   <nova:ports>
Nov 17 01:19:24 user nova-compute[75226]:     <nova:port uuid="9be521ab-d517-4746-b6b3-1e4930610165">
Nov 17 01:19:24 user nova-compute[75226]:       <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 17 01:19:24 user nova-compute[75226]:     </nova:port>
Nov 17 01:19:24 user nova-compute[75226]:     <nova:port uuid="902fc99d-3d0f-4ce4-8502-b4c2f7617163">
Nov 17 01:19:24 user nova-compute[75226]:       <nova:ip type="fixed" address="10.10.10.165" ipVersion="4"/>
Nov 17 01:19:24 user nova-compute[75226]:     </nova:port>
Nov 17 01:19:24 user nova-compute[75226]:   </nova:ports>
Nov 17 01:19:24 user nova-compute[75226]: </nova:instance>
Nov 17 01:19:24 user nova-compute[75226]:  {{(pid=75226) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 17 01:19:24 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-1f8a6ed7-a3d0-46fc-a88f-20f3d34002f6 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] Lock "interface-b054a557-dff6-49f8-9300-1307f8433567-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.263s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:19:24 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:19:24 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:19:24 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:19:24 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:19:24 user nova-compute[75226]: DEBUG nova.network.neutron [req-9322d7de-1080-4b38-ab70-b983bcf1d6d5 req-49710496-0047-4754-a465-ca8c12d02834 service nova] [instance: b054a557-dff6-49f8-9300-1307f8433567] Updated VIF entry in instance network info cache for port 902fc99d-3d0f-4ce4-8502-b4c2f7617163. {{(pid=75226) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 01:19:24 user nova-compute[75226]: DEBUG nova.network.neutron [req-9322d7de-1080-4b38-ab70-b983bcf1d6d5 req-49710496-0047-4754-a465-ca8c12d02834 service nova] [instance: b054a557-dff6-49f8-9300-1307f8433567] Updating instance_info_cache with network_info: [{"id": "9be521ab-d517-4746-b6b3-1e4930610165", "address": "fa:16:3e:c9:37:0f", "network": {"id": "126149e3-f0c6-483c-a0b4-4fd1dcd1a390", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1008205473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8f5190e0bff4cbb9384c0fb4faf54d4", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9be521ab-d5", "ovs_interfaceid": "9be521ab-d517-4746-b6b3-1e4930610165", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "902fc99d-3d0f-4ce4-8502-b4c2f7617163", "address": "fa:16:3e:4c:39:60", "network": {"id": "ad4f167b-03ad-46dd-b568-d8478a055559", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1332712448", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f8f5190e0bff4cbb9384c0fb4faf54d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap902fc99d-3d", "ovs_interfaceid": "902fc99d-3d0f-4ce4-8502-b4c2f7617163", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:19:24 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-9322d7de-1080-4b38-ab70-b983bcf1d6d5 req-49710496-0047-4754-a465-ca8c12d02834 service nova] Releasing lock "refresh_cache-b054a557-dff6-49f8-9300-1307f8433567" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:19:24 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-7b149c5a-e036-483a-942e-31cc9347e676 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] Acquiring lock "b054a557-dff6-49f8-9300-1307f8433567" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:19:24 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-7b149c5a-e036-483a-942e-31cc9347e676 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] Lock "b054a557-dff6-49f8-9300-1307f8433567" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:19:24 user nova-compute[75226]: DEBUG nova.objects.instance [None req-7b149c5a-e036-483a-942e-31cc9347e676 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] Lazy-loading 'flavor' on Instance uuid b054a557-dff6-49f8-9300-1307f8433567 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:19:24 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-7b149c5a-e036-483a-942e-31cc9347e676 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] Lock "b054a557-dff6-49f8-9300-1307f8433567" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:19:24 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-7b149c5a-e036-483a-942e-31cc9347e676 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] Acquiring lock "b054a557-dff6-49f8-9300-1307f8433567" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:19:24 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-7b149c5a-e036-483a-942e-31cc9347e676 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] Lock "b054a557-dff6-49f8-9300-1307f8433567" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:19:24 user nova-compute[75226]: INFO nova.compute.manager [None req-7b149c5a-e036-483a-942e-31cc9347e676 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] [instance: b054a557-dff6-49f8-9300-1307f8433567] Attaching volume 18d60c48-77ba-445e-93c7-aa275249c5c2 to /dev/vdb
Nov 17 01:19:24 user nova-compute[75226]: DEBUG os_brick.utils [None req-7b149c5a-e036-483a-942e-31cc9347e676 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:19:24 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:24 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:24 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[60737d7e-2277-4571-b1b6-e8c204ff4637]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f62857db69\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:24 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:24 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:24 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[07c995b3-e039-478a-bfeb-a28c0a46a350]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:24 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:24 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2397a5a7-bff3-4fa5-bda6-dc7090ee964a tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] [instance: 724b81dd-4531-4c99-850d-0bfcbfdf7bd4] Calling os-brick to attach iSCSI Volume {{(pid=75226) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 17 01:19:24 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-2397a5a7-bff3-4fa5-bda6-dc7090ee964a tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc4cc36b490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:642eafe0-08e5-4d34-a949-c1704d63b132', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iynTxgqj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:19:24 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-2397a5a7-bff3-4fa5-bda6-dc7090ee964a tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:19:24 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-2397a5a7-bff3-4fa5-bda6-dc7090ee964a tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:19:24 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-2397a5a7-bff3-4fa5-bda6-dc7090ee964a tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:19:24 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-2397a5a7-bff3-4fa5-bda6-dc7090ee964a tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:19:24 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-2397a5a7-bff3-4fa5-bda6-dc7090ee964a tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:642eafe0-08e5-4d34-a949-c1704d63b132" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:19:24 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-2397a5a7-bff3-4fa5-bda6-dc7090ee964a tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:642eafe0-08e5-4d34-a949-c1704d63b132" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:19:24 user nova-compute[75226]: INFO os_brick.initiator.connectors.iscsi [None req-2397a5a7-bff3-4fa5-bda6-dc7090ee964a tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 17 01:19:24 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:642eafe0-08e5-4d34-a949-c1704d63b132 -p 172.16.0.220:3260 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:24 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:24 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[d36cd82f-3148-483a-a2bd-5e1968a921bd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:24 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dc11ff9-7fbb-4f91-9d91-7ca92f28886f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:24 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-7b149c5a-e036-483a-942e-31cc9347e676 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] Running cmd (subprocess): nvme version {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:24 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-7b149c5a-e036-483a-942e-31cc9347e676 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] 'nvme version' failed. Not Retrying. {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 01:19:24 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:642eafe0-08e5-4d34-a949-c1704d63b132 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:24 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[9003c0ac-fb36-4171-a0e9-181e67fae4fb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:24 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7b149c5a-e036-483a-942e-31cc9347e676 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] nvme not present on system {{(pid=75226) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 17 01:19:24 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-2397a5a7-bff3-4fa5-bda6-dc7090ee964a tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 17 01:19:24 user nova-compute[75226]:  {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:19:24 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:24 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:642eafe0-08e5-4d34-a949-c1704d63b132 -p 172.16.0.220:3260 --interface default --op new {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:24 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 01:19:24 user nova-compute[75226]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 17 01:19:24 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e59a0e6-6aac-4c2b-ba36-b115aecf71c9]: (4, '') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:24 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-7b149c5a-e036-483a-942e-31cc9347e676 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75226) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 17 01:19:24 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-7b149c5a-e036-483a-942e-31cc9347e676 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75226) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 17 01:19:24 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-7b149c5a-e036-483a-942e-31cc9347e676 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] LIGHTOS: no hostnqn found. {{(pid=75226) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 17 01:19:24 user nova-compute[75226]: DEBUG os_brick.utils [None req-7b149c5a-e036-483a-942e-31cc9347e676 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f62857db69', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:19:24 user nova-compute[75226]: DEBUG nova.virt.block_device [None req-7b149c5a-e036-483a-942e-31cc9347e676 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] [instance: b054a557-dff6-49f8-9300-1307f8433567] Updating existing volume attachment record: fe3253ac-c51f-4ad6-9e1f-96f7f4d3dbc7 {{(pid=75226) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 17 01:19:24 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:642eafe0-08e5-4d34-a949-c1704d63b132 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:24 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0bd2d6e-347c-4ea4-893b-b537a4a733ec]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:642eafe0-08e5-4d34-a949-c1704d63b132] added\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:24 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-2397a5a7-bff3-4fa5-bda6-dc7090ee964a tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:642eafe0-08e5-4d34-a949-c1704d63b132] added
Nov 17 01:19:24 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:19:24 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:642eafe0-08e5-4d34-a949-c1704d63b132 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:24 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:642eafe0-08e5-4d34-a949-c1704d63b132 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:24 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b03b3b9-3cca-4b68-9e56-18497294bbe5]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:24 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-2397a5a7-bff3-4fa5-bda6-dc7090ee964a tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:19:24 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:642eafe0-08e5-4d34-a949-c1704d63b132 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:24 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:642eafe0-08e5-4d34-a949-c1704d63b132 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:24 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4efd1c3-cb88-4c0f-a450-be53d1c53391]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:24 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-2397a5a7-bff3-4fa5-bda6-dc7090ee964a tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:19:24 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:642eafe0-08e5-4d34-a949-c1704d63b132 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iynTxgqj {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:24 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:642eafe0-08e5-4d34-a949-c1704d63b132 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iynTxgqj" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:24 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[f765e0e3-5fb3-45f8-99b9-c85e3c01ce4a]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:24 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-2397a5a7-bff3-4fa5-bda6-dc7090ee964a tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iynTxgqj'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:19:24 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:642eafe0-08e5-4d34-a949-c1704d63b132 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:24 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:642eafe0-08e5-4d34-a949-c1704d63b132 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:24 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[7263507a-7135-469c-b26c-7242c062dd44]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:24 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-2397a5a7-bff3-4fa5-bda6-dc7090ee964a tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:19:24 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:25 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:25 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[68a77177-b885-4f7f-b81a-d96e4ee60d36]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:25 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-2397a5a7-bff3-4fa5-bda6-dc7090ee964a tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2 (non-flash)
Nov 17 01:19:25 user nova-compute[75226]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae (non-flash)
Nov 17 01:19:25 user nova-compute[75226]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1 (non-flash)
Nov 17 01:19:25 user nova-compute[75226]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6 (non-flash)
Nov 17 01:19:25 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:19:25 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-2397a5a7-bff3-4fa5-bda6-dc7090ee964a tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2 (non-flash)
Nov 17 01:19:25 user nova-compute[75226]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae (non-flash)
Nov 17 01:19:25 user nova-compute[75226]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1 (non-flash)
Nov 17 01:19:25 user nova-compute[75226]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6 (non-flash)
Nov 17 01:19:25 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:19:25 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:642eafe0-08e5-4d34-a949-c1704d63b132 -p 172.16.0.220:3260 --login {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:25 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:642eafe0-08e5-4d34-a949-c1704d63b132 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:25 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[c89df5e7-ad98-499b-bb20-256f44b9f920]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:642eafe0-08e5-4d34-a949-c1704d63b132, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:642eafe0-08e5-4d34-a949-c1704d63b132, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:25 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-2397a5a7-bff3-4fa5-bda6-dc7090ee964a tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:642eafe0-08e5-4d34-a949-c1704d63b132, portal: 172.16.0.220,3260]
Nov 17 01:19:25 user nova-compute[75226]: Login to [iface: default, target: iqn.2010-10.org.openstack:642eafe0-08e5-4d34-a949-c1704d63b132, portal: 172.16.0.220,3260] successful.
Nov 17 01:19:25 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:19:25 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:642eafe0-08e5-4d34-a949-c1704d63b132 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:25 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:642eafe0-08e5-4d34-a949-c1704d63b132 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:25 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[e731beb2-68e1-4329-93ae-a5095efab3d2]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:25 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-2397a5a7-bff3-4fa5-bda6-dc7090ee964a tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:19:25 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:25 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:25 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d8558ee-0a05-4ce7-899a-4d4ab8692f11]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642eafe0-08e5-4d34-a949-c1704d63b132 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:25 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-2397a5a7-bff3-4fa5-bda6-dc7090ee964a tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2 (non-flash)
Nov 17 01:19:25 user nova-compute[75226]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae (non-flash)
Nov 17 01:19:25 user nova-compute[75226]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1 (non-flash)
Nov 17 01:19:25 user nova-compute[75226]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6 (non-flash)
Nov 17 01:19:25 user nova-compute[75226]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642eafe0-08e5-4d34-a949-c1704d63b132 (non-flash)
Nov 17 01:19:25 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:19:25 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-2397a5a7-bff3-4fa5-bda6-dc7090ee964a tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2 (non-flash)
Nov 17 01:19:25 user nova-compute[75226]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae (non-flash)
Nov 17 01:19:25 user nova-compute[75226]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1 (non-flash)
Nov 17 01:19:25 user nova-compute[75226]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6 (non-flash)
Nov 17 01:19:25 user nova-compute[75226]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642eafe0-08e5-4d34-a949-c1704d63b132 (non-flash)
Nov 17 01:19:25 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:19:25 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-2397a5a7-bff3-4fa5-bda6-dc7090ee964a tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:642eafe0-08e5-4d34-a949-c1704d63b132" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.325s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:19:25 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-2397a5a7-bff3-4fa5-bda6-dc7090ee964a tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Connected to 172.16.0.220:3260 {{(pid=75226) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 17 01:19:25 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-2397a5a7-bff3-4fa5-bda6-dc7090ee964a tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] HCTL ('37', '-', '-', 0) found on session 7 with lun 0 {{(pid=75226) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 17 01:19:25 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-2397a5a7-bff3-4fa5-bda6-dc7090ee964a tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75226) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 17 01:19:25 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:25 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:25 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[bba7b30b-a548-4b08-9150-f55b4e3c9dc9]: (4, ('- - 0', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:25 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-2397a5a7-bff3-4fa5-bda6-dc7090ee964a tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Searching for a device in session 7 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75226) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 01:19:25 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-2397a5a7-bff3-4fa5-bda6-dc7090ee964a tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:642eafe0-08e5-4d34-a949-c1704d63b132', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iynTxgqj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75226) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 17 01:19:25 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-0b0c9480-f0ba-43c8-8565-e1ce1b7b8b56 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] Acquiring lock "e7830f7a-80f1-4c2f-bd64-363e6dd9114a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:19:25 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-0b0c9480-f0ba-43c8-8565-e1ce1b7b8b56 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] Lock "e7830f7a-80f1-4c2f-bd64-363e6dd9114a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:19:25 user nova-compute[75226]: DEBUG nova.objects.instance [None req-0b0c9480-f0ba-43c8-8565-e1ce1b7b8b56 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] Lazy-loading 'flavor' on Instance uuid e7830f7a-80f1-4c2f-bd64-363e6dd9114a {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:19:25 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6fd6e57b-5024-454c-b424-d95036794484 tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] [instance: 75b1cabe-ba15-4851-9140-5949afc33005] Calling os-brick to attach iSCSI Volume {{(pid=75226) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 17 01:19:25 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fd6e57b-5024-454c-b424-d95036794484 tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc4cc36b490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OsjHbnIp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:19:25 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-6fd6e57b-5024-454c-b424-d95036794484 tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:19:25 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-6fd6e57b-5024-454c-b424-d95036794484 tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:19:25 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-0b0c9480-f0ba-43c8-8565-e1ce1b7b8b56 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] Lock "e7830f7a-80f1-4c2f-bd64-363e6dd9114a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:19:25 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-0b0c9480-f0ba-43c8-8565-e1ce1b7b8b56 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] Acquiring lock "e7830f7a-80f1-4c2f-bd64-363e6dd9114a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:19:25 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-0b0c9480-f0ba-43c8-8565-e1ce1b7b8b56 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] Lock "e7830f7a-80f1-4c2f-bd64-363e6dd9114a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:19:25 user nova-compute[75226]: INFO nova.compute.manager [None req-0b0c9480-f0ba-43c8-8565-e1ce1b7b8b56 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] [instance: e7830f7a-80f1-4c2f-bd64-363e6dd9114a] Attaching volume 356ef305-2a5c-4df3-93ce-51a994422e0b to /dev/sdc
Nov 17 01:19:25 user nova-compute[75226]: DEBUG os_brick.utils [None req-0b0c9480-f0ba-43c8-8565-e1ce1b7b8b56 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:19:25 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:25 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:25 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f8d99bd-5811-4dfa-8907-646e7093d137]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f62857db69\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:25 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:25 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:25 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee79e301-af8f-400f-b18b-1c8ac54cacdf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:25 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:25 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.013s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:25 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[d66e76a6-0081-4b5a-ba50-0d6915642584]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:25 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff711685-44e2-4382-b2ca-384eceee2ee9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:25 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-0b0c9480-f0ba-43c8-8565-e1ce1b7b8b56 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] Running cmd (subprocess): nvme version {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:26 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-0b0c9480-f0ba-43c8-8565-e1ce1b7b8b56 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] 'nvme version' failed. Not Retrying. {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 01:19:26 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0b0c9480-f0ba-43c8-8565-e1ce1b7b8b56 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] nvme not present on system {{(pid=75226) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 17 01:19:26 user nova-compute[75226]: DEBUG nova.compute.manager [req-d4e971cc-e054-437a-990e-cbdc5f01075a req-fbebe6ab-8106-4056-8bb3-e3eba0599076 service nova] [instance: b054a557-dff6-49f8-9300-1307f8433567] Received event network-vif-plugged-902fc99d-3d0f-4ce4-8502-b4c2f7617163 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:19:26 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-d4e971cc-e054-437a-990e-cbdc5f01075a req-fbebe6ab-8106-4056-8bb3-e3eba0599076 service nova] Acquiring lock "b054a557-dff6-49f8-9300-1307f8433567-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:19:26 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-d4e971cc-e054-437a-990e-cbdc5f01075a req-fbebe6ab-8106-4056-8bb3-e3eba0599076 service nova] Lock "b054a557-dff6-49f8-9300-1307f8433567-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:19:26 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-d4e971cc-e054-437a-990e-cbdc5f01075a req-fbebe6ab-8106-4056-8bb3-e3eba0599076 service nova] Lock "b054a557-dff6-49f8-9300-1307f8433567-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:19:26 user nova-compute[75226]: DEBUG nova.compute.manager [req-d4e971cc-e054-437a-990e-cbdc5f01075a req-fbebe6ab-8106-4056-8bb3-e3eba0599076 service nova] [instance: b054a557-dff6-49f8-9300-1307f8433567] No waiting events found dispatching network-vif-plugged-902fc99d-3d0f-4ce4-8502-b4c2f7617163 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:19:26 user nova-compute[75226]: WARNING nova.compute.manager [req-d4e971cc-e054-437a-990e-cbdc5f01075a req-fbebe6ab-8106-4056-8bb3-e3eba0599076 service nova] [instance: b054a557-dff6-49f8-9300-1307f8433567] Received unexpected event network-vif-plugged-902fc99d-3d0f-4ce4-8502-b4c2f7617163 for instance with vm_state active and task_state None.
Nov 17 01:19:26 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:26 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 01:19:26 user nova-compute[75226]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 17 01:19:26 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[8069c6e0-af82-43db-b247-e4920d66d903]: (4, '') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:26 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-0b0c9480-f0ba-43c8-8565-e1ce1b7b8b56 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75226) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 17 01:19:26 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-0b0c9480-f0ba-43c8-8565-e1ce1b7b8b56 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75226) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 17 01:19:26 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-0b0c9480-f0ba-43c8-8565-e1ce1b7b8b56 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] LIGHTOS: no hostnqn found. {{(pid=75226) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 17 01:19:26 user nova-compute[75226]: DEBUG os_brick.utils [None req-0b0c9480-f0ba-43c8-8565-e1ce1b7b8b56 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] <== get_connector_properties: return (110ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f62857db69', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:19:26 user nova-compute[75226]: DEBUG nova.virt.block_device [None req-0b0c9480-f0ba-43c8-8565-e1ce1b7b8b56 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] [instance: e7830f7a-80f1-4c2f-bd64-363e6dd9114a] Updating existing volume attachment record: 94161fce-9c28-41a2-ab46-dd3f00245658 {{(pid=75226) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 17 01:19:26 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-2397a5a7-bff3-4fa5-bda6-dc7090ee964a tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.361s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:19:26 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-2397a5a7-bff3-4fa5-bda6-dc7090ee964a tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] <== connect_volume: return (1362ms) {'type': 'block', 'scsi_wwn': '23337633461333232', 'path': '/dev/sdf'} {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:19:26 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2397a5a7-bff3-4fa5-bda6-dc7090ee964a tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] [instance: 724b81dd-4531-4c99-850d-0bfcbfdf7bd4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23337633461333232', 'path': '/dev/sdf'} {{(pid=75226) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 17 01:19:26 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-6fd6e57b-5024-454c-b424-d95036794484 tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.446s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:19:26 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-6fd6e57b-5024-454c-b424-d95036794484 tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:19:26 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-6fd6e57b-5024-454c-b424-d95036794484 tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:19:26 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-6fd6e57b-5024-454c-b424-d95036794484 tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:19:26 user nova-compute[75226]: INFO os_brick.initiator.connectors.iscsi [None req-6fd6e57b-5024-454c-b424-d95036794484 tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 17 01:19:26 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95 -p 172.16.0.220:3260 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:26 user nova-compute[75226]: DEBUG nova.objects.instance [None req-2397a5a7-bff3-4fa5-bda6-dc7090ee964a tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Lazy-loading 'flavor' on Instance uuid 724b81dd-4531-4c99-850d-0bfcbfdf7bd4 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:19:26 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:26 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5b5bb81-cd62-4422-86e1-ecb7bba85353]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:26 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fd6e57b-5024-454c-b424-d95036794484 tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 17 01:19:26 user nova-compute[75226]:  {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:19:26 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95 -p 172.16.0.220:3260 --interface default --op new {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:26 user nova-compute[75226]: DEBUG nova.virt.libvirt.guest [None req-2397a5a7-bff3-4fa5-bda6-dc7090ee964a tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] attach device xml: <disk type="block" device="disk">
Nov 17 01:19:26 user nova-compute[75226]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 01:19:26 user nova-compute[75226]:   <source dev="/dev/sdf"/>
Nov 17 01:19:26 user nova-compute[75226]:   <target dev="vdb" bus="virtio"/>
Nov 17 01:19:26 user nova-compute[75226]:   <serial>642eafe0-08e5-4d34-a949-c1704d63b132</serial>
Nov 17 01:19:26 user nova-compute[75226]: </disk>
Nov 17 01:19:26 user nova-compute[75226]:  {{(pid=75226) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 17 01:19:26 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:26 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[edce1f81-8104-4da2-8835-cf8e838d4dd1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95] added\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:26 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fd6e57b-5024-454c-b424-d95036794484 tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95] added
Nov 17 01:19:26 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:19:26 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:26 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:26 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4c383f1-d4ad-4435-9a96-4b5ab0df777d]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:26 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fd6e57b-5024-454c-b424-d95036794484 tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:19:26 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:26 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:26 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a5e84ec-85ee-4a07-a47e-970f75f8a16e]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:26 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fd6e57b-5024-454c-b424-d95036794484 tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:19:26 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OsjHbnIp {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:26 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OsjHbnIp" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:26 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae00b1d6-ac3a-492e-bc55-48a153238096]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:26 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fd6e57b-5024-454c-b424-d95036794484 tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OsjHbnIp'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:19:26 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:26 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:26 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c7f20cc-1f6b-467a-b874-de8ef34499e4]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:26 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fd6e57b-5024-454c-b424-d95036794484 tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:19:26 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:26 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:26 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a82cfec-85cc-4d7e-b74a-d96d3a598e63]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642eafe0-08e5-4d34-a949-c1704d63b132 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:26 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fd6e57b-5024-454c-b424-d95036794484 tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2 (non-flash)
Nov 17 01:19:26 user nova-compute[75226]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae (non-flash)
Nov 17 01:19:26 user nova-compute[75226]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1 (non-flash)
Nov 17 01:19:26 user nova-compute[75226]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6 (non-flash)
Nov 17 01:19:26 user nova-compute[75226]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642eafe0-08e5-4d34-a949-c1704d63b132 (non-flash)
Nov 17 01:19:26 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:19:26 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fd6e57b-5024-454c-b424-d95036794484 tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2 (non-flash)
Nov 17 01:19:26 user nova-compute[75226]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae (non-flash)
Nov 17 01:19:26 user nova-compute[75226]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1 (non-flash)
Nov 17 01:19:26 user nova-compute[75226]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6 (non-flash)
Nov 17 01:19:26 user nova-compute[75226]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642eafe0-08e5-4d34-a949-c1704d63b132 (non-flash)
Nov 17 01:19:26 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:19:26 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95 -p 172.16.0.220:3260 --login {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:26 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95 -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:26 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[6934f8cf-ddf5-4b0f-8579-76457a630e38]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:26 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fd6e57b-5024-454c-b424-d95036794484 tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95, portal: 172.16.0.220,3260]
Nov 17 01:19:26 user nova-compute[75226]: Login to [iface: default, target: iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95, portal: 172.16.0.220,3260] successful.
Nov 17 01:19:26 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:19:26 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:26 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:26 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[331d34ac-80ff-475d-bd92-eb5eb98538b2]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:26 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fd6e57b-5024-454c-b424-d95036794484 tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:19:26 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:26 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:26 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[89bda0aa-f3a5-4d9f-957c-df1ca595c1ec]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642eafe0-08e5-4d34-a949-c1704d63b132 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:26 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fd6e57b-5024-454c-b424-d95036794484 tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2 (non-flash)
Nov 17 01:19:26 user nova-compute[75226]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae (non-flash)
Nov 17 01:19:26 user nova-compute[75226]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1 (non-flash)
Nov 17 01:19:26 user nova-compute[75226]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6 (non-flash)
Nov 17 01:19:26 user nova-compute[75226]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642eafe0-08e5-4d34-a949-c1704d63b132 (non-flash)
Nov 17 01:19:26 user nova-compute[75226]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95 (non-flash)
Nov 17 01:19:26 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:19:26 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fd6e57b-5024-454c-b424-d95036794484 tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2 (non-flash)
Nov 17 01:19:26 user nova-compute[75226]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae (non-flash)
Nov 17 01:19:26 user nova-compute[75226]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1 (non-flash)
Nov 17 01:19:26 user nova-compute[75226]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6 (non-flash)
Nov 17 01:19:26 user nova-compute[75226]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642eafe0-08e5-4d34-a949-c1704d63b132 (non-flash)
Nov 17 01:19:26 user nova-compute[75226]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95 (non-flash)
Nov 17 01:19:26 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:19:26 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-6fd6e57b-5024-454c-b424-d95036794484 tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.311s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:19:26 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fd6e57b-5024-454c-b424-d95036794484 tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] Connected to 172.16.0.220:3260 {{(pid=75226) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 17 01:19:26 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-6fd6e57b-5024-454c-b424-d95036794484 tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] HCTL ('38', '-', '-', 0) found on session 8 with lun 0 {{(pid=75226) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 17 01:19:26 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-6fd6e57b-5024-454c-b424-d95036794484 tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75226) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 17 01:19:26 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:26 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.015s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:26 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[6338f6c1-a13f-4f34-b61a-88737ac8fdf8]: (4, ('- - 0', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:26 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-6fd6e57b-5024-454c-b424-d95036794484 tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] Searching for a device in session 8 and hctl ['38', '*', '*', 0] yield: None {{(pid=75226) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 01:19:26 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-2397a5a7-bff3-4fa5-bda6-dc7090ee964a tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] No BDM found with device name vda, not building metadata. {{(pid=75226) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 01:19:26 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-2397a5a7-bff3-4fa5-bda6-dc7090ee964a tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75226) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 01:19:26 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-2397a5a7-bff3-4fa5-bda6-dc7090ee964a tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] No VIF found with MAC fa:16:3e:ac:88:c8, not building metadata {{(pid=75226) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 01:19:26 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-2397a5a7-bff3-4fa5-bda6-dc7090ee964a tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Lock "724b81dd-4531-4c99-850d-0bfcbfdf7bd4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.019s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:19:27 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:19:27 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-6fd6e57b-5024-454c-b424-d95036794484 tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] Searching for a device in session 8 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75226) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 01:19:27 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fd6e57b-5024-454c-b424-d95036794484 tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OsjHbnIp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75226) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 17 01:19:27 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-6fd6e57b-5024-454c-b424-d95036794484 tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.341s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:19:27 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fd6e57b-5024-454c-b424-d95036794484 tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] <== connect_volume: return (1787ms) {'type': 'block', 'scsi_wwn': '23538373563613064', 'path': '/dev/sdg'} {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:19:27 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6fd6e57b-5024-454c-b424-d95036794484 tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] [instance: 75b1cabe-ba15-4851-9140-5949afc33005] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23538373563613064', 'path': '/dev/sdg'} {{(pid=75226) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 17 01:19:27 user nova-compute[75226]: DEBUG nova.objects.instance [None req-6fd6e57b-5024-454c-b424-d95036794484 tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] Lazy-loading 'flavor' on Instance uuid 75b1cabe-ba15-4851-9140-5949afc33005 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:19:27 user nova-compute[75226]: DEBUG nova.virt.libvirt.guest [None req-6fd6e57b-5024-454c-b424-d95036794484 tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] attach device xml: <disk type="block" device="disk">
Nov 17 01:19:27 user nova-compute[75226]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 01:19:27 user nova-compute[75226]:   <source dev="/dev/sdg"/>
Nov 17 01:19:27 user nova-compute[75226]:   <target dev="vdb" bus="virtio"/>
Nov 17 01:19:27 user nova-compute[75226]:   <serial>ac3239e4-20ce-43ca-84b3-f5f0a5ffff95</serial>
Nov 17 01:19:27 user nova-compute[75226]: </disk>
Nov 17 01:19:27 user nova-compute[75226]:  {{(pid=75226) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 17 01:19:27 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-6fd6e57b-5024-454c-b424-d95036794484 tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] No BDM found with device name vda, not building metadata. {{(pid=75226) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 01:19:27 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-6fd6e57b-5024-454c-b424-d95036794484 tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75226) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 01:19:27 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-6fd6e57b-5024-454c-b424-d95036794484 tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] No VIF found with MAC fa:16:3e:43:38:6f, not building metadata {{(pid=75226) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 01:19:28 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-6fd6e57b-5024-454c-b424-d95036794484 tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] Lock "75b1cabe-ba15-4851-9140-5949afc33005" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.653s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:19:28 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-72d762d4-714f-4602-b482-d1768a16c8e0 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Acquiring lock "724b81dd-4531-4c99-850d-0bfcbfdf7bd4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:19:28 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-72d762d4-714f-4602-b482-d1768a16c8e0 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Lock "724b81dd-4531-4c99-850d-0bfcbfdf7bd4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:19:28 user nova-compute[75226]: INFO nova.compute.manager [None req-72d762d4-714f-4602-b482-d1768a16c8e0 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] [instance: 724b81dd-4531-4c99-850d-0bfcbfdf7bd4] Detaching volume 642eafe0-08e5-4d34-a949-c1704d63b132
Nov 17 01:19:28 user nova-compute[75226]: INFO nova.virt.block_device [None req-72d762d4-714f-4602-b482-d1768a16c8e0 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] [instance: 724b81dd-4531-4c99-850d-0bfcbfdf7bd4] Attempting to driver detach volume 642eafe0-08e5-4d34-a949-c1704d63b132 from mountpoint /dev/vdb
Nov 17 01:19:28 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-72d762d4-714f-4602-b482-d1768a16c8e0 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Attempting to detach device vdb from instance 724b81dd-4531-4c99-850d-0bfcbfdf7bd4 from the persistent domain config. {{(pid=75226) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 17 01:19:28 user nova-compute[75226]: DEBUG nova.virt.libvirt.guest [None req-72d762d4-714f-4602-b482-d1768a16c8e0 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] detach device xml: <disk type="block" device="disk">
Nov 17 01:19:28 user nova-compute[75226]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 01:19:28 user nova-compute[75226]:   <source dev="/dev/sdf"/>
Nov 17 01:19:28 user nova-compute[75226]:   <target dev="vdb" bus="virtio"/>
Nov 17 01:19:28 user nova-compute[75226]:   <serial>642eafe0-08e5-4d34-a949-c1704d63b132</serial>
Nov 17 01:19:28 user nova-compute[75226]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 17 01:19:28 user nova-compute[75226]: </disk>
Nov 17 01:19:28 user nova-compute[75226]:  {{(pid=75226) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 17 01:19:28 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-72d762d4-714f-4602-b482-d1768a16c8e0 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Successfully detached device vdb from instance 724b81dd-4531-4c99-850d-0bfcbfdf7bd4 from the persistent domain config.
Nov 17 01:19:28 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-72d762d4-714f-4602-b482-d1768a16c8e0 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 724b81dd-4531-4c99-850d-0bfcbfdf7bd4 from the live domain config. {{(pid=75226) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 17 01:19:28 user nova-compute[75226]: DEBUG nova.virt.libvirt.guest [None req-72d762d4-714f-4602-b482-d1768a16c8e0 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] detach device xml: <disk type="block" device="disk">
Nov 17 01:19:28 user nova-compute[75226]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 01:19:28 user nova-compute[75226]:   <source dev="/dev/sdf"/>
Nov 17 01:19:28 user nova-compute[75226]:   <target dev="vdb" bus="virtio"/>
Nov 17 01:19:28 user nova-compute[75226]:   <serial>642eafe0-08e5-4d34-a949-c1704d63b132</serial>
Nov 17 01:19:28 user nova-compute[75226]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 17 01:19:28 user nova-compute[75226]: </disk>
Nov 17 01:19:28 user nova-compute[75226]:  {{(pid=75226) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 17 01:19:28 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:19:28 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e7b546ed-d589-4ccf-8032-7d47724e65a0 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] Acquiring lock "75b1cabe-ba15-4851-9140-5949afc33005" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:19:28 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e7b546ed-d589-4ccf-8032-7d47724e65a0 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] Lock "75b1cabe-ba15-4851-9140-5949afc33005" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:19:28 user nova-compute[75226]: DEBUG os_brick.utils [None req-e7b546ed-d589-4ccf-8032-7d47724e65a0 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:19:28 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:28 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:28 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[0515f1e5-5c65-4920-b50c-4842cc928229]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f62857db69\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:28 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:28 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:28 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a0625a7-93c7-4577-93d5-bd8d81886124]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:28 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:28 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:28 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b9330f0-0e62-4c07-b6e5-73ec740d2824]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:28 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[57a04b94-956d-4838-a510-8ca9d9ed2683]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:28 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e7b546ed-d589-4ccf-8032-7d47724e65a0 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] Running cmd (subprocess): nvme version {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:28 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e7b546ed-d589-4ccf-8032-7d47724e65a0 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 01:19:28 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e7b546ed-d589-4ccf-8032-7d47724e65a0 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] nvme not present on system {{(pid=75226) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 17 01:19:28 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-72d762d4-714f-4602-b482-d1768a16c8e0 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 724b81dd-4531-4c99-850d-0bfcbfdf7bd4 {{(pid=75226) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 17 01:19:28 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:28 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 01:19:28 user nova-compute[75226]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 17 01:19:28 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[02b6b712-d54b-4036-b05a-84a869b3bf93]: (4, '') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:28 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-e7b546ed-d589-4ccf-8032-7d47724e65a0 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75226) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 17 01:19:28 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-e7b546ed-d589-4ccf-8032-7d47724e65a0 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75226) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 17 01:19:28 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-e7b546ed-d589-4ccf-8032-7d47724e65a0 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] LIGHTOS: no hostnqn found. {{(pid=75226) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 17 01:19:28 user nova-compute[75226]: DEBUG os_brick.utils [None req-e7b546ed-d589-4ccf-8032-7d47724e65a0 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f62857db69', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:19:28 user nova-compute[75226]: INFO nova.compute.manager [None req-e7b546ed-d589-4ccf-8032-7d47724e65a0 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] [instance: 75b1cabe-ba15-4851-9140-5949afc33005] Swapping volume ac3239e4-20ce-43ca-84b3-f5f0a5ffff95 for 0e860a72-9a6d-4889-8210-beafd1f879c7
Nov 17 01:19:29 user nova-compute[75226]: DEBUG nova.compute.manager [req-f1f15948-ae74-4023-a248-667feb1c6e1a req-002d1b56-4d10-460e-8cab-58339fa9e296 service nova] [instance: 1c505f8d-09e0-41bc-ba3a-89bde1646613] Received event network-changed-6c56f715-bdcb-4a40-b922-3081a6457c31 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:19:29 user nova-compute[75226]: DEBUG nova.compute.manager [req-f1f15948-ae74-4023-a248-667feb1c6e1a req-002d1b56-4d10-460e-8cab-58339fa9e296 service nova] [instance: 1c505f8d-09e0-41bc-ba3a-89bde1646613] Refreshing instance network info cache due to event network-changed-6c56f715-bdcb-4a40-b922-3081a6457c31. {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 01:19:29 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-f1f15948-ae74-4023-a248-667feb1c6e1a req-002d1b56-4d10-460e-8cab-58339fa9e296 service nova] Acquiring lock "refresh_cache-1c505f8d-09e0-41bc-ba3a-89bde1646613" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:19:29 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-f1f15948-ae74-4023-a248-667feb1c6e1a req-002d1b56-4d10-460e-8cab-58339fa9e296 service nova] Acquired lock "refresh_cache-1c505f8d-09e0-41bc-ba3a-89bde1646613" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:19:29 user nova-compute[75226]: DEBUG nova.network.neutron [req-f1f15948-ae74-4023-a248-667feb1c6e1a req-002d1b56-4d10-460e-8cab-58339fa9e296 service nova] [instance: 1c505f8d-09e0-41bc-ba3a-89bde1646613] Refreshing network info cache for port 6c56f715-bdcb-4a40-b922-3081a6457c31 {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 01:19:29 user nova-compute[75226]: DEBUG nova.network.neutron [req-f1f15948-ae74-4023-a248-667feb1c6e1a req-002d1b56-4d10-460e-8cab-58339fa9e296 service nova] [instance: 1c505f8d-09e0-41bc-ba3a-89bde1646613] Updated VIF entry in instance network info cache for port 6c56f715-bdcb-4a40-b922-3081a6457c31. {{(pid=75226) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 01:19:29 user nova-compute[75226]: DEBUG nova.network.neutron [req-f1f15948-ae74-4023-a248-667feb1c6e1a req-002d1b56-4d10-460e-8cab-58339fa9e296 service nova] [instance: 1c505f8d-09e0-41bc-ba3a-89bde1646613] Updating instance_info_cache with network_info: [{"id": "6c56f715-bdcb-4a40-b922-3081a6457c31", "address": "fa:16:3e:63:16:60", "network": {"id": "d3de5b6b-3c29-4aeb-b4ec-59dca1237cb5", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1649442166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a26a1467375947e9b71d9a2c61127e2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c56f715-bd", "ovs_interfaceid": "6c56f715-bdcb-4a40-b922-3081a6457c31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:19:29 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-f1f15948-ae74-4023-a248-667feb1c6e1a req-002d1b56-4d10-460e-8cab-58339fa9e296 service nova] Releasing lock "refresh_cache-1c505f8d-09e0-41bc-ba3a-89bde1646613" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:19:30 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b149c5a-e036-483a-942e-31cc9347e676 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] [instance: b054a557-dff6-49f8-9300-1307f8433567] Calling os-brick to attach iSCSI Volume {{(pid=75226) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 17 01:19:30 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b149c5a-e036-483a-942e-31cc9347e676 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc4cc36b490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:18d60c48-77ba-445e-93c7-aa275249c5c2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TjCKYuhQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:19:30 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-7b149c5a-e036-483a-942e-31cc9347e676 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:19:30 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-7b149c5a-e036-483a-942e-31cc9347e676 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:19:30 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-7b149c5a-e036-483a-942e-31cc9347e676 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:19:30 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-7b149c5a-e036-483a-942e-31cc9347e676 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:19:30 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-7b149c5a-e036-483a-942e-31cc9347e676 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:18d60c48-77ba-445e-93c7-aa275249c5c2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:19:30 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-7b149c5a-e036-483a-942e-31cc9347e676 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:18d60c48-77ba-445e-93c7-aa275249c5c2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:19:30 user nova-compute[75226]: INFO os_brick.initiator.connectors.iscsi [None req-7b149c5a-e036-483a-942e-31cc9347e676 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 17 01:19:30 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18d60c48-77ba-445e-93c7-aa275249c5c2 -p 172.16.0.220:3260 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:30 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18d60c48-77ba-445e-93c7-aa275249c5c2 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:30 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[0765a297-a43b-41f4-9ba4-d539288cb2d9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:30 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b149c5a-e036-483a-942e-31cc9347e676 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 17 01:19:30 user nova-compute[75226]:  {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:19:30 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18d60c48-77ba-445e-93c7-aa275249c5c2 -p 172.16.0.220:3260 --interface default --op new {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:30 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18d60c48-77ba-445e-93c7-aa275249c5c2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:30 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e24d233-fc2d-423a-baf0-08056240858e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:18d60c48-77ba-445e-93c7-aa275249c5c2] added\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:30 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b149c5a-e036-483a-942e-31cc9347e676 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:18d60c48-77ba-445e-93c7-aa275249c5c2] added
Nov 17 01:19:30 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:19:30 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18d60c48-77ba-445e-93c7-aa275249c5c2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:30 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18d60c48-77ba-445e-93c7-aa275249c5c2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:30 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[25855491-8d78-4a7f-a0f8-665ebbbf24b7]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:30 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b149c5a-e036-483a-942e-31cc9347e676 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:19:30 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18d60c48-77ba-445e-93c7-aa275249c5c2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:30 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18d60c48-77ba-445e-93c7-aa275249c5c2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:30 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[91eacf66-3193-4839-9d62-540d2593b95a]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:30 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b149c5a-e036-483a-942e-31cc9347e676 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:19:30 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18d60c48-77ba-445e-93c7-aa275249c5c2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TjCKYuhQ {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:30 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18d60c48-77ba-445e-93c7-aa275249c5c2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TjCKYuhQ" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:30 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[12ae4a66-d58a-4cd1-8146-303ce7558413]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:30 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b149c5a-e036-483a-942e-31cc9347e676 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TjCKYuhQ'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:19:30 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18d60c48-77ba-445e-93c7-aa275249c5c2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:30 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-d604bed7-9a2f-4e13-ae55-2032c5e511fd tempest-VolumesAssistedSnapshotsTest-526759134 tempest-VolumesAssistedSnapshotsTest-526759134-project-admin] Acquiring lock "1c505f8d-09e0-41bc-ba3a-89bde1646613" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:19:30 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-d604bed7-9a2f-4e13-ae55-2032c5e511fd tempest-VolumesAssistedSnapshotsTest-526759134 tempest-VolumesAssistedSnapshotsTest-526759134-project-admin] Lock "1c505f8d-09e0-41bc-ba3a-89bde1646613" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:19:30 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18d60c48-77ba-445e-93c7-aa275249c5c2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:30 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c9f7d35-1121-44d1-83e8-11110a94d942]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:30 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b149c5a-e036-483a-942e-31cc9347e676 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:19:30 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:30 user nova-compute[75226]: DEBUG nova.objects.instance [None req-d604bed7-9a2f-4e13-ae55-2032c5e511fd tempest-VolumesAssistedSnapshotsTest-526759134 tempest-VolumesAssistedSnapshotsTest-526759134-project-admin] Lazy-loading 'flavor' on Instance uuid 1c505f8d-09e0-41bc-ba3a-89bde1646613 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:19:30 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:30 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e48dec6-68dd-4436-84ed-a00364c0ea56]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642eafe0-08e5-4d34-a949-c1704d63b132 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:30 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b149c5a-e036-483a-942e-31cc9347e676 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2 (non-flash)
Nov 17 01:19:30 user nova-compute[75226]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae (non-flash)
Nov 17 01:19:30 user nova-compute[75226]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1 (non-flash)
Nov 17 01:19:30 user nova-compute[75226]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6 (non-flash)
Nov 17 01:19:30 user nova-compute[75226]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642eafe0-08e5-4d34-a949-c1704d63b132 (non-flash)
Nov 17 01:19:30 user nova-compute[75226]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95 (non-flash)
Nov 17 01:19:30 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:19:30 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b149c5a-e036-483a-942e-31cc9347e676 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2 (non-flash)
Nov 17 01:19:30 user nova-compute[75226]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae (non-flash)
Nov 17 01:19:30 user nova-compute[75226]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1 (non-flash)
Nov 17 01:19:30 user nova-compute[75226]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6 (non-flash)
Nov 17 01:19:30 user nova-compute[75226]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642eafe0-08e5-4d34-a949-c1704d63b132 (non-flash)
Nov 17 01:19:30 user nova-compute[75226]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95 (non-flash)
Nov 17 01:19:30 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:19:30 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18d60c48-77ba-445e-93c7-aa275249c5c2 -p 172.16.0.220:3260 --login {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:30 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-d604bed7-9a2f-4e13-ae55-2032c5e511fd tempest-VolumesAssistedSnapshotsTest-526759134 tempest-VolumesAssistedSnapshotsTest-526759134-project-admin] Lock "1c505f8d-09e0-41bc-ba3a-89bde1646613" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.085s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:19:30 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18d60c48-77ba-445e-93c7-aa275249c5c2 -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:30 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[bda2864b-9ebb-4c2d-a19d-dd50aa57fb8a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:18d60c48-77ba-445e-93c7-aa275249c5c2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:18d60c48-77ba-445e-93c7-aa275249c5c2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:30 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b149c5a-e036-483a-942e-31cc9347e676 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:18d60c48-77ba-445e-93c7-aa275249c5c2, portal: 172.16.0.220,3260]
Nov 17 01:19:30 user nova-compute[75226]: Login to [iface: default, target: iqn.2010-10.org.openstack:18d60c48-77ba-445e-93c7-aa275249c5c2, portal: 172.16.0.220,3260] successful.
Nov 17 01:19:30 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:19:30 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18d60c48-77ba-445e-93c7-aa275249c5c2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:30 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18d60c48-77ba-445e-93c7-aa275249c5c2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:30 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[987aa10c-a43a-44b9-b4ee-31818996c68d]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:30 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b149c5a-e036-483a-942e-31cc9347e676 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:19:30 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:30 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:30 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eb2b1cd-ec9c-40cc-8647-c9e2eaf904ec]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642eafe0-08e5-4d34-a949-c1704d63b132 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18d60c48-77ba-445e-93c7-aa275249c5c2 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:30 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b149c5a-e036-483a-942e-31cc9347e676 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2 (non-flash)
Nov 17 01:19:30 user nova-compute[75226]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae (non-flash)
Nov 17 01:19:30 user nova-compute[75226]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1 (non-flash)
Nov 17 01:19:30 user nova-compute[75226]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6 (non-flash)
Nov 17 01:19:30 user nova-compute[75226]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642eafe0-08e5-4d34-a949-c1704d63b132 (non-flash)
Nov 17 01:19:30 user nova-compute[75226]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95 (non-flash)
Nov 17 01:19:30 user nova-compute[75226]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18d60c48-77ba-445e-93c7-aa275249c5c2 (non-flash)
Nov 17 01:19:30 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:19:30 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b149c5a-e036-483a-942e-31cc9347e676 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2 (non-flash)
Nov 17 01:19:30 user nova-compute[75226]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae (non-flash)
Nov 17 01:19:30 user nova-compute[75226]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1 (non-flash)
Nov 17 01:19:30 user nova-compute[75226]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6 (non-flash)
Nov 17 01:19:30 user nova-compute[75226]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642eafe0-08e5-4d34-a949-c1704d63b132 (non-flash)
Nov 17 01:19:30 user nova-compute[75226]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95 (non-flash)
Nov 17 01:19:30 user nova-compute[75226]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18d60c48-77ba-445e-93c7-aa275249c5c2 (non-flash)
Nov 17 01:19:30 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:19:30 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-7b149c5a-e036-483a-942e-31cc9347e676 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:18d60c48-77ba-445e-93c7-aa275249c5c2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.313s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:19:30 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b149c5a-e036-483a-942e-31cc9347e676 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] Connected to 172.16.0.220:3260 {{(pid=75226) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 17 01:19:30 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-7b149c5a-e036-483a-942e-31cc9347e676 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] HCTL ('39', '-', '-', 0) found on session 9 with lun 0 {{(pid=75226) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 17 01:19:30 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-7b149c5a-e036-483a-942e-31cc9347e676 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=75226) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 17 01:19:30 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:30 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.014s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:30 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[e21beee0-72dd-4377-ae53-7204cd4ea392]: (4, ('- - 0', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:30 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-7b149c5a-e036-483a-942e-31cc9347e676 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] Searching for a device in session 9 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=75226) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 01:19:30 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b149c5a-e036-483a-942e-31cc9347e676 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:18d60c48-77ba-445e-93c7-aa275249c5c2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TjCKYuhQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75226) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 17 01:19:30 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-d604bed7-9a2f-4e13-ae55-2032c5e511fd tempest-VolumesAssistedSnapshotsTest-526759134 tempest-VolumesAssistedSnapshotsTest-526759134-project-admin] Acquiring lock "1c505f8d-09e0-41bc-ba3a-89bde1646613" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:19:30 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-d604bed7-9a2f-4e13-ae55-2032c5e511fd tempest-VolumesAssistedSnapshotsTest-526759134 tempest-VolumesAssistedSnapshotsTest-526759134-project-admin] Lock "1c505f8d-09e0-41bc-ba3a-89bde1646613" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:19:30 user nova-compute[75226]: INFO nova.compute.manager [None req-d604bed7-9a2f-4e13-ae55-2032c5e511fd tempest-VolumesAssistedSnapshotsTest-526759134 tempest-VolumesAssistedSnapshotsTest-526759134-project-admin] [instance: 1c505f8d-09e0-41bc-ba3a-89bde1646613] Attaching volume 801ff813-83ea-4d9e-a8d2-ed4146b22b52 to /dev/vdb
Nov 17 01:19:31 user nova-compute[75226]: DEBUG os_brick.utils [None req-d604bed7-9a2f-4e13-ae55-2032c5e511fd tempest-VolumesAssistedSnapshotsTest-526759134 tempest-VolumesAssistedSnapshotsTest-526759134-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:19:31 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:31 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:31 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[53570f28-c157-4f1d-a307-5f78f43021c1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f62857db69\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:31 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:31 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:31 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[f78e8866-50cf-41d3-8dfd-cdd3dd82aa4a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:31 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:31 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:31 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[975a6be4-058f-4389-ba61-84aacab03434]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:31 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[455c0d74-5415-4534-95cf-bc2adcff988c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:31 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-d604bed7-9a2f-4e13-ae55-2032c5e511fd tempest-VolumesAssistedSnapshotsTest-526759134 tempest-VolumesAssistedSnapshotsTest-526759134-project-admin] Running cmd (subprocess): nvme version {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:31 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-d604bed7-9a2f-4e13-ae55-2032c5e511fd tempest-VolumesAssistedSnapshotsTest-526759134 tempest-VolumesAssistedSnapshotsTest-526759134-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 01:19:31 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d604bed7-9a2f-4e13-ae55-2032c5e511fd tempest-VolumesAssistedSnapshotsTest-526759134 tempest-VolumesAssistedSnapshotsTest-526759134-project-admin] nvme not present on system {{(pid=75226) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 17 01:19:31 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:31 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 01:19:31 user nova-compute[75226]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 17 01:19:31 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[abe801bb-3b67-414f-8f06-4d44ecdb5688]: (4, '') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:31 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-d604bed7-9a2f-4e13-ae55-2032c5e511fd tempest-VolumesAssistedSnapshotsTest-526759134 tempest-VolumesAssistedSnapshotsTest-526759134-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75226) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 17 01:19:31 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-d604bed7-9a2f-4e13-ae55-2032c5e511fd tempest-VolumesAssistedSnapshotsTest-526759134 tempest-VolumesAssistedSnapshotsTest-526759134-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75226) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 17 01:19:31 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-d604bed7-9a2f-4e13-ae55-2032c5e511fd tempest-VolumesAssistedSnapshotsTest-526759134 tempest-VolumesAssistedSnapshotsTest-526759134-project-admin] LIGHTOS: no hostnqn found. {{(pid=75226) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 17 01:19:31 user nova-compute[75226]: DEBUG os_brick.utils [None req-d604bed7-9a2f-4e13-ae55-2032c5e511fd tempest-VolumesAssistedSnapshotsTest-526759134 tempest-VolumesAssistedSnapshotsTest-526759134-project-admin] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f62857db69', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:19:31 user nova-compute[75226]: DEBUG nova.virt.block_device [None req-d604bed7-9a2f-4e13-ae55-2032c5e511fd tempest-VolumesAssistedSnapshotsTest-526759134 tempest-VolumesAssistedSnapshotsTest-526759134-project-admin] [instance: 1c505f8d-09e0-41bc-ba3a-89bde1646613] Updating existing volume attachment record: e2491346-4045-4fc5-8226-405ef5f17bc4 {{(pid=75226) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 17 01:19:31 user nova-compute[75226]: DEBUG nova.compute.manager [req-423ae955-9508-477f-be6d-6b42abf6a469 req-519c4094-b359-4c5c-8887-0b64edb2865a service nova] [instance: 262eb845-eebe-4ffb-bc49-dcaca53ad7b8] Received event network-changed-ca3803cf-fc7f-4233-8afa-1806c73156be {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:19:31 user nova-compute[75226]: DEBUG nova.compute.manager [req-423ae955-9508-477f-be6d-6b42abf6a469 req-519c4094-b359-4c5c-8887-0b64edb2865a service nova] [instance: 262eb845-eebe-4ffb-bc49-dcaca53ad7b8] Refreshing instance network info cache due to event network-changed-ca3803cf-fc7f-4233-8afa-1806c73156be. {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 01:19:31 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-423ae955-9508-477f-be6d-6b42abf6a469 req-519c4094-b359-4c5c-8887-0b64edb2865a service nova] Acquiring lock "refresh_cache-262eb845-eebe-4ffb-bc49-dcaca53ad7b8" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:19:31 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-423ae955-9508-477f-be6d-6b42abf6a469 req-519c4094-b359-4c5c-8887-0b64edb2865a service nova] Acquired lock "refresh_cache-262eb845-eebe-4ffb-bc49-dcaca53ad7b8" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:19:31 user nova-compute[75226]: DEBUG nova.network.neutron [req-423ae955-9508-477f-be6d-6b42abf6a469 req-519c4094-b359-4c5c-8887-0b64edb2865a service nova] [instance: 262eb845-eebe-4ffb-bc49-dcaca53ad7b8] Refreshing network info cache for port ca3803cf-fc7f-4233-8afa-1806c73156be {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 01:19:31 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-7b149c5a-e036-483a-942e-31cc9347e676 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.348s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:19:31 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b149c5a-e036-483a-942e-31cc9347e676 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] <== connect_volume: return (1350ms) {'type': 'block', 'scsi_wwn': '23237386533616466', 'path': '/dev/sdh'} {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:19:31 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b149c5a-e036-483a-942e-31cc9347e676 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] [instance: b054a557-dff6-49f8-9300-1307f8433567] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23237386533616466', 'path': '/dev/sdh'} {{(pid=75226) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 17 01:19:31 user nova-compute[75226]: DEBUG nova.objects.instance [None req-7b149c5a-e036-483a-942e-31cc9347e676 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] Lazy-loading 'flavor' on Instance uuid b054a557-dff6-49f8-9300-1307f8433567 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:19:31 user nova-compute[75226]: DEBUG nova.virt.libvirt.guest [None req-7b149c5a-e036-483a-942e-31cc9347e676 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] attach device xml: <disk type="block" device="disk">
Nov 17 01:19:31 user nova-compute[75226]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 01:19:31 user nova-compute[75226]:   <source dev="/dev/sdh"/>
Nov 17 01:19:31 user nova-compute[75226]:   <target dev="vdb" bus="virtio"/>
Nov 17 01:19:31 user nova-compute[75226]:   <serial>18d60c48-77ba-445e-93c7-aa275249c5c2</serial>
Nov 17 01:19:31 user nova-compute[75226]: </disk>
Nov 17 01:19:31 user nova-compute[75226]:  {{(pid=75226) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 17 01:19:32 user nova-compute[75226]: DEBUG nova.network.neutron [req-423ae955-9508-477f-be6d-6b42abf6a469 req-519c4094-b359-4c5c-8887-0b64edb2865a service nova] [instance: 262eb845-eebe-4ffb-bc49-dcaca53ad7b8] Updated VIF entry in instance network info cache for port ca3803cf-fc7f-4233-8afa-1806c73156be. {{(pid=75226) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 01:19:32 user nova-compute[75226]: DEBUG nova.network.neutron [req-423ae955-9508-477f-be6d-6b42abf6a469 req-519c4094-b359-4c5c-8887-0b64edb2865a service nova] [instance: 262eb845-eebe-4ffb-bc49-dcaca53ad7b8] Updating instance_info_cache with network_info: [{"id": "ca3803cf-fc7f-4233-8afa-1806c73156be", "address": "fa:16:3e:d9:19:6e", "network": {"id": "432afb25-848f-4ef8-8436-11db949783e6", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1854406043-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25ffeaafcdca494eb7550cec5b100051", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca3803cf-fc", "ovs_interfaceid": "ca3803cf-fc7f-4233-8afa-1806c73156be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:19:32 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-423ae955-9508-477f-be6d-6b42abf6a469 req-519c4094-b359-4c5c-8887-0b64edb2865a service nova] Releasing lock "refresh_cache-262eb845-eebe-4ffb-bc49-dcaca53ad7b8" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:19:32 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0b0c9480-f0ba-43c8-8565-e1ce1b7b8b56 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] [instance: e7830f7a-80f1-4c2f-bd64-363e6dd9114a] Calling os-brick to attach iSCSI Volume {{(pid=75226) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 17 01:19:32 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b0c9480-f0ba-43c8-8565-e1ce1b7b8b56 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc4cc36b490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:356ef305-2a5c-4df3-93ce-51a994422e0b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DxrzYtBc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:19:32 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-0b0c9480-f0ba-43c8-8565-e1ce1b7b8b56 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:19:32 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-0b0c9480-f0ba-43c8-8565-e1ce1b7b8b56 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:19:32 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-0b0c9480-f0ba-43c8-8565-e1ce1b7b8b56 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:19:32 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-0b0c9480-f0ba-43c8-8565-e1ce1b7b8b56 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:19:32 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-0b0c9480-f0ba-43c8-8565-e1ce1b7b8b56 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:356ef305-2a5c-4df3-93ce-51a994422e0b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:19:32 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-0b0c9480-f0ba-43c8-8565-e1ce1b7b8b56 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:356ef305-2a5c-4df3-93ce-51a994422e0b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:19:32 user nova-compute[75226]: INFO os_brick.initiator.connectors.iscsi [None req-0b0c9480-f0ba-43c8-8565-e1ce1b7b8b56 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 17 01:19:32 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:356ef305-2a5c-4df3-93ce-51a994422e0b -p 172.16.0.220:3260 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:32 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:356ef305-2a5c-4df3-93ce-51a994422e0b -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:32 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2aaa010-44e5-4d9b-b13b-a964dcef307e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:32 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b0c9480-f0ba-43c8-8565-e1ce1b7b8b56 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 17 01:19:32 user nova-compute[75226]:  {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:19:32 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:356ef305-2a5c-4df3-93ce-51a994422e0b -p 172.16.0.220:3260 --interface default --op new {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:32 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:356ef305-2a5c-4df3-93ce-51a994422e0b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:32 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[41c1f2c1-9abf-4eea-81c2-9c6b09778d2a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:356ef305-2a5c-4df3-93ce-51a994422e0b] added\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:32 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b0c9480-f0ba-43c8-8565-e1ce1b7b8b56 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:356ef305-2a5c-4df3-93ce-51a994422e0b] added
Nov 17 01:19:32 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:19:32 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:356ef305-2a5c-4df3-93ce-51a994422e0b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:32 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:356ef305-2a5c-4df3-93ce-51a994422e0b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:32 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb274d73-946f-400a-9a5f-f2682820086c]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:32 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b0c9480-f0ba-43c8-8565-e1ce1b7b8b56 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:19:32 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:356ef305-2a5c-4df3-93ce-51a994422e0b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:32 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:356ef305-2a5c-4df3-93ce-51a994422e0b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:32 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fab035f-a056-4383-ac3e-066fd6c82baa]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:32 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b0c9480-f0ba-43c8-8565-e1ce1b7b8b56 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:19:32 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:356ef305-2a5c-4df3-93ce-51a994422e0b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DxrzYtBc {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:32 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:356ef305-2a5c-4df3-93ce-51a994422e0b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DxrzYtBc" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:32 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[354a720c-8fad-43c4-92df-4597bf0f645c]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:32 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b0c9480-f0ba-43c8-8565-e1ce1b7b8b56 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DxrzYtBc'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:19:32 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:356ef305-2a5c-4df3-93ce-51a994422e0b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:32 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:19:32 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:356ef305-2a5c-4df3-93ce-51a994422e0b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:32 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1cfad3c-c8c7-42a9-8a10-4945f298738e]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:32 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b0c9480-f0ba-43c8-8565-e1ce1b7b8b56 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:19:32 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:32 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:32 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca46aff5-181d-4523-aaa8-8555b4bbc1f1]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642eafe0-08e5-4d34-a949-c1704d63b132 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18d60c48-77ba-445e-93c7-aa275249c5c2 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:32 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b0c9480-f0ba-43c8-8565-e1ce1b7b8b56 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2 (non-flash)
Nov 17 01:19:32 user nova-compute[75226]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae (non-flash)
Nov 17 01:19:32 user nova-compute[75226]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1 (non-flash)
Nov 17 01:19:32 user nova-compute[75226]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6 (non-flash)
Nov 17 01:19:32 user nova-compute[75226]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642eafe0-08e5-4d34-a949-c1704d63b132 (non-flash)
Nov 17 01:19:32 user nova-compute[75226]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95 (non-flash)
Nov 17 01:19:32 user nova-compute[75226]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18d60c48-77ba-445e-93c7-aa275249c5c2 (non-flash)
Nov 17 01:19:32 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:19:32 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b0c9480-f0ba-43c8-8565-e1ce1b7b8b56 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2 (non-flash)
Nov 17 01:19:32 user nova-compute[75226]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae (non-flash)
Nov 17 01:19:32 user nova-compute[75226]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1 (non-flash)
Nov 17 01:19:32 user nova-compute[75226]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6 (non-flash)
Nov 17 01:19:32 user nova-compute[75226]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642eafe0-08e5-4d34-a949-c1704d63b132 (non-flash)
Nov 17 01:19:32 user nova-compute[75226]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95 (non-flash)
Nov 17 01:19:32 user nova-compute[75226]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18d60c48-77ba-445e-93c7-aa275249c5c2 (non-flash)
Nov 17 01:19:32 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:19:32 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:356ef305-2a5c-4df3-93ce-51a994422e0b -p 172.16.0.220:3260 --login {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:32 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-7b149c5a-e036-483a-942e-31cc9347e676 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] No BDM found with device name vda, not building metadata. {{(pid=75226) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 01:19:32 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-7b149c5a-e036-483a-942e-31cc9347e676 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] No BDM found with device name hda, not building metadata. {{(pid=75226) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 01:19:32 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-7b149c5a-e036-483a-942e-31cc9347e676 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] No VIF found with MAC fa:16:3e:c9:37:0f, not building metadata {{(pid=75226) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 01:19:32 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:356ef305-2a5c-4df3-93ce-51a994422e0b -p 172.16.0.220:3260 --login" returned: 0 in 0.090s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:32 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[9280941c-b0b5-4bd9-8948-8e0ea67a1b7f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:356ef305-2a5c-4df3-93ce-51a994422e0b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:356ef305-2a5c-4df3-93ce-51a994422e0b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:32 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b0c9480-f0ba-43c8-8565-e1ce1b7b8b56 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:356ef305-2a5c-4df3-93ce-51a994422e0b, portal: 172.16.0.220,3260]
Nov 17 01:19:32 user nova-compute[75226]: Login to [iface: default, target: iqn.2010-10.org.openstack:356ef305-2a5c-4df3-93ce-51a994422e0b, portal: 172.16.0.220,3260] successful.
Nov 17 01:19:32 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:19:32 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:356ef305-2a5c-4df3-93ce-51a994422e0b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:32 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:356ef305-2a5c-4df3-93ce-51a994422e0b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:32 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e57458b-a9fb-4b0e-a6c1-824e22ae5288]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:32 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b0c9480-f0ba-43c8-8565-e1ce1b7b8b56 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:19:32 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:32 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:32 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[553c223c-c80f-4b41-a7d0-30a70241d514]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:356ef305-2a5c-4df3-93ce-51a994422e0b (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642eafe0-08e5-4d34-a949-c1704d63b132 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18d60c48-77ba-445e-93c7-aa275249c5c2 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:32 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b0c9480-f0ba-43c8-8565-e1ce1b7b8b56 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:356ef305-2a5c-4df3-93ce-51a994422e0b (non-flash)
Nov 17 01:19:32 user nova-compute[75226]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2 (non-flash)
Nov 17 01:19:32 user nova-compute[75226]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae (non-flash)
Nov 17 01:19:32 user nova-compute[75226]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1 (non-flash)
Nov 17 01:19:32 user nova-compute[75226]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6 (non-flash)
Nov 17 01:19:32 user nova-compute[75226]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642eafe0-08e5-4d34-a949-c1704d63b132 (non-flash)
Nov 17 01:19:32 user nova-compute[75226]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95 (non-flash)
Nov 17 01:19:32 user nova-compute[75226]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18d60c48-77ba-445e-93c7-aa275249c5c2 (non-flash)
Nov 17 01:19:32 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:19:32 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b0c9480-f0ba-43c8-8565-e1ce1b7b8b56 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:356ef305-2a5c-4df3-93ce-51a994422e0b (non-flash)
Nov 17 01:19:32 user nova-compute[75226]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2 (non-flash)
Nov 17 01:19:32 user nova-compute[75226]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae (non-flash)
Nov 17 01:19:32 user nova-compute[75226]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1 (non-flash)
Nov 17 01:19:32 user nova-compute[75226]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6 (non-flash)
Nov 17 01:19:32 user nova-compute[75226]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642eafe0-08e5-4d34-a949-c1704d63b132 (non-flash)
Nov 17 01:19:32 user nova-compute[75226]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95 (non-flash)
Nov 17 01:19:32 user nova-compute[75226]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18d60c48-77ba-445e-93c7-aa275249c5c2 (non-flash)
Nov 17 01:19:32 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:19:32 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-0b0c9480-f0ba-43c8-8565-e1ce1b7b8b56 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:356ef305-2a5c-4df3-93ce-51a994422e0b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.343s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:19:32 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b0c9480-f0ba-43c8-8565-e1ce1b7b8b56 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] Connected to 172.16.0.220:3260 {{(pid=75226) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 17 01:19:32 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-0b0c9480-f0ba-43c8-8565-e1ce1b7b8b56 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] HCTL ('40', '-', '-', 0) found on session 10 with lun 0 {{(pid=75226) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 17 01:19:32 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-0b0c9480-f0ba-43c8-8565-e1ce1b7b8b56 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=75226) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 17 01:19:32 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:32 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:32 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee195e6a-56e9-4366-8582-cc319ba9b65f]: (4, ('- - 0', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:32 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-0b0c9480-f0ba-43c8-8565-e1ce1b7b8b56 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] Searching for a device in session 10 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=75226) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 01:19:32 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b0c9480-f0ba-43c8-8565-e1ce1b7b8b56 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:356ef305-2a5c-4df3-93ce-51a994422e0b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DxrzYtBc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75226) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 17 01:19:32 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-7b149c5a-e036-483a-942e-31cc9347e676 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] Lock "b054a557-dff6-49f8-9300-1307f8433567" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.056s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:19:33 user nova-compute[75226]: INFO nova.compute.manager [None req-48fffe3b-20dd-4da4-8c79-96b8a6f9fb22 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] [instance: 262eb845-eebe-4ffb-bc49-dcaca53ad7b8] Rebuilding instance
Nov 17 01:19:33 user nova-compute[75226]: DEBUG nova.compute.manager [None req-48fffe3b-20dd-4da4-8c79-96b8a6f9fb22 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] [instance: 262eb845-eebe-4ffb-bc49-dcaca53ad7b8] Checking state {{(pid=75226) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 01:19:33 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:19:33 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:19:33 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:19:33 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:19:33 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:19:33 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:19:33 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-0b0c9480-f0ba-43c8-8565-e1ce1b7b8b56 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.385s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:19:33 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b0c9480-f0ba-43c8-8565-e1ce1b7b8b56 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] <== connect_volume: return (1401ms) {'type': 'block', 'scsi_wwn': '26266636138613064', 'path': '/dev/sdi'} {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:19:33 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0b0c9480-f0ba-43c8-8565-e1ce1b7b8b56 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] [instance: e7830f7a-80f1-4c2f-bd64-363e6dd9114a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26266636138613064', 'path': '/dev/sdi'} {{(pid=75226) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 17 01:19:33 user nova-compute[75226]: DEBUG nova.objects.instance [None req-0b0c9480-f0ba-43c8-8565-e1ce1b7b8b56 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] Lazy-loading 'flavor' on Instance uuid e7830f7a-80f1-4c2f-bd64-363e6dd9114a {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:19:33 user nova-compute[75226]: DEBUG nova.compute.manager [req-c5f9413e-6f73-4a32-a267-be129ee3d875 req-1b258a1e-b528-4910-865d-54995dce080f service nova] [instance: 262eb845-eebe-4ffb-bc49-dcaca53ad7b8] Received event network-vif-unplugged-ca3803cf-fc7f-4233-8afa-1806c73156be {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:19:33 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-c5f9413e-6f73-4a32-a267-be129ee3d875 req-1b258a1e-b528-4910-865d-54995dce080f service nova] Acquiring lock "262eb845-eebe-4ffb-bc49-dcaca53ad7b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:19:33 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-c5f9413e-6f73-4a32-a267-be129ee3d875 req-1b258a1e-b528-4910-865d-54995dce080f service nova] Lock "262eb845-eebe-4ffb-bc49-dcaca53ad7b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:19:33 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-c5f9413e-6f73-4a32-a267-be129ee3d875 req-1b258a1e-b528-4910-865d-54995dce080f service nova] Lock "262eb845-eebe-4ffb-bc49-dcaca53ad7b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:19:33 user nova-compute[75226]: DEBUG nova.compute.manager [req-c5f9413e-6f73-4a32-a267-be129ee3d875 req-1b258a1e-b528-4910-865d-54995dce080f service nova] [instance: 262eb845-eebe-4ffb-bc49-dcaca53ad7b8] No waiting events found dispatching network-vif-unplugged-ca3803cf-fc7f-4233-8afa-1806c73156be {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:19:33 user nova-compute[75226]: WARNING nova.compute.manager [req-c5f9413e-6f73-4a32-a267-be129ee3d875 req-1b258a1e-b528-4910-865d-54995dce080f service nova] [instance: 262eb845-eebe-4ffb-bc49-dcaca53ad7b8] Received unexpected event network-vif-unplugged-ca3803cf-fc7f-4233-8afa-1806c73156be for instance with vm_state active and task_state rebuilding.
Nov 17 01:19:33 user nova-compute[75226]: DEBUG nova.virt.libvirt.guest [None req-0b0c9480-f0ba-43c8-8565-e1ce1b7b8b56 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] attach device xml: <disk type="block" device="disk">
Nov 17 01:19:33 user nova-compute[75226]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 01:19:33 user nova-compute[75226]:   <source dev="/dev/sdi"/>
Nov 17 01:19:33 user nova-compute[75226]:   <target dev="sdc" bus="scsi"/>
Nov 17 01:19:33 user nova-compute[75226]:   <serial>356ef305-2a5c-4df3-93ce-51a994422e0b</serial>
Nov 17 01:19:33 user nova-compute[75226]:   <address type="drive" controller="0" unit="2"/>
Nov 17 01:19:33 user nova-compute[75226]: </disk>
Nov 17 01:19:33 user nova-compute[75226]:  {{(pid=75226) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 17 01:19:34 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-0b0c9480-f0ba-43c8-8565-e1ce1b7b8b56 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] No BDM found with device name sda, not building metadata. {{(pid=75226) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 01:19:34 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-0b0c9480-f0ba-43c8-8565-e1ce1b7b8b56 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75226) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 01:19:34 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-0b0c9480-f0ba-43c8-8565-e1ce1b7b8b56 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] No BDM found with device name sdc, not building metadata. {{(pid=75226) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 01:19:34 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-0b0c9480-f0ba-43c8-8565-e1ce1b7b8b56 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] No VIF found with MAC fa:16:3e:29:76:3a, not building metadata {{(pid=75226) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 01:19:34 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e3404692-5eb6-438f-93d2-ac97d0a47166 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] Acquiring lock "b054a557-dff6-49f8-9300-1307f8433567" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:19:34 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e3404692-5eb6-438f-93d2-ac97d0a47166 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] Lock "b054a557-dff6-49f8-9300-1307f8433567" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:19:34 user nova-compute[75226]: INFO nova.compute.manager [None req-e3404692-5eb6-438f-93d2-ac97d0a47166 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] [instance: b054a557-dff6-49f8-9300-1307f8433567] Detaching volume 18d60c48-77ba-445e-93c7-aa275249c5c2
Nov 17 01:19:34 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-0b0c9480-f0ba-43c8-8565-e1ce1b7b8b56 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] Lock "e7830f7a-80f1-4c2f-bd64-363e6dd9114a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.549s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:19:34 user nova-compute[75226]: INFO nova.virt.libvirt.driver [-] [instance: 262eb845-eebe-4ffb-bc49-dcaca53ad7b8] Instance destroyed successfully.
Nov 17 01:19:34 user nova-compute[75226]: INFO nova.virt.libvirt.driver [-] [instance: 262eb845-eebe-4ffb-bc49-dcaca53ad7b8] Instance destroyed successfully.
Nov 17 01:19:34 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-48fffe3b-20dd-4da4-8c79-96b8a6f9fb22 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:17:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1083843920',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-2087129181',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKV3eUaLv1Nf2GbMurBwqVCKHkTHGINwHn9NxIQT1HFJaTPcIhblv549UYBEzh8qzhRSlfco2n2Ir3Yj2M5HfVEZNDfmX2UBxm0ZhLW7VwOddfd0Muufn03LFhj/HJg0+w==',key_name='tempest-keypair-214561330',keypairs=<?>,launch_index=0,launched_at=2023-11-17T01:17:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='25ffeaafcdca494eb7550cec5b100051',ramdisk_id='',reservation_id='r-7fgkbn6g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1243685842',owner_user_name='tempest-ServerActionsV293TestJSON-1243685842-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T01:19:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2c4b7f0453ec4ef5940b4bdf32bdf6f4',uuid=262eb845-eebe-4ffb-bc49-dcaca53ad7b8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ca3803cf-fc7f-4233-8afa-1806c73156be", "address": "fa:16:3e:d9:19:6e", "network": {"id": "432afb25-848f-4ef8-8436-11db949783e6", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1854406043-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25ffeaafcdca494eb7550cec5b100051", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca3803cf-fc", "ovs_interfaceid": "ca3803cf-fc7f-4233-8afa-1806c73156be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 17 01:19:34 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-48fffe3b-20dd-4da4-8c79-96b8a6f9fb22 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] Converting VIF {"id": "ca3803cf-fc7f-4233-8afa-1806c73156be", "address": "fa:16:3e:d9:19:6e", "network": {"id": "432afb25-848f-4ef8-8436-11db949783e6", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1854406043-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25ffeaafcdca494eb7550cec5b100051", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca3803cf-fc", "ovs_interfaceid": "ca3803cf-fc7f-4233-8afa-1806c73156be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:19:34 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-48fffe3b-20dd-4da4-8c79-96b8a6f9fb22 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d9:19:6e,bridge_name='br-int',has_traffic_filtering=True,id=ca3803cf-fc7f-4233-8afa-1806c73156be,network=Network(432afb25-848f-4ef8-8436-11db949783e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca3803cf-fc') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:19:34 user nova-compute[75226]: DEBUG os_vif [None req-48fffe3b-20dd-4da4-8c79-96b8a6f9fb22 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d9:19:6e,bridge_name='br-int',has_traffic_filtering=True,id=ca3803cf-fc7f-4233-8afa-1806c73156be,network=Network(432afb25-848f-4ef8-8436-11db949783e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca3803cf-fc') {{(pid=75226) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 17 01:19:34 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:19:34 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapca3803cf-fc, bridge=br-int, if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:19:34 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:19:34 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:19:34 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:19:34 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f4ba6023-7aec-408a-a3dc-6ffef405f157) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:19:34 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:19:34 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:19:34 user nova-compute[75226]: INFO os_vif [None req-48fffe3b-20dd-4da4-8c79-96b8a6f9fb22 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d9:19:6e,bridge_name='br-int',has_traffic_filtering=True,id=ca3803cf-fc7f-4233-8afa-1806c73156be,network=Network(432afb25-848f-4ef8-8436-11db949783e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca3803cf-fc')
Nov 17 01:19:34 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48fffe3b-20dd-4da4-8c79-96b8a6f9fb22 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] [instance: 262eb845-eebe-4ffb-bc49-dcaca53ad7b8] calling os-brick to detach iSCSI Volume {{(pid=75226) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 17 01:19:34 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-48fffe3b-20dd-4da4-8c79-96b8a6f9fb22 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc4cc36b490>, {'target_iqn': 'iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iChyRSBt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:19:34 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-48fffe3b-20dd-4da4-8c79-96b8a6f9fb22 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 17 01:19:34 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-48fffe3b-20dd-4da4-8c79-96b8a6f9fb22 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:19:34 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-48fffe3b-20dd-4da4-8c79-96b8a6f9fb22 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:19:34 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:34 user nova-compute[75226]: INFO nova.virt.block_device [None req-e3404692-5eb6-438f-93d2-ac97d0a47166 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] [instance: b054a557-dff6-49f8-9300-1307f8433567] Attempting to driver detach volume 18d60c48-77ba-445e-93c7-aa275249c5c2 from mountpoint /dev/vdb
Nov 17 01:19:34 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:34 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[72b43f4a-f3f4-4b75-9afe-1ca31eeb3fda]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:356ef305-2a5c-4df3-93ce-51a994422e0b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:18d60c48-77ba-445e-93c7-aa275249c5c2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:642eafe0-08e5-4d34-a949-c1704d63b132\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:34 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-48fffe3b-20dd-4da4-8c79-96b8a6f9fb22 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 17 01:19:34 user nova-compute[75226]: No targets found.
Nov 17 01:19:34 user nova-compute[75226]: iSNS:
Nov 17 01:19:34 user nova-compute[75226]: No targets found.
Nov 17 01:19:34 user nova-compute[75226]: STATIC:
Nov 17 01:19:34 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:356ef305-2a5c-4df3-93ce-51a994422e0b
Nov 17 01:19:34 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:19:34 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:19:34 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:18d60c48-77ba-445e-93c7-aa275249c5c2
Nov 17 01:19:34 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:19:34 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:19:34 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae
Nov 17 01:19:34 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:19:34 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:19:34 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1
Nov 17 01:19:34 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:19:34 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:19:34 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:642eafe0-08e5-4d34-a949-c1704d63b132
Nov 17 01:19:34 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:19:34 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:19:34 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2
Nov 17 01:19:34 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:19:34 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:19:34 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95
Nov 17 01:19:34 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:19:34 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:19:34 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6
Nov 17 01:19:34 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:19:34 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:19:34 user nova-compute[75226]: FIRMWARE:
Nov 17 01:19:34 user nova-compute[75226]: No targets found.
Nov 17 01:19:34 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:19:34 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-48fffe3b-20dd-4da4-8c79-96b8a6f9fb22 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 17 01:19:34 user nova-compute[75226]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 17 01:19:34 user nova-compute[75226]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75226) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 17 01:19:34 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-48fffe3b-20dd-4da4-8c79-96b8a6f9fb22 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2', 0)] {{(pid=75226) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 17 01:19:34 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:34 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-e3404692-5eb6-438f-93d2-ac97d0a47166 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] Attempting to detach device vdb from instance b054a557-dff6-49f8-9300-1307f8433567 from the persistent domain config. {{(pid=75226) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 17 01:19:34 user nova-compute[75226]: DEBUG nova.virt.libvirt.guest [None req-e3404692-5eb6-438f-93d2-ac97d0a47166 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] detach device xml: <disk type="block" device="disk">
Nov 17 01:19:34 user nova-compute[75226]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 01:19:34 user nova-compute[75226]:   <source dev="/dev/sdh"/>
Nov 17 01:19:34 user nova-compute[75226]:   <target dev="vdb" bus="virtio"/>
Nov 17 01:19:34 user nova-compute[75226]:   <serial>18d60c48-77ba-445e-93c7-aa275249c5c2</serial>
Nov 17 01:19:34 user nova-compute[75226]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 17 01:19:34 user nova-compute[75226]: </disk>
Nov 17 01:19:34 user nova-compute[75226]:  {{(pid=75226) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 17 01:19:34 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-e3404692-5eb6-438f-93d2-ac97d0a47166 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] Successfully detached device vdb from instance b054a557-dff6-49f8-9300-1307f8433567 from the persistent domain config.
Nov 17 01:19:34 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-e3404692-5eb6-438f-93d2-ac97d0a47166 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b054a557-dff6-49f8-9300-1307f8433567 from the live domain config. {{(pid=75226) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 17 01:19:34 user nova-compute[75226]: DEBUG nova.virt.libvirt.guest [None req-e3404692-5eb6-438f-93d2-ac97d0a47166 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] detach device xml: <disk type="block" device="disk">
Nov 17 01:19:34 user nova-compute[75226]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 01:19:34 user nova-compute[75226]:   <source dev="/dev/sdh"/>
Nov 17 01:19:34 user nova-compute[75226]:   <target dev="vdb" bus="virtio"/>
Nov 17 01:19:34 user nova-compute[75226]:   <serial>18d60c48-77ba-445e-93c7-aa275249c5c2</serial>
Nov 17 01:19:34 user nova-compute[75226]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 17 01:19:34 user nova-compute[75226]: </disk>
Nov 17 01:19:34 user nova-compute[75226]:  {{(pid=75226) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 17 01:19:34 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.028s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:34 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[57418751-9675-4af0-906d-27a3d5d8a097]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:18d60c48-77ba-445e-93c7-aa275249c5c2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:356ef305-2a5c-4df3-93ce-51a994422e0b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:642eafe0-08e5-4d34-a949-c1704d63b132\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:34 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:34 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:34 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed8f9a0b-fb1c-4a95-aac4-006e6023edd9]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:356ef305-2a5c-4df3-93ce-51a994422e0b (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642eafe0-08e5-4d34-a949-c1704d63b132 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18d60c48-77ba-445e-93c7-aa275249c5c2 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:34 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-48fffe3b-20dd-4da4-8c79-96b8a6f9fb22 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:356ef305-2a5c-4df3-93ce-51a994422e0b (non-flash)
Nov 17 01:19:34 user nova-compute[75226]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2 (non-flash)
Nov 17 01:19:34 user nova-compute[75226]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae (non-flash)
Nov 17 01:19:34 user nova-compute[75226]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1 (non-flash)
Nov 17 01:19:34 user nova-compute[75226]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6 (non-flash)
Nov 17 01:19:34 user nova-compute[75226]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642eafe0-08e5-4d34-a949-c1704d63b132 (non-flash)
Nov 17 01:19:34 user nova-compute[75226]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95 (non-flash)
Nov 17 01:19:34 user nova-compute[75226]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18d60c48-77ba-445e-93c7-aa275249c5c2 (non-flash)
Nov 17 01:19:34 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:19:34 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-48fffe3b-20dd-4da4-8c79-96b8a6f9fb22 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:356ef305-2a5c-4df3-93ce-51a994422e0b (non-flash)
Nov 17 01:19:34 user nova-compute[75226]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2 (non-flash)
Nov 17 01:19:34 user nova-compute[75226]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae (non-flash)
Nov 17 01:19:34 user nova-compute[75226]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1 (non-flash)
Nov 17 01:19:34 user nova-compute[75226]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6 (non-flash)
Nov 17 01:19:34 user nova-compute[75226]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642eafe0-08e5-4d34-a949-c1704d63b132 (non-flash)
Nov 17 01:19:34 user nova-compute[75226]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95 (non-flash)
Nov 17 01:19:34 user nova-compute[75226]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18d60c48-77ba-445e-93c7-aa275249c5c2 (non-flash)
Nov 17 01:19:34 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:19:34 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-48fffe3b-20dd-4da4-8c79-96b8a6f9fb22 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc4cc2c0670>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2'): ({'sdb'}, set())}) {{(pid=75226) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 17 01:19:34 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-48fffe3b-20dd-4da4-8c79-96b8a6f9fb22 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] Removing single pathed devices sdb {{(pid=75226) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 17 01:19:34 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:34 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:34 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[35db2d56-a4e3-477f-88f8-6dce7cdb5d26]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:34 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:34 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:34 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d7c5f3e-8881-4320-b241-ba1b88f9d307]: (4, ('ok\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:34 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-48fffe3b-20dd-4da4-8c79-96b8a6f9fb22 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] Flushing IO for device /dev/sdb {{(pid=75226) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 17 01:19:34 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:34 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:34 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[62acda1c-769b-43dd-a4c3-baae8ca0e959]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:34 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-48fffe3b-20dd-4da4-8c79-96b8a6f9fb22 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75226) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 17 01:19:34 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:34 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:34 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[09659868-b26a-4e0d-bf5c-4250365f3cf4]: (4, ('1', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:34 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-48fffe3b-20dd-4da4-8c79-96b8a6f9fb22 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75226) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 17 01:19:34 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-48fffe3b-20dd-4da4-8c79-96b8a6f9fb22 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] SCSI volumes sdb have been removed. {{(pid=75226) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 17 01:19:34 user nova-compute[75226]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23461386330356436', '/dev/disk/by-id/scsi-1SCST_BIO5ad4cd8-4a8c05d6ca102148', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_5ad4cd8') {{(pid=85818) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 17 01:19:34 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4e64212-e907-4751-91fd-9768d9a40ce4]: (4, None) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:34 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-48fffe3b-20dd-4da4-8c79-96b8a6f9fb22 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2')] {{(pid=75226) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 17 01:19:34 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:34 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:34 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b00331c-cd49-4d7e-901b-9d9b02e4d2a3]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:34 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-48fffe3b-20dd-4da4-8c79-96b8a6f9fb22 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:19:34 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2 -p 172.16.0.220:3260 --logout {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:34 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:34 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1be6a6e-75fc-46f0-893b-84fca9c43db3]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:34 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-48fffe3b-20dd-4da4-8c79-96b8a6f9fb22 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2, portal: 172.16.0.220,3260]
Nov 17 01:19:34 user nova-compute[75226]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2, portal: 172.16.0.220,3260] successful.
Nov 17 01:19:34 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:19:34 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2 -p 172.16.0.220:3260 --op delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:34 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.043s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:34 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[97e6e879-0073-4040-96fb-ccaeb664ed9f]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:34 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-48fffe3b-20dd-4da4-8c79-96b8a6f9fb22 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:19:34 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-48fffe3b-20dd-4da4-8c79-96b8a6f9fb22 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.380s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:19:34 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-48fffe3b-20dd-4da4-8c79-96b8a6f9fb22 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] <== disconnect_volume: return (381ms) None {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:19:34 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48fffe3b-20dd-4da4-8c79-96b8a6f9fb22 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] [instance: 262eb845-eebe-4ffb-bc49-dcaca53ad7b8] Disconnected iSCSI Volume {{(pid=75226) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 17 01:19:34 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-48fffe3b-20dd-4da4-8c79-96b8a6f9fb22 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] [instance: 262eb845-eebe-4ffb-bc49-dcaca53ad7b8] Deleting instance files /opt/stack/data/nova/instances/262eb845-eebe-4ffb-bc49-dcaca53ad7b8_del
Nov 17 01:19:34 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-48fffe3b-20dd-4da4-8c79-96b8a6f9fb22 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] [instance: 262eb845-eebe-4ffb-bc49-dcaca53ad7b8] Deletion of /opt/stack/data/nova/instances/262eb845-eebe-4ffb-bc49-dcaca53ad7b8_del complete
Nov 17 01:19:35 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-e3404692-5eb6-438f-93d2-ac97d0a47166 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b054a557-dff6-49f8-9300-1307f8433567 {{(pid=75226) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 17 01:19:35 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-48fffe3b-20dd-4da4-8c79-96b8a6f9fb22 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] [instance: 262eb845-eebe-4ffb-bc49-dcaca53ad7b8] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 262eb845-eebe-4ffb-bc49-dcaca53ad7b8 could not be found.
Nov 17 01:19:35 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48fffe3b-20dd-4da4-8c79-96b8a6f9fb22 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] [instance: 262eb845-eebe-4ffb-bc49-dcaca53ad7b8] calling os-brick to detach iSCSI Volume {{(pid=75226) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 17 01:19:35 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-48fffe3b-20dd-4da4-8c79-96b8a6f9fb22 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc4cc36b490>, {'target_iqn': 'iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iChyRSBt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:19:35 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-48fffe3b-20dd-4da4-8c79-96b8a6f9fb22 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 17 01:19:35 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-48fffe3b-20dd-4da4-8c79-96b8a6f9fb22 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:19:35 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-48fffe3b-20dd-4da4-8c79-96b8a6f9fb22 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:19:35 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:35 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:35 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[f32484bb-a539-47d5-b0c4-51e60c4a0af9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:356ef305-2a5c-4df3-93ce-51a994422e0b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:18d60c48-77ba-445e-93c7-aa275249c5c2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:642eafe0-08e5-4d34-a949-c1704d63b132\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:35 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-48fffe3b-20dd-4da4-8c79-96b8a6f9fb22 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 17 01:19:35 user nova-compute[75226]: No targets found.
Nov 17 01:19:35 user nova-compute[75226]: iSNS:
Nov 17 01:19:35 user nova-compute[75226]: No targets found.
Nov 17 01:19:35 user nova-compute[75226]: STATIC:
Nov 17 01:19:35 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:356ef305-2a5c-4df3-93ce-51a994422e0b
Nov 17 01:19:35 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:19:35 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:19:35 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:18d60c48-77ba-445e-93c7-aa275249c5c2
Nov 17 01:19:35 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:19:35 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:19:35 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae
Nov 17 01:19:35 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:19:35 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:19:35 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1
Nov 17 01:19:35 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:19:35 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:19:35 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:642eafe0-08e5-4d34-a949-c1704d63b132
Nov 17 01:19:35 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:19:35 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:19:35 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95
Nov 17 01:19:35 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:19:35 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:19:35 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6
Nov 17 01:19:35 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:19:35 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:19:35 user nova-compute[75226]: FIRMWARE:
Nov 17 01:19:35 user nova-compute[75226]: No targets found.
Nov 17 01:19:35 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:19:35 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-48fffe3b-20dd-4da4-8c79-96b8a6f9fb22 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 17 01:19:35 user nova-compute[75226]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 17 01:19:35 user nova-compute[75226]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75226) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 17 01:19:35 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-48fffe3b-20dd-4da4-8c79-96b8a6f9fb22 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2', 0)] {{(pid=75226) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 17 01:19:35 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:35 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-31892f4f-def4-4407-9905-0210fbfed9e3 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] Acquiring lock "e7830f7a-80f1-4c2f-bd64-363e6dd9114a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:19:35 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-31892f4f-def4-4407-9905-0210fbfed9e3 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] Lock "e7830f7a-80f1-4c2f-bd64-363e6dd9114a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:19:35 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.041s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:35 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[d57055e2-a7e6-48f1-be3d-ab3b7c2835c4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:18d60c48-77ba-445e-93c7-aa275249c5c2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:356ef305-2a5c-4df3-93ce-51a994422e0b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:642eafe0-08e5-4d34-a949-c1704d63b132\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:35 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:35 user nova-compute[75226]: INFO nova.compute.manager [None req-31892f4f-def4-4407-9905-0210fbfed9e3 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] [instance: e7830f7a-80f1-4c2f-bd64-363e6dd9114a] Detaching volume 356ef305-2a5c-4df3-93ce-51a994422e0b
Nov 17 01:19:35 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e7b546ed-d589-4ccf-8032-7d47724e65a0 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] [instance: 75b1cabe-ba15-4851-9140-5949afc33005] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0e860a72-9a6d-4889-8210-beafd1f879c7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CQNvTtKG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '75b1cabe-ba15-4851-9140-5949afc33005', 'attached_at': '', 'detached_at': '', 'volume_id': '0e860a72-9a6d-4889-8210-beafd1f879c7', 'serial': '0e860a72-9a6d-4889-8210-beafd1f879c7'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OsjHbnIp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, 'status': 'reserved', 'instance': '75b1cabe-ba15-4851-9140-5949afc33005', 'attached_at': '', 'detached_at': '', 'volume_id': 'ac3239e4-20ce-43ca-84b3-f5f0a5ffff95', 'serial'} {{(pid=75226) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 17 01:19:35 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:35 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[c37b1780-a959-443b-a687-4caf868c826f]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:356ef305-2a5c-4df3-93ce-51a994422e0b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642eafe0-08e5-4d34-a949-c1704d63b132 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18d60c48-77ba-445e-93c7-aa275249c5c2 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:35 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-48fffe3b-20dd-4da4-8c79-96b8a6f9fb22 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:356ef305-2a5c-4df3-93ce-51a994422e0b (non-flash)
Nov 17 01:19:35 user nova-compute[75226]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae (non-flash)
Nov 17 01:19:35 user nova-compute[75226]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1 (non-flash)
Nov 17 01:19:35 user nova-compute[75226]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6 (non-flash)
Nov 17 01:19:35 user nova-compute[75226]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642eafe0-08e5-4d34-a949-c1704d63b132 (non-flash)
Nov 17 01:19:35 user nova-compute[75226]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95 (non-flash)
Nov 17 01:19:35 user nova-compute[75226]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18d60c48-77ba-445e-93c7-aa275249c5c2 (non-flash)
Nov 17 01:19:35 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:19:35 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-48fffe3b-20dd-4da4-8c79-96b8a6f9fb22 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:356ef305-2a5c-4df3-93ce-51a994422e0b (non-flash)
Nov 17 01:19:35 user nova-compute[75226]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae (non-flash)
Nov 17 01:19:35 user nova-compute[75226]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1 (non-flash)
Nov 17 01:19:35 user nova-compute[75226]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6 (non-flash)
Nov 17 01:19:35 user nova-compute[75226]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642eafe0-08e5-4d34-a949-c1704d63b132 (non-flash)
Nov 17 01:19:35 user nova-compute[75226]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95 (non-flash)
Nov 17 01:19:35 user nova-compute[75226]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18d60c48-77ba-445e-93c7-aa275249c5c2 (non-flash)
Nov 17 01:19:35 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:19:35 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-48fffe3b-20dd-4da4-8c79-96b8a6f9fb22 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc4cc36e3b0>, {}) {{(pid=75226) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 17 01:19:35 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-48fffe3b-20dd-4da4-8c79-96b8a6f9fb22 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] Disconnecting from: [] {{(pid=75226) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 17 01:19:35 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-48fffe3b-20dd-4da4-8c79-96b8a6f9fb22 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.115s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:19:35 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-48fffe3b-20dd-4da4-8c79-96b8a6f9fb22 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] <== disconnect_volume: return (117ms) None {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:19:35 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48fffe3b-20dd-4da4-8c79-96b8a6f9fb22 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] [instance: 262eb845-eebe-4ffb-bc49-dcaca53ad7b8] Disconnected iSCSI Volume {{(pid=75226) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 17 01:19:35 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7b546ed-d589-4ccf-8032-7d47724e65a0 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] [instance: 75b1cabe-ba15-4851-9140-5949afc33005] Calling os-brick to attach iSCSI Volume {{(pid=75226) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 17 01:19:35 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7b546ed-d589-4ccf-8032-7d47724e65a0 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc4cc36b490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0e860a72-9a6d-4889-8210-beafd1f879c7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CQNvTtKG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:19:35 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-e7b546ed-d589-4ccf-8032-7d47724e65a0 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:19:35 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-e7b546ed-d589-4ccf-8032-7d47724e65a0 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:19:35 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-e7b546ed-d589-4ccf-8032-7d47724e65a0 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:19:35 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-e7b546ed-d589-4ccf-8032-7d47724e65a0 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:19:35 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-e7b546ed-d589-4ccf-8032-7d47724e65a0 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0e860a72-9a6d-4889-8210-beafd1f879c7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:19:35 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-e7b546ed-d589-4ccf-8032-7d47724e65a0 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0e860a72-9a6d-4889-8210-beafd1f879c7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:19:35 user nova-compute[75226]: INFO os_brick.initiator.connectors.iscsi [None req-e7b546ed-d589-4ccf-8032-7d47724e65a0 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 17 01:19:35 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e860a72-9a6d-4889-8210-beafd1f879c7 -p 172.16.0.220:3260 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:35 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e860a72-9a6d-4889-8210-beafd1f879c7 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:35 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee76c3ab-f711-4e24-a7d3-53a05aac91d8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:35 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7b546ed-d589-4ccf-8032-7d47724e65a0 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 17 01:19:35 user nova-compute[75226]:  {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:19:35 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e860a72-9a6d-4889-8210-beafd1f879c7 -p 172.16.0.220:3260 --interface default --op new {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:35 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e860a72-9a6d-4889-8210-beafd1f879c7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:35 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[12dd2e59-9948-4209-83b5-5f07eed57c14]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0e860a72-9a6d-4889-8210-beafd1f879c7] added\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:35 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7b546ed-d589-4ccf-8032-7d47724e65a0 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0e860a72-9a6d-4889-8210-beafd1f879c7] added
Nov 17 01:19:35 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:19:35 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e860a72-9a6d-4889-8210-beafd1f879c7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:35 user nova-compute[75226]: INFO nova.virt.block_device [None req-31892f4f-def4-4407-9905-0210fbfed9e3 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] [instance: e7830f7a-80f1-4c2f-bd64-363e6dd9114a] Attempting to driver detach volume 356ef305-2a5c-4df3-93ce-51a994422e0b from mountpoint /dev/sdc
Nov 17 01:19:35 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e860a72-9a6d-4889-8210-beafd1f879c7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:35 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[9451d374-235b-40e9-b1aa-cf01fc0e7e8c]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:35 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7b546ed-d589-4ccf-8032-7d47724e65a0 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:19:35 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e860a72-9a6d-4889-8210-beafd1f879c7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:35 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-31892f4f-def4-4407-9905-0210fbfed9e3 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] Attempting to detach device sdc from instance e7830f7a-80f1-4c2f-bd64-363e6dd9114a from the persistent domain config. {{(pid=75226) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 17 01:19:35 user nova-compute[75226]: DEBUG nova.virt.libvirt.guest [None req-31892f4f-def4-4407-9905-0210fbfed9e3 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] detach device xml: <disk type="block" device="disk">
Nov 17 01:19:35 user nova-compute[75226]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 01:19:35 user nova-compute[75226]:   <source dev="/dev/sdi"/>
Nov 17 01:19:35 user nova-compute[75226]:   <target dev="sdc" bus="scsi"/>
Nov 17 01:19:35 user nova-compute[75226]:   <serial>356ef305-2a5c-4df3-93ce-51a994422e0b</serial>
Nov 17 01:19:35 user nova-compute[75226]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 17 01:19:35 user nova-compute[75226]: </disk>
Nov 17 01:19:35 user nova-compute[75226]:  {{(pid=75226) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 17 01:19:35 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-31892f4f-def4-4407-9905-0210fbfed9e3 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] Successfully detached device sdc from instance e7830f7a-80f1-4c2f-bd64-363e6dd9114a from the persistent domain config.
Nov 17 01:19:35 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-31892f4f-def4-4407-9905-0210fbfed9e3 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance e7830f7a-80f1-4c2f-bd64-363e6dd9114a from the live domain config. {{(pid=75226) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 17 01:19:35 user nova-compute[75226]: DEBUG nova.virt.libvirt.guest [None req-31892f4f-def4-4407-9905-0210fbfed9e3 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] detach device xml: <disk type="block" device="disk">
Nov 17 01:19:35 user nova-compute[75226]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 01:19:35 user nova-compute[75226]:   <source dev="/dev/sdi"/>
Nov 17 01:19:35 user nova-compute[75226]:   <target dev="sdc" bus="scsi"/>
Nov 17 01:19:35 user nova-compute[75226]:   <serial>356ef305-2a5c-4df3-93ce-51a994422e0b</serial>
Nov 17 01:19:35 user nova-compute[75226]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 17 01:19:35 user nova-compute[75226]: </disk>
Nov 17 01:19:35 user nova-compute[75226]:  {{(pid=75226) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 17 01:19:35 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e860a72-9a6d-4889-8210-beafd1f879c7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:35 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0d1d257-00af-4815-b33b-7bf2d29c3f2c]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:35 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7b546ed-d589-4ccf-8032-7d47724e65a0 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:19:35 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e860a72-9a6d-4889-8210-beafd1f879c7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CQNvTtKG {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:35 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e860a72-9a6d-4889-8210-beafd1f879c7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CQNvTtKG" returned: 0 in 0.025s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:35 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf218284-070e-4ad1-a462-abca5e9b99ab]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:35 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7b546ed-d589-4ccf-8032-7d47724e65a0 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CQNvTtKG'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:19:35 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e860a72-9a6d-4889-8210-beafd1f879c7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:35 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e860a72-9a6d-4889-8210-beafd1f879c7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:35 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[432809b2-ac63-4dc2-9f18-0c77ee91939d]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:35 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7b546ed-d589-4ccf-8032-7d47724e65a0 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:19:35 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:35 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:35 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5285f60-4000-4bb4-8b63-8af842f1286b]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:356ef305-2a5c-4df3-93ce-51a994422e0b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642eafe0-08e5-4d34-a949-c1704d63b132 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18d60c48-77ba-445e-93c7-aa275249c5c2 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:35 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7b546ed-d589-4ccf-8032-7d47724e65a0 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:356ef305-2a5c-4df3-93ce-51a994422e0b (non-flash)
Nov 17 01:19:35 user nova-compute[75226]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae (non-flash)
Nov 17 01:19:35 user nova-compute[75226]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1 (non-flash)
Nov 17 01:19:35 user nova-compute[75226]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6 (non-flash)
Nov 17 01:19:35 user nova-compute[75226]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642eafe0-08e5-4d34-a949-c1704d63b132 (non-flash)
Nov 17 01:19:35 user nova-compute[75226]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95 (non-flash)
Nov 17 01:19:35 user nova-compute[75226]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18d60c48-77ba-445e-93c7-aa275249c5c2 (non-flash)
Nov 17 01:19:35 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:19:35 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7b546ed-d589-4ccf-8032-7d47724e65a0 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:356ef305-2a5c-4df3-93ce-51a994422e0b (non-flash)
Nov 17 01:19:35 user nova-compute[75226]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae (non-flash)
Nov 17 01:19:35 user nova-compute[75226]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1 (non-flash)
Nov 17 01:19:35 user nova-compute[75226]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6 (non-flash)
Nov 17 01:19:35 user nova-compute[75226]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642eafe0-08e5-4d34-a949-c1704d63b132 (non-flash)
Nov 17 01:19:35 user nova-compute[75226]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95 (non-flash)
Nov 17 01:19:35 user nova-compute[75226]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18d60c48-77ba-445e-93c7-aa275249c5c2 (non-flash)
Nov 17 01:19:35 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:19:35 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e860a72-9a6d-4889-8210-beafd1f879c7 -p 172.16.0.220:3260 --login {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:35 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e860a72-9a6d-4889-8210-beafd1f879c7 -p 172.16.0.220:3260 --login" returned: 0 in 0.117s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:35 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b2d309c-db43-403d-98eb-9eeb77ca177f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0e860a72-9a6d-4889-8210-beafd1f879c7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0e860a72-9a6d-4889-8210-beafd1f879c7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:35 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7b546ed-d589-4ccf-8032-7d47724e65a0 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0e860a72-9a6d-4889-8210-beafd1f879c7, portal: 172.16.0.220,3260]
Nov 17 01:19:35 user nova-compute[75226]: Login to [iface: default, target: iqn.2010-10.org.openstack:0e860a72-9a6d-4889-8210-beafd1f879c7, portal: 172.16.0.220,3260] successful.
Nov 17 01:19:35 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:19:35 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e860a72-9a6d-4889-8210-beafd1f879c7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:35 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e860a72-9a6d-4889-8210-beafd1f879c7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:35 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9b16935-0170-4c9a-98d4-440cd7b02590]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:35 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7b546ed-d589-4ccf-8032-7d47724e65a0 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:19:35 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:35 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:35 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[32aec150-1b7f-4493-a489-9ace4dc327e5]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:356ef305-2a5c-4df3-93ce-51a994422e0b (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e860a72-9a6d-4889-8210-beafd1f879c7 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642eafe0-08e5-4d34-a949-c1704d63b132 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18d60c48-77ba-445e-93c7-aa275249c5c2 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:35 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7b546ed-d589-4ccf-8032-7d47724e65a0 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:356ef305-2a5c-4df3-93ce-51a994422e0b (non-flash)
Nov 17 01:19:35 user nova-compute[75226]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e860a72-9a6d-4889-8210-beafd1f879c7 (non-flash)
Nov 17 01:19:35 user nova-compute[75226]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae (non-flash)
Nov 17 01:19:35 user nova-compute[75226]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1 (non-flash)
Nov 17 01:19:35 user nova-compute[75226]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6 (non-flash)
Nov 17 01:19:35 user nova-compute[75226]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642eafe0-08e5-4d34-a949-c1704d63b132 (non-flash)
Nov 17 01:19:35 user nova-compute[75226]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95 (non-flash)
Nov 17 01:19:35 user nova-compute[75226]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18d60c48-77ba-445e-93c7-aa275249c5c2 (non-flash)
Nov 17 01:19:35 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:19:35 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7b546ed-d589-4ccf-8032-7d47724e65a0 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:356ef305-2a5c-4df3-93ce-51a994422e0b (non-flash)
Nov 17 01:19:35 user nova-compute[75226]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e860a72-9a6d-4889-8210-beafd1f879c7 (non-flash)
Nov 17 01:19:35 user nova-compute[75226]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae (non-flash)
Nov 17 01:19:35 user nova-compute[75226]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1 (non-flash)
Nov 17 01:19:35 user nova-compute[75226]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6 (non-flash)
Nov 17 01:19:35 user nova-compute[75226]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642eafe0-08e5-4d34-a949-c1704d63b132 (non-flash)
Nov 17 01:19:35 user nova-compute[75226]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95 (non-flash)
Nov 17 01:19:35 user nova-compute[75226]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18d60c48-77ba-445e-93c7-aa275249c5c2 (non-flash)
Nov 17 01:19:35 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:19:35 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-e7b546ed-d589-4ccf-8032-7d47724e65a0 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0e860a72-9a6d-4889-8210-beafd1f879c7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.401s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:19:35 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7b546ed-d589-4ccf-8032-7d47724e65a0 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] Connected to 172.16.0.220:3260 {{(pid=75226) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 17 01:19:35 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-e7b546ed-d589-4ccf-8032-7d47724e65a0 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] HCTL ('33', '-', '-', 0) found on session 11 with lun 0 {{(pid=75226) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 17 01:19:35 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-e7b546ed-d589-4ccf-8032-7d47724e65a0 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] Scanning host 33 c: -, t: -, l: 0) {{(pid=75226) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 17 01:19:35 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:35 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.023s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:35 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[5201d3ac-309c-4871-a03b-a42539ebcf44]: (4, ('- - 0', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:35 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-e7b546ed-d589-4ccf-8032-7d47724e65a0 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] Searching for a device in session 11 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75226) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 01:19:35 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7b546ed-d589-4ccf-8032-7d47724e65a0 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:0e860a72-9a6d-4889-8210-beafd1f879c7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CQNvTtKG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75226) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 17 01:19:35 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-31892f4f-def4-4407-9905-0210fbfed9e3 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance e7830f7a-80f1-4c2f-bd64-363e6dd9114a {{(pid=75226) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 17 01:19:35 user nova-compute[75226]: DEBUG nova.compute.manager [req-7bb47e78-713d-4b81-a358-9c8606ad64e4 req-e04100c4-5505-4271-a1ea-133fc95bcdc9 service nova] [instance: 262eb845-eebe-4ffb-bc49-dcaca53ad7b8] Received event network-vif-plugged-ca3803cf-fc7f-4233-8afa-1806c73156be {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:19:35 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-7bb47e78-713d-4b81-a358-9c8606ad64e4 req-e04100c4-5505-4271-a1ea-133fc95bcdc9 service nova] Acquiring lock "262eb845-eebe-4ffb-bc49-dcaca53ad7b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:19:35 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-7bb47e78-713d-4b81-a358-9c8606ad64e4 req-e04100c4-5505-4271-a1ea-133fc95bcdc9 service nova] Lock "262eb845-eebe-4ffb-bc49-dcaca53ad7b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:19:35 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-7bb47e78-713d-4b81-a358-9c8606ad64e4 req-e04100c4-5505-4271-a1ea-133fc95bcdc9 service nova] Lock "262eb845-eebe-4ffb-bc49-dcaca53ad7b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:19:35 user nova-compute[75226]: DEBUG nova.compute.manager [req-7bb47e78-713d-4b81-a358-9c8606ad64e4 req-e04100c4-5505-4271-a1ea-133fc95bcdc9 service nova] [instance: 262eb845-eebe-4ffb-bc49-dcaca53ad7b8] No waiting events found dispatching network-vif-plugged-ca3803cf-fc7f-4233-8afa-1806c73156be {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:19:35 user nova-compute[75226]: WARNING nova.compute.manager [req-7bb47e78-713d-4b81-a358-9c8606ad64e4 req-e04100c4-5505-4271-a1ea-133fc95bcdc9 service nova] [instance: 262eb845-eebe-4ffb-bc49-dcaca53ad7b8] Received unexpected event network-vif-plugged-ca3803cf-fc7f-4233-8afa-1806c73156be for instance with vm_state active and task_state rebuilding.
Nov 17 01:19:36 user nova-compute[75226]: DEBUG nova.compute.manager [None req-48fffe3b-20dd-4da4-8c79-96b8a6f9fb22 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] [instance: 262eb845-eebe-4ffb-bc49-dcaca53ad7b8] Preparing to wait for external event volume-reimaged-2ca02b15-b2b8-4e45-9d87-54886c2568a2 {{(pid=75226) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Nov 17 01:19:36 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-48fffe3b-20dd-4da4-8c79-96b8a6f9fb22 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] Acquiring lock "262eb845-eebe-4ffb-bc49-dcaca53ad7b8-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:19:36 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-48fffe3b-20dd-4da4-8c79-96b8a6f9fb22 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] Lock "262eb845-eebe-4ffb-bc49-dcaca53ad7b8-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:19:36 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-48fffe3b-20dd-4da4-8c79-96b8a6f9fb22 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] Lock "262eb845-eebe-4ffb-bc49-dcaca53ad7b8-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:19:36 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-e7b546ed-d589-4ccf-8032-7d47724e65a0 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.446s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:19:36 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7b546ed-d589-4ccf-8032-7d47724e65a0 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] <== connect_volume: return (1448ms) {'type': 'block', 'scsi_wwn': '26337326631343330', 'path': '/dev/sdb'} {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:19:36 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7b546ed-d589-4ccf-8032-7d47724e65a0 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] [instance: 75b1cabe-ba15-4851-9140-5949afc33005] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26337326631343330', 'path': '/dev/sdb'} {{(pid=75226) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 17 01:19:36 user nova-compute[75226]: DEBUG nova.objects.instance [None req-e7b546ed-d589-4ccf-8032-7d47724e65a0 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] Lazy-loading 'flavor' on Instance uuid 75b1cabe-ba15-4851-9140-5949afc33005 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:19:37 user nova-compute[75226]: DEBUG nova.virt.libvirt.guest [None req-e7b546ed-d589-4ccf-8032-7d47724e65a0 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] COPY block job progress, current cursor: 4194304 final cursor: 1073741824 {{(pid=75226) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 17 01:19:37 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:19:37 user nova-compute[75226]: DEBUG nova.virt.libvirt.guest [None req-e7b546ed-d589-4ccf-8032-7d47724e65a0 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] COPY block job progress, current cursor: 105906176 final cursor: 1073741824 {{(pid=75226) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 17 01:19:37 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d604bed7-9a2f-4e13-ae55-2032c5e511fd tempest-VolumesAssistedSnapshotsTest-526759134 tempest-VolumesAssistedSnapshotsTest-526759134-project-admin] [instance: 1c505f8d-09e0-41bc-ba3a-89bde1646613] Calling os-brick to attach iSCSI Volume {{(pid=75226) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 17 01:19:37 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-d604bed7-9a2f-4e13-ae55-2032c5e511fd tempest-VolumesAssistedSnapshotsTest-526759134 tempest-VolumesAssistedSnapshotsTest-526759134-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc4cc36b490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:801ff813-83ea-4d9e-a8d2-ed4146b22b52', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hRtbMogC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:19:37 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-d604bed7-9a2f-4e13-ae55-2032c5e511fd tempest-VolumesAssistedSnapshotsTest-526759134 tempest-VolumesAssistedSnapshotsTest-526759134-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:19:37 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-d604bed7-9a2f-4e13-ae55-2032c5e511fd tempest-VolumesAssistedSnapshotsTest-526759134 tempest-VolumesAssistedSnapshotsTest-526759134-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:19:37 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-d604bed7-9a2f-4e13-ae55-2032c5e511fd tempest-VolumesAssistedSnapshotsTest-526759134 tempest-VolumesAssistedSnapshotsTest-526759134-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:19:37 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-d604bed7-9a2f-4e13-ae55-2032c5e511fd tempest-VolumesAssistedSnapshotsTest-526759134 tempest-VolumesAssistedSnapshotsTest-526759134-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:19:37 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-d604bed7-9a2f-4e13-ae55-2032c5e511fd tempest-VolumesAssistedSnapshotsTest-526759134 tempest-VolumesAssistedSnapshotsTest-526759134-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:801ff813-83ea-4d9e-a8d2-ed4146b22b52" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:19:37 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-d604bed7-9a2f-4e13-ae55-2032c5e511fd tempest-VolumesAssistedSnapshotsTest-526759134 tempest-VolumesAssistedSnapshotsTest-526759134-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:801ff813-83ea-4d9e-a8d2-ed4146b22b52" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:19:37 user nova-compute[75226]: INFO os_brick.initiator.connectors.iscsi [None req-d604bed7-9a2f-4e13-ae55-2032c5e511fd tempest-VolumesAssistedSnapshotsTest-526759134 tempest-VolumesAssistedSnapshotsTest-526759134-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 17 01:19:37 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:801ff813-83ea-4d9e-a8d2-ed4146b22b52 -p 172.16.0.220:3260 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:37 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:801ff813-83ea-4d9e-a8d2-ed4146b22b52 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:37 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ea300eb-0cc0-4d9b-b417-09ede8caa4c8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:37 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-d604bed7-9a2f-4e13-ae55-2032c5e511fd tempest-VolumesAssistedSnapshotsTest-526759134 tempest-VolumesAssistedSnapshotsTest-526759134-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 17 01:19:37 user nova-compute[75226]:  {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:19:37 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:801ff813-83ea-4d9e-a8d2-ed4146b22b52 -p 172.16.0.220:3260 --interface default --op new {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:37 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:801ff813-83ea-4d9e-a8d2-ed4146b22b52 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:37 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[48fbd41d-e87a-4dc4-b824-76b4ff3f9c9a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:801ff813-83ea-4d9e-a8d2-ed4146b22b52] added\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:37 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-d604bed7-9a2f-4e13-ae55-2032c5e511fd tempest-VolumesAssistedSnapshotsTest-526759134 tempest-VolumesAssistedSnapshotsTest-526759134-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:801ff813-83ea-4d9e-a8d2-ed4146b22b52] added
Nov 17 01:19:37 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:19:37 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:801ff813-83ea-4d9e-a8d2-ed4146b22b52 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:38 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:801ff813-83ea-4d9e-a8d2-ed4146b22b52 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.086s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:38 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4a1eb5b-15f6-41e8-89e4-8f2066da2545]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:38 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-d604bed7-9a2f-4e13-ae55-2032c5e511fd tempest-VolumesAssistedSnapshotsTest-526759134 tempest-VolumesAssistedSnapshotsTest-526759134-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:19:38 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:801ff813-83ea-4d9e-a8d2-ed4146b22b52 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:38 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:801ff813-83ea-4d9e-a8d2-ed4146b22b52 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:38 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[70ce040b-0435-4e08-be4a-d1bed405cf3a]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:38 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-d604bed7-9a2f-4e13-ae55-2032c5e511fd tempest-VolumesAssistedSnapshotsTest-526759134 tempest-VolumesAssistedSnapshotsTest-526759134-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:19:38 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:801ff813-83ea-4d9e-a8d2-ed4146b22b52 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hRtbMogC {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:38 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:801ff813-83ea-4d9e-a8d2-ed4146b22b52 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hRtbMogC" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:38 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[36981585-e931-4bb7-96d1-226e6ad7f142]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:38 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-d604bed7-9a2f-4e13-ae55-2032c5e511fd tempest-VolumesAssistedSnapshotsTest-526759134 tempest-VolumesAssistedSnapshotsTest-526759134-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hRtbMogC'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:19:38 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:801ff813-83ea-4d9e-a8d2-ed4146b22b52 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:38 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:801ff813-83ea-4d9e-a8d2-ed4146b22b52 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:38 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[f81310a2-9b73-4f9e-b923-f5d63f8de239]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:38 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-d604bed7-9a2f-4e13-ae55-2032c5e511fd tempest-VolumesAssistedSnapshotsTest-526759134 tempest-VolumesAssistedSnapshotsTest-526759134-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:19:38 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:38 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:38 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[60e67c9a-a90c-41b5-be4d-bb91fde3da2e]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:356ef305-2a5c-4df3-93ce-51a994422e0b (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e860a72-9a6d-4889-8210-beafd1f879c7 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642eafe0-08e5-4d34-a949-c1704d63b132 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18d60c48-77ba-445e-93c7-aa275249c5c2 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:38 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-d604bed7-9a2f-4e13-ae55-2032c5e511fd tempest-VolumesAssistedSnapshotsTest-526759134 tempest-VolumesAssistedSnapshotsTest-526759134-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:356ef305-2a5c-4df3-93ce-51a994422e0b (non-flash)
Nov 17 01:19:38 user nova-compute[75226]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e860a72-9a6d-4889-8210-beafd1f879c7 (non-flash)
Nov 17 01:19:38 user nova-compute[75226]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae (non-flash)
Nov 17 01:19:38 user nova-compute[75226]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1 (non-flash)
Nov 17 01:19:38 user nova-compute[75226]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6 (non-flash)
Nov 17 01:19:38 user nova-compute[75226]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642eafe0-08e5-4d34-a949-c1704d63b132 (non-flash)
Nov 17 01:19:38 user nova-compute[75226]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95 (non-flash)
Nov 17 01:19:38 user nova-compute[75226]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18d60c48-77ba-445e-93c7-aa275249c5c2 (non-flash)
Nov 17 01:19:38 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:19:38 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-d604bed7-9a2f-4e13-ae55-2032c5e511fd tempest-VolumesAssistedSnapshotsTest-526759134 tempest-VolumesAssistedSnapshotsTest-526759134-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:356ef305-2a5c-4df3-93ce-51a994422e0b (non-flash)
Nov 17 01:19:38 user nova-compute[75226]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e860a72-9a6d-4889-8210-beafd1f879c7 (non-flash)
Nov 17 01:19:38 user nova-compute[75226]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae (non-flash)
Nov 17 01:19:38 user nova-compute[75226]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1 (non-flash)
Nov 17 01:19:38 user nova-compute[75226]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6 (non-flash)
Nov 17 01:19:38 user nova-compute[75226]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642eafe0-08e5-4d34-a949-c1704d63b132 (non-flash)
Nov 17 01:19:38 user nova-compute[75226]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95 (non-flash)
Nov 17 01:19:38 user nova-compute[75226]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18d60c48-77ba-445e-93c7-aa275249c5c2 (non-flash)
Nov 17 01:19:38 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:19:38 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:801ff813-83ea-4d9e-a8d2-ed4146b22b52 -p 172.16.0.220:3260 --login {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:38 user nova-compute[75226]: DEBUG nova.virt.libvirt.guest [None req-e7b546ed-d589-4ccf-8032-7d47724e65a0 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] COPY block job progress, current cursor: 218103808 final cursor: 1073741824 {{(pid=75226) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 17 01:19:38 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:801ff813-83ea-4d9e-a8d2-ed4146b22b52 -p 172.16.0.220:3260 --login" returned: 0 in 0.101s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:38 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[91df0e4f-3802-432b-92ab-155565766c22]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:801ff813-83ea-4d9e-a8d2-ed4146b22b52, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:801ff813-83ea-4d9e-a8d2-ed4146b22b52, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:38 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-d604bed7-9a2f-4e13-ae55-2032c5e511fd tempest-VolumesAssistedSnapshotsTest-526759134 tempest-VolumesAssistedSnapshotsTest-526759134-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:801ff813-83ea-4d9e-a8d2-ed4146b22b52, portal: 172.16.0.220,3260]
Nov 17 01:19:38 user nova-compute[75226]: Login to [iface: default, target: iqn.2010-10.org.openstack:801ff813-83ea-4d9e-a8d2-ed4146b22b52, portal: 172.16.0.220,3260] successful.
Nov 17 01:19:38 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:19:38 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:801ff813-83ea-4d9e-a8d2-ed4146b22b52 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:38 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:801ff813-83ea-4d9e-a8d2-ed4146b22b52 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:38 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[d22ad1ad-28a2-4668-b031-6c486137c7ca]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:38 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-d604bed7-9a2f-4e13-ae55-2032c5e511fd tempest-VolumesAssistedSnapshotsTest-526759134 tempest-VolumesAssistedSnapshotsTest-526759134-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:19:38 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:38 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.042s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:38 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[5455efc1-b309-4be1-a12b-144b4af420d5]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:356ef305-2a5c-4df3-93ce-51a994422e0b (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e860a72-9a6d-4889-8210-beafd1f879c7 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:801ff813-83ea-4d9e-a8d2-ed4146b22b52 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642eafe0-08e5-4d34-a949-c1704d63b132 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18d60c48-77ba-445e-93c7-aa275249c5c2 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:38 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-d604bed7-9a2f-4e13-ae55-2032c5e511fd tempest-VolumesAssistedSnapshotsTest-526759134 tempest-VolumesAssistedSnapshotsTest-526759134-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:356ef305-2a5c-4df3-93ce-51a994422e0b (non-flash)
Nov 17 01:19:38 user nova-compute[75226]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e860a72-9a6d-4889-8210-beafd1f879c7 (non-flash)
Nov 17 01:19:38 user nova-compute[75226]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:801ff813-83ea-4d9e-a8d2-ed4146b22b52 (non-flash)
Nov 17 01:19:38 user nova-compute[75226]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae (non-flash)
Nov 17 01:19:38 user nova-compute[75226]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1 (non-flash)
Nov 17 01:19:38 user nova-compute[75226]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6 (non-flash)
Nov 17 01:19:38 user nova-compute[75226]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642eafe0-08e5-4d34-a949-c1704d63b132 (non-flash)
Nov 17 01:19:38 user nova-compute[75226]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95 (non-flash)
Nov 17 01:19:38 user nova-compute[75226]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18d60c48-77ba-445e-93c7-aa275249c5c2 (non-flash)
Nov 17 01:19:38 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:19:38 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-d604bed7-9a2f-4e13-ae55-2032c5e511fd tempest-VolumesAssistedSnapshotsTest-526759134 tempest-VolumesAssistedSnapshotsTest-526759134-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:356ef305-2a5c-4df3-93ce-51a994422e0b (non-flash)
Nov 17 01:19:38 user nova-compute[75226]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e860a72-9a6d-4889-8210-beafd1f879c7 (non-flash)
Nov 17 01:19:38 user nova-compute[75226]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:801ff813-83ea-4d9e-a8d2-ed4146b22b52 (non-flash)
Nov 17 01:19:38 user nova-compute[75226]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae (non-flash)
Nov 17 01:19:38 user nova-compute[75226]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1 (non-flash)
Nov 17 01:19:38 user nova-compute[75226]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6 (non-flash)
Nov 17 01:19:38 user nova-compute[75226]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642eafe0-08e5-4d34-a949-c1704d63b132 (non-flash)
Nov 17 01:19:38 user nova-compute[75226]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95 (non-flash)
Nov 17 01:19:38 user nova-compute[75226]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18d60c48-77ba-445e-93c7-aa275249c5c2 (non-flash)
Nov 17 01:19:38 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:19:38 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-d604bed7-9a2f-4e13-ae55-2032c5e511fd tempest-VolumesAssistedSnapshotsTest-526759134 tempest-VolumesAssistedSnapshotsTest-526759134-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:801ff813-83ea-4d9e-a8d2-ed4146b22b52" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.423s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:19:38 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-d604bed7-9a2f-4e13-ae55-2032c5e511fd tempest-VolumesAssistedSnapshotsTest-526759134 tempest-VolumesAssistedSnapshotsTest-526759134-project-admin] Connected to 172.16.0.220:3260 {{(pid=75226) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 17 01:19:38 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-d604bed7-9a2f-4e13-ae55-2032c5e511fd tempest-VolumesAssistedSnapshotsTest-526759134 tempest-VolumesAssistedSnapshotsTest-526759134-project-admin] HCTL ('41', '-', '-', 0) found on session 12 with lun 0 {{(pid=75226) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 17 01:19:38 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-d604bed7-9a2f-4e13-ae55-2032c5e511fd tempest-VolumesAssistedSnapshotsTest-526759134 tempest-VolumesAssistedSnapshotsTest-526759134-project-admin] Scanning host 41 c: -, t: -, l: 0) {{(pid=75226) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 17 01:19:38 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:38 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:38 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[87a49bca-3059-4561-a8f5-2bb81d4b225e]: (4, ('- - 0', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:38 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-d604bed7-9a2f-4e13-ae55-2032c5e511fd tempest-VolumesAssistedSnapshotsTest-526759134 tempest-VolumesAssistedSnapshotsTest-526759134-project-admin] Searching for a device in session 12 and hctl ['41', '*', '*', 0] yield: None {{(pid=75226) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 01:19:38 user nova-compute[75226]: DEBUG nova.virt.libvirt.guest [None req-e7b546ed-d589-4ccf-8032-7d47724e65a0 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] COPY block job progress, current cursor: 399507456 final cursor: 1073741824 {{(pid=75226) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 17 01:19:39 user nova-compute[75226]: DEBUG nova.virt.libvirt.guest [None req-e7b546ed-d589-4ccf-8032-7d47724e65a0 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] COPY block job progress, current cursor: 546308096 final cursor: 1073741824 {{(pid=75226) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 17 01:19:39 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-d604bed7-9a2f-4e13-ae55-2032c5e511fd tempest-VolumesAssistedSnapshotsTest-526759134 tempest-VolumesAssistedSnapshotsTest-526759134-project-admin] Searching for a device in session 12 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=75226) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 01:19:39 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-d604bed7-9a2f-4e13-ae55-2032c5e511fd tempest-VolumesAssistedSnapshotsTest-526759134 tempest-VolumesAssistedSnapshotsTest-526759134-project-admin] Connected to sdj using {'target_iqn': 'iqn.2010-10.org.openstack:801ff813-83ea-4d9e-a8d2-ed4146b22b52', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hRtbMogC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75226) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 17 01:19:39 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-d604bed7-9a2f-4e13-ae55-2032c5e511fd tempest-VolumesAssistedSnapshotsTest-526759134 tempest-VolumesAssistedSnapshotsTest-526759134-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.459s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:19:39 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-d604bed7-9a2f-4e13-ae55-2032c5e511fd tempest-VolumesAssistedSnapshotsTest-526759134 tempest-VolumesAssistedSnapshotsTest-526759134-project-admin] <== connect_volume: return (1460ms) {'type': 'block', 'scsi_wwn': '23866343333666166', 'path': '/dev/sdj'} {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:19:39 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d604bed7-9a2f-4e13-ae55-2032c5e511fd tempest-VolumesAssistedSnapshotsTest-526759134 tempest-VolumesAssistedSnapshotsTest-526759134-project-admin] [instance: 1c505f8d-09e0-41bc-ba3a-89bde1646613] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23866343333666166', 'path': '/dev/sdj'} {{(pid=75226) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 17 01:19:39 user nova-compute[75226]: DEBUG nova.objects.instance [None req-d604bed7-9a2f-4e13-ae55-2032c5e511fd tempest-VolumesAssistedSnapshotsTest-526759134 tempest-VolumesAssistedSnapshotsTest-526759134-project-admin] Lazy-loading 'flavor' on Instance uuid 1c505f8d-09e0-41bc-ba3a-89bde1646613 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:19:39 user nova-compute[75226]: DEBUG nova.virt.libvirt.guest [None req-d604bed7-9a2f-4e13-ae55-2032c5e511fd tempest-VolumesAssistedSnapshotsTest-526759134 tempest-VolumesAssistedSnapshotsTest-526759134-project-admin] attach device xml: <disk type="block" device="disk">
Nov 17 01:19:39 user nova-compute[75226]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 01:19:39 user nova-compute[75226]:   <source dev="/dev/sdj"/>
Nov 17 01:19:39 user nova-compute[75226]:   <target dev="vdb" bus="virtio"/>
Nov 17 01:19:39 user nova-compute[75226]:   <serial>801ff813-83ea-4d9e-a8d2-ed4146b22b52</serial>
Nov 17 01:19:39 user nova-compute[75226]: </disk>
Nov 17 01:19:39 user nova-compute[75226]:  {{(pid=75226) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 17 01:19:39 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:19:39 user nova-compute[75226]: DEBUG nova.virt.libvirt.guest [None req-e7b546ed-d589-4ccf-8032-7d47724e65a0 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] COPY block job progress, current cursor: 718274560 final cursor: 1073741824 {{(pid=75226) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 17 01:19:39 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-d604bed7-9a2f-4e13-ae55-2032c5e511fd tempest-VolumesAssistedSnapshotsTest-526759134 tempest-VolumesAssistedSnapshotsTest-526759134-project-admin] No BDM found with device name vda, not building metadata. {{(pid=75226) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 01:19:39 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-d604bed7-9a2f-4e13-ae55-2032c5e511fd tempest-VolumesAssistedSnapshotsTest-526759134 tempest-VolumesAssistedSnapshotsTest-526759134-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=75226) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 01:19:39 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-d604bed7-9a2f-4e13-ae55-2032c5e511fd tempest-VolumesAssistedSnapshotsTest-526759134 tempest-VolumesAssistedSnapshotsTest-526759134-project-admin] No VIF found with MAC fa:16:3e:63:16:60, not building metadata {{(pid=75226) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 01:19:40 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-d604bed7-9a2f-4e13-ae55-2032c5e511fd tempest-VolumesAssistedSnapshotsTest-526759134 tempest-VolumesAssistedSnapshotsTest-526759134-project-admin] Lock "1c505f8d-09e0-41bc-ba3a-89bde1646613" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.220s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:19:40 user nova-compute[75226]: DEBUG nova.virt.libvirt.guest [None req-e7b546ed-d589-4ccf-8032-7d47724e65a0 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] COPY block job progress, current cursor: 865075200 final cursor: 1073741824 {{(pid=75226) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 17 01:19:40 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-3b7353d9-367e-4a28-b9d7-14ff0032faa7 tempest-VolumesAssistedSnapshotsTest-2085746719 tempest-VolumesAssistedSnapshotsTest-2085746719-project] [instance: 1c505f8d-09e0-41bc-ba3a-89bde1646613] volume_snapshot_create: create_info: {'snapshot_id': '5d138f0f-b291-47e0-a3a9-34c88aaf9e1a', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=75226) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3576}}
Nov 17 01:19:40 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-3b7353d9-367e-4a28-b9d7-14ff0032faa7 tempest-VolumesAssistedSnapshotsTest-2085746719 tempest-VolumesAssistedSnapshotsTest-2085746719-project] [instance: 1c505f8d-09e0-41bc-ba3a-89bde1646613] snap xml: <domainsnapshot>
Nov 17 01:19:40 user nova-compute[75226]:   <disks>
Nov 17 01:19:40 user nova-compute[75226]:     <disk name="/dev/sdj" snapshot="external" type="file">
Nov 17 01:19:40 user nova-compute[75226]:       <source file="/dev/new_file"/>
Nov 17 01:19:40 user nova-compute[75226]:     </disk>
Nov 17 01:19:40 user nova-compute[75226]:     <disk name="vda" snapshot="no"/>
Nov 17 01:19:40 user nova-compute[75226]:   </disks>
Nov 17 01:19:40 user nova-compute[75226]: </domainsnapshot>
Nov 17 01:19:40 user nova-compute[75226]:  {{(pid=75226) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3517}}
Nov 17 01:19:40 user nova-compute[75226]: DEBUG nova.objects.instance [None req-3b7353d9-367e-4a28-b9d7-14ff0032faa7 tempest-VolumesAssistedSnapshotsTest-2085746719 tempest-VolumesAssistedSnapshotsTest-2085746719-project] Lazy-loading 'system_metadata' on Instance uuid 1c505f8d-09e0-41bc-ba3a-89bde1646613 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:19:40 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-3b7353d9-367e-4a28-b9d7-14ff0032faa7 tempest-VolumesAssistedSnapshotsTest-2085746719 tempest-VolumesAssistedSnapshotsTest-2085746719-project] [instance: 1c505f8d-09e0-41bc-ba3a-89bde1646613] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver [None req-3b7353d9-367e-4a28-b9d7-14ff0032faa7 tempest-VolumesAssistedSnapshotsTest-2085746719 tempest-VolumesAssistedSnapshotsTest-2085746719-project] [instance: 1c505f8d-09e0-41bc-ba3a-89bde1646613] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver [instance: 1c505f8d-09e0-41bc-ba3a-89bde1646613] Traceback (most recent call last):
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver [instance: 1c505f8d-09e0-41bc-ba3a-89bde1646613]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver [instance: 1c505f8d-09e0-41bc-ba3a-89bde1646613]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver [instance: 1c505f8d-09e0-41bc-ba3a-89bde1646613]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver [instance: 1c505f8d-09e0-41bc-ba3a-89bde1646613]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver [instance: 1c505f8d-09e0-41bc-ba3a-89bde1646613]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver [instance: 1c505f8d-09e0-41bc-ba3a-89bde1646613]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver [instance: 1c505f8d-09e0-41bc-ba3a-89bde1646613]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver [instance: 1c505f8d-09e0-41bc-ba3a-89bde1646613]     rv = execute(f, *args, **kwargs)
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver [instance: 1c505f8d-09e0-41bc-ba3a-89bde1646613]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver [instance: 1c505f8d-09e0-41bc-ba3a-89bde1646613]     six.reraise(c, e, tb)
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver [instance: 1c505f8d-09e0-41bc-ba3a-89bde1646613]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver [instance: 1c505f8d-09e0-41bc-ba3a-89bde1646613]     raise value
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver [instance: 1c505f8d-09e0-41bc-ba3a-89bde1646613]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver [instance: 1c505f8d-09e0-41bc-ba3a-89bde1646613]     rv = meth(*args, **kwargs)
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver [instance: 1c505f8d-09e0-41bc-ba3a-89bde1646613]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver [instance: 1c505f8d-09e0-41bc-ba3a-89bde1646613]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver [instance: 1c505f8d-09e0-41bc-ba3a-89bde1646613] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver [instance: 1c505f8d-09e0-41bc-ba3a-89bde1646613] 
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver [None req-3b7353d9-367e-4a28-b9d7-14ff0032faa7 tempest-VolumesAssistedSnapshotsTest-2085746719 tempest-VolumesAssistedSnapshotsTest-2085746719-project] [instance: 1c505f8d-09e0-41bc-ba3a-89bde1646613] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver [instance: 1c505f8d-09e0-41bc-ba3a-89bde1646613] Traceback (most recent call last):
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver [instance: 1c505f8d-09e0-41bc-ba3a-89bde1646613]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver [instance: 1c505f8d-09e0-41bc-ba3a-89bde1646613]     self._volume_snapshot_create(context, instance, guest,
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver [instance: 1c505f8d-09e0-41bc-ba3a-89bde1646613]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver [instance: 1c505f8d-09e0-41bc-ba3a-89bde1646613]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver [instance: 1c505f8d-09e0-41bc-ba3a-89bde1646613]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver [instance: 1c505f8d-09e0-41bc-ba3a-89bde1646613]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver [instance: 1c505f8d-09e0-41bc-ba3a-89bde1646613]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver [instance: 1c505f8d-09e0-41bc-ba3a-89bde1646613]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver [instance: 1c505f8d-09e0-41bc-ba3a-89bde1646613]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver [instance: 1c505f8d-09e0-41bc-ba3a-89bde1646613]     rv = execute(f, *args, **kwargs)
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver [instance: 1c505f8d-09e0-41bc-ba3a-89bde1646613]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver [instance: 1c505f8d-09e0-41bc-ba3a-89bde1646613]     six.reraise(c, e, tb)
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver [instance: 1c505f8d-09e0-41bc-ba3a-89bde1646613]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver [instance: 1c505f8d-09e0-41bc-ba3a-89bde1646613]     raise value
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver [instance: 1c505f8d-09e0-41bc-ba3a-89bde1646613]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver [instance: 1c505f8d-09e0-41bc-ba3a-89bde1646613]     rv = meth(*args, **kwargs)
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver [instance: 1c505f8d-09e0-41bc-ba3a-89bde1646613]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver [instance: 1c505f8d-09e0-41bc-ba3a-89bde1646613]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver [instance: 1c505f8d-09e0-41bc-ba3a-89bde1646613] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver [instance: 1c505f8d-09e0-41bc-ba3a-89bde1646613] 
Nov 17 01:19:40 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-d2977e71-631d-4a4c-b5ee-64dba1754445 tempest-VolumesAssistedSnapshotsTest-2085746719 tempest-VolumesAssistedSnapshotsTest-2085746719-project] [instance: 1c505f8d-09e0-41bc-ba3a-89bde1646613] volume_snapshot_delete: delete_info: {'volume_id': '801ff813-83ea-4d9e-a8d2-ed4146b22b52'} {{(pid=75226) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3677}}
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver [None req-d2977e71-631d-4a4c-b5ee-64dba1754445 tempest-VolumesAssistedSnapshotsTest-2085746719 tempest-VolumesAssistedSnapshotsTest-2085746719-project] [instance: 1c505f8d-09e0-41bc-ba3a-89bde1646613] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver [instance: 1c505f8d-09e0-41bc-ba3a-89bde1646613] Traceback (most recent call last):
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver [instance: 1c505f8d-09e0-41bc-ba3a-89bde1646613]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver [instance: 1c505f8d-09e0-41bc-ba3a-89bde1646613]     self._volume_snapshot_delete(context, instance, volume_id,
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver [instance: 1c505f8d-09e0-41bc-ba3a-89bde1646613]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver [instance: 1c505f8d-09e0-41bc-ba3a-89bde1646613]     if delete_info['type'] != 'qcow2':
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver [instance: 1c505f8d-09e0-41bc-ba3a-89bde1646613] KeyError: 'type'
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver [instance: 1c505f8d-09e0-41bc-ba3a-89bde1646613] 
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver [None req-3b7353d9-367e-4a28-b9d7-14ff0032faa7 tempest-VolumesAssistedSnapshotsTest-2085746719 tempest-VolumesAssistedSnapshotsTest-2085746719-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot 5d138f0f-b291-47e0-a3a9-34c88aaf9e1a could not be found.
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver     raise value
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver 
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver 
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot 5d138f0f-b291-47e0-a3a9-34c88aaf9e1a could not be found. (HTTP 404) (Request-ID: req-b3c6b807-e719-44c8-90ce-42fe38bbbfe7)
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver 
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver 
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot 5d138f0f-b291-47e0-a3a9-34c88aaf9e1a could not be found.
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver 
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver [None req-d2977e71-631d-4a4c-b5ee-64dba1754445 tempest-VolumesAssistedSnapshotsTest-2085746719 tempest-VolumesAssistedSnapshotsTest-2085746719-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver 
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver 
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-a6006bcd-6ae9-4dff-932f-c64174322340)
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver 
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver 
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 17 01:19:40 user nova-compute[75226]: ERROR nova.virt.libvirt.driver 
Nov 17 01:19:40 user nova-compute[75226]: ERROR oslo_messaging.rpc.server [None req-3b7353d9-367e-4a28-b9d7-14ff0032faa7 tempest-VolumesAssistedSnapshotsTest-2085746719 tempest-VolumesAssistedSnapshotsTest-2085746719-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 17 01:19:40 user nova-compute[75226]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 17 01:19:40 user nova-compute[75226]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 17 01:19:40 user nova-compute[75226]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 17 01:19:40 user nova-compute[75226]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 17 01:19:40 user nova-compute[75226]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 17 01:19:40 user nova-compute[75226]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 17 01:19:40 user nova-compute[75226]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 17 01:19:40 user nova-compute[75226]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 17 01:19:40 user nova-compute[75226]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 17 01:19:40 user nova-compute[75226]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 17 01:19:40 user nova-compute[75226]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 17 01:19:40 user nova-compute[75226]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 17 01:19:40 user nova-compute[75226]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 17 01:19:40 user nova-compute[75226]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 17 01:19:40 user nova-compute[75226]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 17 01:19:40 user nova-compute[75226]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 17 01:19:40 user nova-compute[75226]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 17 01:19:40 user nova-compute[75226]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4505, in volume_snapshot_create
Nov 17 01:19:40 user nova-compute[75226]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Nov 17 01:19:40 user nova-compute[75226]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3597, in volume_snapshot_create
Nov 17 01:19:40 user nova-compute[75226]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 17 01:19:40 user nova-compute[75226]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 17 01:19:40 user nova-compute[75226]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 17 01:19:40 user nova-compute[75226]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 17 01:19:40 user nova-compute[75226]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 17 01:19:40 user nova-compute[75226]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 17 01:19:40 user nova-compute[75226]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Nov 17 01:19:40 user nova-compute[75226]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 17 01:19:40 user nova-compute[75226]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 17 01:19:40 user nova-compute[75226]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 17 01:19:40 user nova-compute[75226]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 17 01:19:40 user nova-compute[75226]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 17 01:19:40 user nova-compute[75226]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 17 01:19:40 user nova-compute[75226]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 17 01:19:40 user nova-compute[75226]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Nov 17 01:19:40 user nova-compute[75226]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 17 01:19:40 user nova-compute[75226]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Nov 17 01:19:40 user nova-compute[75226]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 17 01:19:40 user nova-compute[75226]: ERROR oslo_messaging.rpc.server     raise value
Nov 17 01:19:40 user nova-compute[75226]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 17 01:19:40 user nova-compute[75226]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Nov 17 01:19:40 user nova-compute[75226]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 17 01:19:40 user nova-compute[75226]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 17 01:19:40 user nova-compute[75226]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 17 01:19:40 user nova-compute[75226]: ERROR oslo_messaging.rpc.server 
Nov 17 01:19:40 user nova-compute[75226]: ERROR oslo_messaging.rpc.server [None req-d2977e71-631d-4a4c-b5ee-64dba1754445 tempest-VolumesAssistedSnapshotsTest-2085746719 tempest-VolumesAssistedSnapshotsTest-2085746719-project] Exception during message handling: KeyError: 'type'
Nov 17 01:19:40 user nova-compute[75226]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 17 01:19:40 user nova-compute[75226]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 17 01:19:40 user nova-compute[75226]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 17 01:19:40 user nova-compute[75226]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 17 01:19:40 user nova-compute[75226]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 17 01:19:40 user nova-compute[75226]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 17 01:19:40 user nova-compute[75226]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 17 01:19:40 user nova-compute[75226]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 17 01:19:40 user nova-compute[75226]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 17 01:19:40 user nova-compute[75226]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 17 01:19:40 user nova-compute[75226]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 17 01:19:40 user nova-compute[75226]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 17 01:19:40 user nova-compute[75226]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 17 01:19:40 user nova-compute[75226]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 17 01:19:40 user nova-compute[75226]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 17 01:19:40 user nova-compute[75226]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 17 01:19:40 user nova-compute[75226]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 17 01:19:40 user nova-compute[75226]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4517, in volume_snapshot_delete
Nov 17 01:19:40 user nova-compute[75226]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Nov 17 01:19:40 user nova-compute[75226]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3853, in volume_snapshot_delete
Nov 17 01:19:40 user nova-compute[75226]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 17 01:19:40 user nova-compute[75226]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 17 01:19:40 user nova-compute[75226]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 17 01:19:40 user nova-compute[75226]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 17 01:19:40 user nova-compute[75226]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 17 01:19:40 user nova-compute[75226]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 17 01:19:40 user nova-compute[75226]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Nov 17 01:19:40 user nova-compute[75226]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 17 01:19:40 user nova-compute[75226]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Nov 17 01:19:40 user nova-compute[75226]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Nov 17 01:19:40 user nova-compute[75226]: ERROR oslo_messaging.rpc.server 
Nov 17 01:19:40 user nova-compute[75226]: DEBUG nova.virt.libvirt.guest [None req-e7b546ed-d589-4ccf-8032-7d47724e65a0 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] COPY block job progress, current cursor: 1004535808 final cursor: 1073741824 {{(pid=75226) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 17 01:19:40 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e720d526-c0fa-4537-8d1b-f93df9f76fc1 tempest-VolumesAssistedSnapshotsTest-526759134 tempest-VolumesAssistedSnapshotsTest-526759134-project-admin] Acquiring lock "1c505f8d-09e0-41bc-ba3a-89bde1646613" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:19:40 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e720d526-c0fa-4537-8d1b-f93df9f76fc1 tempest-VolumesAssistedSnapshotsTest-526759134 tempest-VolumesAssistedSnapshotsTest-526759134-project-admin] Lock "1c505f8d-09e0-41bc-ba3a-89bde1646613" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:19:40 user nova-compute[75226]: INFO nova.compute.manager [None req-e720d526-c0fa-4537-8d1b-f93df9f76fc1 tempest-VolumesAssistedSnapshotsTest-526759134 tempest-VolumesAssistedSnapshotsTest-526759134-project-admin] [instance: 1c505f8d-09e0-41bc-ba3a-89bde1646613] Detaching volume 801ff813-83ea-4d9e-a8d2-ed4146b22b52
Nov 17 01:19:41 user nova-compute[75226]: INFO nova.virt.block_device [None req-e720d526-c0fa-4537-8d1b-f93df9f76fc1 tempest-VolumesAssistedSnapshotsTest-526759134 tempest-VolumesAssistedSnapshotsTest-526759134-project-admin] [instance: 1c505f8d-09e0-41bc-ba3a-89bde1646613] Attempting to driver detach volume 801ff813-83ea-4d9e-a8d2-ed4146b22b52 from mountpoint /dev/vdb
Nov 17 01:19:41 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-e720d526-c0fa-4537-8d1b-f93df9f76fc1 tempest-VolumesAssistedSnapshotsTest-526759134 tempest-VolumesAssistedSnapshotsTest-526759134-project-admin] Attempting to detach device vdb from instance 1c505f8d-09e0-41bc-ba3a-89bde1646613 from the persistent domain config. {{(pid=75226) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 17 01:19:41 user nova-compute[75226]: DEBUG nova.virt.libvirt.guest [None req-e720d526-c0fa-4537-8d1b-f93df9f76fc1 tempest-VolumesAssistedSnapshotsTest-526759134 tempest-VolumesAssistedSnapshotsTest-526759134-project-admin] detach device xml: <disk type="block" device="disk">
Nov 17 01:19:41 user nova-compute[75226]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 01:19:41 user nova-compute[75226]:   <source dev="/dev/sdj"/>
Nov 17 01:19:41 user nova-compute[75226]:   <target dev="vdb" bus="virtio"/>
Nov 17 01:19:41 user nova-compute[75226]:   <serial>801ff813-83ea-4d9e-a8d2-ed4146b22b52</serial>
Nov 17 01:19:41 user nova-compute[75226]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 17 01:19:41 user nova-compute[75226]: </disk>
Nov 17 01:19:41 user nova-compute[75226]:  {{(pid=75226) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 17 01:19:41 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-e720d526-c0fa-4537-8d1b-f93df9f76fc1 tempest-VolumesAssistedSnapshotsTest-526759134 tempest-VolumesAssistedSnapshotsTest-526759134-project-admin] Successfully detached device vdb from instance 1c505f8d-09e0-41bc-ba3a-89bde1646613 from the persistent domain config.
Nov 17 01:19:41 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-e720d526-c0fa-4537-8d1b-f93df9f76fc1 tempest-VolumesAssistedSnapshotsTest-526759134 tempest-VolumesAssistedSnapshotsTest-526759134-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1c505f8d-09e0-41bc-ba3a-89bde1646613 from the live domain config. {{(pid=75226) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 17 01:19:41 user nova-compute[75226]: DEBUG nova.virt.libvirt.guest [None req-e720d526-c0fa-4537-8d1b-f93df9f76fc1 tempest-VolumesAssistedSnapshotsTest-526759134 tempest-VolumesAssistedSnapshotsTest-526759134-project-admin] detach device xml: <disk type="block" device="disk">
Nov 17 01:19:41 user nova-compute[75226]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 01:19:41 user nova-compute[75226]:   <source dev="/dev/sdj"/>
Nov 17 01:19:41 user nova-compute[75226]:   <target dev="vdb" bus="virtio"/>
Nov 17 01:19:41 user nova-compute[75226]:   <serial>801ff813-83ea-4d9e-a8d2-ed4146b22b52</serial>
Nov 17 01:19:41 user nova-compute[75226]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 17 01:19:41 user nova-compute[75226]: </disk>
Nov 17 01:19:41 user nova-compute[75226]:  {{(pid=75226) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 17 01:19:41 user nova-compute[75226]: DEBUG nova.virt.libvirt.guest [None req-e7b546ed-d589-4ccf-8032-7d47724e65a0 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=75226) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 17 01:19:41 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-e720d526-c0fa-4537-8d1b-f93df9f76fc1 tempest-VolumesAssistedSnapshotsTest-526759134 tempest-VolumesAssistedSnapshotsTest-526759134-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1c505f8d-09e0-41bc-ba3a-89bde1646613 {{(pid=75226) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 17 01:19:41 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7b546ed-d589-4ccf-8032-7d47724e65a0 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] [instance: 75b1cabe-ba15-4851-9140-5949afc33005] calling os-brick to detach iSCSI Volume {{(pid=75226) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 17 01:19:41 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7b546ed-d589-4ccf-8032-7d47724e65a0 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc4cc36b490>, {'target_iqn': 'iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OsjHbnIp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:19:41 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-e7b546ed-d589-4ccf-8032-7d47724e65a0 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:19:41 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-e7b546ed-d589-4ccf-8032-7d47724e65a0 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:19:41 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-e7b546ed-d589-4ccf-8032-7d47724e65a0 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:19:41 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:41 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:41 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc61360c-46f4-4626-8e1b-13fbea84162b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:356ef305-2a5c-4df3-93ce-51a994422e0b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:801ff813-83ea-4d9e-a8d2-ed4146b22b52\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0e860a72-9a6d-4889-8210-beafd1f879c7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:18d60c48-77ba-445e-93c7-aa275249c5c2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:642eafe0-08e5-4d34-a949-c1704d63b132\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:41 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7b546ed-d589-4ccf-8032-7d47724e65a0 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 17 01:19:41 user nova-compute[75226]: No targets found.
Nov 17 01:19:41 user nova-compute[75226]: iSNS:
Nov 17 01:19:41 user nova-compute[75226]: No targets found.
Nov 17 01:19:41 user nova-compute[75226]: STATIC:
Nov 17 01:19:41 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:356ef305-2a5c-4df3-93ce-51a994422e0b
Nov 17 01:19:41 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:19:41 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:19:41 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:801ff813-83ea-4d9e-a8d2-ed4146b22b52
Nov 17 01:19:41 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:19:41 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:19:41 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:0e860a72-9a6d-4889-8210-beafd1f879c7
Nov 17 01:19:41 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:19:41 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:19:41 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:18d60c48-77ba-445e-93c7-aa275249c5c2
Nov 17 01:19:41 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:19:41 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:19:41 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae
Nov 17 01:19:41 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:19:41 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:19:41 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1
Nov 17 01:19:41 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:19:41 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:19:41 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:642eafe0-08e5-4d34-a949-c1704d63b132
Nov 17 01:19:41 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:19:41 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:19:41 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95
Nov 17 01:19:41 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:19:41 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:19:41 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6
Nov 17 01:19:41 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:19:41 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:19:41 user nova-compute[75226]: FIRMWARE:
Nov 17 01:19:41 user nova-compute[75226]: No targets found.
Nov 17 01:19:41 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:19:41 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7b546ed-d589-4ccf-8032-7d47724e65a0 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 17 01:19:41 user nova-compute[75226]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 17 01:19:41 user nova-compute[75226]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75226) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 17 01:19:41 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7b546ed-d589-4ccf-8032-7d47724e65a0 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95', 0)] {{(pid=75226) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 17 01:19:41 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:41 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:41 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[a51b4f89-7cf0-4a28-b093-b8c9f900cbb9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0e860a72-9a6d-4889-8210-beafd1f879c7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:18d60c48-77ba-445e-93c7-aa275249c5c2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:356ef305-2a5c-4df3-93ce-51a994422e0b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:642eafe0-08e5-4d34-a949-c1704d63b132\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:801ff813-83ea-4d9e-a8d2-ed4146b22b52\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:41 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:41 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:41 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8b06f0c-7f7b-4e30-a538-b11f931f7412]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:356ef305-2a5c-4df3-93ce-51a994422e0b (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e860a72-9a6d-4889-8210-beafd1f879c7 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:801ff813-83ea-4d9e-a8d2-ed4146b22b52 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642eafe0-08e5-4d34-a949-c1704d63b132 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18d60c48-77ba-445e-93c7-aa275249c5c2 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:41 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7b546ed-d589-4ccf-8032-7d47724e65a0 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:356ef305-2a5c-4df3-93ce-51a994422e0b (non-flash)
Nov 17 01:19:41 user nova-compute[75226]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e860a72-9a6d-4889-8210-beafd1f879c7 (non-flash)
Nov 17 01:19:41 user nova-compute[75226]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:801ff813-83ea-4d9e-a8d2-ed4146b22b52 (non-flash)
Nov 17 01:19:41 user nova-compute[75226]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae (non-flash)
Nov 17 01:19:41 user nova-compute[75226]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1 (non-flash)
Nov 17 01:19:41 user nova-compute[75226]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6 (non-flash)
Nov 17 01:19:41 user nova-compute[75226]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642eafe0-08e5-4d34-a949-c1704d63b132 (non-flash)
Nov 17 01:19:41 user nova-compute[75226]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95 (non-flash)
Nov 17 01:19:41 user nova-compute[75226]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18d60c48-77ba-445e-93c7-aa275249c5c2 (non-flash)
Nov 17 01:19:41 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:19:41 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7b546ed-d589-4ccf-8032-7d47724e65a0 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:356ef305-2a5c-4df3-93ce-51a994422e0b (non-flash)
Nov 17 01:19:41 user nova-compute[75226]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e860a72-9a6d-4889-8210-beafd1f879c7 (non-flash)
Nov 17 01:19:41 user nova-compute[75226]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:801ff813-83ea-4d9e-a8d2-ed4146b22b52 (non-flash)
Nov 17 01:19:41 user nova-compute[75226]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae (non-flash)
Nov 17 01:19:41 user nova-compute[75226]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1 (non-flash)
Nov 17 01:19:41 user nova-compute[75226]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6 (non-flash)
Nov 17 01:19:41 user nova-compute[75226]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642eafe0-08e5-4d34-a949-c1704d63b132 (non-flash)
Nov 17 01:19:41 user nova-compute[75226]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95 (non-flash)
Nov 17 01:19:41 user nova-compute[75226]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18d60c48-77ba-445e-93c7-aa275249c5c2 (non-flash)
Nov 17 01:19:41 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:19:41 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7b546ed-d589-4ccf-8032-7d47724e65a0 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc4b4382c20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95'): ({'sdg'}, set())}) {{(pid=75226) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 17 01:19:41 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-e7b546ed-d589-4ccf-8032-7d47724e65a0 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] Removing single pathed devices sdg {{(pid=75226) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 17 01:19:41 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:41 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:41 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b391070-6cf5-4b07-b743-c5535e6231af]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:41 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:41 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.024s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:41 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[874c6319-5616-4140-938b-57e6f92f7db2]: (4, ('ok\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:41 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-e7b546ed-d589-4ccf-8032-7d47724e65a0 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] Flushing IO for device /dev/sdg {{(pid=75226) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 17 01:19:41 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:41 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.014s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:41 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0064901-c40f-48c9-9d27-34a1f00c7263]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:41 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-e7b546ed-d589-4ccf-8032-7d47724e65a0 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75226) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 17 01:19:41 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:41 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.032s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:41 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[42e0b14e-e042-4031-8e0f-001ffac7a559]: (4, ('1', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:41 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-e7b546ed-d589-4ccf-8032-7d47724e65a0 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] Checking to see if SCSI volumes sdg have been removed. {{(pid=75226) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 17 01:19:41 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-e7b546ed-d589-4ccf-8032-7d47724e65a0 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] SCSI volumes sdg have been removed. {{(pid=75226) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 17 01:19:41 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7b546ed-d589-4ccf-8032-7d47724e65a0 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95')] {{(pid=75226) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 17 01:19:41 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:41 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:41 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecd39f6c-f4c5-47a8-a049-347381de4080]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:41 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7b546ed-d589-4ccf-8032-7d47724e65a0 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:19:41 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95 -p 172.16.0.220:3260 --logout {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:41 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:41 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e4cbdc3-5690-4a42-8ef4-3330bfb1ccd9]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:41 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7b546ed-d589-4ccf-8032-7d47724e65a0 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95, portal: 172.16.0.220,3260]
Nov 17 01:19:41 user nova-compute[75226]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95, portal: 172.16.0.220,3260] successful.
Nov 17 01:19:41 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:19:41 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95 -p 172.16.0.220:3260 --op delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:41 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:41 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[16a50def-2102-4c01-9959-a97095f815c4]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:41 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7b546ed-d589-4ccf-8032-7d47724e65a0 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:19:41 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-e7b546ed-d589-4ccf-8032-7d47724e65a0 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:19:41 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7b546ed-d589-4ccf-8032-7d47724e65a0 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] <== disconnect_volume: return (326ms) None {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:19:41 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7b546ed-d589-4ccf-8032-7d47724e65a0 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] [instance: 75b1cabe-ba15-4851-9140-5949afc33005] Disconnected iSCSI Volume {{(pid=75226) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 17 01:19:41 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e7b546ed-d589-4ccf-8032-7d47724e65a0 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0e860a72-9a6d-4889-8210-beafd1f879c7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CQNvTtKG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '75b1cabe-ba15-4851-9140-5949afc33005', 'attached_at': '', 'detached_at': '', 'volume_id': '0e860a72-9a6d-4889-8210-beafd1f879c7', 'serial'} {{(pid=75226) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 17 01:19:41 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e7b546ed-d589-4ccf-8032-7d47724e65a0 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] [instance: 75b1cabe-ba15-4851-9140-5949afc33005] swap_volume: removing Cinder connection for volume ac3239e4-20ce-43ca-84b3-f5f0a5ffff95 {{(pid=75226) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 17 01:19:42 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:19:42 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e7b546ed-d589-4ccf-8032-7d47724e65a0 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] [instance: 75b1cabe-ba15-4851-9140-5949afc33005] swap_volume: Updating volume ac3239e4-20ce-43ca-84b3-f5f0a5ffff95 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:0e860a72-9a6d-4889-8210-beafd1f879c7", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "CQNvTtKG", "auth_password": "v61cn0SiAuaXZ5", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdb", "volume_id": "0e860a72-9a6d-4889-8210-beafd1f879c7"}, "status": "reserved", "instance": "75b1cabe-ba15-4851-9140-5949afc33005", "attached_at": "", "detached_at": "", "volume_id": "0e860a72-9a6d-4889-8210-beafd1f879c7", "serial": "0e860a72-9a6d-4889-8210-beafd1f879c7"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '0e860a72-9a6d-4889-8210-beafd1f879c7', 'no_device': None, 'attachment_id': '5cf7a000-67a0-47fd-83c4-0e294eb815ca'} {{(pid=75226) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 17 01:19:42 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e7b546ed-d589-4ccf-8032-7d47724e65a0 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] Lock "75b1cabe-ba15-4851-9140-5949afc33005" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 14.009s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:19:43 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-a3ceb72a-9f51-49f6-9512-80e176adbcd7 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] Acquiring lock "75b1cabe-ba15-4851-9140-5949afc33005" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:19:43 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-a3ceb72a-9f51-49f6-9512-80e176adbcd7 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] Lock "75b1cabe-ba15-4851-9140-5949afc33005" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:19:43 user nova-compute[75226]: DEBUG os_brick.utils [None req-a3ceb72a-9f51-49f6-9512-80e176adbcd7 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:19:43 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:43 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:43 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbf06132-fb0a-4574-9e41-2197d7988f20]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f62857db69\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:43 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:43 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:43 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[def01395-0496-41fd-b913-6da489ee0536]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:43 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:43 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:43 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e53747f-fc20-4817-b0b1-6b37111ec145]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:43 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1b5508d-0ddd-4cd5-a00b-2801ea19ed41]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:43 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-a3ceb72a-9f51-49f6-9512-80e176adbcd7 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] Running cmd (subprocess): nvme version {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:43 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-a3ceb72a-9f51-49f6-9512-80e176adbcd7 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 01:19:43 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a3ceb72a-9f51-49f6-9512-80e176adbcd7 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] nvme not present on system {{(pid=75226) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 17 01:19:43 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:43 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 01:19:43 user nova-compute[75226]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 17 01:19:43 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cf5e5a4-85a9-4653-a52e-b94bd9586860]: (4, '') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:43 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-a3ceb72a-9f51-49f6-9512-80e176adbcd7 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75226) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 17 01:19:43 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-a3ceb72a-9f51-49f6-9512-80e176adbcd7 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75226) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 17 01:19:43 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-a3ceb72a-9f51-49f6-9512-80e176adbcd7 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] LIGHTOS: no hostnqn found. {{(pid=75226) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 17 01:19:43 user nova-compute[75226]: DEBUG os_brick.utils [None req-a3ceb72a-9f51-49f6-9512-80e176adbcd7 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f62857db69', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:19:44 user nova-compute[75226]: INFO nova.compute.manager [None req-a3ceb72a-9f51-49f6-9512-80e176adbcd7 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] [instance: 75b1cabe-ba15-4851-9140-5949afc33005] Swapping volume 0e860a72-9a6d-4889-8210-beafd1f879c7 for ac3239e4-20ce-43ca-84b3-f5f0a5ffff95
Nov 17 01:19:44 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:19:47 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:19:48 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-72d762d4-714f-4602-b482-d1768a16c8e0 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 724b81dd-4531-4c99-850d-0bfcbfdf7bd4 is timed out.
Nov 17 01:19:48 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-72d762d4-714f-4602-b482-d1768a16c8e0 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Successfully detached device vdb from instance 724b81dd-4531-4c99-850d-0bfcbfdf7bd4 from the live domain config.
Nov 17 01:19:48 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-72d762d4-714f-4602-b482-d1768a16c8e0 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] [instance: 724b81dd-4531-4c99-850d-0bfcbfdf7bd4] calling os-brick to detach iSCSI Volume {{(pid=75226) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 17 01:19:48 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-72d762d4-714f-4602-b482-d1768a16c8e0 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc4cc36b490>, {'target_iqn': 'iqn.2010-10.org.openstack:642eafe0-08e5-4d34-a949-c1704d63b132', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iynTxgqj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:19:48 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-72d762d4-714f-4602-b482-d1768a16c8e0 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:19:48 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-72d762d4-714f-4602-b482-d1768a16c8e0 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:19:48 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-72d762d4-714f-4602-b482-d1768a16c8e0 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:19:48 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:48 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:48 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[a379f513-bd55-48d8-a3f4-8134f5e8af4a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:356ef305-2a5c-4df3-93ce-51a994422e0b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:801ff813-83ea-4d9e-a8d2-ed4146b22b52\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0e860a72-9a6d-4889-8210-beafd1f879c7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:18d60c48-77ba-445e-93c7-aa275249c5c2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:642eafe0-08e5-4d34-a949-c1704d63b132\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:48 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-72d762d4-714f-4602-b482-d1768a16c8e0 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 17 01:19:48 user nova-compute[75226]: No targets found.
Nov 17 01:19:48 user nova-compute[75226]: iSNS:
Nov 17 01:19:48 user nova-compute[75226]: No targets found.
Nov 17 01:19:48 user nova-compute[75226]: STATIC:
Nov 17 01:19:48 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:356ef305-2a5c-4df3-93ce-51a994422e0b
Nov 17 01:19:48 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:19:48 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:19:48 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:801ff813-83ea-4d9e-a8d2-ed4146b22b52
Nov 17 01:19:48 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:19:48 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:19:48 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:0e860a72-9a6d-4889-8210-beafd1f879c7
Nov 17 01:19:48 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:19:48 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:19:48 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:18d60c48-77ba-445e-93c7-aa275249c5c2
Nov 17 01:19:48 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:19:48 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:19:48 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae
Nov 17 01:19:48 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:19:48 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:19:48 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1
Nov 17 01:19:48 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:19:48 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:19:48 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:642eafe0-08e5-4d34-a949-c1704d63b132
Nov 17 01:19:48 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:19:48 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:19:48 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2
Nov 17 01:19:48 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:19:48 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:19:48 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6
Nov 17 01:19:48 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:19:48 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:19:48 user nova-compute[75226]: FIRMWARE:
Nov 17 01:19:48 user nova-compute[75226]: No targets found.
Nov 17 01:19:48 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:19:48 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-72d762d4-714f-4602-b482-d1768a16c8e0 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 17 01:19:48 user nova-compute[75226]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 17 01:19:48 user nova-compute[75226]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75226) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 17 01:19:48 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-72d762d4-714f-4602-b482-d1768a16c8e0 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:642eafe0-08e5-4d34-a949-c1704d63b132', 0)] {{(pid=75226) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 17 01:19:48 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:48 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:48 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[02de98b7-c8d3-4e6b-9338-96ce58aa5bdd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0e860a72-9a6d-4889-8210-beafd1f879c7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:18d60c48-77ba-445e-93c7-aa275249c5c2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:356ef305-2a5c-4df3-93ce-51a994422e0b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:642eafe0-08e5-4d34-a949-c1704d63b132\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:801ff813-83ea-4d9e-a8d2-ed4146b22b52\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:48 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:48 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:48 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dd0739d-778d-410a-a728-c92f68123ff2]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:356ef305-2a5c-4df3-93ce-51a994422e0b (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e860a72-9a6d-4889-8210-beafd1f879c7 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:801ff813-83ea-4d9e-a8d2-ed4146b22b52 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642eafe0-08e5-4d34-a949-c1704d63b132 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18d60c48-77ba-445e-93c7-aa275249c5c2 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:48 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-72d762d4-714f-4602-b482-d1768a16c8e0 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:356ef305-2a5c-4df3-93ce-51a994422e0b (non-flash)
Nov 17 01:19:48 user nova-compute[75226]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e860a72-9a6d-4889-8210-beafd1f879c7 (non-flash)
Nov 17 01:19:48 user nova-compute[75226]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:801ff813-83ea-4d9e-a8d2-ed4146b22b52 (non-flash)
Nov 17 01:19:48 user nova-compute[75226]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2 (non-flash)
Nov 17 01:19:48 user nova-compute[75226]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae (non-flash)
Nov 17 01:19:48 user nova-compute[75226]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1 (non-flash)
Nov 17 01:19:48 user nova-compute[75226]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6 (non-flash)
Nov 17 01:19:48 user nova-compute[75226]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642eafe0-08e5-4d34-a949-c1704d63b132 (non-flash)
Nov 17 01:19:48 user nova-compute[75226]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18d60c48-77ba-445e-93c7-aa275249c5c2 (non-flash)
Nov 17 01:19:48 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:19:48 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-72d762d4-714f-4602-b482-d1768a16c8e0 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:356ef305-2a5c-4df3-93ce-51a994422e0b (non-flash)
Nov 17 01:19:48 user nova-compute[75226]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e860a72-9a6d-4889-8210-beafd1f879c7 (non-flash)
Nov 17 01:19:48 user nova-compute[75226]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:801ff813-83ea-4d9e-a8d2-ed4146b22b52 (non-flash)
Nov 17 01:19:48 user nova-compute[75226]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2 (non-flash)
Nov 17 01:19:48 user nova-compute[75226]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae (non-flash)
Nov 17 01:19:48 user nova-compute[75226]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1 (non-flash)
Nov 17 01:19:48 user nova-compute[75226]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6 (non-flash)
Nov 17 01:19:48 user nova-compute[75226]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642eafe0-08e5-4d34-a949-c1704d63b132 (non-flash)
Nov 17 01:19:48 user nova-compute[75226]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18d60c48-77ba-445e-93c7-aa275249c5c2 (non-flash)
Nov 17 01:19:48 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:19:48 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-72d762d4-714f-4602-b482-d1768a16c8e0 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc4b4380e50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:642eafe0-08e5-4d34-a949-c1704d63b132'): ({'sdf'}, set())}) {{(pid=75226) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 17 01:19:48 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-72d762d4-714f-4602-b482-d1768a16c8e0 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Removing single pathed devices sdf {{(pid=75226) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 17 01:19:48 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:48 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:48 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d4d93d2-3616-43bc-9e30-74229fed6f11]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:48 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:48 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:48 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[b87dc333-abfd-4012-bd3f-412a3e06b104]: (4, ('ok\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:48 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-72d762d4-714f-4602-b482-d1768a16c8e0 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Flushing IO for device /dev/sdf {{(pid=75226) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 17 01:19:48 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:48 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.012s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:48 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bb1c3b4-bd93-44d0-8214-e19f54a6bfcd]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:48 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-72d762d4-714f-4602-b482-d1768a16c8e0 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75226) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 17 01:19:48 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:49 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.053s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:49 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f441486-24e9-4fa2-8c13-14645759ba1a]: (4, ('1', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:49 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-72d762d4-714f-4602-b482-d1768a16c8e0 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75226) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 17 01:19:49 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-72d762d4-714f-4602-b482-d1768a16c8e0 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] SCSI volumes sdf have been removed. {{(pid=75226) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 17 01:19:49 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-72d762d4-714f-4602-b482-d1768a16c8e0 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:642eafe0-08e5-4d34-a949-c1704d63b132')] {{(pid=75226) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 17 01:19:49 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:642eafe0-08e5-4d34-a949-c1704d63b132 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:49 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:642eafe0-08e5-4d34-a949-c1704d63b132 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:49 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc864f54-d43c-42fe-bc83-1ab2c4c2d9ef]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:49 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-72d762d4-714f-4602-b482-d1768a16c8e0 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:19:49 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:642eafe0-08e5-4d34-a949-c1704d63b132 -p 172.16.0.220:3260 --logout {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:49 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:642eafe0-08e5-4d34-a949-c1704d63b132 -p 172.16.0.220:3260 --logout" returned: 0 in 0.081s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:49 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[de199920-b95a-4c98-b045-906299b2fdbd]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:642eafe0-08e5-4d34-a949-c1704d63b132, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:642eafe0-08e5-4d34-a949-c1704d63b132, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:49 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-72d762d4-714f-4602-b482-d1768a16c8e0 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:642eafe0-08e5-4d34-a949-c1704d63b132, portal: 172.16.0.220,3260]
Nov 17 01:19:49 user nova-compute[75226]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:642eafe0-08e5-4d34-a949-c1704d63b132, portal: 172.16.0.220,3260] successful.
Nov 17 01:19:49 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:19:49 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:642eafe0-08e5-4d34-a949-c1704d63b132 -p 172.16.0.220:3260 --op delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:49 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:642eafe0-08e5-4d34-a949-c1704d63b132 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:49 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[cae65623-1e03-47b3-808b-de529dc63643]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:49 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-72d762d4-714f-4602-b482-d1768a16c8e0 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:19:49 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-72d762d4-714f-4602-b482-d1768a16c8e0 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.365s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:19:49 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-72d762d4-714f-4602-b482-d1768a16c8e0 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] <== disconnect_volume: return (366ms) None {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:19:49 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-72d762d4-714f-4602-b482-d1768a16c8e0 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] [instance: 724b81dd-4531-4c99-850d-0bfcbfdf7bd4] Disconnected iSCSI Volume {{(pid=75226) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 17 01:19:49 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:19:49 user nova-compute[75226]: DEBUG nova.compute.manager [None req-a3ceb72a-9f51-49f6-9512-80e176adbcd7 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] [instance: 75b1cabe-ba15-4851-9140-5949afc33005] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OsjHbnIp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '75b1cabe-ba15-4851-9140-5949afc33005', 'attached_at': '', 'detached_at': '', 'volume_id': 'ac3239e4-20ce-43ca-84b3-f5f0a5ffff95', 'serial': 'ac3239e4-20ce-43ca-84b3-f5f0a5ffff95'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0e860a72-9a6d-4889-8210-beafd1f879c7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CQNvTtKG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'volume_id': '0e860a72-9a6d-4889-8210-beafd1f879c7'}, 'status': 'reserved', 'instance': '75b1cabe-ba15-4851-9140-5949afc33005', 'attached_at': '', 'detached_at': '', 'volume_id': '0e860a72-9a6d-4889-8210-beafd1f879c7', 'serial'} {{(pid=75226) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 17 01:19:49 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3ceb72a-9f51-49f6-9512-80e176adbcd7 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] [instance: 75b1cabe-ba15-4851-9140-5949afc33005] Calling os-brick to attach iSCSI Volume {{(pid=75226) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 17 01:19:49 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3ceb72a-9f51-49f6-9512-80e176adbcd7 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc4cc36b490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OsjHbnIp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:19:49 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-a3ceb72a-9f51-49f6-9512-80e176adbcd7 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:19:49 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-a3ceb72a-9f51-49f6-9512-80e176adbcd7 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:19:49 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-a3ceb72a-9f51-49f6-9512-80e176adbcd7 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:19:49 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-a3ceb72a-9f51-49f6-9512-80e176adbcd7 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:19:49 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-a3ceb72a-9f51-49f6-9512-80e176adbcd7 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:19:49 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-a3ceb72a-9f51-49f6-9512-80e176adbcd7 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:19:49 user nova-compute[75226]: INFO os_brick.initiator.connectors.iscsi [None req-a3ceb72a-9f51-49f6-9512-80e176adbcd7 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 17 01:19:49 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95 -p 172.16.0.220:3260 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:49 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:49 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[9023a86d-afb4-4448-ae5a-8b03a945405f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:49 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3ceb72a-9f51-49f6-9512-80e176adbcd7 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 17 01:19:49 user nova-compute[75226]:  {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:19:49 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95 -p 172.16.0.220:3260 --interface default --op new {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:49 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:49 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8a7f160-2d07-4c5b-b7ba-f81f55198237]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95] added\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:49 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3ceb72a-9f51-49f6-9512-80e176adbcd7 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95] added
Nov 17 01:19:49 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:19:49 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:49 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:49 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[e505a94a-5163-4631-9a25-337f7b4f6bcf]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:49 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3ceb72a-9f51-49f6-9512-80e176adbcd7 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:19:49 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:49 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:49 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f9c56d5-0688-4f62-929d-ae455ffc2cd5]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:49 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3ceb72a-9f51-49f6-9512-80e176adbcd7 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:19:49 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OsjHbnIp {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:49 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OsjHbnIp" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:49 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca33e750-d72c-4a87-85e7-177113b839c7]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:49 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3ceb72a-9f51-49f6-9512-80e176adbcd7 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OsjHbnIp'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:19:49 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:49 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:49 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c67e17a-5d22-410c-8a09-17a4cc2f9aaa]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:49 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3ceb72a-9f51-49f6-9512-80e176adbcd7 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:19:49 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:49 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:49 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[b03bb2ed-0996-408d-af11-1d8ce017eaf7]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:356ef305-2a5c-4df3-93ce-51a994422e0b (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e860a72-9a6d-4889-8210-beafd1f879c7 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:801ff813-83ea-4d9e-a8d2-ed4146b22b52 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18d60c48-77ba-445e-93c7-aa275249c5c2 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:49 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3ceb72a-9f51-49f6-9512-80e176adbcd7 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:356ef305-2a5c-4df3-93ce-51a994422e0b (non-flash)
Nov 17 01:19:49 user nova-compute[75226]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e860a72-9a6d-4889-8210-beafd1f879c7 (non-flash)
Nov 17 01:19:49 user nova-compute[75226]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:801ff813-83ea-4d9e-a8d2-ed4146b22b52 (non-flash)
Nov 17 01:19:49 user nova-compute[75226]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2 (non-flash)
Nov 17 01:19:49 user nova-compute[75226]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae (non-flash)
Nov 17 01:19:49 user nova-compute[75226]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1 (non-flash)
Nov 17 01:19:49 user nova-compute[75226]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6 (non-flash)
Nov 17 01:19:49 user nova-compute[75226]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18d60c48-77ba-445e-93c7-aa275249c5c2 (non-flash)
Nov 17 01:19:49 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:19:49 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3ceb72a-9f51-49f6-9512-80e176adbcd7 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:356ef305-2a5c-4df3-93ce-51a994422e0b (non-flash)
Nov 17 01:19:49 user nova-compute[75226]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e860a72-9a6d-4889-8210-beafd1f879c7 (non-flash)
Nov 17 01:19:49 user nova-compute[75226]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:801ff813-83ea-4d9e-a8d2-ed4146b22b52 (non-flash)
Nov 17 01:19:49 user nova-compute[75226]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2 (non-flash)
Nov 17 01:19:49 user nova-compute[75226]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae (non-flash)
Nov 17 01:19:49 user nova-compute[75226]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1 (non-flash)
Nov 17 01:19:49 user nova-compute[75226]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6 (non-flash)
Nov 17 01:19:49 user nova-compute[75226]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18d60c48-77ba-445e-93c7-aa275249c5c2 (non-flash)
Nov 17 01:19:49 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:19:49 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95 -p 172.16.0.220:3260 --login {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:50 user nova-compute[75226]: DEBUG nova.objects.instance [None req-72d762d4-714f-4602-b482-d1768a16c8e0 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Lazy-loading 'flavor' on Instance uuid 724b81dd-4531-4c99-850d-0bfcbfdf7bd4 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:19:50 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95 -p 172.16.0.220:3260 --login" returned: 0 in 0.096s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:50 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cc80d41-ffa3-4fb4-baac-b04d5f55aad1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:50 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3ceb72a-9f51-49f6-9512-80e176adbcd7 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95, portal: 172.16.0.220,3260]
Nov 17 01:19:50 user nova-compute[75226]: Login to [iface: default, target: iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95, portal: 172.16.0.220,3260] successful.
Nov 17 01:19:50 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:19:50 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:50 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:50 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[7242413f-dfdf-4589-998b-d87a76aab066]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:50 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3ceb72a-9f51-49f6-9512-80e176adbcd7 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:19:50 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:50 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-72d762d4-714f-4602-b482-d1768a16c8e0 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Lock "724b81dd-4531-4c99-850d-0bfcbfdf7bd4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.890s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:19:50 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:50 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[4341bbd5-58f8-49d5-bdaa-5638fa026ac7]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:356ef305-2a5c-4df3-93ce-51a994422e0b (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e860a72-9a6d-4889-8210-beafd1f879c7 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:801ff813-83ea-4d9e-a8d2-ed4146b22b52 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18d60c48-77ba-445e-93c7-aa275249c5c2 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:50 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3ceb72a-9f51-49f6-9512-80e176adbcd7 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:356ef305-2a5c-4df3-93ce-51a994422e0b (non-flash)
Nov 17 01:19:50 user nova-compute[75226]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e860a72-9a6d-4889-8210-beafd1f879c7 (non-flash)
Nov 17 01:19:50 user nova-compute[75226]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:801ff813-83ea-4d9e-a8d2-ed4146b22b52 (non-flash)
Nov 17 01:19:50 user nova-compute[75226]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2 (non-flash)
Nov 17 01:19:50 user nova-compute[75226]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95 (non-flash)
Nov 17 01:19:50 user nova-compute[75226]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae (non-flash)
Nov 17 01:19:50 user nova-compute[75226]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1 (non-flash)
Nov 17 01:19:50 user nova-compute[75226]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6 (non-flash)
Nov 17 01:19:50 user nova-compute[75226]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18d60c48-77ba-445e-93c7-aa275249c5c2 (non-flash)
Nov 17 01:19:50 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:19:50 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3ceb72a-9f51-49f6-9512-80e176adbcd7 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:356ef305-2a5c-4df3-93ce-51a994422e0b (non-flash)
Nov 17 01:19:50 user nova-compute[75226]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e860a72-9a6d-4889-8210-beafd1f879c7 (non-flash)
Nov 17 01:19:50 user nova-compute[75226]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:801ff813-83ea-4d9e-a8d2-ed4146b22b52 (non-flash)
Nov 17 01:19:50 user nova-compute[75226]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2 (non-flash)
Nov 17 01:19:50 user nova-compute[75226]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95 (non-flash)
Nov 17 01:19:50 user nova-compute[75226]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae (non-flash)
Nov 17 01:19:50 user nova-compute[75226]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1 (non-flash)
Nov 17 01:19:50 user nova-compute[75226]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6 (non-flash)
Nov 17 01:19:50 user nova-compute[75226]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18d60c48-77ba-445e-93c7-aa275249c5c2 (non-flash)
Nov 17 01:19:50 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:19:50 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-a3ceb72a-9f51-49f6-9512-80e176adbcd7 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.337s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:19:50 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3ceb72a-9f51-49f6-9512-80e176adbcd7 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] Connected to 172.16.0.220:3260 {{(pid=75226) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 17 01:19:50 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-a3ceb72a-9f51-49f6-9512-80e176adbcd7 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] HCTL ('37', '-', '-', 0) found on session 14 with lun 0 {{(pid=75226) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 17 01:19:50 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-a3ceb72a-9f51-49f6-9512-80e176adbcd7 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] Scanning host 37 c: -, t: -, l: 0) {{(pid=75226) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 17 01:19:50 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:50 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:50 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[795dd018-9341-4cfd-8585-ff16744d5c10]: (4, ('- - 0', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:50 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-a3ceb72a-9f51-49f6-9512-80e176adbcd7 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] Searching for a device in session 14 and hctl ['37', '*', '*', 0] yield: None {{(pid=75226) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 01:19:50 user nova-compute[75226]: DEBUG nova.compute.manager [req-d320c9ef-6b4e-48c1-9471-c632f8ec0932 req-34e1567c-cfb1-4b85-a84c-80e0fa4afd53 service nova] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Received event network-changed-6337887b-565a-4dc6-9a4f-4c8d9ac1c901 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:19:50 user nova-compute[75226]: DEBUG nova.compute.manager [req-d320c9ef-6b4e-48c1-9471-c632f8ec0932 req-34e1567c-cfb1-4b85-a84c-80e0fa4afd53 service nova] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Refreshing instance network info cache due to event network-changed-6337887b-565a-4dc6-9a4f-4c8d9ac1c901. {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 01:19:50 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-d320c9ef-6b4e-48c1-9471-c632f8ec0932 req-34e1567c-cfb1-4b85-a84c-80e0fa4afd53 service nova] Acquiring lock "refresh_cache-27342ec6-7a03-4f99-8056-5cb56794aa41" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:19:50 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-d320c9ef-6b4e-48c1-9471-c632f8ec0932 req-34e1567c-cfb1-4b85-a84c-80e0fa4afd53 service nova] Acquired lock "refresh_cache-27342ec6-7a03-4f99-8056-5cb56794aa41" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:19:50 user nova-compute[75226]: DEBUG nova.network.neutron [req-d320c9ef-6b4e-48c1-9471-c632f8ec0932 req-34e1567c-cfb1-4b85-a84c-80e0fa4afd53 service nova] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Refreshing network info cache for port 6337887b-565a-4dc6-9a4f-4c8d9ac1c901 {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 01:19:51 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-a3ceb72a-9f51-49f6-9512-80e176adbcd7 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] Searching for a device in session 14 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75226) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 01:19:51 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3ceb72a-9f51-49f6-9512-80e176adbcd7 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OsjHbnIp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75226) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 17 01:19:51 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-a3ceb72a-9f51-49f6-9512-80e176adbcd7 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.372s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:19:51 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3ceb72a-9f51-49f6-9512-80e176adbcd7 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] <== connect_volume: return (1373ms) {'type': 'block', 'scsi_wwn': '23538373563613064', 'path': '/dev/sdf'} {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:19:51 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3ceb72a-9f51-49f6-9512-80e176adbcd7 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] [instance: 75b1cabe-ba15-4851-9140-5949afc33005] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23538373563613064', 'path': '/dev/sdf'} {{(pid=75226) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 17 01:19:51 user nova-compute[75226]: DEBUG nova.objects.instance [None req-a3ceb72a-9f51-49f6-9512-80e176adbcd7 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] Lazy-loading 'flavor' on Instance uuid 75b1cabe-ba15-4851-9140-5949afc33005 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:19:51 user nova-compute[75226]: DEBUG nova.network.neutron [req-d320c9ef-6b4e-48c1-9471-c632f8ec0932 req-34e1567c-cfb1-4b85-a84c-80e0fa4afd53 service nova] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Updated VIF entry in instance network info cache for port 6337887b-565a-4dc6-9a4f-4c8d9ac1c901. {{(pid=75226) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 01:19:51 user nova-compute[75226]: DEBUG nova.network.neutron [req-d320c9ef-6b4e-48c1-9471-c632f8ec0932 req-34e1567c-cfb1-4b85-a84c-80e0fa4afd53 service nova] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Updating instance_info_cache with network_info: [{"id": "6337887b-565a-4dc6-9a4f-4c8d9ac1c901", "address": "fa:16:3e:fc:8e:ff", "network": {"id": "4d03345a-3dc2-4436-a30b-30b8015b649e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2116320858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "871db3f789ac470c877456108324c68c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6337887b-56", "ovs_interfaceid": "6337887b-565a-4dc6-9a4f-4c8d9ac1c901", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8a548a9b-874e-4c7c-bf06-6896dd773ce4", "address": "fa:16:3e:5b:b6:0c", "network": {"id": "df3c1bab-64f6-49c0-b35a-396881f5862f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1354339680", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "871db3f789ac470c877456108324c68c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a548a9b-87", "ovs_interfaceid": "8a548a9b-874e-4c7c-bf06-6896dd773ce4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "01625fc1-9bbc-4edc-b594-78658e91edd9", "address": "fa:16:3e:13:8d:33", "network": {"id": "df3c1bab-64f6-49c0-b35a-396881f5862f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1354339680", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.68", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "871db3f789ac470c877456108324c68c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01625fc1-9b", "ovs_interfaceid": "01625fc1-9bbc-4edc-b594-78658e91edd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3e4d946c-158b-49e8-a349-44da4864f830", "address": "fa:16:3e:65:64:f1", "network": {"id": "df3c1bab-64f6-49c0-b35a-396881f5862f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1354339680", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "871db3f789ac470c877456108324c68c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e4d946c-15", "ovs_interfaceid": "3e4d946c-158b-49e8-a349-44da4864f830", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3b1855a6-8a37-47af-b3e6-86e60eb05a1d", "address": "fa:16:3e:5e:6d:29", "network": {"id": "df3c1bab-64f6-49c0-b35a-396881f5862f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1354339680", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "871db3f789ac470c877456108324c68c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b1855a6-8a", "ovs_interfaceid": "3b1855a6-8a37-47af-b3e6-86e60eb05a1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3c1a838d-e1c6-44d3-ab8a-a545044545a3", "address": "fa:16:3e:47:9b:84", "network": {"id": "b92e4d90-c7bd-45d6-a9db-d4b27ce718c5", "bridge": "br-int", "label": "tempest-device-tagging-net2-541044549", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "871db3f789ac470c877456108324c68c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c1a838d-e1", "ovs_interfaceid": "3c1a838d-e1c6-44d3-ab8a-a545044545a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "11a81061-cde2-4e09-88e4-678aead09ad5", "address": "fa:16:3e:77:77:72", "network": {"id": "b92e4d90-c7bd-45d6-a9db-d4b27ce718c5", "bridge": "br-int", "label": "tempest-device-tagging-net2-541044549", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "871db3f789ac470c877456108324c68c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11a81061-cd", "ovs_interfaceid": "11a81061-cde2-4e09-88e4-678aead09ad5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:19:51 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-d320c9ef-6b4e-48c1-9471-c632f8ec0932 req-34e1567c-cfb1-4b85-a84c-80e0fa4afd53 service nova] Releasing lock "refresh_cache-27342ec6-7a03-4f99-8056-5cb56794aa41" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:19:51 user nova-compute[75226]: DEBUG nova.virt.libvirt.guest [None req-a3ceb72a-9f51-49f6-9512-80e176adbcd7 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=75226) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 17 01:19:52 user nova-compute[75226]: DEBUG nova.compute.manager [req-48fffe3b-20dd-4da4-8c79-96b8a6f9fb22 req-0c9f5cfb-bb54-4aa2-9762-ab9b370abbb7 service nova] [instance: 262eb845-eebe-4ffb-bc49-dcaca53ad7b8] Received event volume-reimaged-2ca02b15-b2b8-4e45-9d87-54886c2568a2 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:19:52 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-48fffe3b-20dd-4da4-8c79-96b8a6f9fb22 req-0c9f5cfb-bb54-4aa2-9762-ab9b370abbb7 service nova] Acquiring lock "262eb845-eebe-4ffb-bc49-dcaca53ad7b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:19:52 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-48fffe3b-20dd-4da4-8c79-96b8a6f9fb22 req-0c9f5cfb-bb54-4aa2-9762-ab9b370abbb7 service nova] Lock "262eb845-eebe-4ffb-bc49-dcaca53ad7b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:19:52 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-48fffe3b-20dd-4da4-8c79-96b8a6f9fb22 req-0c9f5cfb-bb54-4aa2-9762-ab9b370abbb7 service nova] Lock "262eb845-eebe-4ffb-bc49-dcaca53ad7b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:19:52 user nova-compute[75226]: DEBUG nova.compute.manager [req-48fffe3b-20dd-4da4-8c79-96b8a6f9fb22 req-0c9f5cfb-bb54-4aa2-9762-ab9b370abbb7 service nova] [instance: 262eb845-eebe-4ffb-bc49-dcaca53ad7b8] Processing event volume-reimaged-2ca02b15-b2b8-4e45-9d87-54886c2568a2 {{(pid=75226) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10872}}
Nov 17 01:19:52 user nova-compute[75226]: DEBUG nova.compute.manager [None req-48fffe3b-20dd-4da4-8c79-96b8a6f9fb22 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] [instance: 262eb845-eebe-4ffb-bc49-dcaca53ad7b8] Instance event wait completed in 15 seconds for volume-reimaged {{(pid=75226) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 17 01:19:52 user nova-compute[75226]: INFO nova.virt.block_device [None req-48fffe3b-20dd-4da4-8c79-96b8a6f9fb22 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] [instance: 262eb845-eebe-4ffb-bc49-dcaca53ad7b8] Booting with volume 2ca02b15-b2b8-4e45-9d87-54886c2568a2 at /dev/vda
Nov 17 01:19:52 user nova-compute[75226]: DEBUG nova.virt.libvirt.guest [None req-a3ceb72a-9f51-49f6-9512-80e176adbcd7 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] COPY block job progress, current cursor: 148897792 final cursor: 1073741824 {{(pid=75226) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 17 01:19:52 user nova-compute[75226]: DEBUG os_brick.utils [None req-48fffe3b-20dd-4da4-8c79-96b8a6f9fb22 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:19:52 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:52 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:52 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bb71cbf-fe7e-438d-8233-25d08cd6599d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f62857db69\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:52 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:52 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:52 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[81ee7d44-b138-41f3-b2c9-2a74551ed569]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:52 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:52 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:52 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0f996c9-36d5-4208-bbcf-8f06f0672a74]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:52 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[e49021a9-5385-47dd-8cff-f4bb9b368fb6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:52 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-48fffe3b-20dd-4da4-8c79-96b8a6f9fb22 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] Running cmd (subprocess): nvme version {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:52 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-48fffe3b-20dd-4da4-8c79-96b8a6f9fb22 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] 'nvme version' failed. Not Retrying. {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 01:19:52 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.nvmeof [None req-48fffe3b-20dd-4da4-8c79-96b8a6f9fb22 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] nvme not present on system {{(pid=75226) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 17 01:19:52 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:52 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 01:19:52 user nova-compute[75226]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 17 01:19:52 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[39ae7f72-b1fc-4862-a098-ab106bbbda43]: (4, '') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:52 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-48fffe3b-20dd-4da4-8c79-96b8a6f9fb22 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75226) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 17 01:19:52 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-48fffe3b-20dd-4da4-8c79-96b8a6f9fb22 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75226) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 17 01:19:52 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-48fffe3b-20dd-4da4-8c79-96b8a6f9fb22 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] LIGHTOS: no hostnqn found. {{(pid=75226) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 17 01:19:52 user nova-compute[75226]: DEBUG os_brick.utils [None req-48fffe3b-20dd-4da4-8c79-96b8a6f9fb22 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f62857db69', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:19:52 user nova-compute[75226]: DEBUG nova.virt.block_device [None req-48fffe3b-20dd-4da4-8c79-96b8a6f9fb22 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] [instance: 262eb845-eebe-4ffb-bc49-dcaca53ad7b8] Updating existing volume attachment record: 43e94f54-f3ba-4d37-bf28-3d4695063360 {{(pid=75226) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 17 01:19:52 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:19:52 user nova-compute[75226]: DEBUG nova.virt.libvirt.guest [None req-a3ceb72a-9f51-49f6-9512-80e176adbcd7 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] COPY block job progress, current cursor: 294649856 final cursor: 1073741824 {{(pid=75226) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 17 01:19:53 user nova-compute[75226]: DEBUG nova.virt.libvirt.guest [None req-a3ceb72a-9f51-49f6-9512-80e176adbcd7 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] COPY block job progress, current cursor: 414187520 final cursor: 1073741824 {{(pid=75226) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 17 01:19:53 user nova-compute[75226]: DEBUG nova.virt.libvirt.guest [None req-a3ceb72a-9f51-49f6-9512-80e176adbcd7 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] COPY block job progress, current cursor: 497025024 final cursor: 1073741824 {{(pid=75226) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 17 01:19:53 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-c77c2bf8-c00d-4ba7-8ee2-f504accdaabf tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Acquiring lock "27342ec6-7a03-4f99-8056-5cb56794aa41" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:19:53 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-c77c2bf8-c00d-4ba7-8ee2-f504accdaabf tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Lock "27342ec6-7a03-4f99-8056-5cb56794aa41" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:19:53 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-c77c2bf8-c00d-4ba7-8ee2-f504accdaabf tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Acquiring lock "27342ec6-7a03-4f99-8056-5cb56794aa41-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:19:53 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-c77c2bf8-c00d-4ba7-8ee2-f504accdaabf tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Lock "27342ec6-7a03-4f99-8056-5cb56794aa41-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:19:53 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-c77c2bf8-c00d-4ba7-8ee2-f504accdaabf tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Lock "27342ec6-7a03-4f99-8056-5cb56794aa41-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:19:53 user nova-compute[75226]: INFO nova.compute.manager [None req-c77c2bf8-c00d-4ba7-8ee2-f504accdaabf tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Terminating instance
Nov 17 01:19:53 user nova-compute[75226]: DEBUG nova.compute.manager [None req-c77c2bf8-c00d-4ba7-8ee2-f504accdaabf tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Start destroying the instance on the hypervisor. {{(pid=75226) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 17 01:19:54 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:19:54 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:19:54 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:19:54 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:19:54 user nova-compute[75226]: DEBUG nova.virt.libvirt.guest [None req-a3ceb72a-9f51-49f6-9512-80e176adbcd7 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] COPY block job progress, current cursor: 703594496 final cursor: 1073741824 {{(pid=75226) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 17 01:19:54 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:19:54 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:19:54 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:19:54 user nova-compute[75226]: DEBUG nova.compute.manager [req-3c1650b0-11a6-450b-ae55-6b1d4d75e6cc req-88201ab0-dd12-41ec-b5cd-7ba0a51678ed service nova] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Received event network-vif-unplugged-6337887b-565a-4dc6-9a4f-4c8d9ac1c901 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:19:54 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-3c1650b0-11a6-450b-ae55-6b1d4d75e6cc req-88201ab0-dd12-41ec-b5cd-7ba0a51678ed service nova] Acquiring lock "27342ec6-7a03-4f99-8056-5cb56794aa41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:19:54 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-3c1650b0-11a6-450b-ae55-6b1d4d75e6cc req-88201ab0-dd12-41ec-b5cd-7ba0a51678ed service nova] Lock "27342ec6-7a03-4f99-8056-5cb56794aa41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:19:54 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-3c1650b0-11a6-450b-ae55-6b1d4d75e6cc req-88201ab0-dd12-41ec-b5cd-7ba0a51678ed service nova] Lock "27342ec6-7a03-4f99-8056-5cb56794aa41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:19:54 user nova-compute[75226]: DEBUG nova.compute.manager [req-3c1650b0-11a6-450b-ae55-6b1d4d75e6cc req-88201ab0-dd12-41ec-b5cd-7ba0a51678ed service nova] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] No waiting events found dispatching network-vif-unplugged-6337887b-565a-4dc6-9a4f-4c8d9ac1c901 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:19:54 user nova-compute[75226]: DEBUG nova.compute.manager [req-3c1650b0-11a6-450b-ae55-6b1d4d75e6cc req-88201ab0-dd12-41ec-b5cd-7ba0a51678ed service nova] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Received event network-vif-unplugged-6337887b-565a-4dc6-9a4f-4c8d9ac1c901 for instance with task_state deleting. {{(pid=75226) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 17 01:19:54 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:19:54 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:19:54 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:19:54 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:19:54 user nova-compute[75226]: DEBUG nova.compute.manager [req-d2ca1528-9634-4eae-a7fe-95ea6ab65baf req-b856827e-c044-4729-b8a1-a7a9df893af8 service nova] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Received event network-vif-unplugged-8a548a9b-874e-4c7c-bf06-6896dd773ce4 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:19:54 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-d2ca1528-9634-4eae-a7fe-95ea6ab65baf req-b856827e-c044-4729-b8a1-a7a9df893af8 service nova] Acquiring lock "27342ec6-7a03-4f99-8056-5cb56794aa41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:19:54 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-d2ca1528-9634-4eae-a7fe-95ea6ab65baf req-b856827e-c044-4729-b8a1-a7a9df893af8 service nova] Lock "27342ec6-7a03-4f99-8056-5cb56794aa41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:19:54 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-d2ca1528-9634-4eae-a7fe-95ea6ab65baf req-b856827e-c044-4729-b8a1-a7a9df893af8 service nova] Lock "27342ec6-7a03-4f99-8056-5cb56794aa41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:19:54 user nova-compute[75226]: DEBUG nova.compute.manager [req-d2ca1528-9634-4eae-a7fe-95ea6ab65baf req-b856827e-c044-4729-b8a1-a7a9df893af8 service nova] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] No waiting events found dispatching network-vif-unplugged-8a548a9b-874e-4c7c-bf06-6896dd773ce4 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:19:54 user nova-compute[75226]: DEBUG nova.compute.manager [req-d2ca1528-9634-4eae-a7fe-95ea6ab65baf req-b856827e-c044-4729-b8a1-a7a9df893af8 service nova] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Received event network-vif-unplugged-8a548a9b-874e-4c7c-bf06-6896dd773ce4 for instance with task_state deleting. {{(pid=75226) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 17 01:19:54 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:19:54 user nova-compute[75226]: DEBUG nova.virt.libvirt.guest [None req-a3ceb72a-9f51-49f6-9512-80e176adbcd7 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] COPY block job progress, current cursor: 869269504 final cursor: 1073741824 {{(pid=75226) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 17 01:19:54 user nova-compute[75226]: DEBUG nova.compute.manager [req-0f885dc3-3777-4779-ab75-ac3d1a4526b5 req-74463cd8-7d70-41ae-9e7b-4344c0a1d592 service nova] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Received event network-vif-unplugged-01625fc1-9bbc-4edc-b594-78658e91edd9 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:19:54 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-0f885dc3-3777-4779-ab75-ac3d1a4526b5 req-74463cd8-7d70-41ae-9e7b-4344c0a1d592 service nova] Acquiring lock "27342ec6-7a03-4f99-8056-5cb56794aa41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:19:54 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-0f885dc3-3777-4779-ab75-ac3d1a4526b5 req-74463cd8-7d70-41ae-9e7b-4344c0a1d592 service nova] Lock "27342ec6-7a03-4f99-8056-5cb56794aa41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:19:54 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-0f885dc3-3777-4779-ab75-ac3d1a4526b5 req-74463cd8-7d70-41ae-9e7b-4344c0a1d592 service nova] Lock "27342ec6-7a03-4f99-8056-5cb56794aa41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:19:54 user nova-compute[75226]: DEBUG nova.compute.manager [req-0f885dc3-3777-4779-ab75-ac3d1a4526b5 req-74463cd8-7d70-41ae-9e7b-4344c0a1d592 service nova] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] No waiting events found dispatching network-vif-unplugged-01625fc1-9bbc-4edc-b594-78658e91edd9 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:19:54 user nova-compute[75226]: DEBUG nova.compute.manager [req-0f885dc3-3777-4779-ab75-ac3d1a4526b5 req-74463cd8-7d70-41ae-9e7b-4344c0a1d592 service nova] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Received event network-vif-unplugged-01625fc1-9bbc-4edc-b594-78658e91edd9 for instance with task_state deleting. {{(pid=75226) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 17 01:19:54 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:19:54 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:19:54 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:19:54 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:19:54 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:19:55 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:19:55 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:19:55 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-e3404692-5eb6-438f-93d2-ac97d0a47166 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b054a557-dff6-49f8-9300-1307f8433567 is timed out.
Nov 17 01:19:55 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:19:55 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-e3404692-5eb6-438f-93d2-ac97d0a47166 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] Successfully detached device vdb from instance b054a557-dff6-49f8-9300-1307f8433567 from the live domain config.
Nov 17 01:19:55 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e3404692-5eb6-438f-93d2-ac97d0a47166 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] [instance: b054a557-dff6-49f8-9300-1307f8433567] calling os-brick to detach iSCSI Volume {{(pid=75226) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 17 01:19:55 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3404692-5eb6-438f-93d2-ac97d0a47166 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc4cc36b490>, {'target_iqn': 'iqn.2010-10.org.openstack:18d60c48-77ba-445e-93c7-aa275249c5c2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TjCKYuhQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:19:55 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-e3404692-5eb6-438f-93d2-ac97d0a47166 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:19:55 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-e3404692-5eb6-438f-93d2-ac97d0a47166 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:19:55 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-e3404692-5eb6-438f-93d2-ac97d0a47166 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:19:55 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:55 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:55 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[817f0f86-9f45-46ee-9fc2-0733266364cd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:356ef305-2a5c-4df3-93ce-51a994422e0b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:801ff813-83ea-4d9e-a8d2-ed4146b22b52\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0e860a72-9a6d-4889-8210-beafd1f879c7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:18d60c48-77ba-445e-93c7-aa275249c5c2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:55 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3404692-5eb6-438f-93d2-ac97d0a47166 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 17 01:19:55 user nova-compute[75226]: No targets found.
Nov 17 01:19:55 user nova-compute[75226]: iSNS:
Nov 17 01:19:55 user nova-compute[75226]: No targets found.
Nov 17 01:19:55 user nova-compute[75226]: STATIC:
Nov 17 01:19:55 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:356ef305-2a5c-4df3-93ce-51a994422e0b
Nov 17 01:19:55 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:19:55 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:19:55 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:801ff813-83ea-4d9e-a8d2-ed4146b22b52
Nov 17 01:19:55 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:19:55 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:19:55 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:0e860a72-9a6d-4889-8210-beafd1f879c7
Nov 17 01:19:55 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:19:55 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:19:55 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:18d60c48-77ba-445e-93c7-aa275249c5c2
Nov 17 01:19:55 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:19:55 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:19:55 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae
Nov 17 01:19:55 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:19:55 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:19:55 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1
Nov 17 01:19:55 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:19:55 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:19:55 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95
Nov 17 01:19:55 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:19:55 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:19:55 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6
Nov 17 01:19:55 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:19:55 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:19:55 user nova-compute[75226]: FIRMWARE:
Nov 17 01:19:55 user nova-compute[75226]: No targets found.
Nov 17 01:19:55 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:19:55 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3404692-5eb6-438f-93d2-ac97d0a47166 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 17 01:19:55 user nova-compute[75226]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 17 01:19:55 user nova-compute[75226]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75226) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 17 01:19:55 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3404692-5eb6-438f-93d2-ac97d0a47166 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:18d60c48-77ba-445e-93c7-aa275249c5c2', 0)] {{(pid=75226) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 17 01:19:55 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:55 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:55 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[b674bfa1-ee24-41dd-a756-30853361ab80]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0e860a72-9a6d-4889-8210-beafd1f879c7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:18d60c48-77ba-445e-93c7-aa275249c5c2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:356ef305-2a5c-4df3-93ce-51a994422e0b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:801ff813-83ea-4d9e-a8d2-ed4146b22b52\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:55 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:55 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:19:55 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:55 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[83575155-2caf-4e89-bfe7-03df97a2ad1d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:356ef305-2a5c-4df3-93ce-51a994422e0b (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e860a72-9a6d-4889-8210-beafd1f879c7 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:801ff813-83ea-4d9e-a8d2-ed4146b22b52 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18d60c48-77ba-445e-93c7-aa275249c5c2 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:55 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3404692-5eb6-438f-93d2-ac97d0a47166 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:356ef305-2a5c-4df3-93ce-51a994422e0b (non-flash)
Nov 17 01:19:55 user nova-compute[75226]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e860a72-9a6d-4889-8210-beafd1f879c7 (non-flash)
Nov 17 01:19:55 user nova-compute[75226]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:801ff813-83ea-4d9e-a8d2-ed4146b22b52 (non-flash)
Nov 17 01:19:55 user nova-compute[75226]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95 (non-flash)
Nov 17 01:19:55 user nova-compute[75226]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae (non-flash)
Nov 17 01:19:55 user nova-compute[75226]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1 (non-flash)
Nov 17 01:19:55 user nova-compute[75226]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6 (non-flash)
Nov 17 01:19:55 user nova-compute[75226]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18d60c48-77ba-445e-93c7-aa275249c5c2 (non-flash)
Nov 17 01:19:55 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:19:55 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3404692-5eb6-438f-93d2-ac97d0a47166 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:356ef305-2a5c-4df3-93ce-51a994422e0b (non-flash)
Nov 17 01:19:55 user nova-compute[75226]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e860a72-9a6d-4889-8210-beafd1f879c7 (non-flash)
Nov 17 01:19:55 user nova-compute[75226]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:801ff813-83ea-4d9e-a8d2-ed4146b22b52 (non-flash)
Nov 17 01:19:55 user nova-compute[75226]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95 (non-flash)
Nov 17 01:19:55 user nova-compute[75226]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae (non-flash)
Nov 17 01:19:55 user nova-compute[75226]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1 (non-flash)
Nov 17 01:19:55 user nova-compute[75226]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6 (non-flash)
Nov 17 01:19:55 user nova-compute[75226]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18d60c48-77ba-445e-93c7-aa275249c5c2 (non-flash)
Nov 17 01:19:55 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:19:55 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3404692-5eb6-438f-93d2-ac97d0a47166 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc4b445b6d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:18d60c48-77ba-445e-93c7-aa275249c5c2'): ({'sdh'}, set())}) {{(pid=75226) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 17 01:19:55 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-e3404692-5eb6-438f-93d2-ac97d0a47166 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] Removing single pathed devices sdh {{(pid=75226) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 17 01:19:55 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:19:55 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:55 user nova-compute[75226]: DEBUG nova.virt.libvirt.guest [None req-a3ceb72a-9f51-49f6-9512-80e176adbcd7 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] COPY block job progress, current cursor: 987758592 final cursor: 1073741824 {{(pid=75226) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 17 01:19:55 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.030s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:55 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8cb110a-d062-4cbc-97bd-3514f73e5635]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:55 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:55 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:55 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[af70d078-5e3d-48f4-99ec-05aa7ab1639d]: (4, ('ok\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:55 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-e3404692-5eb6-438f-93d2-ac97d0a47166 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] Flushing IO for device /dev/sdh {{(pid=75226) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 17 01:19:55 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:55 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.026s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:55 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[943c9003-71c9-45d9-a0f1-ef832e73dd55]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:55 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-e3404692-5eb6-438f-93d2-ac97d0a47166 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=75226) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 17 01:19:55 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:55 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.043s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:55 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[a181f4a7-103b-4e55-8cbb-2f750279b2b9]: (4, ('1', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:55 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-e3404692-5eb6-438f-93d2-ac97d0a47166 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=75226) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 17 01:19:55 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-e3404692-5eb6-438f-93d2-ac97d0a47166 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] SCSI volumes sdh have been removed. {{(pid=75226) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 17 01:19:55 user nova-compute[75226]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23237386533616466', '/dev/disk/by-id/scsi-1SCST_BIO63f5e4cf-278e3adfe444d7f5', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_63f5e4cf') {{(pid=85818) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 17 01:19:55 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[febbd205-15e7-455f-9d66-a7066cbc740a]: (4, None) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:55 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3404692-5eb6-438f-93d2-ac97d0a47166 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:18d60c48-77ba-445e-93c7-aa275249c5c2')] {{(pid=75226) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 17 01:19:55 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18d60c48-77ba-445e-93c7-aa275249c5c2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:55 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18d60c48-77ba-445e-93c7-aa275249c5c2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.031s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:55 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[9136765f-e20a-4476-ac23-ed9594a45b56]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:55 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3404692-5eb6-438f-93d2-ac97d0a47166 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:19:55 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18d60c48-77ba-445e-93c7-aa275249c5c2 -p 172.16.0.220:3260 --logout {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:55 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:19:55 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:19:55 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18d60c48-77ba-445e-93c7-aa275249c5c2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.130s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:55 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0e35e13-7ba8-4b17-8a00-4df4f964bb77]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:18d60c48-77ba-445e-93c7-aa275249c5c2, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:18d60c48-77ba-445e-93c7-aa275249c5c2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:55 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3404692-5eb6-438f-93d2-ac97d0a47166 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:18d60c48-77ba-445e-93c7-aa275249c5c2, portal: 172.16.0.220,3260]
Nov 17 01:19:55 user nova-compute[75226]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:18d60c48-77ba-445e-93c7-aa275249c5c2, portal: 172.16.0.220,3260] successful.
Nov 17 01:19:55 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:19:55 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18d60c48-77ba-445e-93c7-aa275249c5c2 -p 172.16.0.220:3260 --op delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:55 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:19:55 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18d60c48-77ba-445e-93c7-aa275249c5c2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.077s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:55 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f7fd6d9-e6cd-42fe-9155-b66fa3a6a2be]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:55 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3404692-5eb6-438f-93d2-ac97d0a47166 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:19:55 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-e3404692-5eb6-438f-93d2-ac97d0a47166 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.558s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:19:55 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3404692-5eb6-438f-93d2-ac97d0a47166 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] <== disconnect_volume: return (560ms) None {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:19:55 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e3404692-5eb6-438f-93d2-ac97d0a47166 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] [instance: b054a557-dff6-49f8-9300-1307f8433567] Disconnected iSCSI Volume {{(pid=75226) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 17 01:19:55 user nova-compute[75226]: DEBUG nova.virt.libvirt.guest [None req-a3ceb72a-9f51-49f6-9512-80e176adbcd7 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=75226) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 17 01:19:55 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-31892f4f-def4-4407-9905-0210fbfed9e3 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance e7830f7a-80f1-4c2f-bd64-363e6dd9114a is timed out.
Nov 17 01:19:55 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-31892f4f-def4-4407-9905-0210fbfed9e3 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] Successfully detached device sdc from instance e7830f7a-80f1-4c2f-bd64-363e6dd9114a from the live domain config.
Nov 17 01:19:55 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-31892f4f-def4-4407-9905-0210fbfed9e3 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] [instance: e7830f7a-80f1-4c2f-bd64-363e6dd9114a] calling os-brick to detach iSCSI Volume {{(pid=75226) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 17 01:19:55 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-31892f4f-def4-4407-9905-0210fbfed9e3 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc4cc36b490>, {'target_iqn': 'iqn.2010-10.org.openstack:356ef305-2a5c-4df3-93ce-51a994422e0b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DxrzYtBc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:19:55 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-31892f4f-def4-4407-9905-0210fbfed9e3 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:19:55 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-31892f4f-def4-4407-9905-0210fbfed9e3 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:19:55 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-31892f4f-def4-4407-9905-0210fbfed9e3 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:19:55 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:55 user nova-compute[75226]: INFO nova.virt.libvirt.driver [-] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Instance destroyed successfully.
Nov 17 01:19:55 user nova-compute[75226]: DEBUG nova.objects.instance [None req-c77c2bf8-c00d-4ba7-8ee2-f504accdaabf tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Lazy-loading 'resources' on Instance uuid 27342ec6-7a03-4f99-8056-5cb56794aa41 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:19:55 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-c77c2bf8-c00d-4ba7-8ee2-f504accdaabf tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-17T01:17:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1660208825',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1660208825',id=10,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO4+E9QOiUnWNUKrI+j17EMQbFyLd21Wqpo/hRvSEijsTxwF94lMxe3826dGGI7fte9gqEiKOU9O8ocJVagllay2w4NWQRzLkq112cs0QLNwHnmiDDocCj/FpieRw6NKiw==',key_name='tempest-keypair-413268072',keypairs=<?>,launch_index=0,launched_at=2023-11-17T01:18:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='871db3f789ac470c877456108324c68c',ramdisk_id='',reservation_id='r-e00nhfhr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1790286385',owner_user_name='tempest-TaggedBootDevicesTest-1790286385-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T01:18:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b54686e817042a28596953dde26d329',uuid=27342ec6-7a03-4f99-8056-5cb56794aa41,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6337887b-565a-4dc6-9a4f-4c8d9ac1c901", "address": "fa:16:3e:fc:8e:ff", "network": {"id": "4d03345a-3dc2-4436-a30b-30b8015b649e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2116320858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "871db3f789ac470c877456108324c68c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6337887b-56", "ovs_interfaceid": "6337887b-565a-4dc6-9a4f-4c8d9ac1c901", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 17 01:19:55 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-c77c2bf8-c00d-4ba7-8ee2-f504accdaabf tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Converting VIF {"id": "6337887b-565a-4dc6-9a4f-4c8d9ac1c901", "address": "fa:16:3e:fc:8e:ff", "network": {"id": "4d03345a-3dc2-4436-a30b-30b8015b649e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2116320858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "871db3f789ac470c877456108324c68c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6337887b-56", "ovs_interfaceid": "6337887b-565a-4dc6-9a4f-4c8d9ac1c901", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:19:55 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-c77c2bf8-c00d-4ba7-8ee2-f504accdaabf tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fc:8e:ff,bridge_name='br-int',has_traffic_filtering=True,id=6337887b-565a-4dc6-9a4f-4c8d9ac1c901,network=Network(4d03345a-3dc2-4436-a30b-30b8015b649e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6337887b-56') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:19:55 user nova-compute[75226]: DEBUG os_vif [None req-c77c2bf8-c00d-4ba7-8ee2-f504accdaabf tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fc:8e:ff,bridge_name='br-int',has_traffic_filtering=True,id=6337887b-565a-4dc6-9a4f-4c8d9ac1c901,network=Network(4d03345a-3dc2-4436-a30b-30b8015b649e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6337887b-56') {{(pid=75226) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 17 01:19:55 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.041s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:55 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[563a9a58-7d88-482e-bc44-a4cbf6159acc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:356ef305-2a5c-4df3-93ce-51a994422e0b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:801ff813-83ea-4d9e-a8d2-ed4146b22b52\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0e860a72-9a6d-4889-8210-beafd1f879c7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:55 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-31892f4f-def4-4407-9905-0210fbfed9e3 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 17 01:19:55 user nova-compute[75226]: No targets found.
Nov 17 01:19:55 user nova-compute[75226]: iSNS:
Nov 17 01:19:55 user nova-compute[75226]: No targets found.
Nov 17 01:19:55 user nova-compute[75226]: STATIC:
Nov 17 01:19:55 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:356ef305-2a5c-4df3-93ce-51a994422e0b
Nov 17 01:19:55 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:19:55 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:19:55 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:801ff813-83ea-4d9e-a8d2-ed4146b22b52
Nov 17 01:19:55 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:19:55 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:19:55 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:0e860a72-9a6d-4889-8210-beafd1f879c7
Nov 17 01:19:55 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:19:55 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:19:55 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae
Nov 17 01:19:55 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:19:55 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:19:55 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1
Nov 17 01:19:55 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:19:55 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:19:55 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95
Nov 17 01:19:55 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:19:55 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:19:55 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6
Nov 17 01:19:55 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:19:55 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:19:55 user nova-compute[75226]: FIRMWARE:
Nov 17 01:19:55 user nova-compute[75226]: No targets found.
Nov 17 01:19:55 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:19:55 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-31892f4f-def4-4407-9905-0210fbfed9e3 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 17 01:19:55 user nova-compute[75226]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 17 01:19:55 user nova-compute[75226]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75226) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 17 01:19:55 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-31892f4f-def4-4407-9905-0210fbfed9e3 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:356ef305-2a5c-4df3-93ce-51a994422e0b', 0)] {{(pid=75226) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 17 01:19:55 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:19:55 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6337887b-56, bridge=br-int, if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:19:55 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:19:55 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:55 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:19:55 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:55 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[121085f7-c782-4450-b936-17ac57e7c05f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0e860a72-9a6d-4889-8210-beafd1f879c7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:356ef305-2a5c-4df3-93ce-51a994422e0b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:801ff813-83ea-4d9e-a8d2-ed4146b22b52\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:55 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:55 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3ceb72a-9f51-49f6-9512-80e176adbcd7 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] [instance: 75b1cabe-ba15-4851-9140-5949afc33005] calling os-brick to detach iSCSI Volume {{(pid=75226) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 17 01:19:55 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3ceb72a-9f51-49f6-9512-80e176adbcd7 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc4cc36b490>, {'target_iqn': 'iqn.2010-10.org.openstack:0e860a72-9a6d-4889-8210-beafd1f879c7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CQNvTtKG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'volume_id': '0e860a72-9a6d-4889-8210-beafd1f879c7'}, None), 'kwargs': False}}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:19:55 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-a3ceb72a-9f51-49f6-9512-80e176adbcd7 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:19:55 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-a3ceb72a-9f51-49f6-9512-80e176adbcd7 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:19:55 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.051s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:55 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[133c3b5e-bbf2-4934-998e-990eb833440d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:356ef305-2a5c-4df3-93ce-51a994422e0b (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e860a72-9a6d-4889-8210-beafd1f879c7 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:801ff813-83ea-4d9e-a8d2-ed4146b22b52 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:55 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-31892f4f-def4-4407-9905-0210fbfed9e3 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:356ef305-2a5c-4df3-93ce-51a994422e0b (non-flash)
Nov 17 01:19:55 user nova-compute[75226]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e860a72-9a6d-4889-8210-beafd1f879c7 (non-flash)
Nov 17 01:19:55 user nova-compute[75226]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:801ff813-83ea-4d9e-a8d2-ed4146b22b52 (non-flash)
Nov 17 01:19:55 user nova-compute[75226]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95 (non-flash)
Nov 17 01:19:55 user nova-compute[75226]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae (non-flash)
Nov 17 01:19:55 user nova-compute[75226]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1 (non-flash)
Nov 17 01:19:55 user nova-compute[75226]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6 (non-flash)
Nov 17 01:19:55 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:19:55 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-31892f4f-def4-4407-9905-0210fbfed9e3 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:356ef305-2a5c-4df3-93ce-51a994422e0b (non-flash)
Nov 17 01:19:55 user nova-compute[75226]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e860a72-9a6d-4889-8210-beafd1f879c7 (non-flash)
Nov 17 01:19:55 user nova-compute[75226]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:801ff813-83ea-4d9e-a8d2-ed4146b22b52 (non-flash)
Nov 17 01:19:55 user nova-compute[75226]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95 (non-flash)
Nov 17 01:19:55 user nova-compute[75226]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae (non-flash)
Nov 17 01:19:55 user nova-compute[75226]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1 (non-flash)
Nov 17 01:19:55 user nova-compute[75226]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6 (non-flash)
Nov 17 01:19:55 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:19:55 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-31892f4f-def4-4407-9905-0210fbfed9e3 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc4cc1bf760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:356ef305-2a5c-4df3-93ce-51a994422e0b'): ({'sdi'}, set())}) {{(pid=75226) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 17 01:19:55 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-31892f4f-def4-4407-9905-0210fbfed9e3 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] Removing single pathed devices sdi {{(pid=75226) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 17 01:19:55 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:19:55 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:19:55 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3c58ae96-38a8-4eea-a17b-b300dc623e5b) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:19:55 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:55 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:19:55 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:19:55 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:55 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2819bc2-77b0-47ca-8381-6e4b8c8ab2c5]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:55 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[a20fc3bf-2bc8-4b7b-8316-93d16785af5a]: (4, ('ok\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-31892f4f-def4-4407-9905-0210fbfed9e3 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] Flushing IO for device /dev/sdi {{(pid=75226) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.013s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1a3e78c-92ff-4e05-b6fd-0afd111ed68d]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-31892f4f-def4-4407-9905-0210fbfed9e3 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=75226) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:19:56 user nova-compute[75226]: INFO os_vif [None req-c77c2bf8-c00d-4ba7-8ee2-f504accdaabf tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fc:8e:ff,bridge_name='br-int',has_traffic_filtering=True,id=6337887b-565a-4dc6-9a4f-4c8d9ac1c901,network=Network(4d03345a-3dc2-4436-a30b-30b8015b649e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6337887b-56')
Nov 17 01:19:56 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-c77c2bf8-c00d-4ba7-8ee2-f504accdaabf tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-17T01:17:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1660208825',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1660208825',id=10,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO4+E9QOiUnWNUKrI+j17EMQbFyLd21Wqpo/hRvSEijsTxwF94lMxe3826dGGI7fte9gqEiKOU9O8ocJVagllay2w4NWQRzLkq112cs0QLNwHnmiDDocCj/FpieRw6NKiw==',key_name='tempest-keypair-413268072',keypairs=<?>,launch_index=0,launched_at=2023-11-17T01:18:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='871db3f789ac470c877456108324c68c',ramdisk_id='',reservation_id='r-e00nhfhr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1790286385',owner_user_name='tempest-TaggedBootDevicesTest-1790286385-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T01:18:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b54686e817042a28596953dde26d329',uuid=27342ec6-7a03-4f99-8056-5cb56794aa41,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8a548a9b-874e-4c7c-bf06-6896dd773ce4", "address": "fa:16:3e:5b:b6:0c", "network": {"id": "df3c1bab-64f6-49c0-b35a-396881f5862f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1354339680", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "871db3f789ac470c877456108324c68c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a548a9b-87", "ovs_interfaceid": "8a548a9b-874e-4c7c-bf06-6896dd773ce4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75226) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-c77c2bf8-c00d-4ba7-8ee2-f504accdaabf tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Converting VIF {"id": "8a548a9b-874e-4c7c-bf06-6896dd773ce4", "address": "fa:16:3e:5b:b6:0c", "network": {"id": "df3c1bab-64f6-49c0-b35a-396881f5862f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1354339680", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "871db3f789ac470c877456108324c68c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a548a9b-87", "ovs_interfaceid": "8a548a9b-874e-4c7c-bf06-6896dd773ce4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-c77c2bf8-c00d-4ba7-8ee2-f504accdaabf tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:b6:0c,bridge_name='br-int',has_traffic_filtering=True,id=8a548a9b-874e-4c7c-bf06-6896dd773ce4,network=Network(df3c1bab-64f6-49c0-b35a-396881f5862f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8a548a9b-87') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG os_vif [None req-c77c2bf8-c00d-4ba7-8ee2-f504accdaabf tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:b6:0c,bridge_name='br-int',has_traffic_filtering=True,id=8a548a9b-874e-4c7c-bf06-6896dd773ce4,network=Network(df3c1bab-64f6-49c0-b35a-396881f5862f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8a548a9b-87') {{(pid=75226) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8a548a9b-87, bridge=br-int, if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.044s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4a449fc-804a-4433-ae72-3fd5a6e49b0c]: (4, ('1', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-31892f4f-def4-4407-9905-0210fbfed9e3 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=75226) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-31892f4f-def4-4407-9905-0210fbfed9e3 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] SCSI volumes sdi have been removed. {{(pid=75226) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-31892f4f-def4-4407-9905-0210fbfed9e3 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:356ef305-2a5c-4df3-93ce-51a994422e0b')] {{(pid=75226) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:356ef305-2a5c-4df3-93ce-51a994422e0b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=19ab5b1d-3481-4ff4-afa0-c39d098bd729) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:356ef305-2a5c-4df3-93ce-51a994422e0b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb9999a0-8322-4884-ad69-eb52574dfea4]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-31892f4f-def4-4407-9905-0210fbfed9e3 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:356ef305-2a5c-4df3-93ce-51a994422e0b -p 172.16.0.220:3260 --logout {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:19:56 user nova-compute[75226]: INFO os_vif [None req-c77c2bf8-c00d-4ba7-8ee2-f504accdaabf tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:b6:0c,bridge_name='br-int',has_traffic_filtering=True,id=8a548a9b-874e-4c7c-bf06-6896dd773ce4,network=Network(df3c1bab-64f6-49c0-b35a-396881f5862f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8a548a9b-87')
Nov 17 01:19:56 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-c77c2bf8-c00d-4ba7-8ee2-f504accdaabf tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-17T01:17:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1660208825',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1660208825',id=10,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO4+E9QOiUnWNUKrI+j17EMQbFyLd21Wqpo/hRvSEijsTxwF94lMxe3826dGGI7fte9gqEiKOU9O8ocJVagllay2w4NWQRzLkq112cs0QLNwHnmiDDocCj/FpieRw6NKiw==',key_name='tempest-keypair-413268072',keypairs=<?>,launch_index=0,launched_at=2023-11-17T01:18:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='871db3f789ac470c877456108324c68c',ramdisk_id='',reservation_id='r-e00nhfhr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1790286385',owner_user_name='tempest-TaggedBootDevicesTest-1790286385-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T01:18:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b54686e817042a28596953dde26d329',uuid=27342ec6-7a03-4f99-8056-5cb56794aa41,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "01625fc1-9bbc-4edc-b594-78658e91edd9", "address": "fa:16:3e:13:8d:33", "network": {"id": "df3c1bab-64f6-49c0-b35a-396881f5862f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1354339680", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.68", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "871db3f789ac470c877456108324c68c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01625fc1-9b", "ovs_interfaceid": "01625fc1-9bbc-4edc-b594-78658e91edd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75226) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-c77c2bf8-c00d-4ba7-8ee2-f504accdaabf tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Converting VIF {"id": "01625fc1-9bbc-4edc-b594-78658e91edd9", "address": "fa:16:3e:13:8d:33", "network": {"id": "df3c1bab-64f6-49c0-b35a-396881f5862f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1354339680", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.68", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "871db3f789ac470c877456108324c68c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01625fc1-9b", "ovs_interfaceid": "01625fc1-9bbc-4edc-b594-78658e91edd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-c77c2bf8-c00d-4ba7-8ee2-f504accdaabf tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:8d:33,bridge_name='br-int',has_traffic_filtering=True,id=01625fc1-9bbc-4edc-b594-78658e91edd9,network=Network(df3c1bab-64f6-49c0-b35a-396881f5862f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap01625fc1-9b') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG os_vif [None req-c77c2bf8-c00d-4ba7-8ee2-f504accdaabf tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:8d:33,bridge_name='br-int',has_traffic_filtering=True,id=01625fc1-9bbc-4edc-b594-78658e91edd9,network=Network(df3c1bab-64f6-49c0-b35a-396881f5862f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap01625fc1-9b') {{(pid=75226) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap01625fc1-9b, bridge=br-int, if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:356ef305-2a5c-4df3-93ce-51a994422e0b -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[4907a208-4c6a-4ebb-9eba-393befc4f475]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:356ef305-2a5c-4df3-93ce-51a994422e0b, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:356ef305-2a5c-4df3-93ce-51a994422e0b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-31892f4f-def4-4407-9905-0210fbfed9e3 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:356ef305-2a5c-4df3-93ce-51a994422e0b, portal: 172.16.0.220,3260]
Nov 17 01:19:56 user nova-compute[75226]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:356ef305-2a5c-4df3-93ce-51a994422e0b, portal: 172.16.0.220,3260] successful.
Nov 17 01:19:56 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:356ef305-2a5c-4df3-93ce-51a994422e0b -p 172.16.0.220:3260 --op delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=82f8950a-5aea-476d-85e7-267f79a87075) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:356ef305-2a5c-4df3-93ce-51a994422e0b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[628ae2a7-dc04-4e84-bd5b-82da0b3d4a35]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-31892f4f-def4-4407-9905-0210fbfed9e3 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-31892f4f-def4-4407-9905-0210fbfed9e3 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.402s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-31892f4f-def4-4407-9905-0210fbfed9e3 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] <== disconnect_volume: return (404ms) None {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-31892f4f-def4-4407-9905-0210fbfed9e3 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] [instance: e7830f7a-80f1-4c2f-bd64-363e6dd9114a] Disconnected iSCSI Volume {{(pid=75226) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-a3ceb72a-9f51-49f6-9512-80e176adbcd7 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.306s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fbbc6de-085e-4a54-aa6b-911d6ef3443a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:801ff813-83ea-4d9e-a8d2-ed4146b22b52\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0e860a72-9a6d-4889-8210-beafd1f879c7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3ceb72a-9f51-49f6-9512-80e176adbcd7 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 17 01:19:56 user nova-compute[75226]: No targets found.
Nov 17 01:19:56 user nova-compute[75226]: iSNS:
Nov 17 01:19:56 user nova-compute[75226]: No targets found.
Nov 17 01:19:56 user nova-compute[75226]: STATIC:
Nov 17 01:19:56 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:801ff813-83ea-4d9e-a8d2-ed4146b22b52
Nov 17 01:19:56 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:19:56 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:19:56 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:0e860a72-9a6d-4889-8210-beafd1f879c7
Nov 17 01:19:56 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:19:56 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:19:56 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae
Nov 17 01:19:56 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:19:56 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:19:56 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1
Nov 17 01:19:56 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:19:56 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:19:56 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95
Nov 17 01:19:56 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:19:56 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:19:56 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6
Nov 17 01:19:56 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:19:56 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:19:56 user nova-compute[75226]: FIRMWARE:
Nov 17 01:19:56 user nova-compute[75226]: No targets found.
Nov 17 01:19:56 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3ceb72a-9f51-49f6-9512-80e176adbcd7 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 17 01:19:56 user nova-compute[75226]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 17 01:19:56 user nova-compute[75226]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75226) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3ceb72a-9f51-49f6-9512-80e176adbcd7 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0e860a72-9a6d-4889-8210-beafd1f879c7', 0)] {{(pid=75226) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 17 01:19:56 user nova-compute[75226]: INFO os_vif [None req-c77c2bf8-c00d-4ba7-8ee2-f504accdaabf tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:8d:33,bridge_name='br-int',has_traffic_filtering=True,id=01625fc1-9bbc-4edc-b594-78658e91edd9,network=Network(df3c1bab-64f6-49c0-b35a-396881f5862f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap01625fc1-9b')
Nov 17 01:19:56 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-c77c2bf8-c00d-4ba7-8ee2-f504accdaabf tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-17T01:17:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1660208825',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1660208825',id=10,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO4+E9QOiUnWNUKrI+j17EMQbFyLd21Wqpo/hRvSEijsTxwF94lMxe3826dGGI7fte9gqEiKOU9O8ocJVagllay2w4NWQRzLkq112cs0QLNwHnmiDDocCj/FpieRw6NKiw==',key_name='tempest-keypair-413268072',keypairs=<?>,launch_index=0,launched_at=2023-11-17T01:18:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='871db3f789ac470c877456108324c68c',ramdisk_id='',reservation_id='r-e00nhfhr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1790286385',owner_user_name='tempest-TaggedBootDevicesTest-1790286385-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T01:18:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b54686e817042a28596953dde26d329',uuid=27342ec6-7a03-4f99-8056-5cb56794aa41,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3e4d946c-158b-49e8-a349-44da4864f830", "address": "fa:16:3e:65:64:f1", "network": {"id": "df3c1bab-64f6-49c0-b35a-396881f5862f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1354339680", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "871db3f789ac470c877456108324c68c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e4d946c-15", "ovs_interfaceid": "3e4d946c-158b-49e8-a349-44da4864f830", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-c77c2bf8-c00d-4ba7-8ee2-f504accdaabf tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Converting VIF {"id": "3e4d946c-158b-49e8-a349-44da4864f830", "address": "fa:16:3e:65:64:f1", "network": {"id": "df3c1bab-64f6-49c0-b35a-396881f5862f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1354339680", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "871db3f789ac470c877456108324c68c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e4d946c-15", "ovs_interfaceid": "3e4d946c-158b-49e8-a349-44da4864f830", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-c77c2bf8-c00d-4ba7-8ee2-f504accdaabf tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:64:f1,bridge_name='br-int',has_traffic_filtering=True,id=3e4d946c-158b-49e8-a349-44da4864f830,network=Network(df3c1bab-64f6-49c0-b35a-396881f5862f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e4d946c-15') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG os_vif [None req-c77c2bf8-c00d-4ba7-8ee2-f504accdaabf tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:64:f1,bridge_name='br-int',has_traffic_filtering=True,id=3e4d946c-158b-49e8-a349-44da4864f830,network=Network(df3c1bab-64f6-49c0-b35a-396881f5862f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e4d946c-15') {{(pid=75226) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3e4d946c-15, bridge=br-int, if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e752b86-07ce-4b27-b8ba-3e5d88d86d34]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0e860a72-9a6d-4889-8210-beafd1f879c7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:801ff813-83ea-4d9e-a8d2-ed4146b22b52\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5e68d517-90e1-4ac6-810e-934a48b3fe72) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4c671bc-dd79-404a-bfe5-e09a4098ea47]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e860a72-9a6d-4889-8210-beafd1f879c7 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:801ff813-83ea-4d9e-a8d2-ed4146b22b52 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3ceb72a-9f51-49f6-9512-80e176adbcd7 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e860a72-9a6d-4889-8210-beafd1f879c7 (non-flash)
Nov 17 01:19:56 user nova-compute[75226]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:801ff813-83ea-4d9e-a8d2-ed4146b22b52 (non-flash)
Nov 17 01:19:56 user nova-compute[75226]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95 (non-flash)
Nov 17 01:19:56 user nova-compute[75226]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae (non-flash)
Nov 17 01:19:56 user nova-compute[75226]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1 (non-flash)
Nov 17 01:19:56 user nova-compute[75226]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6 (non-flash)
Nov 17 01:19:56 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3ceb72a-9f51-49f6-9512-80e176adbcd7 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e860a72-9a6d-4889-8210-beafd1f879c7 (non-flash)
Nov 17 01:19:56 user nova-compute[75226]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:801ff813-83ea-4d9e-a8d2-ed4146b22b52 (non-flash)
Nov 17 01:19:56 user nova-compute[75226]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95 (non-flash)
Nov 17 01:19:56 user nova-compute[75226]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae (non-flash)
Nov 17 01:19:56 user nova-compute[75226]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1 (non-flash)
Nov 17 01:19:56 user nova-compute[75226]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6 (non-flash)
Nov 17 01:19:56 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3ceb72a-9f51-49f6-9512-80e176adbcd7 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc4b445a8c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0e860a72-9a6d-4889-8210-beafd1f879c7'): ({'sdb'}, set())}) {{(pid=75226) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-a3ceb72a-9f51-49f6-9512-80e176adbcd7 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] Removing single pathed devices sdb {{(pid=75226) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a685050-7042-41d7-b248-50d2b734f89d]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:56 user nova-compute[75226]: INFO os_vif [None req-c77c2bf8-c00d-4ba7-8ee2-f504accdaabf tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:64:f1,bridge_name='br-int',has_traffic_filtering=True,id=3e4d946c-158b-49e8-a349-44da4864f830,network=Network(df3c1bab-64f6-49c0-b35a-396881f5862f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e4d946c-15')
Nov 17 01:19:56 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-c77c2bf8-c00d-4ba7-8ee2-f504accdaabf tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-17T01:17:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1660208825',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1660208825',id=10,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO4+E9QOiUnWNUKrI+j17EMQbFyLd21Wqpo/hRvSEijsTxwF94lMxe3826dGGI7fte9gqEiKOU9O8ocJVagllay2w4NWQRzLkq112cs0QLNwHnmiDDocCj/FpieRw6NKiw==',key_name='tempest-keypair-413268072',keypairs=<?>,launch_index=0,launched_at=2023-11-17T01:18:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='871db3f789ac470c877456108324c68c',ramdisk_id='',reservation_id='r-e00nhfhr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1790286385',owner_user_name='tempest-TaggedBootDevicesTest-1790286385-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T01:18:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b54686e817042a28596953dde26d329',uuid=27342ec6-7a03-4f99-8056-5cb56794aa41,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3b1855a6-8a37-47af-b3e6-86e60eb05a1d", "address": "fa:16:3e:5e:6d:29", "network": {"id": "df3c1bab-64f6-49c0-b35a-396881f5862f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1354339680", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "871db3f789ac470c877456108324c68c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b1855a6-8a", "ovs_interfaceid": "3b1855a6-8a37-47af-b3e6-86e60eb05a1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-c77c2bf8-c00d-4ba7-8ee2-f504accdaabf tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Converting VIF {"id": "3b1855a6-8a37-47af-b3e6-86e60eb05a1d", "address": "fa:16:3e:5e:6d:29", "network": {"id": "df3c1bab-64f6-49c0-b35a-396881f5862f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1354339680", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "871db3f789ac470c877456108324c68c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b1855a6-8a", "ovs_interfaceid": "3b1855a6-8a37-47af-b3e6-86e60eb05a1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-c77c2bf8-c00d-4ba7-8ee2-f504accdaabf tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:6d:29,bridge_name='br-int',has_traffic_filtering=True,id=3b1855a6-8a37-47af-b3e6-86e60eb05a1d,network=Network(df3c1bab-64f6-49c0-b35a-396881f5862f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b1855a6-8a') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG os_vif [None req-c77c2bf8-c00d-4ba7-8ee2-f504accdaabf tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:6d:29,bridge_name='br-int',has_traffic_filtering=True,id=3b1855a6-8a37-47af-b3e6-86e60eb05a1d,network=Network(df3c1bab-64f6-49c0-b35a-396881f5862f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b1855a6-8a') {{(pid=75226) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3b1855a6-8a, bridge=br-int, if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7aaa6b9-0199-44af-912f-5728420b4dec]: (4, ('ok\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-a3ceb72a-9f51-49f6-9512-80e176adbcd7 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] Flushing IO for device /dev/sdb {{(pid=75226) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8b3ff028-68a8-40bc-a7fb-18ecec4978d2) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[04e53735-3cb7-48e6-9cb4-cc1fa413808b]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-a3ceb72a-9f51-49f6-9512-80e176adbcd7 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75226) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:19:56 user nova-compute[75226]: INFO os_vif [None req-c77c2bf8-c00d-4ba7-8ee2-f504accdaabf tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:6d:29,bridge_name='br-int',has_traffic_filtering=True,id=3b1855a6-8a37-47af-b3e6-86e60eb05a1d,network=Network(df3c1bab-64f6-49c0-b35a-396881f5862f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b1855a6-8a')
Nov 17 01:19:56 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-c77c2bf8-c00d-4ba7-8ee2-f504accdaabf tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-17T01:17:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1660208825',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1660208825',id=10,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO4+E9QOiUnWNUKrI+j17EMQbFyLd21Wqpo/hRvSEijsTxwF94lMxe3826dGGI7fte9gqEiKOU9O8ocJVagllay2w4NWQRzLkq112cs0QLNwHnmiDDocCj/FpieRw6NKiw==',key_name='tempest-keypair-413268072',keypairs=<?>,launch_index=0,launched_at=2023-11-17T01:18:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='871db3f789ac470c877456108324c68c',ramdisk_id='',reservation_id='r-e00nhfhr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1790286385',owner_user_name='tempest-TaggedBootDevicesTest-1790286385-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T01:18:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b54686e817042a28596953dde26d329',uuid=27342ec6-7a03-4f99-8056-5cb56794aa41,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3c1a838d-e1c6-44d3-ab8a-a545044545a3", "address": "fa:16:3e:47:9b:84", "network": {"id": "b92e4d90-c7bd-45d6-a9db-d4b27ce718c5", "bridge": "br-int", "label": "tempest-device-tagging-net2-541044549", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "871db3f789ac470c877456108324c68c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c1a838d-e1", "ovs_interfaceid": "3c1a838d-e1c6-44d3-ab8a-a545044545a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-c77c2bf8-c00d-4ba7-8ee2-f504accdaabf tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Converting VIF {"id": "3c1a838d-e1c6-44d3-ab8a-a545044545a3", "address": "fa:16:3e:47:9b:84", "network": {"id": "b92e4d90-c7bd-45d6-a9db-d4b27ce718c5", "bridge": "br-int", "label": "tempest-device-tagging-net2-541044549", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "871db3f789ac470c877456108324c68c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c1a838d-e1", "ovs_interfaceid": "3c1a838d-e1c6-44d3-ab8a-a545044545a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-c77c2bf8-c00d-4ba7-8ee2-f504accdaabf tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:9b:84,bridge_name='br-int',has_traffic_filtering=True,id=3c1a838d-e1c6-44d3-ab8a-a545044545a3,network=Network(b92e4d90-c7bd-45d6-a9db-d4b27ce718c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c1a838d-e1') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG os_vif [None req-c77c2bf8-c00d-4ba7-8ee2-f504accdaabf tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:9b:84,bridge_name='br-int',has_traffic_filtering=True,id=3c1a838d-e1c6-44d3-ab8a-a545044545a3,network=Network(b92e4d90-c7bd-45d6-a9db-d4b27ce718c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c1a838d-e1') {{(pid=75226) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3c1a838d-e1, bridge=br-int, if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=59e01836-dd96-451c-a518-b99bb9c155d0) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[6566e2ba-671e-4f36-b091-5e1fe43e2473]: (4, ('1', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-a3ceb72a-9f51-49f6-9512-80e176adbcd7 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] Checking to see if SCSI volumes sdb have been removed. {{(pid=75226) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-a3ceb72a-9f51-49f6-9512-80e176adbcd7 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] SCSI volumes sdb have been removed. {{(pid=75226) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3ceb72a-9f51-49f6-9512-80e176adbcd7 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0e860a72-9a6d-4889-8210-beafd1f879c7')] {{(pid=75226) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e860a72-9a6d-4889-8210-beafd1f879c7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:19:56 user nova-compute[75226]: INFO os_vif [None req-c77c2bf8-c00d-4ba7-8ee2-f504accdaabf tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:9b:84,bridge_name='br-int',has_traffic_filtering=True,id=3c1a838d-e1c6-44d3-ab8a-a545044545a3,network=Network(b92e4d90-c7bd-45d6-a9db-d4b27ce718c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c1a838d-e1')
Nov 17 01:19:56 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-c77c2bf8-c00d-4ba7-8ee2-f504accdaabf tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-17T01:17:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1660208825',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1660208825',id=10,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO4+E9QOiUnWNUKrI+j17EMQbFyLd21Wqpo/hRvSEijsTxwF94lMxe3826dGGI7fte9gqEiKOU9O8ocJVagllay2w4NWQRzLkq112cs0QLNwHnmiDDocCj/FpieRw6NKiw==',key_name='tempest-keypair-413268072',keypairs=<?>,launch_index=0,launched_at=2023-11-17T01:18:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='871db3f789ac470c877456108324c68c',ramdisk_id='',reservation_id='r-e00nhfhr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1790286385',owner_user_name='tempest-TaggedBootDevicesTest-1790286385-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T01:18:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b54686e817042a28596953dde26d329',uuid=27342ec6-7a03-4f99-8056-5cb56794aa41,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "11a81061-cde2-4e09-88e4-678aead09ad5", "address": "fa:16:3e:77:77:72", "network": {"id": "b92e4d90-c7bd-45d6-a9db-d4b27ce718c5", "bridge": "br-int", "label": "tempest-device-tagging-net2-541044549", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "871db3f789ac470c877456108324c68c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11a81061-cd", "ovs_interfaceid": "11a81061-cde2-4e09-88e4-678aead09ad5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-c77c2bf8-c00d-4ba7-8ee2-f504accdaabf tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Converting VIF {"id": "11a81061-cde2-4e09-88e4-678aead09ad5", "address": "fa:16:3e:77:77:72", "network": {"id": "b92e4d90-c7bd-45d6-a9db-d4b27ce718c5", "bridge": "br-int", "label": "tempest-device-tagging-net2-541044549", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "871db3f789ac470c877456108324c68c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11a81061-cd", "ovs_interfaceid": "11a81061-cde2-4e09-88e4-678aead09ad5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-c77c2bf8-c00d-4ba7-8ee2-f504accdaabf tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:77:72,bridge_name='br-int',has_traffic_filtering=True,id=11a81061-cde2-4e09-88e4-678aead09ad5,network=Network(b92e4d90-c7bd-45d6-a9db-d4b27ce718c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11a81061-cd') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG os_vif [None req-c77c2bf8-c00d-4ba7-8ee2-f504accdaabf tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:77:72,bridge_name='br-int',has_traffic_filtering=True,id=11a81061-cde2-4e09-88e4-678aead09ad5,network=Network(b92e4d90-c7bd-45d6-a9db-d4b27ce718c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11a81061-cd') {{(pid=75226) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e860a72-9a6d-4889-8210-beafd1f879c7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap11a81061-cd, bridge=br-int, if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[c544f89b-950f-47e5-9b36-7e44bd0f8cdf]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3ceb72a-9f51-49f6-9512-80e176adbcd7 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e860a72-9a6d-4889-8210-beafd1f879c7 -p 172.16.0.220:3260 --logout {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8b44fe87-c611-4675-99df-4493d2f4ffae) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:19:56 user nova-compute[75226]: INFO os_vif [None req-c77c2bf8-c00d-4ba7-8ee2-f504accdaabf tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:77:72,bridge_name='br-int',has_traffic_filtering=True,id=11a81061-cde2-4e09-88e4-678aead09ad5,network=Network(b92e4d90-c7bd-45d6-a9db-d4b27ce718c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11a81061-cd')
Nov 17 01:19:56 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c77c2bf8-c00d-4ba7-8ee2-f504accdaabf tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] calling os-brick to detach iSCSI Volume {{(pid=75226) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-c77c2bf8-c00d-4ba7-8ee2-f504accdaabf tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc4cc36b490>, {'target_iqn': 'iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LvBusbOF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:19:56 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-c77c2bf8-c00d-4ba7-8ee2-f504accdaabf tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:19:56 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-c77c2bf8-c00d-4ba7-8ee2-f504accdaabf tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG nova.compute.manager [req-5849eaef-b5ba-4427-8cb1-39b9804f73b5 req-7c2a9fa8-1541-4ee7-bf6d-b302681badc0 service nova] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Received event network-vif-plugged-6337887b-565a-4dc6-9a4f-4c8d9ac1c901 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-5849eaef-b5ba-4427-8cb1-39b9804f73b5 req-7c2a9fa8-1541-4ee7-bf6d-b302681badc0 service nova] Acquiring lock "27342ec6-7a03-4f99-8056-5cb56794aa41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-5849eaef-b5ba-4427-8cb1-39b9804f73b5 req-7c2a9fa8-1541-4ee7-bf6d-b302681badc0 service nova] Lock "27342ec6-7a03-4f99-8056-5cb56794aa41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-5849eaef-b5ba-4427-8cb1-39b9804f73b5 req-7c2a9fa8-1541-4ee7-bf6d-b302681badc0 service nova] Lock "27342ec6-7a03-4f99-8056-5cb56794aa41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG nova.compute.manager [req-5849eaef-b5ba-4427-8cb1-39b9804f73b5 req-7c2a9fa8-1541-4ee7-bf6d-b302681badc0 service nova] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] No waiting events found dispatching network-vif-plugged-6337887b-565a-4dc6-9a4f-4c8d9ac1c901 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:19:56 user nova-compute[75226]: WARNING nova.compute.manager [req-5849eaef-b5ba-4427-8cb1-39b9804f73b5 req-7c2a9fa8-1541-4ee7-bf6d-b302681badc0 service nova] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Received unexpected event network-vif-plugged-6337887b-565a-4dc6-9a4f-4c8d9ac1c901 for instance with vm_state active and task_state deleting.
Nov 17 01:19:56 user nova-compute[75226]: DEBUG nova.compute.manager [req-5849eaef-b5ba-4427-8cb1-39b9804f73b5 req-7c2a9fa8-1541-4ee7-bf6d-b302681badc0 service nova] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Received event network-vif-unplugged-3b1855a6-8a37-47af-b3e6-86e60eb05a1d {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-5849eaef-b5ba-4427-8cb1-39b9804f73b5 req-7c2a9fa8-1541-4ee7-bf6d-b302681badc0 service nova] Acquiring lock "27342ec6-7a03-4f99-8056-5cb56794aa41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-5849eaef-b5ba-4427-8cb1-39b9804f73b5 req-7c2a9fa8-1541-4ee7-bf6d-b302681badc0 service nova] Lock "27342ec6-7a03-4f99-8056-5cb56794aa41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-5849eaef-b5ba-4427-8cb1-39b9804f73b5 req-7c2a9fa8-1541-4ee7-bf6d-b302681badc0 service nova] Lock "27342ec6-7a03-4f99-8056-5cb56794aa41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG nova.compute.manager [req-5849eaef-b5ba-4427-8cb1-39b9804f73b5 req-7c2a9fa8-1541-4ee7-bf6d-b302681badc0 service nova] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] No waiting events found dispatching network-vif-unplugged-3b1855a6-8a37-47af-b3e6-86e60eb05a1d {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG nova.compute.manager [req-5849eaef-b5ba-4427-8cb1-39b9804f73b5 req-7c2a9fa8-1541-4ee7-bf6d-b302681badc0 service nova] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Received event network-vif-unplugged-3b1855a6-8a37-47af-b3e6-86e60eb05a1d for instance with task_state deleting. {{(pid=75226) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG nova.compute.manager [req-5849eaef-b5ba-4427-8cb1-39b9804f73b5 req-7c2a9fa8-1541-4ee7-bf6d-b302681badc0 service nova] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Received event network-vif-plugged-3b1855a6-8a37-47af-b3e6-86e60eb05a1d {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-5849eaef-b5ba-4427-8cb1-39b9804f73b5 req-7c2a9fa8-1541-4ee7-bf6d-b302681badc0 service nova] Acquiring lock "27342ec6-7a03-4f99-8056-5cb56794aa41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-5849eaef-b5ba-4427-8cb1-39b9804f73b5 req-7c2a9fa8-1541-4ee7-bf6d-b302681badc0 service nova] Lock "27342ec6-7a03-4f99-8056-5cb56794aa41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-5849eaef-b5ba-4427-8cb1-39b9804f73b5 req-7c2a9fa8-1541-4ee7-bf6d-b302681badc0 service nova] Lock "27342ec6-7a03-4f99-8056-5cb56794aa41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG nova.compute.manager [req-5849eaef-b5ba-4427-8cb1-39b9804f73b5 req-7c2a9fa8-1541-4ee7-bf6d-b302681badc0 service nova] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] No waiting events found dispatching network-vif-plugged-3b1855a6-8a37-47af-b3e6-86e60eb05a1d {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:19:56 user nova-compute[75226]: WARNING nova.compute.manager [req-5849eaef-b5ba-4427-8cb1-39b9804f73b5 req-7c2a9fa8-1541-4ee7-bf6d-b302681badc0 service nova] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Received unexpected event network-vif-plugged-3b1855a6-8a37-47af-b3e6-86e60eb05a1d for instance with vm_state active and task_state deleting.
Nov 17 01:19:56 user nova-compute[75226]: DEBUG nova.compute.manager [req-5849eaef-b5ba-4427-8cb1-39b9804f73b5 req-7c2a9fa8-1541-4ee7-bf6d-b302681badc0 service nova] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Received event network-vif-unplugged-11a81061-cde2-4e09-88e4-678aead09ad5 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-5849eaef-b5ba-4427-8cb1-39b9804f73b5 req-7c2a9fa8-1541-4ee7-bf6d-b302681badc0 service nova] Acquiring lock "27342ec6-7a03-4f99-8056-5cb56794aa41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-5849eaef-b5ba-4427-8cb1-39b9804f73b5 req-7c2a9fa8-1541-4ee7-bf6d-b302681badc0 service nova] Lock "27342ec6-7a03-4f99-8056-5cb56794aa41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-5849eaef-b5ba-4427-8cb1-39b9804f73b5 req-7c2a9fa8-1541-4ee7-bf6d-b302681badc0 service nova] Lock "27342ec6-7a03-4f99-8056-5cb56794aa41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG nova.compute.manager [req-5849eaef-b5ba-4427-8cb1-39b9804f73b5 req-7c2a9fa8-1541-4ee7-bf6d-b302681badc0 service nova] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] No waiting events found dispatching network-vif-unplugged-11a81061-cde2-4e09-88e4-678aead09ad5 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG nova.compute.manager [req-5849eaef-b5ba-4427-8cb1-39b9804f73b5 req-7c2a9fa8-1541-4ee7-bf6d-b302681badc0 service nova] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Received event network-vif-unplugged-11a81061-cde2-4e09-88e4-678aead09ad5 for instance with task_state deleting. {{(pid=75226) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG nova.compute.manager [req-5849eaef-b5ba-4427-8cb1-39b9804f73b5 req-7c2a9fa8-1541-4ee7-bf6d-b302681badc0 service nova] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Received event network-vif-plugged-11a81061-cde2-4e09-88e4-678aead09ad5 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-5849eaef-b5ba-4427-8cb1-39b9804f73b5 req-7c2a9fa8-1541-4ee7-bf6d-b302681badc0 service nova] Acquiring lock "27342ec6-7a03-4f99-8056-5cb56794aa41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-5849eaef-b5ba-4427-8cb1-39b9804f73b5 req-7c2a9fa8-1541-4ee7-bf6d-b302681badc0 service nova] Lock "27342ec6-7a03-4f99-8056-5cb56794aa41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-5849eaef-b5ba-4427-8cb1-39b9804f73b5 req-7c2a9fa8-1541-4ee7-bf6d-b302681badc0 service nova] Lock "27342ec6-7a03-4f99-8056-5cb56794aa41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG nova.compute.manager [req-5849eaef-b5ba-4427-8cb1-39b9804f73b5 req-7c2a9fa8-1541-4ee7-bf6d-b302681badc0 service nova] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] No waiting events found dispatching network-vif-plugged-11a81061-cde2-4e09-88e4-678aead09ad5 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:19:56 user nova-compute[75226]: WARNING nova.compute.manager [req-5849eaef-b5ba-4427-8cb1-39b9804f73b5 req-7c2a9fa8-1541-4ee7-bf6d-b302681badc0 service nova] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Received unexpected event network-vif-plugged-11a81061-cde2-4e09-88e4-678aead09ad5 for instance with vm_state active and task_state deleting.
Nov 17 01:19:56 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e860a72-9a6d-4889-8210-beafd1f879c7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[2335c598-0571-4b61-bce6-5203eb94d6ed]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:0e860a72-9a6d-4889-8210-beafd1f879c7, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:0e860a72-9a6d-4889-8210-beafd1f879c7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3ceb72a-9f51-49f6-9512-80e176adbcd7 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:0e860a72-9a6d-4889-8210-beafd1f879c7, portal: 172.16.0.220,3260]
Nov 17 01:19:56 user nova-compute[75226]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:0e860a72-9a6d-4889-8210-beafd1f879c7, portal: 172.16.0.220,3260] successful.
Nov 17 01:19:56 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e860a72-9a6d-4889-8210-beafd1f879c7 -p 172.16.0.220:3260 --op delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e860a72-9a6d-4889-8210-beafd1f879c7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb9767dd-e1e8-4294-862c-17f2266e4219]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3ceb72a-9f51-49f6-9512-80e176adbcd7 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-a3ceb72a-9f51-49f6-9512-80e176adbcd7 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.362s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3ceb72a-9f51-49f6-9512-80e176adbcd7 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] <== disconnect_volume: return (668ms) None {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3ceb72a-9f51-49f6-9512-80e176adbcd7 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] [instance: 75b1cabe-ba15-4851-9140-5949afc33005] Disconnected iSCSI Volume {{(pid=75226) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-c77c2bf8-c00d-4ba7-8ee2-f504accdaabf tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.096s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG nova.objects.instance [None req-e3404692-5eb6-438f-93d2-ac97d0a47166 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] Lazy-loading 'flavor' on Instance uuid b054a557-dff6-49f8-9300-1307f8433567 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[add72aa4-ebf7-4df1-84e5-12e0d9cf55fd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:801ff813-83ea-4d9e-a8d2-ed4146b22b52\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-c77c2bf8-c00d-4ba7-8ee2-f504accdaabf tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 17 01:19:56 user nova-compute[75226]: No targets found.
Nov 17 01:19:56 user nova-compute[75226]: iSNS:
Nov 17 01:19:56 user nova-compute[75226]: No targets found.
Nov 17 01:19:56 user nova-compute[75226]: STATIC:
Nov 17 01:19:56 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:801ff813-83ea-4d9e-a8d2-ed4146b22b52
Nov 17 01:19:56 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:19:56 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:19:56 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae
Nov 17 01:19:56 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:19:56 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:19:56 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1
Nov 17 01:19:56 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:19:56 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:19:56 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95
Nov 17 01:19:56 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:19:56 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:19:56 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6
Nov 17 01:19:56 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:19:56 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:19:56 user nova-compute[75226]: FIRMWARE:
Nov 17 01:19:56 user nova-compute[75226]: No targets found.
Nov 17 01:19:56 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-c77c2bf8-c00d-4ba7-8ee2-f504accdaabf tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 17 01:19:56 user nova-compute[75226]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 17 01:19:56 user nova-compute[75226]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75226) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-c77c2bf8-c00d-4ba7-8ee2-f504accdaabf tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae', 0)] {{(pid=75226) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9761d95-e042-452b-ba92-d1a3580ee24a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:801ff813-83ea-4d9e-a8d2-ed4146b22b52\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[21dd2658-faf7-4850-9884-30538d33b015]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:801ff813-83ea-4d9e-a8d2-ed4146b22b52 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-c77c2bf8-c00d-4ba7-8ee2-f504accdaabf tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:801ff813-83ea-4d9e-a8d2-ed4146b22b52 (non-flash)
Nov 17 01:19:56 user nova-compute[75226]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95 (non-flash)
Nov 17 01:19:56 user nova-compute[75226]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae (non-flash)
Nov 17 01:19:56 user nova-compute[75226]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1 (non-flash)
Nov 17 01:19:56 user nova-compute[75226]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6 (non-flash)
Nov 17 01:19:56 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-c77c2bf8-c00d-4ba7-8ee2-f504accdaabf tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:801ff813-83ea-4d9e-a8d2-ed4146b22b52 (non-flash)
Nov 17 01:19:56 user nova-compute[75226]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95 (non-flash)
Nov 17 01:19:56 user nova-compute[75226]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae (non-flash)
Nov 17 01:19:56 user nova-compute[75226]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1 (non-flash)
Nov 17 01:19:56 user nova-compute[75226]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6 (non-flash)
Nov 17 01:19:56 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-c77c2bf8-c00d-4ba7-8ee2-f504accdaabf tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc4b43dacb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae'): ({'sdc'}, set())}) {{(pid=75226) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-c77c2bf8-c00d-4ba7-8ee2-f504accdaabf tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Removing single pathed devices sdc {{(pid=75226) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG nova.compute.manager [None req-a3ceb72a-9f51-49f6-9512-80e176adbcd7 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OsjHbnIp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': '75b1cabe-ba15-4851-9140-5949afc33005', 'attached_at': '', 'detached_at': '', 'volume_id': 'ac3239e4-20ce-43ca-84b3-f5f0a5ffff95', 'serial'} {{(pid=75226) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG nova.compute.manager [None req-a3ceb72a-9f51-49f6-9512-80e176adbcd7 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] [instance: 75b1cabe-ba15-4851-9140-5949afc33005] swap_volume: removing Cinder connection for volume 0e860a72-9a6d-4889-8210-beafd1f879c7 {{(pid=75226) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e3404692-5eb6-438f-93d2-ac97d0a47166 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] Lock "b054a557-dff6-49f8-9300-1307f8433567" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.301s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0acd217-68b9-4fee-a08a-0ac089e09bed]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[e38a7cb6-7da3-4cd5-af82-c0c37da20e72]: (4, ('ok\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-c77c2bf8-c00d-4ba7-8ee2-f504accdaabf tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Flushing IO for device /dev/sdc {{(pid=75226) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG nova.compute.manager [req-8af6622b-8d91-4f7d-8003-c3a60e90acd3 req-59d40fd5-c73a-4ea7-bbb5-2890598d170c service nova] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Received event network-vif-plugged-8a548a9b-874e-4c7c-bf06-6896dd773ce4 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-8af6622b-8d91-4f7d-8003-c3a60e90acd3 req-59d40fd5-c73a-4ea7-bbb5-2890598d170c service nova] Acquiring lock "27342ec6-7a03-4f99-8056-5cb56794aa41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-8af6622b-8d91-4f7d-8003-c3a60e90acd3 req-59d40fd5-c73a-4ea7-bbb5-2890598d170c service nova] Lock "27342ec6-7a03-4f99-8056-5cb56794aa41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-8af6622b-8d91-4f7d-8003-c3a60e90acd3 req-59d40fd5-c73a-4ea7-bbb5-2890598d170c service nova] Lock "27342ec6-7a03-4f99-8056-5cb56794aa41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG nova.compute.manager [req-8af6622b-8d91-4f7d-8003-c3a60e90acd3 req-59d40fd5-c73a-4ea7-bbb5-2890598d170c service nova] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] No waiting events found dispatching network-vif-plugged-8a548a9b-874e-4c7c-bf06-6896dd773ce4 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:19:56 user nova-compute[75226]: WARNING nova.compute.manager [req-8af6622b-8d91-4f7d-8003-c3a60e90acd3 req-59d40fd5-c73a-4ea7-bbb5-2890598d170c service nova] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Received unexpected event network-vif-plugged-8a548a9b-874e-4c7c-bf06-6896dd773ce4 for instance with vm_state active and task_state deleting.
Nov 17 01:19:56 user nova-compute[75226]: DEBUG nova.compute.manager [req-8af6622b-8d91-4f7d-8003-c3a60e90acd3 req-59d40fd5-c73a-4ea7-bbb5-2890598d170c service nova] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Received event network-vif-unplugged-3c1a838d-e1c6-44d3-ab8a-a545044545a3 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-8af6622b-8d91-4f7d-8003-c3a60e90acd3 req-59d40fd5-c73a-4ea7-bbb5-2890598d170c service nova] Acquiring lock "27342ec6-7a03-4f99-8056-5cb56794aa41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-8af6622b-8d91-4f7d-8003-c3a60e90acd3 req-59d40fd5-c73a-4ea7-bbb5-2890598d170c service nova] Lock "27342ec6-7a03-4f99-8056-5cb56794aa41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-8af6622b-8d91-4f7d-8003-c3a60e90acd3 req-59d40fd5-c73a-4ea7-bbb5-2890598d170c service nova] Lock "27342ec6-7a03-4f99-8056-5cb56794aa41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG nova.compute.manager [req-8af6622b-8d91-4f7d-8003-c3a60e90acd3 req-59d40fd5-c73a-4ea7-bbb5-2890598d170c service nova] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] No waiting events found dispatching network-vif-unplugged-3c1a838d-e1c6-44d3-ab8a-a545044545a3 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG nova.compute.manager [req-8af6622b-8d91-4f7d-8003-c3a60e90acd3 req-59d40fd5-c73a-4ea7-bbb5-2890598d170c service nova] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Received event network-vif-unplugged-3c1a838d-e1c6-44d3-ab8a-a545044545a3 for instance with task_state deleting. {{(pid=75226) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG nova.compute.manager [req-8af6622b-8d91-4f7d-8003-c3a60e90acd3 req-59d40fd5-c73a-4ea7-bbb5-2890598d170c service nova] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Received event network-vif-plugged-3c1a838d-e1c6-44d3-ab8a-a545044545a3 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-8af6622b-8d91-4f7d-8003-c3a60e90acd3 req-59d40fd5-c73a-4ea7-bbb5-2890598d170c service nova] Acquiring lock "27342ec6-7a03-4f99-8056-5cb56794aa41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-8af6622b-8d91-4f7d-8003-c3a60e90acd3 req-59d40fd5-c73a-4ea7-bbb5-2890598d170c service nova] Lock "27342ec6-7a03-4f99-8056-5cb56794aa41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-8af6622b-8d91-4f7d-8003-c3a60e90acd3 req-59d40fd5-c73a-4ea7-bbb5-2890598d170c service nova] Lock "27342ec6-7a03-4f99-8056-5cb56794aa41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG nova.compute.manager [req-8af6622b-8d91-4f7d-8003-c3a60e90acd3 req-59d40fd5-c73a-4ea7-bbb5-2890598d170c service nova] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] No waiting events found dispatching network-vif-plugged-3c1a838d-e1c6-44d3-ab8a-a545044545a3 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:19:56 user nova-compute[75226]: WARNING nova.compute.manager [req-8af6622b-8d91-4f7d-8003-c3a60e90acd3 req-59d40fd5-c73a-4ea7-bbb5-2890598d170c service nova] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Received unexpected event network-vif-plugged-3c1a838d-e1c6-44d3-ab8a-a545044545a3 for instance with vm_state active and task_state deleting.
Nov 17 01:19:56 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[b79dfb91-2ad9-479e-87b9-cf801ceb3d62]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-c77c2bf8-c00d-4ba7-8ee2-f504accdaabf tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75226) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG nova.compute.manager [req-46eead0d-1fdb-45a1-b76c-c45efb983610 req-fc92cb81-8d03-4a7c-9b1a-10f16f1ed484 service nova] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Received event network-vif-plugged-01625fc1-9bbc-4edc-b594-78658e91edd9 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-46eead0d-1fdb-45a1-b76c-c45efb983610 req-fc92cb81-8d03-4a7c-9b1a-10f16f1ed484 service nova] Acquiring lock "27342ec6-7a03-4f99-8056-5cb56794aa41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-46eead0d-1fdb-45a1-b76c-c45efb983610 req-fc92cb81-8d03-4a7c-9b1a-10f16f1ed484 service nova] Lock "27342ec6-7a03-4f99-8056-5cb56794aa41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-46eead0d-1fdb-45a1-b76c-c45efb983610 req-fc92cb81-8d03-4a7c-9b1a-10f16f1ed484 service nova] Lock "27342ec6-7a03-4f99-8056-5cb56794aa41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG nova.compute.manager [req-46eead0d-1fdb-45a1-b76c-c45efb983610 req-fc92cb81-8d03-4a7c-9b1a-10f16f1ed484 service nova] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] No waiting events found dispatching network-vif-plugged-01625fc1-9bbc-4edc-b594-78658e91edd9 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:19:56 user nova-compute[75226]: WARNING nova.compute.manager [req-46eead0d-1fdb-45a1-b76c-c45efb983610 req-fc92cb81-8d03-4a7c-9b1a-10f16f1ed484 service nova] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Received unexpected event network-vif-plugged-01625fc1-9bbc-4edc-b594-78658e91edd9 for instance with vm_state active and task_state deleting.
Nov 17 01:19:56 user nova-compute[75226]: DEBUG nova.compute.manager [req-46eead0d-1fdb-45a1-b76c-c45efb983610 req-fc92cb81-8d03-4a7c-9b1a-10f16f1ed484 service nova] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Received event network-vif-unplugged-3e4d946c-158b-49e8-a349-44da4864f830 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-46eead0d-1fdb-45a1-b76c-c45efb983610 req-fc92cb81-8d03-4a7c-9b1a-10f16f1ed484 service nova] Acquiring lock "27342ec6-7a03-4f99-8056-5cb56794aa41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-46eead0d-1fdb-45a1-b76c-c45efb983610 req-fc92cb81-8d03-4a7c-9b1a-10f16f1ed484 service nova] Lock "27342ec6-7a03-4f99-8056-5cb56794aa41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-46eead0d-1fdb-45a1-b76c-c45efb983610 req-fc92cb81-8d03-4a7c-9b1a-10f16f1ed484 service nova] Lock "27342ec6-7a03-4f99-8056-5cb56794aa41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG nova.compute.manager [req-46eead0d-1fdb-45a1-b76c-c45efb983610 req-fc92cb81-8d03-4a7c-9b1a-10f16f1ed484 service nova] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] No waiting events found dispatching network-vif-unplugged-3e4d946c-158b-49e8-a349-44da4864f830 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG nova.compute.manager [req-46eead0d-1fdb-45a1-b76c-c45efb983610 req-fc92cb81-8d03-4a7c-9b1a-10f16f1ed484 service nova] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Received event network-vif-unplugged-3e4d946c-158b-49e8-a349-44da4864f830 for instance with task_state deleting. {{(pid=75226) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG nova.compute.manager [req-46eead0d-1fdb-45a1-b76c-c45efb983610 req-fc92cb81-8d03-4a7c-9b1a-10f16f1ed484 service nova] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Received event network-vif-plugged-3e4d946c-158b-49e8-a349-44da4864f830 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-46eead0d-1fdb-45a1-b76c-c45efb983610 req-fc92cb81-8d03-4a7c-9b1a-10f16f1ed484 service nova] Acquiring lock "27342ec6-7a03-4f99-8056-5cb56794aa41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-46eead0d-1fdb-45a1-b76c-c45efb983610 req-fc92cb81-8d03-4a7c-9b1a-10f16f1ed484 service nova] Lock "27342ec6-7a03-4f99-8056-5cb56794aa41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-46eead0d-1fdb-45a1-b76c-c45efb983610 req-fc92cb81-8d03-4a7c-9b1a-10f16f1ed484 service nova] Lock "27342ec6-7a03-4f99-8056-5cb56794aa41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG nova.compute.manager [req-46eead0d-1fdb-45a1-b76c-c45efb983610 req-fc92cb81-8d03-4a7c-9b1a-10f16f1ed484 service nova] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] No waiting events found dispatching network-vif-plugged-3e4d946c-158b-49e8-a349-44da4864f830 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:19:56 user nova-compute[75226]: WARNING nova.compute.manager [req-46eead0d-1fdb-45a1-b76c-c45efb983610 req-fc92cb81-8d03-4a7c-9b1a-10f16f1ed484 service nova] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Received unexpected event network-vif-plugged-3e4d946c-158b-49e8-a349-44da4864f830 for instance with vm_state active and task_state deleting.
Nov 17 01:19:56 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.051s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2850773-eb5f-408f-b8ce-02d343d12eb1]: (4, ('1', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-c77c2bf8-c00d-4ba7-8ee2-f504accdaabf tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75226) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-c77c2bf8-c00d-4ba7-8ee2-f504accdaabf tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] SCSI volumes sdc have been removed. {{(pid=75226) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-c77c2bf8-c00d-4ba7-8ee2-f504accdaabf tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae')] {{(pid=75226) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba7c3de1-15a6-426c-bde3-6ea16db4a28b]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-c77c2bf8-c00d-4ba7-8ee2-f504accdaabf tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae -p 172.16.0.220:3260 --logout {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcca8338-0ab4-4fb0-8d69-94fb6cb5a269]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-c77c2bf8-c00d-4ba7-8ee2-f504accdaabf tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae, portal: 172.16.0.220,3260]
Nov 17 01:19:56 user nova-compute[75226]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae, portal: 172.16.0.220,3260] successful.
Nov 17 01:19:56 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae -p 172.16.0.220:3260 --op delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02c7942e-c2b6-4cd2-a05d-9e2f3ccdbfae -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9d82146-0f68-4f36-835d-3c44d97710b7]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-c77c2bf8-c00d-4ba7-8ee2-f504accdaabf tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-c77c2bf8-c00d-4ba7-8ee2-f504accdaabf tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.339s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-c77c2bf8-c00d-4ba7-8ee2-f504accdaabf tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] <== disconnect_volume: return (435ms) None {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c77c2bf8-c00d-4ba7-8ee2-f504accdaabf tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Disconnected iSCSI Volume {{(pid=75226) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c77c2bf8-c00d-4ba7-8ee2-f504accdaabf tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] calling os-brick to detach iSCSI Volume {{(pid=75226) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-c77c2bf8-c00d-4ba7-8ee2-f504accdaabf tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc4cc36b490>, {'target_iqn': 'iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fHjPumtD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:19:56 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-c77c2bf8-c00d-4ba7-8ee2-f504accdaabf tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:19:56 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-c77c2bf8-c00d-4ba7-8ee2-f504accdaabf tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-c77c2bf8-c00d-4ba7-8ee2-f504accdaabf tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[982999a9-760a-437f-b96b-2c72d0d134da]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:801ff813-83ea-4d9e-a8d2-ed4146b22b52\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-c77c2bf8-c00d-4ba7-8ee2-f504accdaabf tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 17 01:19:56 user nova-compute[75226]: No targets found.
Nov 17 01:19:56 user nova-compute[75226]: iSNS:
Nov 17 01:19:56 user nova-compute[75226]: No targets found.
Nov 17 01:19:56 user nova-compute[75226]: STATIC:
Nov 17 01:19:56 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:801ff813-83ea-4d9e-a8d2-ed4146b22b52
Nov 17 01:19:56 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:19:56 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:19:56 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1
Nov 17 01:19:56 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:19:56 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:19:56 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95
Nov 17 01:19:56 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:19:56 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:19:56 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6
Nov 17 01:19:56 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:19:56 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:19:56 user nova-compute[75226]: FIRMWARE:
Nov 17 01:19:56 user nova-compute[75226]: No targets found.
Nov 17 01:19:56 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-c77c2bf8-c00d-4ba7-8ee2-f504accdaabf tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 17 01:19:56 user nova-compute[75226]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 17 01:19:56 user nova-compute[75226]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75226) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-c77c2bf8-c00d-4ba7-8ee2-f504accdaabf tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1', 0)] {{(pid=75226) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc1d65d2-1880-429c-92c9-43f15cb480e0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:801ff813-83ea-4d9e-a8d2-ed4146b22b52\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[d00f6ce0-a65f-4e80-b4e2-3b624352752a]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:801ff813-83ea-4d9e-a8d2-ed4146b22b52 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-c77c2bf8-c00d-4ba7-8ee2-f504accdaabf tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:801ff813-83ea-4d9e-a8d2-ed4146b22b52 (non-flash)
Nov 17 01:19:56 user nova-compute[75226]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95 (non-flash)
Nov 17 01:19:56 user nova-compute[75226]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1 (non-flash)
Nov 17 01:19:56 user nova-compute[75226]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6 (non-flash)
Nov 17 01:19:56 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:19:56 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-c77c2bf8-c00d-4ba7-8ee2-f504accdaabf tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:801ff813-83ea-4d9e-a8d2-ed4146b22b52 (non-flash)
Nov 17 01:19:56 user nova-compute[75226]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95 (non-flash)
Nov 17 01:19:56 user nova-compute[75226]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1 (non-flash)
Nov 17 01:19:56 user nova-compute[75226]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6 (non-flash)
Nov 17 01:19:56 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:19:57 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-c77c2bf8-c00d-4ba7-8ee2-f504accdaabf tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc4cc36c5e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1'): ({'sdd'}, set())}) {{(pid=75226) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 17 01:19:57 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-c77c2bf8-c00d-4ba7-8ee2-f504accdaabf tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Removing single pathed devices sdd {{(pid=75226) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 17 01:19:57 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:57 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:57 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd06d370-6337-4d83-bfcd-9422f4809a5c]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:57 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:57 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:57 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[21b93f95-5505-45d5-b969-a51b93225370]: (4, ('ok\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:57 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-c77c2bf8-c00d-4ba7-8ee2-f504accdaabf tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Flushing IO for device /dev/sdd {{(pid=75226) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 17 01:19:57 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:57 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:57 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b1e8104-09bb-4a0a-9088-41c6ff7fa561]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:57 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-c77c2bf8-c00d-4ba7-8ee2-f504accdaabf tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75226) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 17 01:19:57 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:57 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.036s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:57 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[225b9883-cc52-43d6-a64e-6774849abb41]: (4, ('1', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:57 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-c77c2bf8-c00d-4ba7-8ee2-f504accdaabf tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75226) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 17 01:19:57 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-c77c2bf8-c00d-4ba7-8ee2-f504accdaabf tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] SCSI volumes sdd have been removed. {{(pid=75226) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 17 01:19:57 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-c77c2bf8-c00d-4ba7-8ee2-f504accdaabf tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1')] {{(pid=75226) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 17 01:19:57 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:57 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:57 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b8759b4-1860-4d60-92bd-92914b358adf]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:57 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-c77c2bf8-c00d-4ba7-8ee2-f504accdaabf tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:19:57 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1 -p 172.16.0.220:3260 --logout {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:57 user nova-compute[75226]: DEBUG nova.objects.instance [None req-31892f4f-def4-4407-9905-0210fbfed9e3 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] Lazy-loading 'flavor' on Instance uuid e7830f7a-80f1-4c2f-bd64-363e6dd9114a {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:19:57 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:57 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[777a0f9d-e6a7-4bdc-a3a2-4c9adcdea3c7]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:57 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-c77c2bf8-c00d-4ba7-8ee2-f504accdaabf tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1, portal: 172.16.0.220,3260]
Nov 17 01:19:57 user nova-compute[75226]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1, portal: 172.16.0.220,3260] successful.
Nov 17 01:19:57 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:19:57 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1 -p 172.16.0.220:3260 --op delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:57 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-31892f4f-def4-4407-9905-0210fbfed9e3 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] Lock "e7830f7a-80f1-4c2f-bd64-363e6dd9114a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:19:57 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:324e7042-63b3-44d8-b18d-8201b88923a1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:57 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[8025b220-990b-4f9c-830e-cafa970d32e0]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:57 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-c77c2bf8-c00d-4ba7-8ee2-f504accdaabf tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:19:57 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-c77c2bf8-c00d-4ba7-8ee2-f504accdaabf tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.318s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:19:57 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-c77c2bf8-c00d-4ba7-8ee2-f504accdaabf tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] <== disconnect_volume: return (319ms) None {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:19:57 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c77c2bf8-c00d-4ba7-8ee2-f504accdaabf tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Disconnected iSCSI Volume {{(pid=75226) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 17 01:19:57 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c77c2bf8-c00d-4ba7-8ee2-f504accdaabf tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] calling os-brick to detach iSCSI Volume {{(pid=75226) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 17 01:19:57 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-c77c2bf8-c00d-4ba7-8ee2-f504accdaabf tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc4cc36b490>, {'target_iqn': 'iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TrwJzOak', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:19:57 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-c77c2bf8-c00d-4ba7-8ee2-f504accdaabf tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:19:57 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-c77c2bf8-c00d-4ba7-8ee2-f504accdaabf tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:19:57 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-c77c2bf8-c00d-4ba7-8ee2-f504accdaabf tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:19:57 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:57 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:57 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa56fea7-de71-4da5-afb6-dde5660bbe0e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:801ff813-83ea-4d9e-a8d2-ed4146b22b52\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:57 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-c77c2bf8-c00d-4ba7-8ee2-f504accdaabf tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 17 01:19:57 user nova-compute[75226]: No targets found.
Nov 17 01:19:57 user nova-compute[75226]: iSNS:
Nov 17 01:19:57 user nova-compute[75226]: No targets found.
Nov 17 01:19:57 user nova-compute[75226]: STATIC:
Nov 17 01:19:57 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:801ff813-83ea-4d9e-a8d2-ed4146b22b52
Nov 17 01:19:57 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:19:57 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:19:57 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95
Nov 17 01:19:57 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:19:57 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:19:57 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6
Nov 17 01:19:57 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:19:57 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:19:57 user nova-compute[75226]: FIRMWARE:
Nov 17 01:19:57 user nova-compute[75226]: No targets found.
Nov 17 01:19:57 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:19:57 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-c77c2bf8-c00d-4ba7-8ee2-f504accdaabf tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 17 01:19:57 user nova-compute[75226]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 17 01:19:57 user nova-compute[75226]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75226) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 17 01:19:57 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-c77c2bf8-c00d-4ba7-8ee2-f504accdaabf tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6', 0)] {{(pid=75226) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 17 01:19:57 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:57 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:57 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[213d3d32-7241-4ae2-ae60-40933154677d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:801ff813-83ea-4d9e-a8d2-ed4146b22b52\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:57 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:57 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:57 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a9673b8-568c-47f4-8560-55b69ecd6724]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:801ff813-83ea-4d9e-a8d2-ed4146b22b52 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:57 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-c77c2bf8-c00d-4ba7-8ee2-f504accdaabf tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:801ff813-83ea-4d9e-a8d2-ed4146b22b52 (non-flash)
Nov 17 01:19:57 user nova-compute[75226]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95 (non-flash)
Nov 17 01:19:57 user nova-compute[75226]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6 (non-flash)
Nov 17 01:19:57 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:19:57 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-c77c2bf8-c00d-4ba7-8ee2-f504accdaabf tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:801ff813-83ea-4d9e-a8d2-ed4146b22b52 (non-flash)
Nov 17 01:19:57 user nova-compute[75226]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95 (non-flash)
Nov 17 01:19:57 user nova-compute[75226]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6 (non-flash)
Nov 17 01:19:57 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:19:57 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-c77c2bf8-c00d-4ba7-8ee2-f504accdaabf tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc4cc2c2710>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6'): ({'sde'}, set())}) {{(pid=75226) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 17 01:19:57 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-c77c2bf8-c00d-4ba7-8ee2-f504accdaabf tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Removing single pathed devices sde {{(pid=75226) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 17 01:19:57 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:57 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:57 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdad8f3d-42ec-490e-aa86-f2c956c4eb18]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:57 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:57 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:57 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[56ce33e2-8ec2-4744-9e1a-0ef45f8ed58d]: (4, ('ok\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:57 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-c77c2bf8-c00d-4ba7-8ee2-f504accdaabf tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Flushing IO for device /dev/sde {{(pid=75226) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 17 01:19:57 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:57 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:57 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[b41dfcd0-7d31-4888-adcc-b657267ee612]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:57 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-c77c2bf8-c00d-4ba7-8ee2-f504accdaabf tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75226) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 17 01:19:57 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:57 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-5cd66272-c81d-45ab-afd2-cfb674a33329 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] Acquiring lock "interface-b054a557-dff6-49f8-9300-1307f8433567-902fc99d-3d0f-4ce4-8502-b4c2f7617163" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:19:57 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-5cd66272-c81d-45ab-afd2-cfb674a33329 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] Lock "interface-b054a557-dff6-49f8-9300-1307f8433567-902fc99d-3d0f-4ce4-8502-b4c2f7617163" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:19:57 user nova-compute[75226]: DEBUG nova.objects.instance [None req-5cd66272-c81d-45ab-afd2-cfb674a33329 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] Lazy-loading 'flavor' on Instance uuid b054a557-dff6-49f8-9300-1307f8433567 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:19:57 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.048s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:57 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[891e6e72-605a-4963-b0fe-df12557aa215]: (4, ('1', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:57 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-c77c2bf8-c00d-4ba7-8ee2-f504accdaabf tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75226) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 17 01:19:57 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-c77c2bf8-c00d-4ba7-8ee2-f504accdaabf tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] SCSI volumes sde have been removed. {{(pid=75226) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 17 01:19:57 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-c77c2bf8-c00d-4ba7-8ee2-f504accdaabf tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6')] {{(pid=75226) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 17 01:19:57 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:57 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-5cd66272-c81d-45ab-afd2-cfb674a33329 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-17T01:17:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-670055725',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-670055725',id=6,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLQTkAEsiD7vZkLRChcVhMfcWUFr+J4uCStAPtsh5EcOj4Y0TqNu0/N7e0AK98CTHsomeIYjTkrU/pTyfUW55cXvLwMkYssMQNhMJgsr816svkjbGW+OPHRqanQu9/VlCw==',key_name='tempest-keypair-2003198946',keypairs=<?>,launch_index=0,launched_at=2023-11-17T01:17:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f8f5190e0bff4cbb9384c0fb4faf54d4',ramdisk_id='',reservation_id='r-icespjka',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-177886932',owner_user_name='tempest-TaggedAttachmentsTest-177886932-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T01:17:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b59a9221aae44dcbb688294a0483b715',uuid=b054a557-dff6-49f8-9300-1307f8433567,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "902fc99d-3d0f-4ce4-8502-b4c2f7617163", "address": "fa:16:3e:4c:39:60", "network": {"id": "ad4f167b-03ad-46dd-b568-d8478a055559", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1332712448", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f8f5190e0bff4cbb9384c0fb4faf54d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap902fc99d-3d", "ovs_interfaceid": "902fc99d-3d0f-4ce4-8502-b4c2f7617163", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75226) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 01:19:57 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-5cd66272-c81d-45ab-afd2-cfb674a33329 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] Converting VIF {"id": "902fc99d-3d0f-4ce4-8502-b4c2f7617163", "address": "fa:16:3e:4c:39:60", "network": {"id": "ad4f167b-03ad-46dd-b568-d8478a055559", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1332712448", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f8f5190e0bff4cbb9384c0fb4faf54d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap902fc99d-3d", "ovs_interfaceid": "902fc99d-3d0f-4ce4-8502-b4c2f7617163", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:19:57 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-5cd66272-c81d-45ab-afd2-cfb674a33329 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:39:60,bridge_name='br-int',has_traffic_filtering=True,id=902fc99d-3d0f-4ce4-8502-b4c2f7617163,network=Network(ad4f167b-03ad-46dd-b568-d8478a055559),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap902fc99d-3d') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:19:57 user nova-compute[75226]: DEBUG nova.virt.libvirt.guest [None req-5cd66272-c81d-45ab-afd2-cfb674a33329 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:4c:39:60"/><model type="virtio"/><mtu size="1442"/><target dev="tap902fc99d-3d"/></interface> {{(pid=75226) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 17 01:19:57 user nova-compute[75226]: DEBUG nova.virt.libvirt.guest [None req-5cd66272-c81d-45ab-afd2-cfb674a33329 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:4c:39:60"/><model type="virtio"/><mtu size="1442"/><target dev="tap902fc99d-3d"/></interface> {{(pid=75226) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 17 01:19:57 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:19:57 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.037s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:57 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[fca7424d-789d-44a2-ac6c-30a340b1ce19]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:57 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-c77c2bf8-c00d-4ba7-8ee2-f504accdaabf tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:19:57 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-5cd66272-c81d-45ab-afd2-cfb674a33329 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] Attempting to detach device tap902fc99d-3d from instance b054a557-dff6-49f8-9300-1307f8433567 from the persistent domain config. {{(pid=75226) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 17 01:19:57 user nova-compute[75226]: DEBUG nova.virt.libvirt.guest [None req-5cd66272-c81d-45ab-afd2-cfb674a33329 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] detach device xml: <interface type="ethernet">
Nov 17 01:19:57 user nova-compute[75226]:   <mac address="fa:16:3e:4c:39:60"/>
Nov 17 01:19:57 user nova-compute[75226]:   <model type="virtio"/>
Nov 17 01:19:57 user nova-compute[75226]:   <mtu size="1442"/>
Nov 17 01:19:57 user nova-compute[75226]:   <target dev="tap902fc99d-3d"/>
Nov 17 01:19:57 user nova-compute[75226]: </interface>
Nov 17 01:19:57 user nova-compute[75226]:  {{(pid=75226) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 17 01:19:57 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6 -p 172.16.0.220:3260 --logout {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:57 user nova-compute[75226]: DEBUG nova.virt.libvirt.guest [None req-5cd66272-c81d-45ab-afd2-cfb674a33329 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:4c:39:60"/><model type="virtio"/><mtu size="1442"/><target dev="tap902fc99d-3d"/></interface> {{(pid=75226) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 17 01:19:57 user nova-compute[75226]: DEBUG nova.virt.libvirt.guest [None req-5cd66272-c81d-45ab-afd2-cfb674a33329 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:4c:39:60"/><model type="virtio"/><mtu size="1442"/><target dev="tap902fc99d-3d"/></interface>not found in domain: <domain type='kvm' id='6'>
Nov 17 01:19:57 user nova-compute[75226]:   <name>instance-00000006</name>
Nov 17 01:19:57 user nova-compute[75226]:   <uuid>b054a557-dff6-49f8-9300-1307f8433567</uuid>
Nov 17 01:19:57 user nova-compute[75226]:   <metadata>
Nov 17 01:19:57 user nova-compute[75226]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 17 01:19:57 user nova-compute[75226]:   <nova:package version="0.0.0"/>
Nov 17 01:19:57 user nova-compute[75226]:   <nova:name>tempest-device-tagging-server-670055725</nova:name>
Nov 17 01:19:57 user nova-compute[75226]:   <nova:creationTime>2023-11-17 01:19:24</nova:creationTime>
Nov 17 01:19:57 user nova-compute[75226]:   <nova:flavor name="m1.tiny">
Nov 17 01:19:57 user nova-compute[75226]:     <nova:memory>512</nova:memory>
Nov 17 01:19:57 user nova-compute[75226]:     <nova:disk>1</nova:disk>
Nov 17 01:19:57 user nova-compute[75226]:     <nova:swap>0</nova:swap>
Nov 17 01:19:57 user nova-compute[75226]:     <nova:ephemeral>0</nova:ephemeral>
Nov 17 01:19:57 user nova-compute[75226]:     <nova:vcpus>1</nova:vcpus>
Nov 17 01:19:57 user nova-compute[75226]:   </nova:flavor>
Nov 17 01:19:57 user nova-compute[75226]:   <nova:owner>
Nov 17 01:19:57 user nova-compute[75226]:     <nova:user uuid="b59a9221aae44dcbb688294a0483b715">tempest-TaggedAttachmentsTest-177886932-project-member</nova:user>
Nov 17 01:19:57 user nova-compute[75226]:     <nova:project uuid="f8f5190e0bff4cbb9384c0fb4faf54d4">tempest-TaggedAttachmentsTest-177886932</nova:project>
Nov 17 01:19:57 user nova-compute[75226]:   </nova:owner>
Nov 17 01:19:57 user nova-compute[75226]:   <nova:root type="image" uuid="0b369aea-6f3f-4690-9f01-229b90ab6310"/>
Nov 17 01:19:57 user nova-compute[75226]:   <nova:ports>
Nov 17 01:19:57 user nova-compute[75226]:     <nova:port uuid="9be521ab-d517-4746-b6b3-1e4930610165">
Nov 17 01:19:57 user nova-compute[75226]:       <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 17 01:19:57 user nova-compute[75226]:     </nova:port>
Nov 17 01:19:57 user nova-compute[75226]:     <nova:port uuid="902fc99d-3d0f-4ce4-8502-b4c2f7617163">
Nov 17 01:19:57 user nova-compute[75226]:       <nova:ip type="fixed" address="10.10.10.165" ipVersion="4"/>
Nov 17 01:19:57 user nova-compute[75226]:     </nova:port>
Nov 17 01:19:57 user nova-compute[75226]:   </nova:ports>
Nov 17 01:19:57 user nova-compute[75226]: </nova:instance>
Nov 17 01:19:57 user nova-compute[75226]:   </metadata>
Nov 17 01:19:57 user nova-compute[75226]:   <memory unit='KiB'>524288</memory>
Nov 17 01:19:57 user nova-compute[75226]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 17 01:19:57 user nova-compute[75226]:   <vcpu placement='static'>1</vcpu>
Nov 17 01:19:57 user nova-compute[75226]:   <resource>
Nov 17 01:19:57 user nova-compute[75226]:     <partition>/machine</partition>
Nov 17 01:19:57 user nova-compute[75226]:   </resource>
Nov 17 01:19:57 user nova-compute[75226]:   <sysinfo type='smbios'>
Nov 17 01:19:57 user nova-compute[75226]:     <system>
Nov 17 01:19:57 user nova-compute[75226]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 17 01:19:57 user nova-compute[75226]:       <entry name='product'>OpenStack Nova</entry>
Nov 17 01:19:57 user nova-compute[75226]:       <entry name='version'>0.0.0</entry>
Nov 17 01:19:57 user nova-compute[75226]:       <entry name='serial'>b054a557-dff6-49f8-9300-1307f8433567</entry>
Nov 17 01:19:57 user nova-compute[75226]:       <entry name='uuid'>b054a557-dff6-49f8-9300-1307f8433567</entry>
Nov 17 01:19:57 user nova-compute[75226]:       <entry name='family'>Virtual Machine</entry>
Nov 17 01:19:57 user nova-compute[75226]:     </system>
Nov 17 01:19:57 user nova-compute[75226]:   </sysinfo>
Nov 17 01:19:57 user nova-compute[75226]:   <os>
Nov 17 01:19:57 user nova-compute[75226]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 17 01:19:57 user nova-compute[75226]:     <boot dev='hd'/>
Nov 17 01:19:57 user nova-compute[75226]:     <smbios mode='sysinfo'/>
Nov 17 01:19:57 user nova-compute[75226]:   </os>
Nov 17 01:19:57 user nova-compute[75226]:   <features>
Nov 17 01:19:57 user nova-compute[75226]:     <acpi/>
Nov 17 01:19:57 user nova-compute[75226]:     <apic/>
Nov 17 01:19:57 user nova-compute[75226]:     <vmcoreinfo state='on'/>
Nov 17 01:19:57 user nova-compute[75226]:   </features>
Nov 17 01:19:57 user nova-compute[75226]:   <cpu mode='custom' match='exact' check='full'>
Nov 17 01:19:57 user nova-compute[75226]:     <model fallback='forbid'>Nehalem</model>
Nov 17 01:19:57 user nova-compute[75226]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 17 01:19:57 user nova-compute[75226]:     <feature policy='require' name='vme'/>
Nov 17 01:19:57 user nova-compute[75226]:     <feature policy='require' name='x2apic'/>
Nov 17 01:19:57 user nova-compute[75226]:     <feature policy='require' name='hypervisor'/>
Nov 17 01:19:57 user nova-compute[75226]:   </cpu>
Nov 17 01:19:57 user nova-compute[75226]:   <clock offset='utc'>
Nov 17 01:19:57 user nova-compute[75226]:     <timer name='pit' tickpolicy='delay'/>
Nov 17 01:19:57 user nova-compute[75226]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 17 01:19:57 user nova-compute[75226]:     <timer name='hpet' present='no'/>
Nov 17 01:19:57 user nova-compute[75226]:   </clock>
Nov 17 01:19:57 user nova-compute[75226]:   <on_poweroff>destroy</on_poweroff>
Nov 17 01:19:57 user nova-compute[75226]:   <on_reboot>restart</on_reboot>
Nov 17 01:19:57 user nova-compute[75226]:   <on_crash>destroy</on_crash>
Nov 17 01:19:57 user nova-compute[75226]:   <devices>
Nov 17 01:19:57 user nova-compute[75226]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 17 01:19:57 user nova-compute[75226]:     <disk type='file' device='disk'>
Nov 17 01:19:57 user nova-compute[75226]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 17 01:19:57 user nova-compute[75226]:       <source file='/opt/stack/data/nova/instances/b054a557-dff6-49f8-9300-1307f8433567/disk' index='2'/>
Nov 17 01:19:57 user nova-compute[75226]:       <backingStore type='file' index='3'>
Nov 17 01:19:57 user nova-compute[75226]:         <format type='raw'/>
Nov 17 01:19:57 user nova-compute[75226]:         <source file='/opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371'/>
Nov 17 01:19:57 user nova-compute[75226]:         <backingStore/>
Nov 17 01:19:57 user nova-compute[75226]:       </backingStore>
Nov 17 01:19:57 user nova-compute[75226]:       <target dev='vda' bus='virtio'/>
Nov 17 01:19:57 user nova-compute[75226]:       <alias name='virtio-disk0'/>
Nov 17 01:19:57 user nova-compute[75226]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 17 01:19:57 user nova-compute[75226]:     </disk>
Nov 17 01:19:57 user nova-compute[75226]:     <disk type='file' device='cdrom'>
Nov 17 01:19:57 user nova-compute[75226]:       <driver name='qemu' type='raw' cache='none'/>
Nov 17 01:19:57 user nova-compute[75226]:       <source file='/opt/stack/data/nova/instances/b054a557-dff6-49f8-9300-1307f8433567/disk.config' index='1'/>
Nov 17 01:19:57 user nova-compute[75226]:       <backingStore/>
Nov 17 01:19:57 user nova-compute[75226]:       <target dev='hda' bus='ide'/>
Nov 17 01:19:57 user nova-compute[75226]:       <readonly/>
Nov 17 01:19:57 user nova-compute[75226]:       <alias name='ide0-0-0'/>
Nov 17 01:19:57 user nova-compute[75226]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 17 01:19:57 user nova-compute[75226]:     </disk>
Nov 17 01:19:57 user nova-compute[75226]:     <controller type='usb' index='0' model='none'>
Nov 17 01:19:57 user nova-compute[75226]:       <alias name='usb'/>
Nov 17 01:19:57 user nova-compute[75226]:     </controller>
Nov 17 01:19:57 user nova-compute[75226]:     <controller type='pci' index='0' model='pci-root'>
Nov 17 01:19:57 user nova-compute[75226]:       <alias name='pci.0'/>
Nov 17 01:19:57 user nova-compute[75226]:     </controller>
Nov 17 01:19:57 user nova-compute[75226]:     <controller type='ide' index='0'>
Nov 17 01:19:57 user nova-compute[75226]:       <alias name='ide'/>
Nov 17 01:19:57 user nova-compute[75226]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 17 01:19:57 user nova-compute[75226]:     </controller>
Nov 17 01:19:57 user nova-compute[75226]:     <interface type='ethernet'>
Nov 17 01:19:57 user nova-compute[75226]:       <mac address='fa:16:3e:c9:37:0f'/>
Nov 17 01:19:57 user nova-compute[75226]:       <target dev='tap9be521ab-d5'/>
Nov 17 01:19:57 user nova-compute[75226]:       <model type='virtio'/>
Nov 17 01:19:57 user nova-compute[75226]:       <mtu size='1442'/>
Nov 17 01:19:57 user nova-compute[75226]:       <alias name='net0'/>
Nov 17 01:19:57 user nova-compute[75226]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 17 01:19:57 user nova-compute[75226]:     </interface>
Nov 17 01:19:57 user nova-compute[75226]:     <interface type='ethernet'>
Nov 17 01:19:57 user nova-compute[75226]:       <mac address='fa:16:3e:4c:39:60'/>
Nov 17 01:19:57 user nova-compute[75226]:       <target dev='tap902fc99d-3d'/>
Nov 17 01:19:57 user nova-compute[75226]:       <model type='virtio'/>
Nov 17 01:19:57 user nova-compute[75226]:       <mtu size='1442'/>
Nov 17 01:19:57 user nova-compute[75226]:       <alias name='net1'/>
Nov 17 01:19:57 user nova-compute[75226]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Nov 17 01:19:57 user nova-compute[75226]:     </interface>
Nov 17 01:19:57 user nova-compute[75226]:     <serial type='pty'>
Nov 17 01:19:57 user nova-compute[75226]:       <source path='/dev/pts/5'/>
Nov 17 01:19:57 user nova-compute[75226]:       <log file='/opt/stack/data/nova/instances/b054a557-dff6-49f8-9300-1307f8433567/console.log' append='off'/>
Nov 17 01:19:57 user nova-compute[75226]:       <target type='isa-serial' port='0'>
Nov 17 01:19:57 user nova-compute[75226]:         <model name='isa-serial'/>
Nov 17 01:19:57 user nova-compute[75226]:       </target>
Nov 17 01:19:57 user nova-compute[75226]:       <alias name='serial0'/>
Nov 17 01:19:57 user nova-compute[75226]:     </serial>
Nov 17 01:19:57 user nova-compute[75226]:     <console type='pty' tty='/dev/pts/5'>
Nov 17 01:19:57 user nova-compute[75226]:       <source path='/dev/pts/5'/>
Nov 17 01:19:57 user nova-compute[75226]:       <log file='/opt/stack/data/nova/instances/b054a557-dff6-49f8-9300-1307f8433567/console.log' append='off'/>
Nov 17 01:19:57 user nova-compute[75226]:       <target type='serial' port='0'/>
Nov 17 01:19:57 user nova-compute[75226]:       <alias name='serial0'/>
Nov 17 01:19:57 user nova-compute[75226]:     </console>
Nov 17 01:19:57 user nova-compute[75226]:     <input type='mouse' bus='ps2'>
Nov 17 01:19:57 user nova-compute[75226]:       <alias name='input0'/>
Nov 17 01:19:57 user nova-compute[75226]:     </input>
Nov 17 01:19:57 user nova-compute[75226]:     <input type='keyboard' bus='ps2'>
Nov 17 01:19:57 user nova-compute[75226]:       <alias name='input1'/>
Nov 17 01:19:57 user nova-compute[75226]:     </input>
Nov 17 01:19:57 user nova-compute[75226]:     <graphics type='vnc' port='5905' autoport='yes' listen='0.0.0.0'>
Nov 17 01:19:57 user nova-compute[75226]:       <listen type='address' address='0.0.0.0'/>
Nov 17 01:19:57 user nova-compute[75226]:     </graphics>
Nov 17 01:19:57 user nova-compute[75226]:     <audio id='1' type='none'/>
Nov 17 01:19:57 user nova-compute[75226]:     <video>
Nov 17 01:19:57 user nova-compute[75226]:       <model type='virtio' heads='1' primary='yes'/>
Nov 17 01:19:57 user nova-compute[75226]:       <alias name='video0'/>
Nov 17 01:19:57 user nova-compute[75226]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 17 01:19:57 user nova-compute[75226]:     </video>
Nov 17 01:19:57 user nova-compute[75226]:     <memballoon model='virtio'>
Nov 17 01:19:57 user nova-compute[75226]:       <stats period='10'/>
Nov 17 01:19:57 user nova-compute[75226]:       <alias name='balloon0'/>
Nov 17 01:19:57 user nova-compute[75226]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 17 01:19:57 user nova-compute[75226]:     </memballoon>
Nov 17 01:19:57 user nova-compute[75226]:     <rng model='virtio'>
Nov 17 01:19:57 user nova-compute[75226]:       <backend model='random'>/dev/urandom</backend>
Nov 17 01:19:57 user nova-compute[75226]:       <alias name='rng0'/>
Nov 17 01:19:57 user nova-compute[75226]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 17 01:19:57 user nova-compute[75226]:     </rng>
Nov 17 01:19:57 user nova-compute[75226]:   </devices>
Nov 17 01:19:57 user nova-compute[75226]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 17 01:19:57 user nova-compute[75226]:     <label>libvirt-b054a557-dff6-49f8-9300-1307f8433567</label>
Nov 17 01:19:57 user nova-compute[75226]:     <imagelabel>libvirt-b054a557-dff6-49f8-9300-1307f8433567</imagelabel>
Nov 17 01:19:57 user nova-compute[75226]:   </seclabel>
Nov 17 01:19:57 user nova-compute[75226]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 17 01:19:57 user nova-compute[75226]:     <label>+64055:+108</label>
Nov 17 01:19:57 user nova-compute[75226]:     <imagelabel>+64055:+108</imagelabel>
Nov 17 01:19:57 user nova-compute[75226]:   </seclabel>
Nov 17 01:19:57 user nova-compute[75226]: </domain>
Nov 17 01:19:57 user nova-compute[75226]:  {{(pid=75226) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 17 01:19:57 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-5cd66272-c81d-45ab-afd2-cfb674a33329 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] Successfully detached device tap902fc99d-3d from instance b054a557-dff6-49f8-9300-1307f8433567 from the persistent domain config.
Nov 17 01:19:57 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-5cd66272-c81d-45ab-afd2-cfb674a33329 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] (1/8): Attempting to detach device tap902fc99d-3d with device alias net1 from instance b054a557-dff6-49f8-9300-1307f8433567 from the live domain config. {{(pid=75226) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 17 01:19:57 user nova-compute[75226]: DEBUG nova.virt.libvirt.guest [None req-5cd66272-c81d-45ab-afd2-cfb674a33329 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] detach device xml: <interface type="ethernet">
Nov 17 01:19:57 user nova-compute[75226]:   <mac address="fa:16:3e:4c:39:60"/>
Nov 17 01:19:57 user nova-compute[75226]:   <model type="virtio"/>
Nov 17 01:19:57 user nova-compute[75226]:   <mtu size="1442"/>
Nov 17 01:19:57 user nova-compute[75226]:   <target dev="tap902fc99d-3d"/>
Nov 17 01:19:57 user nova-compute[75226]: </interface>
Nov 17 01:19:57 user nova-compute[75226]:  {{(pid=75226) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 17 01:19:57 user nova-compute[75226]: DEBUG nova.compute.manager [None req-a3ceb72a-9f51-49f6-9512-80e176adbcd7 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] [instance: 75b1cabe-ba15-4851-9140-5949afc33005] swap_volume: Updating volume 0e860a72-9a6d-4889-8210-beafd1f879c7 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "OsjHbnIp", "auth_password": "7R9vlDPb6Lq5zf", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdf", "volume_id": "ac3239e4-20ce-43ca-84b3-f5f0a5ffff95"}, "status": "reserved", "instance": "75b1cabe-ba15-4851-9140-5949afc33005", "attached_at": "", "detached_at": "", "volume_id": "ac3239e4-20ce-43ca-84b3-f5f0a5ffff95", "serial": "ac3239e4-20ce-43ca-84b3-f5f0a5ffff95"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'ac3239e4-20ce-43ca-84b3-f5f0a5ffff95', 'no_device': None, 'attachment_id': 'b04320a7-e68b-442b-a6d1-957fecb4a57b'} {{(pid=75226) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 17 01:19:57 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:57 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e5b39bf-ceb7-4771-8604-7f2e3556fc19]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:57 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-c77c2bf8-c00d-4ba7-8ee2-f504accdaabf tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6, portal: 172.16.0.220,3260]
Nov 17 01:19:57 user nova-compute[75226]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6, portal: 172.16.0.220,3260] successful.
Nov 17 01:19:57 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:19:57 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-a3ceb72a-9f51-49f6-9512-80e176adbcd7 tempest-TestVolumeSwap-68817075 tempest-TestVolumeSwap-68817075-project-admin] Lock "75b1cabe-ba15-4851-9140-5949afc33005" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 13.770s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:19:57 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6 -p 172.16.0.220:3260 --op delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:57 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d528018e-00b4-4d76-ae6d-5e3a0c863ed6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:57 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3949227-b747-4f6d-98ae-fe2be520ba56]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:57 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-c77c2bf8-c00d-4ba7-8ee2-f504accdaabf tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:19:57 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-c77c2bf8-c00d-4ba7-8ee2-f504accdaabf tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.354s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:19:57 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-c77c2bf8-c00d-4ba7-8ee2-f504accdaabf tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] <== disconnect_volume: return (355ms) None {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:19:57 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c77c2bf8-c00d-4ba7-8ee2-f504accdaabf tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Disconnected iSCSI Volume {{(pid=75226) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 17 01:19:57 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-c77c2bf8-c00d-4ba7-8ee2-f504accdaabf tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Deleting instance files /opt/stack/data/nova/instances/27342ec6-7a03-4f99-8056-5cb56794aa41_del
Nov 17 01:19:57 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-c77c2bf8-c00d-4ba7-8ee2-f504accdaabf tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Deletion of /opt/stack/data/nova/instances/27342ec6-7a03-4f99-8056-5cb56794aa41_del complete
Nov 17 01:19:57 user nova-compute[75226]: INFO nova.compute.manager [None req-c77c2bf8-c00d-4ba7-8ee2-f504accdaabf tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Took 3.74 seconds to destroy the instance on the hypervisor.
Nov 17 01:19:57 user nova-compute[75226]: DEBUG oslo.service.loopingcall [None req-c77c2bf8-c00d-4ba7-8ee2-f504accdaabf tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75226) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 17 01:19:57 user nova-compute[75226]: DEBUG nova.compute.manager [-] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Deallocating network for instance {{(pid=75226) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 17 01:19:57 user nova-compute[75226]: DEBUG nova.network.neutron [-] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] deallocate_for_instance() {{(pid=75226) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 17 01:19:57 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-b9316ca6-f1e2-407a-9533-db7ca29f4902 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] Acquiring lock "e7830f7a-80f1-4c2f-bd64-363e6dd9114a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:19:57 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-b9316ca6-f1e2-407a-9533-db7ca29f4902 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] Lock "e7830f7a-80f1-4c2f-bd64-363e6dd9114a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:19:57 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-b9316ca6-f1e2-407a-9533-db7ca29f4902 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] Acquiring lock "e7830f7a-80f1-4c2f-bd64-363e6dd9114a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:19:57 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-b9316ca6-f1e2-407a-9533-db7ca29f4902 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] Lock "e7830f7a-80f1-4c2f-bd64-363e6dd9114a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:19:57 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-b9316ca6-f1e2-407a-9533-db7ca29f4902 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] Lock "e7830f7a-80f1-4c2f-bd64-363e6dd9114a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:19:57 user nova-compute[75226]: INFO nova.compute.manager [None req-b9316ca6-f1e2-407a-9533-db7ca29f4902 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] [instance: e7830f7a-80f1-4c2f-bd64-363e6dd9114a] Terminating instance
Nov 17 01:19:57 user nova-compute[75226]: DEBUG nova.compute.manager [None req-b9316ca6-f1e2-407a-9533-db7ca29f4902 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] [instance: e7830f7a-80f1-4c2f-bd64-363e6dd9114a] Start destroying the instance on the hypervisor. {{(pid=75226) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 17 01:19:57 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:19:57 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-5cd66272-c81d-45ab-afd2-cfb674a33329 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] Start waiting for the detach event from libvirt for device tap902fc99d-3d with device alias net1 for instance b054a557-dff6-49f8-9300-1307f8433567 {{(pid=75226) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 17 01:19:57 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:19:57 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:19:57 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:19:58 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:19:58 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:19:58 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:19:58 user nova-compute[75226]: INFO nova.virt.libvirt.driver [-] [instance: e7830f7a-80f1-4c2f-bd64-363e6dd9114a] Instance destroyed successfully.
Nov 17 01:19:58 user nova-compute[75226]: DEBUG nova.objects.instance [None req-b9316ca6-f1e2-407a-9533-db7ca29f4902 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] Lazy-loading 'resources' on Instance uuid e7830f7a-80f1-4c2f-bd64-363e6dd9114a {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:19:58 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-b9316ca6-f1e2-407a-9533-db7ca29f4902 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-17T01:17:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-666317814',display_name='tempest-AttachSCSIVolumeTestJSON-server-666317814',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-666317814',id=7,image_ref='d512d3f5-0961-48fa-a7c4-4be85445b5e2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMak35wEy5X4htll6OcRNRmmRqqhnqK1vJiFU6fJ+f5y6zGodYL7EUlkS9aJRdrgjNBKi28+u7AsckbU5VHkSXj15M0dtBjswbbdbAbodAm60L+PyJJOuybgoepdT7QJmg==',key_name='tempest-keypair-414562692',keypairs=<?>,launch_index=0,launched_at=2023-11-17T01:17:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='32bfc0cc503b45f7b2ebb10fd934b630',ramdisk_id='',reservation_id='r-goyx788k',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d512d3f5-0961-48fa-a7c4-4be85445b5e2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1545096268',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1545096268-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T01:17:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bab86e39396b4da7888f2f1b9959ffb0',uuid=e7830f7a-80f1-4c2f-bd64-363e6dd9114a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b273b468-b80c-435e-bae6-9cbbcf617110", "address": "fa:16:3e:29:76:3a", "network": {"id": "dbec5c0d-6e91-420e-a351-6aeaccb8253c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2034589845-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32bfc0cc503b45f7b2ebb10fd934b630", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb273b468-b8", "ovs_interfaceid": "b273b468-b80c-435e-bae6-9cbbcf617110", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 17 01:19:58 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-b9316ca6-f1e2-407a-9533-db7ca29f4902 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] Converting VIF {"id": "b273b468-b80c-435e-bae6-9cbbcf617110", "address": "fa:16:3e:29:76:3a", "network": {"id": "dbec5c0d-6e91-420e-a351-6aeaccb8253c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2034589845-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32bfc0cc503b45f7b2ebb10fd934b630", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb273b468-b8", "ovs_interfaceid": "b273b468-b80c-435e-bae6-9cbbcf617110", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:19:58 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-b9316ca6-f1e2-407a-9533-db7ca29f4902 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:29:76:3a,bridge_name='br-int',has_traffic_filtering=True,id=b273b468-b80c-435e-bae6-9cbbcf617110,network=Network(dbec5c0d-6e91-420e-a351-6aeaccb8253c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb273b468-b8') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:19:58 user nova-compute[75226]: DEBUG os_vif [None req-b9316ca6-f1e2-407a-9533-db7ca29f4902 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:29:76:3a,bridge_name='br-int',has_traffic_filtering=True,id=b273b468-b80c-435e-bae6-9cbbcf617110,network=Network(dbec5c0d-6e91-420e-a351-6aeaccb8253c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb273b468-b8') {{(pid=75226) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 17 01:19:58 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:19:58 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb273b468-b8, bridge=br-int, if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:19:58 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:19:58 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:19:58 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:19:58 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:19:58 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=079824ee-cac6-46f8-945b-95f9e7f10c46) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:19:58 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:19:58 user nova-compute[75226]: DEBUG nova.compute.manager [req-719762c4-abbe-422c-a53d-a677bc676000 req-5abe82fb-144b-458f-8ddc-5dd9afae3ad0 service nova] [instance: b054a557-dff6-49f8-9300-1307f8433567] Received event network-vif-unplugged-902fc99d-3d0f-4ce4-8502-b4c2f7617163 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:19:58 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-719762c4-abbe-422c-a53d-a677bc676000 req-5abe82fb-144b-458f-8ddc-5dd9afae3ad0 service nova] Acquiring lock "b054a557-dff6-49f8-9300-1307f8433567-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:19:58 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-719762c4-abbe-422c-a53d-a677bc676000 req-5abe82fb-144b-458f-8ddc-5dd9afae3ad0 service nova] Lock "b054a557-dff6-49f8-9300-1307f8433567-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:19:58 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-719762c4-abbe-422c-a53d-a677bc676000 req-5abe82fb-144b-458f-8ddc-5dd9afae3ad0 service nova] Lock "b054a557-dff6-49f8-9300-1307f8433567-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:19:58 user nova-compute[75226]: DEBUG nova.compute.manager [req-719762c4-abbe-422c-a53d-a677bc676000 req-5abe82fb-144b-458f-8ddc-5dd9afae3ad0 service nova] [instance: b054a557-dff6-49f8-9300-1307f8433567] No waiting events found dispatching network-vif-unplugged-902fc99d-3d0f-4ce4-8502-b4c2f7617163 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:19:58 user nova-compute[75226]: WARNING nova.compute.manager [req-719762c4-abbe-422c-a53d-a677bc676000 req-5abe82fb-144b-458f-8ddc-5dd9afae3ad0 service nova] [instance: b054a557-dff6-49f8-9300-1307f8433567] Received unexpected event network-vif-unplugged-902fc99d-3d0f-4ce4-8502-b4c2f7617163 for instance with vm_state active and task_state None.
Nov 17 01:19:58 user nova-compute[75226]: DEBUG nova.compute.manager [req-719762c4-abbe-422c-a53d-a677bc676000 req-5abe82fb-144b-458f-8ddc-5dd9afae3ad0 service nova] [instance: b054a557-dff6-49f8-9300-1307f8433567] Received event network-vif-plugged-902fc99d-3d0f-4ce4-8502-b4c2f7617163 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:19:58 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-719762c4-abbe-422c-a53d-a677bc676000 req-5abe82fb-144b-458f-8ddc-5dd9afae3ad0 service nova] Acquiring lock "b054a557-dff6-49f8-9300-1307f8433567-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:19:58 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-719762c4-abbe-422c-a53d-a677bc676000 req-5abe82fb-144b-458f-8ddc-5dd9afae3ad0 service nova] Lock "b054a557-dff6-49f8-9300-1307f8433567-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:19:58 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-719762c4-abbe-422c-a53d-a677bc676000 req-5abe82fb-144b-458f-8ddc-5dd9afae3ad0 service nova] Lock "b054a557-dff6-49f8-9300-1307f8433567-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:19:58 user nova-compute[75226]: DEBUG nova.compute.manager [req-719762c4-abbe-422c-a53d-a677bc676000 req-5abe82fb-144b-458f-8ddc-5dd9afae3ad0 service nova] [instance: b054a557-dff6-49f8-9300-1307f8433567] No waiting events found dispatching network-vif-plugged-902fc99d-3d0f-4ce4-8502-b4c2f7617163 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:19:58 user nova-compute[75226]: WARNING nova.compute.manager [req-719762c4-abbe-422c-a53d-a677bc676000 req-5abe82fb-144b-458f-8ddc-5dd9afae3ad0 service nova] [instance: b054a557-dff6-49f8-9300-1307f8433567] Received unexpected event network-vif-plugged-902fc99d-3d0f-4ce4-8502-b4c2f7617163 for instance with vm_state active and task_state None.
Nov 17 01:19:58 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:19:58 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:19:58 user nova-compute[75226]: INFO os_vif [None req-b9316ca6-f1e2-407a-9533-db7ca29f4902 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:29:76:3a,bridge_name='br-int',has_traffic_filtering=True,id=b273b468-b80c-435e-bae6-9cbbcf617110,network=Network(dbec5c0d-6e91-420e-a351-6aeaccb8253c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb273b468-b8')
Nov 17 01:19:58 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-b9316ca6-f1e2-407a-9533-db7ca29f4902 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] [instance: e7830f7a-80f1-4c2f-bd64-363e6dd9114a] Deleting instance files /opt/stack/data/nova/instances/e7830f7a-80f1-4c2f-bd64-363e6dd9114a_del
Nov 17 01:19:58 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-b9316ca6-f1e2-407a-9533-db7ca29f4902 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] [instance: e7830f7a-80f1-4c2f-bd64-363e6dd9114a] Deletion of /opt/stack/data/nova/instances/e7830f7a-80f1-4c2f-bd64-363e6dd9114a_del complete
Nov 17 01:19:58 user nova-compute[75226]: INFO nova.compute.manager [None req-b9316ca6-f1e2-407a-9533-db7ca29f4902 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] [instance: e7830f7a-80f1-4c2f-bd64-363e6dd9114a] Took 0.96 seconds to destroy the instance on the hypervisor.
Nov 17 01:19:58 user nova-compute[75226]: DEBUG oslo.service.loopingcall [None req-b9316ca6-f1e2-407a-9533-db7ca29f4902 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75226) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 17 01:19:58 user nova-compute[75226]: DEBUG nova.compute.manager [-] [instance: e7830f7a-80f1-4c2f-bd64-363e6dd9114a] Deallocating network for instance {{(pid=75226) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 17 01:19:58 user nova-compute[75226]: DEBUG nova.network.neutron [-] [instance: e7830f7a-80f1-4c2f-bd64-363e6dd9114a] deallocate_for_instance() {{(pid=75226) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 17 01:19:58 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-dccdc493-65f1-480e-88d6-857746797fab tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] Acquiring lock "75b1cabe-ba15-4851-9140-5949afc33005" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:19:58 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-dccdc493-65f1-480e-88d6-857746797fab tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] Lock "75b1cabe-ba15-4851-9140-5949afc33005" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:19:58 user nova-compute[75226]: INFO nova.compute.manager [None req-dccdc493-65f1-480e-88d6-857746797fab tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] [instance: 75b1cabe-ba15-4851-9140-5949afc33005] Detaching volume ac3239e4-20ce-43ca-84b3-f5f0a5ffff95
Nov 17 01:19:58 user nova-compute[75226]: DEBUG nova.compute.manager [req-7cd82ae2-7260-457e-81e6-a7311004c9c7 req-47d12559-e79c-471b-81e2-24f0cad8f339 service nova] [instance: e7830f7a-80f1-4c2f-bd64-363e6dd9114a] Received event network-vif-unplugged-b273b468-b80c-435e-bae6-9cbbcf617110 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:19:58 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-7cd82ae2-7260-457e-81e6-a7311004c9c7 req-47d12559-e79c-471b-81e2-24f0cad8f339 service nova] Acquiring lock "e7830f7a-80f1-4c2f-bd64-363e6dd9114a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:19:58 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-7cd82ae2-7260-457e-81e6-a7311004c9c7 req-47d12559-e79c-471b-81e2-24f0cad8f339 service nova] Lock "e7830f7a-80f1-4c2f-bd64-363e6dd9114a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:19:58 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-7cd82ae2-7260-457e-81e6-a7311004c9c7 req-47d12559-e79c-471b-81e2-24f0cad8f339 service nova] Lock "e7830f7a-80f1-4c2f-bd64-363e6dd9114a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:19:58 user nova-compute[75226]: DEBUG nova.compute.manager [req-7cd82ae2-7260-457e-81e6-a7311004c9c7 req-47d12559-e79c-471b-81e2-24f0cad8f339 service nova] [instance: e7830f7a-80f1-4c2f-bd64-363e6dd9114a] No waiting events found dispatching network-vif-unplugged-b273b468-b80c-435e-bae6-9cbbcf617110 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:19:58 user nova-compute[75226]: DEBUG nova.compute.manager [req-7cd82ae2-7260-457e-81e6-a7311004c9c7 req-47d12559-e79c-471b-81e2-24f0cad8f339 service nova] [instance: e7830f7a-80f1-4c2f-bd64-363e6dd9114a] Received event network-vif-unplugged-b273b468-b80c-435e-bae6-9cbbcf617110 for instance with task_state deleting. {{(pid=75226) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 17 01:19:58 user nova-compute[75226]: INFO nova.virt.block_device [None req-dccdc493-65f1-480e-88d6-857746797fab tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] [instance: 75b1cabe-ba15-4851-9140-5949afc33005] Attempting to driver detach volume ac3239e4-20ce-43ca-84b3-f5f0a5ffff95 from mountpoint /dev/vdb
Nov 17 01:19:58 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-dccdc493-65f1-480e-88d6-857746797fab tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] Attempting to detach device vdb from instance 75b1cabe-ba15-4851-9140-5949afc33005 from the persistent domain config. {{(pid=75226) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 17 01:19:58 user nova-compute[75226]: DEBUG nova.virt.libvirt.guest [None req-dccdc493-65f1-480e-88d6-857746797fab tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] detach device xml: <disk type="block" device="disk">
Nov 17 01:19:58 user nova-compute[75226]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 01:19:58 user nova-compute[75226]:   <source dev="/dev/sdf"/>
Nov 17 01:19:58 user nova-compute[75226]:   <target dev="vdb" bus="virtio"/>
Nov 17 01:19:58 user nova-compute[75226]:   <serial>ac3239e4-20ce-43ca-84b3-f5f0a5ffff95</serial>
Nov 17 01:19:58 user nova-compute[75226]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 17 01:19:58 user nova-compute[75226]: </disk>
Nov 17 01:19:58 user nova-compute[75226]:  {{(pid=75226) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 17 01:19:58 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-dccdc493-65f1-480e-88d6-857746797fab tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] Successfully detached device vdb from instance 75b1cabe-ba15-4851-9140-5949afc33005 from the persistent domain config.
Nov 17 01:19:58 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-dccdc493-65f1-480e-88d6-857746797fab tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 75b1cabe-ba15-4851-9140-5949afc33005 from the live domain config. {{(pid=75226) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 17 01:19:58 user nova-compute[75226]: DEBUG nova.virt.libvirt.guest [None req-dccdc493-65f1-480e-88d6-857746797fab tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] detach device xml: <disk type="block" device="disk">
Nov 17 01:19:58 user nova-compute[75226]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 01:19:58 user nova-compute[75226]:   <source dev="/dev/sdf"/>
Nov 17 01:19:58 user nova-compute[75226]:   <target dev="vdb" bus="virtio"/>
Nov 17 01:19:58 user nova-compute[75226]:   <serial>ac3239e4-20ce-43ca-84b3-f5f0a5ffff95</serial>
Nov 17 01:19:58 user nova-compute[75226]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 17 01:19:58 user nova-compute[75226]: </disk>
Nov 17 01:19:58 user nova-compute[75226]:  {{(pid=75226) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 17 01:19:59 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-dccdc493-65f1-480e-88d6-857746797fab tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 75b1cabe-ba15-4851-9140-5949afc33005 {{(pid=75226) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 17 01:19:59 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-48fffe3b-20dd-4da4-8c79-96b8a6f9fb22 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] [instance: 262eb845-eebe-4ffb-bc49-dcaca53ad7b8] Creating instance directory {{(pid=75226) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 17 01:19:59 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-48fffe3b-20dd-4da4-8c79-96b8a6f9fb22 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] [instance: 262eb845-eebe-4ffb-bc49-dcaca53ad7b8] Creating image(s)
Nov 17 01:19:59 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-48fffe3b-20dd-4da4-8c79-96b8a6f9fb22 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] [instance: 262eb845-eebe-4ffb-bc49-dcaca53ad7b8] Did not create local disks {{(pid=75226) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 17 01:19:59 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-48fffe3b-20dd-4da4-8c79-96b8a6f9fb22 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] [instance: 262eb845-eebe-4ffb-bc49-dcaca53ad7b8] Ensure instance console log exists: /opt/stack/data/nova/instances/262eb845-eebe-4ffb-bc49-dcaca53ad7b8/console.log {{(pid=75226) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 17 01:19:59 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-48fffe3b-20dd-4da4-8c79-96b8a6f9fb22 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:19:59 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-48fffe3b-20dd-4da4-8c79-96b8a6f9fb22 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:19:59 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-48fffe3b-20dd-4da4-8c79-96b8a6f9fb22 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:19:59 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-48fffe3b-20dd-4da4-8c79-96b8a6f9fb22 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] [instance: 262eb845-eebe-4ffb-bc49-dcaca53ad7b8] Start _get_guest_xml network_info=[{"id": "ca3803cf-fc7f-4233-8afa-1806c73156be", "address": "fa:16:3e:d9:19:6e", "network": {"id": "432afb25-848f-4ef8-8436-11db949783e6", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1854406043-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25ffeaafcdca494eb7550cec5b100051", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca3803cf-fc", "ovs_interfaceid": "ca3803cf-fc7f-4233-8afa-1806c73156be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T01:13:22Z,direct_url=<?>,disk_format='qcow2',id=0b369aea-6f3f-4690-9f01-229b90ab6310,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4e110cbf9a84362a6864a7732c435a1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T01:13:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iChyRSBt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '262eb845-eebe-4ffb-bc49-dcaca53ad7b8', 'attached_at': '', 'detached_at': '', 'volume_id': '2ca02b15-b2b8-4e45-9d87-54886c2568a2', 'serial': '2ca02b15-b2b8-4e45-9d87-54886c2568a2'}, 'attachment_id': '43e94f54-f3ba-4d37-bf28-3d4695063360', 'device_type': 'disk', 'volume_type': None} {{(pid=75226) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 17 01:19:59 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-48fffe3b-20dd-4da4-8c79-96b8a6f9fb22 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 17 01:19:59 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-48fffe3b-20dd-4da4-8c79-96b8a6f9fb22 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 17 01:19:59 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-48fffe3b-20dd-4da4-8c79-96b8a6f9fb22 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75226) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 17 01:19:59 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-48fffe3b-20dd-4da4-8c79-96b8a6f9fb22 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] CPU controller missing on host. {{(pid=75226) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 17 01:19:59 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-48fffe3b-20dd-4da4-8c79-96b8a6f9fb22 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75226) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 17 01:19:59 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-48fffe3b-20dd-4da4-8c79-96b8a6f9fb22 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] CPU controller found on host. {{(pid=75226) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 17 01:19:59 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-48fffe3b-20dd-4da4-8c79-96b8a6f9fb22 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75226) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 17 01:19:59 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-48fffe3b-20dd-4da4-8c79-96b8a6f9fb22 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-17T01:13:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T01:13:22Z,direct_url=<?>,disk_format='qcow2',id=0b369aea-6f3f-4690-9f01-229b90ab6310,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4e110cbf9a84362a6864a7732c435a1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T01:13:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 17 01:19:59 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-48fffe3b-20dd-4da4-8c79-96b8a6f9fb22 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] Flavor limits 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 17 01:19:59 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-48fffe3b-20dd-4da4-8c79-96b8a6f9fb22 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] Image limits 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 17 01:19:59 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-48fffe3b-20dd-4da4-8c79-96b8a6f9fb22 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] Flavor pref 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 17 01:19:59 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-48fffe3b-20dd-4da4-8c79-96b8a6f9fb22 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] Image pref 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 17 01:19:59 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-48fffe3b-20dd-4da4-8c79-96b8a6f9fb22 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 17 01:19:59 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-48fffe3b-20dd-4da4-8c79-96b8a6f9fb22 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 17 01:19:59 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-48fffe3b-20dd-4da4-8c79-96b8a6f9fb22 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75226) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 17 01:19:59 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-48fffe3b-20dd-4da4-8c79-96b8a6f9fb22 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] Got 1 possible topologies {{(pid=75226) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 17 01:19:59 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-48fffe3b-20dd-4da4-8c79-96b8a6f9fb22 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 17 01:19:59 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-48fffe3b-20dd-4da4-8c79-96b8a6f9fb22 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 17 01:19:59 user nova-compute[75226]: DEBUG nova.objects.instance [None req-48fffe3b-20dd-4da4-8c79-96b8a6f9fb22 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] Lazy-loading 'vcpu_model' on Instance uuid 262eb845-eebe-4ffb-bc49-dcaca53ad7b8 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:19:59 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48fffe3b-20dd-4da4-8c79-96b8a6f9fb22 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] [instance: 262eb845-eebe-4ffb-bc49-dcaca53ad7b8] Calling os-brick to attach iSCSI Volume {{(pid=75226) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 17 01:19:59 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-48fffe3b-20dd-4da4-8c79-96b8a6f9fb22 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc4cc36b490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iChyRSBt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:19:59 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-48fffe3b-20dd-4da4-8c79-96b8a6f9fb22 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 17 01:19:59 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-48fffe3b-20dd-4da4-8c79-96b8a6f9fb22 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:19:59 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-48fffe3b-20dd-4da4-8c79-96b8a6f9fb22 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:19:59 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-48fffe3b-20dd-4da4-8c79-96b8a6f9fb22 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 17 01:19:59 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-48fffe3b-20dd-4da4-8c79-96b8a6f9fb22 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:19:59 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-48fffe3b-20dd-4da4-8c79-96b8a6f9fb22 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:19:59 user nova-compute[75226]: INFO os_brick.initiator.connectors.iscsi [None req-48fffe3b-20dd-4da4-8c79-96b8a6f9fb22 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 17 01:19:59 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2 -p 172.16.0.220:3260 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:59 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:59 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4e21922-2a10-4f21-8e11-1527b44bd990]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:59 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-48fffe3b-20dd-4da4-8c79-96b8a6f9fb22 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 17 01:19:59 user nova-compute[75226]:  {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:19:59 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2 -p 172.16.0.220:3260 --interface default --op new {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:59 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:59 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0647fdf-62a4-4fc1-83ce-ca644eadb678]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2] added\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:59 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-48fffe3b-20dd-4da4-8c79-96b8a6f9fb22 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2] added
Nov 17 01:19:59 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:19:59 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:59 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:59 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ca4d468-2c02-43f6-946e-a739565d1754]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:59 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-48fffe3b-20dd-4da4-8c79-96b8a6f9fb22 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:19:59 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:59 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:59 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[f98a3b9c-3f1e-4897-81d4-c0bcf7a3a5dc]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:59 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-48fffe3b-20dd-4da4-8c79-96b8a6f9fb22 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:19:59 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iChyRSBt {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:59 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iChyRSBt" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:59 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[46ba6378-7a98-459a-8cd4-1d15e953d5c8]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:59 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-48fffe3b-20dd-4da4-8c79-96b8a6f9fb22 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iChyRSBt'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:19:59 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:59 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:59 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[b492cf7d-d0e0-445c-b2a6-af0593f4580b]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:59 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-48fffe3b-20dd-4da4-8c79-96b8a6f9fb22 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:19:59 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:19:59 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:19:59 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cc15e85-b022-4c25-8da4-aba2e12bf7f6]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:801ff813-83ea-4d9e-a8d2-ed4146b22b52 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:19:59 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-48fffe3b-20dd-4da4-8c79-96b8a6f9fb22 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:801ff813-83ea-4d9e-a8d2-ed4146b22b52 (non-flash)
Nov 17 01:19:59 user nova-compute[75226]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95 (non-flash)
Nov 17 01:19:59 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:19:59 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-48fffe3b-20dd-4da4-8c79-96b8a6f9fb22 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:801ff813-83ea-4d9e-a8d2-ed4146b22b52 (non-flash)
Nov 17 01:19:59 user nova-compute[75226]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95 (non-flash)
Nov 17 01:19:59 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:19:59 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2 -p 172.16.0.220:3260 --login {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:20:00 user nova-compute[75226]: DEBUG nova.network.neutron [-] [instance: e7830f7a-80f1-4c2f-bd64-363e6dd9114a] Updating instance_info_cache with network_info: [] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:20:00 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:20:00 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[65ed590d-3a07-4104-aa6a-79564ad00f07]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:20:00 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-48fffe3b-20dd-4da4-8c79-96b8a6f9fb22 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2, portal: 172.16.0.220,3260]
Nov 17 01:20:00 user nova-compute[75226]: Login to [iface: default, target: iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2, portal: 172.16.0.220,3260] successful.
Nov 17 01:20:00 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:20:00 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:20:00 user nova-compute[75226]: INFO nova.compute.manager [-] [instance: e7830f7a-80f1-4c2f-bd64-363e6dd9114a] Took 1.41 seconds to deallocate network for instance.
Nov 17 01:20:00 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:20:00 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ff9af5b-cd94-43a7-9a80-41c7403679c7]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:20:00 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-48fffe3b-20dd-4da4-8c79-96b8a6f9fb22 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:20:00 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:20:00 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:20:00 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[f177135f-d1da-4bc6-a59d-3dbdfe8eb20f]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:801ff813-83ea-4d9e-a8d2-ed4146b22b52 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:20:00 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-48fffe3b-20dd-4da4-8c79-96b8a6f9fb22 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:801ff813-83ea-4d9e-a8d2-ed4146b22b52 (non-flash)
Nov 17 01:20:00 user nova-compute[75226]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95 (non-flash)
Nov 17 01:20:00 user nova-compute[75226]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2 (non-flash)
Nov 17 01:20:00 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:20:00 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-48fffe3b-20dd-4da4-8c79-96b8a6f9fb22 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:801ff813-83ea-4d9e-a8d2-ed4146b22b52 (non-flash)
Nov 17 01:20:00 user nova-compute[75226]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95 (non-flash)
Nov 17 01:20:00 user nova-compute[75226]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2 (non-flash)
Nov 17 01:20:00 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:20:00 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-48fffe3b-20dd-4da4-8c79-96b8a6f9fb22 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.287s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:20:00 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-48fffe3b-20dd-4da4-8c79-96b8a6f9fb22 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] Connected to 172.16.0.220:3260 {{(pid=75226) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 17 01:20:00 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-48fffe3b-20dd-4da4-8c79-96b8a6f9fb22 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] HCTL ('33', '-', '-', 0) found on session 15 with lun 0 {{(pid=75226) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 17 01:20:00 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-48fffe3b-20dd-4da4-8c79-96b8a6f9fb22 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75226) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 17 01:20:00 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:20:00 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:20:00 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca7f1a51-1dbe-4cf5-b117-b76fdf98cf89]: (4, ('- - 0', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:20:00 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-48fffe3b-20dd-4da4-8c79-96b8a6f9fb22 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] Searching for a device in session 15 and hctl ['33', '*', '*', 0] yield: None {{(pid=75226) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 01:20:00 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-b9316ca6-f1e2-407a-9533-db7ca29f4902 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:20:00 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-b9316ca6-f1e2-407a-9533-db7ca29f4902 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:20:00 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-b9316ca6-f1e2-407a-9533-db7ca29f4902 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:20:00 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-b9316ca6-f1e2-407a-9533-db7ca29f4902 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:20:00 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-b9316ca6-f1e2-407a-9533-db7ca29f4902 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.330s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:20:00 user nova-compute[75226]: INFO nova.scheduler.client.report [None req-b9316ca6-f1e2-407a-9533-db7ca29f4902 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] Deleted allocations for instance e7830f7a-80f1-4c2f-bd64-363e6dd9114a
Nov 17 01:20:00 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-b9316ca6-f1e2-407a-9533-db7ca29f4902 tempest-AttachSCSIVolumeTestJSON-1545096268 tempest-AttachSCSIVolumeTestJSON-1545096268-project-member] Lock "e7830f7a-80f1-4c2f-bd64-363e6dd9114a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.913s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:20:00 user nova-compute[75226]: DEBUG nova.compute.manager [req-c5b02951-80dc-4b74-b444-49c5418b29a9 req-4c687869-a61b-4623-bf9d-dcb29a30a9dd service nova] [instance: e7830f7a-80f1-4c2f-bd64-363e6dd9114a] Received event network-vif-plugged-b273b468-b80c-435e-bae6-9cbbcf617110 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:20:00 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-c5b02951-80dc-4b74-b444-49c5418b29a9 req-4c687869-a61b-4623-bf9d-dcb29a30a9dd service nova] Acquiring lock "e7830f7a-80f1-4c2f-bd64-363e6dd9114a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:20:00 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-c5b02951-80dc-4b74-b444-49c5418b29a9 req-4c687869-a61b-4623-bf9d-dcb29a30a9dd service nova] Lock "e7830f7a-80f1-4c2f-bd64-363e6dd9114a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:20:00 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-c5b02951-80dc-4b74-b444-49c5418b29a9 req-4c687869-a61b-4623-bf9d-dcb29a30a9dd service nova] Lock "e7830f7a-80f1-4c2f-bd64-363e6dd9114a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:20:00 user nova-compute[75226]: DEBUG nova.compute.manager [req-c5b02951-80dc-4b74-b444-49c5418b29a9 req-4c687869-a61b-4623-bf9d-dcb29a30a9dd service nova] [instance: e7830f7a-80f1-4c2f-bd64-363e6dd9114a] No waiting events found dispatching network-vif-plugged-b273b468-b80c-435e-bae6-9cbbcf617110 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:20:00 user nova-compute[75226]: WARNING nova.compute.manager [req-c5b02951-80dc-4b74-b444-49c5418b29a9 req-4c687869-a61b-4623-bf9d-dcb29a30a9dd service nova] [instance: e7830f7a-80f1-4c2f-bd64-363e6dd9114a] Received unexpected event network-vif-plugged-b273b468-b80c-435e-bae6-9cbbcf617110 for instance with vm_state deleted and task_state None.
Nov 17 01:20:00 user nova-compute[75226]: DEBUG nova.compute.manager [req-c5b02951-80dc-4b74-b444-49c5418b29a9 req-4c687869-a61b-4623-bf9d-dcb29a30a9dd service nova] [instance: e7830f7a-80f1-4c2f-bd64-363e6dd9114a] Received event network-vif-deleted-b273b468-b80c-435e-bae6-9cbbcf617110 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:20:00 user nova-compute[75226]: DEBUG nova.compute.manager [req-c5b02951-80dc-4b74-b444-49c5418b29a9 req-4c687869-a61b-4623-bf9d-dcb29a30a9dd service nova] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Received event network-vif-deleted-11a81061-cde2-4e09-88e4-678aead09ad5 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:20:00 user nova-compute[75226]: INFO nova.compute.manager [req-c5b02951-80dc-4b74-b444-49c5418b29a9 req-4c687869-a61b-4623-bf9d-dcb29a30a9dd service nova] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Neutron deleted interface 11a81061-cde2-4e09-88e4-678aead09ad5; detaching it from the instance and deleting it from the info cache
Nov 17 01:20:00 user nova-compute[75226]: DEBUG nova.network.neutron [req-c5b02951-80dc-4b74-b444-49c5418b29a9 req-4c687869-a61b-4623-bf9d-dcb29a30a9dd service nova] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Updating instance_info_cache with network_info: [{"id": "6337887b-565a-4dc6-9a4f-4c8d9ac1c901", "address": "fa:16:3e:fc:8e:ff", "network": {"id": "4d03345a-3dc2-4436-a30b-30b8015b649e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2116320858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "871db3f789ac470c877456108324c68c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6337887b-56", "ovs_interfaceid": "6337887b-565a-4dc6-9a4f-4c8d9ac1c901", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8a548a9b-874e-4c7c-bf06-6896dd773ce4", "address": "fa:16:3e:5b:b6:0c", "network": {"id": "df3c1bab-64f6-49c0-b35a-396881f5862f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1354339680", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "871db3f789ac470c877456108324c68c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a548a9b-87", "ovs_interfaceid": "8a548a9b-874e-4c7c-bf06-6896dd773ce4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "01625fc1-9bbc-4edc-b594-78658e91edd9", "address": "fa:16:3e:13:8d:33", "network": {"id": "df3c1bab-64f6-49c0-b35a-396881f5862f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1354339680", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.68", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "871db3f789ac470c877456108324c68c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01625fc1-9b", "ovs_interfaceid": "01625fc1-9bbc-4edc-b594-78658e91edd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3e4d946c-158b-49e8-a349-44da4864f830", "address": "fa:16:3e:65:64:f1", "network": {"id": "df3c1bab-64f6-49c0-b35a-396881f5862f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1354339680", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "871db3f789ac470c877456108324c68c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e4d946c-15", "ovs_interfaceid": "3e4d946c-158b-49e8-a349-44da4864f830", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3b1855a6-8a37-47af-b3e6-86e60eb05a1d", "address": "fa:16:3e:5e:6d:29", "network": {"id": "df3c1bab-64f6-49c0-b35a-396881f5862f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1354339680", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "871db3f789ac470c877456108324c68c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b1855a6-8a", "ovs_interfaceid": "3b1855a6-8a37-47af-b3e6-86e60eb05a1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3c1a838d-e1c6-44d3-ab8a-a545044545a3", "address": "fa:16:3e:47:9b:84", "network": {"id": "b92e4d90-c7bd-45d6-a9db-d4b27ce718c5", "bridge": "br-int", "label": "tempest-device-tagging-net2-541044549", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "871db3f789ac470c877456108324c68c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c1a838d-e1", "ovs_interfaceid": "3c1a838d-e1c6-44d3-ab8a-a545044545a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:20:00 user nova-compute[75226]: DEBUG nova.compute.manager [req-c5b02951-80dc-4b74-b444-49c5418b29a9 req-4c687869-a61b-4623-bf9d-dcb29a30a9dd service nova] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Detach interface failed, port_id=11a81061-cde2-4e09-88e4-678aead09ad5, reason: Instance 27342ec6-7a03-4f99-8056-5cb56794aa41 could not be found. {{(pid=75226) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 17 01:20:01 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-48fffe3b-20dd-4da4-8c79-96b8a6f9fb22 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] Searching for a device in session 15 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75226) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 01:20:01 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-48fffe3b-20dd-4da4-8c79-96b8a6f9fb22 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iChyRSBt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75226) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 17 01:20:01 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-48fffe3b-20dd-4da4-8c79-96b8a6f9fb22 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.314s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:20:01 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-48fffe3b-20dd-4da4-8c79-96b8a6f9fb22 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] <== connect_volume: return (1316ms) {'type': 'block', 'scsi_wwn': '23461386330356436', 'path': '/dev/sdb'} {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:20:01 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48fffe3b-20dd-4da4-8c79-96b8a6f9fb22 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] [instance: 262eb845-eebe-4ffb-bc49-dcaca53ad7b8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23461386330356436', 'path': '/dev/sdb'} {{(pid=75226) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 17 01:20:01 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-48fffe3b-20dd-4da4-8c79-96b8a6f9fb22 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-17T01:17:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1083843920',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-2087129181',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKV3eUaLv1Nf2GbMurBwqVCKHkTHGINwHn9NxIQT1HFJaTPcIhblv549UYBEzh8qzhRSlfco2n2Ir3Yj2M5HfVEZNDfmX2UBxm0ZhLW7VwOddfd0Muufn03LFhj/HJg0+w==',key_name='tempest-keypair-214561330',keypairs=<?>,launch_index=0,launched_at=2023-11-17T01:17:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='25ffeaafcdca494eb7550cec5b100051',ramdisk_id='',reservation_id='r-7fgkbn6g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1243685842',owner_user_name='tempest-ServerActionsV293TestJSON-1243685842-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T01:19:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2c4b7f0453ec4ef5940b4bdf32bdf6f4',uuid=262eb845-eebe-4ffb-bc49-dcaca53ad7b8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ca3803cf-fc7f-4233-8afa-1806c73156be", "address": "fa:16:3e:d9:19:6e", "network": {"id": "432afb25-848f-4ef8-8436-11db949783e6", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1854406043-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25ffeaafcdca494eb7550cec5b100051", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca3803cf-fc", "ovs_interfaceid": "ca3803cf-fc7f-4233-8afa-1806c73156be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75226) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 01:20:01 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-48fffe3b-20dd-4da4-8c79-96b8a6f9fb22 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] Converting VIF {"id": "ca3803cf-fc7f-4233-8afa-1806c73156be", "address": "fa:16:3e:d9:19:6e", "network": {"id": "432afb25-848f-4ef8-8436-11db949783e6", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1854406043-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25ffeaafcdca494eb7550cec5b100051", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca3803cf-fc", "ovs_interfaceid": "ca3803cf-fc7f-4233-8afa-1806c73156be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:20:01 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-48fffe3b-20dd-4da4-8c79-96b8a6f9fb22 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d9:19:6e,bridge_name='br-int',has_traffic_filtering=True,id=ca3803cf-fc7f-4233-8afa-1806c73156be,network=Network(432afb25-848f-4ef8-8436-11db949783e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca3803cf-fc') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:20:01 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-48fffe3b-20dd-4da4-8c79-96b8a6f9fb22 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] [instance: 262eb845-eebe-4ffb-bc49-dcaca53ad7b8] End _get_guest_xml xml=<domain type="kvm">
Nov 17 01:20:01 user nova-compute[75226]:   <uuid>262eb845-eebe-4ffb-bc49-dcaca53ad7b8</uuid>
Nov 17 01:20:01 user nova-compute[75226]:   <name>instance-00000009</name>
Nov 17 01:20:01 user nova-compute[75226]:   <memory>524288</memory>
Nov 17 01:20:01 user nova-compute[75226]:   <vcpu>1</vcpu>
Nov 17 01:20:01 user nova-compute[75226]:   <metadata>
Nov 17 01:20:01 user nova-compute[75226]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 17 01:20:01 user nova-compute[75226]:       <nova:package version="0.0.0"/>
Nov 17 01:20:01 user nova-compute[75226]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1083843920</nova:name>
Nov 17 01:20:01 user nova-compute[75226]:       <nova:creationTime>2023-11-17 01:19:59</nova:creationTime>
Nov 17 01:20:01 user nova-compute[75226]:       <nova:flavor name="m1.tiny">
Nov 17 01:20:01 user nova-compute[75226]:         <nova:memory>512</nova:memory>
Nov 17 01:20:01 user nova-compute[75226]:         <nova:disk>1</nova:disk>
Nov 17 01:20:01 user nova-compute[75226]:         <nova:swap>0</nova:swap>
Nov 17 01:20:01 user nova-compute[75226]:         <nova:ephemeral>0</nova:ephemeral>
Nov 17 01:20:01 user nova-compute[75226]:         <nova:vcpus>1</nova:vcpus>
Nov 17 01:20:01 user nova-compute[75226]:       </nova:flavor>
Nov 17 01:20:01 user nova-compute[75226]:       <nova:owner>
Nov 17 01:20:01 user nova-compute[75226]:         <nova:user uuid="2c4b7f0453ec4ef5940b4bdf32bdf6f4">tempest-ServerActionsV293TestJSON-1243685842-project-member</nova:user>
Nov 17 01:20:01 user nova-compute[75226]:         <nova:project uuid="25ffeaafcdca494eb7550cec5b100051">tempest-ServerActionsV293TestJSON-1243685842</nova:project>
Nov 17 01:20:01 user nova-compute[75226]:       </nova:owner>
Nov 17 01:20:01 user nova-compute[75226]:       <nova:ports>
Nov 17 01:20:01 user nova-compute[75226]:         <nova:port uuid="ca3803cf-fc7f-4233-8afa-1806c73156be">
Nov 17 01:20:01 user nova-compute[75226]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 17 01:20:01 user nova-compute[75226]:         </nova:port>
Nov 17 01:20:01 user nova-compute[75226]:       </nova:ports>
Nov 17 01:20:01 user nova-compute[75226]:     </nova:instance>
Nov 17 01:20:01 user nova-compute[75226]:   </metadata>
Nov 17 01:20:01 user nova-compute[75226]:   <sysinfo type="smbios">
Nov 17 01:20:01 user nova-compute[75226]:     <system>
Nov 17 01:20:01 user nova-compute[75226]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 17 01:20:01 user nova-compute[75226]:       <entry name="product">OpenStack Nova</entry>
Nov 17 01:20:01 user nova-compute[75226]:       <entry name="version">0.0.0</entry>
Nov 17 01:20:01 user nova-compute[75226]:       <entry name="serial">262eb845-eebe-4ffb-bc49-dcaca53ad7b8</entry>
Nov 17 01:20:01 user nova-compute[75226]:       <entry name="uuid">262eb845-eebe-4ffb-bc49-dcaca53ad7b8</entry>
Nov 17 01:20:01 user nova-compute[75226]:       <entry name="family">Virtual Machine</entry>
Nov 17 01:20:01 user nova-compute[75226]:     </system>
Nov 17 01:20:01 user nova-compute[75226]:   </sysinfo>
Nov 17 01:20:01 user nova-compute[75226]:   <os>
Nov 17 01:20:01 user nova-compute[75226]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 17 01:20:01 user nova-compute[75226]:     <boot dev="hd"/>
Nov 17 01:20:01 user nova-compute[75226]:     <smbios mode="sysinfo"/>
Nov 17 01:20:01 user nova-compute[75226]:   </os>
Nov 17 01:20:01 user nova-compute[75226]:   <features>
Nov 17 01:20:01 user nova-compute[75226]:     <acpi/>
Nov 17 01:20:01 user nova-compute[75226]:     <apic/>
Nov 17 01:20:01 user nova-compute[75226]:     <vmcoreinfo/>
Nov 17 01:20:01 user nova-compute[75226]:   </features>
Nov 17 01:20:01 user nova-compute[75226]:   <clock offset="utc">
Nov 17 01:20:01 user nova-compute[75226]:     <timer name="pit" tickpolicy="delay"/>
Nov 17 01:20:01 user nova-compute[75226]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 17 01:20:01 user nova-compute[75226]:     <timer name="hpet" present="no"/>
Nov 17 01:20:01 user nova-compute[75226]:   </clock>
Nov 17 01:20:01 user nova-compute[75226]:   <cpu mode="custom" match="exact">
Nov 17 01:20:01 user nova-compute[75226]:     <model>Nehalem</model>
Nov 17 01:20:01 user nova-compute[75226]:     <topology sockets="1" cores="1" threads="1"/>
Nov 17 01:20:01 user nova-compute[75226]:   </cpu>
Nov 17 01:20:01 user nova-compute[75226]:   <devices>
Nov 17 01:20:01 user nova-compute[75226]:     <disk type="block" device="disk">
Nov 17 01:20:01 user nova-compute[75226]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 01:20:01 user nova-compute[75226]:       <source dev="/dev/sdb"/>
Nov 17 01:20:01 user nova-compute[75226]:       <target dev="vda" bus="virtio"/>
Nov 17 01:20:01 user nova-compute[75226]:       <serial>2ca02b15-b2b8-4e45-9d87-54886c2568a2</serial>
Nov 17 01:20:01 user nova-compute[75226]:     </disk>
Nov 17 01:20:01 user nova-compute[75226]:     <interface type="ethernet">
Nov 17 01:20:01 user nova-compute[75226]:       <mac address="fa:16:3e:d9:19:6e"/>
Nov 17 01:20:01 user nova-compute[75226]:       <model type="virtio"/>
Nov 17 01:20:01 user nova-compute[75226]:       <mtu size="1442"/>
Nov 17 01:20:01 user nova-compute[75226]:       <target dev="tapca3803cf-fc"/>
Nov 17 01:20:01 user nova-compute[75226]:     </interface>
Nov 17 01:20:01 user nova-compute[75226]:     <serial type="pty">
Nov 17 01:20:01 user nova-compute[75226]:       <log file="/opt/stack/data/nova/instances/262eb845-eebe-4ffb-bc49-dcaca53ad7b8/console.log" append="off"/>
Nov 17 01:20:01 user nova-compute[75226]:     </serial>
Nov 17 01:20:01 user nova-compute[75226]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 17 01:20:01 user nova-compute[75226]:     <video>
Nov 17 01:20:01 user nova-compute[75226]:       <model type="virtio"/>
Nov 17 01:20:01 user nova-compute[75226]:     </video>
Nov 17 01:20:01 user nova-compute[75226]:     <rng model="virtio">
Nov 17 01:20:01 user nova-compute[75226]:       <backend model="random">/dev/urandom</backend>
Nov 17 01:20:01 user nova-compute[75226]:     </rng>
Nov 17 01:20:01 user nova-compute[75226]:     <controller type="usb" index="0" model="none"/>
Nov 17 01:20:01 user nova-compute[75226]:     <memballoon model="virtio">
Nov 17 01:20:01 user nova-compute[75226]:       <stats period="10"/>
Nov 17 01:20:01 user nova-compute[75226]:     </memballoon>
Nov 17 01:20:01 user nova-compute[75226]:   </devices>
Nov 17 01:20:01 user nova-compute[75226]: </domain>
Nov 17 01:20:01 user nova-compute[75226]:  {{(pid=75226) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 17 01:20:01 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-48fffe3b-20dd-4da4-8c79-96b8a6f9fb22 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-17T01:17:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1083843920',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-2087129181',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKV3eUaLv1Nf2GbMurBwqVCKHkTHGINwHn9NxIQT1HFJaTPcIhblv549UYBEzh8qzhRSlfco2n2Ir3Yj2M5HfVEZNDfmX2UBxm0ZhLW7VwOddfd0Muufn03LFhj/HJg0+w==',key_name='tempest-keypair-214561330',keypairs=<?>,launch_index=0,launched_at=2023-11-17T01:17:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='25ffeaafcdca494eb7550cec5b100051',ramdisk_id='',reservation_id='r-7fgkbn6g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1243685842',owner_user_name='tempest-ServerActionsV293TestJSON-1243685842-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T01:19:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2c4b7f0453ec4ef5940b4bdf32bdf6f4',uuid=262eb845-eebe-4ffb-bc49-dcaca53ad7b8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ca3803cf-fc7f-4233-8afa-1806c73156be", "address": "fa:16:3e:d9:19:6e", "network": {"id": "432afb25-848f-4ef8-8436-11db949783e6", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1854406043-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25ffeaafcdca494eb7550cec5b100051", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca3803cf-fc", "ovs_interfaceid": "ca3803cf-fc7f-4233-8afa-1806c73156be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 17 01:20:01 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-48fffe3b-20dd-4da4-8c79-96b8a6f9fb22 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] Converting VIF {"id": "ca3803cf-fc7f-4233-8afa-1806c73156be", "address": "fa:16:3e:d9:19:6e", "network": {"id": "432afb25-848f-4ef8-8436-11db949783e6", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1854406043-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25ffeaafcdca494eb7550cec5b100051", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca3803cf-fc", "ovs_interfaceid": "ca3803cf-fc7f-4233-8afa-1806c73156be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:20:01 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-48fffe3b-20dd-4da4-8c79-96b8a6f9fb22 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d9:19:6e,bridge_name='br-int',has_traffic_filtering=True,id=ca3803cf-fc7f-4233-8afa-1806c73156be,network=Network(432afb25-848f-4ef8-8436-11db949783e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca3803cf-fc') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:20:01 user nova-compute[75226]: DEBUG os_vif [None req-48fffe3b-20dd-4da4-8c79-96b8a6f9fb22 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d9:19:6e,bridge_name='br-int',has_traffic_filtering=True,id=ca3803cf-fc7f-4233-8afa-1806c73156be,network=Network(432afb25-848f-4ef8-8436-11db949783e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca3803cf-fc') {{(pid=75226) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 17 01:20:01 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:20:01 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:20:01 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 17 01:20:01 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:20:01 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3117021c-5a10-553d-bdc0-0b97d683e12f', '_type': 'linux-noop'}}, row=False) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:20:01 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:20:01 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:20:01 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:20:01 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:20:01 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapca3803cf-fc, may_exist=True, interface_attrs={}) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:20:01 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapca3803cf-fc, col_values=(('qos', UUID('bdcb8900-4f4a-434c-8b44-932785b867fa')),), if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:20:01 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapca3803cf-fc, col_values=(('external_ids', {'iface-id': 'ca3803cf-fc7f-4233-8afa-1806c73156be', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d9:19:6e', 'vm-uuid': '262eb845-eebe-4ffb-bc49-dcaca53ad7b8'}),), if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:20:01 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:20:01 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:20:01 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:20:01 user nova-compute[75226]: INFO os_vif [None req-48fffe3b-20dd-4da4-8c79-96b8a6f9fb22 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d9:19:6e,bridge_name='br-int',has_traffic_filtering=True,id=ca3803cf-fc7f-4233-8afa-1806c73156be,network=Network(432afb25-848f-4ef8-8436-11db949783e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca3803cf-fc')
Nov 17 01:20:01 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-48fffe3b-20dd-4da4-8c79-96b8a6f9fb22 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] No BDM found with device name vda, not building metadata. {{(pid=75226) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 01:20:01 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-48fffe3b-20dd-4da4-8c79-96b8a6f9fb22 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] No VIF found with MAC fa:16:3e:d9:19:6e, not building metadata {{(pid=75226) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 01:20:01 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-e720d526-c0fa-4537-8d1b-f93df9f76fc1 tempest-VolumesAssistedSnapshotsTest-526759134 tempest-VolumesAssistedSnapshotsTest-526759134-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 1c505f8d-09e0-41bc-ba3a-89bde1646613 is timed out.
Nov 17 01:20:01 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-e720d526-c0fa-4537-8d1b-f93df9f76fc1 tempest-VolumesAssistedSnapshotsTest-526759134 tempest-VolumesAssistedSnapshotsTest-526759134-project-admin] Successfully detached device vdb from instance 1c505f8d-09e0-41bc-ba3a-89bde1646613 from the live domain config.
Nov 17 01:20:01 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e720d526-c0fa-4537-8d1b-f93df9f76fc1 tempest-VolumesAssistedSnapshotsTest-526759134 tempest-VolumesAssistedSnapshotsTest-526759134-project-admin] [instance: 1c505f8d-09e0-41bc-ba3a-89bde1646613] calling os-brick to detach iSCSI Volume {{(pid=75226) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 17 01:20:01 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-e720d526-c0fa-4537-8d1b-f93df9f76fc1 tempest-VolumesAssistedSnapshotsTest-526759134 tempest-VolumesAssistedSnapshotsTest-526759134-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc4cc36b490>, {'target_iqn': 'iqn.2010-10.org.openstack:801ff813-83ea-4d9e-a8d2-ed4146b22b52', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hRtbMogC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': False}}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:20:01 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-e720d526-c0fa-4537-8d1b-f93df9f76fc1 tempest-VolumesAssistedSnapshotsTest-526759134 tempest-VolumesAssistedSnapshotsTest-526759134-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:20:01 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-e720d526-c0fa-4537-8d1b-f93df9f76fc1 tempest-VolumesAssistedSnapshotsTest-526759134 tempest-VolumesAssistedSnapshotsTest-526759134-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:20:01 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-e720d526-c0fa-4537-8d1b-f93df9f76fc1 tempest-VolumesAssistedSnapshotsTest-526759134 tempest-VolumesAssistedSnapshotsTest-526759134-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:20:01 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:20:01 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:20:01 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[9360351e-f5c1-430c-bb0f-6bbf0bcf97d4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:801ff813-83ea-4d9e-a8d2-ed4146b22b52\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:20:01 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-e720d526-c0fa-4537-8d1b-f93df9f76fc1 tempest-VolumesAssistedSnapshotsTest-526759134 tempest-VolumesAssistedSnapshotsTest-526759134-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 17 01:20:01 user nova-compute[75226]: No targets found.
Nov 17 01:20:01 user nova-compute[75226]: iSNS:
Nov 17 01:20:01 user nova-compute[75226]: No targets found.
Nov 17 01:20:01 user nova-compute[75226]: STATIC:
Nov 17 01:20:01 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:801ff813-83ea-4d9e-a8d2-ed4146b22b52
Nov 17 01:20:01 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:20:01 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:20:01 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2
Nov 17 01:20:01 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:20:01 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:20:01 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95
Nov 17 01:20:01 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:20:01 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:20:01 user nova-compute[75226]: FIRMWARE:
Nov 17 01:20:01 user nova-compute[75226]: No targets found.
Nov 17 01:20:01 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:20:01 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-e720d526-c0fa-4537-8d1b-f93df9f76fc1 tempest-VolumesAssistedSnapshotsTest-526759134 tempest-VolumesAssistedSnapshotsTest-526759134-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 17 01:20:01 user nova-compute[75226]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 17 01:20:01 user nova-compute[75226]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75226) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 17 01:20:01 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-e720d526-c0fa-4537-8d1b-f93df9f76fc1 tempest-VolumesAssistedSnapshotsTest-526759134 tempest-VolumesAssistedSnapshotsTest-526759134-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:801ff813-83ea-4d9e-a8d2-ed4146b22b52', 0)] {{(pid=75226) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 17 01:20:01 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:20:01 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:20:01 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dcfa313-fbe0-409b-93e8-760ba5cdf4fc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:801ff813-83ea-4d9e-a8d2-ed4146b22b52\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:20:01 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:20:01 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:20:01 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[f333cf2d-8f68-4f14-aaba-91b4fe027d51]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:801ff813-83ea-4d9e-a8d2-ed4146b22b52 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:20:01 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-e720d526-c0fa-4537-8d1b-f93df9f76fc1 tempest-VolumesAssistedSnapshotsTest-526759134 tempest-VolumesAssistedSnapshotsTest-526759134-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:801ff813-83ea-4d9e-a8d2-ed4146b22b52 (non-flash)
Nov 17 01:20:01 user nova-compute[75226]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95 (non-flash)
Nov 17 01:20:01 user nova-compute[75226]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2 (non-flash)
Nov 17 01:20:01 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:20:01 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-e720d526-c0fa-4537-8d1b-f93df9f76fc1 tempest-VolumesAssistedSnapshotsTest-526759134 tempest-VolumesAssistedSnapshotsTest-526759134-project-admin] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:801ff813-83ea-4d9e-a8d2-ed4146b22b52 (non-flash)
Nov 17 01:20:01 user nova-compute[75226]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95 (non-flash)
Nov 17 01:20:01 user nova-compute[75226]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2 (non-flash)
Nov 17 01:20:01 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:20:01 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-e720d526-c0fa-4537-8d1b-f93df9f76fc1 tempest-VolumesAssistedSnapshotsTest-526759134 tempest-VolumesAssistedSnapshotsTest-526759134-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc4b4380c10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:801ff813-83ea-4d9e-a8d2-ed4146b22b52'): ({'sdj'}, set())}) {{(pid=75226) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 17 01:20:01 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-e720d526-c0fa-4537-8d1b-f93df9f76fc1 tempest-VolumesAssistedSnapshotsTest-526759134 tempest-VolumesAssistedSnapshotsTest-526759134-project-admin] Removing single pathed devices sdj {{(pid=75226) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 17 01:20:01 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:20:01 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:20:01 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc420ec1-ea74-44d5-9f2c-a19c3c3a7087]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:20:01 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:20:01 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:20:01 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[01395a53-939e-4168-9926-8446ae3880a6]: (4, ('ok\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:20:01 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-e720d526-c0fa-4537-8d1b-f93df9f76fc1 tempest-VolumesAssistedSnapshotsTest-526759134 tempest-VolumesAssistedSnapshotsTest-526759134-project-admin] Flushing IO for device /dev/sdj {{(pid=75226) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 17 01:20:01 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:20:01 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.013s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:20:01 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[378c5ad4-d972-4efb-af72-e709ef1a6c36]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:20:01 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-e720d526-c0fa-4537-8d1b-f93df9f76fc1 tempest-VolumesAssistedSnapshotsTest-526759134 tempest-VolumesAssistedSnapshotsTest-526759134-project-admin] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=75226) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 17 01:20:01 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:20:01 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.049s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:20:01 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[429cefc7-cc35-4349-9e3b-0e8ad8123cac]: (4, ('1', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:20:01 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-e720d526-c0fa-4537-8d1b-f93df9f76fc1 tempest-VolumesAssistedSnapshotsTest-526759134 tempest-VolumesAssistedSnapshotsTest-526759134-project-admin] Checking to see if SCSI volumes sdj have been removed. {{(pid=75226) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 17 01:20:01 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-e720d526-c0fa-4537-8d1b-f93df9f76fc1 tempest-VolumesAssistedSnapshotsTest-526759134 tempest-VolumesAssistedSnapshotsTest-526759134-project-admin] SCSI volumes sdj have been removed. {{(pid=75226) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 17 01:20:01 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-e720d526-c0fa-4537-8d1b-f93df9f76fc1 tempest-VolumesAssistedSnapshotsTest-526759134 tempest-VolumesAssistedSnapshotsTest-526759134-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:801ff813-83ea-4d9e-a8d2-ed4146b22b52')] {{(pid=75226) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 17 01:20:01 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:801ff813-83ea-4d9e-a8d2-ed4146b22b52 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:20:01 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:801ff813-83ea-4d9e-a8d2-ed4146b22b52 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:20:01 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[3499d70f-e203-45d2-8e03-38a82c8f9297]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:20:01 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-e720d526-c0fa-4537-8d1b-f93df9f76fc1 tempest-VolumesAssistedSnapshotsTest-526759134 tempest-VolumesAssistedSnapshotsTest-526759134-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:20:01 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:801ff813-83ea-4d9e-a8d2-ed4146b22b52 -p 172.16.0.220:3260 --logout {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:20:01 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:801ff813-83ea-4d9e-a8d2-ed4146b22b52 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:20:01 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb9d33ad-a3d1-41a0-8e70-e7a267d186bb]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:801ff813-83ea-4d9e-a8d2-ed4146b22b52, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:801ff813-83ea-4d9e-a8d2-ed4146b22b52, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:20:01 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-e720d526-c0fa-4537-8d1b-f93df9f76fc1 tempest-VolumesAssistedSnapshotsTest-526759134 tempest-VolumesAssistedSnapshotsTest-526759134-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:801ff813-83ea-4d9e-a8d2-ed4146b22b52, portal: 172.16.0.220,3260]
Nov 17 01:20:01 user nova-compute[75226]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:801ff813-83ea-4d9e-a8d2-ed4146b22b52, portal: 172.16.0.220,3260] successful.
Nov 17 01:20:01 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:20:01 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:801ff813-83ea-4d9e-a8d2-ed4146b22b52 -p 172.16.0.220:3260 --op delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:20:01 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:801ff813-83ea-4d9e-a8d2-ed4146b22b52 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:20:01 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[92e5576c-6fe1-4cb3-95ac-5979112553f5]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:20:01 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-e720d526-c0fa-4537-8d1b-f93df9f76fc1 tempest-VolumesAssistedSnapshotsTest-526759134 tempest-VolumesAssistedSnapshotsTest-526759134-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:20:01 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-e720d526-c0fa-4537-8d1b-f93df9f76fc1 tempest-VolumesAssistedSnapshotsTest-526759134 tempest-VolumesAssistedSnapshotsTest-526759134-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:20:01 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-e720d526-c0fa-4537-8d1b-f93df9f76fc1 tempest-VolumesAssistedSnapshotsTest-526759134 tempest-VolumesAssistedSnapshotsTest-526759134-project-admin] <== disconnect_volume: return (306ms) None {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:20:01 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e720d526-c0fa-4537-8d1b-f93df9f76fc1 tempest-VolumesAssistedSnapshotsTest-526759134 tempest-VolumesAssistedSnapshotsTest-526759134-project-admin] [instance: 1c505f8d-09e0-41bc-ba3a-89bde1646613] Disconnected iSCSI Volume {{(pid=75226) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 17 01:20:02 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:20:02 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:20:02 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:20:02 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:20:02 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:20:02 user nova-compute[75226]: DEBUG nova.objects.instance [None req-e720d526-c0fa-4537-8d1b-f93df9f76fc1 tempest-VolumesAssistedSnapshotsTest-526759134 tempest-VolumesAssistedSnapshotsTest-526759134-project-admin] Lazy-loading 'flavor' on Instance uuid 1c505f8d-09e0-41bc-ba3a-89bde1646613 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:20:02 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e720d526-c0fa-4537-8d1b-f93df9f76fc1 tempest-VolumesAssistedSnapshotsTest-526759134 tempest-VolumesAssistedSnapshotsTest-526759134-project-admin] Lock "1c505f8d-09e0-41bc-ba3a-89bde1646613" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.690s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:20:02 user nova-compute[75226]: DEBUG nova.compute.manager [req-12ae6f79-82dd-419a-aa0a-78305b8d35b5 req-69594a0e-0d27-4478-b0c1-4f52c7d402eb service nova] [instance: 262eb845-eebe-4ffb-bc49-dcaca53ad7b8] Received event network-vif-plugged-ca3803cf-fc7f-4233-8afa-1806c73156be {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:20:02 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-12ae6f79-82dd-419a-aa0a-78305b8d35b5 req-69594a0e-0d27-4478-b0c1-4f52c7d402eb service nova] Acquiring lock "262eb845-eebe-4ffb-bc49-dcaca53ad7b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:20:02 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-12ae6f79-82dd-419a-aa0a-78305b8d35b5 req-69594a0e-0d27-4478-b0c1-4f52c7d402eb service nova] Lock "262eb845-eebe-4ffb-bc49-dcaca53ad7b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:20:02 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-12ae6f79-82dd-419a-aa0a-78305b8d35b5 req-69594a0e-0d27-4478-b0c1-4f52c7d402eb service nova] Lock "262eb845-eebe-4ffb-bc49-dcaca53ad7b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:20:02 user nova-compute[75226]: DEBUG nova.compute.manager [req-12ae6f79-82dd-419a-aa0a-78305b8d35b5 req-69594a0e-0d27-4478-b0c1-4f52c7d402eb service nova] [instance: 262eb845-eebe-4ffb-bc49-dcaca53ad7b8] No waiting events found dispatching network-vif-plugged-ca3803cf-fc7f-4233-8afa-1806c73156be {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:20:02 user nova-compute[75226]: WARNING nova.compute.manager [req-12ae6f79-82dd-419a-aa0a-78305b8d35b5 req-69594a0e-0d27-4478-b0c1-4f52c7d402eb service nova] [instance: 262eb845-eebe-4ffb-bc49-dcaca53ad7b8] Received unexpected event network-vif-plugged-ca3803cf-fc7f-4233-8afa-1806c73156be for instance with vm_state active and task_state rebuild_spawning.
Nov 17 01:20:02 user nova-compute[75226]: DEBUG nova.compute.manager [req-0f763b85-1850-46f2-b254-0dcbed28e3a4 req-5729bd80-77b9-4f3d-a77f-3e3f546a7f05 service nova] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Received event network-vif-deleted-3e4d946c-158b-49e8-a349-44da4864f830 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:20:02 user nova-compute[75226]: INFO nova.compute.manager [req-0f763b85-1850-46f2-b254-0dcbed28e3a4 req-5729bd80-77b9-4f3d-a77f-3e3f546a7f05 service nova] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Neutron deleted interface 3e4d946c-158b-49e8-a349-44da4864f830; detaching it from the instance and deleting it from the info cache
Nov 17 01:20:02 user nova-compute[75226]: DEBUG nova.network.neutron [req-0f763b85-1850-46f2-b254-0dcbed28e3a4 req-5729bd80-77b9-4f3d-a77f-3e3f546a7f05 service nova] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Updating instance_info_cache with network_info: [{"id": "6337887b-565a-4dc6-9a4f-4c8d9ac1c901", "address": "fa:16:3e:fc:8e:ff", "network": {"id": "4d03345a-3dc2-4436-a30b-30b8015b649e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2116320858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "871db3f789ac470c877456108324c68c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6337887b-56", "ovs_interfaceid": "6337887b-565a-4dc6-9a4f-4c8d9ac1c901", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8a548a9b-874e-4c7c-bf06-6896dd773ce4", "address": "fa:16:3e:5b:b6:0c", "network": {"id": "df3c1bab-64f6-49c0-b35a-396881f5862f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1354339680", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "871db3f789ac470c877456108324c68c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a548a9b-87", "ovs_interfaceid": "8a548a9b-874e-4c7c-bf06-6896dd773ce4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "01625fc1-9bbc-4edc-b594-78658e91edd9", "address": "fa:16:3e:13:8d:33", "network": {"id": "df3c1bab-64f6-49c0-b35a-396881f5862f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1354339680", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.68", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "871db3f789ac470c877456108324c68c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01625fc1-9b", "ovs_interfaceid": "01625fc1-9bbc-4edc-b594-78658e91edd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3b1855a6-8a37-47af-b3e6-86e60eb05a1d", "address": "fa:16:3e:5e:6d:29", "network": {"id": "df3c1bab-64f6-49c0-b35a-396881f5862f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1354339680", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "871db3f789ac470c877456108324c68c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b1855a6-8a", "ovs_interfaceid": "3b1855a6-8a37-47af-b3e6-86e60eb05a1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3c1a838d-e1c6-44d3-ab8a-a545044545a3", "address": "fa:16:3e:47:9b:84", "network": {"id": "b92e4d90-c7bd-45d6-a9db-d4b27ce718c5", "bridge": "br-int", "label": "tempest-device-tagging-net2-541044549", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "871db3f789ac470c877456108324c68c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c1a838d-e1", "ovs_interfaceid": "3c1a838d-e1c6-44d3-ab8a-a545044545a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:20:03 user nova-compute[75226]: DEBUG nova.network.neutron [-] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Updating instance_info_cache with network_info: [] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:20:03 user nova-compute[75226]: DEBUG nova.compute.manager [req-0f763b85-1850-46f2-b254-0dcbed28e3a4 req-5729bd80-77b9-4f3d-a77f-3e3f546a7f05 service nova] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Detach interface failed, port_id=3e4d946c-158b-49e8-a349-44da4864f830, reason: Instance 27342ec6-7a03-4f99-8056-5cb56794aa41 could not be found. {{(pid=75226) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 17 01:20:03 user nova-compute[75226]: DEBUG nova.compute.manager [req-0f763b85-1850-46f2-b254-0dcbed28e3a4 req-5729bd80-77b9-4f3d-a77f-3e3f546a7f05 service nova] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Received event network-vif-deleted-3b1855a6-8a37-47af-b3e6-86e60eb05a1d {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:20:03 user nova-compute[75226]: INFO nova.compute.manager [req-0f763b85-1850-46f2-b254-0dcbed28e3a4 req-5729bd80-77b9-4f3d-a77f-3e3f546a7f05 service nova] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Neutron deleted interface 3b1855a6-8a37-47af-b3e6-86e60eb05a1d; detaching it from the instance and deleting it from the info cache
Nov 17 01:20:03 user nova-compute[75226]: DEBUG nova.network.neutron [req-0f763b85-1850-46f2-b254-0dcbed28e3a4 req-5729bd80-77b9-4f3d-a77f-3e3f546a7f05 service nova] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Updating instance_info_cache with network_info: [{"id": "6337887b-565a-4dc6-9a4f-4c8d9ac1c901", "address": "fa:16:3e:fc:8e:ff", "network": {"id": "4d03345a-3dc2-4436-a30b-30b8015b649e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2116320858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "871db3f789ac470c877456108324c68c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6337887b-56", "ovs_interfaceid": "6337887b-565a-4dc6-9a4f-4c8d9ac1c901", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8a548a9b-874e-4c7c-bf06-6896dd773ce4", "address": "fa:16:3e:5b:b6:0c", "network": {"id": "df3c1bab-64f6-49c0-b35a-396881f5862f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1354339680", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "871db3f789ac470c877456108324c68c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a548a9b-87", "ovs_interfaceid": "8a548a9b-874e-4c7c-bf06-6896dd773ce4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "01625fc1-9bbc-4edc-b594-78658e91edd9", "address": "fa:16:3e:13:8d:33", "network": {"id": "df3c1bab-64f6-49c0-b35a-396881f5862f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1354339680", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.68", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "871db3f789ac470c877456108324c68c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01625fc1-9b", "ovs_interfaceid": "01625fc1-9bbc-4edc-b594-78658e91edd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3c1a838d-e1c6-44d3-ab8a-a545044545a3", "address": "fa:16:3e:47:9b:84", "network": {"id": "b92e4d90-c7bd-45d6-a9db-d4b27ce718c5", "bridge": "br-int", "label": "tempest-device-tagging-net2-541044549", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "871db3f789ac470c877456108324c68c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c1a838d-e1", "ovs_interfaceid": "3c1a838d-e1c6-44d3-ab8a-a545044545a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:20:03 user nova-compute[75226]: INFO nova.compute.manager [-] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Took 5.34 seconds to deallocate network for instance.
Nov 17 01:20:03 user nova-compute[75226]: DEBUG nova.compute.manager [req-0f763b85-1850-46f2-b254-0dcbed28e3a4 req-5729bd80-77b9-4f3d-a77f-3e3f546a7f05 service nova] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Detach interface failed, port_id=3b1855a6-8a37-47af-b3e6-86e60eb05a1d, reason: Instance 27342ec6-7a03-4f99-8056-5cb56794aa41 could not be found. {{(pid=75226) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 17 01:20:03 user nova-compute[75226]: DEBUG nova.compute.manager [req-0f763b85-1850-46f2-b254-0dcbed28e3a4 req-5729bd80-77b9-4f3d-a77f-3e3f546a7f05 service nova] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Received event network-vif-deleted-6337887b-565a-4dc6-9a4f-4c8d9ac1c901 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:20:03 user nova-compute[75226]: INFO nova.compute.manager [req-0f763b85-1850-46f2-b254-0dcbed28e3a4 req-5729bd80-77b9-4f3d-a77f-3e3f546a7f05 service nova] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Neutron deleted interface 6337887b-565a-4dc6-9a4f-4c8d9ac1c901; detaching it from the instance and deleting it from the info cache
Nov 17 01:20:03 user nova-compute[75226]: DEBUG nova.network.neutron [req-0f763b85-1850-46f2-b254-0dcbed28e3a4 req-5729bd80-77b9-4f3d-a77f-3e3f546a7f05 service nova] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Updating instance_info_cache with network_info: [{"id": "8a548a9b-874e-4c7c-bf06-6896dd773ce4", "address": "fa:16:3e:5b:b6:0c", "network": {"id": "df3c1bab-64f6-49c0-b35a-396881f5862f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1354339680", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "871db3f789ac470c877456108324c68c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a548a9b-87", "ovs_interfaceid": "8a548a9b-874e-4c7c-bf06-6896dd773ce4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "01625fc1-9bbc-4edc-b594-78658e91edd9", "address": "fa:16:3e:13:8d:33", "network": {"id": "df3c1bab-64f6-49c0-b35a-396881f5862f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1354339680", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.68", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "871db3f789ac470c877456108324c68c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01625fc1-9b", "ovs_interfaceid": "01625fc1-9bbc-4edc-b594-78658e91edd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3c1a838d-e1c6-44d3-ab8a-a545044545a3", "address": "fa:16:3e:47:9b:84", "network": {"id": "b92e4d90-c7bd-45d6-a9db-d4b27ce718c5", "bridge": "br-int", "label": "tempest-device-tagging-net2-541044549", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "871db3f789ac470c877456108324c68c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c1a838d-e1", "ovs_interfaceid": "3c1a838d-e1c6-44d3-ab8a-a545044545a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:20:03 user nova-compute[75226]: DEBUG nova.compute.manager [req-0f763b85-1850-46f2-b254-0dcbed28e3a4 req-5729bd80-77b9-4f3d-a77f-3e3f546a7f05 service nova] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Detach interface failed, port_id=6337887b-565a-4dc6-9a4f-4c8d9ac1c901, reason: Instance 27342ec6-7a03-4f99-8056-5cb56794aa41 could not be found. {{(pid=75226) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 17 01:20:03 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:20:03 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:20:03 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:20:03 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:20:03 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-4d32ff64-444c-4f86-999c-55124dcb793f tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Acquiring lock "6b7e9611-be35-4e51-b886-91a2fac0a653" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:20:03 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-4d32ff64-444c-4f86-999c-55124dcb793f tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Lock "6b7e9611-be35-4e51-b886-91a2fac0a653" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:20:03 user nova-compute[75226]: DEBUG nova.compute.manager [None req-4d32ff64-444c-4f86-999c-55124dcb793f tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 6b7e9611-be35-4e51-b886-91a2fac0a653] Starting instance... {{(pid=75226) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 17 01:20:03 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-4d32ff64-444c-4f86-999c-55124dcb793f tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:20:03 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-4d32ff64-444c-4f86-999c-55124dcb793f tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:20:03 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-4d32ff64-444c-4f86-999c-55124dcb793f tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75226) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 17 01:20:03 user nova-compute[75226]: INFO nova.compute.claims [None req-4d32ff64-444c-4f86-999c-55124dcb793f tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 6b7e9611-be35-4e51-b886-91a2fac0a653] Claim successful on node user
Nov 17 01:20:04 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-4d32ff64-444c-4f86-999c-55124dcb793f tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:20:04 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-4d32ff64-444c-4f86-999c-55124dcb793f tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:20:04 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-4d32ff64-444c-4f86-999c-55124dcb793f tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.383s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:20:04 user nova-compute[75226]: DEBUG nova.compute.manager [None req-4d32ff64-444c-4f86-999c-55124dcb793f tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 6b7e9611-be35-4e51-b886-91a2fac0a653] Start building networks asynchronously for instance. {{(pid=75226) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 17 01:20:04 user nova-compute[75226]: DEBUG nova.compute.manager [None req-4d32ff64-444c-4f86-999c-55124dcb793f tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 6b7e9611-be35-4e51-b886-91a2fac0a653] Allocating IP information in the background. {{(pid=75226) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 17 01:20:04 user nova-compute[75226]: DEBUG nova.network.neutron [None req-4d32ff64-444c-4f86-999c-55124dcb793f tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 6b7e9611-be35-4e51-b886-91a2fac0a653] allocate_for_instance() {{(pid=75226) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 17 01:20:04 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-4d32ff64-444c-4f86-999c-55124dcb793f tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 6b7e9611-be35-4e51-b886-91a2fac0a653] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 17 01:20:04 user nova-compute[75226]: DEBUG nova.compute.manager [None req-4d32ff64-444c-4f86-999c-55124dcb793f tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 6b7e9611-be35-4e51-b886-91a2fac0a653] Start building block device mappings for instance. {{(pid=75226) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 17 01:20:04 user nova-compute[75226]: DEBUG nova.policy [None req-4d32ff64-444c-4f86-999c-55124dcb793f tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1b793ce05bf44b939a9fb5a914a04cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6cb6f679ee4468d82cc7fb5d0f67be9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75226) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 17 01:20:04 user nova-compute[75226]: INFO nova.virt.block_device [None req-4d32ff64-444c-4f86-999c-55124dcb793f tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 6b7e9611-be35-4e51-b886-91a2fac0a653] Booting with blank volume at /dev/vda
Nov 17 01:20:04 user nova-compute[75226]: DEBUG nova.compute.manager [None req-48fffe3b-20dd-4da4-8c79-96b8a6f9fb22 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] [instance: 262eb845-eebe-4ffb-bc49-dcaca53ad7b8] Instance event wait completed in 0 seconds for  {{(pid=75226) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 17 01:20:04 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-48fffe3b-20dd-4da4-8c79-96b8a6f9fb22 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] [instance: 262eb845-eebe-4ffb-bc49-dcaca53ad7b8] Guest created on hypervisor {{(pid=75226) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 17 01:20:04 user nova-compute[75226]: DEBUG nova.compute.manager [req-09fe5fb5-7c57-4e63-a06d-3c6731fd6c08 req-9113cc71-3633-45b9-8aa0-192d41f59be5 service nova] [instance: 262eb845-eebe-4ffb-bc49-dcaca53ad7b8] Received event network-vif-plugged-ca3803cf-fc7f-4233-8afa-1806c73156be {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:20:04 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-09fe5fb5-7c57-4e63-a06d-3c6731fd6c08 req-9113cc71-3633-45b9-8aa0-192d41f59be5 service nova] Acquiring lock "262eb845-eebe-4ffb-bc49-dcaca53ad7b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:20:04 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-09fe5fb5-7c57-4e63-a06d-3c6731fd6c08 req-9113cc71-3633-45b9-8aa0-192d41f59be5 service nova] Lock "262eb845-eebe-4ffb-bc49-dcaca53ad7b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:20:04 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-09fe5fb5-7c57-4e63-a06d-3c6731fd6c08 req-9113cc71-3633-45b9-8aa0-192d41f59be5 service nova] Lock "262eb845-eebe-4ffb-bc49-dcaca53ad7b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:20:04 user nova-compute[75226]: DEBUG nova.compute.manager [req-09fe5fb5-7c57-4e63-a06d-3c6731fd6c08 req-9113cc71-3633-45b9-8aa0-192d41f59be5 service nova] [instance: 262eb845-eebe-4ffb-bc49-dcaca53ad7b8] No waiting events found dispatching network-vif-plugged-ca3803cf-fc7f-4233-8afa-1806c73156be {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:20:04 user nova-compute[75226]: WARNING nova.compute.manager [req-09fe5fb5-7c57-4e63-a06d-3c6731fd6c08 req-9113cc71-3633-45b9-8aa0-192d41f59be5 service nova] [instance: 262eb845-eebe-4ffb-bc49-dcaca53ad7b8] Received unexpected event network-vif-plugged-ca3803cf-fc7f-4233-8afa-1806c73156be for instance with vm_state active and task_state rebuild_spawning.
Nov 17 01:20:04 user nova-compute[75226]: INFO nova.virt.libvirt.driver [-] [instance: 262eb845-eebe-4ffb-bc49-dcaca53ad7b8] Instance spawned successfully.
Nov 17 01:20:04 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-48fffe3b-20dd-4da4-8c79-96b8a6f9fb22 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] [instance: 262eb845-eebe-4ffb-bc49-dcaca53ad7b8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 17 01:20:04 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-48fffe3b-20dd-4da4-8c79-96b8a6f9fb22 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] [instance: 262eb845-eebe-4ffb-bc49-dcaca53ad7b8] Found default for hw_cdrom_bus of ide {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:20:04 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-48fffe3b-20dd-4da4-8c79-96b8a6f9fb22 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] [instance: 262eb845-eebe-4ffb-bc49-dcaca53ad7b8] Found default for hw_disk_bus of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:20:04 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-48fffe3b-20dd-4da4-8c79-96b8a6f9fb22 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] [instance: 262eb845-eebe-4ffb-bc49-dcaca53ad7b8] Found default for hw_input_bus of None {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:20:04 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-48fffe3b-20dd-4da4-8c79-96b8a6f9fb22 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] [instance: 262eb845-eebe-4ffb-bc49-dcaca53ad7b8] Found default for hw_pointer_model of None {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:20:04 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-48fffe3b-20dd-4da4-8c79-96b8a6f9fb22 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] [instance: 262eb845-eebe-4ffb-bc49-dcaca53ad7b8] Found default for hw_video_model of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:20:04 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-48fffe3b-20dd-4da4-8c79-96b8a6f9fb22 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] [instance: 262eb845-eebe-4ffb-bc49-dcaca53ad7b8] Found default for hw_vif_model of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:20:04 user nova-compute[75226]: DEBUG nova.compute.manager [None req-48fffe3b-20dd-4da4-8c79-96b8a6f9fb22 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] [instance: 262eb845-eebe-4ffb-bc49-dcaca53ad7b8] Checking state {{(pid=75226) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 01:20:04 user nova-compute[75226]: DEBUG nova.network.neutron [None req-4d32ff64-444c-4f86-999c-55124dcb793f tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 6b7e9611-be35-4e51-b886-91a2fac0a653] Successfully created port: 657af53c-fc3a-45ab-81e5-b2eeea1c88d7 {{(pid=75226) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 17 01:20:05 user nova-compute[75226]: DEBUG nova.compute.manager [req-fb36f031-8466-4094-8d23-8957936425a8 req-129b5d2c-c3d4-402d-9601-3f28a0fc732e service nova] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Received event network-vif-deleted-3c1a838d-e1c6-44d3-ab8a-a545044545a3 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:20:05 user nova-compute[75226]: INFO nova.compute.manager [req-fb36f031-8466-4094-8d23-8957936425a8 req-129b5d2c-c3d4-402d-9601-3f28a0fc732e service nova] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Neutron deleted interface 3c1a838d-e1c6-44d3-ab8a-a545044545a3; detaching it from the instance and deleting it from the info cache
Nov 17 01:20:05 user nova-compute[75226]: DEBUG nova.network.neutron [req-fb36f031-8466-4094-8d23-8957936425a8 req-129b5d2c-c3d4-402d-9601-3f28a0fc732e service nova] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Updating instance_info_cache with network_info: [{"id": "8a548a9b-874e-4c7c-bf06-6896dd773ce4", "address": "fa:16:3e:5b:b6:0c", "network": {"id": "df3c1bab-64f6-49c0-b35a-396881f5862f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1354339680", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "871db3f789ac470c877456108324c68c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a548a9b-87", "ovs_interfaceid": "8a548a9b-874e-4c7c-bf06-6896dd773ce4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "01625fc1-9bbc-4edc-b594-78658e91edd9", "address": "fa:16:3e:13:8d:33", "network": {"id": "df3c1bab-64f6-49c0-b35a-396881f5862f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1354339680", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.68", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "871db3f789ac470c877456108324c68c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01625fc1-9b", "ovs_interfaceid": "01625fc1-9bbc-4edc-b594-78658e91edd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:20:05 user nova-compute[75226]: DEBUG nova.compute.manager [req-fb36f031-8466-4094-8d23-8957936425a8 req-129b5d2c-c3d4-402d-9601-3f28a0fc732e service nova] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Detach interface failed, port_id=3c1a838d-e1c6-44d3-ab8a-a545044545a3, reason: Instance 27342ec6-7a03-4f99-8056-5cb56794aa41 could not be found. {{(pid=75226) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 17 01:20:05 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-48fffe3b-20dd-4da4-8c79-96b8a6f9fb22 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:20:05 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-48fffe3b-20dd-4da4-8c79-96b8a6f9fb22 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:20:05 user nova-compute[75226]: DEBUG nova.objects.instance [None req-48fffe3b-20dd-4da4-8c79-96b8a6f9fb22 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] [instance: 262eb845-eebe-4ffb-bc49-dcaca53ad7b8] Trying to apply a migration context that does not seem to be set for this instance {{(pid=75226) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 17 01:20:05 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-48fffe3b-20dd-4da4-8c79-96b8a6f9fb22 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.074s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:20:05 user nova-compute[75226]: INFO nova.compute.manager [None req-c77c2bf8-c00d-4ba7-8ee2-f504accdaabf tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] [instance: 27342ec6-7a03-4f99-8056-5cb56794aa41] Took 2.54 seconds to detach 3 volumes for instance.
Nov 17 01:20:05 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-c77c2bf8-c00d-4ba7-8ee2-f504accdaabf tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:20:05 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-c77c2bf8-c00d-4ba7-8ee2-f504accdaabf tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:20:05 user nova-compute[75226]: DEBUG nova.network.neutron [None req-4d32ff64-444c-4f86-999c-55124dcb793f tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 6b7e9611-be35-4e51-b886-91a2fac0a653] Successfully updated port: 657af53c-fc3a-45ab-81e5-b2eeea1c88d7 {{(pid=75226) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 17 01:20:05 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-4d32ff64-444c-4f86-999c-55124dcb793f tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Acquiring lock "refresh_cache-6b7e9611-be35-4e51-b886-91a2fac0a653" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:20:05 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-4d32ff64-444c-4f86-999c-55124dcb793f tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Acquired lock "refresh_cache-6b7e9611-be35-4e51-b886-91a2fac0a653" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:20:05 user nova-compute[75226]: DEBUG nova.network.neutron [None req-4d32ff64-444c-4f86-999c-55124dcb793f tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 6b7e9611-be35-4e51-b886-91a2fac0a653] Building network info cache for instance {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 01:20:05 user nova-compute[75226]: DEBUG nova.network.neutron [None req-4d32ff64-444c-4f86-999c-55124dcb793f tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 6b7e9611-be35-4e51-b886-91a2fac0a653] Instance cache missing network info. {{(pid=75226) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 17 01:20:05 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-c77c2bf8-c00d-4ba7-8ee2-f504accdaabf tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:20:05 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-c77c2bf8-c00d-4ba7-8ee2-f504accdaabf tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:20:05 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:20:05 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:20:05 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Starting heal instance info cache {{(pid=75226) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 17 01:20:06 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-c77c2bf8-c00d-4ba7-8ee2-f504accdaabf tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.345s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:20:06 user nova-compute[75226]: INFO nova.scheduler.client.report [None req-c77c2bf8-c00d-4ba7-8ee2-f504accdaabf tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Deleted allocations for instance 27342ec6-7a03-4f99-8056-5cb56794aa41
Nov 17 01:20:06 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "refresh_cache-ddfecefc-1e9b-4e6e-9995-855c8a061084" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:20:06 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquired lock "refresh_cache-ddfecefc-1e9b-4e6e-9995-855c8a061084" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:20:06 user nova-compute[75226]: DEBUG nova.network.neutron [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] [instance: ddfecefc-1e9b-4e6e-9995-855c8a061084] Forcefully refreshing network info cache for instance {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 17 01:20:06 user nova-compute[75226]: DEBUG nova.network.neutron [None req-4d32ff64-444c-4f86-999c-55124dcb793f tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 6b7e9611-be35-4e51-b886-91a2fac0a653] Updating instance_info_cache with network_info: [{"id": "657af53c-fc3a-45ab-81e5-b2eeea1c88d7", "address": "fa:16:3e:91:de:17", "network": {"id": "450540a3-ff7e-42fb-a0a6-808acd749943", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1503678778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6cb6f679ee4468d82cc7fb5d0f67be9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap657af53c-fc", "ovs_interfaceid": "657af53c-fc3a-45ab-81e5-b2eeea1c88d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:20:06 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-4d32ff64-444c-4f86-999c-55124dcb793f tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Releasing lock "refresh_cache-6b7e9611-be35-4e51-b886-91a2fac0a653" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:20:06 user nova-compute[75226]: DEBUG nova.compute.manager [None req-4d32ff64-444c-4f86-999c-55124dcb793f tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 6b7e9611-be35-4e51-b886-91a2fac0a653] Instance network_info: |[{"id": "657af53c-fc3a-45ab-81e5-b2eeea1c88d7", "address": "fa:16:3e:91:de:17", "network": {"id": "450540a3-ff7e-42fb-a0a6-808acd749943", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1503678778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6cb6f679ee4468d82cc7fb5d0f67be9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap657af53c-fc", "ovs_interfaceid": "657af53c-fc3a-45ab-81e5-b2eeea1c88d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75226) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 17 01:20:06 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-c77c2bf8-c00d-4ba7-8ee2-f504accdaabf tempest-TaggedBootDevicesTest-1790286385 tempest-TaggedBootDevicesTest-1790286385-project-member] Lock "27342ec6-7a03-4f99-8056-5cb56794aa41" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 12.240s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:20:06 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:20:06 user nova-compute[75226]: DEBUG nova.network.neutron [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] [instance: ddfecefc-1e9b-4e6e-9995-855c8a061084] Updating instance_info_cache with network_info: [{"id": "f9a7562b-de63-4374-b43b-18e3cb3af710", "address": "fa:16:3e:94:21:00", "network": {"id": "8450ab2c-4f24-46cc-a6ec-644c02e2b3da", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-385219532-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6869af66e0cc47bf9cca02ea9b688a6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9a7562b-de", "ovs_interfaceid": "f9a7562b-de63-4374-b43b-18e3cb3af710", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:20:06 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Releasing lock "refresh_cache-ddfecefc-1e9b-4e6e-9995-855c8a061084" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:20:06 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] [instance: ddfecefc-1e9b-4e6e-9995-855c8a061084] Updated the network info_cache for instance {{(pid=75226) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 17 01:20:06 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:20:06 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:20:06 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:20:06 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:20:06 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:20:06 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:20:06 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75226) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 17 01:20:06 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:20:06 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:20:06 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:20:06 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:20:06 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75226) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 17 01:20:06 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75226) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 01:20:06 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddfecefc-1e9b-4e6e-9995-855c8a061084/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:20:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddfecefc-1e9b-4e6e-9995-855c8a061084/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:20:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddfecefc-1e9b-4e6e-9995-855c8a061084/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:20:07 user nova-compute[75226]: DEBUG nova.compute.manager [req-ada042e9-5e24-43f6-8316-0d02e5b091b6 req-e9130966-6980-43a0-a6ba-f9c0383ff5ed service nova] [instance: 6b7e9611-be35-4e51-b886-91a2fac0a653] Received event network-changed-657af53c-fc3a-45ab-81e5-b2eeea1c88d7 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:20:07 user nova-compute[75226]: DEBUG nova.compute.manager [req-ada042e9-5e24-43f6-8316-0d02e5b091b6 req-e9130966-6980-43a0-a6ba-f9c0383ff5ed service nova] [instance: 6b7e9611-be35-4e51-b886-91a2fac0a653] Refreshing instance network info cache due to event network-changed-657af53c-fc3a-45ab-81e5-b2eeea1c88d7. {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 01:20:07 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-ada042e9-5e24-43f6-8316-0d02e5b091b6 req-e9130966-6980-43a0-a6ba-f9c0383ff5ed service nova] Acquiring lock "refresh_cache-6b7e9611-be35-4e51-b886-91a2fac0a653" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:20:07 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-ada042e9-5e24-43f6-8316-0d02e5b091b6 req-e9130966-6980-43a0-a6ba-f9c0383ff5ed service nova] Acquired lock "refresh_cache-6b7e9611-be35-4e51-b886-91a2fac0a653" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:20:07 user nova-compute[75226]: DEBUG nova.network.neutron [req-ada042e9-5e24-43f6-8316-0d02e5b091b6 req-e9130966-6980-43a0-a6ba-f9c0383ff5ed service nova] [instance: 6b7e9611-be35-4e51-b886-91a2fac0a653] Refreshing network info cache for port 657af53c-fc3a-45ab-81e5-b2eeea1c88d7 {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 01:20:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddfecefc-1e9b-4e6e-9995-855c8a061084/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:20:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b054a557-dff6-49f8-9300-1307f8433567/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:20:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b054a557-dff6-49f8-9300-1307f8433567/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:20:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b054a557-dff6-49f8-9300-1307f8433567/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:20:07 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:20:07 user nova-compute[75226]: DEBUG nova.network.neutron [req-ada042e9-5e24-43f6-8316-0d02e5b091b6 req-e9130966-6980-43a0-a6ba-f9c0383ff5ed service nova] [instance: 6b7e9611-be35-4e51-b886-91a2fac0a653] Updated VIF entry in instance network info cache for port 657af53c-fc3a-45ab-81e5-b2eeea1c88d7. {{(pid=75226) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 01:20:07 user nova-compute[75226]: DEBUG nova.network.neutron [req-ada042e9-5e24-43f6-8316-0d02e5b091b6 req-e9130966-6980-43a0-a6ba-f9c0383ff5ed service nova] [instance: 6b7e9611-be35-4e51-b886-91a2fac0a653] Updating instance_info_cache with network_info: [{"id": "657af53c-fc3a-45ab-81e5-b2eeea1c88d7", "address": "fa:16:3e:91:de:17", "network": {"id": "450540a3-ff7e-42fb-a0a6-808acd749943", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1503678778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6cb6f679ee4468d82cc7fb5d0f67be9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap657af53c-fc", "ovs_interfaceid": "657af53c-fc3a-45ab-81e5-b2eeea1c88d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:20:07 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-ada042e9-5e24-43f6-8316-0d02e5b091b6 req-e9130966-6980-43a0-a6ba-f9c0383ff5ed service nova] Releasing lock "refresh_cache-6b7e9611-be35-4e51-b886-91a2fac0a653" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:20:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b054a557-dff6-49f8-9300-1307f8433567/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:20:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa84e575-bdad-45b9-80ce-86b1c2826fb0/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:20:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa84e575-bdad-45b9-80ce-86b1c2826fb0/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:20:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa84e575-bdad-45b9-80ce-86b1c2826fb0/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:20:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa84e575-bdad-45b9-80ce-86b1c2826fb0/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:20:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c505f8d-09e0-41bc-ba3a-89bde1646613/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:20:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c505f8d-09e0-41bc-ba3a-89bde1646613/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:20:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c505f8d-09e0-41bc-ba3a-89bde1646613/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:20:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c505f8d-09e0-41bc-ba3a-89bde1646613/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:20:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75b1cabe-ba15-4851-9140-5949afc33005/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:20:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75b1cabe-ba15-4851-9140-5949afc33005/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:20:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75b1cabe-ba15-4851-9140-5949afc33005/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:20:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75b1cabe-ba15-4851-9140-5949afc33005/disk --force-share --output=json" returned: 0 in 0.289s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:20:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/724b81dd-4531-4c99-850d-0bfcbfdf7bd4/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:20:09 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/724b81dd-4531-4c99-850d-0bfcbfdf7bd4/disk --force-share --output=json" returned: 0 in 0.355s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:20:09 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/724b81dd-4531-4c99-850d-0bfcbfdf7bd4/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:20:09 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/724b81dd-4531-4c99-850d-0bfcbfdf7bd4/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:20:09 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:20:09 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:20:09 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Hypervisor/Node resource view: name=user free_ram=8136MB free_disk=25.349853515625GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75226) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 17 01:20:09 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:20:09 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:20:10 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance aa84e575-bdad-45b9-80ce-86b1c2826fb0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:20:10 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance ddfecefc-1e9b-4e6e-9995-855c8a061084 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:20:10 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 724b81dd-4531-4c99-850d-0bfcbfdf7bd4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:20:10 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 75b1cabe-ba15-4851-9140-5949afc33005 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:20:10 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance b054a557-dff6-49f8-9300-1307f8433567 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:20:10 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 1c505f8d-09e0-41bc-ba3a-89bde1646613 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:20:10 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 262eb845-eebe-4ffb-bc49-dcaca53ad7b8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:20:10 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 6b7e9611-be35-4e51-b886-91a2fac0a653 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:20:10 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75226) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 17 01:20:10 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75226) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 17 01:20:10 user nova-compute[75226]: DEBUG os_brick.utils [None req-4d32ff64-444c-4f86-999c-55124dcb793f tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:20:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:20:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:20:10 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4907cac-a62f-424d-84a7-80875daf8f93]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f62857db69\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:20:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:20:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:20:10 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb96c785-2da6-4382-acb3-781fe4faea58]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:20:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:20:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.046s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:20:10 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c81453e-d6ce-4326-91f9-a6d1ce34b854]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:20:10 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b5a2e67-4c2e-42c6-a6d5-5e362eb3787a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:20:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-4d32ff64-444c-4f86-999c-55124dcb793f tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Running cmd (subprocess): nvme version {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:20:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-4d32ff64-444c-4f86-999c-55124dcb793f tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] 'nvme version' failed. Not Retrying. {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 01:20:10 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4d32ff64-444c-4f86-999c-55124dcb793f tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] nvme not present on system {{(pid=75226) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 17 01:20:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:20:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 01:20:10 user nova-compute[75226]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 17 01:20:10 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f614513-078d-4715-bf91-915d7b9b5364]: (4, '') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:20:10 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-4d32ff64-444c-4f86-999c-55124dcb793f tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75226) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 17 01:20:10 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-4d32ff64-444c-4f86-999c-55124dcb793f tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75226) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 17 01:20:10 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-4d32ff64-444c-4f86-999c-55124dcb793f tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] LIGHTOS: no hostnqn found. {{(pid=75226) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 17 01:20:10 user nova-compute[75226]: DEBUG os_brick.utils [None req-4d32ff64-444c-4f86-999c-55124dcb793f tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] <== get_connector_properties: return (168ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f62857db69', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:20:10 user nova-compute[75226]: DEBUG nova.virt.block_device [None req-4d32ff64-444c-4f86-999c-55124dcb793f tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 6b7e9611-be35-4e51-b886-91a2fac0a653] Updating existing volume attachment record: dba3777d-4ebc-415f-9803-b8e2e9467692 {{(pid=75226) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 17 01:20:10 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:20:10 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:20:10 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Compute_service record updated for user:user {{(pid=75226) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 17 01:20:10 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.510s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:20:11 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:20:16 user nova-compute[75226]: DEBUG nova.compute.manager [None req-4d32ff64-444c-4f86-999c-55124dcb793f tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 6b7e9611-be35-4e51-b886-91a2fac0a653] Start spawning the instance on the hypervisor. {{(pid=75226) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 17 01:20:16 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-4d32ff64-444c-4f86-999c-55124dcb793f tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 6b7e9611-be35-4e51-b886-91a2fac0a653] Creating instance directory {{(pid=75226) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 17 01:20:16 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-4d32ff64-444c-4f86-999c-55124dcb793f tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 6b7e9611-be35-4e51-b886-91a2fac0a653] Creating image(s)
Nov 17 01:20:16 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-4d32ff64-444c-4f86-999c-55124dcb793f tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 6b7e9611-be35-4e51-b886-91a2fac0a653] Did not create local disks {{(pid=75226) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 17 01:20:16 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-4d32ff64-444c-4f86-999c-55124dcb793f tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 6b7e9611-be35-4e51-b886-91a2fac0a653] Ensure instance console log exists: /opt/stack/data/nova/instances/6b7e9611-be35-4e51-b886-91a2fac0a653/console.log {{(pid=75226) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 17 01:20:16 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-4d32ff64-444c-4f86-999c-55124dcb793f tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:20:16 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-4d32ff64-444c-4f86-999c-55124dcb793f tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:20:16 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-4d32ff64-444c-4f86-999c-55124dcb793f tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:20:16 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-4d32ff64-444c-4f86-999c-55124dcb793f tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 6b7e9611-be35-4e51-b886-91a2fac0a653] Start _get_guest_xml network_info=[{"id": "657af53c-fc3a-45ab-81e5-b2eeea1c88d7", "address": "fa:16:3e:91:de:17", "network": {"id": "450540a3-ff7e-42fb-a0a6-808acd749943", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1503678778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6cb6f679ee4468d82cc7fb5d0f67be9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap657af53c-fc", "ovs_interfaceid": "657af53c-fc3a-45ab-81e5-b2eeea1c88d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T01:13:22Z,direct_url=<?>,disk_format='qcow2',id=0b369aea-6f3f-4690-9f01-229b90ab6310,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4e110cbf9a84362a6864a7732c435a1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T01:13:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aEbhyCZJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6b7e9611-be35-4e51-b886-91a2fac0a653', 'attached_at': '', 'detached_at': '', 'volume_id': '9cf1355f-12ee-4285-9c07-f120d1308cb8', 'serial': '9cf1355f-12ee-4285-9c07-f120d1308cb8'}, 'attachment_id': 'dba3777d-4ebc-415f-9803-b8e2e9467692', 'device_type': 'disk', 'volume_type': None} {{(pid=75226) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 17 01:20:16 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-4d32ff64-444c-4f86-999c-55124dcb793f tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:20:16 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-4d32ff64-444c-4f86-999c-55124dcb793f tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:20:16 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-4d32ff64-444c-4f86-999c-55124dcb793f tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75226) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 17 01:20:16 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-4d32ff64-444c-4f86-999c-55124dcb793f tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] CPU controller missing on host. {{(pid=75226) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 17 01:20:16 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-4d32ff64-444c-4f86-999c-55124dcb793f tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75226) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 17 01:20:16 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-4d32ff64-444c-4f86-999c-55124dcb793f tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] CPU controller found on host. {{(pid=75226) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 17 01:20:16 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-4d32ff64-444c-4f86-999c-55124dcb793f tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75226) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 17 01:20:16 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-4d32ff64-444c-4f86-999c-55124dcb793f tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-17T01:13:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T01:13:22Z,direct_url=<?>,disk_format='qcow2',id=0b369aea-6f3f-4690-9f01-229b90ab6310,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4e110cbf9a84362a6864a7732c435a1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T01:13:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 17 01:20:16 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-4d32ff64-444c-4f86-999c-55124dcb793f tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Flavor limits 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 17 01:20:16 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-4d32ff64-444c-4f86-999c-55124dcb793f tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Image limits 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 17 01:20:16 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-4d32ff64-444c-4f86-999c-55124dcb793f tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Flavor pref 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 17 01:20:16 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-4d32ff64-444c-4f86-999c-55124dcb793f tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Image pref 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 17 01:20:16 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-4d32ff64-444c-4f86-999c-55124dcb793f tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 17 01:20:16 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-4d32ff64-444c-4f86-999c-55124dcb793f tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 17 01:20:16 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-4d32ff64-444c-4f86-999c-55124dcb793f tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75226) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 17 01:20:16 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-4d32ff64-444c-4f86-999c-55124dcb793f tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Got 1 possible topologies {{(pid=75226) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 17 01:20:16 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-4d32ff64-444c-4f86-999c-55124dcb793f tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 17 01:20:16 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-4d32ff64-444c-4f86-999c-55124dcb793f tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 17 01:20:16 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d32ff64-444c-4f86-999c-55124dcb793f tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 6b7e9611-be35-4e51-b886-91a2fac0a653] Calling os-brick to attach iSCSI Volume {{(pid=75226) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 17 01:20:16 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d32ff64-444c-4f86-999c-55124dcb793f tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc4cc36b490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aEbhyCZJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:20:16 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-4d32ff64-444c-4f86-999c-55124dcb793f tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:20:16 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-4d32ff64-444c-4f86-999c-55124dcb793f tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:20:16 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-4d32ff64-444c-4f86-999c-55124dcb793f tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:20:16 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-4d32ff64-444c-4f86-999c-55124dcb793f tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:20:16 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-4d32ff64-444c-4f86-999c-55124dcb793f tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:20:16 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-4d32ff64-444c-4f86-999c-55124dcb793f tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:20:16 user nova-compute[75226]: INFO os_brick.initiator.connectors.iscsi [None req-4d32ff64-444c-4f86-999c-55124dcb793f tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 17 01:20:16 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 -p 172.16.0.220:3260 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:20:16 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:20:16 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[f12daca0-4140-4b66-9558-09b63f8e635a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:20:16 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d32ff64-444c-4f86-999c-55124dcb793f tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 17 01:20:16 user nova-compute[75226]:  {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:20:16 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 -p 172.16.0.220:3260 --interface default --op new {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:20:16 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:20:16 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a852746-aa02-4eff-913c-eb21c26077d8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8] added\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:20:16 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d32ff64-444c-4f86-999c-55124dcb793f tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8] added
Nov 17 01:20:16 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:20:16 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:20:16 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:20:16 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[799ffbe5-61e8-4afb-8d76-544fcd4aaddb]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:20:16 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d32ff64-444c-4f86-999c-55124dcb793f tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:20:16 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:20:16 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:20:16 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.037s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:20:16 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[a45e1a47-44a1-4053-9614-23ed7271d687]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:20:16 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d32ff64-444c-4f86-999c-55124dcb793f tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:20:16 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aEbhyCZJ {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:20:16 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aEbhyCZJ" returned: 0 in 0.026s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:20:16 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[8774fc1b-633f-4dd0-9d1f-5934632eeef6]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:20:16 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d32ff64-444c-4f86-999c-55124dcb793f tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aEbhyCZJ'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:20:16 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:20:16 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:20:16 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[de206e4f-0ed9-4db8-bb98-6a55454951f2]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:20:16 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d32ff64-444c-4f86-999c-55124dcb793f tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:20:16 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:20:16 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:20:16 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d77c95f-cb12-40c4-830f-d25f25aae334]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:20:16 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d32ff64-444c-4f86-999c-55124dcb793f tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95 (non-flash)
Nov 17 01:20:16 user nova-compute[75226]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2 (non-flash)
Nov 17 01:20:16 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:20:16 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d32ff64-444c-4f86-999c-55124dcb793f tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95 (non-flash)
Nov 17 01:20:16 user nova-compute[75226]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2 (non-flash)
Nov 17 01:20:16 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:20:16 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 -p 172.16.0.220:3260 --login {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:20:16 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:20:16 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f57fd90-c4c2-435a-a49e-8cce4f011634]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:20:16 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d32ff64-444c-4f86-999c-55124dcb793f tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8, portal: 172.16.0.220,3260]
Nov 17 01:20:16 user nova-compute[75226]: Login to [iface: default, target: iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8, portal: 172.16.0.220,3260] successful.
Nov 17 01:20:16 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:20:16 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:20:16 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:20:16 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[f075e969-a517-48b8-a87d-3ca14c07d686]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:20:16 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d32ff64-444c-4f86-999c-55124dcb793f tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:20:16 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:20:16 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:20:16 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c32e0a5-bad2-46c4-ad94-1ae695c906ca]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:20:16 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d32ff64-444c-4f86-999c-55124dcb793f tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95 (non-flash)
Nov 17 01:20:16 user nova-compute[75226]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2 (non-flash)
Nov 17 01:20:16 user nova-compute[75226]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)
Nov 17 01:20:16 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:20:16 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d32ff64-444c-4f86-999c-55124dcb793f tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95 (non-flash)
Nov 17 01:20:16 user nova-compute[75226]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2 (non-flash)
Nov 17 01:20:16 user nova-compute[75226]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)
Nov 17 01:20:16 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:20:16 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-4d32ff64-444c-4f86-999c-55124dcb793f tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.323s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:20:16 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d32ff64-444c-4f86-999c-55124dcb793f tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Connected to 172.16.0.220:3260 {{(pid=75226) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 17 01:20:16 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-4d32ff64-444c-4f86-999c-55124dcb793f tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] HCTL ('34', '-', '-', 0) found on session 16 with lun 0 {{(pid=75226) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 17 01:20:16 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-4d32ff64-444c-4f86-999c-55124dcb793f tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75226) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 17 01:20:16 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:20:16 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:20:16 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[af2543fa-4646-4ff5-9c5a-cf9edcd39c88]: (4, ('- - 0', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:20:16 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-4d32ff64-444c-4f86-999c-55124dcb793f tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Searching for a device in session 16 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75226) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 01:20:16 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d32ff64-444c-4f86-999c-55124dcb793f tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aEbhyCZJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75226) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 17 01:20:17 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-4d32ff64-444c-4f86-999c-55124dcb793f tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.354s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:20:17 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d32ff64-444c-4f86-999c-55124dcb793f tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] <== connect_volume: return (1356ms) {'type': 'block', 'scsi_wwn': '23162386133666163', 'path': '/dev/sdc'} {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:20:17 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d32ff64-444c-4f86-999c-55124dcb793f tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 6b7e9611-be35-4e51-b886-91a2fac0a653] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23162386133666163', 'path': '/dev/sdc'} {{(pid=75226) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 17 01:20:17 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-4d32ff64-444c-4f86-999c-55124dcb793f tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:20:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-614527780',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-614527780',id=11,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e6cb6f679ee4468d82cc7fb5d0f67be9',ramdisk_id='',reservation_id='r-do7w6o8m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-76498640',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T01:20:04Z,user_data=None,user_id='1b793ce05bf44b939a9fb5a914a04cb0',uuid=6b7e9611-be35-4e51-b886-91a2fac0a653,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "657af53c-fc3a-45ab-81e5-b2eeea1c88d7", "address": "fa:16:3e:91:de:17", "network": {"id": "450540a3-ff7e-42fb-a0a6-808acd749943", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1503678778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6cb6f679ee4468d82cc7fb5d0f67be9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap657af53c-fc", "ovs_interfaceid": "657af53c-fc3a-45ab-81e5-b2eeea1c88d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75226) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 01:20:17 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-4d32ff64-444c-4f86-999c-55124dcb793f tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Converting VIF {"id": "657af53c-fc3a-45ab-81e5-b2eeea1c88d7", "address": "fa:16:3e:91:de:17", "network": {"id": "450540a3-ff7e-42fb-a0a6-808acd749943", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1503678778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6cb6f679ee4468d82cc7fb5d0f67be9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap657af53c-fc", "ovs_interfaceid": "657af53c-fc3a-45ab-81e5-b2eeea1c88d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:20:17 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-4d32ff64-444c-4f86-999c-55124dcb793f tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:de:17,bridge_name='br-int',has_traffic_filtering=True,id=657af53c-fc3a-45ab-81e5-b2eeea1c88d7,network=Network(450540a3-ff7e-42fb-a0a6-808acd749943),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap657af53c-fc') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:20:17 user nova-compute[75226]: DEBUG nova.objects.instance [None req-4d32ff64-444c-4f86-999c-55124dcb793f tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Lazy-loading 'pci_devices' on Instance uuid 6b7e9611-be35-4e51-b886-91a2fac0a653 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:20:17 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-4d32ff64-444c-4f86-999c-55124dcb793f tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 6b7e9611-be35-4e51-b886-91a2fac0a653] End _get_guest_xml xml=<domain type="kvm">
Nov 17 01:20:17 user nova-compute[75226]:   <uuid>6b7e9611-be35-4e51-b886-91a2fac0a653</uuid>
Nov 17 01:20:17 user nova-compute[75226]:   <name>instance-0000000b</name>
Nov 17 01:20:17 user nova-compute[75226]:   <memory>524288</memory>
Nov 17 01:20:17 user nova-compute[75226]:   <vcpu>1</vcpu>
Nov 17 01:20:17 user nova-compute[75226]:   <metadata>
Nov 17 01:20:17 user nova-compute[75226]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 17 01:20:17 user nova-compute[75226]:       <nova:package version="0.0.0"/>
Nov 17 01:20:17 user nova-compute[75226]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-614527780</nova:name>
Nov 17 01:20:17 user nova-compute[75226]:       <nova:creationTime>2023-11-17 01:20:16</nova:creationTime>
Nov 17 01:20:17 user nova-compute[75226]:       <nova:flavor name="m1.tiny">
Nov 17 01:20:17 user nova-compute[75226]:         <nova:memory>512</nova:memory>
Nov 17 01:20:17 user nova-compute[75226]:         <nova:disk>1</nova:disk>
Nov 17 01:20:17 user nova-compute[75226]:         <nova:swap>0</nova:swap>
Nov 17 01:20:17 user nova-compute[75226]:         <nova:ephemeral>0</nova:ephemeral>
Nov 17 01:20:17 user nova-compute[75226]:         <nova:vcpus>1</nova:vcpus>
Nov 17 01:20:17 user nova-compute[75226]:       </nova:flavor>
Nov 17 01:20:17 user nova-compute[75226]:       <nova:owner>
Nov 17 01:20:17 user nova-compute[75226]:         <nova:user uuid="1b793ce05bf44b939a9fb5a914a04cb0">tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member</nova:user>
Nov 17 01:20:17 user nova-compute[75226]:         <nova:project uuid="e6cb6f679ee4468d82cc7fb5d0f67be9">tempest-ServerBootFromVolumeStableRescueTest-76498640</nova:project>
Nov 17 01:20:17 user nova-compute[75226]:       </nova:owner>
Nov 17 01:20:17 user nova-compute[75226]:       <nova:root type="image" uuid="0b369aea-6f3f-4690-9f01-229b90ab6310"/>
Nov 17 01:20:17 user nova-compute[75226]:       <nova:ports>
Nov 17 01:20:17 user nova-compute[75226]:         <nova:port uuid="657af53c-fc3a-45ab-81e5-b2eeea1c88d7">
Nov 17 01:20:17 user nova-compute[75226]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 17 01:20:17 user nova-compute[75226]:         </nova:port>
Nov 17 01:20:17 user nova-compute[75226]:       </nova:ports>
Nov 17 01:20:17 user nova-compute[75226]:     </nova:instance>
Nov 17 01:20:17 user nova-compute[75226]:   </metadata>
Nov 17 01:20:17 user nova-compute[75226]:   <sysinfo type="smbios">
Nov 17 01:20:17 user nova-compute[75226]:     <system>
Nov 17 01:20:17 user nova-compute[75226]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 17 01:20:17 user nova-compute[75226]:       <entry name="product">OpenStack Nova</entry>
Nov 17 01:20:17 user nova-compute[75226]:       <entry name="version">0.0.0</entry>
Nov 17 01:20:17 user nova-compute[75226]:       <entry name="serial">6b7e9611-be35-4e51-b886-91a2fac0a653</entry>
Nov 17 01:20:17 user nova-compute[75226]:       <entry name="uuid">6b7e9611-be35-4e51-b886-91a2fac0a653</entry>
Nov 17 01:20:17 user nova-compute[75226]:       <entry name="family">Virtual Machine</entry>
Nov 17 01:20:17 user nova-compute[75226]:     </system>
Nov 17 01:20:17 user nova-compute[75226]:   </sysinfo>
Nov 17 01:20:17 user nova-compute[75226]:   <os>
Nov 17 01:20:17 user nova-compute[75226]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 17 01:20:17 user nova-compute[75226]:     <boot dev="hd"/>
Nov 17 01:20:17 user nova-compute[75226]:     <smbios mode="sysinfo"/>
Nov 17 01:20:17 user nova-compute[75226]:   </os>
Nov 17 01:20:17 user nova-compute[75226]:   <features>
Nov 17 01:20:17 user nova-compute[75226]:     <acpi/>
Nov 17 01:20:17 user nova-compute[75226]:     <apic/>
Nov 17 01:20:17 user nova-compute[75226]:     <vmcoreinfo/>
Nov 17 01:20:17 user nova-compute[75226]:   </features>
Nov 17 01:20:17 user nova-compute[75226]:   <clock offset="utc">
Nov 17 01:20:17 user nova-compute[75226]:     <timer name="pit" tickpolicy="delay"/>
Nov 17 01:20:17 user nova-compute[75226]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 17 01:20:17 user nova-compute[75226]:     <timer name="hpet" present="no"/>
Nov 17 01:20:17 user nova-compute[75226]:   </clock>
Nov 17 01:20:17 user nova-compute[75226]:   <cpu mode="custom" match="exact">
Nov 17 01:20:17 user nova-compute[75226]:     <model>Nehalem</model>
Nov 17 01:20:17 user nova-compute[75226]:     <topology sockets="1" cores="1" threads="1"/>
Nov 17 01:20:17 user nova-compute[75226]:   </cpu>
Nov 17 01:20:17 user nova-compute[75226]:   <devices>
Nov 17 01:20:17 user nova-compute[75226]:     <disk type="block" device="disk">
Nov 17 01:20:17 user nova-compute[75226]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 01:20:17 user nova-compute[75226]:       <source dev="/dev/sdc"/>
Nov 17 01:20:17 user nova-compute[75226]:       <target dev="vda" bus="virtio"/>
Nov 17 01:20:17 user nova-compute[75226]:       <serial>9cf1355f-12ee-4285-9c07-f120d1308cb8</serial>
Nov 17 01:20:17 user nova-compute[75226]:     </disk>
Nov 17 01:20:17 user nova-compute[75226]:     <interface type="ethernet">
Nov 17 01:20:17 user nova-compute[75226]:       <mac address="fa:16:3e:91:de:17"/>
Nov 17 01:20:17 user nova-compute[75226]:       <model type="virtio"/>
Nov 17 01:20:17 user nova-compute[75226]:       <mtu size="1442"/>
Nov 17 01:20:17 user nova-compute[75226]:       <target dev="tap657af53c-fc"/>
Nov 17 01:20:17 user nova-compute[75226]:     </interface>
Nov 17 01:20:17 user nova-compute[75226]:     <serial type="pty">
Nov 17 01:20:17 user nova-compute[75226]:       <log file="/opt/stack/data/nova/instances/6b7e9611-be35-4e51-b886-91a2fac0a653/console.log" append="off"/>
Nov 17 01:20:17 user nova-compute[75226]:     </serial>
Nov 17 01:20:17 user nova-compute[75226]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 17 01:20:17 user nova-compute[75226]:     <video>
Nov 17 01:20:17 user nova-compute[75226]:       <model type="virtio"/>
Nov 17 01:20:17 user nova-compute[75226]:     </video>
Nov 17 01:20:17 user nova-compute[75226]:     <rng model="virtio">
Nov 17 01:20:17 user nova-compute[75226]:       <backend model="random">/dev/urandom</backend>
Nov 17 01:20:17 user nova-compute[75226]:     </rng>
Nov 17 01:20:17 user nova-compute[75226]:     <controller type="usb" index="0" model="none"/>
Nov 17 01:20:17 user nova-compute[75226]:     <memballoon model="virtio">
Nov 17 01:20:17 user nova-compute[75226]:       <stats period="10"/>
Nov 17 01:20:17 user nova-compute[75226]:     </memballoon>
Nov 17 01:20:17 user nova-compute[75226]:   </devices>
Nov 17 01:20:17 user nova-compute[75226]: </domain>
Nov 17 01:20:17 user nova-compute[75226]:  {{(pid=75226) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 17 01:20:17 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-4d32ff64-444c-4f86-999c-55124dcb793f tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:20:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-614527780',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-614527780',id=11,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e6cb6f679ee4468d82cc7fb5d0f67be9',ramdisk_id='',reservation_id='r-do7w6o8m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-76498640',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T01:20:04Z,user_data=None,user_id='1b793ce05bf44b939a9fb5a914a04cb0',uuid=6b7e9611-be35-4e51-b886-91a2fac0a653,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "657af53c-fc3a-45ab-81e5-b2eeea1c88d7", "address": "fa:16:3e:91:de:17", "network": {"id": "450540a3-ff7e-42fb-a0a6-808acd749943", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1503678778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6cb6f679ee4468d82cc7fb5d0f67be9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap657af53c-fc", "ovs_interfaceid": "657af53c-fc3a-45ab-81e5-b2eeea1c88d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 17 01:20:17 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-4d32ff64-444c-4f86-999c-55124dcb793f tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Converting VIF {"id": "657af53c-fc3a-45ab-81e5-b2eeea1c88d7", "address": "fa:16:3e:91:de:17", "network": {"id": "450540a3-ff7e-42fb-a0a6-808acd749943", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1503678778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6cb6f679ee4468d82cc7fb5d0f67be9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap657af53c-fc", "ovs_interfaceid": "657af53c-fc3a-45ab-81e5-b2eeea1c88d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:20:17 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-4d32ff64-444c-4f86-999c-55124dcb793f tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:de:17,bridge_name='br-int',has_traffic_filtering=True,id=657af53c-fc3a-45ab-81e5-b2eeea1c88d7,network=Network(450540a3-ff7e-42fb-a0a6-808acd749943),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap657af53c-fc') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:20:17 user nova-compute[75226]: DEBUG os_vif [None req-4d32ff64-444c-4f86-999c-55124dcb793f tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:de:17,bridge_name='br-int',has_traffic_filtering=True,id=657af53c-fc3a-45ab-81e5-b2eeea1c88d7,network=Network(450540a3-ff7e-42fb-a0a6-808acd749943),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap657af53c-fc') {{(pid=75226) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 17 01:20:17 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:20:17 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:20:17 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 17 01:20:17 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:20:17 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5701029d-2a75-528c-a4b9-8aab3cd3879f', '_type': 'linux-noop'}}, row=False) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:20:17 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:20:17 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:20:17 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:20:17 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:20:17 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap657af53c-fc, may_exist=True, interface_attrs={}) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:20:17 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap657af53c-fc, col_values=(('qos', UUID('010cd372-a211-40d9-9ecb-f3cce7c62f33')),), if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:20:17 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap657af53c-fc, col_values=(('external_ids', {'iface-id': '657af53c-fc3a-45ab-81e5-b2eeea1c88d7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:91:de:17', 'vm-uuid': '6b7e9611-be35-4e51-b886-91a2fac0a653'}),), if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:20:17 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:20:17 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:20:17 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:20:17 user nova-compute[75226]: INFO os_vif [None req-4d32ff64-444c-4f86-999c-55124dcb793f tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:de:17,bridge_name='br-int',has_traffic_filtering=True,id=657af53c-fc3a-45ab-81e5-b2eeea1c88d7,network=Network(450540a3-ff7e-42fb-a0a6-808acd749943),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap657af53c-fc')
Nov 17 01:20:17 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-4d32ff64-444c-4f86-999c-55124dcb793f tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] No BDM found with device name vda, not building metadata. {{(pid=75226) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 01:20:17 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-4d32ff64-444c-4f86-999c-55124dcb793f tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] No VIF found with MAC fa:16:3e:91:de:17, not building metadata {{(pid=75226) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 01:20:17 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-5cd66272-c81d-45ab-afd2-cfb674a33329 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] Waiting for libvirt event about the detach of device tap902fc99d-3d with device alias net1 from instance b054a557-dff6-49f8-9300-1307f8433567 is timed out.
Nov 17 01:20:17 user nova-compute[75226]: DEBUG nova.virt.libvirt.guest [None req-5cd66272-c81d-45ab-afd2-cfb674a33329 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:4c:39:60"/><model type="virtio"/><mtu size="1442"/><target dev="tap902fc99d-3d"/></interface> {{(pid=75226) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 17 01:20:17 user nova-compute[75226]: DEBUG nova.virt.libvirt.guest [None req-5cd66272-c81d-45ab-afd2-cfb674a33329 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:4c:39:60"/><model type="virtio"/><mtu size="1442"/><target dev="tap902fc99d-3d"/></interface>not found in domain: <domain type='kvm' id='6'>
Nov 17 01:20:17 user nova-compute[75226]:   <name>instance-00000006</name>
Nov 17 01:20:17 user nova-compute[75226]:   <uuid>b054a557-dff6-49f8-9300-1307f8433567</uuid>
Nov 17 01:20:17 user nova-compute[75226]:   <metadata>
Nov 17 01:20:17 user nova-compute[75226]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 17 01:20:17 user nova-compute[75226]:   <nova:package version="0.0.0"/>
Nov 17 01:20:17 user nova-compute[75226]:   <nova:name>tempest-device-tagging-server-670055725</nova:name>
Nov 17 01:20:17 user nova-compute[75226]:   <nova:creationTime>2023-11-17 01:19:24</nova:creationTime>
Nov 17 01:20:17 user nova-compute[75226]:   <nova:flavor name="m1.tiny">
Nov 17 01:20:17 user nova-compute[75226]:     <nova:memory>512</nova:memory>
Nov 17 01:20:17 user nova-compute[75226]:     <nova:disk>1</nova:disk>
Nov 17 01:20:17 user nova-compute[75226]:     <nova:swap>0</nova:swap>
Nov 17 01:20:17 user nova-compute[75226]:     <nova:ephemeral>0</nova:ephemeral>
Nov 17 01:20:17 user nova-compute[75226]:     <nova:vcpus>1</nova:vcpus>
Nov 17 01:20:17 user nova-compute[75226]:   </nova:flavor>
Nov 17 01:20:17 user nova-compute[75226]:   <nova:owner>
Nov 17 01:20:17 user nova-compute[75226]:     <nova:user uuid="b59a9221aae44dcbb688294a0483b715">tempest-TaggedAttachmentsTest-177886932-project-member</nova:user>
Nov 17 01:20:17 user nova-compute[75226]:     <nova:project uuid="f8f5190e0bff4cbb9384c0fb4faf54d4">tempest-TaggedAttachmentsTest-177886932</nova:project>
Nov 17 01:20:17 user nova-compute[75226]:   </nova:owner>
Nov 17 01:20:17 user nova-compute[75226]:   <nova:root type="image" uuid="0b369aea-6f3f-4690-9f01-229b90ab6310"/>
Nov 17 01:20:17 user nova-compute[75226]:   <nova:ports>
Nov 17 01:20:17 user nova-compute[75226]:     <nova:port uuid="9be521ab-d517-4746-b6b3-1e4930610165">
Nov 17 01:20:17 user nova-compute[75226]:       <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 17 01:20:17 user nova-compute[75226]:     </nova:port>
Nov 17 01:20:17 user nova-compute[75226]:     <nova:port uuid="902fc99d-3d0f-4ce4-8502-b4c2f7617163">
Nov 17 01:20:17 user nova-compute[75226]:       <nova:ip type="fixed" address="10.10.10.165" ipVersion="4"/>
Nov 17 01:20:17 user nova-compute[75226]:     </nova:port>
Nov 17 01:20:17 user nova-compute[75226]:   </nova:ports>
Nov 17 01:20:17 user nova-compute[75226]: </nova:instance>
Nov 17 01:20:17 user nova-compute[75226]:   </metadata>
Nov 17 01:20:17 user nova-compute[75226]:   <memory unit='KiB'>524288</memory>
Nov 17 01:20:17 user nova-compute[75226]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 17 01:20:17 user nova-compute[75226]:   <vcpu placement='static'>1</vcpu>
Nov 17 01:20:17 user nova-compute[75226]:   <resource>
Nov 17 01:20:17 user nova-compute[75226]:     <partition>/machine</partition>
Nov 17 01:20:17 user nova-compute[75226]:   </resource>
Nov 17 01:20:17 user nova-compute[75226]:   <sysinfo type='smbios'>
Nov 17 01:20:17 user nova-compute[75226]:     <system>
Nov 17 01:20:17 user nova-compute[75226]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 17 01:20:17 user nova-compute[75226]:       <entry name='product'>OpenStack Nova</entry>
Nov 17 01:20:17 user nova-compute[75226]:       <entry name='version'>0.0.0</entry>
Nov 17 01:20:17 user nova-compute[75226]:       <entry name='serial'>b054a557-dff6-49f8-9300-1307f8433567</entry>
Nov 17 01:20:17 user nova-compute[75226]:       <entry name='uuid'>b054a557-dff6-49f8-9300-1307f8433567</entry>
Nov 17 01:20:17 user nova-compute[75226]:       <entry name='family'>Virtual Machine</entry>
Nov 17 01:20:17 user nova-compute[75226]:     </system>
Nov 17 01:20:17 user nova-compute[75226]:   </sysinfo>
Nov 17 01:20:17 user nova-compute[75226]:   <os>
Nov 17 01:20:17 user nova-compute[75226]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 17 01:20:17 user nova-compute[75226]:     <boot dev='hd'/>
Nov 17 01:20:17 user nova-compute[75226]:     <smbios mode='sysinfo'/>
Nov 17 01:20:17 user nova-compute[75226]:   </os>
Nov 17 01:20:17 user nova-compute[75226]:   <features>
Nov 17 01:20:17 user nova-compute[75226]:     <acpi/>
Nov 17 01:20:17 user nova-compute[75226]:     <apic/>
Nov 17 01:20:17 user nova-compute[75226]:     <vmcoreinfo state='on'/>
Nov 17 01:20:17 user nova-compute[75226]:   </features>
Nov 17 01:20:17 user nova-compute[75226]:   <cpu mode='custom' match='exact' check='full'>
Nov 17 01:20:17 user nova-compute[75226]:     <model fallback='forbid'>Nehalem</model>
Nov 17 01:20:17 user nova-compute[75226]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 17 01:20:17 user nova-compute[75226]:     <feature policy='require' name='vme'/>
Nov 17 01:20:17 user nova-compute[75226]:     <feature policy='require' name='x2apic'/>
Nov 17 01:20:17 user nova-compute[75226]:     <feature policy='require' name='hypervisor'/>
Nov 17 01:20:17 user nova-compute[75226]:   </cpu>
Nov 17 01:20:17 user nova-compute[75226]:   <clock offset='utc'>
Nov 17 01:20:17 user nova-compute[75226]:     <timer name='pit' tickpolicy='delay'/>
Nov 17 01:20:17 user nova-compute[75226]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 17 01:20:17 user nova-compute[75226]:     <timer name='hpet' present='no'/>
Nov 17 01:20:17 user nova-compute[75226]:   </clock>
Nov 17 01:20:17 user nova-compute[75226]:   <on_poweroff>destroy</on_poweroff>
Nov 17 01:20:17 user nova-compute[75226]:   <on_reboot>restart</on_reboot>
Nov 17 01:20:17 user nova-compute[75226]:   <on_crash>destroy</on_crash>
Nov 17 01:20:17 user nova-compute[75226]:   <devices>
Nov 17 01:20:17 user nova-compute[75226]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 17 01:20:17 user nova-compute[75226]:     <disk type='file' device='disk'>
Nov 17 01:20:17 user nova-compute[75226]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 17 01:20:17 user nova-compute[75226]:       <source file='/opt/stack/data/nova/instances/b054a557-dff6-49f8-9300-1307f8433567/disk' index='2'/>
Nov 17 01:20:17 user nova-compute[75226]:       <backingStore type='file' index='3'>
Nov 17 01:20:17 user nova-compute[75226]:         <format type='raw'/>
Nov 17 01:20:17 user nova-compute[75226]:         <source file='/opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371'/>
Nov 17 01:20:17 user nova-compute[75226]:         <backingStore/>
Nov 17 01:20:17 user nova-compute[75226]:       </backingStore>
Nov 17 01:20:17 user nova-compute[75226]:       <target dev='vda' bus='virtio'/>
Nov 17 01:20:17 user nova-compute[75226]:       <alias name='virtio-disk0'/>
Nov 17 01:20:17 user nova-compute[75226]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 17 01:20:17 user nova-compute[75226]:     </disk>
Nov 17 01:20:17 user nova-compute[75226]:     <disk type='file' device='cdrom'>
Nov 17 01:20:17 user nova-compute[75226]:       <driver name='qemu' type='raw' cache='none'/>
Nov 17 01:20:17 user nova-compute[75226]:       <source file='/opt/stack/data/nova/instances/b054a557-dff6-49f8-9300-1307f8433567/disk.config' index='1'/>
Nov 17 01:20:17 user nova-compute[75226]:       <backingStore/>
Nov 17 01:20:17 user nova-compute[75226]:       <target dev='hda' bus='ide'/>
Nov 17 01:20:17 user nova-compute[75226]:       <readonly/>
Nov 17 01:20:17 user nova-compute[75226]:       <alias name='ide0-0-0'/>
Nov 17 01:20:17 user nova-compute[75226]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 17 01:20:17 user nova-compute[75226]:     </disk>
Nov 17 01:20:17 user nova-compute[75226]:     <controller type='usb' index='0' model='none'>
Nov 17 01:20:17 user nova-compute[75226]:       <alias name='usb'/>
Nov 17 01:20:17 user nova-compute[75226]:     </controller>
Nov 17 01:20:17 user nova-compute[75226]:     <controller type='pci' index='0' model='pci-root'>
Nov 17 01:20:17 user nova-compute[75226]:       <alias name='pci.0'/>
Nov 17 01:20:17 user nova-compute[75226]:     </controller>
Nov 17 01:20:17 user nova-compute[75226]:     <controller type='ide' index='0'>
Nov 17 01:20:17 user nova-compute[75226]:       <alias name='ide'/>
Nov 17 01:20:17 user nova-compute[75226]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 17 01:20:17 user nova-compute[75226]:     </controller>
Nov 17 01:20:17 user nova-compute[75226]:     <interface type='ethernet'>
Nov 17 01:20:17 user nova-compute[75226]:       <mac address='fa:16:3e:c9:37:0f'/>
Nov 17 01:20:17 user nova-compute[75226]:       <target dev='tap9be521ab-d5'/>
Nov 17 01:20:17 user nova-compute[75226]:       <model type='virtio'/>
Nov 17 01:20:17 user nova-compute[75226]:       <mtu size='1442'/>
Nov 17 01:20:17 user nova-compute[75226]:       <alias name='net0'/>
Nov 17 01:20:17 user nova-compute[75226]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 17 01:20:17 user nova-compute[75226]:     </interface>
Nov 17 01:20:17 user nova-compute[75226]:     <serial type='pty'>
Nov 17 01:20:17 user nova-compute[75226]:       <source path='/dev/pts/5'/>
Nov 17 01:20:17 user nova-compute[75226]:       <log file='/opt/stack/data/nova/instances/b054a557-dff6-49f8-9300-1307f8433567/console.log' append='off'/>
Nov 17 01:20:17 user nova-compute[75226]:       <target type='isa-serial' port='0'>
Nov 17 01:20:17 user nova-compute[75226]:         <model name='isa-serial'/>
Nov 17 01:20:17 user nova-compute[75226]:       </target>
Nov 17 01:20:17 user nova-compute[75226]:       <alias name='serial0'/>
Nov 17 01:20:17 user nova-compute[75226]:     </serial>
Nov 17 01:20:17 user nova-compute[75226]:     <console type='pty' tty='/dev/pts/5'>
Nov 17 01:20:17 user nova-compute[75226]:       <source path='/dev/pts/5'/>
Nov 17 01:20:17 user nova-compute[75226]:       <log file='/opt/stack/data/nova/instances/b054a557-dff6-49f8-9300-1307f8433567/console.log' append='off'/>
Nov 17 01:20:17 user nova-compute[75226]:       <target type='serial' port='0'/>
Nov 17 01:20:17 user nova-compute[75226]:       <alias name='serial0'/>
Nov 17 01:20:17 user nova-compute[75226]:     </console>
Nov 17 01:20:17 user nova-compute[75226]:     <input type='mouse' bus='ps2'>
Nov 17 01:20:17 user nova-compute[75226]:       <alias name='input0'/>
Nov 17 01:20:17 user nova-compute[75226]:     </input>
Nov 17 01:20:17 user nova-compute[75226]:     <input type='keyboard' bus='ps2'>
Nov 17 01:20:17 user nova-compute[75226]:       <alias name='input1'/>
Nov 17 01:20:17 user nova-compute[75226]:     </input>
Nov 17 01:20:17 user nova-compute[75226]:     <graphics type='vnc' port='5905' autoport='yes' listen='0.0.0.0'>
Nov 17 01:20:17 user nova-compute[75226]:       <listen type='address' address='0.0.0.0'/>
Nov 17 01:20:17 user nova-compute[75226]:     </graphics>
Nov 17 01:20:17 user nova-compute[75226]:     <audio id='1' type='none'/>
Nov 17 01:20:17 user nova-compute[75226]:     <video>
Nov 17 01:20:17 user nova-compute[75226]:       <model type='virtio' heads='1' primary='yes'/>
Nov 17 01:20:17 user nova-compute[75226]:       <alias name='video0'/>
Nov 17 01:20:17 user nova-compute[75226]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 17 01:20:17 user nova-compute[75226]:     </video>
Nov 17 01:20:17 user nova-compute[75226]:     <memballoon model='virtio'>
Nov 17 01:20:17 user nova-compute[75226]:       <stats period='10'/>
Nov 17 01:20:17 user nova-compute[75226]:       <alias name='balloon0'/>
Nov 17 01:20:17 user nova-compute[75226]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 17 01:20:17 user nova-compute[75226]:     </memballoon>
Nov 17 01:20:17 user nova-compute[75226]:     <rng model='virtio'>
Nov 17 01:20:17 user nova-compute[75226]:       <backend model='random'>/dev/urandom</backend>
Nov 17 01:20:17 user nova-compute[75226]:       <alias name='rng0'/>
Nov 17 01:20:17 user nova-compute[75226]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 17 01:20:17 user nova-compute[75226]:     </rng>
Nov 17 01:20:17 user nova-compute[75226]:   </devices>
Nov 17 01:20:17 user nova-compute[75226]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 17 01:20:17 user nova-compute[75226]:     <label>libvirt-b054a557-dff6-49f8-9300-1307f8433567</label>
Nov 17 01:20:17 user nova-compute[75226]:     <imagelabel>libvirt-b054a557-dff6-49f8-9300-1307f8433567</imagelabel>
Nov 17 01:20:17 user nova-compute[75226]:   </seclabel>
Nov 17 01:20:17 user nova-compute[75226]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 17 01:20:17 user nova-compute[75226]:     <label>+64055:+108</label>
Nov 17 01:20:17 user nova-compute[75226]:     <imagelabel>+64055:+108</imagelabel>
Nov 17 01:20:17 user nova-compute[75226]:   </seclabel>
Nov 17 01:20:17 user nova-compute[75226]: </domain>
Nov 17 01:20:17 user nova-compute[75226]:  {{(pid=75226) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 17 01:20:17 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-5cd66272-c81d-45ab-afd2-cfb674a33329 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] Successfully detached device tap902fc99d-3d from instance b054a557-dff6-49f8-9300-1307f8433567 from the live domain config.
Nov 17 01:20:17 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-5cd66272-c81d-45ab-afd2-cfb674a33329 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-17T01:17:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-670055725',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-670055725',id=6,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLQTkAEsiD7vZkLRChcVhMfcWUFr+J4uCStAPtsh5EcOj4Y0TqNu0/N7e0AK98CTHsomeIYjTkrU/pTyfUW55cXvLwMkYssMQNhMJgsr816svkjbGW+OPHRqanQu9/VlCw==',key_name='tempest-keypair-2003198946',keypairs=<?>,launch_index=0,launched_at=2023-11-17T01:17:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f8f5190e0bff4cbb9384c0fb4faf54d4',ramdisk_id='',reservation_id='r-icespjka',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-177886932',owner_user_name='tempest-TaggedAttachmentsTest-177886932-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T01:17:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b59a9221aae44dcbb688294a0483b715',uuid=b054a557-dff6-49f8-9300-1307f8433567,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "902fc99d-3d0f-4ce4-8502-b4c2f7617163", "address": "fa:16:3e:4c:39:60", "network": {"id": "ad4f167b-03ad-46dd-b568-d8478a055559", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1332712448", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f8f5190e0bff4cbb9384c0fb4faf54d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap902fc99d-3d", "ovs_interfaceid": "902fc99d-3d0f-4ce4-8502-b4c2f7617163", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 17 01:20:17 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-5cd66272-c81d-45ab-afd2-cfb674a33329 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] Converting VIF {"id": "902fc99d-3d0f-4ce4-8502-b4c2f7617163", "address": "fa:16:3e:4c:39:60", "network": {"id": "ad4f167b-03ad-46dd-b568-d8478a055559", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1332712448", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f8f5190e0bff4cbb9384c0fb4faf54d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap902fc99d-3d", "ovs_interfaceid": "902fc99d-3d0f-4ce4-8502-b4c2f7617163", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:20:17 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-5cd66272-c81d-45ab-afd2-cfb674a33329 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:39:60,bridge_name='br-int',has_traffic_filtering=True,id=902fc99d-3d0f-4ce4-8502-b4c2f7617163,network=Network(ad4f167b-03ad-46dd-b568-d8478a055559),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap902fc99d-3d') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:20:17 user nova-compute[75226]: DEBUG os_vif [None req-5cd66272-c81d-45ab-afd2-cfb674a33329 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:39:60,bridge_name='br-int',has_traffic_filtering=True,id=902fc99d-3d0f-4ce4-8502-b4c2f7617163,network=Network(ad4f167b-03ad-46dd-b568-d8478a055559),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap902fc99d-3d') {{(pid=75226) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 17 01:20:17 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:20:17 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap902fc99d-3d, bridge=br-int, if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:20:17 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:20:17 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:20:17 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:20:17 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:20:17 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cd581523-7dd4-462c-951d-57884b2411fe) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:20:17 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:20:17 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:20:17 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:20:17 user nova-compute[75226]: INFO os_vif [None req-5cd66272-c81d-45ab-afd2-cfb674a33329 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:39:60,bridge_name='br-int',has_traffic_filtering=True,id=902fc99d-3d0f-4ce4-8502-b4c2f7617163,network=Network(ad4f167b-03ad-46dd-b568-d8478a055559),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap902fc99d-3d')
Nov 17 01:20:17 user nova-compute[75226]: DEBUG nova.virt.libvirt.guest [None req-5cd66272-c81d-45ab-afd2-cfb674a33329 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 17 01:20:17 user nova-compute[75226]:   <nova:package version="0.0.0"/>
Nov 17 01:20:17 user nova-compute[75226]:   <nova:name>tempest-device-tagging-server-670055725</nova:name>
Nov 17 01:20:17 user nova-compute[75226]:   <nova:creationTime>2023-11-17 01:20:17</nova:creationTime>
Nov 17 01:20:17 user nova-compute[75226]:   <nova:flavor name="m1.tiny">
Nov 17 01:20:17 user nova-compute[75226]:     <nova:memory>512</nova:memory>
Nov 17 01:20:17 user nova-compute[75226]:     <nova:disk>1</nova:disk>
Nov 17 01:20:17 user nova-compute[75226]:     <nova:swap>0</nova:swap>
Nov 17 01:20:17 user nova-compute[75226]:     <nova:ephemeral>0</nova:ephemeral>
Nov 17 01:20:17 user nova-compute[75226]:     <nova:vcpus>1</nova:vcpus>
Nov 17 01:20:17 user nova-compute[75226]:   </nova:flavor>
Nov 17 01:20:17 user nova-compute[75226]:   <nova:owner>
Nov 17 01:20:17 user nova-compute[75226]:     <nova:user uuid="b59a9221aae44dcbb688294a0483b715">tempest-TaggedAttachmentsTest-177886932-project-member</nova:user>
Nov 17 01:20:17 user nova-compute[75226]:     <nova:project uuid="f8f5190e0bff4cbb9384c0fb4faf54d4">tempest-TaggedAttachmentsTest-177886932</nova:project>
Nov 17 01:20:17 user nova-compute[75226]:   </nova:owner>
Nov 17 01:20:17 user nova-compute[75226]:   <nova:root type="image" uuid="0b369aea-6f3f-4690-9f01-229b90ab6310"/>
Nov 17 01:20:17 user nova-compute[75226]:   <nova:ports>
Nov 17 01:20:17 user nova-compute[75226]:     <nova:port uuid="9be521ab-d517-4746-b6b3-1e4930610165">
Nov 17 01:20:17 user nova-compute[75226]:       <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 17 01:20:17 user nova-compute[75226]:     </nova:port>
Nov 17 01:20:17 user nova-compute[75226]:   </nova:ports>
Nov 17 01:20:17 user nova-compute[75226]: </nova:instance>
Nov 17 01:20:17 user nova-compute[75226]:  {{(pid=75226) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 17 01:20:18 user nova-compute[75226]: DEBUG nova.compute.manager [req-dd762320-648a-43fa-9fd8-6df8354040f9 req-3812ab4d-fa33-4856-86dc-1c9acae5dd9f service nova] [instance: b054a557-dff6-49f8-9300-1307f8433567] Received event network-vif-deleted-902fc99d-3d0f-4ce4-8502-b4c2f7617163 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:20:18 user nova-compute[75226]: INFO nova.compute.manager [req-dd762320-648a-43fa-9fd8-6df8354040f9 req-3812ab4d-fa33-4856-86dc-1c9acae5dd9f service nova] [instance: b054a557-dff6-49f8-9300-1307f8433567] Neutron deleted interface 902fc99d-3d0f-4ce4-8502-b4c2f7617163; detaching it from the instance and deleting it from the info cache
Nov 17 01:20:18 user nova-compute[75226]: DEBUG nova.network.neutron [req-dd762320-648a-43fa-9fd8-6df8354040f9 req-3812ab4d-fa33-4856-86dc-1c9acae5dd9f service nova] [instance: b054a557-dff6-49f8-9300-1307f8433567] Updating instance_info_cache with network_info: [{"id": "9be521ab-d517-4746-b6b3-1e4930610165", "address": "fa:16:3e:c9:37:0f", "network": {"id": "126149e3-f0c6-483c-a0b4-4fd1dcd1a390", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1008205473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8f5190e0bff4cbb9384c0fb4faf54d4", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9be521ab-d5", "ovs_interfaceid": "9be521ab-d517-4746-b6b3-1e4930610165", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:20:18 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-5cd66272-c81d-45ab-afd2-cfb674a33329 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] Acquiring lock "refresh_cache-b054a557-dff6-49f8-9300-1307f8433567" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:20:18 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-5cd66272-c81d-45ab-afd2-cfb674a33329 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] Acquired lock "refresh_cache-b054a557-dff6-49f8-9300-1307f8433567" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:20:18 user nova-compute[75226]: DEBUG nova.network.neutron [None req-5cd66272-c81d-45ab-afd2-cfb674a33329 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] [instance: b054a557-dff6-49f8-9300-1307f8433567] Building network info cache for instance {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 01:20:18 user nova-compute[75226]: DEBUG nova.objects.instance [req-dd762320-648a-43fa-9fd8-6df8354040f9 req-3812ab4d-fa33-4856-86dc-1c9acae5dd9f service nova] Lazy-loading 'system_metadata' on Instance uuid b054a557-dff6-49f8-9300-1307f8433567 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:20:18 user nova-compute[75226]: DEBUG nova.objects.instance [req-dd762320-648a-43fa-9fd8-6df8354040f9 req-3812ab4d-fa33-4856-86dc-1c9acae5dd9f service nova] Lazy-loading 'flavor' on Instance uuid b054a557-dff6-49f8-9300-1307f8433567 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:20:18 user nova-compute[75226]: DEBUG nova.objects.base [req-dd762320-648a-43fa-9fd8-6df8354040f9 req-3812ab4d-fa33-4856-86dc-1c9acae5dd9f service nova] Object Instance<b054a557-dff6-49f8-9300-1307f8433567> lazy-loaded attributes: system_metadata,flavor {{(pid=75226) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 17 01:20:18 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [req-dd762320-648a-43fa-9fd8-6df8354040f9 req-3812ab4d-fa33-4856-86dc-1c9acae5dd9f service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-17T01:17:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-670055725',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-670055725',id=6,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLQTkAEsiD7vZkLRChcVhMfcWUFr+J4uCStAPtsh5EcOj4Y0TqNu0/N7e0AK98CTHsomeIYjTkrU/pTyfUW55cXvLwMkYssMQNhMJgsr816svkjbGW+OPHRqanQu9/VlCw==',key_name='tempest-keypair-2003198946',keypairs=<?>,launch_index=0,launched_at=2023-11-17T01:17:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f8f5190e0bff4cbb9384c0fb4faf54d4',ramdisk_id='',reservation_id='r-icespjka',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-177886932',owner_user_name='tempest-TaggedAttachmentsTest-177886932-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T01:17:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b59a9221aae44dcbb688294a0483b715',uuid=b054a557-dff6-49f8-9300-1307f8433567,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "902fc99d-3d0f-4ce4-8502-b4c2f7617163", "address": "fa:16:3e:4c:39:60", "network": {"id": "ad4f167b-03ad-46dd-b568-d8478a055559", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1332712448", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f8f5190e0bff4cbb9384c0fb4faf54d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap902fc99d-3d", "ovs_interfaceid": "902fc99d-3d0f-4ce4-8502-b4c2f7617163", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75226) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 01:20:18 user nova-compute[75226]: DEBUG nova.network.os_vif_util [req-dd762320-648a-43fa-9fd8-6df8354040f9 req-3812ab4d-fa33-4856-86dc-1c9acae5dd9f service nova] Converting VIF {"id": "902fc99d-3d0f-4ce4-8502-b4c2f7617163", "address": "fa:16:3e:4c:39:60", "network": {"id": "ad4f167b-03ad-46dd-b568-d8478a055559", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1332712448", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f8f5190e0bff4cbb9384c0fb4faf54d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap902fc99d-3d", "ovs_interfaceid": "902fc99d-3d0f-4ce4-8502-b4c2f7617163", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:20:18 user nova-compute[75226]: DEBUG nova.network.os_vif_util [req-dd762320-648a-43fa-9fd8-6df8354040f9 req-3812ab4d-fa33-4856-86dc-1c9acae5dd9f service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:39:60,bridge_name='br-int',has_traffic_filtering=True,id=902fc99d-3d0f-4ce4-8502-b4c2f7617163,network=Network(ad4f167b-03ad-46dd-b568-d8478a055559),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap902fc99d-3d') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:20:18 user nova-compute[75226]: DEBUG nova.virt.libvirt.guest [req-dd762320-648a-43fa-9fd8-6df8354040f9 req-3812ab4d-fa33-4856-86dc-1c9acae5dd9f service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:4c:39:60"/><model type="virtio"/><mtu size="1442"/><target dev="tap902fc99d-3d"/></interface> {{(pid=75226) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 17 01:20:18 user nova-compute[75226]: DEBUG nova.virt.libvirt.guest [req-dd762320-648a-43fa-9fd8-6df8354040f9 req-3812ab4d-fa33-4856-86dc-1c9acae5dd9f service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:4c:39:60"/><model type="virtio"/><mtu size="1442"/><target dev="tap902fc99d-3d"/></interface>not found in domain: <domain type='kvm' id='6'>
Nov 17 01:20:18 user nova-compute[75226]:   <name>instance-00000006</name>
Nov 17 01:20:18 user nova-compute[75226]:   <uuid>b054a557-dff6-49f8-9300-1307f8433567</uuid>
Nov 17 01:20:18 user nova-compute[75226]:   <metadata>
Nov 17 01:20:18 user nova-compute[75226]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 17 01:20:18 user nova-compute[75226]:   <nova:package version="0.0.0"/>
Nov 17 01:20:18 user nova-compute[75226]:   <nova:name>tempest-device-tagging-server-670055725</nova:name>
Nov 17 01:20:18 user nova-compute[75226]:   <nova:creationTime>2023-11-17 01:20:17</nova:creationTime>
Nov 17 01:20:18 user nova-compute[75226]:   <nova:flavor name="m1.tiny">
Nov 17 01:20:18 user nova-compute[75226]:     <nova:memory>512</nova:memory>
Nov 17 01:20:18 user nova-compute[75226]:     <nova:disk>1</nova:disk>
Nov 17 01:20:18 user nova-compute[75226]:     <nova:swap>0</nova:swap>
Nov 17 01:20:18 user nova-compute[75226]:     <nova:ephemeral>0</nova:ephemeral>
Nov 17 01:20:18 user nova-compute[75226]:     <nova:vcpus>1</nova:vcpus>
Nov 17 01:20:18 user nova-compute[75226]:   </nova:flavor>
Nov 17 01:20:18 user nova-compute[75226]:   <nova:owner>
Nov 17 01:20:18 user nova-compute[75226]:     <nova:user uuid="b59a9221aae44dcbb688294a0483b715">tempest-TaggedAttachmentsTest-177886932-project-member</nova:user>
Nov 17 01:20:18 user nova-compute[75226]:     <nova:project uuid="f8f5190e0bff4cbb9384c0fb4faf54d4">tempest-TaggedAttachmentsTest-177886932</nova:project>
Nov 17 01:20:18 user nova-compute[75226]:   </nova:owner>
Nov 17 01:20:18 user nova-compute[75226]:   <nova:root type="image" uuid="0b369aea-6f3f-4690-9f01-229b90ab6310"/>
Nov 17 01:20:18 user nova-compute[75226]:   <nova:ports>
Nov 17 01:20:18 user nova-compute[75226]:     <nova:port uuid="9be521ab-d517-4746-b6b3-1e4930610165">
Nov 17 01:20:18 user nova-compute[75226]:       <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 17 01:20:18 user nova-compute[75226]:     </nova:port>
Nov 17 01:20:18 user nova-compute[75226]:   </nova:ports>
Nov 17 01:20:18 user nova-compute[75226]: </nova:instance>
Nov 17 01:20:18 user nova-compute[75226]:   </metadata>
Nov 17 01:20:18 user nova-compute[75226]:   <memory unit='KiB'>524288</memory>
Nov 17 01:20:18 user nova-compute[75226]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 17 01:20:18 user nova-compute[75226]:   <vcpu placement='static'>1</vcpu>
Nov 17 01:20:18 user nova-compute[75226]:   <resource>
Nov 17 01:20:18 user nova-compute[75226]:     <partition>/machine</partition>
Nov 17 01:20:18 user nova-compute[75226]:   </resource>
Nov 17 01:20:18 user nova-compute[75226]:   <sysinfo type='smbios'>
Nov 17 01:20:18 user nova-compute[75226]:     <system>
Nov 17 01:20:18 user nova-compute[75226]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 17 01:20:18 user nova-compute[75226]:       <entry name='product'>OpenStack Nova</entry>
Nov 17 01:20:18 user nova-compute[75226]:       <entry name='version'>0.0.0</entry>
Nov 17 01:20:18 user nova-compute[75226]:       <entry name='serial'>b054a557-dff6-49f8-9300-1307f8433567</entry>
Nov 17 01:20:18 user nova-compute[75226]:       <entry name='uuid'>b054a557-dff6-49f8-9300-1307f8433567</entry>
Nov 17 01:20:18 user nova-compute[75226]:       <entry name='family'>Virtual Machine</entry>
Nov 17 01:20:18 user nova-compute[75226]:     </system>
Nov 17 01:20:18 user nova-compute[75226]:   </sysinfo>
Nov 17 01:20:18 user nova-compute[75226]:   <os>
Nov 17 01:20:18 user nova-compute[75226]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 17 01:20:18 user nova-compute[75226]:     <boot dev='hd'/>
Nov 17 01:20:18 user nova-compute[75226]:     <smbios mode='sysinfo'/>
Nov 17 01:20:18 user nova-compute[75226]:   </os>
Nov 17 01:20:18 user nova-compute[75226]:   <features>
Nov 17 01:20:18 user nova-compute[75226]:     <acpi/>
Nov 17 01:20:18 user nova-compute[75226]:     <apic/>
Nov 17 01:20:18 user nova-compute[75226]:     <vmcoreinfo state='on'/>
Nov 17 01:20:18 user nova-compute[75226]:   </features>
Nov 17 01:20:18 user nova-compute[75226]:   <cpu mode='custom' match='exact' check='full'>
Nov 17 01:20:18 user nova-compute[75226]:     <model fallback='forbid'>Nehalem</model>
Nov 17 01:20:18 user nova-compute[75226]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 17 01:20:18 user nova-compute[75226]:     <feature policy='require' name='vme'/>
Nov 17 01:20:18 user nova-compute[75226]:     <feature policy='require' name='x2apic'/>
Nov 17 01:20:18 user nova-compute[75226]:     <feature policy='require' name='hypervisor'/>
Nov 17 01:20:18 user nova-compute[75226]:   </cpu>
Nov 17 01:20:18 user nova-compute[75226]:   <clock offset='utc'>
Nov 17 01:20:18 user nova-compute[75226]:     <timer name='pit' tickpolicy='delay'/>
Nov 17 01:20:18 user nova-compute[75226]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 17 01:20:18 user nova-compute[75226]:     <timer name='hpet' present='no'/>
Nov 17 01:20:18 user nova-compute[75226]:   </clock>
Nov 17 01:20:18 user nova-compute[75226]:   <on_poweroff>destroy</on_poweroff>
Nov 17 01:20:18 user nova-compute[75226]:   <on_reboot>restart</on_reboot>
Nov 17 01:20:18 user nova-compute[75226]:   <on_crash>destroy</on_crash>
Nov 17 01:20:18 user nova-compute[75226]:   <devices>
Nov 17 01:20:18 user nova-compute[75226]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 17 01:20:18 user nova-compute[75226]:     <disk type='file' device='disk'>
Nov 17 01:20:18 user nova-compute[75226]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 17 01:20:18 user nova-compute[75226]:       <source file='/opt/stack/data/nova/instances/b054a557-dff6-49f8-9300-1307f8433567/disk' index='2'/>
Nov 17 01:20:18 user nova-compute[75226]:       <backingStore type='file' index='3'>
Nov 17 01:20:18 user nova-compute[75226]:         <format type='raw'/>
Nov 17 01:20:18 user nova-compute[75226]:         <source file='/opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371'/>
Nov 17 01:20:18 user nova-compute[75226]:         <backingStore/>
Nov 17 01:20:18 user nova-compute[75226]:       </backingStore>
Nov 17 01:20:18 user nova-compute[75226]:       <target dev='vda' bus='virtio'/>
Nov 17 01:20:18 user nova-compute[75226]:       <alias name='virtio-disk0'/>
Nov 17 01:20:18 user nova-compute[75226]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 17 01:20:18 user nova-compute[75226]:     </disk>
Nov 17 01:20:18 user nova-compute[75226]:     <disk type='file' device='cdrom'>
Nov 17 01:20:18 user nova-compute[75226]:       <driver name='qemu' type='raw' cache='none'/>
Nov 17 01:20:18 user nova-compute[75226]:       <source file='/opt/stack/data/nova/instances/b054a557-dff6-49f8-9300-1307f8433567/disk.config' index='1'/>
Nov 17 01:20:18 user nova-compute[75226]:       <backingStore/>
Nov 17 01:20:18 user nova-compute[75226]:       <target dev='hda' bus='ide'/>
Nov 17 01:20:18 user nova-compute[75226]:       <readonly/>
Nov 17 01:20:18 user nova-compute[75226]:       <alias name='ide0-0-0'/>
Nov 17 01:20:18 user nova-compute[75226]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 17 01:20:18 user nova-compute[75226]:     </disk>
Nov 17 01:20:18 user nova-compute[75226]:     <controller type='usb' index='0' model='none'>
Nov 17 01:20:18 user nova-compute[75226]:       <alias name='usb'/>
Nov 17 01:20:18 user nova-compute[75226]:     </controller>
Nov 17 01:20:18 user nova-compute[75226]:     <controller type='pci' index='0' model='pci-root'>
Nov 17 01:20:18 user nova-compute[75226]:       <alias name='pci.0'/>
Nov 17 01:20:18 user nova-compute[75226]:     </controller>
Nov 17 01:20:18 user nova-compute[75226]:     <controller type='ide' index='0'>
Nov 17 01:20:18 user nova-compute[75226]:       <alias name='ide'/>
Nov 17 01:20:18 user nova-compute[75226]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 17 01:20:18 user nova-compute[75226]:     </controller>
Nov 17 01:20:18 user nova-compute[75226]:     <interface type='ethernet'>
Nov 17 01:20:18 user nova-compute[75226]:       <mac address='fa:16:3e:c9:37:0f'/>
Nov 17 01:20:18 user nova-compute[75226]:       <target dev='tap9be521ab-d5'/>
Nov 17 01:20:18 user nova-compute[75226]:       <model type='virtio'/>
Nov 17 01:20:18 user nova-compute[75226]:       <mtu size='1442'/>
Nov 17 01:20:18 user nova-compute[75226]:       <alias name='net0'/>
Nov 17 01:20:18 user nova-compute[75226]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 17 01:20:18 user nova-compute[75226]:     </interface>
Nov 17 01:20:18 user nova-compute[75226]:     <serial type='pty'>
Nov 17 01:20:18 user nova-compute[75226]:       <source path='/dev/pts/5'/>
Nov 17 01:20:18 user nova-compute[75226]:       <log file='/opt/stack/data/nova/instances/b054a557-dff6-49f8-9300-1307f8433567/console.log' append='off'/>
Nov 17 01:20:18 user nova-compute[75226]:       <target type='isa-serial' port='0'>
Nov 17 01:20:18 user nova-compute[75226]:         <model name='isa-serial'/>
Nov 17 01:20:18 user nova-compute[75226]:       </target>
Nov 17 01:20:18 user nova-compute[75226]:       <alias name='serial0'/>
Nov 17 01:20:18 user nova-compute[75226]:     </serial>
Nov 17 01:20:18 user nova-compute[75226]:     <console type='pty' tty='/dev/pts/5'>
Nov 17 01:20:18 user nova-compute[75226]:       <source path='/dev/pts/5'/>
Nov 17 01:20:18 user nova-compute[75226]:       <log file='/opt/stack/data/nova/instances/b054a557-dff6-49f8-9300-1307f8433567/console.log' append='off'/>
Nov 17 01:20:18 user nova-compute[75226]:       <target type='serial' port='0'/>
Nov 17 01:20:18 user nova-compute[75226]:       <alias name='serial0'/>
Nov 17 01:20:18 user nova-compute[75226]:     </console>
Nov 17 01:20:18 user nova-compute[75226]:     <input type='mouse' bus='ps2'>
Nov 17 01:20:18 user nova-compute[75226]:       <alias name='input0'/>
Nov 17 01:20:18 user nova-compute[75226]:     </input>
Nov 17 01:20:18 user nova-compute[75226]:     <input type='keyboard' bus='ps2'>
Nov 17 01:20:18 user nova-compute[75226]:       <alias name='input1'/>
Nov 17 01:20:18 user nova-compute[75226]:     </input>
Nov 17 01:20:18 user nova-compute[75226]:     <graphics type='vnc' port='5905' autoport='yes' listen='0.0.0.0'>
Nov 17 01:20:18 user nova-compute[75226]:       <listen type='address' address='0.0.0.0'/>
Nov 17 01:20:18 user nova-compute[75226]:     </graphics>
Nov 17 01:20:18 user nova-compute[75226]:     <audio id='1' type='none'/>
Nov 17 01:20:18 user nova-compute[75226]:     <video>
Nov 17 01:20:18 user nova-compute[75226]:       <model type='virtio' heads='1' primary='yes'/>
Nov 17 01:20:18 user nova-compute[75226]:       <alias name='video0'/>
Nov 17 01:20:18 user nova-compute[75226]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 17 01:20:18 user nova-compute[75226]:     </video>
Nov 17 01:20:18 user nova-compute[75226]:     <memballoon model='virtio'>
Nov 17 01:20:18 user nova-compute[75226]:       <stats period='10'/>
Nov 17 01:20:18 user nova-compute[75226]:       <alias name='balloon0'/>
Nov 17 01:20:18 user nova-compute[75226]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 17 01:20:18 user nova-compute[75226]:     </memballoon>
Nov 17 01:20:18 user nova-compute[75226]:     <rng model='virtio'>
Nov 17 01:20:18 user nova-compute[75226]:       <backend model='random'>/dev/urandom</backend>
Nov 17 01:20:18 user nova-compute[75226]:       <alias name='rng0'/>
Nov 17 01:20:18 user nova-compute[75226]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 17 01:20:18 user nova-compute[75226]:     </rng>
Nov 17 01:20:18 user nova-compute[75226]:   </devices>
Nov 17 01:20:18 user nova-compute[75226]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 17 01:20:18 user nova-compute[75226]:     <label>libvirt-b054a557-dff6-49f8-9300-1307f8433567</label>
Nov 17 01:20:18 user nova-compute[75226]:     <imagelabel>libvirt-b054a557-dff6-49f8-9300-1307f8433567</imagelabel>
Nov 17 01:20:18 user nova-compute[75226]:   </seclabel>
Nov 17 01:20:18 user nova-compute[75226]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 17 01:20:18 user nova-compute[75226]:     <label>+64055:+108</label>
Nov 17 01:20:18 user nova-compute[75226]:     <imagelabel>+64055:+108</imagelabel>
Nov 17 01:20:18 user nova-compute[75226]:   </seclabel>
Nov 17 01:20:18 user nova-compute[75226]: </domain>
Nov 17 01:20:18 user nova-compute[75226]:  {{(pid=75226) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 17 01:20:18 user nova-compute[75226]: DEBUG nova.virt.libvirt.guest [req-dd762320-648a-43fa-9fd8-6df8354040f9 req-3812ab4d-fa33-4856-86dc-1c9acae5dd9f service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:4c:39:60"/><model type="virtio"/><mtu size="1442"/><target dev="tap902fc99d-3d"/></interface> {{(pid=75226) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 17 01:20:18 user nova-compute[75226]: DEBUG nova.virt.libvirt.guest [req-dd762320-648a-43fa-9fd8-6df8354040f9 req-3812ab4d-fa33-4856-86dc-1c9acae5dd9f service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:4c:39:60"/><model type="virtio"/><mtu size="1442"/><target dev="tap902fc99d-3d"/></interface>not found in domain: <domain type='kvm' id='6'>
Nov 17 01:20:18 user nova-compute[75226]:   <name>instance-00000006</name>
Nov 17 01:20:18 user nova-compute[75226]:   <uuid>b054a557-dff6-49f8-9300-1307f8433567</uuid>
Nov 17 01:20:18 user nova-compute[75226]:   <metadata>
Nov 17 01:20:18 user nova-compute[75226]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 17 01:20:18 user nova-compute[75226]:   <nova:package version="0.0.0"/>
Nov 17 01:20:18 user nova-compute[75226]:   <nova:name>tempest-device-tagging-server-670055725</nova:name>
Nov 17 01:20:18 user nova-compute[75226]:   <nova:creationTime>2023-11-17 01:20:17</nova:creationTime>
Nov 17 01:20:18 user nova-compute[75226]:   <nova:flavor name="m1.tiny">
Nov 17 01:20:18 user nova-compute[75226]:     <nova:memory>512</nova:memory>
Nov 17 01:20:18 user nova-compute[75226]:     <nova:disk>1</nova:disk>
Nov 17 01:20:18 user nova-compute[75226]:     <nova:swap>0</nova:swap>
Nov 17 01:20:18 user nova-compute[75226]:     <nova:ephemeral>0</nova:ephemeral>
Nov 17 01:20:18 user nova-compute[75226]:     <nova:vcpus>1</nova:vcpus>
Nov 17 01:20:18 user nova-compute[75226]:   </nova:flavor>
Nov 17 01:20:18 user nova-compute[75226]:   <nova:owner>
Nov 17 01:20:18 user nova-compute[75226]:     <nova:user uuid="b59a9221aae44dcbb688294a0483b715">tempest-TaggedAttachmentsTest-177886932-project-member</nova:user>
Nov 17 01:20:18 user nova-compute[75226]:     <nova:project uuid="f8f5190e0bff4cbb9384c0fb4faf54d4">tempest-TaggedAttachmentsTest-177886932</nova:project>
Nov 17 01:20:18 user nova-compute[75226]:   </nova:owner>
Nov 17 01:20:18 user nova-compute[75226]:   <nova:root type="image" uuid="0b369aea-6f3f-4690-9f01-229b90ab6310"/>
Nov 17 01:20:18 user nova-compute[75226]:   <nova:ports>
Nov 17 01:20:18 user nova-compute[75226]:     <nova:port uuid="9be521ab-d517-4746-b6b3-1e4930610165">
Nov 17 01:20:18 user nova-compute[75226]:       <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 17 01:20:18 user nova-compute[75226]:     </nova:port>
Nov 17 01:20:18 user nova-compute[75226]:   </nova:ports>
Nov 17 01:20:18 user nova-compute[75226]: </nova:instance>
Nov 17 01:20:18 user nova-compute[75226]:   </metadata>
Nov 17 01:20:18 user nova-compute[75226]:   <memory unit='KiB'>524288</memory>
Nov 17 01:20:18 user nova-compute[75226]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 17 01:20:18 user nova-compute[75226]:   <vcpu placement='static'>1</vcpu>
Nov 17 01:20:18 user nova-compute[75226]:   <resource>
Nov 17 01:20:18 user nova-compute[75226]:     <partition>/machine</partition>
Nov 17 01:20:18 user nova-compute[75226]:   </resource>
Nov 17 01:20:18 user nova-compute[75226]:   <sysinfo type='smbios'>
Nov 17 01:20:18 user nova-compute[75226]:     <system>
Nov 17 01:20:18 user nova-compute[75226]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 17 01:20:18 user nova-compute[75226]:       <entry name='product'>OpenStack Nova</entry>
Nov 17 01:20:18 user nova-compute[75226]:       <entry name='version'>0.0.0</entry>
Nov 17 01:20:18 user nova-compute[75226]:       <entry name='serial'>b054a557-dff6-49f8-9300-1307f8433567</entry>
Nov 17 01:20:18 user nova-compute[75226]:       <entry name='uuid'>b054a557-dff6-49f8-9300-1307f8433567</entry>
Nov 17 01:20:18 user nova-compute[75226]:       <entry name='family'>Virtual Machine</entry>
Nov 17 01:20:18 user nova-compute[75226]:     </system>
Nov 17 01:20:18 user nova-compute[75226]:   </sysinfo>
Nov 17 01:20:18 user nova-compute[75226]:   <os>
Nov 17 01:20:18 user nova-compute[75226]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 17 01:20:18 user nova-compute[75226]:     <boot dev='hd'/>
Nov 17 01:20:18 user nova-compute[75226]:     <smbios mode='sysinfo'/>
Nov 17 01:20:18 user nova-compute[75226]:   </os>
Nov 17 01:20:18 user nova-compute[75226]:   <features>
Nov 17 01:20:18 user nova-compute[75226]:     <acpi/>
Nov 17 01:20:18 user nova-compute[75226]:     <apic/>
Nov 17 01:20:18 user nova-compute[75226]:     <vmcoreinfo state='on'/>
Nov 17 01:20:18 user nova-compute[75226]:   </features>
Nov 17 01:20:18 user nova-compute[75226]:   <cpu mode='custom' match='exact' check='full'>
Nov 17 01:20:18 user nova-compute[75226]:     <model fallback='forbid'>Nehalem</model>
Nov 17 01:20:18 user nova-compute[75226]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 17 01:20:18 user nova-compute[75226]:     <feature policy='require' name='vme'/>
Nov 17 01:20:18 user nova-compute[75226]:     <feature policy='require' name='x2apic'/>
Nov 17 01:20:18 user nova-compute[75226]:     <feature policy='require' name='hypervisor'/>
Nov 17 01:20:18 user nova-compute[75226]:   </cpu>
Nov 17 01:20:18 user nova-compute[75226]:   <clock offset='utc'>
Nov 17 01:20:18 user nova-compute[75226]:     <timer name='pit' tickpolicy='delay'/>
Nov 17 01:20:18 user nova-compute[75226]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 17 01:20:18 user nova-compute[75226]:     <timer name='hpet' present='no'/>
Nov 17 01:20:18 user nova-compute[75226]:   </clock>
Nov 17 01:20:18 user nova-compute[75226]:   <on_poweroff>destroy</on_poweroff>
Nov 17 01:20:18 user nova-compute[75226]:   <on_reboot>restart</on_reboot>
Nov 17 01:20:18 user nova-compute[75226]:   <on_crash>destroy</on_crash>
Nov 17 01:20:18 user nova-compute[75226]:   <devices>
Nov 17 01:20:18 user nova-compute[75226]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 17 01:20:18 user nova-compute[75226]:     <disk type='file' device='disk'>
Nov 17 01:20:18 user nova-compute[75226]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 17 01:20:18 user nova-compute[75226]:       <source file='/opt/stack/data/nova/instances/b054a557-dff6-49f8-9300-1307f8433567/disk' index='2'/>
Nov 17 01:20:18 user nova-compute[75226]:       <backingStore type='file' index='3'>
Nov 17 01:20:18 user nova-compute[75226]:         <format type='raw'/>
Nov 17 01:20:18 user nova-compute[75226]:         <source file='/opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371'/>
Nov 17 01:20:18 user nova-compute[75226]:         <backingStore/>
Nov 17 01:20:18 user nova-compute[75226]:       </backingStore>
Nov 17 01:20:18 user nova-compute[75226]:       <target dev='vda' bus='virtio'/>
Nov 17 01:20:18 user nova-compute[75226]:       <alias name='virtio-disk0'/>
Nov 17 01:20:18 user nova-compute[75226]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 17 01:20:18 user nova-compute[75226]:     </disk>
Nov 17 01:20:18 user nova-compute[75226]:     <disk type='file' device='cdrom'>
Nov 17 01:20:18 user nova-compute[75226]:       <driver name='qemu' type='raw' cache='none'/>
Nov 17 01:20:18 user nova-compute[75226]:       <source file='/opt/stack/data/nova/instances/b054a557-dff6-49f8-9300-1307f8433567/disk.config' index='1'/>
Nov 17 01:20:18 user nova-compute[75226]:       <backingStore/>
Nov 17 01:20:18 user nova-compute[75226]:       <target dev='hda' bus='ide'/>
Nov 17 01:20:18 user nova-compute[75226]:       <readonly/>
Nov 17 01:20:18 user nova-compute[75226]:       <alias name='ide0-0-0'/>
Nov 17 01:20:18 user nova-compute[75226]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 17 01:20:18 user nova-compute[75226]:     </disk>
Nov 17 01:20:18 user nova-compute[75226]:     <controller type='usb' index='0' model='none'>
Nov 17 01:20:18 user nova-compute[75226]:       <alias name='usb'/>
Nov 17 01:20:18 user nova-compute[75226]:     </controller>
Nov 17 01:20:18 user nova-compute[75226]:     <controller type='pci' index='0' model='pci-root'>
Nov 17 01:20:18 user nova-compute[75226]:       <alias name='pci.0'/>
Nov 17 01:20:18 user nova-compute[75226]:     </controller>
Nov 17 01:20:18 user nova-compute[75226]:     <controller type='ide' index='0'>
Nov 17 01:20:18 user nova-compute[75226]:       <alias name='ide'/>
Nov 17 01:20:18 user nova-compute[75226]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 17 01:20:18 user nova-compute[75226]:     </controller>
Nov 17 01:20:18 user nova-compute[75226]:     <interface type='ethernet'>
Nov 17 01:20:18 user nova-compute[75226]:       <mac address='fa:16:3e:c9:37:0f'/>
Nov 17 01:20:18 user nova-compute[75226]:       <target dev='tap9be521ab-d5'/>
Nov 17 01:20:18 user nova-compute[75226]:       <model type='virtio'/>
Nov 17 01:20:18 user nova-compute[75226]:       <mtu size='1442'/>
Nov 17 01:20:18 user nova-compute[75226]:       <alias name='net0'/>
Nov 17 01:20:18 user nova-compute[75226]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 17 01:20:18 user nova-compute[75226]:     </interface>
Nov 17 01:20:18 user nova-compute[75226]:     <serial type='pty'>
Nov 17 01:20:18 user nova-compute[75226]:       <source path='/dev/pts/5'/>
Nov 17 01:20:18 user nova-compute[75226]:       <log file='/opt/stack/data/nova/instances/b054a557-dff6-49f8-9300-1307f8433567/console.log' append='off'/>
Nov 17 01:20:18 user nova-compute[75226]:       <target type='isa-serial' port='0'>
Nov 17 01:20:18 user nova-compute[75226]:         <model name='isa-serial'/>
Nov 17 01:20:18 user nova-compute[75226]:       </target>
Nov 17 01:20:18 user nova-compute[75226]:       <alias name='serial0'/>
Nov 17 01:20:18 user nova-compute[75226]:     </serial>
Nov 17 01:20:18 user nova-compute[75226]:     <console type='pty' tty='/dev/pts/5'>
Nov 17 01:20:18 user nova-compute[75226]:       <source path='/dev/pts/5'/>
Nov 17 01:20:18 user nova-compute[75226]:       <log file='/opt/stack/data/nova/instances/b054a557-dff6-49f8-9300-1307f8433567/console.log' append='off'/>
Nov 17 01:20:18 user nova-compute[75226]:       <target type='serial' port='0'/>
Nov 17 01:20:18 user nova-compute[75226]:       <alias name='serial0'/>
Nov 17 01:20:18 user nova-compute[75226]:     </console>
Nov 17 01:20:18 user nova-compute[75226]:     <input type='mouse' bus='ps2'>
Nov 17 01:20:18 user nova-compute[75226]:       <alias name='input0'/>
Nov 17 01:20:18 user nova-compute[75226]:     </input>
Nov 17 01:20:18 user nova-compute[75226]:     <input type='keyboard' bus='ps2'>
Nov 17 01:20:18 user nova-compute[75226]:       <alias name='input1'/>
Nov 17 01:20:18 user nova-compute[75226]:     </input>
Nov 17 01:20:18 user nova-compute[75226]:     <graphics type='vnc' port='5905' autoport='yes' listen='0.0.0.0'>
Nov 17 01:20:18 user nova-compute[75226]:       <listen type='address' address='0.0.0.0'/>
Nov 17 01:20:18 user nova-compute[75226]:     </graphics>
Nov 17 01:20:18 user nova-compute[75226]:     <audio id='1' type='none'/>
Nov 17 01:20:18 user nova-compute[75226]:     <video>
Nov 17 01:20:18 user nova-compute[75226]:       <model type='virtio' heads='1' primary='yes'/>
Nov 17 01:20:18 user nova-compute[75226]:       <alias name='video0'/>
Nov 17 01:20:18 user nova-compute[75226]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 17 01:20:18 user nova-compute[75226]:     </video>
Nov 17 01:20:18 user nova-compute[75226]:     <memballoon model='virtio'>
Nov 17 01:20:18 user nova-compute[75226]:       <stats period='10'/>
Nov 17 01:20:18 user nova-compute[75226]:       <alias name='balloon0'/>
Nov 17 01:20:18 user nova-compute[75226]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 17 01:20:18 user nova-compute[75226]:     </memballoon>
Nov 17 01:20:18 user nova-compute[75226]:     <rng model='virtio'>
Nov 17 01:20:18 user nova-compute[75226]:       <backend model='random'>/dev/urandom</backend>
Nov 17 01:20:18 user nova-compute[75226]:       <alias name='rng0'/>
Nov 17 01:20:18 user nova-compute[75226]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 17 01:20:18 user nova-compute[75226]:     </rng>
Nov 17 01:20:18 user nova-compute[75226]:   </devices>
Nov 17 01:20:18 user nova-compute[75226]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 17 01:20:18 user nova-compute[75226]:     <label>libvirt-b054a557-dff6-49f8-9300-1307f8433567</label>
Nov 17 01:20:18 user nova-compute[75226]:     <imagelabel>libvirt-b054a557-dff6-49f8-9300-1307f8433567</imagelabel>
Nov 17 01:20:18 user nova-compute[75226]:   </seclabel>
Nov 17 01:20:18 user nova-compute[75226]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 17 01:20:18 user nova-compute[75226]:     <label>+64055:+108</label>
Nov 17 01:20:18 user nova-compute[75226]:     <imagelabel>+64055:+108</imagelabel>
Nov 17 01:20:18 user nova-compute[75226]:   </seclabel>
Nov 17 01:20:18 user nova-compute[75226]: </domain>
Nov 17 01:20:18 user nova-compute[75226]:  {{(pid=75226) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 17 01:20:18 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [req-dd762320-648a-43fa-9fd8-6df8354040f9 req-3812ab4d-fa33-4856-86dc-1c9acae5dd9f service nova] [instance: b054a557-dff6-49f8-9300-1307f8433567] Detaching interface fa:16:3e:4c:39:60 failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tap902fc99d-3d' not found.
Nov 17 01:20:18 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [req-dd762320-648a-43fa-9fd8-6df8354040f9 req-3812ab4d-fa33-4856-86dc-1c9acae5dd9f service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-17T01:17:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-670055725',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-670055725',id=6,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLQTkAEsiD7vZkLRChcVhMfcWUFr+J4uCStAPtsh5EcOj4Y0TqNu0/N7e0AK98CTHsomeIYjTkrU/pTyfUW55cXvLwMkYssMQNhMJgsr816svkjbGW+OPHRqanQu9/VlCw==',key_name='tempest-keypair-2003198946',keypairs=<?>,launch_index=0,launched_at=2023-11-17T01:17:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f8f5190e0bff4cbb9384c0fb4faf54d4',ramdisk_id='',reservation_id='r-icespjka',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-177886932',owner_user_name='tempest-TaggedAttachmentsTest-177886932-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T01:17:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b59a9221aae44dcbb688294a0483b715',uuid=b054a557-dff6-49f8-9300-1307f8433567,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "902fc99d-3d0f-4ce4-8502-b4c2f7617163", "address": "fa:16:3e:4c:39:60", "network": {"id": "ad4f167b-03ad-46dd-b568-d8478a055559", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1332712448", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f8f5190e0bff4cbb9384c0fb4faf54d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap902fc99d-3d", "ovs_interfaceid": "902fc99d-3d0f-4ce4-8502-b4c2f7617163", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 17 01:20:18 user nova-compute[75226]: DEBUG nova.network.os_vif_util [req-dd762320-648a-43fa-9fd8-6df8354040f9 req-3812ab4d-fa33-4856-86dc-1c9acae5dd9f service nova] Converting VIF {"id": "902fc99d-3d0f-4ce4-8502-b4c2f7617163", "address": "fa:16:3e:4c:39:60", "network": {"id": "ad4f167b-03ad-46dd-b568-d8478a055559", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1332712448", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f8f5190e0bff4cbb9384c0fb4faf54d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap902fc99d-3d", "ovs_interfaceid": "902fc99d-3d0f-4ce4-8502-b4c2f7617163", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:20:18 user nova-compute[75226]: DEBUG nova.network.os_vif_util [req-dd762320-648a-43fa-9fd8-6df8354040f9 req-3812ab4d-fa33-4856-86dc-1c9acae5dd9f service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:39:60,bridge_name='br-int',has_traffic_filtering=True,id=902fc99d-3d0f-4ce4-8502-b4c2f7617163,network=Network(ad4f167b-03ad-46dd-b568-d8478a055559),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap902fc99d-3d') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:20:18 user nova-compute[75226]: DEBUG os_vif [req-dd762320-648a-43fa-9fd8-6df8354040f9 req-3812ab4d-fa33-4856-86dc-1c9acae5dd9f service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:39:60,bridge_name='br-int',has_traffic_filtering=True,id=902fc99d-3d0f-4ce4-8502-b4c2f7617163,network=Network(ad4f167b-03ad-46dd-b568-d8478a055559),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap902fc99d-3d') {{(pid=75226) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 17 01:20:18 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:20:18 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap902fc99d-3d, bridge=br-int, if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:20:18 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 17 01:20:18 user nova-compute[75226]: INFO os_vif [req-dd762320-648a-43fa-9fd8-6df8354040f9 req-3812ab4d-fa33-4856-86dc-1c9acae5dd9f service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:39:60,bridge_name='br-int',has_traffic_filtering=True,id=902fc99d-3d0f-4ce4-8502-b4c2f7617163,network=Network(ad4f167b-03ad-46dd-b568-d8478a055559),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap902fc99d-3d')
Nov 17 01:20:18 user nova-compute[75226]: DEBUG nova.virt.libvirt.guest [req-dd762320-648a-43fa-9fd8-6df8354040f9 req-3812ab4d-fa33-4856-86dc-1c9acae5dd9f service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 17 01:20:18 user nova-compute[75226]:   <nova:package version="0.0.0"/>
Nov 17 01:20:18 user nova-compute[75226]:   <nova:name>tempest-device-tagging-server-670055725</nova:name>
Nov 17 01:20:18 user nova-compute[75226]:   <nova:creationTime>2023-11-17 01:20:18</nova:creationTime>
Nov 17 01:20:18 user nova-compute[75226]:   <nova:flavor name="m1.tiny">
Nov 17 01:20:18 user nova-compute[75226]:     <nova:memory>512</nova:memory>
Nov 17 01:20:18 user nova-compute[75226]:     <nova:disk>1</nova:disk>
Nov 17 01:20:18 user nova-compute[75226]:     <nova:swap>0</nova:swap>
Nov 17 01:20:18 user nova-compute[75226]:     <nova:ephemeral>0</nova:ephemeral>
Nov 17 01:20:18 user nova-compute[75226]:     <nova:vcpus>1</nova:vcpus>
Nov 17 01:20:18 user nova-compute[75226]:   </nova:flavor>
Nov 17 01:20:18 user nova-compute[75226]:   <nova:owner>
Nov 17 01:20:18 user nova-compute[75226]:     <nova:user uuid="b59a9221aae44dcbb688294a0483b715">tempest-TaggedAttachmentsTest-177886932-project-member</nova:user>
Nov 17 01:20:18 user nova-compute[75226]:     <nova:project uuid="f8f5190e0bff4cbb9384c0fb4faf54d4">tempest-TaggedAttachmentsTest-177886932</nova:project>
Nov 17 01:20:18 user nova-compute[75226]:   </nova:owner>
Nov 17 01:20:18 user nova-compute[75226]:   <nova:root type="image" uuid="0b369aea-6f3f-4690-9f01-229b90ab6310"/>
Nov 17 01:20:18 user nova-compute[75226]:   <nova:ports>
Nov 17 01:20:18 user nova-compute[75226]:     <nova:port uuid="9be521ab-d517-4746-b6b3-1e4930610165">
Nov 17 01:20:18 user nova-compute[75226]:       <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 17 01:20:18 user nova-compute[75226]:     </nova:port>
Nov 17 01:20:18 user nova-compute[75226]:   </nova:ports>
Nov 17 01:20:18 user nova-compute[75226]: </nova:instance>
Nov 17 01:20:18 user nova-compute[75226]:  {{(pid=75226) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 17 01:20:18 user nova-compute[75226]: DEBUG nova.network.neutron [None req-5cd66272-c81d-45ab-afd2-cfb674a33329 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] [instance: b054a557-dff6-49f8-9300-1307f8433567] Updating instance_info_cache with network_info: [{"id": "9be521ab-d517-4746-b6b3-1e4930610165", "address": "fa:16:3e:c9:37:0f", "network": {"id": "126149e3-f0c6-483c-a0b4-4fd1dcd1a390", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1008205473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8f5190e0bff4cbb9384c0fb4faf54d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9be521ab-d5", "ovs_interfaceid": "9be521ab-d517-4746-b6b3-1e4930610165", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:20:19 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-5cd66272-c81d-45ab-afd2-cfb674a33329 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] Releasing lock "refresh_cache-b054a557-dff6-49f8-9300-1307f8433567" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:20:19 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-5cd66272-c81d-45ab-afd2-cfb674a33329 tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] Lock "interface-b054a557-dff6-49f8-9300-1307f8433567-902fc99d-3d0f-4ce4-8502-b4c2f7617163" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 21.628s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:20:19 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:20:19 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:20:19 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:20:19 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:20:19 user nova-compute[75226]: DEBUG nova.compute.manager [req-f3607dbc-fe7e-404f-9f0c-195f95aae9ee req-a963abe8-bf11-459f-abe0-16da88646783 service nova] [instance: 6b7e9611-be35-4e51-b886-91a2fac0a653] Received event network-vif-plugged-657af53c-fc3a-45ab-81e5-b2eeea1c88d7 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:20:19 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-f3607dbc-fe7e-404f-9f0c-195f95aae9ee req-a963abe8-bf11-459f-abe0-16da88646783 service nova] Acquiring lock "6b7e9611-be35-4e51-b886-91a2fac0a653-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:20:19 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-f3607dbc-fe7e-404f-9f0c-195f95aae9ee req-a963abe8-bf11-459f-abe0-16da88646783 service nova] Lock "6b7e9611-be35-4e51-b886-91a2fac0a653-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:20:19 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-f3607dbc-fe7e-404f-9f0c-195f95aae9ee req-a963abe8-bf11-459f-abe0-16da88646783 service nova] Lock "6b7e9611-be35-4e51-b886-91a2fac0a653-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:20:19 user nova-compute[75226]: DEBUG nova.compute.manager [req-f3607dbc-fe7e-404f-9f0c-195f95aae9ee req-a963abe8-bf11-459f-abe0-16da88646783 service nova] [instance: 6b7e9611-be35-4e51-b886-91a2fac0a653] No waiting events found dispatching network-vif-plugged-657af53c-fc3a-45ab-81e5-b2eeea1c88d7 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:20:19 user nova-compute[75226]: WARNING nova.compute.manager [req-f3607dbc-fe7e-404f-9f0c-195f95aae9ee req-a963abe8-bf11-459f-abe0-16da88646783 service nova] [instance: 6b7e9611-be35-4e51-b886-91a2fac0a653] Received unexpected event network-vif-plugged-657af53c-fc3a-45ab-81e5-b2eeea1c88d7 for instance with vm_state building and task_state spawning.
Nov 17 01:20:19 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-dccdc493-65f1-480e-88d6-857746797fab tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 75b1cabe-ba15-4851-9140-5949afc33005 is timed out.
Nov 17 01:20:19 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-dccdc493-65f1-480e-88d6-857746797fab tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] Successfully detached device vdb from instance 75b1cabe-ba15-4851-9140-5949afc33005 from the live domain config.
Nov 17 01:20:19 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dccdc493-65f1-480e-88d6-857746797fab tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] [instance: 75b1cabe-ba15-4851-9140-5949afc33005] calling os-brick to detach iSCSI Volume {{(pid=75226) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 17 01:20:19 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-dccdc493-65f1-480e-88d6-857746797fab tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc4cc36b490>, {'target_iqn': 'iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OsjHbnIp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf', 'volume_id': 'ac3239e4-20ce-43ca-84b3-f5f0a5ffff95'}, None), 'kwargs': False}}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:20:19 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-dccdc493-65f1-480e-88d6-857746797fab tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:20:19 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-dccdc493-65f1-480e-88d6-857746797fab tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:20:19 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-dccdc493-65f1-480e-88d6-857746797fab tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:20:19 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:20:19 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:20:19 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb5551d7-4c31-40aa-8173-3ad72a787d0e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:20:19 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-dccdc493-65f1-480e-88d6-857746797fab tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 17 01:20:19 user nova-compute[75226]: No targets found.
Nov 17 01:20:19 user nova-compute[75226]: iSNS:
Nov 17 01:20:19 user nova-compute[75226]: No targets found.
Nov 17 01:20:19 user nova-compute[75226]: STATIC:
Nov 17 01:20:19 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8
Nov 17 01:20:19 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:20:19 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:20:19 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2
Nov 17 01:20:19 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:20:19 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:20:19 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95
Nov 17 01:20:19 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:20:19 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:20:19 user nova-compute[75226]: FIRMWARE:
Nov 17 01:20:19 user nova-compute[75226]: No targets found.
Nov 17 01:20:19 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:20:19 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-dccdc493-65f1-480e-88d6-857746797fab tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 17 01:20:19 user nova-compute[75226]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 17 01:20:19 user nova-compute[75226]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75226) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 17 01:20:19 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-dccdc493-65f1-480e-88d6-857746797fab tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95', 0)] {{(pid=75226) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 17 01:20:19 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:20:19 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.031s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:20:19 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ada4176-93b8-42c5-b263-39fdb2709559]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:20:19 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:20:19 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:20:19 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d7ba766-d4f4-4264-b2ed-6dc73cccb545]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:20:19 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-dccdc493-65f1-480e-88d6-857746797fab tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95 (non-flash)
Nov 17 01:20:19 user nova-compute[75226]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2 (non-flash)
Nov 17 01:20:19 user nova-compute[75226]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)
Nov 17 01:20:19 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:20:19 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-dccdc493-65f1-480e-88d6-857746797fab tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95 (non-flash)
Nov 17 01:20:19 user nova-compute[75226]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2 (non-flash)
Nov 17 01:20:19 user nova-compute[75226]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)
Nov 17 01:20:19 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:20:19 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-dccdc493-65f1-480e-88d6-857746797fab tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc4b43e1870>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95'): ({'sdf'}, set())}) {{(pid=75226) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 17 01:20:19 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-dccdc493-65f1-480e-88d6-857746797fab tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] Removing single pathed devices sdf {{(pid=75226) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 17 01:20:19 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:20:19 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.030s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:20:19 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9d1a6be-a895-43a3-9bf2-958005fcef3a]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:20:19 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:20:19 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.023s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:20:19 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f7e0843-24ca-47bc-aff7-52020cc91672]: (4, ('ok\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:20:19 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-dccdc493-65f1-480e-88d6-857746797fab tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] Flushing IO for device /dev/sdf {{(pid=75226) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 17 01:20:19 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:20:19 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.016s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:20:19 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0dbae71-f939-4ef7-ad00-b963cbedf28e]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:20:19 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-dccdc493-65f1-480e-88d6-857746797fab tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75226) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 17 01:20:19 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:20:19 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.046s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:20:19 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f17e1c6-0d1e-4439-a789-701ffb0e6e41]: (4, ('1', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:20:19 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-dccdc493-65f1-480e-88d6-857746797fab tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75226) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 17 01:20:19 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-dccdc493-65f1-480e-88d6-857746797fab tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] SCSI volumes sdf have been removed. {{(pid=75226) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 17 01:20:19 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-dccdc493-65f1-480e-88d6-857746797fab tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95')] {{(pid=75226) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 17 01:20:19 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:20:19 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:20:19 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[2100e894-67af-42a3-98e3-89e3131a0deb]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:20:19 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-dccdc493-65f1-480e-88d6-857746797fab tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:20:19 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95 -p 172.16.0.220:3260 --logout {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:20:19 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:20:19 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[c724ac94-dc86-458f-9eb4-77de34cc5876]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:20:19 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-dccdc493-65f1-480e-88d6-857746797fab tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95, portal: 172.16.0.220,3260]
Nov 17 01:20:19 user nova-compute[75226]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95, portal: 172.16.0.220,3260] successful.
Nov 17 01:20:19 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:20:19 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95 -p 172.16.0.220:3260 --op delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:20:19 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac3239e4-20ce-43ca-84b3-f5f0a5ffff95 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:20:19 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3a2867b-0258-4280-a286-6dd998c62ad3]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:20:19 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-dccdc493-65f1-480e-88d6-857746797fab tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:20:19 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-dccdc493-65f1-480e-88d6-857746797fab tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.383s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:20:19 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-dccdc493-65f1-480e-88d6-857746797fab tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] <== disconnect_volume: return (384ms) None {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:20:19 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dccdc493-65f1-480e-88d6-857746797fab tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] [instance: 75b1cabe-ba15-4851-9140-5949afc33005] Disconnected iSCSI Volume {{(pid=75226) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 17 01:20:19 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e643be78-8a3d-4b7a-a3d1-9a46e2884b98 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Acquiring lock "094ccd9a-bf3e-49d2-be76-34e2ce2b19e3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:20:19 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e643be78-8a3d-4b7a-a3d1-9a46e2884b98 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Lock "094ccd9a-bf3e-49d2-be76-34e2ce2b19e3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:20:19 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e643be78-8a3d-4b7a-a3d1-9a46e2884b98 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] [instance: 094ccd9a-bf3e-49d2-be76-34e2ce2b19e3] Starting instance... {{(pid=75226) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 17 01:20:20 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e643be78-8a3d-4b7a-a3d1-9a46e2884b98 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:20:20 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e643be78-8a3d-4b7a-a3d1-9a46e2884b98 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:20:20 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-e643be78-8a3d-4b7a-a3d1-9a46e2884b98 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75226) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 17 01:20:20 user nova-compute[75226]: INFO nova.compute.claims [None req-e643be78-8a3d-4b7a-a3d1-9a46e2884b98 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] [instance: 094ccd9a-bf3e-49d2-be76-34e2ce2b19e3] Claim successful on node user
Nov 17 01:20:20 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-e643be78-8a3d-4b7a-a3d1-9a46e2884b98 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:20:20 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-e643be78-8a3d-4b7a-a3d1-9a46e2884b98 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:20:20 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e643be78-8a3d-4b7a-a3d1-9a46e2884b98 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.472s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:20:20 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e643be78-8a3d-4b7a-a3d1-9a46e2884b98 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] [instance: 094ccd9a-bf3e-49d2-be76-34e2ce2b19e3] Start building networks asynchronously for instance. {{(pid=75226) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 17 01:20:20 user nova-compute[75226]: DEBUG nova.objects.instance [None req-dccdc493-65f1-480e-88d6-857746797fab tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] Lazy-loading 'flavor' on Instance uuid 75b1cabe-ba15-4851-9140-5949afc33005 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:20:20 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e643be78-8a3d-4b7a-a3d1-9a46e2884b98 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] [instance: 094ccd9a-bf3e-49d2-be76-34e2ce2b19e3] Allocating IP information in the background. {{(pid=75226) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 17 01:20:20 user nova-compute[75226]: DEBUG nova.network.neutron [None req-e643be78-8a3d-4b7a-a3d1-9a46e2884b98 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] [instance: 094ccd9a-bf3e-49d2-be76-34e2ce2b19e3] allocate_for_instance() {{(pid=75226) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 17 01:20:20 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-dccdc493-65f1-480e-88d6-857746797fab tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] Lock "75b1cabe-ba15-4851-9140-5949afc33005" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.845s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:20:20 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-e643be78-8a3d-4b7a-a3d1-9a46e2884b98 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] [instance: 094ccd9a-bf3e-49d2-be76-34e2ce2b19e3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 17 01:20:20 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e643be78-8a3d-4b7a-a3d1-9a46e2884b98 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] [instance: 094ccd9a-bf3e-49d2-be76-34e2ce2b19e3] Start building block device mappings for instance. {{(pid=75226) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 17 01:20:20 user nova-compute[75226]: DEBUG nova.policy [None req-e643be78-8a3d-4b7a-a3d1-9a46e2884b98 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5f6fd5dfdd9a4a36b6965ffab1b7c1e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a364d502d8948ff8b255dd2531b6218', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75226) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 17 01:20:20 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e643be78-8a3d-4b7a-a3d1-9a46e2884b98 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] [instance: 094ccd9a-bf3e-49d2-be76-34e2ce2b19e3] Start spawning the instance on the hypervisor. {{(pid=75226) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 17 01:20:20 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-e643be78-8a3d-4b7a-a3d1-9a46e2884b98 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] [instance: 094ccd9a-bf3e-49d2-be76-34e2ce2b19e3] Creating instance directory {{(pid=75226) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 17 01:20:20 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-e643be78-8a3d-4b7a-a3d1-9a46e2884b98 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] [instance: 094ccd9a-bf3e-49d2-be76-34e2ce2b19e3] Creating image(s)
Nov 17 01:20:20 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e643be78-8a3d-4b7a-a3d1-9a46e2884b98 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Acquiring lock "/opt/stack/data/nova/instances/094ccd9a-bf3e-49d2-be76-34e2ce2b19e3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:20:20 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e643be78-8a3d-4b7a-a3d1-9a46e2884b98 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Lock "/opt/stack/data/nova/instances/094ccd9a-bf3e-49d2-be76-34e2ce2b19e3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:20:20 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e643be78-8a3d-4b7a-a3d1-9a46e2884b98 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Lock "/opt/stack/data/nova/instances/094ccd9a-bf3e-49d2-be76-34e2ce2b19e3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:20:20 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e643be78-8a3d-4b7a-a3d1-9a46e2884b98 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:20:20 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e643be78-8a3d-4b7a-a3d1-9a46e2884b98 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json" returned: 0 in 0.195s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:20:20 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e643be78-8a3d-4b7a-a3d1-9a46e2884b98 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Acquiring lock "a8a62c2546af3a2036b853250c5ac64d4c6b4371" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:20:20 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e643be78-8a3d-4b7a-a3d1-9a46e2884b98 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Lock "a8a62c2546af3a2036b853250c5ac64d4c6b4371" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:20:20 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e643be78-8a3d-4b7a-a3d1-9a46e2884b98 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:20:21 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e643be78-8a3d-4b7a-a3d1-9a46e2884b98 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json" returned: 0 in 0.210s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:20:21 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e643be78-8a3d-4b7a-a3d1-9a46e2884b98 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371,backing_fmt=raw /opt/stack/data/nova/instances/094ccd9a-bf3e-49d2-be76-34e2ce2b19e3/disk 1073741824 {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:20:21 user nova-compute[75226]: DEBUG nova.network.neutron [None req-e643be78-8a3d-4b7a-a3d1-9a46e2884b98 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] [instance: 094ccd9a-bf3e-49d2-be76-34e2ce2b19e3] Successfully created port: 2ec14695-ebb4-4854-a2d9-6f9160f5adfc {{(pid=75226) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 17 01:20:21 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e643be78-8a3d-4b7a-a3d1-9a46e2884b98 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371,backing_fmt=raw /opt/stack/data/nova/instances/094ccd9a-bf3e-49d2-be76-34e2ce2b19e3/disk 1073741824" returned: 0 in 0.052s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:20:21 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e643be78-8a3d-4b7a-a3d1-9a46e2884b98 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Lock "a8a62c2546af3a2036b853250c5ac64d4c6b4371" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.267s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:20:21 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e643be78-8a3d-4b7a-a3d1-9a46e2884b98 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:20:21 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e643be78-8a3d-4b7a-a3d1-9a46e2884b98 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json" returned: 0 in 0.187s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:20:21 user nova-compute[75226]: DEBUG nova.virt.disk.api [None req-e643be78-8a3d-4b7a-a3d1-9a46e2884b98 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Checking if we can resize image /opt/stack/data/nova/instances/094ccd9a-bf3e-49d2-be76-34e2ce2b19e3/disk. size=1073741824 {{(pid=75226) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 17 01:20:21 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e643be78-8a3d-4b7a-a3d1-9a46e2884b98 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/094ccd9a-bf3e-49d2-be76-34e2ce2b19e3/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:20:21 user nova-compute[75226]: DEBUG nova.compute.manager [None req-4d32ff64-444c-4f86-999c-55124dcb793f tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 6b7e9611-be35-4e51-b886-91a2fac0a653] Instance event wait completed in 0 seconds for  {{(pid=75226) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 17 01:20:21 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-4d32ff64-444c-4f86-999c-55124dcb793f tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 6b7e9611-be35-4e51-b886-91a2fac0a653] Guest created on hypervisor {{(pid=75226) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 17 01:20:21 user nova-compute[75226]: DEBUG nova.compute.manager [req-409fb8de-230b-4b60-bba1-e8b33b5c07dd req-9cf35283-1df2-462a-b497-0c6b52bc097f service nova] [instance: 6b7e9611-be35-4e51-b886-91a2fac0a653] Received event network-vif-plugged-657af53c-fc3a-45ab-81e5-b2eeea1c88d7 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:20:21 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-409fb8de-230b-4b60-bba1-e8b33b5c07dd req-9cf35283-1df2-462a-b497-0c6b52bc097f service nova] Acquiring lock "6b7e9611-be35-4e51-b886-91a2fac0a653-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:20:21 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-409fb8de-230b-4b60-bba1-e8b33b5c07dd req-9cf35283-1df2-462a-b497-0c6b52bc097f service nova] Lock "6b7e9611-be35-4e51-b886-91a2fac0a653-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:20:21 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-409fb8de-230b-4b60-bba1-e8b33b5c07dd req-9cf35283-1df2-462a-b497-0c6b52bc097f service nova] Lock "6b7e9611-be35-4e51-b886-91a2fac0a653-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:20:21 user nova-compute[75226]: DEBUG nova.compute.manager [req-409fb8de-230b-4b60-bba1-e8b33b5c07dd req-9cf35283-1df2-462a-b497-0c6b52bc097f service nova] [instance: 6b7e9611-be35-4e51-b886-91a2fac0a653] No waiting events found dispatching network-vif-plugged-657af53c-fc3a-45ab-81e5-b2eeea1c88d7 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:20:21 user nova-compute[75226]: WARNING nova.compute.manager [req-409fb8de-230b-4b60-bba1-e8b33b5c07dd req-9cf35283-1df2-462a-b497-0c6b52bc097f service nova] [instance: 6b7e9611-be35-4e51-b886-91a2fac0a653] Received unexpected event network-vif-plugged-657af53c-fc3a-45ab-81e5-b2eeea1c88d7 for instance with vm_state building and task_state spawning.
Nov 17 01:20:21 user nova-compute[75226]: INFO nova.virt.libvirt.driver [-] [instance: 6b7e9611-be35-4e51-b886-91a2fac0a653] Instance spawned successfully.
Nov 17 01:20:21 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-4d32ff64-444c-4f86-999c-55124dcb793f tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 6b7e9611-be35-4e51-b886-91a2fac0a653] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 17 01:20:21 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-4d32ff64-444c-4f86-999c-55124dcb793f tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 6b7e9611-be35-4e51-b886-91a2fac0a653] Found default for hw_cdrom_bus of ide {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:20:21 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-4d32ff64-444c-4f86-999c-55124dcb793f tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 6b7e9611-be35-4e51-b886-91a2fac0a653] Found default for hw_disk_bus of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:20:21 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-4d32ff64-444c-4f86-999c-55124dcb793f tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 6b7e9611-be35-4e51-b886-91a2fac0a653] Found default for hw_input_bus of None {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:20:21 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-4d32ff64-444c-4f86-999c-55124dcb793f tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 6b7e9611-be35-4e51-b886-91a2fac0a653] Found default for hw_pointer_model of None {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:20:21 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-4d32ff64-444c-4f86-999c-55124dcb793f tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 6b7e9611-be35-4e51-b886-91a2fac0a653] Found default for hw_video_model of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:20:21 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-4d32ff64-444c-4f86-999c-55124dcb793f tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 6b7e9611-be35-4e51-b886-91a2fac0a653] Found default for hw_vif_model of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:20:21 user nova-compute[75226]: INFO nova.compute.manager [None req-4d32ff64-444c-4f86-999c-55124dcb793f tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 6b7e9611-be35-4e51-b886-91a2fac0a653] Took 5.51 seconds to spawn the instance on the hypervisor.
Nov 17 01:20:21 user nova-compute[75226]: DEBUG nova.compute.manager [None req-4d32ff64-444c-4f86-999c-55124dcb793f tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 6b7e9611-be35-4e51-b886-91a2fac0a653] Checking state {{(pid=75226) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 01:20:21 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e643be78-8a3d-4b7a-a3d1-9a46e2884b98 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/094ccd9a-bf3e-49d2-be76-34e2ce2b19e3/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:20:21 user nova-compute[75226]: DEBUG nova.virt.disk.api [None req-e643be78-8a3d-4b7a-a3d1-9a46e2884b98 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Cannot resize image /opt/stack/data/nova/instances/094ccd9a-bf3e-49d2-be76-34e2ce2b19e3/disk to a smaller size. {{(pid=75226) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 17 01:20:21 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-e643be78-8a3d-4b7a-a3d1-9a46e2884b98 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] [instance: 094ccd9a-bf3e-49d2-be76-34e2ce2b19e3] Created local disks {{(pid=75226) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 17 01:20:21 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-e643be78-8a3d-4b7a-a3d1-9a46e2884b98 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] [instance: 094ccd9a-bf3e-49d2-be76-34e2ce2b19e3] Ensure instance console log exists: /opt/stack/data/nova/instances/094ccd9a-bf3e-49d2-be76-34e2ce2b19e3/console.log {{(pid=75226) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 17 01:20:21 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e643be78-8a3d-4b7a-a3d1-9a46e2884b98 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:20:21 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e643be78-8a3d-4b7a-a3d1-9a46e2884b98 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:20:21 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e643be78-8a3d-4b7a-a3d1-9a46e2884b98 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:20:21 user nova-compute[75226]: INFO nova.compute.manager [None req-4d32ff64-444c-4f86-999c-55124dcb793f tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 6b7e9611-be35-4e51-b886-91a2fac0a653] Took 17.94 seconds to build instance.
Nov 17 01:20:21 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-4d32ff64-444c-4f86-999c-55124dcb793f tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Lock "6b7e9611-be35-4e51-b886-91a2fac0a653" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.059s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:20:21 user nova-compute[75226]: DEBUG nova.network.neutron [None req-e643be78-8a3d-4b7a-a3d1-9a46e2884b98 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] [instance: 094ccd9a-bf3e-49d2-be76-34e2ce2b19e3] Successfully updated port: 2ec14695-ebb4-4854-a2d9-6f9160f5adfc {{(pid=75226) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 17 01:20:21 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e643be78-8a3d-4b7a-a3d1-9a46e2884b98 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Acquiring lock "refresh_cache-094ccd9a-bf3e-49d2-be76-34e2ce2b19e3" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:20:21 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e643be78-8a3d-4b7a-a3d1-9a46e2884b98 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Acquired lock "refresh_cache-094ccd9a-bf3e-49d2-be76-34e2ce2b19e3" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:20:21 user nova-compute[75226]: DEBUG nova.network.neutron [None req-e643be78-8a3d-4b7a-a3d1-9a46e2884b98 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] [instance: 094ccd9a-bf3e-49d2-be76-34e2ce2b19e3] Building network info cache for instance {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 01:20:21 user nova-compute[75226]: DEBUG nova.compute.manager [req-606704e9-287c-462e-b2fc-12ddec90d1a3 req-f28352b1-9bbe-4400-a5ee-f167a8637902 service nova] [instance: 094ccd9a-bf3e-49d2-be76-34e2ce2b19e3] Received event network-changed-2ec14695-ebb4-4854-a2d9-6f9160f5adfc {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:20:21 user nova-compute[75226]: DEBUG nova.compute.manager [req-606704e9-287c-462e-b2fc-12ddec90d1a3 req-f28352b1-9bbe-4400-a5ee-f167a8637902 service nova] [instance: 094ccd9a-bf3e-49d2-be76-34e2ce2b19e3] Refreshing instance network info cache due to event network-changed-2ec14695-ebb4-4854-a2d9-6f9160f5adfc. {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 01:20:21 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-606704e9-287c-462e-b2fc-12ddec90d1a3 req-f28352b1-9bbe-4400-a5ee-f167a8637902 service nova] Acquiring lock "refresh_cache-094ccd9a-bf3e-49d2-be76-34e2ce2b19e3" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:20:21 user nova-compute[75226]: DEBUG nova.network.neutron [None req-e643be78-8a3d-4b7a-a3d1-9a46e2884b98 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] [instance: 094ccd9a-bf3e-49d2-be76-34e2ce2b19e3] Instance cache missing network info. {{(pid=75226) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 17 01:20:22 user nova-compute[75226]: DEBUG nova.network.neutron [None req-e643be78-8a3d-4b7a-a3d1-9a46e2884b98 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] [instance: 094ccd9a-bf3e-49d2-be76-34e2ce2b19e3] Updating instance_info_cache with network_info: [{"id": "2ec14695-ebb4-4854-a2d9-6f9160f5adfc", "address": "fa:16:3e:b4:0c:cf", "network": {"id": "1c1e8b70-ab07-4bf6-896b-f8779c33ac07", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1634201097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a364d502d8948ff8b255dd2531b6218", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ec14695-eb", "ovs_interfaceid": "2ec14695-ebb4-4854-a2d9-6f9160f5adfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:20:22 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e643be78-8a3d-4b7a-a3d1-9a46e2884b98 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Releasing lock "refresh_cache-094ccd9a-bf3e-49d2-be76-34e2ce2b19e3" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:20:22 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e643be78-8a3d-4b7a-a3d1-9a46e2884b98 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] [instance: 094ccd9a-bf3e-49d2-be76-34e2ce2b19e3] Instance network_info: |[{"id": "2ec14695-ebb4-4854-a2d9-6f9160f5adfc", "address": "fa:16:3e:b4:0c:cf", "network": {"id": "1c1e8b70-ab07-4bf6-896b-f8779c33ac07", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1634201097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a364d502d8948ff8b255dd2531b6218", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ec14695-eb", "ovs_interfaceid": "2ec14695-ebb4-4854-a2d9-6f9160f5adfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75226) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 17 01:20:22 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-606704e9-287c-462e-b2fc-12ddec90d1a3 req-f28352b1-9bbe-4400-a5ee-f167a8637902 service nova] Acquired lock "refresh_cache-094ccd9a-bf3e-49d2-be76-34e2ce2b19e3" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:20:22 user nova-compute[75226]: DEBUG nova.network.neutron [req-606704e9-287c-462e-b2fc-12ddec90d1a3 req-f28352b1-9bbe-4400-a5ee-f167a8637902 service nova] [instance: 094ccd9a-bf3e-49d2-be76-34e2ce2b19e3] Refreshing network info cache for port 2ec14695-ebb4-4854-a2d9-6f9160f5adfc {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 01:20:22 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-e643be78-8a3d-4b7a-a3d1-9a46e2884b98 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] [instance: 094ccd9a-bf3e-49d2-be76-34e2ce2b19e3] Start _get_guest_xml network_info=[{"id": "2ec14695-ebb4-4854-a2d9-6f9160f5adfc", "address": "fa:16:3e:b4:0c:cf", "network": {"id": "1c1e8b70-ab07-4bf6-896b-f8779c33ac07", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1634201097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a364d502d8948ff8b255dd2531b6218", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ec14695-eb", "ovs_interfaceid": "2ec14695-ebb4-4854-a2d9-6f9160f5adfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T01:13:22Z,direct_url=<?>,disk_format='qcow2',id=0b369aea-6f3f-4690-9f01-229b90ab6310,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4e110cbf9a84362a6864a7732c435a1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T01:13:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '0b369aea-6f3f-4690-9f01-229b90ab6310'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75226) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 17 01:20:22 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-e643be78-8a3d-4b7a-a3d1-9a46e2884b98 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:20:22 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-e643be78-8a3d-4b7a-a3d1-9a46e2884b98 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:20:22 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-e643be78-8a3d-4b7a-a3d1-9a46e2884b98 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75226) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 17 01:20:22 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-e643be78-8a3d-4b7a-a3d1-9a46e2884b98 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] CPU controller missing on host. {{(pid=75226) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 17 01:20:22 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-e643be78-8a3d-4b7a-a3d1-9a46e2884b98 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75226) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 17 01:20:22 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-e643be78-8a3d-4b7a-a3d1-9a46e2884b98 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] CPU controller found on host. {{(pid=75226) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 17 01:20:22 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-e643be78-8a3d-4b7a-a3d1-9a46e2884b98 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75226) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 17 01:20:22 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-e643be78-8a3d-4b7a-a3d1-9a46e2884b98 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-17T01:13:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T01:13:22Z,direct_url=<?>,disk_format='qcow2',id=0b369aea-6f3f-4690-9f01-229b90ab6310,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4e110cbf9a84362a6864a7732c435a1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T01:13:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 17 01:20:22 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-e643be78-8a3d-4b7a-a3d1-9a46e2884b98 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Flavor limits 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 17 01:20:22 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-e643be78-8a3d-4b7a-a3d1-9a46e2884b98 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Image limits 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 17 01:20:22 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-e643be78-8a3d-4b7a-a3d1-9a46e2884b98 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Flavor pref 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 17 01:20:22 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-e643be78-8a3d-4b7a-a3d1-9a46e2884b98 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Image pref 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 17 01:20:22 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-e643be78-8a3d-4b7a-a3d1-9a46e2884b98 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 17 01:20:22 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-e643be78-8a3d-4b7a-a3d1-9a46e2884b98 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 17 01:20:22 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-e643be78-8a3d-4b7a-a3d1-9a46e2884b98 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75226) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 17 01:20:22 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-e643be78-8a3d-4b7a-a3d1-9a46e2884b98 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Got 1 possible topologies {{(pid=75226) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 17 01:20:22 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-e643be78-8a3d-4b7a-a3d1-9a46e2884b98 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 17 01:20:22 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-e643be78-8a3d-4b7a-a3d1-9a46e2884b98 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 17 01:20:22 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-e643be78-8a3d-4b7a-a3d1-9a46e2884b98 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:20:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1278666806',display_name='tempest-VolumesAdminNegativeTest-server-1278666806',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1278666806',id=12,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8a364d502d8948ff8b255dd2531b6218',ramdisk_id='',reservation_id='r-jzm0k0y1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-2120834708',owner_user_name='tempest-VolumesAdminNegativeTest-2120834708-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T01:20:21Z,user_data=None,user_id='5f6fd5dfdd9a4a36b6965ffab1b7c1e4',uuid=094ccd9a-bf3e-49d2-be76-34e2ce2b19e3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2ec14695-ebb4-4854-a2d9-6f9160f5adfc", "address": "fa:16:3e:b4:0c:cf", "network": {"id": "1c1e8b70-ab07-4bf6-896b-f8779c33ac07", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1634201097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a364d502d8948ff8b255dd2531b6218", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ec14695-eb", "ovs_interfaceid": "2ec14695-ebb4-4854-a2d9-6f9160f5adfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75226) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 01:20:22 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-e643be78-8a3d-4b7a-a3d1-9a46e2884b98 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Converting VIF {"id": "2ec14695-ebb4-4854-a2d9-6f9160f5adfc", "address": "fa:16:3e:b4:0c:cf", "network": {"id": "1c1e8b70-ab07-4bf6-896b-f8779c33ac07", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1634201097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a364d502d8948ff8b255dd2531b6218", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ec14695-eb", "ovs_interfaceid": "2ec14695-ebb4-4854-a2d9-6f9160f5adfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:20:22 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-e643be78-8a3d-4b7a-a3d1-9a46e2884b98 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:0c:cf,bridge_name='br-int',has_traffic_filtering=True,id=2ec14695-ebb4-4854-a2d9-6f9160f5adfc,network=Network(1c1e8b70-ab07-4bf6-896b-f8779c33ac07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ec14695-eb') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:20:22 user nova-compute[75226]: DEBUG nova.objects.instance [None req-e643be78-8a3d-4b7a-a3d1-9a46e2884b98 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Lazy-loading 'pci_devices' on Instance uuid 094ccd9a-bf3e-49d2-be76-34e2ce2b19e3 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:20:22 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-e643be78-8a3d-4b7a-a3d1-9a46e2884b98 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] [instance: 094ccd9a-bf3e-49d2-be76-34e2ce2b19e3] End _get_guest_xml xml=<domain type="kvm">
Nov 17 01:20:22 user nova-compute[75226]:   <uuid>094ccd9a-bf3e-49d2-be76-34e2ce2b19e3</uuid>
Nov 17 01:20:22 user nova-compute[75226]:   <name>instance-0000000c</name>
Nov 17 01:20:22 user nova-compute[75226]:   <memory>524288</memory>
Nov 17 01:20:22 user nova-compute[75226]:   <vcpu>1</vcpu>
Nov 17 01:20:22 user nova-compute[75226]:   <metadata>
Nov 17 01:20:22 user nova-compute[75226]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 17 01:20:22 user nova-compute[75226]:       <nova:package version="0.0.0"/>
Nov 17 01:20:22 user nova-compute[75226]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1278666806</nova:name>
Nov 17 01:20:22 user nova-compute[75226]:       <nova:creationTime>2023-11-17 01:20:22</nova:creationTime>
Nov 17 01:20:22 user nova-compute[75226]:       <nova:flavor name="m1.tiny">
Nov 17 01:20:22 user nova-compute[75226]:         <nova:memory>512</nova:memory>
Nov 17 01:20:22 user nova-compute[75226]:         <nova:disk>1</nova:disk>
Nov 17 01:20:22 user nova-compute[75226]:         <nova:swap>0</nova:swap>
Nov 17 01:20:22 user nova-compute[75226]:         <nova:ephemeral>0</nova:ephemeral>
Nov 17 01:20:22 user nova-compute[75226]:         <nova:vcpus>1</nova:vcpus>
Nov 17 01:20:22 user nova-compute[75226]:       </nova:flavor>
Nov 17 01:20:22 user nova-compute[75226]:       <nova:owner>
Nov 17 01:20:22 user nova-compute[75226]:         <nova:user uuid="5f6fd5dfdd9a4a36b6965ffab1b7c1e4">tempest-VolumesAdminNegativeTest-2120834708-project-member</nova:user>
Nov 17 01:20:22 user nova-compute[75226]:         <nova:project uuid="8a364d502d8948ff8b255dd2531b6218">tempest-VolumesAdminNegativeTest-2120834708</nova:project>
Nov 17 01:20:22 user nova-compute[75226]:       </nova:owner>
Nov 17 01:20:22 user nova-compute[75226]:       <nova:root type="image" uuid="0b369aea-6f3f-4690-9f01-229b90ab6310"/>
Nov 17 01:20:22 user nova-compute[75226]:       <nova:ports>
Nov 17 01:20:22 user nova-compute[75226]:         <nova:port uuid="2ec14695-ebb4-4854-a2d9-6f9160f5adfc">
Nov 17 01:20:22 user nova-compute[75226]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 17 01:20:22 user nova-compute[75226]:         </nova:port>
Nov 17 01:20:22 user nova-compute[75226]:       </nova:ports>
Nov 17 01:20:22 user nova-compute[75226]:     </nova:instance>
Nov 17 01:20:22 user nova-compute[75226]:   </metadata>
Nov 17 01:20:22 user nova-compute[75226]:   <sysinfo type="smbios">
Nov 17 01:20:22 user nova-compute[75226]:     <system>
Nov 17 01:20:22 user nova-compute[75226]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 17 01:20:22 user nova-compute[75226]:       <entry name="product">OpenStack Nova</entry>
Nov 17 01:20:22 user nova-compute[75226]:       <entry name="version">0.0.0</entry>
Nov 17 01:20:22 user nova-compute[75226]:       <entry name="serial">094ccd9a-bf3e-49d2-be76-34e2ce2b19e3</entry>
Nov 17 01:20:22 user nova-compute[75226]:       <entry name="uuid">094ccd9a-bf3e-49d2-be76-34e2ce2b19e3</entry>
Nov 17 01:20:22 user nova-compute[75226]:       <entry name="family">Virtual Machine</entry>
Nov 17 01:20:22 user nova-compute[75226]:     </system>
Nov 17 01:20:22 user nova-compute[75226]:   </sysinfo>
Nov 17 01:20:22 user nova-compute[75226]:   <os>
Nov 17 01:20:22 user nova-compute[75226]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 17 01:20:22 user nova-compute[75226]:     <boot dev="hd"/>
Nov 17 01:20:22 user nova-compute[75226]:     <smbios mode="sysinfo"/>
Nov 17 01:20:22 user nova-compute[75226]:   </os>
Nov 17 01:20:22 user nova-compute[75226]:   <features>
Nov 17 01:20:22 user nova-compute[75226]:     <acpi/>
Nov 17 01:20:22 user nova-compute[75226]:     <apic/>
Nov 17 01:20:22 user nova-compute[75226]:     <vmcoreinfo/>
Nov 17 01:20:22 user nova-compute[75226]:   </features>
Nov 17 01:20:22 user nova-compute[75226]:   <clock offset="utc">
Nov 17 01:20:22 user nova-compute[75226]:     <timer name="pit" tickpolicy="delay"/>
Nov 17 01:20:22 user nova-compute[75226]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 17 01:20:22 user nova-compute[75226]:     <timer name="hpet" present="no"/>
Nov 17 01:20:22 user nova-compute[75226]:   </clock>
Nov 17 01:20:22 user nova-compute[75226]:   <cpu mode="custom" match="exact">
Nov 17 01:20:22 user nova-compute[75226]:     <model>Nehalem</model>
Nov 17 01:20:22 user nova-compute[75226]:     <topology sockets="1" cores="1" threads="1"/>
Nov 17 01:20:22 user nova-compute[75226]:   </cpu>
Nov 17 01:20:22 user nova-compute[75226]:   <devices>
Nov 17 01:20:22 user nova-compute[75226]:     <disk type="file" device="disk">
Nov 17 01:20:22 user nova-compute[75226]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 17 01:20:22 user nova-compute[75226]:       <source file="/opt/stack/data/nova/instances/094ccd9a-bf3e-49d2-be76-34e2ce2b19e3/disk"/>
Nov 17 01:20:22 user nova-compute[75226]:       <target dev="vda" bus="virtio"/>
Nov 17 01:20:22 user nova-compute[75226]:     </disk>
Nov 17 01:20:22 user nova-compute[75226]:     <interface type="ethernet">
Nov 17 01:20:22 user nova-compute[75226]:       <mac address="fa:16:3e:b4:0c:cf"/>
Nov 17 01:20:22 user nova-compute[75226]:       <model type="virtio"/>
Nov 17 01:20:22 user nova-compute[75226]:       <mtu size="1442"/>
Nov 17 01:20:22 user nova-compute[75226]:       <target dev="tap2ec14695-eb"/>
Nov 17 01:20:22 user nova-compute[75226]:     </interface>
Nov 17 01:20:22 user nova-compute[75226]:     <serial type="pty">
Nov 17 01:20:22 user nova-compute[75226]:       <log file="/opt/stack/data/nova/instances/094ccd9a-bf3e-49d2-be76-34e2ce2b19e3/console.log" append="off"/>
Nov 17 01:20:22 user nova-compute[75226]:     </serial>
Nov 17 01:20:22 user nova-compute[75226]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 17 01:20:22 user nova-compute[75226]:     <video>
Nov 17 01:20:22 user nova-compute[75226]:       <model type="virtio"/>
Nov 17 01:20:22 user nova-compute[75226]:     </video>
Nov 17 01:20:22 user nova-compute[75226]:     <rng model="virtio">
Nov 17 01:20:22 user nova-compute[75226]:       <backend model="random">/dev/urandom</backend>
Nov 17 01:20:22 user nova-compute[75226]:     </rng>
Nov 17 01:20:22 user nova-compute[75226]:     <controller type="usb" index="0" model="none"/>
Nov 17 01:20:22 user nova-compute[75226]:     <memballoon model="virtio">
Nov 17 01:20:22 user nova-compute[75226]:       <stats period="10"/>
Nov 17 01:20:22 user nova-compute[75226]:     </memballoon>
Nov 17 01:20:22 user nova-compute[75226]:   </devices>
Nov 17 01:20:22 user nova-compute[75226]: </domain>
Nov 17 01:20:22 user nova-compute[75226]:  {{(pid=75226) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 17 01:20:22 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-e643be78-8a3d-4b7a-a3d1-9a46e2884b98 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:20:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1278666806',display_name='tempest-VolumesAdminNegativeTest-server-1278666806',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1278666806',id=12,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8a364d502d8948ff8b255dd2531b6218',ramdisk_id='',reservation_id='r-jzm0k0y1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-2120834708',owner_user_name='tempest-VolumesAdminNegativeTest-2120834708-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T01:20:21Z,user_data=None,user_id='5f6fd5dfdd9a4a36b6965ffab1b7c1e4',uuid=094ccd9a-bf3e-49d2-be76-34e2ce2b19e3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2ec14695-ebb4-4854-a2d9-6f9160f5adfc", "address": "fa:16:3e:b4:0c:cf", "network": {"id": "1c1e8b70-ab07-4bf6-896b-f8779c33ac07", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1634201097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a364d502d8948ff8b255dd2531b6218", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ec14695-eb", "ovs_interfaceid": "2ec14695-ebb4-4854-a2d9-6f9160f5adfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 17 01:20:22 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-e643be78-8a3d-4b7a-a3d1-9a46e2884b98 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Converting VIF {"id": "2ec14695-ebb4-4854-a2d9-6f9160f5adfc", "address": "fa:16:3e:b4:0c:cf", "network": {"id": "1c1e8b70-ab07-4bf6-896b-f8779c33ac07", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1634201097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a364d502d8948ff8b255dd2531b6218", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ec14695-eb", "ovs_interfaceid": "2ec14695-ebb4-4854-a2d9-6f9160f5adfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:20:22 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-e643be78-8a3d-4b7a-a3d1-9a46e2884b98 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:0c:cf,bridge_name='br-int',has_traffic_filtering=True,id=2ec14695-ebb4-4854-a2d9-6f9160f5adfc,network=Network(1c1e8b70-ab07-4bf6-896b-f8779c33ac07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ec14695-eb') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:20:22 user nova-compute[75226]: DEBUG os_vif [None req-e643be78-8a3d-4b7a-a3d1-9a46e2884b98 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:0c:cf,bridge_name='br-int',has_traffic_filtering=True,id=2ec14695-ebb4-4854-a2d9-6f9160f5adfc,network=Network(1c1e8b70-ab07-4bf6-896b-f8779c33ac07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ec14695-eb') {{(pid=75226) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 17 01:20:22 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:20:22 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:20:22 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 17 01:20:22 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:20:22 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c3b2011e-e20b-5e91-a5e8-737854499cf4', '_type': 'linux-noop'}}, row=False) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:20:22 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:20:22 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:20:22 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:20:22 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2ec14695-eb, may_exist=True, interface_attrs={}) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:20:22 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2ec14695-eb, col_values=(('qos', UUID('2c71768f-fc73-4f26-91db-026ed8334bef')),), if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:20:22 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2ec14695-eb, col_values=(('external_ids', {'iface-id': '2ec14695-ebb4-4854-a2d9-6f9160f5adfc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b4:0c:cf', 'vm-uuid': '094ccd9a-bf3e-49d2-be76-34e2ce2b19e3'}),), if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:20:22 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:20:22 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:20:22 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:20:22 user nova-compute[75226]: INFO os_vif [None req-e643be78-8a3d-4b7a-a3d1-9a46e2884b98 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:0c:cf,bridge_name='br-int',has_traffic_filtering=True,id=2ec14695-ebb4-4854-a2d9-6f9160f5adfc,network=Network(1c1e8b70-ab07-4bf6-896b-f8779c33ac07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ec14695-eb')
Nov 17 01:20:22 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-e643be78-8a3d-4b7a-a3d1-9a46e2884b98 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] No BDM found with device name vda, not building metadata. {{(pid=75226) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 01:20:22 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-e643be78-8a3d-4b7a-a3d1-9a46e2884b98 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] No VIF found with MAC fa:16:3e:b4:0c:cf, not building metadata {{(pid=75226) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 01:20:22 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:20:22 user nova-compute[75226]: DEBUG nova.network.neutron [req-606704e9-287c-462e-b2fc-12ddec90d1a3 req-f28352b1-9bbe-4400-a5ee-f167a8637902 service nova] [instance: 094ccd9a-bf3e-49d2-be76-34e2ce2b19e3] Updated VIF entry in instance network info cache for port 2ec14695-ebb4-4854-a2d9-6f9160f5adfc. {{(pid=75226) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 01:20:22 user nova-compute[75226]: DEBUG nova.network.neutron [req-606704e9-287c-462e-b2fc-12ddec90d1a3 req-f28352b1-9bbe-4400-a5ee-f167a8637902 service nova] [instance: 094ccd9a-bf3e-49d2-be76-34e2ce2b19e3] Updating instance_info_cache with network_info: [{"id": "2ec14695-ebb4-4854-a2d9-6f9160f5adfc", "address": "fa:16:3e:b4:0c:cf", "network": {"id": "1c1e8b70-ab07-4bf6-896b-f8779c33ac07", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1634201097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a364d502d8948ff8b255dd2531b6218", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ec14695-eb", "ovs_interfaceid": "2ec14695-ebb4-4854-a2d9-6f9160f5adfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:20:22 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-606704e9-287c-462e-b2fc-12ddec90d1a3 req-f28352b1-9bbe-4400-a5ee-f167a8637902 service nova] Releasing lock "refresh_cache-094ccd9a-bf3e-49d2-be76-34e2ce2b19e3" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:20:23 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:20:23 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:20:23 user nova-compute[75226]: DEBUG nova.compute.manager [req-8b377931-47a3-4c74-b82c-db4420979ced req-81f4286c-d794-4993-bc28-1023f496090f service nova] [instance: 094ccd9a-bf3e-49d2-be76-34e2ce2b19e3] Received event network-vif-plugged-2ec14695-ebb4-4854-a2d9-6f9160f5adfc {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:20:23 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-8b377931-47a3-4c74-b82c-db4420979ced req-81f4286c-d794-4993-bc28-1023f496090f service nova] Acquiring lock "094ccd9a-bf3e-49d2-be76-34e2ce2b19e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:20:23 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-8b377931-47a3-4c74-b82c-db4420979ced req-81f4286c-d794-4993-bc28-1023f496090f service nova] Lock "094ccd9a-bf3e-49d2-be76-34e2ce2b19e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:20:23 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-8b377931-47a3-4c74-b82c-db4420979ced req-81f4286c-d794-4993-bc28-1023f496090f service nova] Lock "094ccd9a-bf3e-49d2-be76-34e2ce2b19e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:20:23 user nova-compute[75226]: DEBUG nova.compute.manager [req-8b377931-47a3-4c74-b82c-db4420979ced req-81f4286c-d794-4993-bc28-1023f496090f service nova] [instance: 094ccd9a-bf3e-49d2-be76-34e2ce2b19e3] No waiting events found dispatching network-vif-plugged-2ec14695-ebb4-4854-a2d9-6f9160f5adfc {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:20:23 user nova-compute[75226]: WARNING nova.compute.manager [req-8b377931-47a3-4c74-b82c-db4420979ced req-81f4286c-d794-4993-bc28-1023f496090f service nova] [instance: 094ccd9a-bf3e-49d2-be76-34e2ce2b19e3] Received unexpected event network-vif-plugged-2ec14695-ebb4-4854-a2d9-6f9160f5adfc for instance with vm_state building and task_state spawning.
Nov 17 01:20:23 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:20:23 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:20:25 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e643be78-8a3d-4b7a-a3d1-9a46e2884b98 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] [instance: 094ccd9a-bf3e-49d2-be76-34e2ce2b19e3] Instance event wait completed in 0 seconds for  {{(pid=75226) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 17 01:20:25 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-e643be78-8a3d-4b7a-a3d1-9a46e2884b98 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] [instance: 094ccd9a-bf3e-49d2-be76-34e2ce2b19e3] Guest created on hypervisor {{(pid=75226) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 17 01:20:25 user nova-compute[75226]: INFO nova.virt.libvirt.driver [-] [instance: 094ccd9a-bf3e-49d2-be76-34e2ce2b19e3] Instance spawned successfully.
Nov 17 01:20:25 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-e643be78-8a3d-4b7a-a3d1-9a46e2884b98 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] [instance: 094ccd9a-bf3e-49d2-be76-34e2ce2b19e3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 17 01:20:25 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-e643be78-8a3d-4b7a-a3d1-9a46e2884b98 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] [instance: 094ccd9a-bf3e-49d2-be76-34e2ce2b19e3] Found default for hw_cdrom_bus of ide {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:20:25 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-e643be78-8a3d-4b7a-a3d1-9a46e2884b98 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] [instance: 094ccd9a-bf3e-49d2-be76-34e2ce2b19e3] Found default for hw_disk_bus of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:20:25 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-e643be78-8a3d-4b7a-a3d1-9a46e2884b98 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] [instance: 094ccd9a-bf3e-49d2-be76-34e2ce2b19e3] Found default for hw_input_bus of None {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:20:25 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-e643be78-8a3d-4b7a-a3d1-9a46e2884b98 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] [instance: 094ccd9a-bf3e-49d2-be76-34e2ce2b19e3] Found default for hw_pointer_model of None {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:20:25 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-e643be78-8a3d-4b7a-a3d1-9a46e2884b98 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] [instance: 094ccd9a-bf3e-49d2-be76-34e2ce2b19e3] Found default for hw_video_model of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:20:25 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-e643be78-8a3d-4b7a-a3d1-9a46e2884b98 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] [instance: 094ccd9a-bf3e-49d2-be76-34e2ce2b19e3] Found default for hw_vif_model of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:20:25 user nova-compute[75226]: DEBUG nova.compute.manager [req-8bccac1f-3e63-4e8f-b434-b37301c387fd req-61cb98b7-4b4b-470a-903c-574939a53f5b service nova] [instance: 094ccd9a-bf3e-49d2-be76-34e2ce2b19e3] Received event network-vif-plugged-2ec14695-ebb4-4854-a2d9-6f9160f5adfc {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:20:25 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-8bccac1f-3e63-4e8f-b434-b37301c387fd req-61cb98b7-4b4b-470a-903c-574939a53f5b service nova] Acquiring lock "094ccd9a-bf3e-49d2-be76-34e2ce2b19e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:20:25 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-8bccac1f-3e63-4e8f-b434-b37301c387fd req-61cb98b7-4b4b-470a-903c-574939a53f5b service nova] Lock "094ccd9a-bf3e-49d2-be76-34e2ce2b19e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:20:25 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-8bccac1f-3e63-4e8f-b434-b37301c387fd req-61cb98b7-4b4b-470a-903c-574939a53f5b service nova] Lock "094ccd9a-bf3e-49d2-be76-34e2ce2b19e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:20:25 user nova-compute[75226]: DEBUG nova.compute.manager [req-8bccac1f-3e63-4e8f-b434-b37301c387fd req-61cb98b7-4b4b-470a-903c-574939a53f5b service nova] [instance: 094ccd9a-bf3e-49d2-be76-34e2ce2b19e3] No waiting events found dispatching network-vif-plugged-2ec14695-ebb4-4854-a2d9-6f9160f5adfc {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:20:25 user nova-compute[75226]: WARNING nova.compute.manager [req-8bccac1f-3e63-4e8f-b434-b37301c387fd req-61cb98b7-4b4b-470a-903c-574939a53f5b service nova] [instance: 094ccd9a-bf3e-49d2-be76-34e2ce2b19e3] Received unexpected event network-vif-plugged-2ec14695-ebb4-4854-a2d9-6f9160f5adfc for instance with vm_state building and task_state spawning.
Nov 17 01:20:25 user nova-compute[75226]: INFO nova.compute.manager [None req-e643be78-8a3d-4b7a-a3d1-9a46e2884b98 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] [instance: 094ccd9a-bf3e-49d2-be76-34e2ce2b19e3] Took 5.15 seconds to spawn the instance on the hypervisor.
Nov 17 01:20:25 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e643be78-8a3d-4b7a-a3d1-9a46e2884b98 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] [instance: 094ccd9a-bf3e-49d2-be76-34e2ce2b19e3] Checking state {{(pid=75226) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 01:20:25 user nova-compute[75226]: INFO nova.compute.manager [None req-e643be78-8a3d-4b7a-a3d1-9a46e2884b98 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] [instance: 094ccd9a-bf3e-49d2-be76-34e2ce2b19e3] Took 5.94 seconds to build instance.
Nov 17 01:20:25 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e643be78-8a3d-4b7a-a3d1-9a46e2884b98 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Lock "094ccd9a-bf3e-49d2-be76-34e2ce2b19e3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.035s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:20:27 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:20:27 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:20:32 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:20:32 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:20:34 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-80e31163-8923-4f5c-9a95-ea060179f8f0 tempest-VolumesAssistedSnapshotsTest-244184502 tempest-VolumesAssistedSnapshotsTest-244184502-project-member] Acquiring lock "1c505f8d-09e0-41bc-ba3a-89bde1646613" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:20:34 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-80e31163-8923-4f5c-9a95-ea060179f8f0 tempest-VolumesAssistedSnapshotsTest-244184502 tempest-VolumesAssistedSnapshotsTest-244184502-project-member] Lock "1c505f8d-09e0-41bc-ba3a-89bde1646613" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:20:34 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-80e31163-8923-4f5c-9a95-ea060179f8f0 tempest-VolumesAssistedSnapshotsTest-244184502 tempest-VolumesAssistedSnapshotsTest-244184502-project-member] Acquiring lock "1c505f8d-09e0-41bc-ba3a-89bde1646613-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:20:34 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-80e31163-8923-4f5c-9a95-ea060179f8f0 tempest-VolumesAssistedSnapshotsTest-244184502 tempest-VolumesAssistedSnapshotsTest-244184502-project-member] Lock "1c505f8d-09e0-41bc-ba3a-89bde1646613-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:20:34 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-80e31163-8923-4f5c-9a95-ea060179f8f0 tempest-VolumesAssistedSnapshotsTest-244184502 tempest-VolumesAssistedSnapshotsTest-244184502-project-member] Lock "1c505f8d-09e0-41bc-ba3a-89bde1646613-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:20:34 user nova-compute[75226]: INFO nova.compute.manager [None req-80e31163-8923-4f5c-9a95-ea060179f8f0 tempest-VolumesAssistedSnapshotsTest-244184502 tempest-VolumesAssistedSnapshotsTest-244184502-project-member] [instance: 1c505f8d-09e0-41bc-ba3a-89bde1646613] Terminating instance
Nov 17 01:20:34 user nova-compute[75226]: DEBUG nova.compute.manager [None req-80e31163-8923-4f5c-9a95-ea060179f8f0 tempest-VolumesAssistedSnapshotsTest-244184502 tempest-VolumesAssistedSnapshotsTest-244184502-project-member] [instance: 1c505f8d-09e0-41bc-ba3a-89bde1646613] Start destroying the instance on the hypervisor. {{(pid=75226) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 17 01:20:34 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:20:34 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:20:34 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:20:34 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:20:35 user nova-compute[75226]: DEBUG nova.compute.manager [req-e685407b-03bc-4c5b-a71d-986d429db9d9 req-05cdeac9-79a9-4105-a0d4-91be06b34262 service nova] [instance: 1c505f8d-09e0-41bc-ba3a-89bde1646613] Received event network-vif-unplugged-6c56f715-bdcb-4a40-b922-3081a6457c31 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:20:35 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-e685407b-03bc-4c5b-a71d-986d429db9d9 req-05cdeac9-79a9-4105-a0d4-91be06b34262 service nova] Acquiring lock "1c505f8d-09e0-41bc-ba3a-89bde1646613-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:20:35 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-e685407b-03bc-4c5b-a71d-986d429db9d9 req-05cdeac9-79a9-4105-a0d4-91be06b34262 service nova] Lock "1c505f8d-09e0-41bc-ba3a-89bde1646613-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:20:35 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-e685407b-03bc-4c5b-a71d-986d429db9d9 req-05cdeac9-79a9-4105-a0d4-91be06b34262 service nova] Lock "1c505f8d-09e0-41bc-ba3a-89bde1646613-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:20:35 user nova-compute[75226]: DEBUG nova.compute.manager [req-e685407b-03bc-4c5b-a71d-986d429db9d9 req-05cdeac9-79a9-4105-a0d4-91be06b34262 service nova] [instance: 1c505f8d-09e0-41bc-ba3a-89bde1646613] No waiting events found dispatching network-vif-unplugged-6c56f715-bdcb-4a40-b922-3081a6457c31 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:20:35 user nova-compute[75226]: DEBUG nova.compute.manager [req-e685407b-03bc-4c5b-a71d-986d429db9d9 req-05cdeac9-79a9-4105-a0d4-91be06b34262 service nova] [instance: 1c505f8d-09e0-41bc-ba3a-89bde1646613] Received event network-vif-unplugged-6c56f715-bdcb-4a40-b922-3081a6457c31 for instance with task_state deleting. {{(pid=75226) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 17 01:20:35 user nova-compute[75226]: INFO nova.virt.libvirt.driver [-] [instance: 1c505f8d-09e0-41bc-ba3a-89bde1646613] Instance destroyed successfully.
Nov 17 01:20:35 user nova-compute[75226]: DEBUG nova.objects.instance [None req-80e31163-8923-4f5c-9a95-ea060179f8f0 tempest-VolumesAssistedSnapshotsTest-244184502 tempest-VolumesAssistedSnapshotsTest-244184502-project-member] Lazy-loading 'resources' on Instance uuid 1c505f8d-09e0-41bc-ba3a-89bde1646613 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:20:35 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-80e31163-8923-4f5c-9a95-ea060179f8f0 tempest-VolumesAssistedSnapshotsTest-244184502 tempest-VolumesAssistedSnapshotsTest-244184502-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:17:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-570930396',display_name='tempest-VolumesAssistedSnapshotsTest-server-570930396',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-570930396',id=8,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJlfqV6RKTcGPsTVJ/7zZdekCYJssU5KvEtDm7p/yfUDtE3w49cLW1kEDdi+lHiyKVwB4aKUI8Mr44DzIxpjzLd8+iuQMcBuHn67m90G/oq+hLDEoNSv0U7784Ke8OOWlQ==',key_name='tempest-keypair-36891835',keypairs=<?>,launch_index=0,launched_at=2023-11-17T01:17:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a26a1467375947e9b71d9a2c61127e2b',ramdisk_id='',reservation_id='r-ghx0jkmy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-244184502',owner_user_name='tempest-VolumesAssistedSnapshotsTest-244184502-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T01:17:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='95cb1198a0c24bc6acf389d90595ab5a',uuid=1c505f8d-09e0-41bc-ba3a-89bde1646613,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6c56f715-bdcb-4a40-b922-3081a6457c31", "address": "fa:16:3e:63:16:60", "network": {"id": "d3de5b6b-3c29-4aeb-b4ec-59dca1237cb5", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1649442166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a26a1467375947e9b71d9a2c61127e2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c56f715-bd", "ovs_interfaceid": "6c56f715-bdcb-4a40-b922-3081a6457c31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 17 01:20:35 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-80e31163-8923-4f5c-9a95-ea060179f8f0 tempest-VolumesAssistedSnapshotsTest-244184502 tempest-VolumesAssistedSnapshotsTest-244184502-project-member] Converting VIF {"id": "6c56f715-bdcb-4a40-b922-3081a6457c31", "address": "fa:16:3e:63:16:60", "network": {"id": "d3de5b6b-3c29-4aeb-b4ec-59dca1237cb5", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1649442166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a26a1467375947e9b71d9a2c61127e2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c56f715-bd", "ovs_interfaceid": "6c56f715-bdcb-4a40-b922-3081a6457c31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:20:35 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-80e31163-8923-4f5c-9a95-ea060179f8f0 tempest-VolumesAssistedSnapshotsTest-244184502 tempest-VolumesAssistedSnapshotsTest-244184502-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:63:16:60,bridge_name='br-int',has_traffic_filtering=True,id=6c56f715-bdcb-4a40-b922-3081a6457c31,network=Network(d3de5b6b-3c29-4aeb-b4ec-59dca1237cb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c56f715-bd') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:20:35 user nova-compute[75226]: DEBUG os_vif [None req-80e31163-8923-4f5c-9a95-ea060179f8f0 tempest-VolumesAssistedSnapshotsTest-244184502 tempest-VolumesAssistedSnapshotsTest-244184502-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:63:16:60,bridge_name='br-int',has_traffic_filtering=True,id=6c56f715-bdcb-4a40-b922-3081a6457c31,network=Network(d3de5b6b-3c29-4aeb-b4ec-59dca1237cb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c56f715-bd') {{(pid=75226) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 17 01:20:35 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:20:35 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6c56f715-bd, bridge=br-int, if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:20:35 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:20:35 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:20:35 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:20:35 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=390abc60-c324-4820-aec4-a17a304a6f00) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:20:35 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:20:35 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:20:35 user nova-compute[75226]: INFO os_vif [None req-80e31163-8923-4f5c-9a95-ea060179f8f0 tempest-VolumesAssistedSnapshotsTest-244184502 tempest-VolumesAssistedSnapshotsTest-244184502-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:63:16:60,bridge_name='br-int',has_traffic_filtering=True,id=6c56f715-bdcb-4a40-b922-3081a6457c31,network=Network(d3de5b6b-3c29-4aeb-b4ec-59dca1237cb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c56f715-bd')
Nov 17 01:20:35 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-80e31163-8923-4f5c-9a95-ea060179f8f0 tempest-VolumesAssistedSnapshotsTest-244184502 tempest-VolumesAssistedSnapshotsTest-244184502-project-member] [instance: 1c505f8d-09e0-41bc-ba3a-89bde1646613] Deleting instance files /opt/stack/data/nova/instances/1c505f8d-09e0-41bc-ba3a-89bde1646613_del
Nov 17 01:20:35 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-80e31163-8923-4f5c-9a95-ea060179f8f0 tempest-VolumesAssistedSnapshotsTest-244184502 tempest-VolumesAssistedSnapshotsTest-244184502-project-member] [instance: 1c505f8d-09e0-41bc-ba3a-89bde1646613] Deletion of /opt/stack/data/nova/instances/1c505f8d-09e0-41bc-ba3a-89bde1646613_del complete
Nov 17 01:20:35 user nova-compute[75226]: INFO nova.compute.manager [None req-80e31163-8923-4f5c-9a95-ea060179f8f0 tempest-VolumesAssistedSnapshotsTest-244184502 tempest-VolumesAssistedSnapshotsTest-244184502-project-member] [instance: 1c505f8d-09e0-41bc-ba3a-89bde1646613] Took 0.96 seconds to destroy the instance on the hypervisor.
Nov 17 01:20:35 user nova-compute[75226]: DEBUG oslo.service.loopingcall [None req-80e31163-8923-4f5c-9a95-ea060179f8f0 tempest-VolumesAssistedSnapshotsTest-244184502 tempest-VolumesAssistedSnapshotsTest-244184502-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75226) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 17 01:20:35 user nova-compute[75226]: DEBUG nova.compute.manager [-] [instance: 1c505f8d-09e0-41bc-ba3a-89bde1646613] Deallocating network for instance {{(pid=75226) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 17 01:20:35 user nova-compute[75226]: DEBUG nova.network.neutron [-] [instance: 1c505f8d-09e0-41bc-ba3a-89bde1646613] deallocate_for_instance() {{(pid=75226) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 17 01:20:36 user nova-compute[75226]: DEBUG nova.network.neutron [-] [instance: 1c505f8d-09e0-41bc-ba3a-89bde1646613] Updating instance_info_cache with network_info: [] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:20:36 user nova-compute[75226]: INFO nova.compute.manager [-] [instance: 1c505f8d-09e0-41bc-ba3a-89bde1646613] Took 1.08 seconds to deallocate network for instance.
Nov 17 01:20:36 user nova-compute[75226]: DEBUG nova.compute.manager [req-7bec47ba-6ac6-454b-b660-f4705912daaa req-fa5e16a1-3f37-48ff-afd1-a5aeefc0048b service nova] [instance: 1c505f8d-09e0-41bc-ba3a-89bde1646613] Received event network-vif-deleted-6c56f715-bdcb-4a40-b922-3081a6457c31 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:20:36 user nova-compute[75226]: INFO nova.compute.manager [req-7bec47ba-6ac6-454b-b660-f4705912daaa req-fa5e16a1-3f37-48ff-afd1-a5aeefc0048b service nova] [instance: 1c505f8d-09e0-41bc-ba3a-89bde1646613] Neutron deleted interface 6c56f715-bdcb-4a40-b922-3081a6457c31; detaching it from the instance and deleting it from the info cache
Nov 17 01:20:36 user nova-compute[75226]: DEBUG nova.network.neutron [req-7bec47ba-6ac6-454b-b660-f4705912daaa req-fa5e16a1-3f37-48ff-afd1-a5aeefc0048b service nova] [instance: 1c505f8d-09e0-41bc-ba3a-89bde1646613] Updating instance_info_cache with network_info: [] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:20:36 user nova-compute[75226]: DEBUG nova.compute.manager [req-7bec47ba-6ac6-454b-b660-f4705912daaa req-fa5e16a1-3f37-48ff-afd1-a5aeefc0048b service nova] [instance: 1c505f8d-09e0-41bc-ba3a-89bde1646613] Detach interface failed, port_id=6c56f715-bdcb-4a40-b922-3081a6457c31, reason: Instance 1c505f8d-09e0-41bc-ba3a-89bde1646613 could not be found. {{(pid=75226) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 17 01:20:36 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-80e31163-8923-4f5c-9a95-ea060179f8f0 tempest-VolumesAssistedSnapshotsTest-244184502 tempest-VolumesAssistedSnapshotsTest-244184502-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:20:36 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-80e31163-8923-4f5c-9a95-ea060179f8f0 tempest-VolumesAssistedSnapshotsTest-244184502 tempest-VolumesAssistedSnapshotsTest-244184502-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:20:36 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-80e31163-8923-4f5c-9a95-ea060179f8f0 tempest-VolumesAssistedSnapshotsTest-244184502 tempest-VolumesAssistedSnapshotsTest-244184502-project-member] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:20:37 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-80e31163-8923-4f5c-9a95-ea060179f8f0 tempest-VolumesAssistedSnapshotsTest-244184502 tempest-VolumesAssistedSnapshotsTest-244184502-project-member] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:20:37 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:20:37 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-80e31163-8923-4f5c-9a95-ea060179f8f0 tempest-VolumesAssistedSnapshotsTest-244184502 tempest-VolumesAssistedSnapshotsTest-244184502-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.324s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:20:37 user nova-compute[75226]: INFO nova.scheduler.client.report [None req-80e31163-8923-4f5c-9a95-ea060179f8f0 tempest-VolumesAssistedSnapshotsTest-244184502 tempest-VolumesAssistedSnapshotsTest-244184502-project-member] Deleted allocations for instance 1c505f8d-09e0-41bc-ba3a-89bde1646613
Nov 17 01:20:37 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-80e31163-8923-4f5c-9a95-ea060179f8f0 tempest-VolumesAssistedSnapshotsTest-244184502 tempest-VolumesAssistedSnapshotsTest-244184502-project-member] Lock "1c505f8d-09e0-41bc-ba3a-89bde1646613" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.545s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:20:37 user nova-compute[75226]: DEBUG nova.compute.manager [req-b183029a-1ee4-4db6-bfd4-381c706adbad req-bbab9533-c46d-4a69-8215-634b94c15a3c service nova] [instance: 1c505f8d-09e0-41bc-ba3a-89bde1646613] Received event network-vif-plugged-6c56f715-bdcb-4a40-b922-3081a6457c31 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:20:37 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-b183029a-1ee4-4db6-bfd4-381c706adbad req-bbab9533-c46d-4a69-8215-634b94c15a3c service nova] Acquiring lock "1c505f8d-09e0-41bc-ba3a-89bde1646613-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:20:37 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-b183029a-1ee4-4db6-bfd4-381c706adbad req-bbab9533-c46d-4a69-8215-634b94c15a3c service nova] Lock "1c505f8d-09e0-41bc-ba3a-89bde1646613-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:20:37 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-b183029a-1ee4-4db6-bfd4-381c706adbad req-bbab9533-c46d-4a69-8215-634b94c15a3c service nova] Lock "1c505f8d-09e0-41bc-ba3a-89bde1646613-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:20:37 user nova-compute[75226]: DEBUG nova.compute.manager [req-b183029a-1ee4-4db6-bfd4-381c706adbad req-bbab9533-c46d-4a69-8215-634b94c15a3c service nova] [instance: 1c505f8d-09e0-41bc-ba3a-89bde1646613] No waiting events found dispatching network-vif-plugged-6c56f715-bdcb-4a40-b922-3081a6457c31 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:20:37 user nova-compute[75226]: WARNING nova.compute.manager [req-b183029a-1ee4-4db6-bfd4-381c706adbad req-bbab9533-c46d-4a69-8215-634b94c15a3c service nova] [instance: 1c505f8d-09e0-41bc-ba3a-89bde1646613] Received unexpected event network-vif-plugged-6c56f715-bdcb-4a40-b922-3081a6457c31 for instance with vm_state deleted and task_state None.
Nov 17 01:20:37 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:20:38 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:20:40 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:20:42 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:20:42 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:20:44 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:20:45 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:20:47 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:20:48 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-f900e81b-7ba5-4405-9342-4161914cadd5 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] Acquiring lock "52fe0a91-9320-47d2-ac83-4f49260a0997" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:20:48 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-f900e81b-7ba5-4405-9342-4161914cadd5 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] Lock "52fe0a91-9320-47d2-ac83-4f49260a0997" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:20:48 user nova-compute[75226]: DEBUG nova.compute.manager [None req-f900e81b-7ba5-4405-9342-4161914cadd5 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] [instance: 52fe0a91-9320-47d2-ac83-4f49260a0997] Starting instance... {{(pid=75226) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 17 01:20:48 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-9f7ffa92-e778-4a73-86d7-e79ec514eb3c tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] Acquiring lock "b054a557-dff6-49f8-9300-1307f8433567" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:20:48 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-9f7ffa92-e778-4a73-86d7-e79ec514eb3c tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] Lock "b054a557-dff6-49f8-9300-1307f8433567" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:20:48 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-9f7ffa92-e778-4a73-86d7-e79ec514eb3c tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] Acquiring lock "b054a557-dff6-49f8-9300-1307f8433567-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:20:48 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-9f7ffa92-e778-4a73-86d7-e79ec514eb3c tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] Lock "b054a557-dff6-49f8-9300-1307f8433567-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:20:48 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-9f7ffa92-e778-4a73-86d7-e79ec514eb3c tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] Lock "b054a557-dff6-49f8-9300-1307f8433567-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:20:48 user nova-compute[75226]: INFO nova.compute.manager [None req-9f7ffa92-e778-4a73-86d7-e79ec514eb3c tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] [instance: b054a557-dff6-49f8-9300-1307f8433567] Terminating instance
Nov 17 01:20:48 user nova-compute[75226]: DEBUG nova.compute.manager [None req-9f7ffa92-e778-4a73-86d7-e79ec514eb3c tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] [instance: b054a557-dff6-49f8-9300-1307f8433567] Start destroying the instance on the hypervisor. {{(pid=75226) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 17 01:20:48 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:20:48 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-f900e81b-7ba5-4405-9342-4161914cadd5 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:20:48 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-f900e81b-7ba5-4405-9342-4161914cadd5 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:20:48 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:20:48 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-f900e81b-7ba5-4405-9342-4161914cadd5 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75226) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 17 01:20:48 user nova-compute[75226]: INFO nova.compute.claims [None req-f900e81b-7ba5-4405-9342-4161914cadd5 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] [instance: 52fe0a91-9320-47d2-ac83-4f49260a0997] Claim successful on node user
Nov 17 01:20:48 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:20:48 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:20:48 user nova-compute[75226]: DEBUG nova.compute.manager [req-c3da834c-d615-41af-abcf-4ac29fa23319 req-0c85ef56-fcb2-4e74-a7a5-092b86ec6f63 service nova] [instance: b054a557-dff6-49f8-9300-1307f8433567] Received event network-vif-unplugged-9be521ab-d517-4746-b6b3-1e4930610165 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:20:48 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-c3da834c-d615-41af-abcf-4ac29fa23319 req-0c85ef56-fcb2-4e74-a7a5-092b86ec6f63 service nova] Acquiring lock "b054a557-dff6-49f8-9300-1307f8433567-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:20:48 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-c3da834c-d615-41af-abcf-4ac29fa23319 req-0c85ef56-fcb2-4e74-a7a5-092b86ec6f63 service nova] Lock "b054a557-dff6-49f8-9300-1307f8433567-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:20:48 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-c3da834c-d615-41af-abcf-4ac29fa23319 req-0c85ef56-fcb2-4e74-a7a5-092b86ec6f63 service nova] Lock "b054a557-dff6-49f8-9300-1307f8433567-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:20:48 user nova-compute[75226]: DEBUG nova.compute.manager [req-c3da834c-d615-41af-abcf-4ac29fa23319 req-0c85ef56-fcb2-4e74-a7a5-092b86ec6f63 service nova] [instance: b054a557-dff6-49f8-9300-1307f8433567] No waiting events found dispatching network-vif-unplugged-9be521ab-d517-4746-b6b3-1e4930610165 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:20:48 user nova-compute[75226]: DEBUG nova.compute.manager [req-c3da834c-d615-41af-abcf-4ac29fa23319 req-0c85ef56-fcb2-4e74-a7a5-092b86ec6f63 service nova] [instance: b054a557-dff6-49f8-9300-1307f8433567] Received event network-vif-unplugged-9be521ab-d517-4746-b6b3-1e4930610165 for instance with task_state deleting. {{(pid=75226) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 17 01:20:49 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-f900e81b-7ba5-4405-9342-4161914cadd5 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:20:49 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-646d95f4-3829-431d-a130-0179048be883 tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] Acquiring lock "75b1cabe-ba15-4851-9140-5949afc33005" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:20:49 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-646d95f4-3829-431d-a130-0179048be883 tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] Lock "75b1cabe-ba15-4851-9140-5949afc33005" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:20:49 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-646d95f4-3829-431d-a130-0179048be883 tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] Acquiring lock "75b1cabe-ba15-4851-9140-5949afc33005-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:20:49 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-646d95f4-3829-431d-a130-0179048be883 tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] Lock "75b1cabe-ba15-4851-9140-5949afc33005-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:20:49 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-646d95f4-3829-431d-a130-0179048be883 tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] Lock "75b1cabe-ba15-4851-9140-5949afc33005-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:20:49 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-f900e81b-7ba5-4405-9342-4161914cadd5 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:20:49 user nova-compute[75226]: INFO nova.compute.manager [None req-646d95f4-3829-431d-a130-0179048be883 tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] [instance: 75b1cabe-ba15-4851-9140-5949afc33005] Terminating instance
Nov 17 01:20:49 user nova-compute[75226]: DEBUG nova.compute.manager [None req-646d95f4-3829-431d-a130-0179048be883 tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] [instance: 75b1cabe-ba15-4851-9140-5949afc33005] Start destroying the instance on the hypervisor. {{(pid=75226) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 17 01:20:49 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-f900e81b-7ba5-4405-9342-4161914cadd5 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.487s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:20:49 user nova-compute[75226]: DEBUG nova.compute.manager [None req-f900e81b-7ba5-4405-9342-4161914cadd5 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] [instance: 52fe0a91-9320-47d2-ac83-4f49260a0997] Start building networks asynchronously for instance. {{(pid=75226) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 17 01:20:49 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:20:49 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:20:49 user nova-compute[75226]: DEBUG nova.compute.manager [None req-f900e81b-7ba5-4405-9342-4161914cadd5 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] [instance: 52fe0a91-9320-47d2-ac83-4f49260a0997] Allocating IP information in the background. {{(pid=75226) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 17 01:20:49 user nova-compute[75226]: DEBUG nova.network.neutron [None req-f900e81b-7ba5-4405-9342-4161914cadd5 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] [instance: 52fe0a91-9320-47d2-ac83-4f49260a0997] allocate_for_instance() {{(pid=75226) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 17 01:20:49 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:20:49 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-f900e81b-7ba5-4405-9342-4161914cadd5 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] [instance: 52fe0a91-9320-47d2-ac83-4f49260a0997] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 17 01:20:49 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:20:49 user nova-compute[75226]: DEBUG nova.compute.manager [None req-f900e81b-7ba5-4405-9342-4161914cadd5 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] [instance: 52fe0a91-9320-47d2-ac83-4f49260a0997] Start building block device mappings for instance. {{(pid=75226) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 17 01:20:49 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:20:49 user nova-compute[75226]: DEBUG nova.policy [None req-f900e81b-7ba5-4405-9342-4161914cadd5 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '991e21017fde48ccbf2aab961434f0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339f5602853149bcad2f8416ee82a0c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75226) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 17 01:20:49 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:20:49 user nova-compute[75226]: INFO nova.virt.libvirt.driver [-] [instance: b054a557-dff6-49f8-9300-1307f8433567] Instance destroyed successfully.
Nov 17 01:20:49 user nova-compute[75226]: DEBUG nova.objects.instance [None req-9f7ffa92-e778-4a73-86d7-e79ec514eb3c tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] Lazy-loading 'resources' on Instance uuid b054a557-dff6-49f8-9300-1307f8433567 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:20:49 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-9f7ffa92-e778-4a73-86d7-e79ec514eb3c tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-17T01:17:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-670055725',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-670055725',id=6,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLQTkAEsiD7vZkLRChcVhMfcWUFr+J4uCStAPtsh5EcOj4Y0TqNu0/N7e0AK98CTHsomeIYjTkrU/pTyfUW55cXvLwMkYssMQNhMJgsr816svkjbGW+OPHRqanQu9/VlCw==',key_name='tempest-keypair-2003198946',keypairs=<?>,launch_index=0,launched_at=2023-11-17T01:17:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f8f5190e0bff4cbb9384c0fb4faf54d4',ramdisk_id='',reservation_id='r-icespjka',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-177886932',owner_user_name='tempest-TaggedAttachmentsTest-177886932-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T01:17:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b59a9221aae44dcbb688294a0483b715',uuid=b054a557-dff6-49f8-9300-1307f8433567,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9be521ab-d517-4746-b6b3-1e4930610165", "address": "fa:16:3e:c9:37:0f", "network": {"id": "126149e3-f0c6-483c-a0b4-4fd1dcd1a390", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1008205473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8f5190e0bff4cbb9384c0fb4faf54d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9be521ab-d5", "ovs_interfaceid": "9be521ab-d517-4746-b6b3-1e4930610165", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 17 01:20:49 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-9f7ffa92-e778-4a73-86d7-e79ec514eb3c tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] Converting VIF {"id": "9be521ab-d517-4746-b6b3-1e4930610165", "address": "fa:16:3e:c9:37:0f", "network": {"id": "126149e3-f0c6-483c-a0b4-4fd1dcd1a390", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1008205473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8f5190e0bff4cbb9384c0fb4faf54d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9be521ab-d5", "ovs_interfaceid": "9be521ab-d517-4746-b6b3-1e4930610165", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:20:49 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-9f7ffa92-e778-4a73-86d7-e79ec514eb3c tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c9:37:0f,bridge_name='br-int',has_traffic_filtering=True,id=9be521ab-d517-4746-b6b3-1e4930610165,network=Network(126149e3-f0c6-483c-a0b4-4fd1dcd1a390),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9be521ab-d5') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:20:49 user nova-compute[75226]: DEBUG os_vif [None req-9f7ffa92-e778-4a73-86d7-e79ec514eb3c tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c9:37:0f,bridge_name='br-int',has_traffic_filtering=True,id=9be521ab-d517-4746-b6b3-1e4930610165,network=Network(126149e3-f0c6-483c-a0b4-4fd1dcd1a390),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9be521ab-d5') {{(pid=75226) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 17 01:20:49 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:20:49 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9be521ab-d5, bridge=br-int, if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:20:49 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:20:49 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:20:49 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:20:49 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:20:49 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d1afbd9c-b126-452e-a959-aa1ddfb26ce7) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:20:49 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:20:49 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:20:49 user nova-compute[75226]: DEBUG nova.compute.manager [None req-f900e81b-7ba5-4405-9342-4161914cadd5 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] [instance: 52fe0a91-9320-47d2-ac83-4f49260a0997] Start spawning the instance on the hypervisor. {{(pid=75226) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 17 01:20:49 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-f900e81b-7ba5-4405-9342-4161914cadd5 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] [instance: 52fe0a91-9320-47d2-ac83-4f49260a0997] Creating instance directory {{(pid=75226) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 17 01:20:49 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-f900e81b-7ba5-4405-9342-4161914cadd5 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] [instance: 52fe0a91-9320-47d2-ac83-4f49260a0997] Creating image(s)
Nov 17 01:20:49 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-f900e81b-7ba5-4405-9342-4161914cadd5 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] Acquiring lock "/opt/stack/data/nova/instances/52fe0a91-9320-47d2-ac83-4f49260a0997/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:20:49 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-f900e81b-7ba5-4405-9342-4161914cadd5 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] Lock "/opt/stack/data/nova/instances/52fe0a91-9320-47d2-ac83-4f49260a0997/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:20:49 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-f900e81b-7ba5-4405-9342-4161914cadd5 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] Lock "/opt/stack/data/nova/instances/52fe0a91-9320-47d2-ac83-4f49260a0997/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:20:49 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:20:49 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-f900e81b-7ba5-4405-9342-4161914cadd5 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:20:49 user nova-compute[75226]: INFO os_vif [None req-9f7ffa92-e778-4a73-86d7-e79ec514eb3c tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c9:37:0f,bridge_name='br-int',has_traffic_filtering=True,id=9be521ab-d517-4746-b6b3-1e4930610165,network=Network(126149e3-f0c6-483c-a0b4-4fd1dcd1a390),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9be521ab-d5')
Nov 17 01:20:49 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-9f7ffa92-e778-4a73-86d7-e79ec514eb3c tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] [instance: b054a557-dff6-49f8-9300-1307f8433567] Deleting instance files /opt/stack/data/nova/instances/b054a557-dff6-49f8-9300-1307f8433567_del
Nov 17 01:20:49 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-9f7ffa92-e778-4a73-86d7-e79ec514eb3c tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] [instance: b054a557-dff6-49f8-9300-1307f8433567] Deletion of /opt/stack/data/nova/instances/b054a557-dff6-49f8-9300-1307f8433567_del complete
Nov 17 01:20:49 user nova-compute[75226]: INFO nova.compute.manager [None req-9f7ffa92-e778-4a73-86d7-e79ec514eb3c tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] [instance: b054a557-dff6-49f8-9300-1307f8433567] Took 1.11 seconds to destroy the instance on the hypervisor.
Nov 17 01:20:49 user nova-compute[75226]: DEBUG oslo.service.loopingcall [None req-9f7ffa92-e778-4a73-86d7-e79ec514eb3c tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75226) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 17 01:20:49 user nova-compute[75226]: DEBUG nova.compute.manager [-] [instance: b054a557-dff6-49f8-9300-1307f8433567] Deallocating network for instance {{(pid=75226) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 17 01:20:49 user nova-compute[75226]: DEBUG nova.network.neutron [-] [instance: b054a557-dff6-49f8-9300-1307f8433567] deallocate_for_instance() {{(pid=75226) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 17 01:20:49 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-f900e81b-7ba5-4405-9342-4161914cadd5 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json" returned: 0 in 0.176s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:20:49 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-f900e81b-7ba5-4405-9342-4161914cadd5 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] Acquiring lock "a8a62c2546af3a2036b853250c5ac64d4c6b4371" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:20:49 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-f900e81b-7ba5-4405-9342-4161914cadd5 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] Lock "a8a62c2546af3a2036b853250c5ac64d4c6b4371" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:20:49 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-f900e81b-7ba5-4405-9342-4161914cadd5 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:20:49 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:20:49 user nova-compute[75226]: INFO nova.virt.libvirt.driver [-] [instance: 75b1cabe-ba15-4851-9140-5949afc33005] Instance destroyed successfully.
Nov 17 01:20:49 user nova-compute[75226]: DEBUG nova.objects.instance [None req-646d95f4-3829-431d-a130-0179048be883 tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] Lazy-loading 'resources' on Instance uuid 75b1cabe-ba15-4851-9140-5949afc33005 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:20:49 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-f900e81b-7ba5-4405-9342-4161914cadd5 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json" returned: 0 in 0.208s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:20:49 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-f900e81b-7ba5-4405-9342-4161914cadd5 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371,backing_fmt=raw /opt/stack/data/nova/instances/52fe0a91-9320-47d2-ac83-4f49260a0997/disk 1073741824 {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:20:49 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-646d95f4-3829-431d-a130-0179048be883 tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:17:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1789442028',display_name='tempest-TestVolumeSwap-server-1789442028',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1789442028',id=5,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBGdgEhsAQqzlHMqVa3uvgZ2wMKsXi+U6v0PTYrZZdvqXgf5RhML9/5l4IK+m2ego8dF6p13DlEHVrQfBH3tafvGrfNFAWDKMQK3LJGRiq7HZc27y3eq0IkTBO9dsZj2Sg==',key_name='tempest-keypair-2092853100',keypairs=<?>,launch_index=0,launched_at=2023-11-17T01:17:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1abb76252c4f437b9cb23db20136262c',ramdisk_id='',reservation_id='r-v7toeb7g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-281843478',owner_user_name='tempest-TestVolumeSwap-281843478-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T01:17:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cd3334c6476249beab82ac7c6df39afe',uuid=75b1cabe-ba15-4851-9140-5949afc33005,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8e47eaef-6e73-4c79-973d-31f6481368be", "address": "fa:16:3e:43:38:6f", "network": {"id": "343b2264-f73a-436f-9588-6532711956ca", "bridge": "br-int", "label": "tempest-TestVolumeSwap-926357821-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1abb76252c4f437b9cb23db20136262c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e47eaef-6e", "ovs_interfaceid": "8e47eaef-6e73-4c79-973d-31f6481368be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 17 01:20:49 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-646d95f4-3829-431d-a130-0179048be883 tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] Converting VIF {"id": "8e47eaef-6e73-4c79-973d-31f6481368be", "address": "fa:16:3e:43:38:6f", "network": {"id": "343b2264-f73a-436f-9588-6532711956ca", "bridge": "br-int", "label": "tempest-TestVolumeSwap-926357821-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1abb76252c4f437b9cb23db20136262c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e47eaef-6e", "ovs_interfaceid": "8e47eaef-6e73-4c79-973d-31f6481368be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:20:49 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-646d95f4-3829-431d-a130-0179048be883 tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:43:38:6f,bridge_name='br-int',has_traffic_filtering=True,id=8e47eaef-6e73-4c79-973d-31f6481368be,network=Network(343b2264-f73a-436f-9588-6532711956ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e47eaef-6e') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:20:49 user nova-compute[75226]: DEBUG os_vif [None req-646d95f4-3829-431d-a130-0179048be883 tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:43:38:6f,bridge_name='br-int',has_traffic_filtering=True,id=8e47eaef-6e73-4c79-973d-31f6481368be,network=Network(343b2264-f73a-436f-9588-6532711956ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e47eaef-6e') {{(pid=75226) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 17 01:20:49 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:20:49 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8e47eaef-6e, bridge=br-int, if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:20:49 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-f900e81b-7ba5-4405-9342-4161914cadd5 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371,backing_fmt=raw /opt/stack/data/nova/instances/52fe0a91-9320-47d2-ac83-4f49260a0997/disk 1073741824" returned: 0 in 0.067s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:20:49 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-f900e81b-7ba5-4405-9342-4161914cadd5 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] Lock "a8a62c2546af3a2036b853250c5ac64d4c6b4371" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.278s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:20:49 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-f900e81b-7ba5-4405-9342-4161914cadd5 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:20:50 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:20:50 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:20:50 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:20:50 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=02c7df97-c958-4da2-b8f0-0a7555933300) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:20:50 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:20:50 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:20:50 user nova-compute[75226]: INFO os_vif [None req-646d95f4-3829-431d-a130-0179048be883 tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:43:38:6f,bridge_name='br-int',has_traffic_filtering=True,id=8e47eaef-6e73-4c79-973d-31f6481368be,network=Network(343b2264-f73a-436f-9588-6532711956ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e47eaef-6e')
Nov 17 01:20:50 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-646d95f4-3829-431d-a130-0179048be883 tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] [instance: 75b1cabe-ba15-4851-9140-5949afc33005] Deleting instance files /opt/stack/data/nova/instances/75b1cabe-ba15-4851-9140-5949afc33005_del
Nov 17 01:20:50 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-646d95f4-3829-431d-a130-0179048be883 tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] [instance: 75b1cabe-ba15-4851-9140-5949afc33005] Deletion of /opt/stack/data/nova/instances/75b1cabe-ba15-4851-9140-5949afc33005_del complete
Nov 17 01:20:50 user nova-compute[75226]: INFO nova.compute.manager [None req-646d95f4-3829-431d-a130-0179048be883 tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] [instance: 75b1cabe-ba15-4851-9140-5949afc33005] Took 0.99 seconds to destroy the instance on the hypervisor.
Nov 17 01:20:50 user nova-compute[75226]: DEBUG oslo.service.loopingcall [None req-646d95f4-3829-431d-a130-0179048be883 tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75226) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 17 01:20:50 user nova-compute[75226]: DEBUG nova.compute.manager [-] [instance: 75b1cabe-ba15-4851-9140-5949afc33005] Deallocating network for instance {{(pid=75226) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 17 01:20:50 user nova-compute[75226]: DEBUG nova.network.neutron [-] [instance: 75b1cabe-ba15-4851-9140-5949afc33005] deallocate_for_instance() {{(pid=75226) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 17 01:20:50 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-f900e81b-7ba5-4405-9342-4161914cadd5 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json" returned: 0 in 0.204s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:20:50 user nova-compute[75226]: DEBUG nova.virt.disk.api [None req-f900e81b-7ba5-4405-9342-4161914cadd5 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] Checking if we can resize image /opt/stack/data/nova/instances/52fe0a91-9320-47d2-ac83-4f49260a0997/disk. size=1073741824 {{(pid=75226) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 17 01:20:50 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-f900e81b-7ba5-4405-9342-4161914cadd5 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52fe0a91-9320-47d2-ac83-4f49260a0997/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:20:50 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-f900e81b-7ba5-4405-9342-4161914cadd5 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52fe0a91-9320-47d2-ac83-4f49260a0997/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:20:50 user nova-compute[75226]: DEBUG nova.virt.disk.api [None req-f900e81b-7ba5-4405-9342-4161914cadd5 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] Cannot resize image /opt/stack/data/nova/instances/52fe0a91-9320-47d2-ac83-4f49260a0997/disk to a smaller size. {{(pid=75226) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 17 01:20:50 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-f900e81b-7ba5-4405-9342-4161914cadd5 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] [instance: 52fe0a91-9320-47d2-ac83-4f49260a0997] Created local disks {{(pid=75226) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 17 01:20:50 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-f900e81b-7ba5-4405-9342-4161914cadd5 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] [instance: 52fe0a91-9320-47d2-ac83-4f49260a0997] Ensure instance console log exists: /opt/stack/data/nova/instances/52fe0a91-9320-47d2-ac83-4f49260a0997/console.log {{(pid=75226) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 17 01:20:50 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-f900e81b-7ba5-4405-9342-4161914cadd5 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:20:50 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-f900e81b-7ba5-4405-9342-4161914cadd5 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:20:50 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-f900e81b-7ba5-4405-9342-4161914cadd5 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:20:50 user nova-compute[75226]: DEBUG nova.network.neutron [-] [instance: 75b1cabe-ba15-4851-9140-5949afc33005] Updating instance_info_cache with network_info: [] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:20:50 user nova-compute[75226]: INFO nova.compute.manager [-] [instance: 75b1cabe-ba15-4851-9140-5949afc33005] Took 0.78 seconds to deallocate network for instance.
Nov 17 01:20:50 user nova-compute[75226]: DEBUG nova.compute.manager [req-10219ef2-f8c1-43f6-b74a-3dd14c9ba570 req-54dbd64c-319b-4768-b22b-8aa91eedf015 service nova] [instance: b054a557-dff6-49f8-9300-1307f8433567] Received event network-vif-plugged-9be521ab-d517-4746-b6b3-1e4930610165 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:20:50 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-10219ef2-f8c1-43f6-b74a-3dd14c9ba570 req-54dbd64c-319b-4768-b22b-8aa91eedf015 service nova] Acquiring lock "b054a557-dff6-49f8-9300-1307f8433567-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:20:50 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-10219ef2-f8c1-43f6-b74a-3dd14c9ba570 req-54dbd64c-319b-4768-b22b-8aa91eedf015 service nova] Lock "b054a557-dff6-49f8-9300-1307f8433567-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:20:50 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-10219ef2-f8c1-43f6-b74a-3dd14c9ba570 req-54dbd64c-319b-4768-b22b-8aa91eedf015 service nova] Lock "b054a557-dff6-49f8-9300-1307f8433567-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:20:50 user nova-compute[75226]: DEBUG nova.compute.manager [req-10219ef2-f8c1-43f6-b74a-3dd14c9ba570 req-54dbd64c-319b-4768-b22b-8aa91eedf015 service nova] [instance: b054a557-dff6-49f8-9300-1307f8433567] No waiting events found dispatching network-vif-plugged-9be521ab-d517-4746-b6b3-1e4930610165 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:20:50 user nova-compute[75226]: WARNING nova.compute.manager [req-10219ef2-f8c1-43f6-b74a-3dd14c9ba570 req-54dbd64c-319b-4768-b22b-8aa91eedf015 service nova] [instance: b054a557-dff6-49f8-9300-1307f8433567] Received unexpected event network-vif-plugged-9be521ab-d517-4746-b6b3-1e4930610165 for instance with vm_state active and task_state deleting.
Nov 17 01:20:50 user nova-compute[75226]: DEBUG nova.compute.manager [req-10219ef2-f8c1-43f6-b74a-3dd14c9ba570 req-54dbd64c-319b-4768-b22b-8aa91eedf015 service nova] [instance: 75b1cabe-ba15-4851-9140-5949afc33005] Received event network-vif-unplugged-8e47eaef-6e73-4c79-973d-31f6481368be {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:20:50 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-10219ef2-f8c1-43f6-b74a-3dd14c9ba570 req-54dbd64c-319b-4768-b22b-8aa91eedf015 service nova] Acquiring lock "75b1cabe-ba15-4851-9140-5949afc33005-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:20:50 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-10219ef2-f8c1-43f6-b74a-3dd14c9ba570 req-54dbd64c-319b-4768-b22b-8aa91eedf015 service nova] Lock "75b1cabe-ba15-4851-9140-5949afc33005-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:20:50 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-10219ef2-f8c1-43f6-b74a-3dd14c9ba570 req-54dbd64c-319b-4768-b22b-8aa91eedf015 service nova] Lock "75b1cabe-ba15-4851-9140-5949afc33005-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:20:50 user nova-compute[75226]: DEBUG nova.compute.manager [req-10219ef2-f8c1-43f6-b74a-3dd14c9ba570 req-54dbd64c-319b-4768-b22b-8aa91eedf015 service nova] [instance: 75b1cabe-ba15-4851-9140-5949afc33005] No waiting events found dispatching network-vif-unplugged-8e47eaef-6e73-4c79-973d-31f6481368be {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:20:50 user nova-compute[75226]: DEBUG nova.compute.manager [req-10219ef2-f8c1-43f6-b74a-3dd14c9ba570 req-54dbd64c-319b-4768-b22b-8aa91eedf015 service nova] [instance: 75b1cabe-ba15-4851-9140-5949afc33005] Received event network-vif-unplugged-8e47eaef-6e73-4c79-973d-31f6481368be for instance with task_state deleting. {{(pid=75226) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 17 01:20:50 user nova-compute[75226]: DEBUG nova.compute.manager [req-10219ef2-f8c1-43f6-b74a-3dd14c9ba570 req-54dbd64c-319b-4768-b22b-8aa91eedf015 service nova] [instance: 75b1cabe-ba15-4851-9140-5949afc33005] Received event network-vif-plugged-8e47eaef-6e73-4c79-973d-31f6481368be {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:20:50 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-10219ef2-f8c1-43f6-b74a-3dd14c9ba570 req-54dbd64c-319b-4768-b22b-8aa91eedf015 service nova] Acquiring lock "75b1cabe-ba15-4851-9140-5949afc33005-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:20:50 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-10219ef2-f8c1-43f6-b74a-3dd14c9ba570 req-54dbd64c-319b-4768-b22b-8aa91eedf015 service nova] Lock "75b1cabe-ba15-4851-9140-5949afc33005-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:20:50 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-10219ef2-f8c1-43f6-b74a-3dd14c9ba570 req-54dbd64c-319b-4768-b22b-8aa91eedf015 service nova] Lock "75b1cabe-ba15-4851-9140-5949afc33005-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:20:50 user nova-compute[75226]: DEBUG nova.compute.manager [req-10219ef2-f8c1-43f6-b74a-3dd14c9ba570 req-54dbd64c-319b-4768-b22b-8aa91eedf015 service nova] [instance: 75b1cabe-ba15-4851-9140-5949afc33005] No waiting events found dispatching network-vif-plugged-8e47eaef-6e73-4c79-973d-31f6481368be {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:20:50 user nova-compute[75226]: WARNING nova.compute.manager [req-10219ef2-f8c1-43f6-b74a-3dd14c9ba570 req-54dbd64c-319b-4768-b22b-8aa91eedf015 service nova] [instance: 75b1cabe-ba15-4851-9140-5949afc33005] Received unexpected event network-vif-plugged-8e47eaef-6e73-4c79-973d-31f6481368be for instance with vm_state active and task_state deleting.
Nov 17 01:20:50 user nova-compute[75226]: DEBUG nova.compute.manager [req-10219ef2-f8c1-43f6-b74a-3dd14c9ba570 req-54dbd64c-319b-4768-b22b-8aa91eedf015 service nova] [instance: 75b1cabe-ba15-4851-9140-5949afc33005] Received event network-vif-deleted-8e47eaef-6e73-4c79-973d-31f6481368be {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:20:51 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-646d95f4-3829-431d-a130-0179048be883 tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:20:51 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-646d95f4-3829-431d-a130-0179048be883 tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:20:51 user nova-compute[75226]: DEBUG nova.network.neutron [None req-f900e81b-7ba5-4405-9342-4161914cadd5 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] [instance: 52fe0a91-9320-47d2-ac83-4f49260a0997] Successfully created port: 40569c42-220e-4c21-8b6c-b12dc4e111c5 {{(pid=75226) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 17 01:20:51 user nova-compute[75226]: DEBUG nova.network.neutron [-] [instance: b054a557-dff6-49f8-9300-1307f8433567] Updating instance_info_cache with network_info: [] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:20:51 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-646d95f4-3829-431d-a130-0179048be883 tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:20:51 user nova-compute[75226]: INFO nova.compute.manager [-] [instance: b054a557-dff6-49f8-9300-1307f8433567] Took 1.68 seconds to deallocate network for instance.
Nov 17 01:20:51 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-646d95f4-3829-431d-a130-0179048be883 tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:20:51 user nova-compute[75226]: DEBUG nova.compute.manager [req-499c6d22-7b81-477f-95ac-091b96c242e5 req-6aaafe88-0b40-4274-a833-35421907c237 service nova] [instance: b054a557-dff6-49f8-9300-1307f8433567] Received event network-vif-deleted-9be521ab-d517-4746-b6b3-1e4930610165 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:20:51 user nova-compute[75226]: INFO nova.compute.manager [req-499c6d22-7b81-477f-95ac-091b96c242e5 req-6aaafe88-0b40-4274-a833-35421907c237 service nova] [instance: b054a557-dff6-49f8-9300-1307f8433567] Neutron deleted interface 9be521ab-d517-4746-b6b3-1e4930610165; detaching it from the instance and deleting it from the info cache
Nov 17 01:20:51 user nova-compute[75226]: DEBUG nova.network.neutron [req-499c6d22-7b81-477f-95ac-091b96c242e5 req-6aaafe88-0b40-4274-a833-35421907c237 service nova] [instance: b054a557-dff6-49f8-9300-1307f8433567] Updating instance_info_cache with network_info: [] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:20:51 user nova-compute[75226]: DEBUG nova.compute.manager [req-499c6d22-7b81-477f-95ac-091b96c242e5 req-6aaafe88-0b40-4274-a833-35421907c237 service nova] [instance: b054a557-dff6-49f8-9300-1307f8433567] Detach interface failed, port_id=9be521ab-d517-4746-b6b3-1e4930610165, reason: Instance b054a557-dff6-49f8-9300-1307f8433567 could not be found. {{(pid=75226) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 17 01:20:51 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-646d95f4-3829-431d-a130-0179048be883 tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.402s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:20:51 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-9f7ffa92-e778-4a73-86d7-e79ec514eb3c tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:20:51 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-9f7ffa92-e778-4a73-86d7-e79ec514eb3c tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:20:51 user nova-compute[75226]: INFO nova.scheduler.client.report [None req-646d95f4-3829-431d-a130-0179048be883 tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] Deleted allocations for instance 75b1cabe-ba15-4851-9140-5949afc33005
Nov 17 01:20:51 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-646d95f4-3829-431d-a130-0179048be883 tempest-TestVolumeSwap-281843478 tempest-TestVolumeSwap-281843478-project-member] Lock "75b1cabe-ba15-4851-9140-5949afc33005" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.412s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:20:51 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-9f7ffa92-e778-4a73-86d7-e79ec514eb3c tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:20:51 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-9f7ffa92-e778-4a73-86d7-e79ec514eb3c tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:20:51 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-9f7ffa92-e778-4a73-86d7-e79ec514eb3c tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.310s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:20:51 user nova-compute[75226]: INFO nova.scheduler.client.report [None req-9f7ffa92-e778-4a73-86d7-e79ec514eb3c tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] Deleted allocations for instance b054a557-dff6-49f8-9300-1307f8433567
Nov 17 01:20:51 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-9f7ffa92-e778-4a73-86d7-e79ec514eb3c tempest-TaggedAttachmentsTest-177886932 tempest-TaggedAttachmentsTest-177886932-project-member] Lock "b054a557-dff6-49f8-9300-1307f8433567" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.304s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:20:51 user nova-compute[75226]: DEBUG nova.network.neutron [None req-f900e81b-7ba5-4405-9342-4161914cadd5 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] [instance: 52fe0a91-9320-47d2-ac83-4f49260a0997] Successfully updated port: 40569c42-220e-4c21-8b6c-b12dc4e111c5 {{(pid=75226) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 17 01:20:51 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-f900e81b-7ba5-4405-9342-4161914cadd5 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] Acquiring lock "refresh_cache-52fe0a91-9320-47d2-ac83-4f49260a0997" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:20:51 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-f900e81b-7ba5-4405-9342-4161914cadd5 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] Acquired lock "refresh_cache-52fe0a91-9320-47d2-ac83-4f49260a0997" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:20:51 user nova-compute[75226]: DEBUG nova.network.neutron [None req-f900e81b-7ba5-4405-9342-4161914cadd5 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] [instance: 52fe0a91-9320-47d2-ac83-4f49260a0997] Building network info cache for instance {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 01:20:51 user nova-compute[75226]: DEBUG nova.network.neutron [None req-f900e81b-7ba5-4405-9342-4161914cadd5 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] [instance: 52fe0a91-9320-47d2-ac83-4f49260a0997] Instance cache missing network info. {{(pid=75226) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 17 01:20:52 user nova-compute[75226]: DEBUG nova.network.neutron [None req-f900e81b-7ba5-4405-9342-4161914cadd5 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] [instance: 52fe0a91-9320-47d2-ac83-4f49260a0997] Updating instance_info_cache with network_info: [{"id": "40569c42-220e-4c21-8b6c-b12dc4e111c5", "address": "fa:16:3e:ee:92:2e", "network": {"id": "413a22ba-ac08-4a82-ad4a-7be66b8b38d0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-885127095-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "339f5602853149bcad2f8416ee82a0c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40569c42-22", "ovs_interfaceid": "40569c42-220e-4c21-8b6c-b12dc4e111c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:20:52 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-f900e81b-7ba5-4405-9342-4161914cadd5 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] Releasing lock "refresh_cache-52fe0a91-9320-47d2-ac83-4f49260a0997" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:20:52 user nova-compute[75226]: DEBUG nova.compute.manager [None req-f900e81b-7ba5-4405-9342-4161914cadd5 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] [instance: 52fe0a91-9320-47d2-ac83-4f49260a0997] Instance network_info: |[{"id": "40569c42-220e-4c21-8b6c-b12dc4e111c5", "address": "fa:16:3e:ee:92:2e", "network": {"id": "413a22ba-ac08-4a82-ad4a-7be66b8b38d0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-885127095-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "339f5602853149bcad2f8416ee82a0c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40569c42-22", "ovs_interfaceid": "40569c42-220e-4c21-8b6c-b12dc4e111c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75226) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 17 01:20:52 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-f900e81b-7ba5-4405-9342-4161914cadd5 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] [instance: 52fe0a91-9320-47d2-ac83-4f49260a0997] Start _get_guest_xml network_info=[{"id": "40569c42-220e-4c21-8b6c-b12dc4e111c5", "address": "fa:16:3e:ee:92:2e", "network": {"id": "413a22ba-ac08-4a82-ad4a-7be66b8b38d0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-885127095-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "339f5602853149bcad2f8416ee82a0c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40569c42-22", "ovs_interfaceid": "40569c42-220e-4c21-8b6c-b12dc4e111c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T01:13:22Z,direct_url=<?>,disk_format='qcow2',id=0b369aea-6f3f-4690-9f01-229b90ab6310,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4e110cbf9a84362a6864a7732c435a1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T01:13:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '0b369aea-6f3f-4690-9f01-229b90ab6310'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75226) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 17 01:20:52 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-f900e81b-7ba5-4405-9342-4161914cadd5 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:20:52 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-f900e81b-7ba5-4405-9342-4161914cadd5 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:20:52 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-f900e81b-7ba5-4405-9342-4161914cadd5 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75226) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 17 01:20:52 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-f900e81b-7ba5-4405-9342-4161914cadd5 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] CPU controller missing on host. {{(pid=75226) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 17 01:20:52 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-f900e81b-7ba5-4405-9342-4161914cadd5 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75226) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 17 01:20:52 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-f900e81b-7ba5-4405-9342-4161914cadd5 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] CPU controller found on host. {{(pid=75226) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 17 01:20:52 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-f900e81b-7ba5-4405-9342-4161914cadd5 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75226) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 17 01:20:52 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-f900e81b-7ba5-4405-9342-4161914cadd5 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-17T01:13:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T01:13:22Z,direct_url=<?>,disk_format='qcow2',id=0b369aea-6f3f-4690-9f01-229b90ab6310,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4e110cbf9a84362a6864a7732c435a1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T01:13:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 17 01:20:52 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-f900e81b-7ba5-4405-9342-4161914cadd5 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] Flavor limits 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 17 01:20:52 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-f900e81b-7ba5-4405-9342-4161914cadd5 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] Image limits 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 17 01:20:52 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-f900e81b-7ba5-4405-9342-4161914cadd5 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] Flavor pref 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 17 01:20:52 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-f900e81b-7ba5-4405-9342-4161914cadd5 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] Image pref 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 17 01:20:52 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-f900e81b-7ba5-4405-9342-4161914cadd5 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 17 01:20:52 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-f900e81b-7ba5-4405-9342-4161914cadd5 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 17 01:20:52 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-f900e81b-7ba5-4405-9342-4161914cadd5 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75226) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 17 01:20:52 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-f900e81b-7ba5-4405-9342-4161914cadd5 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] Got 1 possible topologies {{(pid=75226) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 17 01:20:52 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-f900e81b-7ba5-4405-9342-4161914cadd5 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 17 01:20:52 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-f900e81b-7ba5-4405-9342-4161914cadd5 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 17 01:20:52 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-f900e81b-7ba5-4405-9342-4161914cadd5 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:20:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-2021125272',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-2021125272',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-2021125',id=13,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOByX3h5BvkplC/tYK6tBAVVzVst/GaAXZZ4Xkr5lIxcg22rMq+aNROVe5qtJBezb0nVCZUZonuThPHXSxX5EMjO5MecIyQyfnb6TE854o5anrYnCWMDNbGQ4jnQE8yp+A==',key_name='tempest-keypair-2013635682',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='339f5602853149bcad2f8416ee82a0c2',ramdisk_id='',reservation_id='r-9v9df3pe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1271757401',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T01:20:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='991e21017fde48ccbf2aab961434f0bc',uuid=52fe0a91-9320-47d2-ac83-4f49260a0997,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "40569c42-220e-4c21-8b6c-b12dc4e111c5", "address": "fa:16:3e:ee:92:2e", "network": {"id": "413a22ba-ac08-4a82-ad4a-7be66b8b38d0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-885127095-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "339f5602853149bcad2f8416ee82a0c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40569c42-22", "ovs_interfaceid": "40569c42-220e-4c21-8b6c-b12dc4e111c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75226) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 01:20:52 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-f900e81b-7ba5-4405-9342-4161914cadd5 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] Converting VIF {"id": "40569c42-220e-4c21-8b6c-b12dc4e111c5", "address": "fa:16:3e:ee:92:2e", "network": {"id": "413a22ba-ac08-4a82-ad4a-7be66b8b38d0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-885127095-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "339f5602853149bcad2f8416ee82a0c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40569c42-22", "ovs_interfaceid": "40569c42-220e-4c21-8b6c-b12dc4e111c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:20:52 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-f900e81b-7ba5-4405-9342-4161914cadd5 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:92:2e,bridge_name='br-int',has_traffic_filtering=True,id=40569c42-220e-4c21-8b6c-b12dc4e111c5,network=Network(413a22ba-ac08-4a82-ad4a-7be66b8b38d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40569c42-22') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:20:52 user nova-compute[75226]: DEBUG nova.objects.instance [None req-f900e81b-7ba5-4405-9342-4161914cadd5 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] Lazy-loading 'pci_devices' on Instance uuid 52fe0a91-9320-47d2-ac83-4f49260a0997 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:20:52 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-f900e81b-7ba5-4405-9342-4161914cadd5 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] [instance: 52fe0a91-9320-47d2-ac83-4f49260a0997] End _get_guest_xml xml=<domain type="kvm">
Nov 17 01:20:52 user nova-compute[75226]:   <uuid>52fe0a91-9320-47d2-ac83-4f49260a0997</uuid>
Nov 17 01:20:52 user nova-compute[75226]:   <name>instance-0000000d</name>
Nov 17 01:20:52 user nova-compute[75226]:   <memory>524288</memory>
Nov 17 01:20:52 user nova-compute[75226]:   <vcpu>1</vcpu>
Nov 17 01:20:52 user nova-compute[75226]:   <metadata>
Nov 17 01:20:52 user nova-compute[75226]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 17 01:20:52 user nova-compute[75226]:       <nova:package version="0.0.0"/>
Nov 17 01:20:52 user nova-compute[75226]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-2021125272</nova:name>
Nov 17 01:20:52 user nova-compute[75226]:       <nova:creationTime>2023-11-17 01:20:52</nova:creationTime>
Nov 17 01:20:52 user nova-compute[75226]:       <nova:flavor name="m1.tiny">
Nov 17 01:20:52 user nova-compute[75226]:         <nova:memory>512</nova:memory>
Nov 17 01:20:52 user nova-compute[75226]:         <nova:disk>1</nova:disk>
Nov 17 01:20:52 user nova-compute[75226]:         <nova:swap>0</nova:swap>
Nov 17 01:20:52 user nova-compute[75226]:         <nova:ephemeral>0</nova:ephemeral>
Nov 17 01:20:52 user nova-compute[75226]:         <nova:vcpus>1</nova:vcpus>
Nov 17 01:20:52 user nova-compute[75226]:       </nova:flavor>
Nov 17 01:20:52 user nova-compute[75226]:       <nova:owner>
Nov 17 01:20:52 user nova-compute[75226]:         <nova:user uuid="991e21017fde48ccbf2aab961434f0bc">tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member</nova:user>
Nov 17 01:20:52 user nova-compute[75226]:         <nova:project uuid="339f5602853149bcad2f8416ee82a0c2">tempest-TestServerVolumeAttachScenarioOldVersion-1271757401</nova:project>
Nov 17 01:20:52 user nova-compute[75226]:       </nova:owner>
Nov 17 01:20:52 user nova-compute[75226]:       <nova:root type="image" uuid="0b369aea-6f3f-4690-9f01-229b90ab6310"/>
Nov 17 01:20:52 user nova-compute[75226]:       <nova:ports>
Nov 17 01:20:52 user nova-compute[75226]:         <nova:port uuid="40569c42-220e-4c21-8b6c-b12dc4e111c5">
Nov 17 01:20:52 user nova-compute[75226]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 17 01:20:52 user nova-compute[75226]:         </nova:port>
Nov 17 01:20:52 user nova-compute[75226]:       </nova:ports>
Nov 17 01:20:52 user nova-compute[75226]:     </nova:instance>
Nov 17 01:20:52 user nova-compute[75226]:   </metadata>
Nov 17 01:20:52 user nova-compute[75226]:   <sysinfo type="smbios">
Nov 17 01:20:52 user nova-compute[75226]:     <system>
Nov 17 01:20:52 user nova-compute[75226]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 17 01:20:52 user nova-compute[75226]:       <entry name="product">OpenStack Nova</entry>
Nov 17 01:20:52 user nova-compute[75226]:       <entry name="version">0.0.0</entry>
Nov 17 01:20:52 user nova-compute[75226]:       <entry name="serial">52fe0a91-9320-47d2-ac83-4f49260a0997</entry>
Nov 17 01:20:52 user nova-compute[75226]:       <entry name="uuid">52fe0a91-9320-47d2-ac83-4f49260a0997</entry>
Nov 17 01:20:52 user nova-compute[75226]:       <entry name="family">Virtual Machine</entry>
Nov 17 01:20:52 user nova-compute[75226]:     </system>
Nov 17 01:20:52 user nova-compute[75226]:   </sysinfo>
Nov 17 01:20:52 user nova-compute[75226]:   <os>
Nov 17 01:20:52 user nova-compute[75226]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 17 01:20:52 user nova-compute[75226]:     <boot dev="hd"/>
Nov 17 01:20:52 user nova-compute[75226]:     <smbios mode="sysinfo"/>
Nov 17 01:20:52 user nova-compute[75226]:   </os>
Nov 17 01:20:52 user nova-compute[75226]:   <features>
Nov 17 01:20:52 user nova-compute[75226]:     <acpi/>
Nov 17 01:20:52 user nova-compute[75226]:     <apic/>
Nov 17 01:20:52 user nova-compute[75226]:     <vmcoreinfo/>
Nov 17 01:20:52 user nova-compute[75226]:   </features>
Nov 17 01:20:52 user nova-compute[75226]:   <clock offset="utc">
Nov 17 01:20:52 user nova-compute[75226]:     <timer name="pit" tickpolicy="delay"/>
Nov 17 01:20:52 user nova-compute[75226]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 17 01:20:52 user nova-compute[75226]:     <timer name="hpet" present="no"/>
Nov 17 01:20:52 user nova-compute[75226]:   </clock>
Nov 17 01:20:52 user nova-compute[75226]:   <cpu mode="custom" match="exact">
Nov 17 01:20:52 user nova-compute[75226]:     <model>Nehalem</model>
Nov 17 01:20:52 user nova-compute[75226]:     <topology sockets="1" cores="1" threads="1"/>
Nov 17 01:20:52 user nova-compute[75226]:   </cpu>
Nov 17 01:20:52 user nova-compute[75226]:   <devices>
Nov 17 01:20:52 user nova-compute[75226]:     <disk type="file" device="disk">
Nov 17 01:20:52 user nova-compute[75226]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 17 01:20:52 user nova-compute[75226]:       <source file="/opt/stack/data/nova/instances/52fe0a91-9320-47d2-ac83-4f49260a0997/disk"/>
Nov 17 01:20:52 user nova-compute[75226]:       <target dev="vda" bus="virtio"/>
Nov 17 01:20:52 user nova-compute[75226]:     </disk>
Nov 17 01:20:52 user nova-compute[75226]:     <interface type="ethernet">
Nov 17 01:20:52 user nova-compute[75226]:       <mac address="fa:16:3e:ee:92:2e"/>
Nov 17 01:20:52 user nova-compute[75226]:       <model type="virtio"/>
Nov 17 01:20:52 user nova-compute[75226]:       <mtu size="1442"/>
Nov 17 01:20:52 user nova-compute[75226]:       <target dev="tap40569c42-22"/>
Nov 17 01:20:52 user nova-compute[75226]:     </interface>
Nov 17 01:20:52 user nova-compute[75226]:     <serial type="pty">
Nov 17 01:20:52 user nova-compute[75226]:       <log file="/opt/stack/data/nova/instances/52fe0a91-9320-47d2-ac83-4f49260a0997/console.log" append="off"/>
Nov 17 01:20:52 user nova-compute[75226]:     </serial>
Nov 17 01:20:52 user nova-compute[75226]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 17 01:20:52 user nova-compute[75226]:     <video>
Nov 17 01:20:52 user nova-compute[75226]:       <model type="virtio"/>
Nov 17 01:20:52 user nova-compute[75226]:     </video>
Nov 17 01:20:52 user nova-compute[75226]:     <rng model="virtio">
Nov 17 01:20:52 user nova-compute[75226]:       <backend model="random">/dev/urandom</backend>
Nov 17 01:20:52 user nova-compute[75226]:     </rng>
Nov 17 01:20:52 user nova-compute[75226]:     <controller type="usb" index="0" model="none"/>
Nov 17 01:20:52 user nova-compute[75226]:     <memballoon model="virtio">
Nov 17 01:20:52 user nova-compute[75226]:       <stats period="10"/>
Nov 17 01:20:52 user nova-compute[75226]:     </memballoon>
Nov 17 01:20:52 user nova-compute[75226]:   </devices>
Nov 17 01:20:52 user nova-compute[75226]: </domain>
Nov 17 01:20:52 user nova-compute[75226]:  {{(pid=75226) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 17 01:20:52 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-f900e81b-7ba5-4405-9342-4161914cadd5 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:20:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-2021125272',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-2021125272',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-2021125',id=13,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOByX3h5BvkplC/tYK6tBAVVzVst/GaAXZZ4Xkr5lIxcg22rMq+aNROVe5qtJBezb0nVCZUZonuThPHXSxX5EMjO5MecIyQyfnb6TE854o5anrYnCWMDNbGQ4jnQE8yp+A==',key_name='tempest-keypair-2013635682',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='339f5602853149bcad2f8416ee82a0c2',ramdisk_id='',reservation_id='r-9v9df3pe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1271757401',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T01:20:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='991e21017fde48ccbf2aab961434f0bc',uuid=52fe0a91-9320-47d2-ac83-4f49260a0997,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "40569c42-220e-4c21-8b6c-b12dc4e111c5", "address": "fa:16:3e:ee:92:2e", "network": {"id": "413a22ba-ac08-4a82-ad4a-7be66b8b38d0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-885127095-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "339f5602853149bcad2f8416ee82a0c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40569c42-22", "ovs_interfaceid": "40569c42-220e-4c21-8b6c-b12dc4e111c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 17 01:20:52 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-f900e81b-7ba5-4405-9342-4161914cadd5 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] Converting VIF {"id": "40569c42-220e-4c21-8b6c-b12dc4e111c5", "address": "fa:16:3e:ee:92:2e", "network": {"id": "413a22ba-ac08-4a82-ad4a-7be66b8b38d0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-885127095-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "339f5602853149bcad2f8416ee82a0c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40569c42-22", "ovs_interfaceid": "40569c42-220e-4c21-8b6c-b12dc4e111c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:20:52 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-f900e81b-7ba5-4405-9342-4161914cadd5 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:92:2e,bridge_name='br-int',has_traffic_filtering=True,id=40569c42-220e-4c21-8b6c-b12dc4e111c5,network=Network(413a22ba-ac08-4a82-ad4a-7be66b8b38d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40569c42-22') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:20:52 user nova-compute[75226]: DEBUG os_vif [None req-f900e81b-7ba5-4405-9342-4161914cadd5 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:92:2e,bridge_name='br-int',has_traffic_filtering=True,id=40569c42-220e-4c21-8b6c-b12dc4e111c5,network=Network(413a22ba-ac08-4a82-ad4a-7be66b8b38d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40569c42-22') {{(pid=75226) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 17 01:20:52 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:20:52 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:20:52 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 17 01:20:52 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:20:52 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3330f410-9efe-5186-85a3-065418441870', '_type': 'linux-noop'}}, row=False) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:20:52 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:20:52 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:20:52 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:20:52 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap40569c42-22, may_exist=True, interface_attrs={}) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:20:52 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap40569c42-22, col_values=(('qos', UUID('f60f33f5-d4de-4c7f-b8a7-1b2613669b04')),), if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:20:52 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap40569c42-22, col_values=(('external_ids', {'iface-id': '40569c42-220e-4c21-8b6c-b12dc4e111c5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ee:92:2e', 'vm-uuid': '52fe0a91-9320-47d2-ac83-4f49260a0997'}),), if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:20:52 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:20:52 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:20:52 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:20:52 user nova-compute[75226]: INFO os_vif [None req-f900e81b-7ba5-4405-9342-4161914cadd5 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:92:2e,bridge_name='br-int',has_traffic_filtering=True,id=40569c42-220e-4c21-8b6c-b12dc4e111c5,network=Network(413a22ba-ac08-4a82-ad4a-7be66b8b38d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40569c42-22')
Nov 17 01:20:52 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-f900e81b-7ba5-4405-9342-4161914cadd5 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] No BDM found with device name vda, not building metadata. {{(pid=75226) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 01:20:52 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-f900e81b-7ba5-4405-9342-4161914cadd5 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] No VIF found with MAC fa:16:3e:ee:92:2e, not building metadata {{(pid=75226) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 01:20:52 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:20:53 user nova-compute[75226]: DEBUG nova.compute.manager [req-118cc4c5-344d-472e-b1dd-b78d241592e2 req-bea690ee-a7a0-45f6-b6d3-9cb0efb21d23 service nova] [instance: 52fe0a91-9320-47d2-ac83-4f49260a0997] Received event network-changed-40569c42-220e-4c21-8b6c-b12dc4e111c5 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:20:53 user nova-compute[75226]: DEBUG nova.compute.manager [req-118cc4c5-344d-472e-b1dd-b78d241592e2 req-bea690ee-a7a0-45f6-b6d3-9cb0efb21d23 service nova] [instance: 52fe0a91-9320-47d2-ac83-4f49260a0997] Refreshing instance network info cache due to event network-changed-40569c42-220e-4c21-8b6c-b12dc4e111c5. {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 01:20:53 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-118cc4c5-344d-472e-b1dd-b78d241592e2 req-bea690ee-a7a0-45f6-b6d3-9cb0efb21d23 service nova] Acquiring lock "refresh_cache-52fe0a91-9320-47d2-ac83-4f49260a0997" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:20:53 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-118cc4c5-344d-472e-b1dd-b78d241592e2 req-bea690ee-a7a0-45f6-b6d3-9cb0efb21d23 service nova] Acquired lock "refresh_cache-52fe0a91-9320-47d2-ac83-4f49260a0997" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:20:53 user nova-compute[75226]: DEBUG nova.network.neutron [req-118cc4c5-344d-472e-b1dd-b78d241592e2 req-bea690ee-a7a0-45f6-b6d3-9cb0efb21d23 service nova] [instance: 52fe0a91-9320-47d2-ac83-4f49260a0997] Refreshing network info cache for port 40569c42-220e-4c21-8b6c-b12dc4e111c5 {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 01:20:53 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:20:53 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:20:53 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:20:53 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:20:53 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-4be6ad31-e303-4418-9be0-2fd944a0e983 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Acquiring lock "ddfecefc-1e9b-4e6e-9995-855c8a061084" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:20:53 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-4be6ad31-e303-4418-9be0-2fd944a0e983 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Lock "ddfecefc-1e9b-4e6e-9995-855c8a061084" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:20:53 user nova-compute[75226]: DEBUG nova.objects.instance [None req-4be6ad31-e303-4418-9be0-2fd944a0e983 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Lazy-loading 'flavor' on Instance uuid ddfecefc-1e9b-4e6e-9995-855c8a061084 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:20:53 user nova-compute[75226]: DEBUG nova.network.neutron [req-118cc4c5-344d-472e-b1dd-b78d241592e2 req-bea690ee-a7a0-45f6-b6d3-9cb0efb21d23 service nova] [instance: 52fe0a91-9320-47d2-ac83-4f49260a0997] Updated VIF entry in instance network info cache for port 40569c42-220e-4c21-8b6c-b12dc4e111c5. {{(pid=75226) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 01:20:53 user nova-compute[75226]: DEBUG nova.network.neutron [req-118cc4c5-344d-472e-b1dd-b78d241592e2 req-bea690ee-a7a0-45f6-b6d3-9cb0efb21d23 service nova] [instance: 52fe0a91-9320-47d2-ac83-4f49260a0997] Updating instance_info_cache with network_info: [{"id": "40569c42-220e-4c21-8b6c-b12dc4e111c5", "address": "fa:16:3e:ee:92:2e", "network": {"id": "413a22ba-ac08-4a82-ad4a-7be66b8b38d0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-885127095-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "339f5602853149bcad2f8416ee82a0c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40569c42-22", "ovs_interfaceid": "40569c42-220e-4c21-8b6c-b12dc4e111c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:20:53 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-118cc4c5-344d-472e-b1dd-b78d241592e2 req-bea690ee-a7a0-45f6-b6d3-9cb0efb21d23 service nova] Releasing lock "refresh_cache-52fe0a91-9320-47d2-ac83-4f49260a0997" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:20:53 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-4be6ad31-e303-4418-9be0-2fd944a0e983 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Lock "ddfecefc-1e9b-4e6e-9995-855c8a061084" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.084s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:20:54 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-4be6ad31-e303-4418-9be0-2fd944a0e983 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Acquiring lock "ddfecefc-1e9b-4e6e-9995-855c8a061084" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:20:54 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-4be6ad31-e303-4418-9be0-2fd944a0e983 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Lock "ddfecefc-1e9b-4e6e-9995-855c8a061084" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:20:54 user nova-compute[75226]: INFO nova.compute.manager [None req-4be6ad31-e303-4418-9be0-2fd944a0e983 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] [instance: ddfecefc-1e9b-4e6e-9995-855c8a061084] Attaching volume fa7be6d3-d525-4aa3-bcc3-481465f2832b to /dev/vdb
Nov 17 01:20:54 user nova-compute[75226]: DEBUG os_brick.utils [None req-4be6ad31-e303-4418-9be0-2fd944a0e983 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:20:54 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:20:54 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:20:54 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[56e55a70-8d7a-4cad-a3a5-0cf8e1c18a65]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f62857db69\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:20:54 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:20:54 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:20:54 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[489230f3-0097-4663-9532-c4687852d5af]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:20:54 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:20:54 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:20:54 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f250a4a-d700-4371-8a04-80478e4e298a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:20:54 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[48c34692-c946-4305-bae5-6f1ebe351dbf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:20:54 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-4be6ad31-e303-4418-9be0-2fd944a0e983 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Running cmd (subprocess): nvme version {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:20:54 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-4be6ad31-e303-4418-9be0-2fd944a0e983 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] 'nvme version' failed. Not Retrying. {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 01:20:54 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4be6ad31-e303-4418-9be0-2fd944a0e983 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] nvme not present on system {{(pid=75226) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 17 01:20:54 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:20:54 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 01:20:54 user nova-compute[75226]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 17 01:20:54 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[0889f7ee-4e27-41e2-bc79-8cc365355eed]: (4, '') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:20:54 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-4be6ad31-e303-4418-9be0-2fd944a0e983 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75226) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 17 01:20:54 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-4be6ad31-e303-4418-9be0-2fd944a0e983 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75226) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 17 01:20:54 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-4be6ad31-e303-4418-9be0-2fd944a0e983 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] LIGHTOS: no hostnqn found. {{(pid=75226) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 17 01:20:54 user nova-compute[75226]: DEBUG os_brick.utils [None req-4be6ad31-e303-4418-9be0-2fd944a0e983 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f62857db69', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:20:54 user nova-compute[75226]: DEBUG nova.virt.block_device [None req-4be6ad31-e303-4418-9be0-2fd944a0e983 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] [instance: ddfecefc-1e9b-4e6e-9995-855c8a061084] Updating existing volume attachment record: b819d425-cae1-480b-9a49-b5137073ae21 {{(pid=75226) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 17 01:20:54 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:20:54 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:20:54 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:20:54 user nova-compute[75226]: DEBUG nova.compute.manager [req-29f33e03-6a39-457d-b448-24129d72acc2 req-12a6b711-4fc4-4034-8f19-7282c2e04a5c service nova] [instance: 52fe0a91-9320-47d2-ac83-4f49260a0997] Received event network-vif-plugged-40569c42-220e-4c21-8b6c-b12dc4e111c5 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:20:54 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-29f33e03-6a39-457d-b448-24129d72acc2 req-12a6b711-4fc4-4034-8f19-7282c2e04a5c service nova] Acquiring lock "52fe0a91-9320-47d2-ac83-4f49260a0997-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:20:54 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-29f33e03-6a39-457d-b448-24129d72acc2 req-12a6b711-4fc4-4034-8f19-7282c2e04a5c service nova] Lock "52fe0a91-9320-47d2-ac83-4f49260a0997-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:20:54 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-29f33e03-6a39-457d-b448-24129d72acc2 req-12a6b711-4fc4-4034-8f19-7282c2e04a5c service nova] Lock "52fe0a91-9320-47d2-ac83-4f49260a0997-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:20:54 user nova-compute[75226]: DEBUG nova.compute.manager [req-29f33e03-6a39-457d-b448-24129d72acc2 req-12a6b711-4fc4-4034-8f19-7282c2e04a5c service nova] [instance: 52fe0a91-9320-47d2-ac83-4f49260a0997] No waiting events found dispatching network-vif-plugged-40569c42-220e-4c21-8b6c-b12dc4e111c5 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:20:54 user nova-compute[75226]: WARNING nova.compute.manager [req-29f33e03-6a39-457d-b448-24129d72acc2 req-12a6b711-4fc4-4034-8f19-7282c2e04a5c service nova] [instance: 52fe0a91-9320-47d2-ac83-4f49260a0997] Received unexpected event network-vif-plugged-40569c42-220e-4c21-8b6c-b12dc4e111c5 for instance with vm_state building and task_state spawning.
Nov 17 01:20:55 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:20:56 user nova-compute[75226]: DEBUG nova.compute.manager [None req-f900e81b-7ba5-4405-9342-4161914cadd5 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] [instance: 52fe0a91-9320-47d2-ac83-4f49260a0997] Instance event wait completed in 0 seconds for  {{(pid=75226) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 17 01:20:56 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-f900e81b-7ba5-4405-9342-4161914cadd5 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] [instance: 52fe0a91-9320-47d2-ac83-4f49260a0997] Guest created on hypervisor {{(pid=75226) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 17 01:20:56 user nova-compute[75226]: INFO nova.virt.libvirt.driver [-] [instance: 52fe0a91-9320-47d2-ac83-4f49260a0997] Instance spawned successfully.
Nov 17 01:20:56 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-f900e81b-7ba5-4405-9342-4161914cadd5 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] [instance: 52fe0a91-9320-47d2-ac83-4f49260a0997] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 17 01:20:56 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-f900e81b-7ba5-4405-9342-4161914cadd5 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] [instance: 52fe0a91-9320-47d2-ac83-4f49260a0997] Found default for hw_cdrom_bus of ide {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:20:56 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-f900e81b-7ba5-4405-9342-4161914cadd5 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] [instance: 52fe0a91-9320-47d2-ac83-4f49260a0997] Found default for hw_disk_bus of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:20:56 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-f900e81b-7ba5-4405-9342-4161914cadd5 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] [instance: 52fe0a91-9320-47d2-ac83-4f49260a0997] Found default for hw_input_bus of None {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:20:56 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-f900e81b-7ba5-4405-9342-4161914cadd5 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] [instance: 52fe0a91-9320-47d2-ac83-4f49260a0997] Found default for hw_pointer_model of None {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:20:56 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-f900e81b-7ba5-4405-9342-4161914cadd5 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] [instance: 52fe0a91-9320-47d2-ac83-4f49260a0997] Found default for hw_video_model of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:20:56 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-f900e81b-7ba5-4405-9342-4161914cadd5 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] [instance: 52fe0a91-9320-47d2-ac83-4f49260a0997] Found default for hw_vif_model of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:20:56 user nova-compute[75226]: DEBUG nova.compute.manager [req-0a64a343-e849-4057-b5d3-136ee4c2d1e4 req-ca48b2c0-3867-4d8a-a8f2-1d08e10480a0 service nova] [instance: 52fe0a91-9320-47d2-ac83-4f49260a0997] Received event network-vif-plugged-40569c42-220e-4c21-8b6c-b12dc4e111c5 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:20:56 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-0a64a343-e849-4057-b5d3-136ee4c2d1e4 req-ca48b2c0-3867-4d8a-a8f2-1d08e10480a0 service nova] Acquiring lock "52fe0a91-9320-47d2-ac83-4f49260a0997-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:20:56 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-0a64a343-e849-4057-b5d3-136ee4c2d1e4 req-ca48b2c0-3867-4d8a-a8f2-1d08e10480a0 service nova] Lock "52fe0a91-9320-47d2-ac83-4f49260a0997-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:20:56 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-0a64a343-e849-4057-b5d3-136ee4c2d1e4 req-ca48b2c0-3867-4d8a-a8f2-1d08e10480a0 service nova] Lock "52fe0a91-9320-47d2-ac83-4f49260a0997-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:20:56 user nova-compute[75226]: DEBUG nova.compute.manager [req-0a64a343-e849-4057-b5d3-136ee4c2d1e4 req-ca48b2c0-3867-4d8a-a8f2-1d08e10480a0 service nova] [instance: 52fe0a91-9320-47d2-ac83-4f49260a0997] No waiting events found dispatching network-vif-plugged-40569c42-220e-4c21-8b6c-b12dc4e111c5 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:20:56 user nova-compute[75226]: WARNING nova.compute.manager [req-0a64a343-e849-4057-b5d3-136ee4c2d1e4 req-ca48b2c0-3867-4d8a-a8f2-1d08e10480a0 service nova] [instance: 52fe0a91-9320-47d2-ac83-4f49260a0997] Received unexpected event network-vif-plugged-40569c42-220e-4c21-8b6c-b12dc4e111c5 for instance with vm_state building and task_state spawning.
Nov 17 01:20:56 user nova-compute[75226]: INFO nova.compute.manager [None req-f900e81b-7ba5-4405-9342-4161914cadd5 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] [instance: 52fe0a91-9320-47d2-ac83-4f49260a0997] Took 7.19 seconds to spawn the instance on the hypervisor.
Nov 17 01:20:56 user nova-compute[75226]: DEBUG nova.compute.manager [None req-f900e81b-7ba5-4405-9342-4161914cadd5 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] [instance: 52fe0a91-9320-47d2-ac83-4f49260a0997] Checking state {{(pid=75226) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 01:20:56 user nova-compute[75226]: INFO nova.compute.manager [None req-f900e81b-7ba5-4405-9342-4161914cadd5 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] [instance: 52fe0a91-9320-47d2-ac83-4f49260a0997] Took 8.20 seconds to build instance.
Nov 17 01:20:56 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-f900e81b-7ba5-4405-9342-4161914cadd5 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] Lock "52fe0a91-9320-47d2-ac83-4f49260a0997" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.682s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:20:57 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:20:57 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:20:57 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:21:00 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4be6ad31-e303-4418-9be0-2fd944a0e983 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] [instance: ddfecefc-1e9b-4e6e-9995-855c8a061084] Calling os-brick to attach iSCSI Volume {{(pid=75226) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 17 01:21:00 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-4be6ad31-e303-4418-9be0-2fd944a0e983 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc4cc36b490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fa7be6d3-d525-4aa3-bcc3-481465f2832b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nBQYPyRW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:21:00 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-4be6ad31-e303-4418-9be0-2fd944a0e983 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:21:00 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-4be6ad31-e303-4418-9be0-2fd944a0e983 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:21:00 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-4be6ad31-e303-4418-9be0-2fd944a0e983 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:21:00 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-4be6ad31-e303-4418-9be0-2fd944a0e983 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:21:00 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-4be6ad31-e303-4418-9be0-2fd944a0e983 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fa7be6d3-d525-4aa3-bcc3-481465f2832b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:21:00 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-4be6ad31-e303-4418-9be0-2fd944a0e983 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fa7be6d3-d525-4aa3-bcc3-481465f2832b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:21:00 user nova-compute[75226]: INFO os_brick.initiator.connectors.iscsi [None req-4be6ad31-e303-4418-9be0-2fd944a0e983 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 17 01:21:00 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa7be6d3-d525-4aa3-bcc3-481465f2832b -p 172.16.0.220:3260 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:21:00 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa7be6d3-d525-4aa3-bcc3-481465f2832b -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:21:00 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[02b293cf-ec8f-4019-83fd-3548b52d0ca5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:21:00 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-4be6ad31-e303-4418-9be0-2fd944a0e983 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 17 01:21:00 user nova-compute[75226]:  {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:21:00 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa7be6d3-d525-4aa3-bcc3-481465f2832b -p 172.16.0.220:3260 --interface default --op new {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:21:00 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa7be6d3-d525-4aa3-bcc3-481465f2832b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:21:00 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[8064e630-d59e-424a-ab6c-c7f8770393e3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fa7be6d3-d525-4aa3-bcc3-481465f2832b] added\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:21:00 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-4be6ad31-e303-4418-9be0-2fd944a0e983 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fa7be6d3-d525-4aa3-bcc3-481465f2832b] added
Nov 17 01:21:00 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:21:00 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa7be6d3-d525-4aa3-bcc3-481465f2832b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:21:00 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa7be6d3-d525-4aa3-bcc3-481465f2832b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:21:00 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcdd2725-7b11-4459-a2c7-23c69c3a4906]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:21:00 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-4be6ad31-e303-4418-9be0-2fd944a0e983 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:21:00 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa7be6d3-d525-4aa3-bcc3-481465f2832b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:21:00 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa7be6d3-d525-4aa3-bcc3-481465f2832b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:21:00 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[e70a58e4-badb-4134-af65-91b52d715766]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:21:00 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-4be6ad31-e303-4418-9be0-2fd944a0e983 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:21:00 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa7be6d3-d525-4aa3-bcc3-481465f2832b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nBQYPyRW {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:21:00 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa7be6d3-d525-4aa3-bcc3-481465f2832b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nBQYPyRW" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:21:00 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[566b2f2f-2919-4baf-a263-11b87f3216e7]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:21:00 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-4be6ad31-e303-4418-9be0-2fd944a0e983 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nBQYPyRW'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:21:00 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa7be6d3-d525-4aa3-bcc3-481465f2832b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:21:00 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:21:00 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa7be6d3-d525-4aa3-bcc3-481465f2832b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:21:00 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[d609dad8-2c86-4d2e-90d5-5c92f7ccac72]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:21:00 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-4be6ad31-e303-4418-9be0-2fd944a0e983 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:21:00 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:21:00 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:21:00 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e4dbec7-41b7-40f3-814c-127f66dae970]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:21:00 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-4be6ad31-e303-4418-9be0-2fd944a0e983 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2 (non-flash)
Nov 17 01:21:00 user nova-compute[75226]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)
Nov 17 01:21:00 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:21:00 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-4be6ad31-e303-4418-9be0-2fd944a0e983 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2 (non-flash)
Nov 17 01:21:00 user nova-compute[75226]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)
Nov 17 01:21:00 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:21:00 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa7be6d3-d525-4aa3-bcc3-481465f2832b -p 172.16.0.220:3260 --login {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:21:00 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:21:00 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa7be6d3-d525-4aa3-bcc3-481465f2832b -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:21:00 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[944ca90f-390d-4064-8e34-f12f1fc09768]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fa7be6d3-d525-4aa3-bcc3-481465f2832b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fa7be6d3-d525-4aa3-bcc3-481465f2832b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:21:00 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-4be6ad31-e303-4418-9be0-2fd944a0e983 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fa7be6d3-d525-4aa3-bcc3-481465f2832b, portal: 172.16.0.220,3260]
Nov 17 01:21:00 user nova-compute[75226]: Login to [iface: default, target: iqn.2010-10.org.openstack:fa7be6d3-d525-4aa3-bcc3-481465f2832b, portal: 172.16.0.220,3260] successful.
Nov 17 01:21:00 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:21:00 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa7be6d3-d525-4aa3-bcc3-481465f2832b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:21:00 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa7be6d3-d525-4aa3-bcc3-481465f2832b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:21:00 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[1480ef62-a7c7-416f-94d3-4381b4174953]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:21:00 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-4be6ad31-e303-4418-9be0-2fd944a0e983 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:21:00 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:21:00 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:21:00 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[5416b3a1-a5da-4aee-8a3f-d75024a0ec3e]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa7be6d3-d525-4aa3-bcc3-481465f2832b (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:21:00 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-4be6ad31-e303-4418-9be0-2fd944a0e983 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2 (non-flash)
Nov 17 01:21:00 user nova-compute[75226]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)
Nov 17 01:21:00 user nova-compute[75226]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa7be6d3-d525-4aa3-bcc3-481465f2832b (non-flash)
Nov 17 01:21:00 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:21:00 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-4be6ad31-e303-4418-9be0-2fd944a0e983 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2 (non-flash)
Nov 17 01:21:00 user nova-compute[75226]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)
Nov 17 01:21:00 user nova-compute[75226]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa7be6d3-d525-4aa3-bcc3-481465f2832b (non-flash)
Nov 17 01:21:00 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:21:00 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-4be6ad31-e303-4418-9be0-2fd944a0e983 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fa7be6d3-d525-4aa3-bcc3-481465f2832b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.308s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:21:00 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-4be6ad31-e303-4418-9be0-2fd944a0e983 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Connected to 172.16.0.220:3260 {{(pid=75226) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 17 01:21:00 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-4be6ad31-e303-4418-9be0-2fd944a0e983 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] HCTL ('35', '-', '-', 0) found on session 17 with lun 0 {{(pid=75226) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 17 01:21:00 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-4be6ad31-e303-4418-9be0-2fd944a0e983 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75226) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 17 01:21:00 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:21:00 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:21:00 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b0aea58-6540-484c-9869-d81029e8678a]: (4, ('- - 0', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:21:00 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-4be6ad31-e303-4418-9be0-2fd944a0e983 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Searching for a device in session 17 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75226) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 01:21:00 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-4be6ad31-e303-4418-9be0-2fd944a0e983 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:fa7be6d3-d525-4aa3-bcc3-481465f2832b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nBQYPyRW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75226) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 17 01:21:01 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-4be6ad31-e303-4418-9be0-2fd944a0e983 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.349s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:21:01 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-4be6ad31-e303-4418-9be0-2fd944a0e983 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] <== connect_volume: return (1350ms) {'type': 'block', 'scsi_wwn': '23835616564346632', 'path': '/dev/sdd'} {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:21:01 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4be6ad31-e303-4418-9be0-2fd944a0e983 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] [instance: ddfecefc-1e9b-4e6e-9995-855c8a061084] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23835616564346632', 'path': '/dev/sdd'} {{(pid=75226) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 17 01:21:01 user nova-compute[75226]: DEBUG nova.objects.instance [None req-4be6ad31-e303-4418-9be0-2fd944a0e983 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Lazy-loading 'flavor' on Instance uuid ddfecefc-1e9b-4e6e-9995-855c8a061084 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:21:01 user nova-compute[75226]: DEBUG nova.virt.libvirt.guest [None req-4be6ad31-e303-4418-9be0-2fd944a0e983 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] attach device xml: <disk type="block" device="disk">
Nov 17 01:21:01 user nova-compute[75226]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 01:21:01 user nova-compute[75226]:   <source dev="/dev/sdd"/>
Nov 17 01:21:01 user nova-compute[75226]:   <target dev="vdb" bus="virtio"/>
Nov 17 01:21:01 user nova-compute[75226]:   <serial>fa7be6d3-d525-4aa3-bcc3-481465f2832b</serial>
Nov 17 01:21:01 user nova-compute[75226]: </disk>
Nov 17 01:21:01 user nova-compute[75226]:  {{(pid=75226) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 17 01:21:02 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-4be6ad31-e303-4418-9be0-2fd944a0e983 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] No BDM found with device name vda, not building metadata. {{(pid=75226) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 01:21:02 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-4be6ad31-e303-4418-9be0-2fd944a0e983 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75226) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 01:21:02 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-4be6ad31-e303-4418-9be0-2fd944a0e983 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] No VIF found with MAC fa:16:3e:94:21:00, not building metadata {{(pid=75226) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 01:21:02 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:21:02 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-4be6ad31-e303-4418-9be0-2fd944a0e983 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Lock "ddfecefc-1e9b-4e6e-9995-855c8a061084" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.320s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:21:02 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:21:03 user nova-compute[75226]: INFO nova.compute.manager [None req-1aba04ba-8eed-4c99-9d33-3ece744f1c59 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] [instance: ddfecefc-1e9b-4e6e-9995-855c8a061084] Rescuing
Nov 17 01:21:03 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-1aba04ba-8eed-4c99-9d33-3ece744f1c59 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Acquiring lock "refresh_cache-ddfecefc-1e9b-4e6e-9995-855c8a061084" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:21:03 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-1aba04ba-8eed-4c99-9d33-3ece744f1c59 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Acquired lock "refresh_cache-ddfecefc-1e9b-4e6e-9995-855c8a061084" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:21:03 user nova-compute[75226]: DEBUG nova.network.neutron [None req-1aba04ba-8eed-4c99-9d33-3ece744f1c59 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] [instance: ddfecefc-1e9b-4e6e-9995-855c8a061084] Building network info cache for instance {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 01:21:03 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:21:04 user nova-compute[75226]: DEBUG nova.network.neutron [None req-1aba04ba-8eed-4c99-9d33-3ece744f1c59 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] [instance: ddfecefc-1e9b-4e6e-9995-855c8a061084] Updating instance_info_cache with network_info: [{"id": "f9a7562b-de63-4374-b43b-18e3cb3af710", "address": "fa:16:3e:94:21:00", "network": {"id": "8450ab2c-4f24-46cc-a6ec-644c02e2b3da", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-385219532-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6869af66e0cc47bf9cca02ea9b688a6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9a7562b-de", "ovs_interfaceid": "f9a7562b-de63-4374-b43b-18e3cb3af710", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:21:04 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-1aba04ba-8eed-4c99-9d33-3ece744f1c59 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Releasing lock "refresh_cache-ddfecefc-1e9b-4e6e-9995-855c8a061084" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:21:04 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:21:04 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:21:04 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:21:04 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:21:04 user nova-compute[75226]: DEBUG nova.compute.manager [req-bf4eecdc-73a6-447c-ab01-924efc2047c2 req-c62096bc-7d19-4265-bc70-a7cd79f948a6 service nova] [instance: ddfecefc-1e9b-4e6e-9995-855c8a061084] Received event network-vif-unplugged-f9a7562b-de63-4374-b43b-18e3cb3af710 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:21:04 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-bf4eecdc-73a6-447c-ab01-924efc2047c2 req-c62096bc-7d19-4265-bc70-a7cd79f948a6 service nova] Acquiring lock "ddfecefc-1e9b-4e6e-9995-855c8a061084-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:21:04 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-bf4eecdc-73a6-447c-ab01-924efc2047c2 req-c62096bc-7d19-4265-bc70-a7cd79f948a6 service nova] Lock "ddfecefc-1e9b-4e6e-9995-855c8a061084-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:21:04 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-bf4eecdc-73a6-447c-ab01-924efc2047c2 req-c62096bc-7d19-4265-bc70-a7cd79f948a6 service nova] Lock "ddfecefc-1e9b-4e6e-9995-855c8a061084-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:21:04 user nova-compute[75226]: DEBUG nova.compute.manager [req-bf4eecdc-73a6-447c-ab01-924efc2047c2 req-c62096bc-7d19-4265-bc70-a7cd79f948a6 service nova] [instance: ddfecefc-1e9b-4e6e-9995-855c8a061084] No waiting events found dispatching network-vif-unplugged-f9a7562b-de63-4374-b43b-18e3cb3af710 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:21:04 user nova-compute[75226]: WARNING nova.compute.manager [req-bf4eecdc-73a6-447c-ab01-924efc2047c2 req-c62096bc-7d19-4265-bc70-a7cd79f948a6 service nova] [instance: ddfecefc-1e9b-4e6e-9995-855c8a061084] Received unexpected event network-vif-unplugged-f9a7562b-de63-4374-b43b-18e3cb3af710 for instance with vm_state active and task_state rescuing.
Nov 17 01:21:05 user nova-compute[75226]: INFO nova.virt.libvirt.driver [-] [instance: ddfecefc-1e9b-4e6e-9995-855c8a061084] Instance destroyed successfully.
Nov 17 01:21:05 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-1aba04ba-8eed-4c99-9d33-3ece744f1c59 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] [instance: ddfecefc-1e9b-4e6e-9995-855c8a061084] Attempting a stable device rescue
Nov 17 01:21:05 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-1aba04ba-8eed-4c99-9d33-3ece744f1c59 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=75226) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 17 01:21:05 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-1aba04ba-8eed-4c99-9d33-3ece744f1c59 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] [instance: ddfecefc-1e9b-4e6e-9995-855c8a061084] Instance directory exists: not creating {{(pid=75226) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 17 01:21:05 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-1aba04ba-8eed-4c99-9d33-3ece744f1c59 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] [instance: ddfecefc-1e9b-4e6e-9995-855c8a061084] Creating image(s)
Nov 17 01:21:05 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-1aba04ba-8eed-4c99-9d33-3ece744f1c59 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Acquiring lock "/opt/stack/data/nova/instances/ddfecefc-1e9b-4e6e-9995-855c8a061084/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:21:05 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-1aba04ba-8eed-4c99-9d33-3ece744f1c59 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Lock "/opt/stack/data/nova/instances/ddfecefc-1e9b-4e6e-9995-855c8a061084/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:21:05 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-1aba04ba-8eed-4c99-9d33-3ece744f1c59 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Lock "/opt/stack/data/nova/instances/ddfecefc-1e9b-4e6e-9995-855c8a061084/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:21:05 user nova-compute[75226]: DEBUG nova.objects.instance [None req-1aba04ba-8eed-4c99-9d33-3ece744f1c59 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Lazy-loading 'trusted_certs' on Instance uuid ddfecefc-1e9b-4e6e-9995-855c8a061084 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:21:05 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-1aba04ba-8eed-4c99-9d33-3ece744f1c59 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Acquiring lock "7fdb905bd01258dcf4217958e5bd5218074db835" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:21:05 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-1aba04ba-8eed-4c99-9d33-3ece744f1c59 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Lock "7fdb905bd01258dcf4217958e5bd5218074db835" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:21:06 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-1aba04ba-8eed-4c99-9d33-3ece744f1c59 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7fdb905bd01258dcf4217958e5bd5218074db835.part --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:21:06 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-1aba04ba-8eed-4c99-9d33-3ece744f1c59 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7fdb905bd01258dcf4217958e5bd5218074db835.part --force-share --output=json" returned: 0 in 0.235s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:21:06 user nova-compute[75226]: DEBUG nova.virt.images [None req-1aba04ba-8eed-4c99-9d33-3ece744f1c59 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] 0abec773-7388-4997-9a18-fe71b77f8886 was qcow2, converting to raw {{(pid=75226) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 17 01:21:06 user nova-compute[75226]: DEBUG nova.privsep.utils [None req-1aba04ba-8eed-4c99-9d33-3ece744f1c59 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75226) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 17 01:21:06 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-1aba04ba-8eed-4c99-9d33-3ece744f1c59 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7fdb905bd01258dcf4217958e5bd5218074db835.part /opt/stack/data/nova/instances/_base/7fdb905bd01258dcf4217958e5bd5218074db835.converted {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:21:06 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:21:06 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:21:06 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:21:06 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Starting heal instance info cache {{(pid=75226) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 17 01:21:06 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "refresh_cache-724b81dd-4531-4c99-850d-0bfcbfdf7bd4" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:21:06 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquired lock "refresh_cache-724b81dd-4531-4c99-850d-0bfcbfdf7bd4" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:21:06 user nova-compute[75226]: DEBUG nova.network.neutron [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] [instance: 724b81dd-4531-4c99-850d-0bfcbfdf7bd4] Forcefully refreshing network info cache for instance {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 17 01:21:06 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-1aba04ba-8eed-4c99-9d33-3ece744f1c59 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7fdb905bd01258dcf4217958e5bd5218074db835.part /opt/stack/data/nova/instances/_base/7fdb905bd01258dcf4217958e5bd5218074db835.converted" returned: 0 in 0.286s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:21:06 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-1aba04ba-8eed-4c99-9d33-3ece744f1c59 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7fdb905bd01258dcf4217958e5bd5218074db835.converted --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:21:06 user nova-compute[75226]: DEBUG nova.compute.manager [req-fdc27841-8d0b-4db1-be2f-7f031943b6c4 req-9bc6016e-0f80-44c3-be8b-b7b05138f978 service nova] [instance: ddfecefc-1e9b-4e6e-9995-855c8a061084] Received event network-vif-plugged-f9a7562b-de63-4374-b43b-18e3cb3af710 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:21:06 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-fdc27841-8d0b-4db1-be2f-7f031943b6c4 req-9bc6016e-0f80-44c3-be8b-b7b05138f978 service nova] Acquiring lock "ddfecefc-1e9b-4e6e-9995-855c8a061084-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:21:06 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-fdc27841-8d0b-4db1-be2f-7f031943b6c4 req-9bc6016e-0f80-44c3-be8b-b7b05138f978 service nova] Lock "ddfecefc-1e9b-4e6e-9995-855c8a061084-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:21:06 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-fdc27841-8d0b-4db1-be2f-7f031943b6c4 req-9bc6016e-0f80-44c3-be8b-b7b05138f978 service nova] Lock "ddfecefc-1e9b-4e6e-9995-855c8a061084-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:21:06 user nova-compute[75226]: DEBUG nova.compute.manager [req-fdc27841-8d0b-4db1-be2f-7f031943b6c4 req-9bc6016e-0f80-44c3-be8b-b7b05138f978 service nova] [instance: ddfecefc-1e9b-4e6e-9995-855c8a061084] No waiting events found dispatching network-vif-plugged-f9a7562b-de63-4374-b43b-18e3cb3af710 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:21:06 user nova-compute[75226]: WARNING nova.compute.manager [req-fdc27841-8d0b-4db1-be2f-7f031943b6c4 req-9bc6016e-0f80-44c3-be8b-b7b05138f978 service nova] [instance: ddfecefc-1e9b-4e6e-9995-855c8a061084] Received unexpected event network-vif-plugged-f9a7562b-de63-4374-b43b-18e3cb3af710 for instance with vm_state active and task_state rescuing.
Nov 17 01:21:06 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-1aba04ba-8eed-4c99-9d33-3ece744f1c59 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7fdb905bd01258dcf4217958e5bd5218074db835.converted --force-share --output=json" returned: 0 in 0.175s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:21:06 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-1aba04ba-8eed-4c99-9d33-3ece744f1c59 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Lock "7fdb905bd01258dcf4217958e5bd5218074db835" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.704s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:21:06 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-1aba04ba-8eed-4c99-9d33-3ece744f1c59 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Acquiring lock "7fdb905bd01258dcf4217958e5bd5218074db835" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:21:06 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-1aba04ba-8eed-4c99-9d33-3ece744f1c59 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Lock "7fdb905bd01258dcf4217958e5bd5218074db835" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:21:06 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-1aba04ba-8eed-4c99-9d33-3ece744f1c59 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7fdb905bd01258dcf4217958e5bd5218074db835 --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:21:07 user nova-compute[75226]: DEBUG nova.network.neutron [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] [instance: 724b81dd-4531-4c99-850d-0bfcbfdf7bd4] Updating instance_info_cache with network_info: [{"id": "f9692d93-cc90-464e-a8ef-abb2a5bb8fe0", "address": "fa:16:3e:ac:88:c8", "network": {"id": "1c1e8b70-ab07-4bf6-896b-f8779c33ac07", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1634201097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a364d502d8948ff8b255dd2531b6218", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9692d93-cc", "ovs_interfaceid": "f9692d93-cc90-464e-a8ef-abb2a5bb8fe0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:21:07 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:21:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-1aba04ba-8eed-4c99-9d33-3ece744f1c59 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7fdb905bd01258dcf4217958e5bd5218074db835 --force-share --output=json" returned: 0 in 0.195s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:21:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-1aba04ba-8eed-4c99-9d33-3ece744f1c59 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7fdb905bd01258dcf4217958e5bd5218074db835,backing_fmt=raw /opt/stack/data/nova/instances/ddfecefc-1e9b-4e6e-9995-855c8a061084/disk.rescue {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:21:07 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Releasing lock "refresh_cache-724b81dd-4531-4c99-850d-0bfcbfdf7bd4" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:21:07 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] [instance: 724b81dd-4531-4c99-850d-0bfcbfdf7bd4] Updated the network info_cache for instance {{(pid=75226) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 17 01:21:07 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:21:07 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:21:07 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:21:07 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:21:07 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:21:07 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:21:07 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75226) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 17 01:21:07 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:21:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-1aba04ba-8eed-4c99-9d33-3ece744f1c59 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7fdb905bd01258dcf4217958e5bd5218074db835,backing_fmt=raw /opt/stack/data/nova/instances/ddfecefc-1e9b-4e6e-9995-855c8a061084/disk.rescue" returned: 0 in 0.058s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:21:07 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-1aba04ba-8eed-4c99-9d33-3ece744f1c59 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Lock "7fdb905bd01258dcf4217958e5bd5218074db835" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.262s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:21:07 user nova-compute[75226]: DEBUG nova.objects.instance [None req-1aba04ba-8eed-4c99-9d33-3ece744f1c59 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Lazy-loading 'migration_context' on Instance uuid ddfecefc-1e9b-4e6e-9995-855c8a061084 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:21:07 user nova-compute[75226]: DEBUG nova.objects.base [None req-1aba04ba-8eed-4c99-9d33-3ece744f1c59 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Object Instance<ddfecefc-1e9b-4e6e-9995-855c8a061084> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75226) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 17 01:21:07 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-1aba04ba-8eed-4c99-9d33-3ece744f1c59 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] [instance: ddfecefc-1e9b-4e6e-9995-855c8a061084] Created local disks {{(pid=75226) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 17 01:21:07 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-1aba04ba-8eed-4c99-9d33-3ece744f1c59 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] [instance: ddfecefc-1e9b-4e6e-9995-855c8a061084] Start _get_guest_xml network_info=[{"id": "f9a7562b-de63-4374-b43b-18e3cb3af710", "address": "fa:16:3e:94:21:00", "network": {"id": "8450ab2c-4f24-46cc-a6ec-644c02e2b3da", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-385219532-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-385219532-network", "vif_mac": "fa:16:3e:94:21:00"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6869af66e0cc47bf9cca02ea9b688a6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9a7562b-de", "ovs_interfaceid": "f9a7562b-de63-4374-b43b-18e3cb3af710", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T01:13:22Z,direct_url=<?>,disk_format='qcow2',id=0b369aea-6f3f-4690-9f01-229b90ab6310,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4e110cbf9a84362a6864a7732c435a1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T01:13:23Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '0abec773-7388-4997-9a18-fe71b77f8886', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '0b369aea-6f3f-4690-9f01-229b90ab6310'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'boot_index': None, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:fa7be6d3-d525-4aa3-bcc3-481465f2832b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nBQYPyRW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': 'ddfecefc-1e9b-4e6e-9995-855c8a061084', 'attached_at': '', 'detached_at': '', 'volume_id': 'fa7be6d3-d525-4aa3-bcc3-481465f2832b', 'serial': 'fa7be6d3-d525-4aa3-bcc3-481465f2832b'}, 'attachment_id': 'b819d425-cae1-480b-9a49-b5137073ae21', 'device_type': 'disk', 'volume_type': None} {{(pid=75226) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 17 01:21:07 user nova-compute[75226]: DEBUG nova.objects.instance [None req-1aba04ba-8eed-4c99-9d33-3ece744f1c59 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Lazy-loading 'resources' on Instance uuid ddfecefc-1e9b-4e6e-9995-855c8a061084 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:21:07 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:21:07 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:21:07 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:21:07 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75226) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 17 01:21:07 user nova-compute[75226]: DEBUG nova.objects.base [None req-1aba04ba-8eed-4c99-9d33-3ece744f1c59 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Object Instance<ddfecefc-1e9b-4e6e-9995-855c8a061084> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75226) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 17 01:21:07 user nova-compute[75226]: DEBUG nova.objects.instance [None req-1aba04ba-8eed-4c99-9d33-3ece744f1c59 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Lazy-loading 'numa_topology' on Instance uuid ddfecefc-1e9b-4e6e-9995-855c8a061084 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:21:07 user nova-compute[75226]: DEBUG nova.objects.base [None req-1aba04ba-8eed-4c99-9d33-3ece744f1c59 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Object Instance<ddfecefc-1e9b-4e6e-9995-855c8a061084> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75226) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 17 01:21:07 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-1aba04ba-8eed-4c99-9d33-3ece744f1c59 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:21:07 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-1aba04ba-8eed-4c99-9d33-3ece744f1c59 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:21:07 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-1aba04ba-8eed-4c99-9d33-3ece744f1c59 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75226) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 17 01:21:07 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-1aba04ba-8eed-4c99-9d33-3ece744f1c59 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] CPU controller missing on host. {{(pid=75226) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 17 01:21:07 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-1aba04ba-8eed-4c99-9d33-3ece744f1c59 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75226) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 17 01:21:07 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-1aba04ba-8eed-4c99-9d33-3ece744f1c59 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] CPU controller found on host. {{(pid=75226) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 17 01:21:07 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-1aba04ba-8eed-4c99-9d33-3ece744f1c59 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75226) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 17 01:21:07 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-1aba04ba-8eed-4c99-9d33-3ece744f1c59 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-17T01:13:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T01:13:22Z,direct_url=<?>,disk_format='qcow2',id=0b369aea-6f3f-4690-9f01-229b90ab6310,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4e110cbf9a84362a6864a7732c435a1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T01:13:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 17 01:21:07 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-1aba04ba-8eed-4c99-9d33-3ece744f1c59 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Flavor limits 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 17 01:21:07 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-1aba04ba-8eed-4c99-9d33-3ece744f1c59 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Image limits 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 17 01:21:07 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-1aba04ba-8eed-4c99-9d33-3ece744f1c59 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Flavor pref 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 17 01:21:07 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-1aba04ba-8eed-4c99-9d33-3ece744f1c59 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Image pref 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 17 01:21:07 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-1aba04ba-8eed-4c99-9d33-3ece744f1c59 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 17 01:21:07 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-1aba04ba-8eed-4c99-9d33-3ece744f1c59 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 17 01:21:07 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-1aba04ba-8eed-4c99-9d33-3ece744f1c59 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75226) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 17 01:21:07 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-1aba04ba-8eed-4c99-9d33-3ece744f1c59 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Got 1 possible topologies {{(pid=75226) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 17 01:21:07 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-1aba04ba-8eed-4c99-9d33-3ece744f1c59 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 17 01:21:07 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-1aba04ba-8eed-4c99-9d33-3ece744f1c59 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 17 01:21:07 user nova-compute[75226]: DEBUG nova.objects.instance [None req-1aba04ba-8eed-4c99-9d33-3ece744f1c59 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Lazy-loading 'vcpu_model' on Instance uuid ddfecefc-1e9b-4e6e-9995-855c8a061084 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:21:07 user nova-compute[75226]: DEBUG nova.objects.base [None req-1aba04ba-8eed-4c99-9d33-3ece744f1c59 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Object Instance<ddfecefc-1e9b-4e6e-9995-855c8a061084> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75226) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 17 01:21:07 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1aba04ba-8eed-4c99-9d33-3ece744f1c59 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] [instance: ddfecefc-1e9b-4e6e-9995-855c8a061084] Calling os-brick to attach iSCSI Volume {{(pid=75226) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 17 01:21:07 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aba04ba-8eed-4c99-9d33-3ece744f1c59 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc4cc36b490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fa7be6d3-d525-4aa3-bcc3-481465f2832b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nBQYPyRW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:21:07 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-1aba04ba-8eed-4c99-9d33-3ece744f1c59 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:21:07 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-1aba04ba-8eed-4c99-9d33-3ece744f1c59 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:21:07 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-1aba04ba-8eed-4c99-9d33-3ece744f1c59 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:21:07 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-1aba04ba-8eed-4c99-9d33-3ece744f1c59 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:21:07 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-1aba04ba-8eed-4c99-9d33-3ece744f1c59 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fa7be6d3-d525-4aa3-bcc3-481465f2832b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:21:07 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-1aba04ba-8eed-4c99-9d33-3ece744f1c59 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fa7be6d3-d525-4aa3-bcc3-481465f2832b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:21:07 user nova-compute[75226]: INFO os_brick.initiator.connectors.iscsi [None req-1aba04ba-8eed-4c99-9d33-3ece744f1c59 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 17 01:21:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa7be6d3-d525-4aa3-bcc3-481465f2832b -p 172.16.0.220:3260 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:21:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa7be6d3-d525-4aa3-bcc3-481465f2832b -p 172.16.0.220:3260" returned: 0 in 0.026s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:21:07 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ed64555-261a-4b3a-87c0-d4e6107fc32d]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:fa7be6d3-d525-4aa3-bcc3-481465f2832b\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = nBQYPyRW\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:21:07 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aba04ba-8eed-4c99-9d33-3ece744f1c59 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 17 01:21:07 user nova-compute[75226]: node.name = iqn.2010-10.org.openstack:fa7be6d3-d525-4aa3-bcc3-481465f2832b
Nov 17 01:21:07 user nova-compute[75226]: node.tpgt = -1
Nov 17 01:21:07 user nova-compute[75226]: node.startup = automatic
Nov 17 01:21:07 user nova-compute[75226]: node.leading_login = No
Nov 17 01:21:07 user nova-compute[75226]: iface.iscsi_ifacename = default
Nov 17 01:21:07 user nova-compute[75226]: iface.net_ifacename = <empty>
Nov 17 01:21:07 user nova-compute[75226]: iface.ipaddress = <empty>
Nov 17 01:21:07 user nova-compute[75226]: iface.prefix_len = 0
Nov 17 01:21:07 user nova-compute[75226]: iface.hwaddress = <empty>
Nov 17 01:21:07 user nova-compute[75226]: iface.transport_name = tcp
Nov 17 01:21:07 user nova-compute[75226]: iface.initiatorname = <empty>
Nov 17 01:21:07 user nova-compute[75226]: iface.state = <empty>
Nov 17 01:21:07 user nova-compute[75226]: iface.vlan_id = 0
Nov 17 01:21:07 user nova-compute[75226]: iface.vlan_priority = 0
Nov 17 01:21:07 user nova-compute[75226]: iface.vlan_state = <empty>
Nov 17 01:21:07 user nova-compute[75226]: iface.iface_num = 0
Nov 17 01:21:07 user nova-compute[75226]: iface.mtu = 0
Nov 17 01:21:07 user nova-compute[75226]: iface.port = 0
Nov 17 01:21:07 user nova-compute[75226]: iface.bootproto = <empty>
Nov 17 01:21:07 user nova-compute[75226]: iface.subnet_mask = <empty>
Nov 17 01:21:07 user nova-compute[75226]: iface.gateway = <empty>
Nov 17 01:21:07 user nova-compute[75226]: iface.dhcp_alt_client_id_state = <empty>
Nov 17 01:21:07 user nova-compute[75226]: iface.dhcp_alt_client_id = <empty>
Nov 17 01:21:07 user nova-compute[75226]: iface.dhcp_dns = <empty>
Nov 17 01:21:07 user nova-compute[75226]: iface.dhcp_learn_iqn = <empty>
Nov 17 01:21:07 user nova-compute[75226]: iface.dhcp_req_vendor_id_state = <empty>
Nov 17 01:21:07 user nova-compute[75226]: iface.dhcp_vendor_id_state = <empty>
Nov 17 01:21:07 user nova-compute[75226]: iface.dhcp_vendor_id = <empty>
Nov 17 01:21:07 user nova-compute[75226]: iface.dhcp_slp_da = <empty>
Nov 17 01:21:07 user nova-compute[75226]: iface.fragmentation = <empty>
Nov 17 01:21:07 user nova-compute[75226]: iface.gratuitous_arp = <empty>
Nov 17 01:21:07 user nova-compute[75226]: iface.incoming_forwarding = <empty>
Nov 17 01:21:07 user nova-compute[75226]: iface.tos_state = <empty>
Nov 17 01:21:07 user nova-compute[75226]: iface.tos = 0
Nov 17 01:21:07 user nova-compute[75226]: iface.ttl = 0
Nov 17 01:21:07 user nova-compute[75226]: iface.delayed_ack = <empty>
Nov 17 01:21:07 user nova-compute[75226]: iface.tcp_nagle = <empty>
Nov 17 01:21:07 user nova-compute[75226]: iface.tcp_wsf_state = <empty>
Nov 17 01:21:07 user nova-compute[75226]: iface.tcp_wsf = 0
Nov 17 01:21:07 user nova-compute[75226]: iface.tcp_timer_scale = 0
Nov 17 01:21:07 user nova-compute[75226]: iface.tcp_timestamp = <empty>
Nov 17 01:21:07 user nova-compute[75226]: iface.redirect = <empty>
Nov 17 01:21:07 user nova-compute[75226]: iface.def_task_mgmt_timeout = 0
Nov 17 01:21:07 user nova-compute[75226]: iface.header_digest = <empty>
Nov 17 01:21:07 user nova-compute[75226]: iface.data_digest = <empty>
Nov 17 01:21:07 user nova-compute[75226]: iface.immediate_data = <empty>
Nov 17 01:21:07 user nova-compute[75226]: iface.initial_r2t = <empty>
Nov 17 01:21:07 user nova-compute[75226]: iface.data_seq_inorder = <empty>
Nov 17 01:21:07 user nova-compute[75226]: iface.data_pdu_inorder = <empty>
Nov 17 01:21:07 user nova-compute[75226]: iface.erl = 0
Nov 17 01:21:07 user nova-compute[75226]: iface.max_receive_data_len = 0
Nov 17 01:21:07 user nova-compute[75226]: iface.first_burst_len = 0
Nov 17 01:21:07 user nova-compute[75226]: iface.max_outstanding_r2t = 0
Nov 17 01:21:07 user nova-compute[75226]: iface.max_burst_len = 0
Nov 17 01:21:07 user nova-compute[75226]: iface.chap_auth = <empty>
Nov 17 01:21:07 user nova-compute[75226]: iface.bidi_chap = <empty>
Nov 17 01:21:07 user nova-compute[75226]: iface.strict_login_compliance = <empty>
Nov 17 01:21:07 user nova-compute[75226]: iface.discovery_auth = <empty>
Nov 17 01:21:07 user nova-compute[75226]: iface.discovery_logout = <empty>
Nov 17 01:21:07 user nova-compute[75226]: node.discovery_address = <empty>
Nov 17 01:21:07 user nova-compute[75226]: node.discovery_port = 0
Nov 17 01:21:07 user nova-compute[75226]: node.discovery_type = static
Nov 17 01:21:07 user nova-compute[75226]: node.session.initial_cmdsn = 0
Nov 17 01:21:07 user nova-compute[75226]: node.session.initial_login_retry_max = 8
Nov 17 01:21:07 user nova-compute[75226]: node.session.xmit_thread_priority = -20
Nov 17 01:21:07 user nova-compute[75226]: node.session.cmds_max = 128
Nov 17 01:21:07 user nova-compute[75226]: node.session.queue_depth = 32
Nov 17 01:21:07 user nova-compute[75226]: node.session.nr_sessions = 1
Nov 17 01:21:07 user nova-compute[75226]: node.session.auth.authmethod = CHAP
Nov 17 01:21:07 user nova-compute[75226]: node.session.auth.username = nBQYPyRW
Nov 17 01:21:07 user nova-compute[75226]: node.session.auth.password = ***
Nov 17 01:21:07 user nova-compute[75226]: node.session.auth.username_in = <empty>
Nov 17 01:21:07 user nova-compute[75226]: node.session.auth.password_in = <empty>
Nov 17 01:21:07 user nova-compute[75226]: node.session.auth.chap_algs = MD5
Nov 17 01:21:07 user nova-compute[75226]: node.session.timeo.replacement_timeout = 120
Nov 17 01:21:07 user nova-compute[75226]: node.session.err_timeo.abort_timeout = 15
Nov 17 01:21:07 user nova-compute[75226]: node.session.err_timeo.lu_reset_timeout = 30
Nov 17 01:21:07 user nova-compute[75226]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 17 01:21:07 user nova-compute[75226]: node.session.err_timeo.host_reset_timeout = 60
Nov 17 01:21:07 user nova-compute[75226]: node.session.iscsi.FastAbort = Yes
Nov 17 01:21:07 user nova-compute[75226]: node.session.iscsi.InitialR2T = No
Nov 17 01:21:07 user nova-compute[75226]: node.session.iscsi.ImmediateData = Yes
Nov 17 01:21:07 user nova-compute[75226]: node.session.iscsi.FirstBurstLength = 262144
Nov 17 01:21:07 user nova-compute[75226]: node.session.iscsi.MaxBurstLength = 16776192
Nov 17 01:21:07 user nova-compute[75226]: node.session.iscsi.DefaultTime2Retain = 0
Nov 17 01:21:07 user nova-compute[75226]: node.session.iscsi.DefaultTime2Wait = 2
Nov 17 01:21:07 user nova-compute[75226]: node.session.iscsi.MaxConnections = 1
Nov 17 01:21:07 user nova-compute[75226]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 17 01:21:07 user nova-compute[75226]: node.session.iscsi.ERL = 0
Nov 17 01:21:07 user nova-compute[75226]: node.session.scan = manual
Nov 17 01:21:07 user nova-compute[75226]: node.session.reopen_max = 0
Nov 17 01:21:07 user nova-compute[75226]: node.conn[0].address = 172.16.0.220
Nov 17 01:21:07 user nova-compute[75226]: node.conn[0].port = 3260
Nov 17 01:21:07 user nova-compute[75226]: node.conn[0].startup = manual
Nov 17 01:21:07 user nova-compute[75226]: node.conn[0].tcp.window_size = 524288
Nov 17 01:21:07 user nova-compute[75226]: node.conn[0].tcp.type_of_service = 0
Nov 17 01:21:07 user nova-compute[75226]: node.conn[0].timeo.logout_timeout = 15
Nov 17 01:21:07 user nova-compute[75226]: node.conn[0].timeo.login_timeout = 15
Nov 17 01:21:07 user nova-compute[75226]: node.conn[0].timeo.auth_timeout = 45
Nov 17 01:21:07 user nova-compute[75226]: node.conn[0].timeo.noop_out_interval = 5
Nov 17 01:21:07 user nova-compute[75226]: node.conn[0].timeo.noop_out_timeout = 5
Nov 17 01:21:07 user nova-compute[75226]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 17 01:21:07 user nova-compute[75226]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 17 01:21:07 user nova-compute[75226]: node.conn[0].iscsi.HeaderDigest = None
Nov 17 01:21:07 user nova-compute[75226]: node.conn[0].iscsi.DataDigest = None
Nov 17 01:21:07 user nova-compute[75226]: node.conn[0].iscsi.IFMarker = No
Nov 17 01:21:07 user nova-compute[75226]: node.conn[0].iscsi.OFMarker = No
Nov 17 01:21:07 user nova-compute[75226]: # END RECORD
Nov 17 01:21:07 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:21:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa7be6d3-d525-4aa3-bcc3-481465f2832b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:21:07 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:21:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa7be6d3-d525-4aa3-bcc3-481465f2832b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.032s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:21:07 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[31e7abdc-ba99-4264-97de-bb16284d4ecf]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:21:07 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aba04ba-8eed-4c99-9d33-3ece744f1c59 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:21:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa7be6d3-d525-4aa3-bcc3-481465f2832b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:21:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa7be6d3-d525-4aa3-bcc3-481465f2832b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:21:07 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4c3264b-1c68-4f32-acb8-2b1b9cc379d1]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:21:07 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aba04ba-8eed-4c99-9d33-3ece744f1c59 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:21:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa7be6d3-d525-4aa3-bcc3-481465f2832b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nBQYPyRW {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:21:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa7be6d3-d525-4aa3-bcc3-481465f2832b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nBQYPyRW" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:21:07 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f9b36f5-d22b-47df-b144-dd9ff6d1c7d5]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:21:07 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aba04ba-8eed-4c99-9d33-3ece744f1c59 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nBQYPyRW'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:21:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa7be6d3-d525-4aa3-bcc3-481465f2832b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:21:07 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75226) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 01:21:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa7be6d3-d525-4aa3-bcc3-481465f2832b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:21:07 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e068dda-0c42-430e-ab52-75ae2692eca9]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:21:07 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aba04ba-8eed-4c99-9d33-3ece744f1c59 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:21:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:21:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddfecefc-1e9b-4e6e-9995-855c8a061084/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:21:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:21:07 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[349a993c-2b48-428f-8507-1d6cbede3c77]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa7be6d3-d525-4aa3-bcc3-481465f2832b (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:21:07 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aba04ba-8eed-4c99-9d33-3ece744f1c59 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2 (non-flash)
Nov 17 01:21:07 user nova-compute[75226]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)
Nov 17 01:21:07 user nova-compute[75226]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa7be6d3-d525-4aa3-bcc3-481465f2832b (non-flash)
Nov 17 01:21:07 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:21:07 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aba04ba-8eed-4c99-9d33-3ece744f1c59 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2 (non-flash)
Nov 17 01:21:07 user nova-compute[75226]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)
Nov 17 01:21:07 user nova-compute[75226]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa7be6d3-d525-4aa3-bcc3-481465f2832b (non-flash)
Nov 17 01:21:07 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:21:07 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-1aba04ba-8eed-4c99-9d33-3ece744f1c59 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fa7be6d3-d525-4aa3-bcc3-481465f2832b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.190s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:21:07 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aba04ba-8eed-4c99-9d33-3ece744f1c59 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Connected to 172.16.0.220:3260 {{(pid=75226) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 17 01:21:07 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-1aba04ba-8eed-4c99-9d33-3ece744f1c59 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] HCTL ('35', '0', '0', 0) found on session 17 with lun 0 {{(pid=75226) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 17 01:21:07 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-1aba04ba-8eed-4c99-9d33-3ece744f1c59 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Scanning host 35 c: 0, t: 0, l: 0) {{(pid=75226) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 17 01:21:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:21:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.012s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:21:07 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdaef763-f36d-4c13-84e8-684413435645]: (4, ('0 0 0', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:21:07 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-1aba04ba-8eed-4c99-9d33-3ece744f1c59 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Searching for a device in session 17 and hctl ('35', '0', '0', 0) yield: sdd {{(pid=75226) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 01:21:07 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aba04ba-8eed-4c99-9d33-3ece744f1c59 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:fa7be6d3-d525-4aa3-bcc3-481465f2832b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nBQYPyRW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75226) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 17 01:21:07 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-1aba04ba-8eed-4c99-9d33-3ece744f1c59 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.213s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:21:07 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aba04ba-8eed-4c99-9d33-3ece744f1c59 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] <== connect_volume: return (214ms) {'type': 'block', 'scsi_wwn': '23835616564346632', 'path': '/dev/sdd'} {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:21:07 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1aba04ba-8eed-4c99-9d33-3ece744f1c59 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] [instance: ddfecefc-1e9b-4e6e-9995-855c8a061084] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23835616564346632', 'path': '/dev/sdd'} {{(pid=75226) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 17 01:21:07 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-1aba04ba-8eed-4c99-9d33-3ece744f1c59 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:17:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1305430160',display_name='tempest-ServerStableDeviceRescueTest-server-1305430160',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1305430160',id=3,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMpvCGoDARt2nfeOrZzYRwVyzyxP/aG4WAR20CLnxUZStgu3wTBvwojfCRlppCSQBs5b3NyOL+sqX0v7IlA3zj/BimKWwl8Hmvj+spsaJeKGpvZAX8jZPtApeiUgJwdeig==',key_name='tempest-keypair-904701876',keypairs=<?>,launch_index=0,launched_at=2023-11-17T01:17:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6869af66e0cc47bf9cca02ea9b688a6d',ramdisk_id='',reservation_id='r-oy7hjp6e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-358573654',owner_user_name='tempest-ServerStableDeviceRescueTest-358573654-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T01:19:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0a9b03e89f164c23a6e8e4d1b75ba07b',uuid=ddfecefc-1e9b-4e6e-9995-855c8a061084,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f9a7562b-de63-4374-b43b-18e3cb3af710", "address": "fa:16:3e:94:21:00", "network": {"id": "8450ab2c-4f24-46cc-a6ec-644c02e2b3da", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-385219532-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-385219532-network", "vif_mac": "fa:16:3e:94:21:00"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6869af66e0cc47bf9cca02ea9b688a6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9a7562b-de", "ovs_interfaceid": "f9a7562b-de63-4374-b43b-18e3cb3af710", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75226) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 01:21:07 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-1aba04ba-8eed-4c99-9d33-3ece744f1c59 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Converting VIF {"id": "f9a7562b-de63-4374-b43b-18e3cb3af710", "address": "fa:16:3e:94:21:00", "network": {"id": "8450ab2c-4f24-46cc-a6ec-644c02e2b3da", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-385219532-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-385219532-network", "vif_mac": "fa:16:3e:94:21:00"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6869af66e0cc47bf9cca02ea9b688a6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9a7562b-de", "ovs_interfaceid": "f9a7562b-de63-4374-b43b-18e3cb3af710", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:21:07 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-1aba04ba-8eed-4c99-9d33-3ece744f1c59 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:94:21:00,bridge_name='br-int',has_traffic_filtering=True,id=f9a7562b-de63-4374-b43b-18e3cb3af710,network=Network(8450ab2c-4f24-46cc-a6ec-644c02e2b3da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9a7562b-de') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:21:07 user nova-compute[75226]: DEBUG nova.objects.instance [None req-1aba04ba-8eed-4c99-9d33-3ece744f1c59 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Lazy-loading 'pci_devices' on Instance uuid ddfecefc-1e9b-4e6e-9995-855c8a061084 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:21:07 user nova-compute[75226]: DEBUG nova.objects.base [None req-1aba04ba-8eed-4c99-9d33-3ece744f1c59 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Object Instance<ddfecefc-1e9b-4e6e-9995-855c8a061084> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75226) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 17 01:21:07 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-1aba04ba-8eed-4c99-9d33-3ece744f1c59 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] [instance: ddfecefc-1e9b-4e6e-9995-855c8a061084] End _get_guest_xml xml=<domain type="kvm">
Nov 17 01:21:07 user nova-compute[75226]:   <uuid>ddfecefc-1e9b-4e6e-9995-855c8a061084</uuid>
Nov 17 01:21:07 user nova-compute[75226]:   <name>instance-00000003</name>
Nov 17 01:21:07 user nova-compute[75226]:   <memory>524288</memory>
Nov 17 01:21:07 user nova-compute[75226]:   <vcpu>1</vcpu>
Nov 17 01:21:07 user nova-compute[75226]:   <metadata>
Nov 17 01:21:07 user nova-compute[75226]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 17 01:21:07 user nova-compute[75226]:       <nova:package version="0.0.0"/>
Nov 17 01:21:07 user nova-compute[75226]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1305430160</nova:name>
Nov 17 01:21:07 user nova-compute[75226]:       <nova:creationTime>2023-11-17 01:21:07</nova:creationTime>
Nov 17 01:21:07 user nova-compute[75226]:       <nova:flavor name="m1.tiny">
Nov 17 01:21:07 user nova-compute[75226]:         <nova:memory>512</nova:memory>
Nov 17 01:21:07 user nova-compute[75226]:         <nova:disk>1</nova:disk>
Nov 17 01:21:07 user nova-compute[75226]:         <nova:swap>0</nova:swap>
Nov 17 01:21:07 user nova-compute[75226]:         <nova:ephemeral>0</nova:ephemeral>
Nov 17 01:21:07 user nova-compute[75226]:         <nova:vcpus>1</nova:vcpus>
Nov 17 01:21:07 user nova-compute[75226]:       </nova:flavor>
Nov 17 01:21:07 user nova-compute[75226]:       <nova:owner>
Nov 17 01:21:07 user nova-compute[75226]:         <nova:user uuid="0a9b03e89f164c23a6e8e4d1b75ba07b">tempest-ServerStableDeviceRescueTest-358573654-project-member</nova:user>
Nov 17 01:21:07 user nova-compute[75226]:         <nova:project uuid="6869af66e0cc47bf9cca02ea9b688a6d">tempest-ServerStableDeviceRescueTest-358573654</nova:project>
Nov 17 01:21:07 user nova-compute[75226]:       </nova:owner>
Nov 17 01:21:07 user nova-compute[75226]:       <nova:root type="image" uuid="0b369aea-6f3f-4690-9f01-229b90ab6310"/>
Nov 17 01:21:07 user nova-compute[75226]:       <nova:ports>
Nov 17 01:21:07 user nova-compute[75226]:         <nova:port uuid="f9a7562b-de63-4374-b43b-18e3cb3af710">
Nov 17 01:21:07 user nova-compute[75226]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 17 01:21:07 user nova-compute[75226]:         </nova:port>
Nov 17 01:21:07 user nova-compute[75226]:       </nova:ports>
Nov 17 01:21:07 user nova-compute[75226]:     </nova:instance>
Nov 17 01:21:07 user nova-compute[75226]:   </metadata>
Nov 17 01:21:07 user nova-compute[75226]:   <sysinfo type="smbios">
Nov 17 01:21:07 user nova-compute[75226]:     <system>
Nov 17 01:21:07 user nova-compute[75226]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 17 01:21:07 user nova-compute[75226]:       <entry name="product">OpenStack Nova</entry>
Nov 17 01:21:07 user nova-compute[75226]:       <entry name="version">0.0.0</entry>
Nov 17 01:21:07 user nova-compute[75226]:       <entry name="serial">ddfecefc-1e9b-4e6e-9995-855c8a061084</entry>
Nov 17 01:21:07 user nova-compute[75226]:       <entry name="uuid">ddfecefc-1e9b-4e6e-9995-855c8a061084</entry>
Nov 17 01:21:07 user nova-compute[75226]:       <entry name="family">Virtual Machine</entry>
Nov 17 01:21:07 user nova-compute[75226]:     </system>
Nov 17 01:21:07 user nova-compute[75226]:   </sysinfo>
Nov 17 01:21:07 user nova-compute[75226]:   <os>
Nov 17 01:21:07 user nova-compute[75226]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 17 01:21:07 user nova-compute[75226]:     <smbios mode="sysinfo"/>
Nov 17 01:21:07 user nova-compute[75226]:   </os>
Nov 17 01:21:07 user nova-compute[75226]:   <features>
Nov 17 01:21:07 user nova-compute[75226]:     <acpi/>
Nov 17 01:21:07 user nova-compute[75226]:     <apic/>
Nov 17 01:21:07 user nova-compute[75226]:     <vmcoreinfo/>
Nov 17 01:21:07 user nova-compute[75226]:   </features>
Nov 17 01:21:07 user nova-compute[75226]:   <clock offset="utc">
Nov 17 01:21:07 user nova-compute[75226]:     <timer name="pit" tickpolicy="delay"/>
Nov 17 01:21:07 user nova-compute[75226]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 17 01:21:07 user nova-compute[75226]:     <timer name="hpet" present="no"/>
Nov 17 01:21:07 user nova-compute[75226]:   </clock>
Nov 17 01:21:07 user nova-compute[75226]:   <cpu mode="custom" match="exact">
Nov 17 01:21:07 user nova-compute[75226]:     <model>Nehalem</model>
Nov 17 01:21:07 user nova-compute[75226]:     <topology sockets="1" cores="1" threads="1"/>
Nov 17 01:21:07 user nova-compute[75226]:   </cpu>
Nov 17 01:21:07 user nova-compute[75226]:   <devices>
Nov 17 01:21:07 user nova-compute[75226]:     <disk type="file" device="disk">
Nov 17 01:21:07 user nova-compute[75226]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 17 01:21:07 user nova-compute[75226]:       <source file="/opt/stack/data/nova/instances/ddfecefc-1e9b-4e6e-9995-855c8a061084/disk"/>
Nov 17 01:21:07 user nova-compute[75226]:       <target dev="vda" bus="virtio"/>
Nov 17 01:21:07 user nova-compute[75226]:     </disk>
Nov 17 01:21:07 user nova-compute[75226]:     <disk type="block" device="disk">
Nov 17 01:21:07 user nova-compute[75226]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 01:21:07 user nova-compute[75226]:       <source dev="/dev/sdd"/>
Nov 17 01:21:07 user nova-compute[75226]:       <target dev="vdb" bus="virtio"/>
Nov 17 01:21:07 user nova-compute[75226]:       <serial>fa7be6d3-d525-4aa3-bcc3-481465f2832b</serial>
Nov 17 01:21:07 user nova-compute[75226]:     </disk>
Nov 17 01:21:07 user nova-compute[75226]:     <disk type="file" device="disk">
Nov 17 01:21:07 user nova-compute[75226]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 17 01:21:07 user nova-compute[75226]:       <source file="/opt/stack/data/nova/instances/ddfecefc-1e9b-4e6e-9995-855c8a061084/disk.rescue"/>
Nov 17 01:21:07 user nova-compute[75226]:       <target dev="vdc" bus="virtio"/>
Nov 17 01:21:07 user nova-compute[75226]:       <boot order="1"/>
Nov 17 01:21:07 user nova-compute[75226]:     </disk>
Nov 17 01:21:07 user nova-compute[75226]:     <interface type="ethernet">
Nov 17 01:21:07 user nova-compute[75226]:       <mac address="fa:16:3e:94:21:00"/>
Nov 17 01:21:07 user nova-compute[75226]:       <model type="virtio"/>
Nov 17 01:21:07 user nova-compute[75226]:       <mtu size="1442"/>
Nov 17 01:21:07 user nova-compute[75226]:       <target dev="tapf9a7562b-de"/>
Nov 17 01:21:07 user nova-compute[75226]:     </interface>
Nov 17 01:21:07 user nova-compute[75226]:     <serial type="pty">
Nov 17 01:21:07 user nova-compute[75226]:       <log file="/opt/stack/data/nova/instances/ddfecefc-1e9b-4e6e-9995-855c8a061084/console.log" append="off"/>
Nov 17 01:21:07 user nova-compute[75226]:     </serial>
Nov 17 01:21:07 user nova-compute[75226]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 17 01:21:07 user nova-compute[75226]:     <video>
Nov 17 01:21:07 user nova-compute[75226]:       <model type="virtio"/>
Nov 17 01:21:07 user nova-compute[75226]:     </video>
Nov 17 01:21:07 user nova-compute[75226]:     <rng model="virtio">
Nov 17 01:21:07 user nova-compute[75226]:       <backend model="random">/dev/urandom</backend>
Nov 17 01:21:07 user nova-compute[75226]:     </rng>
Nov 17 01:21:07 user nova-compute[75226]:     <controller type="usb" index="0" model="none"/>
Nov 17 01:21:07 user nova-compute[75226]:     <memballoon model="virtio">
Nov 17 01:21:07 user nova-compute[75226]:       <stats period="10"/>
Nov 17 01:21:07 user nova-compute[75226]:     </memballoon>
Nov 17 01:21:07 user nova-compute[75226]:   </devices>
Nov 17 01:21:07 user nova-compute[75226]: </domain>
Nov 17 01:21:07 user nova-compute[75226]:  {{(pid=75226) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 17 01:21:07 user nova-compute[75226]: INFO nova.virt.libvirt.driver [-] [instance: ddfecefc-1e9b-4e6e-9995-855c8a061084] Instance destroyed successfully.
Nov 17 01:21:07 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-1aba04ba-8eed-4c99-9d33-3ece744f1c59 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] No BDM found with device name vda, not building metadata. {{(pid=75226) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 01:21:07 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-1aba04ba-8eed-4c99-9d33-3ece744f1c59 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75226) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 01:21:07 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-1aba04ba-8eed-4c99-9d33-3ece744f1c59 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75226) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 01:21:07 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-1aba04ba-8eed-4c99-9d33-3ece744f1c59 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] No VIF found with MAC fa:16:3e:94:21:00, not building metadata {{(pid=75226) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 01:21:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddfecefc-1e9b-4e6e-9995-855c8a061084/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:21:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddfecefc-1e9b-4e6e-9995-855c8a061084/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:21:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddfecefc-1e9b-4e6e-9995-855c8a061084/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:21:07 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75226) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 01:21:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa84e575-bdad-45b9-80ce-86b1c2826fb0/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:21:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa84e575-bdad-45b9-80ce-86b1c2826fb0/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:21:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa84e575-bdad-45b9-80ce-86b1c2826fb0/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:21:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa84e575-bdad-45b9-80ce-86b1c2826fb0/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:21:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/724b81dd-4531-4c99-850d-0bfcbfdf7bd4/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:21:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/724b81dd-4531-4c99-850d-0bfcbfdf7bd4/disk --force-share --output=json" returned: 0 in 0.327s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:21:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/724b81dd-4531-4c99-850d-0bfcbfdf7bd4/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:21:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/724b81dd-4531-4c99-850d-0bfcbfdf7bd4/disk --force-share --output=json" returned: 0 in 0.275s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:21:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/094ccd9a-bf3e-49d2-be76-34e2ce2b19e3/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:21:09 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/094ccd9a-bf3e-49d2-be76-34e2ce2b19e3/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:21:09 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/094ccd9a-bf3e-49d2-be76-34e2ce2b19e3/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:21:09 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:21:09 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:21:09 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:21:09 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:21:09 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/094ccd9a-bf3e-49d2-be76-34e2ce2b19e3/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:21:09 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75226) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 01:21:09 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52fe0a91-9320-47d2-ac83-4f49260a0997/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:21:09 user nova-compute[75226]: DEBUG nova.compute.manager [req-8969d23a-8a85-4e2a-a8fb-f73849e0970c req-beb422f1-bc3f-4292-a971-8457f4c8a1ae service nova] [instance: ddfecefc-1e9b-4e6e-9995-855c8a061084] Received event network-vif-plugged-f9a7562b-de63-4374-b43b-18e3cb3af710 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:21:09 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-8969d23a-8a85-4e2a-a8fb-f73849e0970c req-beb422f1-bc3f-4292-a971-8457f4c8a1ae service nova] Acquiring lock "ddfecefc-1e9b-4e6e-9995-855c8a061084-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:21:09 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-8969d23a-8a85-4e2a-a8fb-f73849e0970c req-beb422f1-bc3f-4292-a971-8457f4c8a1ae service nova] Lock "ddfecefc-1e9b-4e6e-9995-855c8a061084-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:21:09 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-8969d23a-8a85-4e2a-a8fb-f73849e0970c req-beb422f1-bc3f-4292-a971-8457f4c8a1ae service nova] Lock "ddfecefc-1e9b-4e6e-9995-855c8a061084-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:21:09 user nova-compute[75226]: DEBUG nova.compute.manager [req-8969d23a-8a85-4e2a-a8fb-f73849e0970c req-beb422f1-bc3f-4292-a971-8457f4c8a1ae service nova] [instance: ddfecefc-1e9b-4e6e-9995-855c8a061084] No waiting events found dispatching network-vif-plugged-f9a7562b-de63-4374-b43b-18e3cb3af710 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:21:09 user nova-compute[75226]: WARNING nova.compute.manager [req-8969d23a-8a85-4e2a-a8fb-f73849e0970c req-beb422f1-bc3f-4292-a971-8457f4c8a1ae service nova] [instance: ddfecefc-1e9b-4e6e-9995-855c8a061084] Received unexpected event network-vif-plugged-f9a7562b-de63-4374-b43b-18e3cb3af710 for instance with vm_state active and task_state rescuing.
Nov 17 01:21:09 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52fe0a91-9320-47d2-ac83-4f49260a0997/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:21:09 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52fe0a91-9320-47d2-ac83-4f49260a0997/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:21:09 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52fe0a91-9320-47d2-ac83-4f49260a0997/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:21:11 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:21:11 user nova-compute[75226]: DEBUG nova.compute.manager [req-f5124b29-7ed7-4fac-aa20-44ed7e1dfded req-c35d2713-dfaf-45f3-9e02-80d6c09cee49 service nova] [instance: ddfecefc-1e9b-4e6e-9995-855c8a061084] Received event network-vif-plugged-f9a7562b-de63-4374-b43b-18e3cb3af710 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:21:11 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-f5124b29-7ed7-4fac-aa20-44ed7e1dfded req-c35d2713-dfaf-45f3-9e02-80d6c09cee49 service nova] Acquiring lock "ddfecefc-1e9b-4e6e-9995-855c8a061084-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:21:11 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-f5124b29-7ed7-4fac-aa20-44ed7e1dfded req-c35d2713-dfaf-45f3-9e02-80d6c09cee49 service nova] Lock "ddfecefc-1e9b-4e6e-9995-855c8a061084-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:21:11 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-f5124b29-7ed7-4fac-aa20-44ed7e1dfded req-c35d2713-dfaf-45f3-9e02-80d6c09cee49 service nova] Lock "ddfecefc-1e9b-4e6e-9995-855c8a061084-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:21:11 user nova-compute[75226]: DEBUG nova.compute.manager [req-f5124b29-7ed7-4fac-aa20-44ed7e1dfded req-c35d2713-dfaf-45f3-9e02-80d6c09cee49 service nova] [instance: ddfecefc-1e9b-4e6e-9995-855c8a061084] No waiting events found dispatching network-vif-plugged-f9a7562b-de63-4374-b43b-18e3cb3af710 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:21:11 user nova-compute[75226]: WARNING nova.compute.manager [req-f5124b29-7ed7-4fac-aa20-44ed7e1dfded req-c35d2713-dfaf-45f3-9e02-80d6c09cee49 service nova] [instance: ddfecefc-1e9b-4e6e-9995-855c8a061084] Received unexpected event network-vif-plugged-f9a7562b-de63-4374-b43b-18e3cb3af710 for instance with vm_state active and task_state rescuing.
Nov 17 01:21:11 user nova-compute[75226]: DEBUG nova.compute.manager [None req-1aba04ba-8eed-4c99-9d33-3ece744f1c59 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] [instance: ddfecefc-1e9b-4e6e-9995-855c8a061084] Checking state {{(pid=75226) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 01:21:11 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:21:11 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:21:11 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Hypervisor/Node resource view: name=user free_ram=8143MB free_disk=25.33523941040039GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75226) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 17 01:21:11 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:21:11 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:21:11 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance aa84e575-bdad-45b9-80ce-86b1c2826fb0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:21:11 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance ddfecefc-1e9b-4e6e-9995-855c8a061084 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:21:11 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 724b81dd-4531-4c99-850d-0bfcbfdf7bd4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:21:11 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 262eb845-eebe-4ffb-bc49-dcaca53ad7b8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:21:11 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 6b7e9611-be35-4e51-b886-91a2fac0a653 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:21:11 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 094ccd9a-bf3e-49d2-be76-34e2ce2b19e3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:21:11 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 52fe0a91-9320-47d2-ac83-4f49260a0997 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:21:11 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75226) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 17 01:21:11 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75226) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 17 01:21:12 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:21:12 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:21:12 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Compute_service record updated for user:user {{(pid=75226) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 17 01:21:12 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.442s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:21:12 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:21:12 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:21:12 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:21:12 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-f13d0d8a-2a91-4b2d-a1cc-3cbf580119d2 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Acquiring lock "f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:21:12 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-f13d0d8a-2a91-4b2d-a1cc-3cbf580119d2 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Lock "f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:21:12 user nova-compute[75226]: DEBUG nova.compute.manager [None req-f13d0d8a-2a91-4b2d-a1cc-3cbf580119d2 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] [instance: f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c] Starting instance... {{(pid=75226) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 17 01:21:13 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-f13d0d8a-2a91-4b2d-a1cc-3cbf580119d2 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:21:13 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-f13d0d8a-2a91-4b2d-a1cc-3cbf580119d2 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:21:13 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-f13d0d8a-2a91-4b2d-a1cc-3cbf580119d2 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75226) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 17 01:21:13 user nova-compute[75226]: INFO nova.compute.claims [None req-f13d0d8a-2a91-4b2d-a1cc-3cbf580119d2 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] [instance: f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c] Claim successful on node user
Nov 17 01:21:13 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-f13d0d8a-2a91-4b2d-a1cc-3cbf580119d2 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:21:13 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-f13d0d8a-2a91-4b2d-a1cc-3cbf580119d2 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:21:13 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-f13d0d8a-2a91-4b2d-a1cc-3cbf580119d2 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.495s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:21:13 user nova-compute[75226]: DEBUG nova.compute.manager [None req-f13d0d8a-2a91-4b2d-a1cc-3cbf580119d2 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] [instance: f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c] Start building networks asynchronously for instance. {{(pid=75226) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 17 01:21:13 user nova-compute[75226]: DEBUG nova.compute.manager [None req-f13d0d8a-2a91-4b2d-a1cc-3cbf580119d2 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] [instance: f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c] Allocating IP information in the background. {{(pid=75226) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 17 01:21:13 user nova-compute[75226]: DEBUG nova.network.neutron [None req-f13d0d8a-2a91-4b2d-a1cc-3cbf580119d2 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] [instance: f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c] allocate_for_instance() {{(pid=75226) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 17 01:21:13 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-f13d0d8a-2a91-4b2d-a1cc-3cbf580119d2 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] [instance: f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 17 01:21:13 user nova-compute[75226]: DEBUG nova.compute.manager [None req-f13d0d8a-2a91-4b2d-a1cc-3cbf580119d2 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] [instance: f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c] Start building block device mappings for instance. {{(pid=75226) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 17 01:21:13 user nova-compute[75226]: DEBUG nova.policy [None req-f13d0d8a-2a91-4b2d-a1cc-3cbf580119d2 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c30381a66814427ba39e21c024136fee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '054575d3dc66452091173b4c604b8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75226) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 17 01:21:13 user nova-compute[75226]: DEBUG nova.compute.manager [None req-f13d0d8a-2a91-4b2d-a1cc-3cbf580119d2 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] [instance: f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c] Start spawning the instance on the hypervisor. {{(pid=75226) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 17 01:21:13 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-f13d0d8a-2a91-4b2d-a1cc-3cbf580119d2 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] [instance: f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c] Creating instance directory {{(pid=75226) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 17 01:21:13 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-f13d0d8a-2a91-4b2d-a1cc-3cbf580119d2 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] [instance: f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c] Creating image(s)
Nov 17 01:21:13 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-f13d0d8a-2a91-4b2d-a1cc-3cbf580119d2 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Acquiring lock "/opt/stack/data/nova/instances/f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:21:13 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-f13d0d8a-2a91-4b2d-a1cc-3cbf580119d2 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Lock "/opt/stack/data/nova/instances/f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:21:13 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-f13d0d8a-2a91-4b2d-a1cc-3cbf580119d2 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Lock "/opt/stack/data/nova/instances/f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:21:13 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-f13d0d8a-2a91-4b2d-a1cc-3cbf580119d2 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:21:13 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-f13d0d8a-2a91-4b2d-a1cc-3cbf580119d2 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json" returned: 0 in 0.198s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:21:13 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-f13d0d8a-2a91-4b2d-a1cc-3cbf580119d2 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Acquiring lock "a8a62c2546af3a2036b853250c5ac64d4c6b4371" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:21:13 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-f13d0d8a-2a91-4b2d-a1cc-3cbf580119d2 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Lock "a8a62c2546af3a2036b853250c5ac64d4c6b4371" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:21:13 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-f13d0d8a-2a91-4b2d-a1cc-3cbf580119d2 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:21:14 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-f13d0d8a-2a91-4b2d-a1cc-3cbf580119d2 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json" returned: 0 in 0.207s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:21:14 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-f13d0d8a-2a91-4b2d-a1cc-3cbf580119d2 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371,backing_fmt=raw /opt/stack/data/nova/instances/f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c/disk 1073741824 {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:21:14 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-f13d0d8a-2a91-4b2d-a1cc-3cbf580119d2 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371,backing_fmt=raw /opt/stack/data/nova/instances/f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c/disk 1073741824" returned: 0 in 0.048s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:21:14 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-f13d0d8a-2a91-4b2d-a1cc-3cbf580119d2 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Lock "a8a62c2546af3a2036b853250c5ac64d4c6b4371" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.266s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:21:14 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-f13d0d8a-2a91-4b2d-a1cc-3cbf580119d2 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:21:14 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-f13d0d8a-2a91-4b2d-a1cc-3cbf580119d2 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json" returned: 0 in 0.188s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:21:14 user nova-compute[75226]: DEBUG nova.virt.disk.api [None req-f13d0d8a-2a91-4b2d-a1cc-3cbf580119d2 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c/disk. size=1073741824 {{(pid=75226) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 17 01:21:14 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-f13d0d8a-2a91-4b2d-a1cc-3cbf580119d2 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:21:14 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-f13d0d8a-2a91-4b2d-a1cc-3cbf580119d2 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:21:14 user nova-compute[75226]: DEBUG nova.virt.disk.api [None req-f13d0d8a-2a91-4b2d-a1cc-3cbf580119d2 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Cannot resize image /opt/stack/data/nova/instances/f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c/disk to a smaller size. {{(pid=75226) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 17 01:21:14 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-f13d0d8a-2a91-4b2d-a1cc-3cbf580119d2 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] [instance: f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c] Created local disks {{(pid=75226) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 17 01:21:14 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-f13d0d8a-2a91-4b2d-a1cc-3cbf580119d2 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] [instance: f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c] Ensure instance console log exists: /opt/stack/data/nova/instances/f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c/console.log {{(pid=75226) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 17 01:21:14 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-f13d0d8a-2a91-4b2d-a1cc-3cbf580119d2 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:21:14 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-f13d0d8a-2a91-4b2d-a1cc-3cbf580119d2 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:21:14 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-f13d0d8a-2a91-4b2d-a1cc-3cbf580119d2 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:21:14 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:21:15 user nova-compute[75226]: DEBUG nova.network.neutron [None req-f13d0d8a-2a91-4b2d-a1cc-3cbf580119d2 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] [instance: f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c] Successfully created port: ed40e788-7338-4ecd-8204-008d4601131b {{(pid=75226) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 17 01:21:15 user nova-compute[75226]: DEBUG nova.network.neutron [None req-f13d0d8a-2a91-4b2d-a1cc-3cbf580119d2 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] [instance: f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c] Successfully updated port: ed40e788-7338-4ecd-8204-008d4601131b {{(pid=75226) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 17 01:21:15 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-f13d0d8a-2a91-4b2d-a1cc-3cbf580119d2 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Acquiring lock "refresh_cache-f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:21:15 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-f13d0d8a-2a91-4b2d-a1cc-3cbf580119d2 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Acquired lock "refresh_cache-f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:21:15 user nova-compute[75226]: DEBUG nova.network.neutron [None req-f13d0d8a-2a91-4b2d-a1cc-3cbf580119d2 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] [instance: f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c] Building network info cache for instance {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 01:21:15 user nova-compute[75226]: DEBUG nova.compute.manager [req-8b38fabb-9e55-4722-a797-4dbd79656349 req-c09137e8-39e7-49af-a776-95161bd116bf service nova] [instance: f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c] Received event network-changed-ed40e788-7338-4ecd-8204-008d4601131b {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:21:15 user nova-compute[75226]: DEBUG nova.compute.manager [req-8b38fabb-9e55-4722-a797-4dbd79656349 req-c09137e8-39e7-49af-a776-95161bd116bf service nova] [instance: f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c] Refreshing instance network info cache due to event network-changed-ed40e788-7338-4ecd-8204-008d4601131b. {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 01:21:15 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-8b38fabb-9e55-4722-a797-4dbd79656349 req-c09137e8-39e7-49af-a776-95161bd116bf service nova] Acquiring lock "refresh_cache-f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:21:15 user nova-compute[75226]: DEBUG nova.network.neutron [None req-f13d0d8a-2a91-4b2d-a1cc-3cbf580119d2 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] [instance: f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c] Instance cache missing network info. {{(pid=75226) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 17 01:21:16 user nova-compute[75226]: DEBUG nova.network.neutron [None req-f13d0d8a-2a91-4b2d-a1cc-3cbf580119d2 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] [instance: f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c] Updating instance_info_cache with network_info: [{"id": "ed40e788-7338-4ecd-8204-008d4601131b", "address": "fa:16:3e:69:68:ce", "network": {"id": "c93f11a7-52c6-4379-a1fb-9a002876c221", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-985502177-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "054575d3dc66452091173b4c604b8c96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped40e788-73", "ovs_interfaceid": "ed40e788-7338-4ecd-8204-008d4601131b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:21:16 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-f13d0d8a-2a91-4b2d-a1cc-3cbf580119d2 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Releasing lock "refresh_cache-f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:21:16 user nova-compute[75226]: DEBUG nova.compute.manager [None req-f13d0d8a-2a91-4b2d-a1cc-3cbf580119d2 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] [instance: f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c] Instance network_info: |[{"id": "ed40e788-7338-4ecd-8204-008d4601131b", "address": "fa:16:3e:69:68:ce", "network": {"id": "c93f11a7-52c6-4379-a1fb-9a002876c221", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-985502177-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "054575d3dc66452091173b4c604b8c96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped40e788-73", "ovs_interfaceid": "ed40e788-7338-4ecd-8204-008d4601131b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75226) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 17 01:21:16 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-8b38fabb-9e55-4722-a797-4dbd79656349 req-c09137e8-39e7-49af-a776-95161bd116bf service nova] Acquired lock "refresh_cache-f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:21:16 user nova-compute[75226]: DEBUG nova.network.neutron [req-8b38fabb-9e55-4722-a797-4dbd79656349 req-c09137e8-39e7-49af-a776-95161bd116bf service nova] [instance: f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c] Refreshing network info cache for port ed40e788-7338-4ecd-8204-008d4601131b {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 01:21:16 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-f13d0d8a-2a91-4b2d-a1cc-3cbf580119d2 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] [instance: f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c] Start _get_guest_xml network_info=[{"id": "ed40e788-7338-4ecd-8204-008d4601131b", "address": "fa:16:3e:69:68:ce", "network": {"id": "c93f11a7-52c6-4379-a1fb-9a002876c221", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-985502177-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "054575d3dc66452091173b4c604b8c96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped40e788-73", "ovs_interfaceid": "ed40e788-7338-4ecd-8204-008d4601131b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T01:13:22Z,direct_url=<?>,disk_format='qcow2',id=0b369aea-6f3f-4690-9f01-229b90ab6310,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4e110cbf9a84362a6864a7732c435a1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T01:13:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '0b369aea-6f3f-4690-9f01-229b90ab6310'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75226) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 17 01:21:16 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-f13d0d8a-2a91-4b2d-a1cc-3cbf580119d2 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:21:16 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-f13d0d8a-2a91-4b2d-a1cc-3cbf580119d2 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:21:16 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-f13d0d8a-2a91-4b2d-a1cc-3cbf580119d2 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75226) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 17 01:21:16 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-f13d0d8a-2a91-4b2d-a1cc-3cbf580119d2 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] CPU controller missing on host. {{(pid=75226) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 17 01:21:16 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-f13d0d8a-2a91-4b2d-a1cc-3cbf580119d2 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75226) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 17 01:21:16 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-f13d0d8a-2a91-4b2d-a1cc-3cbf580119d2 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] CPU controller found on host. {{(pid=75226) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 17 01:21:16 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-f13d0d8a-2a91-4b2d-a1cc-3cbf580119d2 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75226) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 17 01:21:16 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-f13d0d8a-2a91-4b2d-a1cc-3cbf580119d2 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-17T01:13:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T01:13:22Z,direct_url=<?>,disk_format='qcow2',id=0b369aea-6f3f-4690-9f01-229b90ab6310,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4e110cbf9a84362a6864a7732c435a1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T01:13:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 17 01:21:16 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-f13d0d8a-2a91-4b2d-a1cc-3cbf580119d2 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Flavor limits 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 17 01:21:16 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-f13d0d8a-2a91-4b2d-a1cc-3cbf580119d2 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Image limits 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 17 01:21:16 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-f13d0d8a-2a91-4b2d-a1cc-3cbf580119d2 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Flavor pref 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 17 01:21:16 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-f13d0d8a-2a91-4b2d-a1cc-3cbf580119d2 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Image pref 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 17 01:21:16 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-f13d0d8a-2a91-4b2d-a1cc-3cbf580119d2 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 17 01:21:16 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-f13d0d8a-2a91-4b2d-a1cc-3cbf580119d2 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 17 01:21:16 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-f13d0d8a-2a91-4b2d-a1cc-3cbf580119d2 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75226) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 17 01:21:16 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-f13d0d8a-2a91-4b2d-a1cc-3cbf580119d2 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Got 1 possible topologies {{(pid=75226) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 17 01:21:16 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-f13d0d8a-2a91-4b2d-a1cc-3cbf580119d2 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 17 01:21:16 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-f13d0d8a-2a91-4b2d-a1cc-3cbf580119d2 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 17 01:21:16 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-f13d0d8a-2a91-4b2d-a1cc-3cbf580119d2 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:21:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-980884499',display_name='tempest-AttachVolumeTestJSON-server-980884499',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-980884499',id=14,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEeERZjFkWxmLB8VU7feu2kYsY5hOpCoxndDBoQzV87owC8kzSgAjyPTw83uHfeVmkKFRyeTiQ9M6sBUaGKQxsiszNV9RLzq6OmxLI7Pi6/hF+7Z96DGb0RR92U15Os/9A==',key_name='tempest-keypair-1317105249',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='054575d3dc66452091173b4c604b8c96',ramdisk_id='',reservation_id='r-cjk2rxuv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-223132631',owner_user_name='tempest-AttachVolumeTestJSON-223132631-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T01:21:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c30381a66814427ba39e21c024136fee',uuid=f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ed40e788-7338-4ecd-8204-008d4601131b", "address": "fa:16:3e:69:68:ce", "network": {"id": "c93f11a7-52c6-4379-a1fb-9a002876c221", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-985502177-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "054575d3dc66452091173b4c604b8c96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped40e788-73", "ovs_interfaceid": "ed40e788-7338-4ecd-8204-008d4601131b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75226) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 01:21:16 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-f13d0d8a-2a91-4b2d-a1cc-3cbf580119d2 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Converting VIF {"id": "ed40e788-7338-4ecd-8204-008d4601131b", "address": "fa:16:3e:69:68:ce", "network": {"id": "c93f11a7-52c6-4379-a1fb-9a002876c221", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-985502177-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "054575d3dc66452091173b4c604b8c96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped40e788-73", "ovs_interfaceid": "ed40e788-7338-4ecd-8204-008d4601131b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:21:16 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-f13d0d8a-2a91-4b2d-a1cc-3cbf580119d2 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:68:ce,bridge_name='br-int',has_traffic_filtering=True,id=ed40e788-7338-4ecd-8204-008d4601131b,network=Network(c93f11a7-52c6-4379-a1fb-9a002876c221),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped40e788-73') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:21:16 user nova-compute[75226]: DEBUG nova.objects.instance [None req-f13d0d8a-2a91-4b2d-a1cc-3cbf580119d2 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Lazy-loading 'pci_devices' on Instance uuid f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:21:16 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-f13d0d8a-2a91-4b2d-a1cc-3cbf580119d2 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] [instance: f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c] End _get_guest_xml xml=<domain type="kvm">
Nov 17 01:21:16 user nova-compute[75226]:   <uuid>f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c</uuid>
Nov 17 01:21:16 user nova-compute[75226]:   <name>instance-0000000e</name>
Nov 17 01:21:16 user nova-compute[75226]:   <memory>524288</memory>
Nov 17 01:21:16 user nova-compute[75226]:   <vcpu>1</vcpu>
Nov 17 01:21:16 user nova-compute[75226]:   <metadata>
Nov 17 01:21:16 user nova-compute[75226]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 17 01:21:16 user nova-compute[75226]:       <nova:package version="0.0.0"/>
Nov 17 01:21:16 user nova-compute[75226]:       <nova:name>tempest-AttachVolumeTestJSON-server-980884499</nova:name>
Nov 17 01:21:16 user nova-compute[75226]:       <nova:creationTime>2023-11-17 01:21:16</nova:creationTime>
Nov 17 01:21:16 user nova-compute[75226]:       <nova:flavor name="m1.tiny">
Nov 17 01:21:16 user nova-compute[75226]:         <nova:memory>512</nova:memory>
Nov 17 01:21:16 user nova-compute[75226]:         <nova:disk>1</nova:disk>
Nov 17 01:21:16 user nova-compute[75226]:         <nova:swap>0</nova:swap>
Nov 17 01:21:16 user nova-compute[75226]:         <nova:ephemeral>0</nova:ephemeral>
Nov 17 01:21:16 user nova-compute[75226]:         <nova:vcpus>1</nova:vcpus>
Nov 17 01:21:16 user nova-compute[75226]:       </nova:flavor>
Nov 17 01:21:16 user nova-compute[75226]:       <nova:owner>
Nov 17 01:21:16 user nova-compute[75226]:         <nova:user uuid="c30381a66814427ba39e21c024136fee">tempest-AttachVolumeTestJSON-223132631-project-member</nova:user>
Nov 17 01:21:16 user nova-compute[75226]:         <nova:project uuid="054575d3dc66452091173b4c604b8c96">tempest-AttachVolumeTestJSON-223132631</nova:project>
Nov 17 01:21:16 user nova-compute[75226]:       </nova:owner>
Nov 17 01:21:16 user nova-compute[75226]:       <nova:root type="image" uuid="0b369aea-6f3f-4690-9f01-229b90ab6310"/>
Nov 17 01:21:16 user nova-compute[75226]:       <nova:ports>
Nov 17 01:21:16 user nova-compute[75226]:         <nova:port uuid="ed40e788-7338-4ecd-8204-008d4601131b">
Nov 17 01:21:16 user nova-compute[75226]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 17 01:21:16 user nova-compute[75226]:         </nova:port>
Nov 17 01:21:16 user nova-compute[75226]:       </nova:ports>
Nov 17 01:21:16 user nova-compute[75226]:     </nova:instance>
Nov 17 01:21:16 user nova-compute[75226]:   </metadata>
Nov 17 01:21:16 user nova-compute[75226]:   <sysinfo type="smbios">
Nov 17 01:21:16 user nova-compute[75226]:     <system>
Nov 17 01:21:16 user nova-compute[75226]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 17 01:21:16 user nova-compute[75226]:       <entry name="product">OpenStack Nova</entry>
Nov 17 01:21:16 user nova-compute[75226]:       <entry name="version">0.0.0</entry>
Nov 17 01:21:16 user nova-compute[75226]:       <entry name="serial">f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c</entry>
Nov 17 01:21:16 user nova-compute[75226]:       <entry name="uuid">f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c</entry>
Nov 17 01:21:16 user nova-compute[75226]:       <entry name="family">Virtual Machine</entry>
Nov 17 01:21:16 user nova-compute[75226]:     </system>
Nov 17 01:21:16 user nova-compute[75226]:   </sysinfo>
Nov 17 01:21:16 user nova-compute[75226]:   <os>
Nov 17 01:21:16 user nova-compute[75226]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 17 01:21:16 user nova-compute[75226]:     <boot dev="hd"/>
Nov 17 01:21:16 user nova-compute[75226]:     <smbios mode="sysinfo"/>
Nov 17 01:21:16 user nova-compute[75226]:   </os>
Nov 17 01:21:16 user nova-compute[75226]:   <features>
Nov 17 01:21:16 user nova-compute[75226]:     <acpi/>
Nov 17 01:21:16 user nova-compute[75226]:     <apic/>
Nov 17 01:21:16 user nova-compute[75226]:     <vmcoreinfo/>
Nov 17 01:21:16 user nova-compute[75226]:   </features>
Nov 17 01:21:16 user nova-compute[75226]:   <clock offset="utc">
Nov 17 01:21:16 user nova-compute[75226]:     <timer name="pit" tickpolicy="delay"/>
Nov 17 01:21:16 user nova-compute[75226]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 17 01:21:16 user nova-compute[75226]:     <timer name="hpet" present="no"/>
Nov 17 01:21:16 user nova-compute[75226]:   </clock>
Nov 17 01:21:16 user nova-compute[75226]:   <cpu mode="custom" match="exact">
Nov 17 01:21:16 user nova-compute[75226]:     <model>Nehalem</model>
Nov 17 01:21:16 user nova-compute[75226]:     <topology sockets="1" cores="1" threads="1"/>
Nov 17 01:21:16 user nova-compute[75226]:   </cpu>
Nov 17 01:21:16 user nova-compute[75226]:   <devices>
Nov 17 01:21:16 user nova-compute[75226]:     <disk type="file" device="disk">
Nov 17 01:21:16 user nova-compute[75226]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 17 01:21:16 user nova-compute[75226]:       <source file="/opt/stack/data/nova/instances/f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c/disk"/>
Nov 17 01:21:16 user nova-compute[75226]:       <target dev="vda" bus="virtio"/>
Nov 17 01:21:16 user nova-compute[75226]:     </disk>
Nov 17 01:21:16 user nova-compute[75226]:     <interface type="ethernet">
Nov 17 01:21:16 user nova-compute[75226]:       <mac address="fa:16:3e:69:68:ce"/>
Nov 17 01:21:16 user nova-compute[75226]:       <model type="virtio"/>
Nov 17 01:21:16 user nova-compute[75226]:       <mtu size="1442"/>
Nov 17 01:21:16 user nova-compute[75226]:       <target dev="taped40e788-73"/>
Nov 17 01:21:16 user nova-compute[75226]:     </interface>
Nov 17 01:21:16 user nova-compute[75226]:     <serial type="pty">
Nov 17 01:21:16 user nova-compute[75226]:       <log file="/opt/stack/data/nova/instances/f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c/console.log" append="off"/>
Nov 17 01:21:16 user nova-compute[75226]:     </serial>
Nov 17 01:21:16 user nova-compute[75226]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 17 01:21:16 user nova-compute[75226]:     <video>
Nov 17 01:21:16 user nova-compute[75226]:       <model type="virtio"/>
Nov 17 01:21:16 user nova-compute[75226]:     </video>
Nov 17 01:21:16 user nova-compute[75226]:     <rng model="virtio">
Nov 17 01:21:16 user nova-compute[75226]:       <backend model="random">/dev/urandom</backend>
Nov 17 01:21:16 user nova-compute[75226]:     </rng>
Nov 17 01:21:16 user nova-compute[75226]:     <controller type="usb" index="0" model="none"/>
Nov 17 01:21:16 user nova-compute[75226]:     <memballoon model="virtio">
Nov 17 01:21:16 user nova-compute[75226]:       <stats period="10"/>
Nov 17 01:21:16 user nova-compute[75226]:     </memballoon>
Nov 17 01:21:16 user nova-compute[75226]:   </devices>
Nov 17 01:21:16 user nova-compute[75226]: </domain>
Nov 17 01:21:16 user nova-compute[75226]:  {{(pid=75226) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 17 01:21:16 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-f13d0d8a-2a91-4b2d-a1cc-3cbf580119d2 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:21:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-980884499',display_name='tempest-AttachVolumeTestJSON-server-980884499',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-980884499',id=14,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEeERZjFkWxmLB8VU7feu2kYsY5hOpCoxndDBoQzV87owC8kzSgAjyPTw83uHfeVmkKFRyeTiQ9M6sBUaGKQxsiszNV9RLzq6OmxLI7Pi6/hF+7Z96DGb0RR92U15Os/9A==',key_name='tempest-keypair-1317105249',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='054575d3dc66452091173b4c604b8c96',ramdisk_id='',reservation_id='r-cjk2rxuv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-223132631',owner_user_name='tempest-AttachVolumeTestJSON-223132631-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T01:21:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c30381a66814427ba39e21c024136fee',uuid=f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ed40e788-7338-4ecd-8204-008d4601131b", "address": "fa:16:3e:69:68:ce", "network": {"id": "c93f11a7-52c6-4379-a1fb-9a002876c221", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-985502177-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "054575d3dc66452091173b4c604b8c96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped40e788-73", "ovs_interfaceid": "ed40e788-7338-4ecd-8204-008d4601131b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 17 01:21:16 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-f13d0d8a-2a91-4b2d-a1cc-3cbf580119d2 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Converting VIF {"id": "ed40e788-7338-4ecd-8204-008d4601131b", "address": "fa:16:3e:69:68:ce", "network": {"id": "c93f11a7-52c6-4379-a1fb-9a002876c221", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-985502177-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "054575d3dc66452091173b4c604b8c96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped40e788-73", "ovs_interfaceid": "ed40e788-7338-4ecd-8204-008d4601131b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:21:16 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-f13d0d8a-2a91-4b2d-a1cc-3cbf580119d2 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:68:ce,bridge_name='br-int',has_traffic_filtering=True,id=ed40e788-7338-4ecd-8204-008d4601131b,network=Network(c93f11a7-52c6-4379-a1fb-9a002876c221),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped40e788-73') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:21:16 user nova-compute[75226]: DEBUG os_vif [None req-f13d0d8a-2a91-4b2d-a1cc-3cbf580119d2 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:68:ce,bridge_name='br-int',has_traffic_filtering=True,id=ed40e788-7338-4ecd-8204-008d4601131b,network=Network(c93f11a7-52c6-4379-a1fb-9a002876c221),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped40e788-73') {{(pid=75226) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 17 01:21:16 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:21:16 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:21:16 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 17 01:21:16 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:21:16 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'afe1cc5f-9cdf-5f89-b0f4-4864cb3a3601', '_type': 'linux-noop'}}, row=False) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:21:16 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:21:16 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:21:16 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:21:16 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=taped40e788-73, may_exist=True, interface_attrs={}) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:21:16 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=taped40e788-73, col_values=(('qos', UUID('e1caf1c8-ca88-45f7-9a99-394d22b2cdbf')),), if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:21:16 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=taped40e788-73, col_values=(('external_ids', {'iface-id': 'ed40e788-7338-4ecd-8204-008d4601131b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:69:68:ce', 'vm-uuid': 'f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c'}),), if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:21:16 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:21:16 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:21:16 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:21:16 user nova-compute[75226]: INFO os_vif [None req-f13d0d8a-2a91-4b2d-a1cc-3cbf580119d2 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:68:ce,bridge_name='br-int',has_traffic_filtering=True,id=ed40e788-7338-4ecd-8204-008d4601131b,network=Network(c93f11a7-52c6-4379-a1fb-9a002876c221),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped40e788-73')
Nov 17 01:21:16 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-f13d0d8a-2a91-4b2d-a1cc-3cbf580119d2 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] No BDM found with device name vda, not building metadata. {{(pid=75226) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 01:21:16 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-f13d0d8a-2a91-4b2d-a1cc-3cbf580119d2 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] No VIF found with MAC fa:16:3e:69:68:ce, not building metadata {{(pid=75226) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 01:21:16 user nova-compute[75226]: DEBUG nova.network.neutron [req-8b38fabb-9e55-4722-a797-4dbd79656349 req-c09137e8-39e7-49af-a776-95161bd116bf service nova] [instance: f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c] Updated VIF entry in instance network info cache for port ed40e788-7338-4ecd-8204-008d4601131b. {{(pid=75226) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 01:21:16 user nova-compute[75226]: DEBUG nova.network.neutron [req-8b38fabb-9e55-4722-a797-4dbd79656349 req-c09137e8-39e7-49af-a776-95161bd116bf service nova] [instance: f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c] Updating instance_info_cache with network_info: [{"id": "ed40e788-7338-4ecd-8204-008d4601131b", "address": "fa:16:3e:69:68:ce", "network": {"id": "c93f11a7-52c6-4379-a1fb-9a002876c221", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-985502177-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "054575d3dc66452091173b4c604b8c96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped40e788-73", "ovs_interfaceid": "ed40e788-7338-4ecd-8204-008d4601131b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:21:16 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-8b38fabb-9e55-4722-a797-4dbd79656349 req-c09137e8-39e7-49af-a776-95161bd116bf service nova] Releasing lock "refresh_cache-f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:21:17 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:21:17 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:21:17 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:21:17 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:21:17 user nova-compute[75226]: DEBUG nova.compute.manager [req-d8ead4ad-3d0d-4f34-8b5f-db773d769126 req-11f210fd-fe7e-4727-be11-7577164a6e1a service nova] [instance: f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c] Received event network-vif-plugged-ed40e788-7338-4ecd-8204-008d4601131b {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:21:17 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-d8ead4ad-3d0d-4f34-8b5f-db773d769126 req-11f210fd-fe7e-4727-be11-7577164a6e1a service nova] Acquiring lock "f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:21:17 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-d8ead4ad-3d0d-4f34-8b5f-db773d769126 req-11f210fd-fe7e-4727-be11-7577164a6e1a service nova] Lock "f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:21:17 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-d8ead4ad-3d0d-4f34-8b5f-db773d769126 req-11f210fd-fe7e-4727-be11-7577164a6e1a service nova] Lock "f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:21:17 user nova-compute[75226]: DEBUG nova.compute.manager [req-d8ead4ad-3d0d-4f34-8b5f-db773d769126 req-11f210fd-fe7e-4727-be11-7577164a6e1a service nova] [instance: f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c] No waiting events found dispatching network-vif-plugged-ed40e788-7338-4ecd-8204-008d4601131b {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:21:17 user nova-compute[75226]: WARNING nova.compute.manager [req-d8ead4ad-3d0d-4f34-8b5f-db773d769126 req-11f210fd-fe7e-4727-be11-7577164a6e1a service nova] [instance: f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c] Received unexpected event network-vif-plugged-ed40e788-7338-4ecd-8204-008d4601131b for instance with vm_state building and task_state spawning.
Nov 17 01:21:18 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-7e13af9a-0be2-441b-9966-ea9143472713 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Acquiring lock "2fbdd8af-f608-4d73-92d9-ae0586814c1b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:21:18 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-7e13af9a-0be2-441b-9966-ea9143472713 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Lock "2fbdd8af-f608-4d73-92d9-ae0586814c1b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:21:18 user nova-compute[75226]: DEBUG nova.compute.manager [None req-7e13af9a-0be2-441b-9966-ea9143472713 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: 2fbdd8af-f608-4d73-92d9-ae0586814c1b] Starting instance... {{(pid=75226) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 17 01:21:18 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-7e13af9a-0be2-441b-9966-ea9143472713 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:21:18 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-7e13af9a-0be2-441b-9966-ea9143472713 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:21:18 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-7e13af9a-0be2-441b-9966-ea9143472713 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75226) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 17 01:21:18 user nova-compute[75226]: INFO nova.compute.claims [None req-7e13af9a-0be2-441b-9966-ea9143472713 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: 2fbdd8af-f608-4d73-92d9-ae0586814c1b] Claim successful on node user
Nov 17 01:21:18 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:21:18 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:21:18 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:21:18 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:21:18 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-7e13af9a-0be2-441b-9966-ea9143472713 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:21:18 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-7e13af9a-0be2-441b-9966-ea9143472713 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:21:18 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-7e13af9a-0be2-441b-9966-ea9143472713 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.410s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:21:18 user nova-compute[75226]: DEBUG nova.compute.manager [None req-7e13af9a-0be2-441b-9966-ea9143472713 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: 2fbdd8af-f608-4d73-92d9-ae0586814c1b] Start building networks asynchronously for instance. {{(pid=75226) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 17 01:21:18 user nova-compute[75226]: DEBUG nova.compute.manager [None req-7e13af9a-0be2-441b-9966-ea9143472713 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: 2fbdd8af-f608-4d73-92d9-ae0586814c1b] Allocating IP information in the background. {{(pid=75226) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 17 01:21:18 user nova-compute[75226]: DEBUG nova.network.neutron [None req-7e13af9a-0be2-441b-9966-ea9143472713 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: 2fbdd8af-f608-4d73-92d9-ae0586814c1b] allocate_for_instance() {{(pid=75226) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 17 01:21:18 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-7e13af9a-0be2-441b-9966-ea9143472713 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: 2fbdd8af-f608-4d73-92d9-ae0586814c1b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 17 01:21:18 user nova-compute[75226]: DEBUG nova.compute.manager [None req-7e13af9a-0be2-441b-9966-ea9143472713 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: 2fbdd8af-f608-4d73-92d9-ae0586814c1b] Start building block device mappings for instance. {{(pid=75226) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 17 01:21:18 user nova-compute[75226]: DEBUG nova.policy [None req-7e13af9a-0be2-441b-9966-ea9143472713 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '642db538240b4ca1a367cf4ee9714f66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38777e8baf745e79f31190da97406a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75226) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 17 01:21:18 user nova-compute[75226]: DEBUG nova.compute.manager [None req-7e13af9a-0be2-441b-9966-ea9143472713 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: 2fbdd8af-f608-4d73-92d9-ae0586814c1b] Start spawning the instance on the hypervisor. {{(pid=75226) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 17 01:21:18 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-7e13af9a-0be2-441b-9966-ea9143472713 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: 2fbdd8af-f608-4d73-92d9-ae0586814c1b] Creating instance directory {{(pid=75226) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 17 01:21:18 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-7e13af9a-0be2-441b-9966-ea9143472713 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: 2fbdd8af-f608-4d73-92d9-ae0586814c1b] Creating image(s)
Nov 17 01:21:18 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-7e13af9a-0be2-441b-9966-ea9143472713 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Acquiring lock "/opt/stack/data/nova/instances/2fbdd8af-f608-4d73-92d9-ae0586814c1b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:21:18 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-7e13af9a-0be2-441b-9966-ea9143472713 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Lock "/opt/stack/data/nova/instances/2fbdd8af-f608-4d73-92d9-ae0586814c1b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:21:18 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-7e13af9a-0be2-441b-9966-ea9143472713 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Lock "/opt/stack/data/nova/instances/2fbdd8af-f608-4d73-92d9-ae0586814c1b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:21:18 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-7e13af9a-0be2-441b-9966-ea9143472713 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:21:18 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-7e13af9a-0be2-441b-9966-ea9143472713 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json" returned: 0 in 0.180s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:21:18 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-7e13af9a-0be2-441b-9966-ea9143472713 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Acquiring lock "a8a62c2546af3a2036b853250c5ac64d4c6b4371" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:21:18 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-7e13af9a-0be2-441b-9966-ea9143472713 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Lock "a8a62c2546af3a2036b853250c5ac64d4c6b4371" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:21:18 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-7e13af9a-0be2-441b-9966-ea9143472713 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:21:19 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-7e13af9a-0be2-441b-9966-ea9143472713 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json" returned: 0 in 0.194s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:21:19 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-7e13af9a-0be2-441b-9966-ea9143472713 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371,backing_fmt=raw /opt/stack/data/nova/instances/2fbdd8af-f608-4d73-92d9-ae0586814c1b/disk 1073741824 {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:21:19 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-7e13af9a-0be2-441b-9966-ea9143472713 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371,backing_fmt=raw /opt/stack/data/nova/instances/2fbdd8af-f608-4d73-92d9-ae0586814c1b/disk 1073741824" returned: 0 in 0.168s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:21:19 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-7e13af9a-0be2-441b-9966-ea9143472713 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Lock "a8a62c2546af3a2036b853250c5ac64d4c6b4371" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.370s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:21:19 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-7e13af9a-0be2-441b-9966-ea9143472713 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:21:19 user nova-compute[75226]: DEBUG nova.network.neutron [None req-7e13af9a-0be2-441b-9966-ea9143472713 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: 2fbdd8af-f608-4d73-92d9-ae0586814c1b] Successfully created port: 4316e1ea-ca57-46b7-b415-7af7d3997c2c {{(pid=75226) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 17 01:21:19 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-7e13af9a-0be2-441b-9966-ea9143472713 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json" returned: 0 in 0.172s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:21:19 user nova-compute[75226]: DEBUG nova.virt.disk.api [None req-7e13af9a-0be2-441b-9966-ea9143472713 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2fbdd8af-f608-4d73-92d9-ae0586814c1b/disk. size=1073741824 {{(pid=75226) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 17 01:21:19 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-7e13af9a-0be2-441b-9966-ea9143472713 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fbdd8af-f608-4d73-92d9-ae0586814c1b/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:21:19 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-7e13af9a-0be2-441b-9966-ea9143472713 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fbdd8af-f608-4d73-92d9-ae0586814c1b/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:21:19 user nova-compute[75226]: DEBUG nova.virt.disk.api [None req-7e13af9a-0be2-441b-9966-ea9143472713 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Cannot resize image /opt/stack/data/nova/instances/2fbdd8af-f608-4d73-92d9-ae0586814c1b/disk to a smaller size. {{(pid=75226) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 17 01:21:19 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-7e13af9a-0be2-441b-9966-ea9143472713 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: 2fbdd8af-f608-4d73-92d9-ae0586814c1b] Created local disks {{(pid=75226) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 17 01:21:19 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-7e13af9a-0be2-441b-9966-ea9143472713 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: 2fbdd8af-f608-4d73-92d9-ae0586814c1b] Ensure instance console log exists: /opt/stack/data/nova/instances/2fbdd8af-f608-4d73-92d9-ae0586814c1b/console.log {{(pid=75226) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 17 01:21:19 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-7e13af9a-0be2-441b-9966-ea9143472713 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:21:19 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-7e13af9a-0be2-441b-9966-ea9143472713 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:21:19 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-7e13af9a-0be2-441b-9966-ea9143472713 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:21:19 user nova-compute[75226]: DEBUG nova.network.neutron [None req-7e13af9a-0be2-441b-9966-ea9143472713 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: 2fbdd8af-f608-4d73-92d9-ae0586814c1b] Successfully updated port: 4316e1ea-ca57-46b7-b415-7af7d3997c2c {{(pid=75226) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 17 01:21:19 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-7e13af9a-0be2-441b-9966-ea9143472713 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Acquiring lock "refresh_cache-2fbdd8af-f608-4d73-92d9-ae0586814c1b" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:21:19 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-7e13af9a-0be2-441b-9966-ea9143472713 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Acquired lock "refresh_cache-2fbdd8af-f608-4d73-92d9-ae0586814c1b" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:21:19 user nova-compute[75226]: DEBUG nova.network.neutron [None req-7e13af9a-0be2-441b-9966-ea9143472713 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: 2fbdd8af-f608-4d73-92d9-ae0586814c1b] Building network info cache for instance {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 01:21:20 user nova-compute[75226]: DEBUG nova.compute.manager [req-0130e409-cd66-45c1-8009-d2828daba430 req-d1f0b626-858c-4c13-9d95-8cb88d66cf96 service nova] [instance: f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c] Received event network-vif-plugged-ed40e788-7338-4ecd-8204-008d4601131b {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:21:20 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-0130e409-cd66-45c1-8009-d2828daba430 req-d1f0b626-858c-4c13-9d95-8cb88d66cf96 service nova] Acquiring lock "f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:21:20 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-0130e409-cd66-45c1-8009-d2828daba430 req-d1f0b626-858c-4c13-9d95-8cb88d66cf96 service nova] Lock "f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:21:20 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-0130e409-cd66-45c1-8009-d2828daba430 req-d1f0b626-858c-4c13-9d95-8cb88d66cf96 service nova] Lock "f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:21:20 user nova-compute[75226]: DEBUG nova.compute.manager [req-0130e409-cd66-45c1-8009-d2828daba430 req-d1f0b626-858c-4c13-9d95-8cb88d66cf96 service nova] [instance: f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c] No waiting events found dispatching network-vif-plugged-ed40e788-7338-4ecd-8204-008d4601131b {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:21:20 user nova-compute[75226]: WARNING nova.compute.manager [req-0130e409-cd66-45c1-8009-d2828daba430 req-d1f0b626-858c-4c13-9d95-8cb88d66cf96 service nova] [instance: f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c] Received unexpected event network-vif-plugged-ed40e788-7338-4ecd-8204-008d4601131b for instance with vm_state building and task_state spawning.
Nov 17 01:21:20 user nova-compute[75226]: DEBUG nova.compute.manager [req-0130e409-cd66-45c1-8009-d2828daba430 req-d1f0b626-858c-4c13-9d95-8cb88d66cf96 service nova] [instance: 2fbdd8af-f608-4d73-92d9-ae0586814c1b] Received event network-changed-4316e1ea-ca57-46b7-b415-7af7d3997c2c {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:21:20 user nova-compute[75226]: DEBUG nova.compute.manager [req-0130e409-cd66-45c1-8009-d2828daba430 req-d1f0b626-858c-4c13-9d95-8cb88d66cf96 service nova] [instance: 2fbdd8af-f608-4d73-92d9-ae0586814c1b] Refreshing instance network info cache due to event network-changed-4316e1ea-ca57-46b7-b415-7af7d3997c2c. {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 01:21:20 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-0130e409-cd66-45c1-8009-d2828daba430 req-d1f0b626-858c-4c13-9d95-8cb88d66cf96 service nova] Acquiring lock "refresh_cache-2fbdd8af-f608-4d73-92d9-ae0586814c1b" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:21:20 user nova-compute[75226]: DEBUG nova.network.neutron [None req-7e13af9a-0be2-441b-9966-ea9143472713 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: 2fbdd8af-f608-4d73-92d9-ae0586814c1b] Instance cache missing network info. {{(pid=75226) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 17 01:21:20 user nova-compute[75226]: DEBUG nova.compute.manager [None req-f13d0d8a-2a91-4b2d-a1cc-3cbf580119d2 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] [instance: f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c] Instance event wait completed in 0 seconds for  {{(pid=75226) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 17 01:21:20 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-f13d0d8a-2a91-4b2d-a1cc-3cbf580119d2 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] [instance: f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c] Guest created on hypervisor {{(pid=75226) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 17 01:21:20 user nova-compute[75226]: INFO nova.virt.libvirt.driver [-] [instance: f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c] Instance spawned successfully.
Nov 17 01:21:20 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-f13d0d8a-2a91-4b2d-a1cc-3cbf580119d2 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] [instance: f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 17 01:21:20 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-f13d0d8a-2a91-4b2d-a1cc-3cbf580119d2 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] [instance: f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c] Found default for hw_cdrom_bus of ide {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:21:20 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-f13d0d8a-2a91-4b2d-a1cc-3cbf580119d2 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] [instance: f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c] Found default for hw_disk_bus of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:21:20 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-f13d0d8a-2a91-4b2d-a1cc-3cbf580119d2 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] [instance: f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c] Found default for hw_input_bus of None {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:21:20 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-f13d0d8a-2a91-4b2d-a1cc-3cbf580119d2 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] [instance: f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c] Found default for hw_pointer_model of None {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:21:20 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-f13d0d8a-2a91-4b2d-a1cc-3cbf580119d2 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] [instance: f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c] Found default for hw_video_model of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:21:20 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-f13d0d8a-2a91-4b2d-a1cc-3cbf580119d2 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] [instance: f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c] Found default for hw_vif_model of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:21:20 user nova-compute[75226]: INFO nova.compute.manager [None req-f13d0d8a-2a91-4b2d-a1cc-3cbf580119d2 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] [instance: f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c] Took 6.44 seconds to spawn the instance on the hypervisor.
Nov 17 01:21:20 user nova-compute[75226]: DEBUG nova.compute.manager [None req-f13d0d8a-2a91-4b2d-a1cc-3cbf580119d2 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] [instance: f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c] Checking state {{(pid=75226) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 01:21:20 user nova-compute[75226]: DEBUG nova.network.neutron [None req-7e13af9a-0be2-441b-9966-ea9143472713 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: 2fbdd8af-f608-4d73-92d9-ae0586814c1b] Updating instance_info_cache with network_info: [{"id": "4316e1ea-ca57-46b7-b415-7af7d3997c2c", "address": "fa:16:3e:03:ba:fb", "network": {"id": "57d0e7ee-0b11-4e00-86f9-bb4a3c25c674", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1357446034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e38777e8baf745e79f31190da97406a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4316e1ea-ca", "ovs_interfaceid": "4316e1ea-ca57-46b7-b415-7af7d3997c2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:21:20 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-7e13af9a-0be2-441b-9966-ea9143472713 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Releasing lock "refresh_cache-2fbdd8af-f608-4d73-92d9-ae0586814c1b" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:21:20 user nova-compute[75226]: DEBUG nova.compute.manager [None req-7e13af9a-0be2-441b-9966-ea9143472713 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: 2fbdd8af-f608-4d73-92d9-ae0586814c1b] Instance network_info: |[{"id": "4316e1ea-ca57-46b7-b415-7af7d3997c2c", "address": "fa:16:3e:03:ba:fb", "network": {"id": "57d0e7ee-0b11-4e00-86f9-bb4a3c25c674", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1357446034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e38777e8baf745e79f31190da97406a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4316e1ea-ca", "ovs_interfaceid": "4316e1ea-ca57-46b7-b415-7af7d3997c2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75226) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 17 01:21:20 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-0130e409-cd66-45c1-8009-d2828daba430 req-d1f0b626-858c-4c13-9d95-8cb88d66cf96 service nova] Acquired lock "refresh_cache-2fbdd8af-f608-4d73-92d9-ae0586814c1b" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:21:20 user nova-compute[75226]: DEBUG nova.network.neutron [req-0130e409-cd66-45c1-8009-d2828daba430 req-d1f0b626-858c-4c13-9d95-8cb88d66cf96 service nova] [instance: 2fbdd8af-f608-4d73-92d9-ae0586814c1b] Refreshing network info cache for port 4316e1ea-ca57-46b7-b415-7af7d3997c2c {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 01:21:20 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-7e13af9a-0be2-441b-9966-ea9143472713 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: 2fbdd8af-f608-4d73-92d9-ae0586814c1b] Start _get_guest_xml network_info=[{"id": "4316e1ea-ca57-46b7-b415-7af7d3997c2c", "address": "fa:16:3e:03:ba:fb", "network": {"id": "57d0e7ee-0b11-4e00-86f9-bb4a3c25c674", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1357446034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e38777e8baf745e79f31190da97406a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4316e1ea-ca", "ovs_interfaceid": "4316e1ea-ca57-46b7-b415-7af7d3997c2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T01:13:22Z,direct_url=<?>,disk_format='qcow2',id=0b369aea-6f3f-4690-9f01-229b90ab6310,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4e110cbf9a84362a6864a7732c435a1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T01:13:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '0b369aea-6f3f-4690-9f01-229b90ab6310'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75226) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 17 01:21:20 user nova-compute[75226]: INFO nova.compute.manager [None req-f13d0d8a-2a91-4b2d-a1cc-3cbf580119d2 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] [instance: f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c] Took 7.32 seconds to build instance.
Nov 17 01:21:20 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-7e13af9a-0be2-441b-9966-ea9143472713 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:21:20 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-7e13af9a-0be2-441b-9966-ea9143472713 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:21:20 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-7e13af9a-0be2-441b-9966-ea9143472713 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75226) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 17 01:21:20 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-7e13af9a-0be2-441b-9966-ea9143472713 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] CPU controller missing on host. {{(pid=75226) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 17 01:21:20 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-7e13af9a-0be2-441b-9966-ea9143472713 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75226) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 17 01:21:20 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-7e13af9a-0be2-441b-9966-ea9143472713 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] CPU controller found on host. {{(pid=75226) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 17 01:21:20 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-7e13af9a-0be2-441b-9966-ea9143472713 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75226) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 17 01:21:20 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-7e13af9a-0be2-441b-9966-ea9143472713 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-17T01:13:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T01:13:22Z,direct_url=<?>,disk_format='qcow2',id=0b369aea-6f3f-4690-9f01-229b90ab6310,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4e110cbf9a84362a6864a7732c435a1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T01:13:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 17 01:21:20 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-7e13af9a-0be2-441b-9966-ea9143472713 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Flavor limits 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 17 01:21:20 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-7e13af9a-0be2-441b-9966-ea9143472713 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Image limits 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 17 01:21:20 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-7e13af9a-0be2-441b-9966-ea9143472713 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Flavor pref 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 17 01:21:20 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-7e13af9a-0be2-441b-9966-ea9143472713 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Image pref 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 17 01:21:20 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-7e13af9a-0be2-441b-9966-ea9143472713 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 17 01:21:20 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-7e13af9a-0be2-441b-9966-ea9143472713 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 17 01:21:20 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-7e13af9a-0be2-441b-9966-ea9143472713 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75226) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 17 01:21:20 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-7e13af9a-0be2-441b-9966-ea9143472713 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Got 1 possible topologies {{(pid=75226) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 17 01:21:20 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-7e13af9a-0be2-441b-9966-ea9143472713 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 17 01:21:20 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-7e13af9a-0be2-441b-9966-ea9143472713 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 17 01:21:20 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-7e13af9a-0be2-441b-9966-ea9143472713 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:21:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-85385458',display_name='tempest-AttachVolumeNegativeTest-server-85385458',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-85385458',id=15,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO46rXGsJCsUKsG3L7Os3VOXlmaB5wyNEisbmxrfpssXGrAoRL9/uQPOgg8odupEi8Teu8yo5I2pKiJ22pWTE11MHyiRwbAlyRujmIJ4NnYJnG02tDdnLQIMxdAi4teuoA==',key_name='tempest-keypair-1691716024',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e38777e8baf745e79f31190da97406a0',ramdisk_id='',reservation_id='r-8backq3o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-940905741',owner_user_name='tempest-AttachVolumeNegativeTest-940905741-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T01:21:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='642db538240b4ca1a367cf4ee9714f66',uuid=2fbdd8af-f608-4d73-92d9-ae0586814c1b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4316e1ea-ca57-46b7-b415-7af7d3997c2c", "address": "fa:16:3e:03:ba:fb", "network": {"id": "57d0e7ee-0b11-4e00-86f9-bb4a3c25c674", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1357446034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e38777e8baf745e79f31190da97406a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4316e1ea-ca", "ovs_interfaceid": "4316e1ea-ca57-46b7-b415-7af7d3997c2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75226) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 01:21:20 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-7e13af9a-0be2-441b-9966-ea9143472713 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Converting VIF {"id": "4316e1ea-ca57-46b7-b415-7af7d3997c2c", "address": "fa:16:3e:03:ba:fb", "network": {"id": "57d0e7ee-0b11-4e00-86f9-bb4a3c25c674", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1357446034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e38777e8baf745e79f31190da97406a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4316e1ea-ca", "ovs_interfaceid": "4316e1ea-ca57-46b7-b415-7af7d3997c2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:21:20 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-7e13af9a-0be2-441b-9966-ea9143472713 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:ba:fb,bridge_name='br-int',has_traffic_filtering=True,id=4316e1ea-ca57-46b7-b415-7af7d3997c2c,network=Network(57d0e7ee-0b11-4e00-86f9-bb4a3c25c674),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4316e1ea-ca') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:21:20 user nova-compute[75226]: DEBUG nova.objects.instance [None req-7e13af9a-0be2-441b-9966-ea9143472713 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Lazy-loading 'pci_devices' on Instance uuid 2fbdd8af-f608-4d73-92d9-ae0586814c1b {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:21:20 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-f13d0d8a-2a91-4b2d-a1cc-3cbf580119d2 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Lock "f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.475s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:21:20 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-7e13af9a-0be2-441b-9966-ea9143472713 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: 2fbdd8af-f608-4d73-92d9-ae0586814c1b] End _get_guest_xml xml=<domain type="kvm">
Nov 17 01:21:20 user nova-compute[75226]:   <uuid>2fbdd8af-f608-4d73-92d9-ae0586814c1b</uuid>
Nov 17 01:21:20 user nova-compute[75226]:   <name>instance-0000000f</name>
Nov 17 01:21:20 user nova-compute[75226]:   <memory>524288</memory>
Nov 17 01:21:20 user nova-compute[75226]:   <vcpu>1</vcpu>
Nov 17 01:21:20 user nova-compute[75226]:   <metadata>
Nov 17 01:21:20 user nova-compute[75226]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 17 01:21:20 user nova-compute[75226]:       <nova:package version="0.0.0"/>
Nov 17 01:21:20 user nova-compute[75226]:       <nova:name>tempest-AttachVolumeNegativeTest-server-85385458</nova:name>
Nov 17 01:21:20 user nova-compute[75226]:       <nova:creationTime>2023-11-17 01:21:20</nova:creationTime>
Nov 17 01:21:20 user nova-compute[75226]:       <nova:flavor name="m1.tiny">
Nov 17 01:21:20 user nova-compute[75226]:         <nova:memory>512</nova:memory>
Nov 17 01:21:20 user nova-compute[75226]:         <nova:disk>1</nova:disk>
Nov 17 01:21:20 user nova-compute[75226]:         <nova:swap>0</nova:swap>
Nov 17 01:21:20 user nova-compute[75226]:         <nova:ephemeral>0</nova:ephemeral>
Nov 17 01:21:20 user nova-compute[75226]:         <nova:vcpus>1</nova:vcpus>
Nov 17 01:21:20 user nova-compute[75226]:       </nova:flavor>
Nov 17 01:21:20 user nova-compute[75226]:       <nova:owner>
Nov 17 01:21:20 user nova-compute[75226]:         <nova:user uuid="642db538240b4ca1a367cf4ee9714f66">tempest-AttachVolumeNegativeTest-940905741-project-member</nova:user>
Nov 17 01:21:20 user nova-compute[75226]:         <nova:project uuid="e38777e8baf745e79f31190da97406a0">tempest-AttachVolumeNegativeTest-940905741</nova:project>
Nov 17 01:21:20 user nova-compute[75226]:       </nova:owner>
Nov 17 01:21:20 user nova-compute[75226]:       <nova:root type="image" uuid="0b369aea-6f3f-4690-9f01-229b90ab6310"/>
Nov 17 01:21:20 user nova-compute[75226]:       <nova:ports>
Nov 17 01:21:20 user nova-compute[75226]:         <nova:port uuid="4316e1ea-ca57-46b7-b415-7af7d3997c2c">
Nov 17 01:21:20 user nova-compute[75226]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 17 01:21:20 user nova-compute[75226]:         </nova:port>
Nov 17 01:21:20 user nova-compute[75226]:       </nova:ports>
Nov 17 01:21:20 user nova-compute[75226]:     </nova:instance>
Nov 17 01:21:20 user nova-compute[75226]:   </metadata>
Nov 17 01:21:20 user nova-compute[75226]:   <sysinfo type="smbios">
Nov 17 01:21:20 user nova-compute[75226]:     <system>
Nov 17 01:21:20 user nova-compute[75226]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 17 01:21:20 user nova-compute[75226]:       <entry name="product">OpenStack Nova</entry>
Nov 17 01:21:20 user nova-compute[75226]:       <entry name="version">0.0.0</entry>
Nov 17 01:21:20 user nova-compute[75226]:       <entry name="serial">2fbdd8af-f608-4d73-92d9-ae0586814c1b</entry>
Nov 17 01:21:20 user nova-compute[75226]:       <entry name="uuid">2fbdd8af-f608-4d73-92d9-ae0586814c1b</entry>
Nov 17 01:21:20 user nova-compute[75226]:       <entry name="family">Virtual Machine</entry>
Nov 17 01:21:20 user nova-compute[75226]:     </system>
Nov 17 01:21:20 user nova-compute[75226]:   </sysinfo>
Nov 17 01:21:20 user nova-compute[75226]:   <os>
Nov 17 01:21:20 user nova-compute[75226]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 17 01:21:20 user nova-compute[75226]:     <boot dev="hd"/>
Nov 17 01:21:20 user nova-compute[75226]:     <smbios mode="sysinfo"/>
Nov 17 01:21:20 user nova-compute[75226]:   </os>
Nov 17 01:21:20 user nova-compute[75226]:   <features>
Nov 17 01:21:20 user nova-compute[75226]:     <acpi/>
Nov 17 01:21:20 user nova-compute[75226]:     <apic/>
Nov 17 01:21:20 user nova-compute[75226]:     <vmcoreinfo/>
Nov 17 01:21:20 user nova-compute[75226]:   </features>
Nov 17 01:21:20 user nova-compute[75226]:   <clock offset="utc">
Nov 17 01:21:20 user nova-compute[75226]:     <timer name="pit" tickpolicy="delay"/>
Nov 17 01:21:20 user nova-compute[75226]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 17 01:21:20 user nova-compute[75226]:     <timer name="hpet" present="no"/>
Nov 17 01:21:20 user nova-compute[75226]:   </clock>
Nov 17 01:21:20 user nova-compute[75226]:   <cpu mode="custom" match="exact">
Nov 17 01:21:20 user nova-compute[75226]:     <model>Nehalem</model>
Nov 17 01:21:20 user nova-compute[75226]:     <topology sockets="1" cores="1" threads="1"/>
Nov 17 01:21:20 user nova-compute[75226]:   </cpu>
Nov 17 01:21:20 user nova-compute[75226]:   <devices>
Nov 17 01:21:20 user nova-compute[75226]:     <disk type="file" device="disk">
Nov 17 01:21:20 user nova-compute[75226]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 17 01:21:20 user nova-compute[75226]:       <source file="/opt/stack/data/nova/instances/2fbdd8af-f608-4d73-92d9-ae0586814c1b/disk"/>
Nov 17 01:21:20 user nova-compute[75226]:       <target dev="vda" bus="virtio"/>
Nov 17 01:21:20 user nova-compute[75226]:     </disk>
Nov 17 01:21:20 user nova-compute[75226]:     <interface type="ethernet">
Nov 17 01:21:20 user nova-compute[75226]:       <mac address="fa:16:3e:03:ba:fb"/>
Nov 17 01:21:20 user nova-compute[75226]:       <model type="virtio"/>
Nov 17 01:21:20 user nova-compute[75226]:       <mtu size="1442"/>
Nov 17 01:21:20 user nova-compute[75226]:       <target dev="tap4316e1ea-ca"/>
Nov 17 01:21:20 user nova-compute[75226]:     </interface>
Nov 17 01:21:20 user nova-compute[75226]:     <serial type="pty">
Nov 17 01:21:20 user nova-compute[75226]:       <log file="/opt/stack/data/nova/instances/2fbdd8af-f608-4d73-92d9-ae0586814c1b/console.log" append="off"/>
Nov 17 01:21:20 user nova-compute[75226]:     </serial>
Nov 17 01:21:20 user nova-compute[75226]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 17 01:21:20 user nova-compute[75226]:     <video>
Nov 17 01:21:20 user nova-compute[75226]:       <model type="virtio"/>
Nov 17 01:21:20 user nova-compute[75226]:     </video>
Nov 17 01:21:20 user nova-compute[75226]:     <rng model="virtio">
Nov 17 01:21:20 user nova-compute[75226]:       <backend model="random">/dev/urandom</backend>
Nov 17 01:21:20 user nova-compute[75226]:     </rng>
Nov 17 01:21:20 user nova-compute[75226]:     <controller type="usb" index="0" model="none"/>
Nov 17 01:21:20 user nova-compute[75226]:     <memballoon model="virtio">
Nov 17 01:21:20 user nova-compute[75226]:       <stats period="10"/>
Nov 17 01:21:20 user nova-compute[75226]:     </memballoon>
Nov 17 01:21:20 user nova-compute[75226]:   </devices>
Nov 17 01:21:20 user nova-compute[75226]: </domain>
Nov 17 01:21:20 user nova-compute[75226]:  {{(pid=75226) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 17 01:21:20 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-7e13af9a-0be2-441b-9966-ea9143472713 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:21:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-85385458',display_name='tempest-AttachVolumeNegativeTest-server-85385458',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-85385458',id=15,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO46rXGsJCsUKsG3L7Os3VOXlmaB5wyNEisbmxrfpssXGrAoRL9/uQPOgg8odupEi8Teu8yo5I2pKiJ22pWTE11MHyiRwbAlyRujmIJ4NnYJnG02tDdnLQIMxdAi4teuoA==',key_name='tempest-keypair-1691716024',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e38777e8baf745e79f31190da97406a0',ramdisk_id='',reservation_id='r-8backq3o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-940905741',owner_user_name='tempest-AttachVolumeNegativeTest-940905741-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T01:21:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='642db538240b4ca1a367cf4ee9714f66',uuid=2fbdd8af-f608-4d73-92d9-ae0586814c1b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4316e1ea-ca57-46b7-b415-7af7d3997c2c", "address": "fa:16:3e:03:ba:fb", "network": {"id": "57d0e7ee-0b11-4e00-86f9-bb4a3c25c674", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1357446034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e38777e8baf745e79f31190da97406a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4316e1ea-ca", "ovs_interfaceid": "4316e1ea-ca57-46b7-b415-7af7d3997c2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 17 01:21:20 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-7e13af9a-0be2-441b-9966-ea9143472713 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Converting VIF {"id": "4316e1ea-ca57-46b7-b415-7af7d3997c2c", "address": "fa:16:3e:03:ba:fb", "network": {"id": "57d0e7ee-0b11-4e00-86f9-bb4a3c25c674", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1357446034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e38777e8baf745e79f31190da97406a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4316e1ea-ca", "ovs_interfaceid": "4316e1ea-ca57-46b7-b415-7af7d3997c2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:21:20 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-7e13af9a-0be2-441b-9966-ea9143472713 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:ba:fb,bridge_name='br-int',has_traffic_filtering=True,id=4316e1ea-ca57-46b7-b415-7af7d3997c2c,network=Network(57d0e7ee-0b11-4e00-86f9-bb4a3c25c674),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4316e1ea-ca') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:21:20 user nova-compute[75226]: DEBUG os_vif [None req-7e13af9a-0be2-441b-9966-ea9143472713 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:ba:fb,bridge_name='br-int',has_traffic_filtering=True,id=4316e1ea-ca57-46b7-b415-7af7d3997c2c,network=Network(57d0e7ee-0b11-4e00-86f9-bb4a3c25c674),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4316e1ea-ca') {{(pid=75226) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 17 01:21:20 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:21:20 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:21:20 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 17 01:21:20 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:21:20 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '74d20009-e4ee-5c78-b20d-989501fc055a', '_type': 'linux-noop'}}, row=False) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:21:20 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:21:20 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:21:20 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:21:20 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4316e1ea-ca, may_exist=True, interface_attrs={}) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:21:20 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4316e1ea-ca, col_values=(('qos', UUID('dbe3d745-7b29-4be5-a480-c8f8c036faeb')),), if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:21:20 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4316e1ea-ca, col_values=(('external_ids', {'iface-id': '4316e1ea-ca57-46b7-b415-7af7d3997c2c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:03:ba:fb', 'vm-uuid': '2fbdd8af-f608-4d73-92d9-ae0586814c1b'}),), if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:21:20 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:21:20 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:21:20 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:21:20 user nova-compute[75226]: INFO os_vif [None req-7e13af9a-0be2-441b-9966-ea9143472713 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:ba:fb,bridge_name='br-int',has_traffic_filtering=True,id=4316e1ea-ca57-46b7-b415-7af7d3997c2c,network=Network(57d0e7ee-0b11-4e00-86f9-bb4a3c25c674),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4316e1ea-ca')
Nov 17 01:21:20 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-7e13af9a-0be2-441b-9966-ea9143472713 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] No BDM found with device name vda, not building metadata. {{(pid=75226) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 01:21:20 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-7e13af9a-0be2-441b-9966-ea9143472713 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] No VIF found with MAC fa:16:3e:03:ba:fb, not building metadata {{(pid=75226) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 01:21:20 user nova-compute[75226]: DEBUG nova.network.neutron [req-0130e409-cd66-45c1-8009-d2828daba430 req-d1f0b626-858c-4c13-9d95-8cb88d66cf96 service nova] [instance: 2fbdd8af-f608-4d73-92d9-ae0586814c1b] Updated VIF entry in instance network info cache for port 4316e1ea-ca57-46b7-b415-7af7d3997c2c. {{(pid=75226) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 01:21:20 user nova-compute[75226]: DEBUG nova.network.neutron [req-0130e409-cd66-45c1-8009-d2828daba430 req-d1f0b626-858c-4c13-9d95-8cb88d66cf96 service nova] [instance: 2fbdd8af-f608-4d73-92d9-ae0586814c1b] Updating instance_info_cache with network_info: [{"id": "4316e1ea-ca57-46b7-b415-7af7d3997c2c", "address": "fa:16:3e:03:ba:fb", "network": {"id": "57d0e7ee-0b11-4e00-86f9-bb4a3c25c674", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1357446034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e38777e8baf745e79f31190da97406a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4316e1ea-ca", "ovs_interfaceid": "4316e1ea-ca57-46b7-b415-7af7d3997c2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:21:20 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-0130e409-cd66-45c1-8009-d2828daba430 req-d1f0b626-858c-4c13-9d95-8cb88d66cf96 service nova] Releasing lock "refresh_cache-2fbdd8af-f608-4d73-92d9-ae0586814c1b" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:21:21 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:21:21 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:21:21 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:21:21 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:21:22 user nova-compute[75226]: DEBUG nova.compute.manager [req-f712c335-e255-44d7-b30a-f56bf42f6793 req-889a9f7d-2bed-4b2d-bde2-ea459a05a57c service nova] [instance: 2fbdd8af-f608-4d73-92d9-ae0586814c1b] Received event network-vif-plugged-4316e1ea-ca57-46b7-b415-7af7d3997c2c {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:21:22 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-f712c335-e255-44d7-b30a-f56bf42f6793 req-889a9f7d-2bed-4b2d-bde2-ea459a05a57c service nova] Acquiring lock "2fbdd8af-f608-4d73-92d9-ae0586814c1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:21:22 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-f712c335-e255-44d7-b30a-f56bf42f6793 req-889a9f7d-2bed-4b2d-bde2-ea459a05a57c service nova] Lock "2fbdd8af-f608-4d73-92d9-ae0586814c1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:21:22 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-f712c335-e255-44d7-b30a-f56bf42f6793 req-889a9f7d-2bed-4b2d-bde2-ea459a05a57c service nova] Lock "2fbdd8af-f608-4d73-92d9-ae0586814c1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:21:22 user nova-compute[75226]: DEBUG nova.compute.manager [req-f712c335-e255-44d7-b30a-f56bf42f6793 req-889a9f7d-2bed-4b2d-bde2-ea459a05a57c service nova] [instance: 2fbdd8af-f608-4d73-92d9-ae0586814c1b] No waiting events found dispatching network-vif-plugged-4316e1ea-ca57-46b7-b415-7af7d3997c2c {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:21:22 user nova-compute[75226]: WARNING nova.compute.manager [req-f712c335-e255-44d7-b30a-f56bf42f6793 req-889a9f7d-2bed-4b2d-bde2-ea459a05a57c service nova] [instance: 2fbdd8af-f608-4d73-92d9-ae0586814c1b] Received unexpected event network-vif-plugged-4316e1ea-ca57-46b7-b415-7af7d3997c2c for instance with vm_state building and task_state spawning.
Nov 17 01:21:22 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:21:22 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:21:22 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:21:22 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:21:22 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:21:24 user nova-compute[75226]: DEBUG nova.compute.manager [None req-7e13af9a-0be2-441b-9966-ea9143472713 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: 2fbdd8af-f608-4d73-92d9-ae0586814c1b] Instance event wait completed in 0 seconds for  {{(pid=75226) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 17 01:21:24 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-7e13af9a-0be2-441b-9966-ea9143472713 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: 2fbdd8af-f608-4d73-92d9-ae0586814c1b] Guest created on hypervisor {{(pid=75226) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 17 01:21:24 user nova-compute[75226]: DEBUG nova.compute.manager [req-0f3b4b12-bc9b-4b4c-bb18-77ecd77673ca req-bd56dfc9-4920-4c30-9205-ff7bfb28a588 service nova] [instance: 2fbdd8af-f608-4d73-92d9-ae0586814c1b] Received event network-vif-plugged-4316e1ea-ca57-46b7-b415-7af7d3997c2c {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:21:24 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-0f3b4b12-bc9b-4b4c-bb18-77ecd77673ca req-bd56dfc9-4920-4c30-9205-ff7bfb28a588 service nova] Acquiring lock "2fbdd8af-f608-4d73-92d9-ae0586814c1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:21:24 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-0f3b4b12-bc9b-4b4c-bb18-77ecd77673ca req-bd56dfc9-4920-4c30-9205-ff7bfb28a588 service nova] Lock "2fbdd8af-f608-4d73-92d9-ae0586814c1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:21:24 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-0f3b4b12-bc9b-4b4c-bb18-77ecd77673ca req-bd56dfc9-4920-4c30-9205-ff7bfb28a588 service nova] Lock "2fbdd8af-f608-4d73-92d9-ae0586814c1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:21:24 user nova-compute[75226]: DEBUG nova.compute.manager [req-0f3b4b12-bc9b-4b4c-bb18-77ecd77673ca req-bd56dfc9-4920-4c30-9205-ff7bfb28a588 service nova] [instance: 2fbdd8af-f608-4d73-92d9-ae0586814c1b] No waiting events found dispatching network-vif-plugged-4316e1ea-ca57-46b7-b415-7af7d3997c2c {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:21:24 user nova-compute[75226]: WARNING nova.compute.manager [req-0f3b4b12-bc9b-4b4c-bb18-77ecd77673ca req-bd56dfc9-4920-4c30-9205-ff7bfb28a588 service nova] [instance: 2fbdd8af-f608-4d73-92d9-ae0586814c1b] Received unexpected event network-vif-plugged-4316e1ea-ca57-46b7-b415-7af7d3997c2c for instance with vm_state building and task_state spawning.
Nov 17 01:21:24 user nova-compute[75226]: INFO nova.virt.libvirt.driver [-] [instance: 2fbdd8af-f608-4d73-92d9-ae0586814c1b] Instance spawned successfully.
Nov 17 01:21:24 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-7e13af9a-0be2-441b-9966-ea9143472713 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: 2fbdd8af-f608-4d73-92d9-ae0586814c1b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 17 01:21:24 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-7e13af9a-0be2-441b-9966-ea9143472713 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: 2fbdd8af-f608-4d73-92d9-ae0586814c1b] Found default for hw_cdrom_bus of ide {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:21:24 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-7e13af9a-0be2-441b-9966-ea9143472713 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: 2fbdd8af-f608-4d73-92d9-ae0586814c1b] Found default for hw_disk_bus of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:21:24 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-7e13af9a-0be2-441b-9966-ea9143472713 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: 2fbdd8af-f608-4d73-92d9-ae0586814c1b] Found default for hw_input_bus of None {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:21:24 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-7e13af9a-0be2-441b-9966-ea9143472713 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: 2fbdd8af-f608-4d73-92d9-ae0586814c1b] Found default for hw_pointer_model of None {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:21:24 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-7e13af9a-0be2-441b-9966-ea9143472713 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: 2fbdd8af-f608-4d73-92d9-ae0586814c1b] Found default for hw_video_model of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:21:24 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-7e13af9a-0be2-441b-9966-ea9143472713 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: 2fbdd8af-f608-4d73-92d9-ae0586814c1b] Found default for hw_vif_model of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:21:24 user nova-compute[75226]: INFO nova.compute.manager [None req-7e13af9a-0be2-441b-9966-ea9143472713 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: 2fbdd8af-f608-4d73-92d9-ae0586814c1b] Took 5.41 seconds to spawn the instance on the hypervisor.
Nov 17 01:21:24 user nova-compute[75226]: DEBUG nova.compute.manager [None req-7e13af9a-0be2-441b-9966-ea9143472713 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: 2fbdd8af-f608-4d73-92d9-ae0586814c1b] Checking state {{(pid=75226) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 01:21:24 user nova-compute[75226]: INFO nova.compute.manager [None req-7e13af9a-0be2-441b-9966-ea9143472713 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: 2fbdd8af-f608-4d73-92d9-ae0586814c1b] Took 6.20 seconds to build instance.
Nov 17 01:21:24 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-7e13af9a-0be2-441b-9966-ea9143472713 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Lock "2fbdd8af-f608-4d73-92d9-ae0586814c1b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.319s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:21:24 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-279ac783-766b-4649-9c69-6485bc534667 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] Acquiring lock "262eb845-eebe-4ffb-bc49-dcaca53ad7b8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:21:24 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-279ac783-766b-4649-9c69-6485bc534667 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] Lock "262eb845-eebe-4ffb-bc49-dcaca53ad7b8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:21:24 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-279ac783-766b-4649-9c69-6485bc534667 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] Acquiring lock "262eb845-eebe-4ffb-bc49-dcaca53ad7b8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:21:24 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-279ac783-766b-4649-9c69-6485bc534667 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] Lock "262eb845-eebe-4ffb-bc49-dcaca53ad7b8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:21:24 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-279ac783-766b-4649-9c69-6485bc534667 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] Lock "262eb845-eebe-4ffb-bc49-dcaca53ad7b8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:21:24 user nova-compute[75226]: INFO nova.compute.manager [None req-279ac783-766b-4649-9c69-6485bc534667 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] [instance: 262eb845-eebe-4ffb-bc49-dcaca53ad7b8] Terminating instance
Nov 17 01:21:24 user nova-compute[75226]: DEBUG nova.compute.manager [None req-279ac783-766b-4649-9c69-6485bc534667 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] [instance: 262eb845-eebe-4ffb-bc49-dcaca53ad7b8] Start destroying the instance on the hypervisor. {{(pid=75226) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 17 01:21:24 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:21:24 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:21:24 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:21:24 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:21:25 user nova-compute[75226]: DEBUG nova.compute.manager [req-56344439-56ab-487f-b0ef-d14506038af2 req-a3db3dfd-c6bc-48e7-aead-25535ddfb96d service nova] [instance: 262eb845-eebe-4ffb-bc49-dcaca53ad7b8] Received event network-vif-unplugged-ca3803cf-fc7f-4233-8afa-1806c73156be {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:21:25 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-56344439-56ab-487f-b0ef-d14506038af2 req-a3db3dfd-c6bc-48e7-aead-25535ddfb96d service nova] Acquiring lock "262eb845-eebe-4ffb-bc49-dcaca53ad7b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:21:25 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-56344439-56ab-487f-b0ef-d14506038af2 req-a3db3dfd-c6bc-48e7-aead-25535ddfb96d service nova] Lock "262eb845-eebe-4ffb-bc49-dcaca53ad7b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:21:25 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-56344439-56ab-487f-b0ef-d14506038af2 req-a3db3dfd-c6bc-48e7-aead-25535ddfb96d service nova] Lock "262eb845-eebe-4ffb-bc49-dcaca53ad7b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:21:25 user nova-compute[75226]: DEBUG nova.compute.manager [req-56344439-56ab-487f-b0ef-d14506038af2 req-a3db3dfd-c6bc-48e7-aead-25535ddfb96d service nova] [instance: 262eb845-eebe-4ffb-bc49-dcaca53ad7b8] No waiting events found dispatching network-vif-unplugged-ca3803cf-fc7f-4233-8afa-1806c73156be {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:21:25 user nova-compute[75226]: DEBUG nova.compute.manager [req-56344439-56ab-487f-b0ef-d14506038af2 req-a3db3dfd-c6bc-48e7-aead-25535ddfb96d service nova] [instance: 262eb845-eebe-4ffb-bc49-dcaca53ad7b8] Received event network-vif-unplugged-ca3803cf-fc7f-4233-8afa-1806c73156be for instance with task_state deleting. {{(pid=75226) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 17 01:21:25 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:21:25 user nova-compute[75226]: INFO nova.virt.libvirt.driver [-] [instance: 262eb845-eebe-4ffb-bc49-dcaca53ad7b8] Instance destroyed successfully.
Nov 17 01:21:25 user nova-compute[75226]: DEBUG nova.objects.instance [None req-279ac783-766b-4649-9c69-6485bc534667 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] Lazy-loading 'resources' on Instance uuid 262eb845-eebe-4ffb-bc49-dcaca53ad7b8 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:21:25 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-279ac783-766b-4649-9c69-6485bc534667 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-17T01:17:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1083843920',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-2087129181',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKV3eUaLv1Nf2GbMurBwqVCKHkTHGINwHn9NxIQT1HFJaTPcIhblv549UYBEzh8qzhRSlfco2n2Ir3Yj2M5HfVEZNDfmX2UBxm0ZhLW7VwOddfd0Muufn03LFhj/HJg0+w==',key_name='tempest-keypair-214561330',keypairs=<?>,launch_index=0,launched_at=2023-11-17T01:20:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='25ffeaafcdca494eb7550cec5b100051',ramdisk_id='',reservation_id='r-7fgkbn6g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1243685842',owner_user_name='tempest-ServerActionsV293TestJSON-1243685842-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T01:20:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2c4b7f0453ec4ef5940b4bdf32bdf6f4',uuid=262eb845-eebe-4ffb-bc49-dcaca53ad7b8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ca3803cf-fc7f-4233-8afa-1806c73156be", "address": "fa:16:3e:d9:19:6e", "network": {"id": "432afb25-848f-4ef8-8436-11db949783e6", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1854406043-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25ffeaafcdca494eb7550cec5b100051", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca3803cf-fc", "ovs_interfaceid": "ca3803cf-fc7f-4233-8afa-1806c73156be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 17 01:21:25 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-279ac783-766b-4649-9c69-6485bc534667 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] Converting VIF {"id": "ca3803cf-fc7f-4233-8afa-1806c73156be", "address": "fa:16:3e:d9:19:6e", "network": {"id": "432afb25-848f-4ef8-8436-11db949783e6", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1854406043-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25ffeaafcdca494eb7550cec5b100051", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca3803cf-fc", "ovs_interfaceid": "ca3803cf-fc7f-4233-8afa-1806c73156be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:21:25 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-279ac783-766b-4649-9c69-6485bc534667 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d9:19:6e,bridge_name='br-int',has_traffic_filtering=True,id=ca3803cf-fc7f-4233-8afa-1806c73156be,network=Network(432afb25-848f-4ef8-8436-11db949783e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca3803cf-fc') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:21:25 user nova-compute[75226]: DEBUG os_vif [None req-279ac783-766b-4649-9c69-6485bc534667 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d9:19:6e,bridge_name='br-int',has_traffic_filtering=True,id=ca3803cf-fc7f-4233-8afa-1806c73156be,network=Network(432afb25-848f-4ef8-8436-11db949783e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca3803cf-fc') {{(pid=75226) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 17 01:21:25 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:21:25 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapca3803cf-fc, bridge=br-int, if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:21:25 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:21:25 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:21:25 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bdcb8900-4f4a-434c-8b44-932785b867fa) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:21:25 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:21:25 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:21:25 user nova-compute[75226]: INFO os_vif [None req-279ac783-766b-4649-9c69-6485bc534667 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d9:19:6e,bridge_name='br-int',has_traffic_filtering=True,id=ca3803cf-fc7f-4233-8afa-1806c73156be,network=Network(432afb25-848f-4ef8-8436-11db949783e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca3803cf-fc')
Nov 17 01:21:25 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-279ac783-766b-4649-9c69-6485bc534667 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] [instance: 262eb845-eebe-4ffb-bc49-dcaca53ad7b8] calling os-brick to detach iSCSI Volume {{(pid=75226) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 17 01:21:25 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-279ac783-766b-4649-9c69-6485bc534667 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc4cc36b490>, {'target_iqn': 'iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iChyRSBt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:21:25 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-279ac783-766b-4649-9c69-6485bc534667 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:21:25 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-279ac783-766b-4649-9c69-6485bc534667 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:21:25 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-279ac783-766b-4649-9c69-6485bc534667 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:21:25 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:21:25 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:21:25 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f4a5e62-8818-4c5a-b1cb-f191444afe5d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fa7be6d3-d525-4aa3-bcc3-481465f2832b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:21:25 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-279ac783-766b-4649-9c69-6485bc534667 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 17 01:21:25 user nova-compute[75226]: No targets found.
Nov 17 01:21:25 user nova-compute[75226]: iSNS:
Nov 17 01:21:25 user nova-compute[75226]: No targets found.
Nov 17 01:21:25 user nova-compute[75226]: STATIC:
Nov 17 01:21:25 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:fa7be6d3-d525-4aa3-bcc3-481465f2832b
Nov 17 01:21:25 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:21:25 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:21:25 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8
Nov 17 01:21:25 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:21:25 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:21:25 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2
Nov 17 01:21:25 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:21:25 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:21:25 user nova-compute[75226]: FIRMWARE:
Nov 17 01:21:25 user nova-compute[75226]: No targets found.
Nov 17 01:21:25 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:21:25 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-279ac783-766b-4649-9c69-6485bc534667 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 17 01:21:25 user nova-compute[75226]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 17 01:21:25 user nova-compute[75226]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75226) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 17 01:21:25 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-279ac783-766b-4649-9c69-6485bc534667 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2', 0)] {{(pid=75226) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 17 01:21:25 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:21:25 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:21:25 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[07c4e4f0-f0d1-457c-a98b-5d9d1b5fa4bd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa7be6d3-d525-4aa3-bcc3-481465f2832b\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:21:25 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:21:25 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:21:25 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ddafbf0-8030-48f2-90f7-f5b619eb458e]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa7be6d3-d525-4aa3-bcc3-481465f2832b (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:21:25 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-279ac783-766b-4649-9c69-6485bc534667 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2 (non-flash)
Nov 17 01:21:25 user nova-compute[75226]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)
Nov 17 01:21:25 user nova-compute[75226]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa7be6d3-d525-4aa3-bcc3-481465f2832b (non-flash)
Nov 17 01:21:25 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:21:25 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-279ac783-766b-4649-9c69-6485bc534667 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2 (non-flash)
Nov 17 01:21:25 user nova-compute[75226]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)
Nov 17 01:21:25 user nova-compute[75226]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa7be6d3-d525-4aa3-bcc3-481465f2832b (non-flash)
Nov 17 01:21:25 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:21:25 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-279ac783-766b-4649-9c69-6485bc534667 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc4b43d9ea0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2'): ({'sdb'}, set())}) {{(pid=75226) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 17 01:21:25 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-279ac783-766b-4649-9c69-6485bc534667 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] Removing single pathed devices sdb {{(pid=75226) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 17 01:21:25 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:21:25 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:21:25 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbb4dfdf-6ea7-4795-8029-08951a23c0d5]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:21:25 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:21:25 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:21:25 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cb637ed-31cf-460d-8d12-89042920e06d]: (4, ('ok\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:21:25 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-279ac783-766b-4649-9c69-6485bc534667 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] Flushing IO for device /dev/sdb {{(pid=75226) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 17 01:21:25 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:21:25 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.031s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:21:25 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[681fb91a-9944-4c1c-9c36-108ffde9e458]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:21:25 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-279ac783-766b-4649-9c69-6485bc534667 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75226) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 17 01:21:25 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:21:25 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.056s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:21:25 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[73468ad9-4185-4c82-b85c-33a24c9ef69c]: (4, ('1', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:21:25 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-279ac783-766b-4649-9c69-6485bc534667 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75226) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 17 01:21:25 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-279ac783-766b-4649-9c69-6485bc534667 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] SCSI volumes sdb have been removed. {{(pid=75226) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 17 01:21:25 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-279ac783-766b-4649-9c69-6485bc534667 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2')] {{(pid=75226) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 17 01:21:25 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:21:25 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:21:25 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fbd50f0-2682-47eb-8061-9cb107bd1420]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:21:25 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-279ac783-766b-4649-9c69-6485bc534667 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:21:25 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2 -p 172.16.0.220:3260 --logout {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:21:25 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:21:25 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[c819e978-15ad-456c-8231-e455c59253f8]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:21:25 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-279ac783-766b-4649-9c69-6485bc534667 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2, portal: 172.16.0.220,3260]
Nov 17 01:21:25 user nova-compute[75226]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2, portal: 172.16.0.220,3260] successful.
Nov 17 01:21:25 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:21:25 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2 -p 172.16.0.220:3260 --op delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:21:26 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ca02b15-b2b8-4e45-9d87-54886c2568a2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:21:26 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5571cc6-2f6e-4f88-b7da-27812b82d5b9]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:21:26 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-279ac783-766b-4649-9c69-6485bc534667 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:21:26 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-279ac783-766b-4649-9c69-6485bc534667 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.364s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:21:26 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-279ac783-766b-4649-9c69-6485bc534667 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] <== disconnect_volume: return (367ms) None {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:21:26 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-279ac783-766b-4649-9c69-6485bc534667 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] [instance: 262eb845-eebe-4ffb-bc49-dcaca53ad7b8] Disconnected iSCSI Volume {{(pid=75226) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 17 01:21:26 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-279ac783-766b-4649-9c69-6485bc534667 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] [instance: 262eb845-eebe-4ffb-bc49-dcaca53ad7b8] Deleting instance files /opt/stack/data/nova/instances/262eb845-eebe-4ffb-bc49-dcaca53ad7b8_del
Nov 17 01:21:26 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-279ac783-766b-4649-9c69-6485bc534667 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] [instance: 262eb845-eebe-4ffb-bc49-dcaca53ad7b8] Deletion of /opt/stack/data/nova/instances/262eb845-eebe-4ffb-bc49-dcaca53ad7b8_del complete
Nov 17 01:21:26 user nova-compute[75226]: INFO nova.compute.manager [None req-279ac783-766b-4649-9c69-6485bc534667 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] [instance: 262eb845-eebe-4ffb-bc49-dcaca53ad7b8] Took 1.30 seconds to destroy the instance on the hypervisor.
Nov 17 01:21:26 user nova-compute[75226]: DEBUG oslo.service.loopingcall [None req-279ac783-766b-4649-9c69-6485bc534667 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75226) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 17 01:21:26 user nova-compute[75226]: DEBUG nova.compute.manager [-] [instance: 262eb845-eebe-4ffb-bc49-dcaca53ad7b8] Deallocating network for instance {{(pid=75226) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 17 01:21:26 user nova-compute[75226]: DEBUG nova.network.neutron [-] [instance: 262eb845-eebe-4ffb-bc49-dcaca53ad7b8] deallocate_for_instance() {{(pid=75226) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 17 01:21:26 user nova-compute[75226]: DEBUG nova.network.neutron [-] [instance: 262eb845-eebe-4ffb-bc49-dcaca53ad7b8] Updating instance_info_cache with network_info: [] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:21:26 user nova-compute[75226]: INFO nova.compute.manager [-] [instance: 262eb845-eebe-4ffb-bc49-dcaca53ad7b8] Took 0.78 seconds to deallocate network for instance.
Nov 17 01:21:26 user nova-compute[75226]: DEBUG nova.compute.manager [req-f8e2ab00-6575-4767-a407-4e774c69e841 req-e18b2d4c-8e5e-489a-bb95-74f00dd21cba service nova] [instance: 262eb845-eebe-4ffb-bc49-dcaca53ad7b8] Received event network-vif-deleted-ca3803cf-fc7f-4233-8afa-1806c73156be {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:21:26 user nova-compute[75226]: INFO nova.compute.manager [req-f8e2ab00-6575-4767-a407-4e774c69e841 req-e18b2d4c-8e5e-489a-bb95-74f00dd21cba service nova] [instance: 262eb845-eebe-4ffb-bc49-dcaca53ad7b8] Neutron deleted interface ca3803cf-fc7f-4233-8afa-1806c73156be; detaching it from the instance and deleting it from the info cache
Nov 17 01:21:26 user nova-compute[75226]: DEBUG nova.network.neutron [req-f8e2ab00-6575-4767-a407-4e774c69e841 req-e18b2d4c-8e5e-489a-bb95-74f00dd21cba service nova] [instance: 262eb845-eebe-4ffb-bc49-dcaca53ad7b8] Updating instance_info_cache with network_info: [] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:21:26 user nova-compute[75226]: DEBUG nova.compute.manager [req-f8e2ab00-6575-4767-a407-4e774c69e841 req-e18b2d4c-8e5e-489a-bb95-74f00dd21cba service nova] [instance: 262eb845-eebe-4ffb-bc49-dcaca53ad7b8] Detach interface failed, port_id=ca3803cf-fc7f-4233-8afa-1806c73156be, reason: Instance 262eb845-eebe-4ffb-bc49-dcaca53ad7b8 could not be found. {{(pid=75226) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 17 01:21:27 user nova-compute[75226]: DEBUG nova.compute.manager [req-754a0bc0-c0d1-442c-97fa-0bf82a54508a req-b7cad4e0-0b53-4f10-a54e-34f193fc99f0 service nova] [instance: 262eb845-eebe-4ffb-bc49-dcaca53ad7b8] Received event network-vif-plugged-ca3803cf-fc7f-4233-8afa-1806c73156be {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:21:27 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-754a0bc0-c0d1-442c-97fa-0bf82a54508a req-b7cad4e0-0b53-4f10-a54e-34f193fc99f0 service nova] Acquiring lock "262eb845-eebe-4ffb-bc49-dcaca53ad7b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:21:27 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-754a0bc0-c0d1-442c-97fa-0bf82a54508a req-b7cad4e0-0b53-4f10-a54e-34f193fc99f0 service nova] Lock "262eb845-eebe-4ffb-bc49-dcaca53ad7b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:21:27 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-754a0bc0-c0d1-442c-97fa-0bf82a54508a req-b7cad4e0-0b53-4f10-a54e-34f193fc99f0 service nova] Lock "262eb845-eebe-4ffb-bc49-dcaca53ad7b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:21:27 user nova-compute[75226]: DEBUG nova.compute.manager [req-754a0bc0-c0d1-442c-97fa-0bf82a54508a req-b7cad4e0-0b53-4f10-a54e-34f193fc99f0 service nova] [instance: 262eb845-eebe-4ffb-bc49-dcaca53ad7b8] No waiting events found dispatching network-vif-plugged-ca3803cf-fc7f-4233-8afa-1806c73156be {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:21:27 user nova-compute[75226]: WARNING nova.compute.manager [req-754a0bc0-c0d1-442c-97fa-0bf82a54508a req-b7cad4e0-0b53-4f10-a54e-34f193fc99f0 service nova] [instance: 262eb845-eebe-4ffb-bc49-dcaca53ad7b8] Received unexpected event network-vif-plugged-ca3803cf-fc7f-4233-8afa-1806c73156be for instance with vm_state active and task_state deleting.
Nov 17 01:21:27 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:21:27 user nova-compute[75226]: INFO nova.compute.manager [None req-279ac783-766b-4649-9c69-6485bc534667 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] [instance: 262eb845-eebe-4ffb-bc49-dcaca53ad7b8] Took 0.77 seconds to detach 1 volumes for instance.
Nov 17 01:21:27 user nova-compute[75226]: DEBUG nova.compute.manager [None req-279ac783-766b-4649-9c69-6485bc534667 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] [instance: 262eb845-eebe-4ffb-bc49-dcaca53ad7b8] Deleting volume: 2ca02b15-b2b8-4e45-9d87-54886c2568a2 {{(pid=75226) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 17 01:21:27 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-279ac783-766b-4649-9c69-6485bc534667 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:21:27 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-279ac783-766b-4649-9c69-6485bc534667 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:21:28 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-279ac783-766b-4649-9c69-6485bc534667 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:21:28 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-279ac783-766b-4649-9c69-6485bc534667 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:21:28 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-279ac783-766b-4649-9c69-6485bc534667 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.391s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:21:28 user nova-compute[75226]: INFO nova.scheduler.client.report [None req-279ac783-766b-4649-9c69-6485bc534667 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] Deleted allocations for instance 262eb845-eebe-4ffb-bc49-dcaca53ad7b8
Nov 17 01:21:28 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-279ac783-766b-4649-9c69-6485bc534667 tempest-ServerActionsV293TestJSON-1243685842 tempest-ServerActionsV293TestJSON-1243685842-project-member] Lock "262eb845-eebe-4ffb-bc49-dcaca53ad7b8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.506s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:21:28 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:21:30 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:21:31 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:21:32 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:21:34 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:21:35 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:21:37 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:21:40 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:21:42 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:21:42 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:21:44 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:21:45 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:21:47 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-16492697-8e3c-4860-a714-d84c147268f0 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Acquiring lock "38062487-67ca-4962-974f-81456aebe97b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:21:47 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-16492697-8e3c-4860-a714-d84c147268f0 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Lock "38062487-67ca-4962-974f-81456aebe97b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:21:47 user nova-compute[75226]: DEBUG nova.compute.manager [None req-16492697-8e3c-4860-a714-d84c147268f0 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: 38062487-67ca-4962-974f-81456aebe97b] Starting instance... {{(pid=75226) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 17 01:21:47 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-16492697-8e3c-4860-a714-d84c147268f0 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:21:47 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-16492697-8e3c-4860-a714-d84c147268f0 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:21:47 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-16492697-8e3c-4860-a714-d84c147268f0 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75226) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 17 01:21:47 user nova-compute[75226]: INFO nova.compute.claims [None req-16492697-8e3c-4860-a714-d84c147268f0 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: 38062487-67ca-4962-974f-81456aebe97b] Claim successful on node user
Nov 17 01:21:47 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:21:47 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-16492697-8e3c-4860-a714-d84c147268f0 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:21:47 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-16492697-8e3c-4860-a714-d84c147268f0 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:21:47 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-16492697-8e3c-4860-a714-d84c147268f0 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.415s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:21:47 user nova-compute[75226]: DEBUG nova.compute.manager [None req-16492697-8e3c-4860-a714-d84c147268f0 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: 38062487-67ca-4962-974f-81456aebe97b] Start building networks asynchronously for instance. {{(pid=75226) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 17 01:21:48 user nova-compute[75226]: DEBUG nova.compute.manager [None req-16492697-8e3c-4860-a714-d84c147268f0 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: 38062487-67ca-4962-974f-81456aebe97b] Allocating IP information in the background. {{(pid=75226) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 17 01:21:48 user nova-compute[75226]: DEBUG nova.network.neutron [None req-16492697-8e3c-4860-a714-d84c147268f0 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: 38062487-67ca-4962-974f-81456aebe97b] allocate_for_instance() {{(pid=75226) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 17 01:21:48 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-16492697-8e3c-4860-a714-d84c147268f0 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: 38062487-67ca-4962-974f-81456aebe97b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 17 01:21:48 user nova-compute[75226]: DEBUG nova.compute.manager [None req-16492697-8e3c-4860-a714-d84c147268f0 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: 38062487-67ca-4962-974f-81456aebe97b] Start building block device mappings for instance. {{(pid=75226) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 17 01:21:48 user nova-compute[75226]: DEBUG nova.policy [None req-16492697-8e3c-4860-a714-d84c147268f0 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a13dd8231937440185c9fc628c3bd5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9042fe4ecc245dd97553f6e942c3e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75226) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 17 01:21:48 user nova-compute[75226]: DEBUG nova.compute.manager [None req-16492697-8e3c-4860-a714-d84c147268f0 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: 38062487-67ca-4962-974f-81456aebe97b] Start spawning the instance on the hypervisor. {{(pid=75226) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 17 01:21:48 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-16492697-8e3c-4860-a714-d84c147268f0 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: 38062487-67ca-4962-974f-81456aebe97b] Creating instance directory {{(pid=75226) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 17 01:21:48 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-16492697-8e3c-4860-a714-d84c147268f0 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: 38062487-67ca-4962-974f-81456aebe97b] Creating image(s)
Nov 17 01:21:48 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-16492697-8e3c-4860-a714-d84c147268f0 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Acquiring lock "/opt/stack/data/nova/instances/38062487-67ca-4962-974f-81456aebe97b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:21:48 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-16492697-8e3c-4860-a714-d84c147268f0 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Lock "/opt/stack/data/nova/instances/38062487-67ca-4962-974f-81456aebe97b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:21:48 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-16492697-8e3c-4860-a714-d84c147268f0 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Lock "/opt/stack/data/nova/instances/38062487-67ca-4962-974f-81456aebe97b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:21:48 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-16492697-8e3c-4860-a714-d84c147268f0 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:21:48 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:21:48 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-16492697-8e3c-4860-a714-d84c147268f0 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json" returned: 0 in 0.225s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:21:48 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-16492697-8e3c-4860-a714-d84c147268f0 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Acquiring lock "a8a62c2546af3a2036b853250c5ac64d4c6b4371" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:21:48 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-16492697-8e3c-4860-a714-d84c147268f0 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Lock "a8a62c2546af3a2036b853250c5ac64d4c6b4371" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:21:48 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-16492697-8e3c-4860-a714-d84c147268f0 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:21:48 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-16492697-8e3c-4860-a714-d84c147268f0 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json" returned: 0 in 0.179s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:21:48 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-16492697-8e3c-4860-a714-d84c147268f0 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371,backing_fmt=raw /opt/stack/data/nova/instances/38062487-67ca-4962-974f-81456aebe97b/disk 1073741824 {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:21:48 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-16492697-8e3c-4860-a714-d84c147268f0 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371,backing_fmt=raw /opt/stack/data/nova/instances/38062487-67ca-4962-974f-81456aebe97b/disk 1073741824" returned: 0 in 0.059s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:21:48 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-16492697-8e3c-4860-a714-d84c147268f0 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Lock "a8a62c2546af3a2036b853250c5ac64d4c6b4371" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:21:48 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-16492697-8e3c-4860-a714-d84c147268f0 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:21:48 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-16492697-8e3c-4860-a714-d84c147268f0 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json" returned: 0 in 0.165s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:21:48 user nova-compute[75226]: DEBUG nova.virt.disk.api [None req-16492697-8e3c-4860-a714-d84c147268f0 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Checking if we can resize image /opt/stack/data/nova/instances/38062487-67ca-4962-974f-81456aebe97b/disk. size=1073741824 {{(pid=75226) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 17 01:21:48 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-16492697-8e3c-4860-a714-d84c147268f0 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38062487-67ca-4962-974f-81456aebe97b/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:21:49 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-16492697-8e3c-4860-a714-d84c147268f0 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38062487-67ca-4962-974f-81456aebe97b/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:21:49 user nova-compute[75226]: DEBUG nova.virt.disk.api [None req-16492697-8e3c-4860-a714-d84c147268f0 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Cannot resize image /opt/stack/data/nova/instances/38062487-67ca-4962-974f-81456aebe97b/disk to a smaller size. {{(pid=75226) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 17 01:21:49 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-16492697-8e3c-4860-a714-d84c147268f0 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: 38062487-67ca-4962-974f-81456aebe97b] Created local disks {{(pid=75226) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 17 01:21:49 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-16492697-8e3c-4860-a714-d84c147268f0 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: 38062487-67ca-4962-974f-81456aebe97b] Ensure instance console log exists: /opt/stack/data/nova/instances/38062487-67ca-4962-974f-81456aebe97b/console.log {{(pid=75226) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 17 01:21:49 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-16492697-8e3c-4860-a714-d84c147268f0 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:21:49 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-16492697-8e3c-4860-a714-d84c147268f0 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:21:49 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-16492697-8e3c-4860-a714-d84c147268f0 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:21:49 user nova-compute[75226]: DEBUG nova.network.neutron [None req-16492697-8e3c-4860-a714-d84c147268f0 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: 38062487-67ca-4962-974f-81456aebe97b] Successfully created port: b4bb80f3-212b-41bf-94a3-442865a852c7 {{(pid=75226) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 17 01:21:49 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:21:49 user nova-compute[75226]: DEBUG nova.network.neutron [None req-16492697-8e3c-4860-a714-d84c147268f0 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: 38062487-67ca-4962-974f-81456aebe97b] Successfully updated port: b4bb80f3-212b-41bf-94a3-442865a852c7 {{(pid=75226) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 17 01:21:49 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-16492697-8e3c-4860-a714-d84c147268f0 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Acquiring lock "refresh_cache-38062487-67ca-4962-974f-81456aebe97b" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:21:49 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-16492697-8e3c-4860-a714-d84c147268f0 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Acquired lock "refresh_cache-38062487-67ca-4962-974f-81456aebe97b" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:21:49 user nova-compute[75226]: DEBUG nova.network.neutron [None req-16492697-8e3c-4860-a714-d84c147268f0 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: 38062487-67ca-4962-974f-81456aebe97b] Building network info cache for instance {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 01:21:49 user nova-compute[75226]: DEBUG nova.compute.manager [req-fc834127-385b-4527-bf83-57b80f5d0f67 req-cb9660be-6f64-46a8-ada1-2082a1348783 service nova] [instance: 38062487-67ca-4962-974f-81456aebe97b] Received event network-changed-b4bb80f3-212b-41bf-94a3-442865a852c7 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:21:49 user nova-compute[75226]: DEBUG nova.compute.manager [req-fc834127-385b-4527-bf83-57b80f5d0f67 req-cb9660be-6f64-46a8-ada1-2082a1348783 service nova] [instance: 38062487-67ca-4962-974f-81456aebe97b] Refreshing instance network info cache due to event network-changed-b4bb80f3-212b-41bf-94a3-442865a852c7. {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 01:21:49 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-fc834127-385b-4527-bf83-57b80f5d0f67 req-cb9660be-6f64-46a8-ada1-2082a1348783 service nova] Acquiring lock "refresh_cache-38062487-67ca-4962-974f-81456aebe97b" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:21:49 user nova-compute[75226]: DEBUG nova.network.neutron [None req-16492697-8e3c-4860-a714-d84c147268f0 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: 38062487-67ca-4962-974f-81456aebe97b] Instance cache missing network info. {{(pid=75226) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 17 01:21:50 user nova-compute[75226]: DEBUG nova.network.neutron [None req-16492697-8e3c-4860-a714-d84c147268f0 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: 38062487-67ca-4962-974f-81456aebe97b] Updating instance_info_cache with network_info: [{"id": "b4bb80f3-212b-41bf-94a3-442865a852c7", "address": "fa:16:3e:ef:fd:97", "network": {"id": "9f39d3e5-b106-4bd9-b8ba-0f326e89c481", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-675861281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9042fe4ecc245dd97553f6e942c3e05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4bb80f3-21", "ovs_interfaceid": "b4bb80f3-212b-41bf-94a3-442865a852c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:21:50 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-16492697-8e3c-4860-a714-d84c147268f0 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Releasing lock "refresh_cache-38062487-67ca-4962-974f-81456aebe97b" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:21:50 user nova-compute[75226]: DEBUG nova.compute.manager [None req-16492697-8e3c-4860-a714-d84c147268f0 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: 38062487-67ca-4962-974f-81456aebe97b] Instance network_info: |[{"id": "b4bb80f3-212b-41bf-94a3-442865a852c7", "address": "fa:16:3e:ef:fd:97", "network": {"id": "9f39d3e5-b106-4bd9-b8ba-0f326e89c481", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-675861281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9042fe4ecc245dd97553f6e942c3e05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4bb80f3-21", "ovs_interfaceid": "b4bb80f3-212b-41bf-94a3-442865a852c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75226) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 17 01:21:50 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-fc834127-385b-4527-bf83-57b80f5d0f67 req-cb9660be-6f64-46a8-ada1-2082a1348783 service nova] Acquired lock "refresh_cache-38062487-67ca-4962-974f-81456aebe97b" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:21:50 user nova-compute[75226]: DEBUG nova.network.neutron [req-fc834127-385b-4527-bf83-57b80f5d0f67 req-cb9660be-6f64-46a8-ada1-2082a1348783 service nova] [instance: 38062487-67ca-4962-974f-81456aebe97b] Refreshing network info cache for port b4bb80f3-212b-41bf-94a3-442865a852c7 {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 01:21:50 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-16492697-8e3c-4860-a714-d84c147268f0 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: 38062487-67ca-4962-974f-81456aebe97b] Start _get_guest_xml network_info=[{"id": "b4bb80f3-212b-41bf-94a3-442865a852c7", "address": "fa:16:3e:ef:fd:97", "network": {"id": "9f39d3e5-b106-4bd9-b8ba-0f326e89c481", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-675861281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9042fe4ecc245dd97553f6e942c3e05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4bb80f3-21", "ovs_interfaceid": "b4bb80f3-212b-41bf-94a3-442865a852c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T01:13:22Z,direct_url=<?>,disk_format='qcow2',id=0b369aea-6f3f-4690-9f01-229b90ab6310,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4e110cbf9a84362a6864a7732c435a1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T01:13:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '0b369aea-6f3f-4690-9f01-229b90ab6310'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75226) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 17 01:21:50 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-16492697-8e3c-4860-a714-d84c147268f0 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:21:50 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-16492697-8e3c-4860-a714-d84c147268f0 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:21:50 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-16492697-8e3c-4860-a714-d84c147268f0 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75226) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 17 01:21:50 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-16492697-8e3c-4860-a714-d84c147268f0 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] CPU controller missing on host. {{(pid=75226) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 17 01:21:50 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-16492697-8e3c-4860-a714-d84c147268f0 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75226) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 17 01:21:50 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-16492697-8e3c-4860-a714-d84c147268f0 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] CPU controller found on host. {{(pid=75226) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 17 01:21:50 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-16492697-8e3c-4860-a714-d84c147268f0 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75226) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 17 01:21:50 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-16492697-8e3c-4860-a714-d84c147268f0 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-17T01:13:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T01:13:22Z,direct_url=<?>,disk_format='qcow2',id=0b369aea-6f3f-4690-9f01-229b90ab6310,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4e110cbf9a84362a6864a7732c435a1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T01:13:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 17 01:21:50 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-16492697-8e3c-4860-a714-d84c147268f0 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Flavor limits 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 17 01:21:50 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-16492697-8e3c-4860-a714-d84c147268f0 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Image limits 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 17 01:21:50 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-16492697-8e3c-4860-a714-d84c147268f0 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Flavor pref 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 17 01:21:50 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-16492697-8e3c-4860-a714-d84c147268f0 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Image pref 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 17 01:21:50 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-16492697-8e3c-4860-a714-d84c147268f0 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 17 01:21:50 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-16492697-8e3c-4860-a714-d84c147268f0 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 17 01:21:50 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-16492697-8e3c-4860-a714-d84c147268f0 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75226) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 17 01:21:50 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-16492697-8e3c-4860-a714-d84c147268f0 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Got 1 possible topologies {{(pid=75226) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 17 01:21:50 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-16492697-8e3c-4860-a714-d84c147268f0 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 17 01:21:50 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-16492697-8e3c-4860-a714-d84c147268f0 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 17 01:21:50 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-16492697-8e3c-4860-a714-d84c147268f0 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:21:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-258103968',display_name='tempest-ServerActionsTestOtherA-server-258103968',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-258103968',id=16,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFcMGt3BPMgKZBdescHicrTnz7kyNBHfMwmrFONg75JAKc8VfRVh1PCQT3W5iiYYT6fcflPeuhtfYyaPi/d36jL88Vz6dOEwhdGgUoOilw3GKb90qUp0hFoOK7faoQkiRg==',key_name='tempest-keypair-1413404210',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f9042fe4ecc245dd97553f6e942c3e05',ramdisk_id='',reservation_id='r-s08uzlt2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2125452149',owner_user_name='tempest-ServerActionsTestOtherA-2125452149-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T01:21:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a13dd8231937440185c9fc628c3bd5db',uuid=38062487-67ca-4962-974f-81456aebe97b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b4bb80f3-212b-41bf-94a3-442865a852c7", "address": "fa:16:3e:ef:fd:97", "network": {"id": "9f39d3e5-b106-4bd9-b8ba-0f326e89c481", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-675861281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9042fe4ecc245dd97553f6e942c3e05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4bb80f3-21", "ovs_interfaceid": "b4bb80f3-212b-41bf-94a3-442865a852c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75226) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 01:21:50 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-16492697-8e3c-4860-a714-d84c147268f0 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Converting VIF {"id": "b4bb80f3-212b-41bf-94a3-442865a852c7", "address": "fa:16:3e:ef:fd:97", "network": {"id": "9f39d3e5-b106-4bd9-b8ba-0f326e89c481", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-675861281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9042fe4ecc245dd97553f6e942c3e05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4bb80f3-21", "ovs_interfaceid": "b4bb80f3-212b-41bf-94a3-442865a852c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:21:50 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-16492697-8e3c-4860-a714-d84c147268f0 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:fd:97,bridge_name='br-int',has_traffic_filtering=True,id=b4bb80f3-212b-41bf-94a3-442865a852c7,network=Network(9f39d3e5-b106-4bd9-b8ba-0f326e89c481),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4bb80f3-21') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:21:50 user nova-compute[75226]: DEBUG nova.objects.instance [None req-16492697-8e3c-4860-a714-d84c147268f0 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Lazy-loading 'pci_devices' on Instance uuid 38062487-67ca-4962-974f-81456aebe97b {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:21:50 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-16492697-8e3c-4860-a714-d84c147268f0 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: 38062487-67ca-4962-974f-81456aebe97b] End _get_guest_xml xml=<domain type="kvm">
Nov 17 01:21:50 user nova-compute[75226]:   <uuid>38062487-67ca-4962-974f-81456aebe97b</uuid>
Nov 17 01:21:50 user nova-compute[75226]:   <name>instance-00000010</name>
Nov 17 01:21:50 user nova-compute[75226]:   <memory>524288</memory>
Nov 17 01:21:50 user nova-compute[75226]:   <vcpu>1</vcpu>
Nov 17 01:21:50 user nova-compute[75226]:   <metadata>
Nov 17 01:21:50 user nova-compute[75226]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 17 01:21:50 user nova-compute[75226]:       <nova:package version="0.0.0"/>
Nov 17 01:21:50 user nova-compute[75226]:       <nova:name>tempest-ServerActionsTestOtherA-server-258103968</nova:name>
Nov 17 01:21:50 user nova-compute[75226]:       <nova:creationTime>2023-11-17 01:21:50</nova:creationTime>
Nov 17 01:21:50 user nova-compute[75226]:       <nova:flavor name="m1.tiny">
Nov 17 01:21:50 user nova-compute[75226]:         <nova:memory>512</nova:memory>
Nov 17 01:21:50 user nova-compute[75226]:         <nova:disk>1</nova:disk>
Nov 17 01:21:50 user nova-compute[75226]:         <nova:swap>0</nova:swap>
Nov 17 01:21:50 user nova-compute[75226]:         <nova:ephemeral>0</nova:ephemeral>
Nov 17 01:21:50 user nova-compute[75226]:         <nova:vcpus>1</nova:vcpus>
Nov 17 01:21:50 user nova-compute[75226]:       </nova:flavor>
Nov 17 01:21:50 user nova-compute[75226]:       <nova:owner>
Nov 17 01:21:50 user nova-compute[75226]:         <nova:user uuid="a13dd8231937440185c9fc628c3bd5db">tempest-ServerActionsTestOtherA-2125452149-project-member</nova:user>
Nov 17 01:21:50 user nova-compute[75226]:         <nova:project uuid="f9042fe4ecc245dd97553f6e942c3e05">tempest-ServerActionsTestOtherA-2125452149</nova:project>
Nov 17 01:21:50 user nova-compute[75226]:       </nova:owner>
Nov 17 01:21:50 user nova-compute[75226]:       <nova:root type="image" uuid="0b369aea-6f3f-4690-9f01-229b90ab6310"/>
Nov 17 01:21:50 user nova-compute[75226]:       <nova:ports>
Nov 17 01:21:50 user nova-compute[75226]:         <nova:port uuid="b4bb80f3-212b-41bf-94a3-442865a852c7">
Nov 17 01:21:50 user nova-compute[75226]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 17 01:21:50 user nova-compute[75226]:         </nova:port>
Nov 17 01:21:50 user nova-compute[75226]:       </nova:ports>
Nov 17 01:21:50 user nova-compute[75226]:     </nova:instance>
Nov 17 01:21:50 user nova-compute[75226]:   </metadata>
Nov 17 01:21:50 user nova-compute[75226]:   <sysinfo type="smbios">
Nov 17 01:21:50 user nova-compute[75226]:     <system>
Nov 17 01:21:50 user nova-compute[75226]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 17 01:21:50 user nova-compute[75226]:       <entry name="product">OpenStack Nova</entry>
Nov 17 01:21:50 user nova-compute[75226]:       <entry name="version">0.0.0</entry>
Nov 17 01:21:50 user nova-compute[75226]:       <entry name="serial">38062487-67ca-4962-974f-81456aebe97b</entry>
Nov 17 01:21:50 user nova-compute[75226]:       <entry name="uuid">38062487-67ca-4962-974f-81456aebe97b</entry>
Nov 17 01:21:50 user nova-compute[75226]:       <entry name="family">Virtual Machine</entry>
Nov 17 01:21:50 user nova-compute[75226]:     </system>
Nov 17 01:21:50 user nova-compute[75226]:   </sysinfo>
Nov 17 01:21:50 user nova-compute[75226]:   <os>
Nov 17 01:21:50 user nova-compute[75226]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 17 01:21:50 user nova-compute[75226]:     <boot dev="hd"/>
Nov 17 01:21:50 user nova-compute[75226]:     <smbios mode="sysinfo"/>
Nov 17 01:21:50 user nova-compute[75226]:   </os>
Nov 17 01:21:50 user nova-compute[75226]:   <features>
Nov 17 01:21:50 user nova-compute[75226]:     <acpi/>
Nov 17 01:21:50 user nova-compute[75226]:     <apic/>
Nov 17 01:21:50 user nova-compute[75226]:     <vmcoreinfo/>
Nov 17 01:21:50 user nova-compute[75226]:   </features>
Nov 17 01:21:50 user nova-compute[75226]:   <clock offset="utc">
Nov 17 01:21:50 user nova-compute[75226]:     <timer name="pit" tickpolicy="delay"/>
Nov 17 01:21:50 user nova-compute[75226]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 17 01:21:50 user nova-compute[75226]:     <timer name="hpet" present="no"/>
Nov 17 01:21:50 user nova-compute[75226]:   </clock>
Nov 17 01:21:50 user nova-compute[75226]:   <cpu mode="custom" match="exact">
Nov 17 01:21:50 user nova-compute[75226]:     <model>Nehalem</model>
Nov 17 01:21:50 user nova-compute[75226]:     <topology sockets="1" cores="1" threads="1"/>
Nov 17 01:21:50 user nova-compute[75226]:   </cpu>
Nov 17 01:21:50 user nova-compute[75226]:   <devices>
Nov 17 01:21:50 user nova-compute[75226]:     <disk type="file" device="disk">
Nov 17 01:21:50 user nova-compute[75226]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 17 01:21:50 user nova-compute[75226]:       <source file="/opt/stack/data/nova/instances/38062487-67ca-4962-974f-81456aebe97b/disk"/>
Nov 17 01:21:50 user nova-compute[75226]:       <target dev="vda" bus="virtio"/>
Nov 17 01:21:50 user nova-compute[75226]:     </disk>
Nov 17 01:21:50 user nova-compute[75226]:     <interface type="ethernet">
Nov 17 01:21:50 user nova-compute[75226]:       <mac address="fa:16:3e:ef:fd:97"/>
Nov 17 01:21:50 user nova-compute[75226]:       <model type="virtio"/>
Nov 17 01:21:50 user nova-compute[75226]:       <mtu size="1442"/>
Nov 17 01:21:50 user nova-compute[75226]:       <target dev="tapb4bb80f3-21"/>
Nov 17 01:21:50 user nova-compute[75226]:     </interface>
Nov 17 01:21:50 user nova-compute[75226]:     <serial type="pty">
Nov 17 01:21:50 user nova-compute[75226]:       <log file="/opt/stack/data/nova/instances/38062487-67ca-4962-974f-81456aebe97b/console.log" append="off"/>
Nov 17 01:21:50 user nova-compute[75226]:     </serial>
Nov 17 01:21:50 user nova-compute[75226]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 17 01:21:50 user nova-compute[75226]:     <video>
Nov 17 01:21:50 user nova-compute[75226]:       <model type="virtio"/>
Nov 17 01:21:50 user nova-compute[75226]:     </video>
Nov 17 01:21:50 user nova-compute[75226]:     <rng model="virtio">
Nov 17 01:21:50 user nova-compute[75226]:       <backend model="random">/dev/urandom</backend>
Nov 17 01:21:50 user nova-compute[75226]:     </rng>
Nov 17 01:21:50 user nova-compute[75226]:     <controller type="usb" index="0" model="none"/>
Nov 17 01:21:50 user nova-compute[75226]:     <memballoon model="virtio">
Nov 17 01:21:50 user nova-compute[75226]:       <stats period="10"/>
Nov 17 01:21:50 user nova-compute[75226]:     </memballoon>
Nov 17 01:21:50 user nova-compute[75226]:   </devices>
Nov 17 01:21:50 user nova-compute[75226]: </domain>
Nov 17 01:21:50 user nova-compute[75226]:  {{(pid=75226) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 17 01:21:50 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-16492697-8e3c-4860-a714-d84c147268f0 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:21:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-258103968',display_name='tempest-ServerActionsTestOtherA-server-258103968',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-258103968',id=16,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFcMGt3BPMgKZBdescHicrTnz7kyNBHfMwmrFONg75JAKc8VfRVh1PCQT3W5iiYYT6fcflPeuhtfYyaPi/d36jL88Vz6dOEwhdGgUoOilw3GKb90qUp0hFoOK7faoQkiRg==',key_name='tempest-keypair-1413404210',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f9042fe4ecc245dd97553f6e942c3e05',ramdisk_id='',reservation_id='r-s08uzlt2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2125452149',owner_user_name='tempest-ServerActionsTestOtherA-2125452149-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T01:21:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a13dd8231937440185c9fc628c3bd5db',uuid=38062487-67ca-4962-974f-81456aebe97b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b4bb80f3-212b-41bf-94a3-442865a852c7", "address": "fa:16:3e:ef:fd:97", "network": {"id": "9f39d3e5-b106-4bd9-b8ba-0f326e89c481", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-675861281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9042fe4ecc245dd97553f6e942c3e05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4bb80f3-21", "ovs_interfaceid": "b4bb80f3-212b-41bf-94a3-442865a852c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 17 01:21:50 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-16492697-8e3c-4860-a714-d84c147268f0 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Converting VIF {"id": "b4bb80f3-212b-41bf-94a3-442865a852c7", "address": "fa:16:3e:ef:fd:97", "network": {"id": "9f39d3e5-b106-4bd9-b8ba-0f326e89c481", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-675861281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9042fe4ecc245dd97553f6e942c3e05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4bb80f3-21", "ovs_interfaceid": "b4bb80f3-212b-41bf-94a3-442865a852c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:21:50 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-16492697-8e3c-4860-a714-d84c147268f0 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:fd:97,bridge_name='br-int',has_traffic_filtering=True,id=b4bb80f3-212b-41bf-94a3-442865a852c7,network=Network(9f39d3e5-b106-4bd9-b8ba-0f326e89c481),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4bb80f3-21') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:21:50 user nova-compute[75226]: DEBUG os_vif [None req-16492697-8e3c-4860-a714-d84c147268f0 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:fd:97,bridge_name='br-int',has_traffic_filtering=True,id=b4bb80f3-212b-41bf-94a3-442865a852c7,network=Network(9f39d3e5-b106-4bd9-b8ba-0f326e89c481),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4bb80f3-21') {{(pid=75226) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 17 01:21:50 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:21:50 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:21:50 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 17 01:21:50 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:21:50 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '71189400-73ab-5daa-9ce8-0bfb1f08e1b0', '_type': 'linux-noop'}}, row=False) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:21:50 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:21:50 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:21:50 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:21:50 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb4bb80f3-21, may_exist=True, interface_attrs={}) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:21:50 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb4bb80f3-21, col_values=(('qos', UUID('c3875751-864c-497c-ae3a-8d8b217782a0')),), if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:21:50 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb4bb80f3-21, col_values=(('external_ids', {'iface-id': 'b4bb80f3-212b-41bf-94a3-442865a852c7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ef:fd:97', 'vm-uuid': '38062487-67ca-4962-974f-81456aebe97b'}),), if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:21:50 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:21:50 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:21:50 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:21:50 user nova-compute[75226]: INFO os_vif [None req-16492697-8e3c-4860-a714-d84c147268f0 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:fd:97,bridge_name='br-int',has_traffic_filtering=True,id=b4bb80f3-212b-41bf-94a3-442865a852c7,network=Network(9f39d3e5-b106-4bd9-b8ba-0f326e89c481),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4bb80f3-21')
Nov 17 01:21:50 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-16492697-8e3c-4860-a714-d84c147268f0 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] No BDM found with device name vda, not building metadata. {{(pid=75226) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 01:21:50 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-16492697-8e3c-4860-a714-d84c147268f0 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] No VIF found with MAC fa:16:3e:ef:fd:97, not building metadata {{(pid=75226) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 01:21:50 user nova-compute[75226]: DEBUG nova.network.neutron [req-fc834127-385b-4527-bf83-57b80f5d0f67 req-cb9660be-6f64-46a8-ada1-2082a1348783 service nova] [instance: 38062487-67ca-4962-974f-81456aebe97b] Updated VIF entry in instance network info cache for port b4bb80f3-212b-41bf-94a3-442865a852c7. {{(pid=75226) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 01:21:50 user nova-compute[75226]: DEBUG nova.network.neutron [req-fc834127-385b-4527-bf83-57b80f5d0f67 req-cb9660be-6f64-46a8-ada1-2082a1348783 service nova] [instance: 38062487-67ca-4962-974f-81456aebe97b] Updating instance_info_cache with network_info: [{"id": "b4bb80f3-212b-41bf-94a3-442865a852c7", "address": "fa:16:3e:ef:fd:97", "network": {"id": "9f39d3e5-b106-4bd9-b8ba-0f326e89c481", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-675861281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9042fe4ecc245dd97553f6e942c3e05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4bb80f3-21", "ovs_interfaceid": "b4bb80f3-212b-41bf-94a3-442865a852c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:21:50 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-fc834127-385b-4527-bf83-57b80f5d0f67 req-cb9660be-6f64-46a8-ada1-2082a1348783 service nova] Releasing lock "refresh_cache-38062487-67ca-4962-974f-81456aebe97b" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:21:51 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:21:51 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:21:51 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:21:52 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:21:52 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:21:52 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:21:52 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:21:52 user nova-compute[75226]: DEBUG nova.compute.manager [req-604cf8b2-179f-4488-97f5-80e293d19719 req-24c277f4-9f07-4867-a9c0-8e4431f143c0 service nova] [instance: 38062487-67ca-4962-974f-81456aebe97b] Received event network-vif-plugged-b4bb80f3-212b-41bf-94a3-442865a852c7 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:21:52 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-604cf8b2-179f-4488-97f5-80e293d19719 req-24c277f4-9f07-4867-a9c0-8e4431f143c0 service nova] Acquiring lock "38062487-67ca-4962-974f-81456aebe97b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:21:52 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-604cf8b2-179f-4488-97f5-80e293d19719 req-24c277f4-9f07-4867-a9c0-8e4431f143c0 service nova] Lock "38062487-67ca-4962-974f-81456aebe97b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:21:52 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-604cf8b2-179f-4488-97f5-80e293d19719 req-24c277f4-9f07-4867-a9c0-8e4431f143c0 service nova] Lock "38062487-67ca-4962-974f-81456aebe97b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:21:52 user nova-compute[75226]: DEBUG nova.compute.manager [req-604cf8b2-179f-4488-97f5-80e293d19719 req-24c277f4-9f07-4867-a9c0-8e4431f143c0 service nova] [instance: 38062487-67ca-4962-974f-81456aebe97b] No waiting events found dispatching network-vif-plugged-b4bb80f3-212b-41bf-94a3-442865a852c7 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:21:52 user nova-compute[75226]: WARNING nova.compute.manager [req-604cf8b2-179f-4488-97f5-80e293d19719 req-24c277f4-9f07-4867-a9c0-8e4431f143c0 service nova] [instance: 38062487-67ca-4962-974f-81456aebe97b] Received unexpected event network-vif-plugged-b4bb80f3-212b-41bf-94a3-442865a852c7 for instance with vm_state building and task_state spawning.
Nov 17 01:21:52 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:21:53 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:21:53 user nova-compute[75226]: DEBUG nova.compute.manager [None req-16492697-8e3c-4860-a714-d84c147268f0 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: 38062487-67ca-4962-974f-81456aebe97b] Instance event wait completed in 0 seconds for  {{(pid=75226) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 17 01:21:53 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-16492697-8e3c-4860-a714-d84c147268f0 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: 38062487-67ca-4962-974f-81456aebe97b] Guest created on hypervisor {{(pid=75226) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 17 01:21:53 user nova-compute[75226]: INFO nova.virt.libvirt.driver [-] [instance: 38062487-67ca-4962-974f-81456aebe97b] Instance spawned successfully.
Nov 17 01:21:53 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-16492697-8e3c-4860-a714-d84c147268f0 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: 38062487-67ca-4962-974f-81456aebe97b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 17 01:21:54 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-16492697-8e3c-4860-a714-d84c147268f0 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: 38062487-67ca-4962-974f-81456aebe97b] Found default for hw_cdrom_bus of ide {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:21:54 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-16492697-8e3c-4860-a714-d84c147268f0 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: 38062487-67ca-4962-974f-81456aebe97b] Found default for hw_disk_bus of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:21:54 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-16492697-8e3c-4860-a714-d84c147268f0 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: 38062487-67ca-4962-974f-81456aebe97b] Found default for hw_input_bus of None {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:21:54 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-16492697-8e3c-4860-a714-d84c147268f0 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: 38062487-67ca-4962-974f-81456aebe97b] Found default for hw_pointer_model of None {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:21:54 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-16492697-8e3c-4860-a714-d84c147268f0 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: 38062487-67ca-4962-974f-81456aebe97b] Found default for hw_video_model of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:21:54 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-16492697-8e3c-4860-a714-d84c147268f0 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: 38062487-67ca-4962-974f-81456aebe97b] Found default for hw_vif_model of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:21:54 user nova-compute[75226]: INFO nova.compute.manager [None req-16492697-8e3c-4860-a714-d84c147268f0 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: 38062487-67ca-4962-974f-81456aebe97b] Took 5.86 seconds to spawn the instance on the hypervisor.
Nov 17 01:21:54 user nova-compute[75226]: DEBUG nova.compute.manager [None req-16492697-8e3c-4860-a714-d84c147268f0 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: 38062487-67ca-4962-974f-81456aebe97b] Checking state {{(pid=75226) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 01:21:54 user nova-compute[75226]: INFO nova.compute.manager [None req-16492697-8e3c-4860-a714-d84c147268f0 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: 38062487-67ca-4962-974f-81456aebe97b] Took 6.64 seconds to build instance.
Nov 17 01:21:54 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-16492697-8e3c-4860-a714-d84c147268f0 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Lock "38062487-67ca-4962-974f-81456aebe97b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.739s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:21:54 user nova-compute[75226]: DEBUG nova.compute.manager [req-f018f01d-f7cb-4c7e-9a97-c2e00ac7b6a4 req-26f7608d-7c0e-4241-b03a-0811cac214d7 service nova] [instance: 38062487-67ca-4962-974f-81456aebe97b] Received event network-vif-plugged-b4bb80f3-212b-41bf-94a3-442865a852c7 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:21:54 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-f018f01d-f7cb-4c7e-9a97-c2e00ac7b6a4 req-26f7608d-7c0e-4241-b03a-0811cac214d7 service nova] Acquiring lock "38062487-67ca-4962-974f-81456aebe97b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:21:54 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-f018f01d-f7cb-4c7e-9a97-c2e00ac7b6a4 req-26f7608d-7c0e-4241-b03a-0811cac214d7 service nova] Lock "38062487-67ca-4962-974f-81456aebe97b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:21:54 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-f018f01d-f7cb-4c7e-9a97-c2e00ac7b6a4 req-26f7608d-7c0e-4241-b03a-0811cac214d7 service nova] Lock "38062487-67ca-4962-974f-81456aebe97b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:21:54 user nova-compute[75226]: DEBUG nova.compute.manager [req-f018f01d-f7cb-4c7e-9a97-c2e00ac7b6a4 req-26f7608d-7c0e-4241-b03a-0811cac214d7 service nova] [instance: 38062487-67ca-4962-974f-81456aebe97b] No waiting events found dispatching network-vif-plugged-b4bb80f3-212b-41bf-94a3-442865a852c7 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:21:54 user nova-compute[75226]: WARNING nova.compute.manager [req-f018f01d-f7cb-4c7e-9a97-c2e00ac7b6a4 req-26f7608d-7c0e-4241-b03a-0811cac214d7 service nova] [instance: 38062487-67ca-4962-974f-81456aebe97b] Received unexpected event network-vif-plugged-b4bb80f3-212b-41bf-94a3-442865a852c7 for instance with vm_state active and task_state None.
Nov 17 01:21:54 user nova-compute[75226]: INFO nova.compute.manager [None req-e9f3e9e0-0487-4dea-8c75-19843e9ba481 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 6b7e9611-be35-4e51-b886-91a2fac0a653] Rescuing
Nov 17 01:21:54 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e9f3e9e0-0487-4dea-8c75-19843e9ba481 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Acquiring lock "refresh_cache-6b7e9611-be35-4e51-b886-91a2fac0a653" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:21:54 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e9f3e9e0-0487-4dea-8c75-19843e9ba481 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Acquired lock "refresh_cache-6b7e9611-be35-4e51-b886-91a2fac0a653" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:21:54 user nova-compute[75226]: DEBUG nova.network.neutron [None req-e9f3e9e0-0487-4dea-8c75-19843e9ba481 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 6b7e9611-be35-4e51-b886-91a2fac0a653] Building network info cache for instance {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 01:21:55 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:21:55 user nova-compute[75226]: DEBUG nova.network.neutron [None req-e9f3e9e0-0487-4dea-8c75-19843e9ba481 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 6b7e9611-be35-4e51-b886-91a2fac0a653] Updating instance_info_cache with network_info: [{"id": "657af53c-fc3a-45ab-81e5-b2eeea1c88d7", "address": "fa:16:3e:91:de:17", "network": {"id": "450540a3-ff7e-42fb-a0a6-808acd749943", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1503678778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6cb6f679ee4468d82cc7fb5d0f67be9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap657af53c-fc", "ovs_interfaceid": "657af53c-fc3a-45ab-81e5-b2eeea1c88d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:21:55 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e9f3e9e0-0487-4dea-8c75-19843e9ba481 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Releasing lock "refresh_cache-6b7e9611-be35-4e51-b886-91a2fac0a653" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:21:55 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:21:55 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:21:55 user nova-compute[75226]: DEBUG nova.compute.manager [req-21ca810f-0615-43b9-bbf4-7237ec3db23a req-5724ee7f-957b-4982-a0ef-d75dca22bafc service nova] [instance: 6b7e9611-be35-4e51-b886-91a2fac0a653] Received event network-vif-unplugged-657af53c-fc3a-45ab-81e5-b2eeea1c88d7 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:21:55 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-21ca810f-0615-43b9-bbf4-7237ec3db23a req-5724ee7f-957b-4982-a0ef-d75dca22bafc service nova] Acquiring lock "6b7e9611-be35-4e51-b886-91a2fac0a653-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:21:55 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-21ca810f-0615-43b9-bbf4-7237ec3db23a req-5724ee7f-957b-4982-a0ef-d75dca22bafc service nova] Lock "6b7e9611-be35-4e51-b886-91a2fac0a653-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:21:55 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-21ca810f-0615-43b9-bbf4-7237ec3db23a req-5724ee7f-957b-4982-a0ef-d75dca22bafc service nova] Lock "6b7e9611-be35-4e51-b886-91a2fac0a653-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:21:55 user nova-compute[75226]: DEBUG nova.compute.manager [req-21ca810f-0615-43b9-bbf4-7237ec3db23a req-5724ee7f-957b-4982-a0ef-d75dca22bafc service nova] [instance: 6b7e9611-be35-4e51-b886-91a2fac0a653] No waiting events found dispatching network-vif-unplugged-657af53c-fc3a-45ab-81e5-b2eeea1c88d7 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:21:55 user nova-compute[75226]: WARNING nova.compute.manager [req-21ca810f-0615-43b9-bbf4-7237ec3db23a req-5724ee7f-957b-4982-a0ef-d75dca22bafc service nova] [instance: 6b7e9611-be35-4e51-b886-91a2fac0a653] Received unexpected event network-vif-unplugged-657af53c-fc3a-45ab-81e5-b2eeea1c88d7 for instance with vm_state active and task_state rescuing.
Nov 17 01:21:55 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:21:55 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:21:56 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:21:56 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:21:56 user nova-compute[75226]: INFO nova.virt.libvirt.driver [-] [instance: 6b7e9611-be35-4e51-b886-91a2fac0a653] Instance destroyed successfully.
Nov 17 01:21:56 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-e9f3e9e0-0487-4dea-8c75-19843e9ba481 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 6b7e9611-be35-4e51-b886-91a2fac0a653] Attempting a stable device rescue
Nov 17 01:21:56 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-e9f3e9e0-0487-4dea-8c75-19843e9ba481 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75226) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 17 01:21:56 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:21:56 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-e9f3e9e0-0487-4dea-8c75-19843e9ba481 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 6b7e9611-be35-4e51-b886-91a2fac0a653] Instance directory exists: not creating {{(pid=75226) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 17 01:21:56 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-e9f3e9e0-0487-4dea-8c75-19843e9ba481 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 6b7e9611-be35-4e51-b886-91a2fac0a653] Creating image(s)
Nov 17 01:21:56 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e9f3e9e0-0487-4dea-8c75-19843e9ba481 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Acquiring lock "/opt/stack/data/nova/instances/6b7e9611-be35-4e51-b886-91a2fac0a653/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:21:56 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e9f3e9e0-0487-4dea-8c75-19843e9ba481 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Lock "/opt/stack/data/nova/instances/6b7e9611-be35-4e51-b886-91a2fac0a653/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:21:56 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e9f3e9e0-0487-4dea-8c75-19843e9ba481 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Lock "/opt/stack/data/nova/instances/6b7e9611-be35-4e51-b886-91a2fac0a653/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.010s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:21:56 user nova-compute[75226]: DEBUG nova.objects.instance [None req-e9f3e9e0-0487-4dea-8c75-19843e9ba481 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Lazy-loading 'trusted_certs' on Instance uuid 6b7e9611-be35-4e51-b886-91a2fac0a653 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:21:56 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e9f3e9e0-0487-4dea-8c75-19843e9ba481 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Acquiring lock "391ae0785444ade97eb9cd60c251e05e79857e81" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:21:56 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e9f3e9e0-0487-4dea-8c75-19843e9ba481 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Lock "391ae0785444ade97eb9cd60c251e05e79857e81" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:21:58 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e9f3e9e0-0487-4dea-8c75-19843e9ba481 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/391ae0785444ade97eb9cd60c251e05e79857e81.part --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:21:58 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:21:58 user nova-compute[75226]: DEBUG nova.compute.manager [req-5a806db1-898b-4aa7-816c-3efdd130bd7d req-2638a1ca-0795-45ae-9267-a7282d30c4d9 service nova] [instance: 6b7e9611-be35-4e51-b886-91a2fac0a653] Received event network-vif-plugged-657af53c-fc3a-45ab-81e5-b2eeea1c88d7 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:21:58 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-5a806db1-898b-4aa7-816c-3efdd130bd7d req-2638a1ca-0795-45ae-9267-a7282d30c4d9 service nova] Acquiring lock "6b7e9611-be35-4e51-b886-91a2fac0a653-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:21:58 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-5a806db1-898b-4aa7-816c-3efdd130bd7d req-2638a1ca-0795-45ae-9267-a7282d30c4d9 service nova] Lock "6b7e9611-be35-4e51-b886-91a2fac0a653-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:21:58 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-5a806db1-898b-4aa7-816c-3efdd130bd7d req-2638a1ca-0795-45ae-9267-a7282d30c4d9 service nova] Lock "6b7e9611-be35-4e51-b886-91a2fac0a653-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:21:58 user nova-compute[75226]: DEBUG nova.compute.manager [req-5a806db1-898b-4aa7-816c-3efdd130bd7d req-2638a1ca-0795-45ae-9267-a7282d30c4d9 service nova] [instance: 6b7e9611-be35-4e51-b886-91a2fac0a653] No waiting events found dispatching network-vif-plugged-657af53c-fc3a-45ab-81e5-b2eeea1c88d7 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:21:58 user nova-compute[75226]: WARNING nova.compute.manager [req-5a806db1-898b-4aa7-816c-3efdd130bd7d req-2638a1ca-0795-45ae-9267-a7282d30c4d9 service nova] [instance: 6b7e9611-be35-4e51-b886-91a2fac0a653] Received unexpected event network-vif-plugged-657af53c-fc3a-45ab-81e5-b2eeea1c88d7 for instance with vm_state active and task_state rescuing.
Nov 17 01:21:58 user nova-compute[75226]: DEBUG nova.compute.manager [req-5a806db1-898b-4aa7-816c-3efdd130bd7d req-2638a1ca-0795-45ae-9267-a7282d30c4d9 service nova] [instance: 6b7e9611-be35-4e51-b886-91a2fac0a653] Received event network-vif-plugged-657af53c-fc3a-45ab-81e5-b2eeea1c88d7 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:21:58 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-5a806db1-898b-4aa7-816c-3efdd130bd7d req-2638a1ca-0795-45ae-9267-a7282d30c4d9 service nova] Acquiring lock "6b7e9611-be35-4e51-b886-91a2fac0a653-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:21:58 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-5a806db1-898b-4aa7-816c-3efdd130bd7d req-2638a1ca-0795-45ae-9267-a7282d30c4d9 service nova] Lock "6b7e9611-be35-4e51-b886-91a2fac0a653-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:21:58 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-5a806db1-898b-4aa7-816c-3efdd130bd7d req-2638a1ca-0795-45ae-9267-a7282d30c4d9 service nova] Lock "6b7e9611-be35-4e51-b886-91a2fac0a653-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:21:58 user nova-compute[75226]: DEBUG nova.compute.manager [req-5a806db1-898b-4aa7-816c-3efdd130bd7d req-2638a1ca-0795-45ae-9267-a7282d30c4d9 service nova] [instance: 6b7e9611-be35-4e51-b886-91a2fac0a653] No waiting events found dispatching network-vif-plugged-657af53c-fc3a-45ab-81e5-b2eeea1c88d7 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:21:58 user nova-compute[75226]: WARNING nova.compute.manager [req-5a806db1-898b-4aa7-816c-3efdd130bd7d req-2638a1ca-0795-45ae-9267-a7282d30c4d9 service nova] [instance: 6b7e9611-be35-4e51-b886-91a2fac0a653] Received unexpected event network-vif-plugged-657af53c-fc3a-45ab-81e5-b2eeea1c88d7 for instance with vm_state active and task_state rescuing.
Nov 17 01:21:58 user nova-compute[75226]: DEBUG nova.compute.manager [req-5a806db1-898b-4aa7-816c-3efdd130bd7d req-2638a1ca-0795-45ae-9267-a7282d30c4d9 service nova] [instance: 6b7e9611-be35-4e51-b886-91a2fac0a653] Received event network-vif-plugged-657af53c-fc3a-45ab-81e5-b2eeea1c88d7 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:21:58 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-5a806db1-898b-4aa7-816c-3efdd130bd7d req-2638a1ca-0795-45ae-9267-a7282d30c4d9 service nova] Acquiring lock "6b7e9611-be35-4e51-b886-91a2fac0a653-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:21:58 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-5a806db1-898b-4aa7-816c-3efdd130bd7d req-2638a1ca-0795-45ae-9267-a7282d30c4d9 service nova] Lock "6b7e9611-be35-4e51-b886-91a2fac0a653-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:21:58 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-5a806db1-898b-4aa7-816c-3efdd130bd7d req-2638a1ca-0795-45ae-9267-a7282d30c4d9 service nova] Lock "6b7e9611-be35-4e51-b886-91a2fac0a653-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:21:58 user nova-compute[75226]: DEBUG nova.compute.manager [req-5a806db1-898b-4aa7-816c-3efdd130bd7d req-2638a1ca-0795-45ae-9267-a7282d30c4d9 service nova] [instance: 6b7e9611-be35-4e51-b886-91a2fac0a653] No waiting events found dispatching network-vif-plugged-657af53c-fc3a-45ab-81e5-b2eeea1c88d7 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:21:58 user nova-compute[75226]: WARNING nova.compute.manager [req-5a806db1-898b-4aa7-816c-3efdd130bd7d req-2638a1ca-0795-45ae-9267-a7282d30c4d9 service nova] [instance: 6b7e9611-be35-4e51-b886-91a2fac0a653] Received unexpected event network-vif-plugged-657af53c-fc3a-45ab-81e5-b2eeea1c88d7 for instance with vm_state active and task_state rescuing.
Nov 17 01:21:58 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e9f3e9e0-0487-4dea-8c75-19843e9ba481 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/391ae0785444ade97eb9cd60c251e05e79857e81.part --force-share --output=json" returned: 0 in 0.278s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:21:58 user nova-compute[75226]: DEBUG nova.virt.images [None req-e9f3e9e0-0487-4dea-8c75-19843e9ba481 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] 4b89a484-b018-4c71-9839-3c6cdc3f7b3f was qcow2, converting to raw {{(pid=75226) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 17 01:21:58 user nova-compute[75226]: DEBUG nova.privsep.utils [None req-e9f3e9e0-0487-4dea-8c75-19843e9ba481 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75226) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 17 01:21:58 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e9f3e9e0-0487-4dea-8c75-19843e9ba481 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/391ae0785444ade97eb9cd60c251e05e79857e81.part /opt/stack/data/nova/instances/_base/391ae0785444ade97eb9cd60c251e05e79857e81.converted {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:21:58 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e9f3e9e0-0487-4dea-8c75-19843e9ba481 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/391ae0785444ade97eb9cd60c251e05e79857e81.part /opt/stack/data/nova/instances/_base/391ae0785444ade97eb9cd60c251e05e79857e81.converted" returned: 0 in 0.176s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:21:58 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e9f3e9e0-0487-4dea-8c75-19843e9ba481 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/391ae0785444ade97eb9cd60c251e05e79857e81.converted --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:21:58 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e9f3e9e0-0487-4dea-8c75-19843e9ba481 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/391ae0785444ade97eb9cd60c251e05e79857e81.converted --force-share --output=json" returned: 0 in 0.267s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:21:58 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e9f3e9e0-0487-4dea-8c75-19843e9ba481 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Lock "391ae0785444ade97eb9cd60c251e05e79857e81" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.300s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:21:58 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e9f3e9e0-0487-4dea-8c75-19843e9ba481 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Acquiring lock "391ae0785444ade97eb9cd60c251e05e79857e81" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:21:58 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e9f3e9e0-0487-4dea-8c75-19843e9ba481 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Lock "391ae0785444ade97eb9cd60c251e05e79857e81" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:21:58 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e9f3e9e0-0487-4dea-8c75-19843e9ba481 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/391ae0785444ade97eb9cd60c251e05e79857e81 --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:21:59 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e9f3e9e0-0487-4dea-8c75-19843e9ba481 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/391ae0785444ade97eb9cd60c251e05e79857e81 --force-share --output=json" returned: 0 in 0.187s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:21:59 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e9f3e9e0-0487-4dea-8c75-19843e9ba481 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/391ae0785444ade97eb9cd60c251e05e79857e81,backing_fmt=raw /opt/stack/data/nova/instances/6b7e9611-be35-4e51-b886-91a2fac0a653/disk.rescue {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:21:59 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e9f3e9e0-0487-4dea-8c75-19843e9ba481 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/391ae0785444ade97eb9cd60c251e05e79857e81,backing_fmt=raw /opt/stack/data/nova/instances/6b7e9611-be35-4e51-b886-91a2fac0a653/disk.rescue" returned: 0 in 0.061s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:21:59 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e9f3e9e0-0487-4dea-8c75-19843e9ba481 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Lock "391ae0785444ade97eb9cd60c251e05e79857e81" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.260s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:21:59 user nova-compute[75226]: DEBUG nova.objects.instance [None req-e9f3e9e0-0487-4dea-8c75-19843e9ba481 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Lazy-loading 'migration_context' on Instance uuid 6b7e9611-be35-4e51-b886-91a2fac0a653 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:21:59 user nova-compute[75226]: DEBUG nova.objects.base [None req-e9f3e9e0-0487-4dea-8c75-19843e9ba481 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Object Instance<6b7e9611-be35-4e51-b886-91a2fac0a653> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75226) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 17 01:21:59 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-e9f3e9e0-0487-4dea-8c75-19843e9ba481 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 6b7e9611-be35-4e51-b886-91a2fac0a653] Created local disks {{(pid=75226) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 17 01:21:59 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-e9f3e9e0-0487-4dea-8c75-19843e9ba481 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 6b7e9611-be35-4e51-b886-91a2fac0a653] Start _get_guest_xml network_info=[{"id": "657af53c-fc3a-45ab-81e5-b2eeea1c88d7", "address": "fa:16:3e:91:de:17", "network": {"id": "450540a3-ff7e-42fb-a0a6-808acd749943", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1503678778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1503678778-network", "vif_mac": "fa:16:3e:91:de:17"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6cb6f679ee4468d82cc7fb5d0f67be9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap657af53c-fc", "ovs_interfaceid": "657af53c-fc3a-45ab-81e5-b2eeea1c88d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T01:13:22Z,direct_url=<?>,disk_format='qcow2',id=0b369aea-6f3f-4690-9f01-229b90ab6310,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4e110cbf9a84362a6864a7732c435a1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T01:13:23Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '4b89a484-b018-4c71-9839-3c6cdc3f7b3f', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aEbhyCZJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '6b7e9611-be35-4e51-b886-91a2fac0a653', 'attached_at': '', 'detached_at': '', 'volume_id': '9cf1355f-12ee-4285-9c07-f120d1308cb8', 'serial': '9cf1355f-12ee-4285-9c07-f120d1308cb8'}, 'attachment_id': 'dba3777d-4ebc-415f-9803-b8e2e9467692', 'device_type': 'disk', 'volume_type': None} {{(pid=75226) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 17 01:21:59 user nova-compute[75226]: DEBUG nova.objects.instance [None req-e9f3e9e0-0487-4dea-8c75-19843e9ba481 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Lazy-loading 'resources' on Instance uuid 6b7e9611-be35-4e51-b886-91a2fac0a653 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:21:59 user nova-compute[75226]: DEBUG nova.objects.base [None req-e9f3e9e0-0487-4dea-8c75-19843e9ba481 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Object Instance<6b7e9611-be35-4e51-b886-91a2fac0a653> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75226) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 17 01:21:59 user nova-compute[75226]: DEBUG nova.objects.instance [None req-e9f3e9e0-0487-4dea-8c75-19843e9ba481 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Lazy-loading 'numa_topology' on Instance uuid 6b7e9611-be35-4e51-b886-91a2fac0a653 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:21:59 user nova-compute[75226]: DEBUG nova.objects.base [None req-e9f3e9e0-0487-4dea-8c75-19843e9ba481 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Object Instance<6b7e9611-be35-4e51-b886-91a2fac0a653> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75226) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 17 01:21:59 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-e9f3e9e0-0487-4dea-8c75-19843e9ba481 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:21:59 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-e9f3e9e0-0487-4dea-8c75-19843e9ba481 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:21:59 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-e9f3e9e0-0487-4dea-8c75-19843e9ba481 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75226) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 17 01:21:59 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-e9f3e9e0-0487-4dea-8c75-19843e9ba481 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] CPU controller missing on host. {{(pid=75226) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 17 01:21:59 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-e9f3e9e0-0487-4dea-8c75-19843e9ba481 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75226) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 17 01:21:59 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-e9f3e9e0-0487-4dea-8c75-19843e9ba481 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] CPU controller found on host. {{(pid=75226) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 17 01:21:59 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-e9f3e9e0-0487-4dea-8c75-19843e9ba481 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75226) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 17 01:21:59 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-e9f3e9e0-0487-4dea-8c75-19843e9ba481 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-17T01:13:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T01:13:22Z,direct_url=<?>,disk_format='qcow2',id=0b369aea-6f3f-4690-9f01-229b90ab6310,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4e110cbf9a84362a6864a7732c435a1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T01:13:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 17 01:21:59 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-e9f3e9e0-0487-4dea-8c75-19843e9ba481 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Flavor limits 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 17 01:21:59 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-e9f3e9e0-0487-4dea-8c75-19843e9ba481 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Image limits 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 17 01:21:59 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-e9f3e9e0-0487-4dea-8c75-19843e9ba481 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Flavor pref 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 17 01:21:59 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-e9f3e9e0-0487-4dea-8c75-19843e9ba481 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Image pref 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 17 01:21:59 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-e9f3e9e0-0487-4dea-8c75-19843e9ba481 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 17 01:21:59 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-e9f3e9e0-0487-4dea-8c75-19843e9ba481 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 17 01:21:59 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-e9f3e9e0-0487-4dea-8c75-19843e9ba481 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75226) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 17 01:21:59 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-e9f3e9e0-0487-4dea-8c75-19843e9ba481 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Got 1 possible topologies {{(pid=75226) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 17 01:21:59 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-e9f3e9e0-0487-4dea-8c75-19843e9ba481 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 17 01:21:59 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-e9f3e9e0-0487-4dea-8c75-19843e9ba481 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 17 01:21:59 user nova-compute[75226]: DEBUG nova.objects.instance [None req-e9f3e9e0-0487-4dea-8c75-19843e9ba481 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Lazy-loading 'vcpu_model' on Instance uuid 6b7e9611-be35-4e51-b886-91a2fac0a653 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:21:59 user nova-compute[75226]: DEBUG nova.objects.base [None req-e9f3e9e0-0487-4dea-8c75-19843e9ba481 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Object Instance<6b7e9611-be35-4e51-b886-91a2fac0a653> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75226) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 17 01:21:59 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9f3e9e0-0487-4dea-8c75-19843e9ba481 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 6b7e9611-be35-4e51-b886-91a2fac0a653] Calling os-brick to attach iSCSI Volume {{(pid=75226) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 17 01:21:59 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9f3e9e0-0487-4dea-8c75-19843e9ba481 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc4cc36b490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aEbhyCZJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:21:59 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-e9f3e9e0-0487-4dea-8c75-19843e9ba481 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:21:59 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-e9f3e9e0-0487-4dea-8c75-19843e9ba481 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:21:59 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-e9f3e9e0-0487-4dea-8c75-19843e9ba481 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:21:59 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-e9f3e9e0-0487-4dea-8c75-19843e9ba481 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:21:59 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-e9f3e9e0-0487-4dea-8c75-19843e9ba481 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:21:59 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-e9f3e9e0-0487-4dea-8c75-19843e9ba481 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:21:59 user nova-compute[75226]: INFO os_brick.initiator.connectors.iscsi [None req-e9f3e9e0-0487-4dea-8c75-19843e9ba481 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 17 01:21:59 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 -p 172.16.0.220:3260 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:21:59 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 -p 172.16.0.220:3260" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:21:59 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d4eecb0-20ea-4d31-bcaa-5fe139b337e9]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = aEbhyCZJ\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:21:59 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9f3e9e0-0487-4dea-8c75-19843e9ba481 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 17 01:21:59 user nova-compute[75226]: node.name = iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8
Nov 17 01:21:59 user nova-compute[75226]: node.tpgt = -1
Nov 17 01:21:59 user nova-compute[75226]: node.startup = automatic
Nov 17 01:21:59 user nova-compute[75226]: node.leading_login = No
Nov 17 01:21:59 user nova-compute[75226]: iface.iscsi_ifacename = default
Nov 17 01:21:59 user nova-compute[75226]: iface.net_ifacename = <empty>
Nov 17 01:21:59 user nova-compute[75226]: iface.ipaddress = <empty>
Nov 17 01:21:59 user nova-compute[75226]: iface.prefix_len = 0
Nov 17 01:21:59 user nova-compute[75226]: iface.hwaddress = <empty>
Nov 17 01:21:59 user nova-compute[75226]: iface.transport_name = tcp
Nov 17 01:21:59 user nova-compute[75226]: iface.initiatorname = <empty>
Nov 17 01:21:59 user nova-compute[75226]: iface.state = <empty>
Nov 17 01:21:59 user nova-compute[75226]: iface.vlan_id = 0
Nov 17 01:21:59 user nova-compute[75226]: iface.vlan_priority = 0
Nov 17 01:21:59 user nova-compute[75226]: iface.vlan_state = <empty>
Nov 17 01:21:59 user nova-compute[75226]: iface.iface_num = 0
Nov 17 01:21:59 user nova-compute[75226]: iface.mtu = 0
Nov 17 01:21:59 user nova-compute[75226]: iface.port = 0
Nov 17 01:21:59 user nova-compute[75226]: iface.bootproto = <empty>
Nov 17 01:21:59 user nova-compute[75226]: iface.subnet_mask = <empty>
Nov 17 01:21:59 user nova-compute[75226]: iface.gateway = <empty>
Nov 17 01:21:59 user nova-compute[75226]: iface.dhcp_alt_client_id_state = <empty>
Nov 17 01:21:59 user nova-compute[75226]: iface.dhcp_alt_client_id = <empty>
Nov 17 01:21:59 user nova-compute[75226]: iface.dhcp_dns = <empty>
Nov 17 01:21:59 user nova-compute[75226]: iface.dhcp_learn_iqn = <empty>
Nov 17 01:21:59 user nova-compute[75226]: iface.dhcp_req_vendor_id_state = <empty>
Nov 17 01:21:59 user nova-compute[75226]: iface.dhcp_vendor_id_state = <empty>
Nov 17 01:21:59 user nova-compute[75226]: iface.dhcp_vendor_id = <empty>
Nov 17 01:21:59 user nova-compute[75226]: iface.dhcp_slp_da = <empty>
Nov 17 01:21:59 user nova-compute[75226]: iface.fragmentation = <empty>
Nov 17 01:21:59 user nova-compute[75226]: iface.gratuitous_arp = <empty>
Nov 17 01:21:59 user nova-compute[75226]: iface.incoming_forwarding = <empty>
Nov 17 01:21:59 user nova-compute[75226]: iface.tos_state = <empty>
Nov 17 01:21:59 user nova-compute[75226]: iface.tos = 0
Nov 17 01:21:59 user nova-compute[75226]: iface.ttl = 0
Nov 17 01:21:59 user nova-compute[75226]: iface.delayed_ack = <empty>
Nov 17 01:21:59 user nova-compute[75226]: iface.tcp_nagle = <empty>
Nov 17 01:21:59 user nova-compute[75226]: iface.tcp_wsf_state = <empty>
Nov 17 01:21:59 user nova-compute[75226]: iface.tcp_wsf = 0
Nov 17 01:21:59 user nova-compute[75226]: iface.tcp_timer_scale = 0
Nov 17 01:21:59 user nova-compute[75226]: iface.tcp_timestamp = <empty>
Nov 17 01:21:59 user nova-compute[75226]: iface.redirect = <empty>
Nov 17 01:21:59 user nova-compute[75226]: iface.def_task_mgmt_timeout = 0
Nov 17 01:21:59 user nova-compute[75226]: iface.header_digest = <empty>
Nov 17 01:21:59 user nova-compute[75226]: iface.data_digest = <empty>
Nov 17 01:21:59 user nova-compute[75226]: iface.immediate_data = <empty>
Nov 17 01:21:59 user nova-compute[75226]: iface.initial_r2t = <empty>
Nov 17 01:21:59 user nova-compute[75226]: iface.data_seq_inorder = <empty>
Nov 17 01:21:59 user nova-compute[75226]: iface.data_pdu_inorder = <empty>
Nov 17 01:21:59 user nova-compute[75226]: iface.erl = 0
Nov 17 01:21:59 user nova-compute[75226]: iface.max_receive_data_len = 0
Nov 17 01:21:59 user nova-compute[75226]: iface.first_burst_len = 0
Nov 17 01:21:59 user nova-compute[75226]: iface.max_outstanding_r2t = 0
Nov 17 01:21:59 user nova-compute[75226]: iface.max_burst_len = 0
Nov 17 01:21:59 user nova-compute[75226]: iface.chap_auth = <empty>
Nov 17 01:21:59 user nova-compute[75226]: iface.bidi_chap = <empty>
Nov 17 01:21:59 user nova-compute[75226]: iface.strict_login_compliance = <empty>
Nov 17 01:21:59 user nova-compute[75226]: iface.discovery_auth = <empty>
Nov 17 01:21:59 user nova-compute[75226]: iface.discovery_logout = <empty>
Nov 17 01:21:59 user nova-compute[75226]: node.discovery_address = <empty>
Nov 17 01:21:59 user nova-compute[75226]: node.discovery_port = 0
Nov 17 01:21:59 user nova-compute[75226]: node.discovery_type = static
Nov 17 01:21:59 user nova-compute[75226]: node.session.initial_cmdsn = 0
Nov 17 01:21:59 user nova-compute[75226]: node.session.initial_login_retry_max = 8
Nov 17 01:21:59 user nova-compute[75226]: node.session.xmit_thread_priority = -20
Nov 17 01:21:59 user nova-compute[75226]: node.session.cmds_max = 128
Nov 17 01:21:59 user nova-compute[75226]: node.session.queue_depth = 32
Nov 17 01:21:59 user nova-compute[75226]: node.session.nr_sessions = 1
Nov 17 01:21:59 user nova-compute[75226]: node.session.auth.authmethod = CHAP
Nov 17 01:21:59 user nova-compute[75226]: node.session.auth.username = aEbhyCZJ
Nov 17 01:21:59 user nova-compute[75226]: node.session.auth.password = ***
Nov 17 01:21:59 user nova-compute[75226]: node.session.auth.username_in = <empty>
Nov 17 01:21:59 user nova-compute[75226]: node.session.auth.password_in = <empty>
Nov 17 01:21:59 user nova-compute[75226]: node.session.auth.chap_algs = MD5
Nov 17 01:21:59 user nova-compute[75226]: node.session.timeo.replacement_timeout = 120
Nov 17 01:21:59 user nova-compute[75226]: node.session.err_timeo.abort_timeout = 15
Nov 17 01:21:59 user nova-compute[75226]: node.session.err_timeo.lu_reset_timeout = 30
Nov 17 01:21:59 user nova-compute[75226]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 17 01:21:59 user nova-compute[75226]: node.session.err_timeo.host_reset_timeout = 60
Nov 17 01:21:59 user nova-compute[75226]: node.session.iscsi.FastAbort = Yes
Nov 17 01:21:59 user nova-compute[75226]: node.session.iscsi.InitialR2T = No
Nov 17 01:21:59 user nova-compute[75226]: node.session.iscsi.ImmediateData = Yes
Nov 17 01:21:59 user nova-compute[75226]: node.session.iscsi.FirstBurstLength = 262144
Nov 17 01:21:59 user nova-compute[75226]: node.session.iscsi.MaxBurstLength = 16776192
Nov 17 01:21:59 user nova-compute[75226]: node.session.iscsi.DefaultTime2Retain = 0
Nov 17 01:21:59 user nova-compute[75226]: node.session.iscsi.DefaultTime2Wait = 2
Nov 17 01:21:59 user nova-compute[75226]: node.session.iscsi.MaxConnections = 1
Nov 17 01:21:59 user nova-compute[75226]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 17 01:21:59 user nova-compute[75226]: node.session.iscsi.ERL = 0
Nov 17 01:21:59 user nova-compute[75226]: node.session.scan = manual
Nov 17 01:21:59 user nova-compute[75226]: node.session.reopen_max = 0
Nov 17 01:21:59 user nova-compute[75226]: node.conn[0].address = 172.16.0.220
Nov 17 01:21:59 user nova-compute[75226]: node.conn[0].port = 3260
Nov 17 01:21:59 user nova-compute[75226]: node.conn[0].startup = manual
Nov 17 01:21:59 user nova-compute[75226]: node.conn[0].tcp.window_size = 524288
Nov 17 01:21:59 user nova-compute[75226]: node.conn[0].tcp.type_of_service = 0
Nov 17 01:21:59 user nova-compute[75226]: node.conn[0].timeo.logout_timeout = 15
Nov 17 01:21:59 user nova-compute[75226]: node.conn[0].timeo.login_timeout = 15
Nov 17 01:21:59 user nova-compute[75226]: node.conn[0].timeo.auth_timeout = 45
Nov 17 01:21:59 user nova-compute[75226]: node.conn[0].timeo.noop_out_interval = 5
Nov 17 01:21:59 user nova-compute[75226]: node.conn[0].timeo.noop_out_timeout = 5
Nov 17 01:21:59 user nova-compute[75226]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 17 01:21:59 user nova-compute[75226]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 17 01:21:59 user nova-compute[75226]: node.conn[0].iscsi.HeaderDigest = None
Nov 17 01:21:59 user nova-compute[75226]: node.conn[0].iscsi.DataDigest = None
Nov 17 01:21:59 user nova-compute[75226]: node.conn[0].iscsi.IFMarker = No
Nov 17 01:21:59 user nova-compute[75226]: node.conn[0].iscsi.OFMarker = No
Nov 17 01:21:59 user nova-compute[75226]: # END RECORD
Nov 17 01:21:59 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:21:59 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:21:59 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:21:59 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[4442beff-0122-4b00-be20-ad5a13d35eb8]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:21:59 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9f3e9e0-0487-4dea-8c75-19843e9ba481 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:21:59 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:21:59 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:21:59 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dd7f631-d798-431f-a0a1-1e9a790419b4]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:21:59 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9f3e9e0-0487-4dea-8c75-19843e9ba481 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:21:59 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aEbhyCZJ {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:21:59 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aEbhyCZJ" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:21:59 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[23a00466-822c-4e05-9adc-489e51c5a557]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:21:59 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9f3e9e0-0487-4dea-8c75-19843e9ba481 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aEbhyCZJ'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:21:59 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:21:59 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:21:59 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d3edd6d-0cd2-4fce-bd2f-02deb9079951]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:21:59 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9f3e9e0-0487-4dea-8c75-19843e9ba481 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:21:59 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:21:59 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:21:59 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1e41967-8da5-4365-8e07-57e80a3bd308]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa7be6d3-d525-4aa3-bcc3-481465f2832b (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:21:59 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9f3e9e0-0487-4dea-8c75-19843e9ba481 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)
Nov 17 01:21:59 user nova-compute[75226]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa7be6d3-d525-4aa3-bcc3-481465f2832b (non-flash)
Nov 17 01:21:59 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:21:59 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9f3e9e0-0487-4dea-8c75-19843e9ba481 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)
Nov 17 01:21:59 user nova-compute[75226]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa7be6d3-d525-4aa3-bcc3-481465f2832b (non-flash)
Nov 17 01:21:59 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:21:59 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-e9f3e9e0-0487-4dea-8c75-19843e9ba481 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.149s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:21:59 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9f3e9e0-0487-4dea-8c75-19843e9ba481 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Connected to 172.16.0.220:3260 {{(pid=75226) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 17 01:21:59 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-e9f3e9e0-0487-4dea-8c75-19843e9ba481 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] HCTL ('34', '0', '0', 0) found on session 16 with lun 0 {{(pid=75226) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 17 01:21:59 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-e9f3e9e0-0487-4dea-8c75-19843e9ba481 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=75226) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 17 01:21:59 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:21:59 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.013s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:21:59 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[0972ee19-4cca-4231-bec3-18fbe92bf3cd]: (4, ('0 0 0', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:21:59 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-e9f3e9e0-0487-4dea-8c75-19843e9ba481 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Searching for a device in session 16 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=75226) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 01:21:59 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9f3e9e0-0487-4dea-8c75-19843e9ba481 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aEbhyCZJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75226) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 17 01:21:59 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-e9f3e9e0-0487-4dea-8c75-19843e9ba481 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.172s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:21:59 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9f3e9e0-0487-4dea-8c75-19843e9ba481 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] <== connect_volume: return (176ms) {'type': 'block', 'scsi_wwn': '23162386133666163', 'path': '/dev/sdc'} {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:21:59 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9f3e9e0-0487-4dea-8c75-19843e9ba481 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 6b7e9611-be35-4e51-b886-91a2fac0a653] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23162386133666163', 'path': '/dev/sdc'} {{(pid=75226) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 17 01:21:59 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-e9f3e9e0-0487-4dea-8c75-19843e9ba481 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:20:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-614527780',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-614527780',id=11,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-17T01:20:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e6cb6f679ee4468d82cc7fb5d0f67be9',ramdisk_id='',reservation_id='r-do7w6o8m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-76498640',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T01:20:22Z,user_data=None,user_id='1b793ce05bf44b939a9fb5a914a04cb0',uuid=6b7e9611-be35-4e51-b886-91a2fac0a653,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "657af53c-fc3a-45ab-81e5-b2eeea1c88d7", "address": "fa:16:3e:91:de:17", "network": {"id": "450540a3-ff7e-42fb-a0a6-808acd749943", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1503678778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1503678778-network", "vif_mac": "fa:16:3e:91:de:17"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6cb6f679ee4468d82cc7fb5d0f67be9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap657af53c-fc", "ovs_interfaceid": "657af53c-fc3a-45ab-81e5-b2eeea1c88d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75226) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 01:21:59 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-e9f3e9e0-0487-4dea-8c75-19843e9ba481 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Converting VIF {"id": "657af53c-fc3a-45ab-81e5-b2eeea1c88d7", "address": "fa:16:3e:91:de:17", "network": {"id": "450540a3-ff7e-42fb-a0a6-808acd749943", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1503678778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1503678778-network", "vif_mac": "fa:16:3e:91:de:17"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6cb6f679ee4468d82cc7fb5d0f67be9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap657af53c-fc", "ovs_interfaceid": "657af53c-fc3a-45ab-81e5-b2eeea1c88d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:21:59 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-e9f3e9e0-0487-4dea-8c75-19843e9ba481 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:91:de:17,bridge_name='br-int',has_traffic_filtering=True,id=657af53c-fc3a-45ab-81e5-b2eeea1c88d7,network=Network(450540a3-ff7e-42fb-a0a6-808acd749943),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap657af53c-fc') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:21:59 user nova-compute[75226]: DEBUG nova.objects.instance [None req-e9f3e9e0-0487-4dea-8c75-19843e9ba481 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Lazy-loading 'pci_devices' on Instance uuid 6b7e9611-be35-4e51-b886-91a2fac0a653 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:21:59 user nova-compute[75226]: DEBUG nova.objects.base [None req-e9f3e9e0-0487-4dea-8c75-19843e9ba481 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Object Instance<6b7e9611-be35-4e51-b886-91a2fac0a653> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75226) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 17 01:21:59 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-e9f3e9e0-0487-4dea-8c75-19843e9ba481 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 6b7e9611-be35-4e51-b886-91a2fac0a653] End _get_guest_xml xml=<domain type="kvm">
Nov 17 01:21:59 user nova-compute[75226]:   <uuid>6b7e9611-be35-4e51-b886-91a2fac0a653</uuid>
Nov 17 01:21:59 user nova-compute[75226]:   <name>instance-0000000b</name>
Nov 17 01:21:59 user nova-compute[75226]:   <memory>524288</memory>
Nov 17 01:21:59 user nova-compute[75226]:   <vcpu>1</vcpu>
Nov 17 01:21:59 user nova-compute[75226]:   <metadata>
Nov 17 01:21:59 user nova-compute[75226]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 17 01:21:59 user nova-compute[75226]:       <nova:package version="0.0.0"/>
Nov 17 01:21:59 user nova-compute[75226]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-614527780</nova:name>
Nov 17 01:21:59 user nova-compute[75226]:       <nova:creationTime>2023-11-17 01:21:59</nova:creationTime>
Nov 17 01:21:59 user nova-compute[75226]:       <nova:flavor name="m1.tiny">
Nov 17 01:21:59 user nova-compute[75226]:         <nova:memory>512</nova:memory>
Nov 17 01:21:59 user nova-compute[75226]:         <nova:disk>1</nova:disk>
Nov 17 01:21:59 user nova-compute[75226]:         <nova:swap>0</nova:swap>
Nov 17 01:21:59 user nova-compute[75226]:         <nova:ephemeral>0</nova:ephemeral>
Nov 17 01:21:59 user nova-compute[75226]:         <nova:vcpus>1</nova:vcpus>
Nov 17 01:21:59 user nova-compute[75226]:       </nova:flavor>
Nov 17 01:21:59 user nova-compute[75226]:       <nova:owner>
Nov 17 01:21:59 user nova-compute[75226]:         <nova:user uuid="1b793ce05bf44b939a9fb5a914a04cb0">tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member</nova:user>
Nov 17 01:21:59 user nova-compute[75226]:         <nova:project uuid="e6cb6f679ee4468d82cc7fb5d0f67be9">tempest-ServerBootFromVolumeStableRescueTest-76498640</nova:project>
Nov 17 01:21:59 user nova-compute[75226]:       </nova:owner>
Nov 17 01:21:59 user nova-compute[75226]:       <nova:root type="image" uuid="0b369aea-6f3f-4690-9f01-229b90ab6310"/>
Nov 17 01:21:59 user nova-compute[75226]:       <nova:ports>
Nov 17 01:21:59 user nova-compute[75226]:         <nova:port uuid="657af53c-fc3a-45ab-81e5-b2eeea1c88d7">
Nov 17 01:21:59 user nova-compute[75226]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 17 01:21:59 user nova-compute[75226]:         </nova:port>
Nov 17 01:21:59 user nova-compute[75226]:       </nova:ports>
Nov 17 01:21:59 user nova-compute[75226]:     </nova:instance>
Nov 17 01:21:59 user nova-compute[75226]:   </metadata>
Nov 17 01:21:59 user nova-compute[75226]:   <sysinfo type="smbios">
Nov 17 01:21:59 user nova-compute[75226]:     <system>
Nov 17 01:21:59 user nova-compute[75226]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 17 01:21:59 user nova-compute[75226]:       <entry name="product">OpenStack Nova</entry>
Nov 17 01:21:59 user nova-compute[75226]:       <entry name="version">0.0.0</entry>
Nov 17 01:21:59 user nova-compute[75226]:       <entry name="serial">6b7e9611-be35-4e51-b886-91a2fac0a653</entry>
Nov 17 01:21:59 user nova-compute[75226]:       <entry name="uuid">6b7e9611-be35-4e51-b886-91a2fac0a653</entry>
Nov 17 01:21:59 user nova-compute[75226]:       <entry name="family">Virtual Machine</entry>
Nov 17 01:21:59 user nova-compute[75226]:     </system>
Nov 17 01:21:59 user nova-compute[75226]:   </sysinfo>
Nov 17 01:21:59 user nova-compute[75226]:   <os>
Nov 17 01:21:59 user nova-compute[75226]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 17 01:21:59 user nova-compute[75226]:     <smbios mode="sysinfo"/>
Nov 17 01:21:59 user nova-compute[75226]:   </os>
Nov 17 01:21:59 user nova-compute[75226]:   <features>
Nov 17 01:21:59 user nova-compute[75226]:     <acpi/>
Nov 17 01:21:59 user nova-compute[75226]:     <apic/>
Nov 17 01:21:59 user nova-compute[75226]:     <vmcoreinfo/>
Nov 17 01:21:59 user nova-compute[75226]:   </features>
Nov 17 01:21:59 user nova-compute[75226]:   <clock offset="utc">
Nov 17 01:21:59 user nova-compute[75226]:     <timer name="pit" tickpolicy="delay"/>
Nov 17 01:21:59 user nova-compute[75226]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 17 01:21:59 user nova-compute[75226]:     <timer name="hpet" present="no"/>
Nov 17 01:21:59 user nova-compute[75226]:   </clock>
Nov 17 01:21:59 user nova-compute[75226]:   <cpu mode="custom" match="exact">
Nov 17 01:21:59 user nova-compute[75226]:     <model>Nehalem</model>
Nov 17 01:21:59 user nova-compute[75226]:     <topology sockets="1" cores="1" threads="1"/>
Nov 17 01:21:59 user nova-compute[75226]:   </cpu>
Nov 17 01:21:59 user nova-compute[75226]:   <devices>
Nov 17 01:21:59 user nova-compute[75226]:     <disk type="block" device="disk">
Nov 17 01:21:59 user nova-compute[75226]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 01:21:59 user nova-compute[75226]:       <source dev="/dev/sdc"/>
Nov 17 01:21:59 user nova-compute[75226]:       <target dev="vda" bus="virtio"/>
Nov 17 01:21:59 user nova-compute[75226]:       <serial>9cf1355f-12ee-4285-9c07-f120d1308cb8</serial>
Nov 17 01:21:59 user nova-compute[75226]:     </disk>
Nov 17 01:21:59 user nova-compute[75226]:     <disk type="file" device="disk">
Nov 17 01:21:59 user nova-compute[75226]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 17 01:21:59 user nova-compute[75226]:       <source file="/opt/stack/data/nova/instances/6b7e9611-be35-4e51-b886-91a2fac0a653/disk.rescue"/>
Nov 17 01:21:59 user nova-compute[75226]:       <target dev="vdb" bus="virtio"/>
Nov 17 01:21:59 user nova-compute[75226]:       <boot order="1"/>
Nov 17 01:21:59 user nova-compute[75226]:     </disk>
Nov 17 01:21:59 user nova-compute[75226]:     <interface type="ethernet">
Nov 17 01:21:59 user nova-compute[75226]:       <mac address="fa:16:3e:91:de:17"/>
Nov 17 01:21:59 user nova-compute[75226]:       <model type="virtio"/>
Nov 17 01:21:59 user nova-compute[75226]:       <mtu size="1442"/>
Nov 17 01:21:59 user nova-compute[75226]:       <target dev="tap657af53c-fc"/>
Nov 17 01:21:59 user nova-compute[75226]:     </interface>
Nov 17 01:21:59 user nova-compute[75226]:     <serial type="pty">
Nov 17 01:21:59 user nova-compute[75226]:       <log file="/opt/stack/data/nova/instances/6b7e9611-be35-4e51-b886-91a2fac0a653/console.log" append="off"/>
Nov 17 01:21:59 user nova-compute[75226]:     </serial>
Nov 17 01:21:59 user nova-compute[75226]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 17 01:21:59 user nova-compute[75226]:     <video>
Nov 17 01:21:59 user nova-compute[75226]:       <model type="virtio"/>
Nov 17 01:21:59 user nova-compute[75226]:     </video>
Nov 17 01:21:59 user nova-compute[75226]:     <rng model="virtio">
Nov 17 01:21:59 user nova-compute[75226]:       <backend model="random">/dev/urandom</backend>
Nov 17 01:21:59 user nova-compute[75226]:     </rng>
Nov 17 01:21:59 user nova-compute[75226]:     <controller type="usb" index="0" model="none"/>
Nov 17 01:21:59 user nova-compute[75226]:     <memballoon model="virtio">
Nov 17 01:21:59 user nova-compute[75226]:       <stats period="10"/>
Nov 17 01:21:59 user nova-compute[75226]:     </memballoon>
Nov 17 01:21:59 user nova-compute[75226]:   </devices>
Nov 17 01:21:59 user nova-compute[75226]: </domain>
Nov 17 01:21:59 user nova-compute[75226]:  {{(pid=75226) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 17 01:21:59 user nova-compute[75226]: INFO nova.virt.libvirt.driver [-] [instance: 6b7e9611-be35-4e51-b886-91a2fac0a653] Instance destroyed successfully.
Nov 17 01:21:59 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-e9f3e9e0-0487-4dea-8c75-19843e9ba481 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] No BDM found with device name vda, not building metadata. {{(pid=75226) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 01:21:59 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-e9f3e9e0-0487-4dea-8c75-19843e9ba481 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75226) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 01:21:59 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-e9f3e9e0-0487-4dea-8c75-19843e9ba481 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] No VIF found with MAC fa:16:3e:91:de:17, not building metadata {{(pid=75226) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 01:21:59 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:22:00 user nova-compute[75226]: DEBUG nova.compute.manager [req-ae0ae924-841e-4f25-bb74-fc6c818c6809 req-5df5b423-f095-4174-ab6e-da3a3ff65f40 service nova] [instance: 6b7e9611-be35-4e51-b886-91a2fac0a653] Received event network-vif-unplugged-657af53c-fc3a-45ab-81e5-b2eeea1c88d7 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:22:00 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-ae0ae924-841e-4f25-bb74-fc6c818c6809 req-5df5b423-f095-4174-ab6e-da3a3ff65f40 service nova] Acquiring lock "6b7e9611-be35-4e51-b886-91a2fac0a653-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:22:00 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-ae0ae924-841e-4f25-bb74-fc6c818c6809 req-5df5b423-f095-4174-ab6e-da3a3ff65f40 service nova] Lock "6b7e9611-be35-4e51-b886-91a2fac0a653-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:22:00 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-ae0ae924-841e-4f25-bb74-fc6c818c6809 req-5df5b423-f095-4174-ab6e-da3a3ff65f40 service nova] Lock "6b7e9611-be35-4e51-b886-91a2fac0a653-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:22:00 user nova-compute[75226]: DEBUG nova.compute.manager [req-ae0ae924-841e-4f25-bb74-fc6c818c6809 req-5df5b423-f095-4174-ab6e-da3a3ff65f40 service nova] [instance: 6b7e9611-be35-4e51-b886-91a2fac0a653] No waiting events found dispatching network-vif-unplugged-657af53c-fc3a-45ab-81e5-b2eeea1c88d7 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:22:00 user nova-compute[75226]: WARNING nova.compute.manager [req-ae0ae924-841e-4f25-bb74-fc6c818c6809 req-5df5b423-f095-4174-ab6e-da3a3ff65f40 service nova] [instance: 6b7e9611-be35-4e51-b886-91a2fac0a653] Received unexpected event network-vif-unplugged-657af53c-fc3a-45ab-81e5-b2eeea1c88d7 for instance with vm_state active and task_state rescuing.
Nov 17 01:22:00 user nova-compute[75226]: DEBUG nova.compute.manager [req-ae0ae924-841e-4f25-bb74-fc6c818c6809 req-5df5b423-f095-4174-ab6e-da3a3ff65f40 service nova] [instance: 6b7e9611-be35-4e51-b886-91a2fac0a653] Received event network-vif-plugged-657af53c-fc3a-45ab-81e5-b2eeea1c88d7 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:22:00 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-ae0ae924-841e-4f25-bb74-fc6c818c6809 req-5df5b423-f095-4174-ab6e-da3a3ff65f40 service nova] Acquiring lock "6b7e9611-be35-4e51-b886-91a2fac0a653-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:22:00 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-ae0ae924-841e-4f25-bb74-fc6c818c6809 req-5df5b423-f095-4174-ab6e-da3a3ff65f40 service nova] Lock "6b7e9611-be35-4e51-b886-91a2fac0a653-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:22:00 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-ae0ae924-841e-4f25-bb74-fc6c818c6809 req-5df5b423-f095-4174-ab6e-da3a3ff65f40 service nova] Lock "6b7e9611-be35-4e51-b886-91a2fac0a653-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:22:00 user nova-compute[75226]: DEBUG nova.compute.manager [req-ae0ae924-841e-4f25-bb74-fc6c818c6809 req-5df5b423-f095-4174-ab6e-da3a3ff65f40 service nova] [instance: 6b7e9611-be35-4e51-b886-91a2fac0a653] No waiting events found dispatching network-vif-plugged-657af53c-fc3a-45ab-81e5-b2eeea1c88d7 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:22:00 user nova-compute[75226]: WARNING nova.compute.manager [req-ae0ae924-841e-4f25-bb74-fc6c818c6809 req-5df5b423-f095-4174-ab6e-da3a3ff65f40 service nova] [instance: 6b7e9611-be35-4e51-b886-91a2fac0a653] Received unexpected event network-vif-plugged-657af53c-fc3a-45ab-81e5-b2eeea1c88d7 for instance with vm_state active and task_state rescuing.
Nov 17 01:22:00 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:22:00 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:22:00 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:22:00 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:22:00 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:22:01 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:22:02 user nova-compute[75226]: DEBUG nova.compute.manager [req-82746058-acbb-4f12-8fbf-d6ae2e408906 req-bd2bf9be-cbb4-4c24-8ece-cd76b0eb65bc service nova] [instance: 6b7e9611-be35-4e51-b886-91a2fac0a653] Received event network-vif-plugged-657af53c-fc3a-45ab-81e5-b2eeea1c88d7 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:22:02 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-82746058-acbb-4f12-8fbf-d6ae2e408906 req-bd2bf9be-cbb4-4c24-8ece-cd76b0eb65bc service nova] Acquiring lock "6b7e9611-be35-4e51-b886-91a2fac0a653-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:22:02 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-82746058-acbb-4f12-8fbf-d6ae2e408906 req-bd2bf9be-cbb4-4c24-8ece-cd76b0eb65bc service nova] Lock "6b7e9611-be35-4e51-b886-91a2fac0a653-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:22:02 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-82746058-acbb-4f12-8fbf-d6ae2e408906 req-bd2bf9be-cbb4-4c24-8ece-cd76b0eb65bc service nova] Lock "6b7e9611-be35-4e51-b886-91a2fac0a653-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:22:02 user nova-compute[75226]: DEBUG nova.compute.manager [req-82746058-acbb-4f12-8fbf-d6ae2e408906 req-bd2bf9be-cbb4-4c24-8ece-cd76b0eb65bc service nova] [instance: 6b7e9611-be35-4e51-b886-91a2fac0a653] No waiting events found dispatching network-vif-plugged-657af53c-fc3a-45ab-81e5-b2eeea1c88d7 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:22:02 user nova-compute[75226]: WARNING nova.compute.manager [req-82746058-acbb-4f12-8fbf-d6ae2e408906 req-bd2bf9be-cbb4-4c24-8ece-cd76b0eb65bc service nova] [instance: 6b7e9611-be35-4e51-b886-91a2fac0a653] Received unexpected event network-vif-plugged-657af53c-fc3a-45ab-81e5-b2eeea1c88d7 for instance with vm_state active and task_state rescuing.
Nov 17 01:22:02 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:22:02 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:22:03 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e9f3e9e0-0487-4dea-8c75-19843e9ba481 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 6b7e9611-be35-4e51-b886-91a2fac0a653] Checking state {{(pid=75226) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 01:22:03 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:22:04 user nova-compute[75226]: DEBUG nova.compute.manager [req-053205be-01ea-40ab-b326-a586d4e73ad3 req-b7ce4a2d-b2d3-4122-891a-f1cbe7e37e9d service nova] [instance: 6b7e9611-be35-4e51-b886-91a2fac0a653] Received event network-vif-plugged-657af53c-fc3a-45ab-81e5-b2eeea1c88d7 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:22:04 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-053205be-01ea-40ab-b326-a586d4e73ad3 req-b7ce4a2d-b2d3-4122-891a-f1cbe7e37e9d service nova] Acquiring lock "6b7e9611-be35-4e51-b886-91a2fac0a653-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:22:04 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-053205be-01ea-40ab-b326-a586d4e73ad3 req-b7ce4a2d-b2d3-4122-891a-f1cbe7e37e9d service nova] Lock "6b7e9611-be35-4e51-b886-91a2fac0a653-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:22:04 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-053205be-01ea-40ab-b326-a586d4e73ad3 req-b7ce4a2d-b2d3-4122-891a-f1cbe7e37e9d service nova] Lock "6b7e9611-be35-4e51-b886-91a2fac0a653-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:22:04 user nova-compute[75226]: DEBUG nova.compute.manager [req-053205be-01ea-40ab-b326-a586d4e73ad3 req-b7ce4a2d-b2d3-4122-891a-f1cbe7e37e9d service nova] [instance: 6b7e9611-be35-4e51-b886-91a2fac0a653] No waiting events found dispatching network-vif-plugged-657af53c-fc3a-45ab-81e5-b2eeea1c88d7 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:22:04 user nova-compute[75226]: WARNING nova.compute.manager [req-053205be-01ea-40ab-b326-a586d4e73ad3 req-b7ce4a2d-b2d3-4122-891a-f1cbe7e37e9d service nova] [instance: 6b7e9611-be35-4e51-b886-91a2fac0a653] Received unexpected event network-vif-plugged-657af53c-fc3a-45ab-81e5-b2eeea1c88d7 for instance with vm_state rescued and task_state None.
Nov 17 01:22:05 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:22:06 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:22:06 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e4ecd5b5-92fc-433e-9934-ac3b9120b1a5 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Acquiring lock "306054a8-4d0f-4913-b3b8-97aeeeec071c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:22:06 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e4ecd5b5-92fc-433e-9934-ac3b9120b1a5 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Lock "306054a8-4d0f-4913-b3b8-97aeeeec071c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:22:06 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e4ecd5b5-92fc-433e-9934-ac3b9120b1a5 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] [instance: 306054a8-4d0f-4913-b3b8-97aeeeec071c] Starting instance... {{(pid=75226) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 17 01:22:06 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e4ecd5b5-92fc-433e-9934-ac3b9120b1a5 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:22:06 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e4ecd5b5-92fc-433e-9934-ac3b9120b1a5 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:22:06 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-e4ecd5b5-92fc-433e-9934-ac3b9120b1a5 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75226) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 17 01:22:06 user nova-compute[75226]: INFO nova.compute.claims [None req-e4ecd5b5-92fc-433e-9934-ac3b9120b1a5 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] [instance: 306054a8-4d0f-4913-b3b8-97aeeeec071c] Claim successful on node user
Nov 17 01:22:07 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-e4ecd5b5-92fc-433e-9934-ac3b9120b1a5 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:22:07 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-e4ecd5b5-92fc-433e-9934-ac3b9120b1a5 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:22:07 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e4ecd5b5-92fc-433e-9934-ac3b9120b1a5 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.503s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:22:07 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e4ecd5b5-92fc-433e-9934-ac3b9120b1a5 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] [instance: 306054a8-4d0f-4913-b3b8-97aeeeec071c] Start building networks asynchronously for instance. {{(pid=75226) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 17 01:22:07 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e4ecd5b5-92fc-433e-9934-ac3b9120b1a5 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] [instance: 306054a8-4d0f-4913-b3b8-97aeeeec071c] Allocating IP information in the background. {{(pid=75226) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 17 01:22:07 user nova-compute[75226]: DEBUG nova.network.neutron [None req-e4ecd5b5-92fc-433e-9934-ac3b9120b1a5 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] [instance: 306054a8-4d0f-4913-b3b8-97aeeeec071c] allocate_for_instance() {{(pid=75226) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 17 01:22:07 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-e4ecd5b5-92fc-433e-9934-ac3b9120b1a5 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] [instance: 306054a8-4d0f-4913-b3b8-97aeeeec071c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 17 01:22:07 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e4ecd5b5-92fc-433e-9934-ac3b9120b1a5 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] [instance: 306054a8-4d0f-4913-b3b8-97aeeeec071c] Start building block device mappings for instance. {{(pid=75226) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 17 01:22:07 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e4ecd5b5-92fc-433e-9934-ac3b9120b1a5 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] [instance: 306054a8-4d0f-4913-b3b8-97aeeeec071c] Start spawning the instance on the hypervisor. {{(pid=75226) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 17 01:22:07 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-e4ecd5b5-92fc-433e-9934-ac3b9120b1a5 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] [instance: 306054a8-4d0f-4913-b3b8-97aeeeec071c] Creating instance directory {{(pid=75226) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 17 01:22:07 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-e4ecd5b5-92fc-433e-9934-ac3b9120b1a5 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] [instance: 306054a8-4d0f-4913-b3b8-97aeeeec071c] Creating image(s)
Nov 17 01:22:07 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e4ecd5b5-92fc-433e-9934-ac3b9120b1a5 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Acquiring lock "/opt/stack/data/nova/instances/306054a8-4d0f-4913-b3b8-97aeeeec071c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:22:07 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e4ecd5b5-92fc-433e-9934-ac3b9120b1a5 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Lock "/opt/stack/data/nova/instances/306054a8-4d0f-4913-b3b8-97aeeeec071c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:22:07 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e4ecd5b5-92fc-433e-9934-ac3b9120b1a5 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Lock "/opt/stack/data/nova/instances/306054a8-4d0f-4913-b3b8-97aeeeec071c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:22:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e4ecd5b5-92fc-433e-9934-ac3b9120b1a5 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:22:07 user nova-compute[75226]: DEBUG nova.policy [None req-e4ecd5b5-92fc-433e-9934-ac3b9120b1a5 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2adb9c6cd5c443a7993f6f9d09da6346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fcdc65b510141e9b7c9a01401a97448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75226) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 17 01:22:07 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:22:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e4ecd5b5-92fc-433e-9934-ac3b9120b1a5 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json" returned: 0 in 0.200s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:22:07 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e4ecd5b5-92fc-433e-9934-ac3b9120b1a5 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Acquiring lock "a8a62c2546af3a2036b853250c5ac64d4c6b4371" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:22:07 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e4ecd5b5-92fc-433e-9934-ac3b9120b1a5 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Lock "a8a62c2546af3a2036b853250c5ac64d4c6b4371" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:22:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e4ecd5b5-92fc-433e-9934-ac3b9120b1a5 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:22:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e4ecd5b5-92fc-433e-9934-ac3b9120b1a5 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json" returned: 0 in 0.186s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:22:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e4ecd5b5-92fc-433e-9934-ac3b9120b1a5 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371,backing_fmt=raw /opt/stack/data/nova/instances/306054a8-4d0f-4913-b3b8-97aeeeec071c/disk 1073741824 {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:22:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e4ecd5b5-92fc-433e-9934-ac3b9120b1a5 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371,backing_fmt=raw /opt/stack/data/nova/instances/306054a8-4d0f-4913-b3b8-97aeeeec071c/disk 1073741824" returned: 0 in 0.074s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:22:07 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e4ecd5b5-92fc-433e-9934-ac3b9120b1a5 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Lock "a8a62c2546af3a2036b853250c5ac64d4c6b4371" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.270s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:22:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e4ecd5b5-92fc-433e-9934-ac3b9120b1a5 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:22:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e4ecd5b5-92fc-433e-9934-ac3b9120b1a5 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json" returned: 0 in 0.202s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:22:08 user nova-compute[75226]: DEBUG nova.virt.disk.api [None req-e4ecd5b5-92fc-433e-9934-ac3b9120b1a5 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Checking if we can resize image /opt/stack/data/nova/instances/306054a8-4d0f-4913-b3b8-97aeeeec071c/disk. size=1073741824 {{(pid=75226) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 17 01:22:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e4ecd5b5-92fc-433e-9934-ac3b9120b1a5 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/306054a8-4d0f-4913-b3b8-97aeeeec071c/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:22:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e4ecd5b5-92fc-433e-9934-ac3b9120b1a5 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/306054a8-4d0f-4913-b3b8-97aeeeec071c/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:22:08 user nova-compute[75226]: DEBUG nova.virt.disk.api [None req-e4ecd5b5-92fc-433e-9934-ac3b9120b1a5 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Cannot resize image /opt/stack/data/nova/instances/306054a8-4d0f-4913-b3b8-97aeeeec071c/disk to a smaller size. {{(pid=75226) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 17 01:22:08 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-e4ecd5b5-92fc-433e-9934-ac3b9120b1a5 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] [instance: 306054a8-4d0f-4913-b3b8-97aeeeec071c] Created local disks {{(pid=75226) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 17 01:22:08 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-e4ecd5b5-92fc-433e-9934-ac3b9120b1a5 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] [instance: 306054a8-4d0f-4913-b3b8-97aeeeec071c] Ensure instance console log exists: /opt/stack/data/nova/instances/306054a8-4d0f-4913-b3b8-97aeeeec071c/console.log {{(pid=75226) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 17 01:22:08 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e4ecd5b5-92fc-433e-9934-ac3b9120b1a5 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:22:08 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e4ecd5b5-92fc-433e-9934-ac3b9120b1a5 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:22:08 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e4ecd5b5-92fc-433e-9934-ac3b9120b1a5 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:22:08 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:22:08 user nova-compute[75226]: DEBUG nova.network.neutron [None req-e4ecd5b5-92fc-433e-9934-ac3b9120b1a5 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] [instance: 306054a8-4d0f-4913-b3b8-97aeeeec071c] Successfully created port: 9c6d2999-f11a-4cab-828c-993cc52b996c {{(pid=75226) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 17 01:22:09 user nova-compute[75226]: DEBUG nova.network.neutron [None req-e4ecd5b5-92fc-433e-9934-ac3b9120b1a5 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] [instance: 306054a8-4d0f-4913-b3b8-97aeeeec071c] Successfully updated port: 9c6d2999-f11a-4cab-828c-993cc52b996c {{(pid=75226) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 17 01:22:09 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e4ecd5b5-92fc-433e-9934-ac3b9120b1a5 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Acquiring lock "refresh_cache-306054a8-4d0f-4913-b3b8-97aeeeec071c" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:22:09 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e4ecd5b5-92fc-433e-9934-ac3b9120b1a5 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Acquired lock "refresh_cache-306054a8-4d0f-4913-b3b8-97aeeeec071c" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:22:09 user nova-compute[75226]: DEBUG nova.network.neutron [None req-e4ecd5b5-92fc-433e-9934-ac3b9120b1a5 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] [instance: 306054a8-4d0f-4913-b3b8-97aeeeec071c] Building network info cache for instance {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 01:22:09 user nova-compute[75226]: DEBUG nova.compute.manager [req-a487281c-6b33-485e-9bfd-bcab4a909e26 req-a0373d83-d8b4-4ac2-9358-6b08d2aea0ef service nova] [instance: 306054a8-4d0f-4913-b3b8-97aeeeec071c] Received event network-changed-9c6d2999-f11a-4cab-828c-993cc52b996c {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:22:09 user nova-compute[75226]: DEBUG nova.compute.manager [req-a487281c-6b33-485e-9bfd-bcab4a909e26 req-a0373d83-d8b4-4ac2-9358-6b08d2aea0ef service nova] [instance: 306054a8-4d0f-4913-b3b8-97aeeeec071c] Refreshing instance network info cache due to event network-changed-9c6d2999-f11a-4cab-828c-993cc52b996c. {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 01:22:09 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-a487281c-6b33-485e-9bfd-bcab4a909e26 req-a0373d83-d8b4-4ac2-9358-6b08d2aea0ef service nova] Acquiring lock "refresh_cache-306054a8-4d0f-4913-b3b8-97aeeeec071c" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:22:09 user nova-compute[75226]: DEBUG nova.network.neutron [None req-e4ecd5b5-92fc-433e-9934-ac3b9120b1a5 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] [instance: 306054a8-4d0f-4913-b3b8-97aeeeec071c] Instance cache missing network info. {{(pid=75226) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 17 01:22:10 user nova-compute[75226]: DEBUG nova.network.neutron [None req-e4ecd5b5-92fc-433e-9934-ac3b9120b1a5 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] [instance: 306054a8-4d0f-4913-b3b8-97aeeeec071c] Updating instance_info_cache with network_info: [{"id": "9c6d2999-f11a-4cab-828c-993cc52b996c", "address": "fa:16:3e:71:4a:e0", "network": {"id": "72724945-89ae-47c2-ac58-ea393837ada6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-308563626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fcdc65b510141e9b7c9a01401a97448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c6d2999-f1", "ovs_interfaceid": "9c6d2999-f11a-4cab-828c-993cc52b996c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:22:10 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e4ecd5b5-92fc-433e-9934-ac3b9120b1a5 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Releasing lock "refresh_cache-306054a8-4d0f-4913-b3b8-97aeeeec071c" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:22:10 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e4ecd5b5-92fc-433e-9934-ac3b9120b1a5 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] [instance: 306054a8-4d0f-4913-b3b8-97aeeeec071c] Instance network_info: |[{"id": "9c6d2999-f11a-4cab-828c-993cc52b996c", "address": "fa:16:3e:71:4a:e0", "network": {"id": "72724945-89ae-47c2-ac58-ea393837ada6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-308563626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fcdc65b510141e9b7c9a01401a97448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c6d2999-f1", "ovs_interfaceid": "9c6d2999-f11a-4cab-828c-993cc52b996c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75226) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 17 01:22:10 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-a487281c-6b33-485e-9bfd-bcab4a909e26 req-a0373d83-d8b4-4ac2-9358-6b08d2aea0ef service nova] Acquired lock "refresh_cache-306054a8-4d0f-4913-b3b8-97aeeeec071c" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:22:10 user nova-compute[75226]: DEBUG nova.network.neutron [req-a487281c-6b33-485e-9bfd-bcab4a909e26 req-a0373d83-d8b4-4ac2-9358-6b08d2aea0ef service nova] [instance: 306054a8-4d0f-4913-b3b8-97aeeeec071c] Refreshing network info cache for port 9c6d2999-f11a-4cab-828c-993cc52b996c {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 01:22:10 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-e4ecd5b5-92fc-433e-9934-ac3b9120b1a5 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] [instance: 306054a8-4d0f-4913-b3b8-97aeeeec071c] Start _get_guest_xml network_info=[{"id": "9c6d2999-f11a-4cab-828c-993cc52b996c", "address": "fa:16:3e:71:4a:e0", "network": {"id": "72724945-89ae-47c2-ac58-ea393837ada6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-308563626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fcdc65b510141e9b7c9a01401a97448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c6d2999-f1", "ovs_interfaceid": "9c6d2999-f11a-4cab-828c-993cc52b996c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T01:13:22Z,direct_url=<?>,disk_format='qcow2',id=0b369aea-6f3f-4690-9f01-229b90ab6310,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4e110cbf9a84362a6864a7732c435a1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T01:13:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '0b369aea-6f3f-4690-9f01-229b90ab6310'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75226) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 17 01:22:10 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:22:10 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-e4ecd5b5-92fc-433e-9934-ac3b9120b1a5 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:22:10 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-e4ecd5b5-92fc-433e-9934-ac3b9120b1a5 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:22:10 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-e4ecd5b5-92fc-433e-9934-ac3b9120b1a5 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75226) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 17 01:22:10 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-e4ecd5b5-92fc-433e-9934-ac3b9120b1a5 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] CPU controller missing on host. {{(pid=75226) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 17 01:22:10 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-e4ecd5b5-92fc-433e-9934-ac3b9120b1a5 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75226) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 17 01:22:10 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-e4ecd5b5-92fc-433e-9934-ac3b9120b1a5 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] CPU controller found on host. {{(pid=75226) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 17 01:22:10 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-e4ecd5b5-92fc-433e-9934-ac3b9120b1a5 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75226) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 17 01:22:10 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-e4ecd5b5-92fc-433e-9934-ac3b9120b1a5 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-17T01:13:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T01:13:22Z,direct_url=<?>,disk_format='qcow2',id=0b369aea-6f3f-4690-9f01-229b90ab6310,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4e110cbf9a84362a6864a7732c435a1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T01:13:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 17 01:22:10 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-e4ecd5b5-92fc-433e-9934-ac3b9120b1a5 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Flavor limits 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 17 01:22:10 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-e4ecd5b5-92fc-433e-9934-ac3b9120b1a5 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Image limits 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 17 01:22:10 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-e4ecd5b5-92fc-433e-9934-ac3b9120b1a5 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Flavor pref 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 17 01:22:10 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-e4ecd5b5-92fc-433e-9934-ac3b9120b1a5 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Image pref 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 17 01:22:10 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-e4ecd5b5-92fc-433e-9934-ac3b9120b1a5 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 17 01:22:10 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-e4ecd5b5-92fc-433e-9934-ac3b9120b1a5 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 17 01:22:10 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-e4ecd5b5-92fc-433e-9934-ac3b9120b1a5 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75226) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 17 01:22:10 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-e4ecd5b5-92fc-433e-9934-ac3b9120b1a5 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Got 1 possible topologies {{(pid=75226) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 17 01:22:10 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-e4ecd5b5-92fc-433e-9934-ac3b9120b1a5 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 17 01:22:10 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-e4ecd5b5-92fc-433e-9934-ac3b9120b1a5 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 17 01:22:10 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-e4ecd5b5-92fc-433e-9934-ac3b9120b1a5 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:22:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-523828380',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-523828380',id=17,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB8VZbi6odui0QRmSeooLxUmEz2+PJYm2i8ad1QX8czd8x79RdCiZHgEEKU0giPyPELai241fCLcP/Lw9LIxZnLDBi+bjdOFgz9iAt9ifW0YqhW6c0loV0dXybeEkqmBVQ==',key_name='tempest-keypair-1641360166',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1fcdc65b510141e9b7c9a01401a97448',ramdisk_id='',reservation_id='r-7ael85gs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1321076871',owner_user_name='tempest-AttachVolumeShelveTestJSON-1321076871-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T01:22:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2adb9c6cd5c443a7993f6f9d09da6346',uuid=306054a8-4d0f-4913-b3b8-97aeeeec071c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9c6d2999-f11a-4cab-828c-993cc52b996c", "address": "fa:16:3e:71:4a:e0", "network": {"id": "72724945-89ae-47c2-ac58-ea393837ada6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-308563626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fcdc65b510141e9b7c9a01401a97448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c6d2999-f1", "ovs_interfaceid": "9c6d2999-f11a-4cab-828c-993cc52b996c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75226) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 01:22:10 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-e4ecd5b5-92fc-433e-9934-ac3b9120b1a5 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Converting VIF {"id": "9c6d2999-f11a-4cab-828c-993cc52b996c", "address": "fa:16:3e:71:4a:e0", "network": {"id": "72724945-89ae-47c2-ac58-ea393837ada6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-308563626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fcdc65b510141e9b7c9a01401a97448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c6d2999-f1", "ovs_interfaceid": "9c6d2999-f11a-4cab-828c-993cc52b996c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:22:10 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-e4ecd5b5-92fc-433e-9934-ac3b9120b1a5 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:4a:e0,bridge_name='br-int',has_traffic_filtering=True,id=9c6d2999-f11a-4cab-828c-993cc52b996c,network=Network(72724945-89ae-47c2-ac58-ea393837ada6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c6d2999-f1') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:22:10 user nova-compute[75226]: DEBUG nova.objects.instance [None req-e4ecd5b5-92fc-433e-9934-ac3b9120b1a5 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Lazy-loading 'pci_devices' on Instance uuid 306054a8-4d0f-4913-b3b8-97aeeeec071c {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:22:10 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-e4ecd5b5-92fc-433e-9934-ac3b9120b1a5 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] [instance: 306054a8-4d0f-4913-b3b8-97aeeeec071c] End _get_guest_xml xml=<domain type="kvm">
Nov 17 01:22:10 user nova-compute[75226]:   <uuid>306054a8-4d0f-4913-b3b8-97aeeeec071c</uuid>
Nov 17 01:22:10 user nova-compute[75226]:   <name>instance-00000011</name>
Nov 17 01:22:10 user nova-compute[75226]:   <memory>524288</memory>
Nov 17 01:22:10 user nova-compute[75226]:   <vcpu>1</vcpu>
Nov 17 01:22:10 user nova-compute[75226]:   <metadata>
Nov 17 01:22:10 user nova-compute[75226]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 17 01:22:10 user nova-compute[75226]:       <nova:package version="0.0.0"/>
Nov 17 01:22:10 user nova-compute[75226]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-523828380</nova:name>
Nov 17 01:22:10 user nova-compute[75226]:       <nova:creationTime>2023-11-17 01:22:10</nova:creationTime>
Nov 17 01:22:10 user nova-compute[75226]:       <nova:flavor name="m1.tiny">
Nov 17 01:22:10 user nova-compute[75226]:         <nova:memory>512</nova:memory>
Nov 17 01:22:10 user nova-compute[75226]:         <nova:disk>1</nova:disk>
Nov 17 01:22:10 user nova-compute[75226]:         <nova:swap>0</nova:swap>
Nov 17 01:22:10 user nova-compute[75226]:         <nova:ephemeral>0</nova:ephemeral>
Nov 17 01:22:10 user nova-compute[75226]:         <nova:vcpus>1</nova:vcpus>
Nov 17 01:22:10 user nova-compute[75226]:       </nova:flavor>
Nov 17 01:22:10 user nova-compute[75226]:       <nova:owner>
Nov 17 01:22:10 user nova-compute[75226]:         <nova:user uuid="2adb9c6cd5c443a7993f6f9d09da6346">tempest-AttachVolumeShelveTestJSON-1321076871-project-member</nova:user>
Nov 17 01:22:10 user nova-compute[75226]:         <nova:project uuid="1fcdc65b510141e9b7c9a01401a97448">tempest-AttachVolumeShelveTestJSON-1321076871</nova:project>
Nov 17 01:22:10 user nova-compute[75226]:       </nova:owner>
Nov 17 01:22:10 user nova-compute[75226]:       <nova:root type="image" uuid="0b369aea-6f3f-4690-9f01-229b90ab6310"/>
Nov 17 01:22:10 user nova-compute[75226]:       <nova:ports>
Nov 17 01:22:10 user nova-compute[75226]:         <nova:port uuid="9c6d2999-f11a-4cab-828c-993cc52b996c">
Nov 17 01:22:10 user nova-compute[75226]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 17 01:22:10 user nova-compute[75226]:         </nova:port>
Nov 17 01:22:10 user nova-compute[75226]:       </nova:ports>
Nov 17 01:22:10 user nova-compute[75226]:     </nova:instance>
Nov 17 01:22:10 user nova-compute[75226]:   </metadata>
Nov 17 01:22:10 user nova-compute[75226]:   <sysinfo type="smbios">
Nov 17 01:22:10 user nova-compute[75226]:     <system>
Nov 17 01:22:10 user nova-compute[75226]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 17 01:22:10 user nova-compute[75226]:       <entry name="product">OpenStack Nova</entry>
Nov 17 01:22:10 user nova-compute[75226]:       <entry name="version">0.0.0</entry>
Nov 17 01:22:10 user nova-compute[75226]:       <entry name="serial">306054a8-4d0f-4913-b3b8-97aeeeec071c</entry>
Nov 17 01:22:10 user nova-compute[75226]:       <entry name="uuid">306054a8-4d0f-4913-b3b8-97aeeeec071c</entry>
Nov 17 01:22:10 user nova-compute[75226]:       <entry name="family">Virtual Machine</entry>
Nov 17 01:22:10 user nova-compute[75226]:     </system>
Nov 17 01:22:10 user nova-compute[75226]:   </sysinfo>
Nov 17 01:22:10 user nova-compute[75226]:   <os>
Nov 17 01:22:10 user nova-compute[75226]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 17 01:22:10 user nova-compute[75226]:     <boot dev="hd"/>
Nov 17 01:22:10 user nova-compute[75226]:     <smbios mode="sysinfo"/>
Nov 17 01:22:10 user nova-compute[75226]:   </os>
Nov 17 01:22:10 user nova-compute[75226]:   <features>
Nov 17 01:22:10 user nova-compute[75226]:     <acpi/>
Nov 17 01:22:10 user nova-compute[75226]:     <apic/>
Nov 17 01:22:10 user nova-compute[75226]:     <vmcoreinfo/>
Nov 17 01:22:10 user nova-compute[75226]:   </features>
Nov 17 01:22:10 user nova-compute[75226]:   <clock offset="utc">
Nov 17 01:22:10 user nova-compute[75226]:     <timer name="pit" tickpolicy="delay"/>
Nov 17 01:22:10 user nova-compute[75226]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 17 01:22:10 user nova-compute[75226]:     <timer name="hpet" present="no"/>
Nov 17 01:22:10 user nova-compute[75226]:   </clock>
Nov 17 01:22:10 user nova-compute[75226]:   <cpu mode="custom" match="exact">
Nov 17 01:22:10 user nova-compute[75226]:     <model>Nehalem</model>
Nov 17 01:22:10 user nova-compute[75226]:     <topology sockets="1" cores="1" threads="1"/>
Nov 17 01:22:10 user nova-compute[75226]:   </cpu>
Nov 17 01:22:10 user nova-compute[75226]:   <devices>
Nov 17 01:22:10 user nova-compute[75226]:     <disk type="file" device="disk">
Nov 17 01:22:10 user nova-compute[75226]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 17 01:22:10 user nova-compute[75226]:       <source file="/opt/stack/data/nova/instances/306054a8-4d0f-4913-b3b8-97aeeeec071c/disk"/>
Nov 17 01:22:10 user nova-compute[75226]:       <target dev="vda" bus="virtio"/>
Nov 17 01:22:10 user nova-compute[75226]:     </disk>
Nov 17 01:22:10 user nova-compute[75226]:     <interface type="ethernet">
Nov 17 01:22:10 user nova-compute[75226]:       <mac address="fa:16:3e:71:4a:e0"/>
Nov 17 01:22:10 user nova-compute[75226]:       <model type="virtio"/>
Nov 17 01:22:10 user nova-compute[75226]:       <mtu size="1442"/>
Nov 17 01:22:10 user nova-compute[75226]:       <target dev="tap9c6d2999-f1"/>
Nov 17 01:22:10 user nova-compute[75226]:     </interface>
Nov 17 01:22:10 user nova-compute[75226]:     <serial type="pty">
Nov 17 01:22:10 user nova-compute[75226]:       <log file="/opt/stack/data/nova/instances/306054a8-4d0f-4913-b3b8-97aeeeec071c/console.log" append="off"/>
Nov 17 01:22:10 user nova-compute[75226]:     </serial>
Nov 17 01:22:10 user nova-compute[75226]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 17 01:22:10 user nova-compute[75226]:     <video>
Nov 17 01:22:10 user nova-compute[75226]:       <model type="virtio"/>
Nov 17 01:22:10 user nova-compute[75226]:     </video>
Nov 17 01:22:10 user nova-compute[75226]:     <rng model="virtio">
Nov 17 01:22:10 user nova-compute[75226]:       <backend model="random">/dev/urandom</backend>
Nov 17 01:22:10 user nova-compute[75226]:     </rng>
Nov 17 01:22:10 user nova-compute[75226]:     <controller type="usb" index="0" model="none"/>
Nov 17 01:22:10 user nova-compute[75226]:     <memballoon model="virtio">
Nov 17 01:22:10 user nova-compute[75226]:       <stats period="10"/>
Nov 17 01:22:10 user nova-compute[75226]:     </memballoon>
Nov 17 01:22:10 user nova-compute[75226]:   </devices>
Nov 17 01:22:10 user nova-compute[75226]: </domain>
Nov 17 01:22:10 user nova-compute[75226]:  {{(pid=75226) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 17 01:22:10 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-e4ecd5b5-92fc-433e-9934-ac3b9120b1a5 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:22:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-523828380',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-523828380',id=17,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB8VZbi6odui0QRmSeooLxUmEz2+PJYm2i8ad1QX8czd8x79RdCiZHgEEKU0giPyPELai241fCLcP/Lw9LIxZnLDBi+bjdOFgz9iAt9ifW0YqhW6c0loV0dXybeEkqmBVQ==',key_name='tempest-keypair-1641360166',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1fcdc65b510141e9b7c9a01401a97448',ramdisk_id='',reservation_id='r-7ael85gs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1321076871',owner_user_name='tempest-AttachVolumeShelveTestJSON-1321076871-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T01:22:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2adb9c6cd5c443a7993f6f9d09da6346',uuid=306054a8-4d0f-4913-b3b8-97aeeeec071c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9c6d2999-f11a-4cab-828c-993cc52b996c", "address": "fa:16:3e:71:4a:e0", "network": {"id": "72724945-89ae-47c2-ac58-ea393837ada6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-308563626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fcdc65b510141e9b7c9a01401a97448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c6d2999-f1", "ovs_interfaceid": "9c6d2999-f11a-4cab-828c-993cc52b996c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 17 01:22:10 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-e4ecd5b5-92fc-433e-9934-ac3b9120b1a5 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Converting VIF {"id": "9c6d2999-f11a-4cab-828c-993cc52b996c", "address": "fa:16:3e:71:4a:e0", "network": {"id": "72724945-89ae-47c2-ac58-ea393837ada6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-308563626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fcdc65b510141e9b7c9a01401a97448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c6d2999-f1", "ovs_interfaceid": "9c6d2999-f11a-4cab-828c-993cc52b996c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:22:10 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-e4ecd5b5-92fc-433e-9934-ac3b9120b1a5 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:4a:e0,bridge_name='br-int',has_traffic_filtering=True,id=9c6d2999-f11a-4cab-828c-993cc52b996c,network=Network(72724945-89ae-47c2-ac58-ea393837ada6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c6d2999-f1') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:22:10 user nova-compute[75226]: DEBUG os_vif [None req-e4ecd5b5-92fc-433e-9934-ac3b9120b1a5 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:4a:e0,bridge_name='br-int',has_traffic_filtering=True,id=9c6d2999-f11a-4cab-828c-993cc52b996c,network=Network(72724945-89ae-47c2-ac58-ea393837ada6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c6d2999-f1') {{(pid=75226) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 17 01:22:10 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:22:10 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:22:10 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 17 01:22:10 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:22:10 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'de28ce65-6941-5350-ae2c-94a5a3d66e7c', '_type': 'linux-noop'}}, row=False) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:22:10 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:22:10 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:22:10 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9c6d2999-f1, may_exist=True, interface_attrs={}) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:22:10 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9c6d2999-f1, col_values=(('qos', UUID('0c335649-8039-4afc-a298-c1ee49d042a7')),), if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:22:10 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9c6d2999-f1, col_values=(('external_ids', {'iface-id': '9c6d2999-f11a-4cab-828c-993cc52b996c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:71:4a:e0', 'vm-uuid': '306054a8-4d0f-4913-b3b8-97aeeeec071c'}),), if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:22:10 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:22:10 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:22:10 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:22:10 user nova-compute[75226]: INFO os_vif [None req-e4ecd5b5-92fc-433e-9934-ac3b9120b1a5 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:4a:e0,bridge_name='br-int',has_traffic_filtering=True,id=9c6d2999-f11a-4cab-828c-993cc52b996c,network=Network(72724945-89ae-47c2-ac58-ea393837ada6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c6d2999-f1')
Nov 17 01:22:10 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-e4ecd5b5-92fc-433e-9934-ac3b9120b1a5 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] No BDM found with device name vda, not building metadata. {{(pid=75226) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 01:22:10 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-e4ecd5b5-92fc-433e-9934-ac3b9120b1a5 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] No VIF found with MAC fa:16:3e:71:4a:e0, not building metadata {{(pid=75226) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 01:22:10 user nova-compute[75226]: DEBUG nova.network.neutron [req-a487281c-6b33-485e-9bfd-bcab4a909e26 req-a0373d83-d8b4-4ac2-9358-6b08d2aea0ef service nova] [instance: 306054a8-4d0f-4913-b3b8-97aeeeec071c] Updated VIF entry in instance network info cache for port 9c6d2999-f11a-4cab-828c-993cc52b996c. {{(pid=75226) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 01:22:10 user nova-compute[75226]: DEBUG nova.network.neutron [req-a487281c-6b33-485e-9bfd-bcab4a909e26 req-a0373d83-d8b4-4ac2-9358-6b08d2aea0ef service nova] [instance: 306054a8-4d0f-4913-b3b8-97aeeeec071c] Updating instance_info_cache with network_info: [{"id": "9c6d2999-f11a-4cab-828c-993cc52b996c", "address": "fa:16:3e:71:4a:e0", "network": {"id": "72724945-89ae-47c2-ac58-ea393837ada6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-308563626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fcdc65b510141e9b7c9a01401a97448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c6d2999-f1", "ovs_interfaceid": "9c6d2999-f11a-4cab-828c-993cc52b996c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:22:10 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-a487281c-6b33-485e-9bfd-bcab4a909e26 req-a0373d83-d8b4-4ac2-9358-6b08d2aea0ef service nova] Releasing lock "refresh_cache-306054a8-4d0f-4913-b3b8-97aeeeec071c" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:22:11 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:22:11 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:22:11 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:22:11 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:22:12 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:22:12 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:22:12 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Starting heal instance info cache {{(pid=75226) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 17 01:22:12 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Didn't find any instances for network info cache update. {{(pid=75226) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 17 01:22:12 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:22:12 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:22:12 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:22:12 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:22:12 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:22:12 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:22:12 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75226) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 17 01:22:12 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:22:12 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:22:12 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:22:12 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:22:12 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75226) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 17 01:22:12 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:22:12 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:22:12 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:22:12 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:22:13 user nova-compute[75226]: DEBUG nova.compute.manager [req-a0dd6848-adcb-4098-a78d-84bda5204b68 req-0b8bd7e7-ef3e-43fe-9122-118230d390b2 service nova] [instance: 306054a8-4d0f-4913-b3b8-97aeeeec071c] Received event network-vif-plugged-9c6d2999-f11a-4cab-828c-993cc52b996c {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:22:13 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-a0dd6848-adcb-4098-a78d-84bda5204b68 req-0b8bd7e7-ef3e-43fe-9122-118230d390b2 service nova] Acquiring lock "306054a8-4d0f-4913-b3b8-97aeeeec071c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:22:13 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-a0dd6848-adcb-4098-a78d-84bda5204b68 req-0b8bd7e7-ef3e-43fe-9122-118230d390b2 service nova] Lock "306054a8-4d0f-4913-b3b8-97aeeeec071c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:22:13 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-a0dd6848-adcb-4098-a78d-84bda5204b68 req-0b8bd7e7-ef3e-43fe-9122-118230d390b2 service nova] Lock "306054a8-4d0f-4913-b3b8-97aeeeec071c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:22:13 user nova-compute[75226]: DEBUG nova.compute.manager [req-a0dd6848-adcb-4098-a78d-84bda5204b68 req-0b8bd7e7-ef3e-43fe-9122-118230d390b2 service nova] [instance: 306054a8-4d0f-4913-b3b8-97aeeeec071c] No waiting events found dispatching network-vif-plugged-9c6d2999-f11a-4cab-828c-993cc52b996c {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:22:13 user nova-compute[75226]: WARNING nova.compute.manager [req-a0dd6848-adcb-4098-a78d-84bda5204b68 req-0b8bd7e7-ef3e-43fe-9122-118230d390b2 service nova] [instance: 306054a8-4d0f-4913-b3b8-97aeeeec071c] Received unexpected event network-vif-plugged-9c6d2999-f11a-4cab-828c-993cc52b996c for instance with vm_state building and task_state spawning.
Nov 17 01:22:14 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e4ecd5b5-92fc-433e-9934-ac3b9120b1a5 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] [instance: 306054a8-4d0f-4913-b3b8-97aeeeec071c] Instance event wait completed in 0 seconds for  {{(pid=75226) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 17 01:22:14 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-e4ecd5b5-92fc-433e-9934-ac3b9120b1a5 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] [instance: 306054a8-4d0f-4913-b3b8-97aeeeec071c] Guest created on hypervisor {{(pid=75226) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 17 01:22:14 user nova-compute[75226]: INFO nova.virt.libvirt.driver [-] [instance: 306054a8-4d0f-4913-b3b8-97aeeeec071c] Instance spawned successfully.
Nov 17 01:22:14 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-e4ecd5b5-92fc-433e-9934-ac3b9120b1a5 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] [instance: 306054a8-4d0f-4913-b3b8-97aeeeec071c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 17 01:22:14 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-e4ecd5b5-92fc-433e-9934-ac3b9120b1a5 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] [instance: 306054a8-4d0f-4913-b3b8-97aeeeec071c] Found default for hw_cdrom_bus of ide {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:22:14 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-e4ecd5b5-92fc-433e-9934-ac3b9120b1a5 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] [instance: 306054a8-4d0f-4913-b3b8-97aeeeec071c] Found default for hw_disk_bus of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:22:14 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-e4ecd5b5-92fc-433e-9934-ac3b9120b1a5 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] [instance: 306054a8-4d0f-4913-b3b8-97aeeeec071c] Found default for hw_input_bus of None {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:22:14 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-e4ecd5b5-92fc-433e-9934-ac3b9120b1a5 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] [instance: 306054a8-4d0f-4913-b3b8-97aeeeec071c] Found default for hw_pointer_model of None {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:22:14 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-e4ecd5b5-92fc-433e-9934-ac3b9120b1a5 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] [instance: 306054a8-4d0f-4913-b3b8-97aeeeec071c] Found default for hw_video_model of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:22:14 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-e4ecd5b5-92fc-433e-9934-ac3b9120b1a5 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] [instance: 306054a8-4d0f-4913-b3b8-97aeeeec071c] Found default for hw_vif_model of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:22:14 user nova-compute[75226]: INFO nova.compute.manager [None req-e4ecd5b5-92fc-433e-9934-ac3b9120b1a5 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] [instance: 306054a8-4d0f-4913-b3b8-97aeeeec071c] Took 6.78 seconds to spawn the instance on the hypervisor.
Nov 17 01:22:14 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e4ecd5b5-92fc-433e-9934-ac3b9120b1a5 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] [instance: 306054a8-4d0f-4913-b3b8-97aeeeec071c] Checking state {{(pid=75226) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 01:22:14 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddfecefc-1e9b-4e6e-9995-855c8a061084/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:22:14 user nova-compute[75226]: INFO nova.compute.manager [None req-e4ecd5b5-92fc-433e-9934-ac3b9120b1a5 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] [instance: 306054a8-4d0f-4913-b3b8-97aeeeec071c] Took 7.69 seconds to build instance.
Nov 17 01:22:14 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e4ecd5b5-92fc-433e-9934-ac3b9120b1a5 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Lock "306054a8-4d0f-4913-b3b8-97aeeeec071c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.814s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:22:14 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddfecefc-1e9b-4e6e-9995-855c8a061084/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:22:14 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddfecefc-1e9b-4e6e-9995-855c8a061084/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:22:14 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddfecefc-1e9b-4e6e-9995-855c8a061084/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:22:14 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75226) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 01:22:14 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddfecefc-1e9b-4e6e-9995-855c8a061084/disk.rescue --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:22:14 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddfecefc-1e9b-4e6e-9995-855c8a061084/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:22:14 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddfecefc-1e9b-4e6e-9995-855c8a061084/disk.rescue --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:22:15 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddfecefc-1e9b-4e6e-9995-855c8a061084/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:22:15 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38062487-67ca-4962-974f-81456aebe97b/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:22:15 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38062487-67ca-4962-974f-81456aebe97b/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:22:15 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38062487-67ca-4962-974f-81456aebe97b/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:22:15 user nova-compute[75226]: DEBUG nova.compute.manager [req-2892253c-6e9f-4c7d-82b1-c62e8fc68164 req-a03aecf5-d081-45ad-9936-796427aca2c6 service nova] [instance: 306054a8-4d0f-4913-b3b8-97aeeeec071c] Received event network-vif-plugged-9c6d2999-f11a-4cab-828c-993cc52b996c {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:22:15 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-2892253c-6e9f-4c7d-82b1-c62e8fc68164 req-a03aecf5-d081-45ad-9936-796427aca2c6 service nova] Acquiring lock "306054a8-4d0f-4913-b3b8-97aeeeec071c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:22:15 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-2892253c-6e9f-4c7d-82b1-c62e8fc68164 req-a03aecf5-d081-45ad-9936-796427aca2c6 service nova] Lock "306054a8-4d0f-4913-b3b8-97aeeeec071c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:22:15 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-2892253c-6e9f-4c7d-82b1-c62e8fc68164 req-a03aecf5-d081-45ad-9936-796427aca2c6 service nova] Lock "306054a8-4d0f-4913-b3b8-97aeeeec071c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:22:15 user nova-compute[75226]: DEBUG nova.compute.manager [req-2892253c-6e9f-4c7d-82b1-c62e8fc68164 req-a03aecf5-d081-45ad-9936-796427aca2c6 service nova] [instance: 306054a8-4d0f-4913-b3b8-97aeeeec071c] No waiting events found dispatching network-vif-plugged-9c6d2999-f11a-4cab-828c-993cc52b996c {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:22:15 user nova-compute[75226]: WARNING nova.compute.manager [req-2892253c-6e9f-4c7d-82b1-c62e8fc68164 req-a03aecf5-d081-45ad-9936-796427aca2c6 service nova] [instance: 306054a8-4d0f-4913-b3b8-97aeeeec071c] Received unexpected event network-vif-plugged-9c6d2999-f11a-4cab-828c-993cc52b996c for instance with vm_state active and task_state None.
Nov 17 01:22:15 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38062487-67ca-4962-974f-81456aebe97b/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:22:15 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa84e575-bdad-45b9-80ce-86b1c2826fb0/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:22:15 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:22:15 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa84e575-bdad-45b9-80ce-86b1c2826fb0/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:22:15 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa84e575-bdad-45b9-80ce-86b1c2826fb0/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:22:15 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa84e575-bdad-45b9-80ce-86b1c2826fb0/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:22:15 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fbdd8af-f608-4d73-92d9-ae0586814c1b/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:22:16 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fbdd8af-f608-4d73-92d9-ae0586814c1b/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:22:16 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fbdd8af-f608-4d73-92d9-ae0586814c1b/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:22:16 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fbdd8af-f608-4d73-92d9-ae0586814c1b/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:22:16 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/306054a8-4d0f-4913-b3b8-97aeeeec071c/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:22:16 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-2cb7b5a0-0f89-46fd-962f-e766602b8060 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Acquiring lock "094ccd9a-bf3e-49d2-be76-34e2ce2b19e3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:22:16 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-2cb7b5a0-0f89-46fd-962f-e766602b8060 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Lock "094ccd9a-bf3e-49d2-be76-34e2ce2b19e3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:22:16 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-2cb7b5a0-0f89-46fd-962f-e766602b8060 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Acquiring lock "094ccd9a-bf3e-49d2-be76-34e2ce2b19e3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:22:16 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-2cb7b5a0-0f89-46fd-962f-e766602b8060 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Lock "094ccd9a-bf3e-49d2-be76-34e2ce2b19e3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:22:16 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-2cb7b5a0-0f89-46fd-962f-e766602b8060 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Lock "094ccd9a-bf3e-49d2-be76-34e2ce2b19e3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:22:16 user nova-compute[75226]: INFO nova.compute.manager [None req-2cb7b5a0-0f89-46fd-962f-e766602b8060 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] [instance: 094ccd9a-bf3e-49d2-be76-34e2ce2b19e3] Terminating instance
Nov 17 01:22:16 user nova-compute[75226]: DEBUG nova.compute.manager [None req-2cb7b5a0-0f89-46fd-962f-e766602b8060 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] [instance: 094ccd9a-bf3e-49d2-be76-34e2ce2b19e3] Start destroying the instance on the hypervisor. {{(pid=75226) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 17 01:22:16 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/306054a8-4d0f-4913-b3b8-97aeeeec071c/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:22:16 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/306054a8-4d0f-4913-b3b8-97aeeeec071c/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:22:16 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:22:16 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/306054a8-4d0f-4913-b3b8-97aeeeec071c/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:22:16 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:22:16 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:22:16 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:22:17 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:22:17 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:22:17 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:22:17 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/724b81dd-4531-4c99-850d-0bfcbfdf7bd4/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:22:17 user nova-compute[75226]: INFO nova.virt.libvirt.driver [-] [instance: 094ccd9a-bf3e-49d2-be76-34e2ce2b19e3] Instance destroyed successfully.
Nov 17 01:22:17 user nova-compute[75226]: DEBUG nova.objects.instance [None req-2cb7b5a0-0f89-46fd-962f-e766602b8060 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Lazy-loading 'resources' on Instance uuid 094ccd9a-bf3e-49d2-be76-34e2ce2b19e3 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:22:17 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-2cb7b5a0-0f89-46fd-962f-e766602b8060 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:20:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1278666806',display_name='tempest-VolumesAdminNegativeTest-server-1278666806',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1278666806',id=12,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-17T01:20:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8a364d502d8948ff8b255dd2531b6218',ramdisk_id='',reservation_id='r-jzm0k0y1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-2120834708',owner_user_name='tempest-VolumesAdminNegativeTest-2120834708-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T01:20:26Z,user_data=None,user_id='5f6fd5dfdd9a4a36b6965ffab1b7c1e4',uuid=094ccd9a-bf3e-49d2-be76-34e2ce2b19e3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2ec14695-ebb4-4854-a2d9-6f9160f5adfc", "address": "fa:16:3e:b4:0c:cf", "network": {"id": "1c1e8b70-ab07-4bf6-896b-f8779c33ac07", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1634201097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a364d502d8948ff8b255dd2531b6218", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ec14695-eb", "ovs_interfaceid": "2ec14695-ebb4-4854-a2d9-6f9160f5adfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 17 01:22:17 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-2cb7b5a0-0f89-46fd-962f-e766602b8060 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Converting VIF {"id": "2ec14695-ebb4-4854-a2d9-6f9160f5adfc", "address": "fa:16:3e:b4:0c:cf", "network": {"id": "1c1e8b70-ab07-4bf6-896b-f8779c33ac07", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1634201097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a364d502d8948ff8b255dd2531b6218", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ec14695-eb", "ovs_interfaceid": "2ec14695-ebb4-4854-a2d9-6f9160f5adfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:22:17 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-2cb7b5a0-0f89-46fd-962f-e766602b8060 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:0c:cf,bridge_name='br-int',has_traffic_filtering=True,id=2ec14695-ebb4-4854-a2d9-6f9160f5adfc,network=Network(1c1e8b70-ab07-4bf6-896b-f8779c33ac07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ec14695-eb') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:22:17 user nova-compute[75226]: DEBUG os_vif [None req-2cb7b5a0-0f89-46fd-962f-e766602b8060 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:0c:cf,bridge_name='br-int',has_traffic_filtering=True,id=2ec14695-ebb4-4854-a2d9-6f9160f5adfc,network=Network(1c1e8b70-ab07-4bf6-896b-f8779c33ac07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ec14695-eb') {{(pid=75226) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 17 01:22:17 user nova-compute[75226]: DEBUG nova.compute.manager [req-a6213417-6075-46d0-801f-e4ff1b5b14dc req-63ae934d-fb2a-4429-b3e9-646c7c3f31ac service nova] [instance: 094ccd9a-bf3e-49d2-be76-34e2ce2b19e3] Received event network-vif-unplugged-2ec14695-ebb4-4854-a2d9-6f9160f5adfc {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:22:17 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-a6213417-6075-46d0-801f-e4ff1b5b14dc req-63ae934d-fb2a-4429-b3e9-646c7c3f31ac service nova] Acquiring lock "094ccd9a-bf3e-49d2-be76-34e2ce2b19e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:22:17 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-a6213417-6075-46d0-801f-e4ff1b5b14dc req-63ae934d-fb2a-4429-b3e9-646c7c3f31ac service nova] Lock "094ccd9a-bf3e-49d2-be76-34e2ce2b19e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:22:17 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-a6213417-6075-46d0-801f-e4ff1b5b14dc req-63ae934d-fb2a-4429-b3e9-646c7c3f31ac service nova] Lock "094ccd9a-bf3e-49d2-be76-34e2ce2b19e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:22:17 user nova-compute[75226]: DEBUG nova.compute.manager [req-a6213417-6075-46d0-801f-e4ff1b5b14dc req-63ae934d-fb2a-4429-b3e9-646c7c3f31ac service nova] [instance: 094ccd9a-bf3e-49d2-be76-34e2ce2b19e3] No waiting events found dispatching network-vif-unplugged-2ec14695-ebb4-4854-a2d9-6f9160f5adfc {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:22:17 user nova-compute[75226]: DEBUG nova.compute.manager [req-a6213417-6075-46d0-801f-e4ff1b5b14dc req-63ae934d-fb2a-4429-b3e9-646c7c3f31ac service nova] [instance: 094ccd9a-bf3e-49d2-be76-34e2ce2b19e3] Received event network-vif-unplugged-2ec14695-ebb4-4854-a2d9-6f9160f5adfc for instance with task_state deleting. {{(pid=75226) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 17 01:22:17 user nova-compute[75226]: DEBUG nova.compute.manager [req-a6213417-6075-46d0-801f-e4ff1b5b14dc req-63ae934d-fb2a-4429-b3e9-646c7c3f31ac service nova] [instance: 094ccd9a-bf3e-49d2-be76-34e2ce2b19e3] Received event network-vif-plugged-2ec14695-ebb4-4854-a2d9-6f9160f5adfc {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:22:17 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-a6213417-6075-46d0-801f-e4ff1b5b14dc req-63ae934d-fb2a-4429-b3e9-646c7c3f31ac service nova] Acquiring lock "094ccd9a-bf3e-49d2-be76-34e2ce2b19e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:22:17 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-a6213417-6075-46d0-801f-e4ff1b5b14dc req-63ae934d-fb2a-4429-b3e9-646c7c3f31ac service nova] Lock "094ccd9a-bf3e-49d2-be76-34e2ce2b19e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:22:17 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-a6213417-6075-46d0-801f-e4ff1b5b14dc req-63ae934d-fb2a-4429-b3e9-646c7c3f31ac service nova] Lock "094ccd9a-bf3e-49d2-be76-34e2ce2b19e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:22:17 user nova-compute[75226]: DEBUG nova.compute.manager [req-a6213417-6075-46d0-801f-e4ff1b5b14dc req-63ae934d-fb2a-4429-b3e9-646c7c3f31ac service nova] [instance: 094ccd9a-bf3e-49d2-be76-34e2ce2b19e3] No waiting events found dispatching network-vif-plugged-2ec14695-ebb4-4854-a2d9-6f9160f5adfc {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:22:17 user nova-compute[75226]: WARNING nova.compute.manager [req-a6213417-6075-46d0-801f-e4ff1b5b14dc req-63ae934d-fb2a-4429-b3e9-646c7c3f31ac service nova] [instance: 094ccd9a-bf3e-49d2-be76-34e2ce2b19e3] Received unexpected event network-vif-plugged-2ec14695-ebb4-4854-a2d9-6f9160f5adfc for instance with vm_state active and task_state deleting.
Nov 17 01:22:17 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:22:17 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2ec14695-eb, bridge=br-int, if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:22:17 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:22:17 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:22:17 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2c71768f-fc73-4f26-91db-026ed8334bef) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:22:17 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:22:17 user nova-compute[75226]: INFO os_vif [None req-2cb7b5a0-0f89-46fd-962f-e766602b8060 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:0c:cf,bridge_name='br-int',has_traffic_filtering=True,id=2ec14695-ebb4-4854-a2d9-6f9160f5adfc,network=Network(1c1e8b70-ab07-4bf6-896b-f8779c33ac07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ec14695-eb')
Nov 17 01:22:17 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-2cb7b5a0-0f89-46fd-962f-e766602b8060 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] [instance: 094ccd9a-bf3e-49d2-be76-34e2ce2b19e3] Deleting instance files /opt/stack/data/nova/instances/094ccd9a-bf3e-49d2-be76-34e2ce2b19e3_del
Nov 17 01:22:17 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-2cb7b5a0-0f89-46fd-962f-e766602b8060 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] [instance: 094ccd9a-bf3e-49d2-be76-34e2ce2b19e3] Deletion of /opt/stack/data/nova/instances/094ccd9a-bf3e-49d2-be76-34e2ce2b19e3_del complete
Nov 17 01:22:17 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/724b81dd-4531-4c99-850d-0bfcbfdf7bd4/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:22:17 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/724b81dd-4531-4c99-850d-0bfcbfdf7bd4/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:22:17 user nova-compute[75226]: INFO nova.compute.manager [None req-2cb7b5a0-0f89-46fd-962f-e766602b8060 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] [instance: 094ccd9a-bf3e-49d2-be76-34e2ce2b19e3] Took 1.01 seconds to destroy the instance on the hypervisor.
Nov 17 01:22:17 user nova-compute[75226]: DEBUG oslo.service.loopingcall [None req-2cb7b5a0-0f89-46fd-962f-e766602b8060 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75226) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 17 01:22:17 user nova-compute[75226]: DEBUG nova.compute.manager [-] [instance: 094ccd9a-bf3e-49d2-be76-34e2ce2b19e3] Deallocating network for instance {{(pid=75226) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 17 01:22:17 user nova-compute[75226]: DEBUG nova.network.neutron [-] [instance: 094ccd9a-bf3e-49d2-be76-34e2ce2b19e3] deallocate_for_instance() {{(pid=75226) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 17 01:22:17 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:22:17 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/724b81dd-4531-4c99-850d-0bfcbfdf7bd4/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:22:17 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Error from libvirt while getting description of instance-0000000c: [Error Code 42] Domain not found: no domain with matching uuid '094ccd9a-bf3e-49d2-be76-34e2ce2b19e3' (instance-0000000c): libvirt.libvirtError: Domain not found: no domain with matching uuid '094ccd9a-bf3e-49d2-be76-34e2ce2b19e3' (instance-0000000c)
Nov 17 01:22:17 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75226) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 01:22:17 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b7e9611-be35-4e51-b886-91a2fac0a653/disk.rescue --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:22:17 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b7e9611-be35-4e51-b886-91a2fac0a653/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:22:17 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b7e9611-be35-4e51-b886-91a2fac0a653/disk.rescue --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:22:18 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b7e9611-be35-4e51-b886-91a2fac0a653/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:22:18 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52fe0a91-9320-47d2-ac83-4f49260a0997/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:22:18 user nova-compute[75226]: DEBUG nova.network.neutron [-] [instance: 094ccd9a-bf3e-49d2-be76-34e2ce2b19e3] Updating instance_info_cache with network_info: [] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:22:18 user nova-compute[75226]: INFO nova.compute.manager [-] [instance: 094ccd9a-bf3e-49d2-be76-34e2ce2b19e3] Took 0.63 seconds to deallocate network for instance.
Nov 17 01:22:18 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-2cb7b5a0-0f89-46fd-962f-e766602b8060 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:22:18 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-2cb7b5a0-0f89-46fd-962f-e766602b8060 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:22:18 user nova-compute[75226]: DEBUG nova.compute.manager [req-5c130f47-2603-4fed-95f9-00ec5dfeedce req-9ee68333-7133-44e5-9ba3-344ae9900ccf service nova] [instance: 094ccd9a-bf3e-49d2-be76-34e2ce2b19e3] Received event network-vif-deleted-2ec14695-ebb4-4854-a2d9-6f9160f5adfc {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:22:18 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52fe0a91-9320-47d2-ac83-4f49260a0997/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:22:18 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52fe0a91-9320-47d2-ac83-4f49260a0997/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:22:18 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52fe0a91-9320-47d2-ac83-4f49260a0997/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:22:19 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:22:19 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:22:19 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Hypervisor/Node resource view: name=user free_ram=7618MB free_disk=25.103515625GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75226) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 17 01:22:19 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:22:19 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-2cb7b5a0-0f89-46fd-962f-e766602b8060 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:22:19 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-2cb7b5a0-0f89-46fd-962f-e766602b8060 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:22:19 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-2cb7b5a0-0f89-46fd-962f-e766602b8060 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.885s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:22:19 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.112s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:22:19 user nova-compute[75226]: INFO nova.scheduler.client.report [None req-2cb7b5a0-0f89-46fd-962f-e766602b8060 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Deleted allocations for instance 094ccd9a-bf3e-49d2-be76-34e2ce2b19e3
Nov 17 01:22:19 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-2cb7b5a0-0f89-46fd-962f-e766602b8060 tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Lock "094ccd9a-bf3e-49d2-be76-34e2ce2b19e3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.760s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:22:19 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance aa84e575-bdad-45b9-80ce-86b1c2826fb0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:22:19 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance ddfecefc-1e9b-4e6e-9995-855c8a061084 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:22:19 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 724b81dd-4531-4c99-850d-0bfcbfdf7bd4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:22:19 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 6b7e9611-be35-4e51-b886-91a2fac0a653 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:22:19 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 52fe0a91-9320-47d2-ac83-4f49260a0997 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:22:19 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:22:19 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 2fbdd8af-f608-4d73-92d9-ae0586814c1b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:22:19 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 38062487-67ca-4962-974f-81456aebe97b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:22:19 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 306054a8-4d0f-4913-b3b8-97aeeeec071c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:22:19 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75226) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 17 01:22:19 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75226) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 17 01:22:19 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:22:19 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:22:19 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:22:19 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Compute_service record updated for user:user {{(pid=75226) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 17 01:22:19 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.540s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:22:22 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:22:22 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:22:27 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Acquiring lock "663933b0-95dc-4fba-b411-029f0552571d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:22:27 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Lock "663933b0-95dc-4fba-b411-029f0552571d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:22:27 user nova-compute[75226]: DEBUG nova.compute.manager [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Starting instance... {{(pid=75226) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 17 01:22:27 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:22:27 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:22:27 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75226) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 17 01:22:27 user nova-compute[75226]: INFO nova.compute.claims [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Claim successful on node user
Nov 17 01:22:27 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:22:27 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:22:27 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:22:27 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.474s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:22:27 user nova-compute[75226]: DEBUG nova.compute.manager [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Start building networks asynchronously for instance. {{(pid=75226) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 17 01:22:27 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:22:27 user nova-compute[75226]: DEBUG nova.compute.manager [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Allocating IP information in the background. {{(pid=75226) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 17 01:22:27 user nova-compute[75226]: DEBUG nova.network.neutron [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] [instance: 663933b0-95dc-4fba-b411-029f0552571d] allocate_for_instance() {{(pid=75226) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 17 01:22:27 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 17 01:22:27 user nova-compute[75226]: DEBUG nova.compute.manager [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Start building block device mappings for instance. {{(pid=75226) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 17 01:22:27 user nova-compute[75226]: INFO nova.virt.block_device [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Booting with volume 928c93b5-ae63-4e04-94ce-6059e7eaa7d6 at /dev/vda
Nov 17 01:22:27 user nova-compute[75226]: DEBUG nova.policy [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '85f6f2dd0ff44b33874cde7e2e36482c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fce4eef0d24de0a320670623085bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75226) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 17 01:22:27 user nova-compute[75226]: DEBUG os_brick.utils [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:22:27 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:22:27 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:22:27 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f68a272-a8d8-407d-b406-dfaf7b7fe281]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f62857db69\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:22:27 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:22:27 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:22:27 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[3427fc6b-caa2-4279-8254-84a25edb6ae0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:22:27 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:22:27 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:22:27 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[621bdd39-cdcf-4233-bfe9-9e90b1209bed]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:22:27 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e3c7259-d2f7-436c-aefe-fdeae6c3b674]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:22:27 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Running cmd (subprocess): nvme version {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:22:28 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] 'nvme version' failed. Not Retrying. {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 01:22:28 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] nvme not present on system {{(pid=75226) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 17 01:22:28 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:22:28 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 01:22:28 user nova-compute[75226]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 17 01:22:28 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[ada4f78d-15ec-4d44-b115-d786816c4d98]: (4, '') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:22:28 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75226) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 17 01:22:28 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75226) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 17 01:22:28 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] LIGHTOS: no hostnqn found. {{(pid=75226) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 17 01:22:28 user nova-compute[75226]: DEBUG os_brick.utils [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f62857db69', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:22:28 user nova-compute[75226]: DEBUG nova.virt.block_device [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Updating existing volume attachment record: ed882383-ebd5-4387-89c3-824c50c45e85 {{(pid=75226) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 17 01:22:28 user nova-compute[75226]: DEBUG nova.network.neutron [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Successfully created port: 462b7d76-b8d0-4374-8b29-da083c4ec28f {{(pid=75226) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 17 01:22:29 user nova-compute[75226]: DEBUG nova.network.neutron [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Successfully created port: 46134046-ef40-4332-aa3f-044beaf6f991 {{(pid=75226) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 17 01:22:29 user nova-compute[75226]: DEBUG nova.network.neutron [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Successfully created port: 24888c49-a7a9-4f44-8f95-1174dba77750 {{(pid=75226) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 17 01:22:30 user nova-compute[75226]: DEBUG nova.network.neutron [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Successfully created port: 5f7ca871-040f-460c-8709-7ca74ca282ba {{(pid=75226) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 17 01:22:30 user nova-compute[75226]: DEBUG nova.network.neutron [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Successfully created port: 153c3e02-4aa9-4b9f-b03d-229f12e2ed68 {{(pid=75226) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 17 01:22:31 user nova-compute[75226]: DEBUG nova.network.neutron [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Successfully updated port: 462b7d76-b8d0-4374-8b29-da083c4ec28f {{(pid=75226) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 17 01:22:31 user nova-compute[75226]: DEBUG nova.compute.manager [req-e2519dbc-af11-4373-923a-ba8e8cec1eca req-0a449016-135e-4a71-9248-7a972983ad5d service nova] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Received event network-changed-462b7d76-b8d0-4374-8b29-da083c4ec28f {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:22:31 user nova-compute[75226]: DEBUG nova.compute.manager [req-e2519dbc-af11-4373-923a-ba8e8cec1eca req-0a449016-135e-4a71-9248-7a972983ad5d service nova] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Refreshing instance network info cache due to event network-changed-462b7d76-b8d0-4374-8b29-da083c4ec28f. {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 01:22:31 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-e2519dbc-af11-4373-923a-ba8e8cec1eca req-0a449016-135e-4a71-9248-7a972983ad5d service nova] Acquiring lock "refresh_cache-663933b0-95dc-4fba-b411-029f0552571d" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:22:31 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-e2519dbc-af11-4373-923a-ba8e8cec1eca req-0a449016-135e-4a71-9248-7a972983ad5d service nova] Acquired lock "refresh_cache-663933b0-95dc-4fba-b411-029f0552571d" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:22:31 user nova-compute[75226]: DEBUG nova.network.neutron [req-e2519dbc-af11-4373-923a-ba8e8cec1eca req-0a449016-135e-4a71-9248-7a972983ad5d service nova] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Refreshing network info cache for port 462b7d76-b8d0-4374-8b29-da083c4ec28f {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 01:22:31 user nova-compute[75226]: DEBUG nova.network.neutron [req-e2519dbc-af11-4373-923a-ba8e8cec1eca req-0a449016-135e-4a71-9248-7a972983ad5d service nova] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Instance cache missing network info. {{(pid=75226) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 17 01:22:31 user nova-compute[75226]: DEBUG nova.network.neutron [req-e2519dbc-af11-4373-923a-ba8e8cec1eca req-0a449016-135e-4a71-9248-7a972983ad5d service nova] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Updating instance_info_cache with network_info: [] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:22:31 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-e2519dbc-af11-4373-923a-ba8e8cec1eca req-0a449016-135e-4a71-9248-7a972983ad5d service nova] Releasing lock "refresh_cache-663933b0-95dc-4fba-b411-029f0552571d" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:22:31 user nova-compute[75226]: DEBUG nova.network.neutron [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Successfully updated port: 6bcf1322-1aad-4ffa-9231-7273376e4572 {{(pid=75226) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 17 01:22:32 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:22:32 user nova-compute[75226]: DEBUG nova.network.neutron [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Successfully updated port: fbacd963-6a62-4682-89a2-27f92a9f0ff2 {{(pid=75226) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 17 01:22:32 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:22:33 user nova-compute[75226]: DEBUG nova.network.neutron [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Successfully updated port: 46134046-ef40-4332-aa3f-044beaf6f991 {{(pid=75226) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 17 01:22:33 user nova-compute[75226]: DEBUG nova.compute.manager [req-3fd4d39b-da3f-497d-92c2-4cca57e0e0db req-a28739f0-e24b-436f-8111-6e01fdf37a7d service nova] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Received event network-changed-6bcf1322-1aad-4ffa-9231-7273376e4572 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:22:33 user nova-compute[75226]: DEBUG nova.compute.manager [req-3fd4d39b-da3f-497d-92c2-4cca57e0e0db req-a28739f0-e24b-436f-8111-6e01fdf37a7d service nova] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Refreshing instance network info cache due to event network-changed-6bcf1322-1aad-4ffa-9231-7273376e4572. {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 01:22:33 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-3fd4d39b-da3f-497d-92c2-4cca57e0e0db req-a28739f0-e24b-436f-8111-6e01fdf37a7d service nova] Acquiring lock "refresh_cache-663933b0-95dc-4fba-b411-029f0552571d" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:22:33 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-3fd4d39b-da3f-497d-92c2-4cca57e0e0db req-a28739f0-e24b-436f-8111-6e01fdf37a7d service nova] Acquired lock "refresh_cache-663933b0-95dc-4fba-b411-029f0552571d" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:22:33 user nova-compute[75226]: DEBUG nova.network.neutron [req-3fd4d39b-da3f-497d-92c2-4cca57e0e0db req-a28739f0-e24b-436f-8111-6e01fdf37a7d service nova] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Refreshing network info cache for port 6bcf1322-1aad-4ffa-9231-7273376e4572 {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 01:22:33 user nova-compute[75226]: DEBUG nova.network.neutron [req-3fd4d39b-da3f-497d-92c2-4cca57e0e0db req-a28739f0-e24b-436f-8111-6e01fdf37a7d service nova] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Instance cache missing network info. {{(pid=75226) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 17 01:22:33 user nova-compute[75226]: DEBUG nova.network.neutron [req-3fd4d39b-da3f-497d-92c2-4cca57e0e0db req-a28739f0-e24b-436f-8111-6e01fdf37a7d service nova] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Updating instance_info_cache with network_info: [] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:22:33 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-3fd4d39b-da3f-497d-92c2-4cca57e0e0db req-a28739f0-e24b-436f-8111-6e01fdf37a7d service nova] Releasing lock "refresh_cache-663933b0-95dc-4fba-b411-029f0552571d" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:22:33 user nova-compute[75226]: DEBUG nova.compute.manager [req-3fd4d39b-da3f-497d-92c2-4cca57e0e0db req-a28739f0-e24b-436f-8111-6e01fdf37a7d service nova] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Received event network-changed-fbacd963-6a62-4682-89a2-27f92a9f0ff2 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:22:33 user nova-compute[75226]: DEBUG nova.compute.manager [req-3fd4d39b-da3f-497d-92c2-4cca57e0e0db req-a28739f0-e24b-436f-8111-6e01fdf37a7d service nova] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Refreshing instance network info cache due to event network-changed-fbacd963-6a62-4682-89a2-27f92a9f0ff2. {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 01:22:33 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-3fd4d39b-da3f-497d-92c2-4cca57e0e0db req-a28739f0-e24b-436f-8111-6e01fdf37a7d service nova] Acquiring lock "refresh_cache-663933b0-95dc-4fba-b411-029f0552571d" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:22:33 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-3fd4d39b-da3f-497d-92c2-4cca57e0e0db req-a28739f0-e24b-436f-8111-6e01fdf37a7d service nova] Acquired lock "refresh_cache-663933b0-95dc-4fba-b411-029f0552571d" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:22:33 user nova-compute[75226]: DEBUG nova.network.neutron [req-3fd4d39b-da3f-497d-92c2-4cca57e0e0db req-a28739f0-e24b-436f-8111-6e01fdf37a7d service nova] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Refreshing network info cache for port fbacd963-6a62-4682-89a2-27f92a9f0ff2 {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 01:22:33 user nova-compute[75226]: DEBUG nova.network.neutron [req-3fd4d39b-da3f-497d-92c2-4cca57e0e0db req-a28739f0-e24b-436f-8111-6e01fdf37a7d service nova] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Instance cache missing network info. {{(pid=75226) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 17 01:22:33 user nova-compute[75226]: DEBUG nova.network.neutron [req-3fd4d39b-da3f-497d-92c2-4cca57e0e0db req-a28739f0-e24b-436f-8111-6e01fdf37a7d service nova] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Updating instance_info_cache with network_info: [] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:22:34 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-3fd4d39b-da3f-497d-92c2-4cca57e0e0db req-a28739f0-e24b-436f-8111-6e01fdf37a7d service nova] Releasing lock "refresh_cache-663933b0-95dc-4fba-b411-029f0552571d" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:22:34 user nova-compute[75226]: DEBUG nova.compute.manager [req-3fd4d39b-da3f-497d-92c2-4cca57e0e0db req-a28739f0-e24b-436f-8111-6e01fdf37a7d service nova] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Received event network-changed-46134046-ef40-4332-aa3f-044beaf6f991 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:22:34 user nova-compute[75226]: DEBUG nova.compute.manager [req-3fd4d39b-da3f-497d-92c2-4cca57e0e0db req-a28739f0-e24b-436f-8111-6e01fdf37a7d service nova] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Refreshing instance network info cache due to event network-changed-46134046-ef40-4332-aa3f-044beaf6f991. {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 01:22:34 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-3fd4d39b-da3f-497d-92c2-4cca57e0e0db req-a28739f0-e24b-436f-8111-6e01fdf37a7d service nova] Acquiring lock "refresh_cache-663933b0-95dc-4fba-b411-029f0552571d" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:22:34 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-3fd4d39b-da3f-497d-92c2-4cca57e0e0db req-a28739f0-e24b-436f-8111-6e01fdf37a7d service nova] Acquired lock "refresh_cache-663933b0-95dc-4fba-b411-029f0552571d" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:22:34 user nova-compute[75226]: DEBUG nova.network.neutron [req-3fd4d39b-da3f-497d-92c2-4cca57e0e0db req-a28739f0-e24b-436f-8111-6e01fdf37a7d service nova] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Refreshing network info cache for port 46134046-ef40-4332-aa3f-044beaf6f991 {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 01:22:34 user nova-compute[75226]: DEBUG nova.network.neutron [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Successfully updated port: 24888c49-a7a9-4f44-8f95-1174dba77750 {{(pid=75226) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 17 01:22:34 user nova-compute[75226]: DEBUG nova.network.neutron [req-3fd4d39b-da3f-497d-92c2-4cca57e0e0db req-a28739f0-e24b-436f-8111-6e01fdf37a7d service nova] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Instance cache missing network info. {{(pid=75226) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 17 01:22:34 user nova-compute[75226]: DEBUG nova.network.neutron [req-3fd4d39b-da3f-497d-92c2-4cca57e0e0db req-a28739f0-e24b-436f-8111-6e01fdf37a7d service nova] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Updating instance_info_cache with network_info: [] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:22:34 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-3fd4d39b-da3f-497d-92c2-4cca57e0e0db req-a28739f0-e24b-436f-8111-6e01fdf37a7d service nova] Releasing lock "refresh_cache-663933b0-95dc-4fba-b411-029f0552571d" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:22:35 user nova-compute[75226]: DEBUG nova.network.neutron [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Successfully updated port: 5f7ca871-040f-460c-8709-7ca74ca282ba {{(pid=75226) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 17 01:22:35 user nova-compute[75226]: DEBUG nova.compute.manager [req-60af8c74-c53d-4071-9998-7d8a9d4f80dd req-041dad88-6a3c-4d94-b7f1-57ebd233b6df service nova] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Received event network-changed-24888c49-a7a9-4f44-8f95-1174dba77750 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:22:35 user nova-compute[75226]: DEBUG nova.compute.manager [req-60af8c74-c53d-4071-9998-7d8a9d4f80dd req-041dad88-6a3c-4d94-b7f1-57ebd233b6df service nova] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Refreshing instance network info cache due to event network-changed-24888c49-a7a9-4f44-8f95-1174dba77750. {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 01:22:35 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-60af8c74-c53d-4071-9998-7d8a9d4f80dd req-041dad88-6a3c-4d94-b7f1-57ebd233b6df service nova] Acquiring lock "refresh_cache-663933b0-95dc-4fba-b411-029f0552571d" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:22:35 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-60af8c74-c53d-4071-9998-7d8a9d4f80dd req-041dad88-6a3c-4d94-b7f1-57ebd233b6df service nova] Acquired lock "refresh_cache-663933b0-95dc-4fba-b411-029f0552571d" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:22:35 user nova-compute[75226]: DEBUG nova.network.neutron [req-60af8c74-c53d-4071-9998-7d8a9d4f80dd req-041dad88-6a3c-4d94-b7f1-57ebd233b6df service nova] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Refreshing network info cache for port 24888c49-a7a9-4f44-8f95-1174dba77750 {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 01:22:35 user nova-compute[75226]: DEBUG nova.network.neutron [req-60af8c74-c53d-4071-9998-7d8a9d4f80dd req-041dad88-6a3c-4d94-b7f1-57ebd233b6df service nova] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Instance cache missing network info. {{(pid=75226) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 17 01:22:35 user nova-compute[75226]: DEBUG nova.network.neutron [req-60af8c74-c53d-4071-9998-7d8a9d4f80dd req-041dad88-6a3c-4d94-b7f1-57ebd233b6df service nova] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Updating instance_info_cache with network_info: [] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:22:35 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-60af8c74-c53d-4071-9998-7d8a9d4f80dd req-041dad88-6a3c-4d94-b7f1-57ebd233b6df service nova] Releasing lock "refresh_cache-663933b0-95dc-4fba-b411-029f0552571d" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:22:35 user nova-compute[75226]: DEBUG nova.compute.manager [req-60af8c74-c53d-4071-9998-7d8a9d4f80dd req-041dad88-6a3c-4d94-b7f1-57ebd233b6df service nova] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Received event network-changed-5f7ca871-040f-460c-8709-7ca74ca282ba {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:22:35 user nova-compute[75226]: DEBUG nova.compute.manager [req-60af8c74-c53d-4071-9998-7d8a9d4f80dd req-041dad88-6a3c-4d94-b7f1-57ebd233b6df service nova] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Refreshing instance network info cache due to event network-changed-5f7ca871-040f-460c-8709-7ca74ca282ba. {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 01:22:35 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-60af8c74-c53d-4071-9998-7d8a9d4f80dd req-041dad88-6a3c-4d94-b7f1-57ebd233b6df service nova] Acquiring lock "refresh_cache-663933b0-95dc-4fba-b411-029f0552571d" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:22:35 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-60af8c74-c53d-4071-9998-7d8a9d4f80dd req-041dad88-6a3c-4d94-b7f1-57ebd233b6df service nova] Acquired lock "refresh_cache-663933b0-95dc-4fba-b411-029f0552571d" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:22:35 user nova-compute[75226]: DEBUG nova.network.neutron [req-60af8c74-c53d-4071-9998-7d8a9d4f80dd req-041dad88-6a3c-4d94-b7f1-57ebd233b6df service nova] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Refreshing network info cache for port 5f7ca871-040f-460c-8709-7ca74ca282ba {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 01:22:35 user nova-compute[75226]: DEBUG nova.network.neutron [req-60af8c74-c53d-4071-9998-7d8a9d4f80dd req-041dad88-6a3c-4d94-b7f1-57ebd233b6df service nova] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Instance cache missing network info. {{(pid=75226) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 17 01:22:36 user nova-compute[75226]: DEBUG nova.network.neutron [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Successfully updated port: 153c3e02-4aa9-4b9f-b03d-229f12e2ed68 {{(pid=75226) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 17 01:22:36 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Acquiring lock "refresh_cache-663933b0-95dc-4fba-b411-029f0552571d" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:22:36 user nova-compute[75226]: DEBUG nova.network.neutron [req-60af8c74-c53d-4071-9998-7d8a9d4f80dd req-041dad88-6a3c-4d94-b7f1-57ebd233b6df service nova] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Updating instance_info_cache with network_info: [] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:22:36 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-60af8c74-c53d-4071-9998-7d8a9d4f80dd req-041dad88-6a3c-4d94-b7f1-57ebd233b6df service nova] Releasing lock "refresh_cache-663933b0-95dc-4fba-b411-029f0552571d" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:22:36 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Acquired lock "refresh_cache-663933b0-95dc-4fba-b411-029f0552571d" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:22:36 user nova-compute[75226]: DEBUG nova.network.neutron [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Building network info cache for instance {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 01:22:36 user nova-compute[75226]: DEBUG nova.network.neutron [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Instance cache missing network info. {{(pid=75226) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 17 01:22:36 user nova-compute[75226]: INFO nova.virt.block_device [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Booting with volume 607b7fb8-097d-43ea-b13c-0825e015e14e at /dev/vdb
Nov 17 01:22:36 user nova-compute[75226]: DEBUG os_brick.utils [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:22:36 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:22:36 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:22:36 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[e510e8a8-9d50-4414-92b4-f46f58579adb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f62857db69\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:22:36 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:22:36 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:22:36 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[0051ee7e-9d5f-4a3a-9533-99fa649c5533]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:22:36 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:22:36 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:22:36 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a16f223-db40-4786-a485-4d387229e6b8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:22:36 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a03eb6b-f8d7-41f7-9d42-5787664626eb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:22:36 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Running cmd (subprocess): nvme version {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:22:36 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] 'nvme version' failed. Not Retrying. {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 01:22:36 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] nvme not present on system {{(pid=75226) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 17 01:22:36 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:22:36 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 01:22:36 user nova-compute[75226]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 17 01:22:36 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ed6d147-d9a2-440d-b14d-f5daab71cc2e]: (4, '') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:22:36 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75226) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 17 01:22:36 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75226) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 17 01:22:36 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] LIGHTOS: no hostnqn found. {{(pid=75226) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 17 01:22:36 user nova-compute[75226]: DEBUG os_brick.utils [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f62857db69', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:22:36 user nova-compute[75226]: DEBUG nova.virt.block_device [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Updating existing volume attachment record: d60c693b-c245-446b-a4a9-cd19947f166e {{(pid=75226) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 17 01:22:37 user nova-compute[75226]: DEBUG nova.compute.manager [req-857efb78-ccef-42a7-9327-b14d9846e78c req-298ccf4d-d32d-4a80-8fc0-d4446754a8ee service nova] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Received event network-changed-153c3e02-4aa9-4b9f-b03d-229f12e2ed68 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:22:37 user nova-compute[75226]: DEBUG nova.compute.manager [req-857efb78-ccef-42a7-9327-b14d9846e78c req-298ccf4d-d32d-4a80-8fc0-d4446754a8ee service nova] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Refreshing instance network info cache due to event network-changed-153c3e02-4aa9-4b9f-b03d-229f12e2ed68. {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 01:22:37 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-857efb78-ccef-42a7-9327-b14d9846e78c req-298ccf4d-d32d-4a80-8fc0-d4446754a8ee service nova] Acquiring lock "refresh_cache-663933b0-95dc-4fba-b411-029f0552571d" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:22:37 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:22:37 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:22:38 user nova-compute[75226]: DEBUG nova.network.neutron [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Updating instance_info_cache with network_info: [{"id": "462b7d76-b8d0-4374-8b29-da083c4ec28f", "address": "fa:16:3e:e5:9d:a6", "network": {"id": "3e4d69ef-0f6d-4d32-bcfa-0cae712a750e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1270397153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60fce4eef0d24de0a320670623085bb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap462b7d76-b8", "ovs_interfaceid": "462b7d76-b8d0-4374-8b29-da083c4ec28f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6bcf1322-1aad-4ffa-9231-7273376e4572", "address": "fa:16:3e:74:57:6e", "network": {"id": "a8dd3d50-aad0-4fe6-8986-98d0400bcaec", "bridge": "br-int", "label": "tempest-device-tagging-net1-1117474203", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.96", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "60fce4eef0d24de0a320670623085bb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bcf1322-1a", "ovs_interfaceid": "6bcf1322-1aad-4ffa-9231-7273376e4572", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fbacd963-6a62-4682-89a2-27f92a9f0ff2", "address": "fa:16:3e:34:dd:56", "network": {"id": "a8dd3d50-aad0-4fe6-8986-98d0400bcaec", "bridge": "br-int", "label": "tempest-device-tagging-net1-1117474203", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "60fce4eef0d24de0a320670623085bb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbacd963-6a", "ovs_interfaceid": "fbacd963-6a62-4682-89a2-27f92a9f0ff2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "46134046-ef40-4332-aa3f-044beaf6f991", "address": "fa:16:3e:d8:00:e9", "network": {"id": "a8dd3d50-aad0-4fe6-8986-98d0400bcaec", "bridge": "br-int", "label": "tempest-device-tagging-net1-1117474203", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "60fce4eef0d24de0a320670623085bb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46134046-ef", "ovs_interfaceid": "46134046-ef40-4332-aa3f-044beaf6f991", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "24888c49-a7a9-4f44-8f95-1174dba77750", "address": "fa:16:3e:38:2a:e5", "network": {"id": "a8dd3d50-aad0-4fe6-8986-98d0400bcaec", "bridge": "br-int", "label": "tempest-device-tagging-net1-1117474203", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "60fce4eef0d24de0a320670623085bb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24888c49-a7", "ovs_interfaceid": "24888c49-a7a9-4f44-8f95-1174dba77750", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5f7ca871-040f-460c-8709-7ca74ca282ba", "address": "fa:16:3e:4b:05:65", "network": {"id": "5cee0137-a429-434d-a7ce-0a8d2f9e41ea", "bridge": "br-int", "label": "tempest-device-tagging-net2-1427092874", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "60fce4eef0d24de0a320670623085bb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f7ca871-04", "ovs_interfaceid": "5f7ca871-040f-460c-8709-7ca74ca282ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "153c3e02-4aa9-4b9f-b03d-229f12e2ed68", "address": "fa:16:3e:a1:1f:ee", "network": {"id": "5cee0137-a429-434d-a7ce-0a8d2f9e41ea", "bridge": "br-int", "label": "tempest-device-tagging-net2-1427092874", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "60fce4eef0d24de0a320670623085bb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap153c3e02-4a", "ovs_interfaceid": "153c3e02-4aa9-4b9f-b03d-229f12e2ed68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:22:38 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Releasing lock "refresh_cache-663933b0-95dc-4fba-b411-029f0552571d" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:22:38 user nova-compute[75226]: DEBUG nova.compute.manager [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Instance network_info: |[{"id": "462b7d76-b8d0-4374-8b29-da083c4ec28f", "address": "fa:16:3e:e5:9d:a6", "network": {"id": "3e4d69ef-0f6d-4d32-bcfa-0cae712a750e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1270397153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60fce4eef0d24de0a320670623085bb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap462b7d76-b8", "ovs_interfaceid": "462b7d76-b8d0-4374-8b29-da083c4ec28f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6bcf1322-1aad-4ffa-9231-7273376e4572", "address": "fa:16:3e:74:57:6e", "network": {"id": "a8dd3d50-aad0-4fe6-8986-98d0400bcaec", "bridge": "br-int", "label": "tempest-device-tagging-net1-1117474203", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.96", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "60fce4eef0d24de0a320670623085bb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bcf1322-1a", "ovs_interfaceid": "6bcf1322-1aad-4ffa-9231-7273376e4572", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fbacd963-6a62-4682-89a2-27f92a9f0ff2", "address": "fa:16:3e:34:dd:56", "network": {"id": "a8dd3d50-aad0-4fe6-8986-98d0400bcaec", "bridge": "br-int", "label": "tempest-device-tagging-net1-1117474203", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "60fce4eef0d24de0a320670623085bb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbacd963-6a", "ovs_interfaceid": "fbacd963-6a62-4682-89a2-27f92a9f0ff2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "46134046-ef40-4332-aa3f-044beaf6f991", "address": "fa:16:3e:d8:00:e9", "network": {"id": "a8dd3d50-aad0-4fe6-8986-98d0400bcaec", "bridge": "br-int", "label": "tempest-device-tagging-net1-1117474203", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "60fce4eef0d24de0a320670623085bb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46134046-ef", "ovs_interfaceid": "46134046-ef40-4332-aa3f-044beaf6f991", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "24888c49-a7a9-4f44-8f95-1174dba77750", "address": "fa:16:3e:38:2a:e5", "network": {"id": "a8dd3d50-aad0-4fe6-8986-98d0400bcaec", "bridge": "br-int", "label": "tempest-device-tagging-net1-1117474203", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "60fce4eef0d24de0a320670623085bb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24888c49-a7", "ovs_interfaceid": "24888c49-a7a9-4f44-8f95-1174dba77750", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5f7ca871-040f-460c-8709-7ca74ca282ba", "address": "fa:16:3e:4b:05:65", "network": {"id": "5cee0137-a429-434d-a7ce-0a8d2f9e41ea", "bridge": "br-int", "label": "tempest-device-tagging-net2-1427092874", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "60fce4eef0d24de0a320670623085bb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f7ca871-04", "ovs_interfaceid": "5f7ca871-040f-460c-8709-7ca74ca282ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "153c3e02-4aa9-4b9f-b03d-229f12e2ed68", "address": "fa:16:3e:a1:1f:ee", "network": {"id": "5cee0137-a429-434d-a7ce-0a8d2f9e41ea", "bridge": "br-int", "label": "tempest-device-tagging-net2-1427092874", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "60fce4eef0d24de0a320670623085bb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap153c3e02-4a", "ovs_interfaceid": "153c3e02-4aa9-4b9f-b03d-229f12e2ed68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75226) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 17 01:22:38 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-857efb78-ccef-42a7-9327-b14d9846e78c req-298ccf4d-d32d-4a80-8fc0-d4446754a8ee service nova] Acquired lock "refresh_cache-663933b0-95dc-4fba-b411-029f0552571d" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:22:38 user nova-compute[75226]: DEBUG nova.network.neutron [req-857efb78-ccef-42a7-9327-b14d9846e78c req-298ccf4d-d32d-4a80-8fc0-d4446754a8ee service nova] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Refreshing network info cache for port 153c3e02-4aa9-4b9f-b03d-229f12e2ed68 {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 01:22:38 user nova-compute[75226]: DEBUG nova.network.neutron [req-857efb78-ccef-42a7-9327-b14d9846e78c req-298ccf4d-d32d-4a80-8fc0-d4446754a8ee service nova] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Updated VIF entry in instance network info cache for port 153c3e02-4aa9-4b9f-b03d-229f12e2ed68. {{(pid=75226) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 01:22:38 user nova-compute[75226]: DEBUG nova.network.neutron [req-857efb78-ccef-42a7-9327-b14d9846e78c req-298ccf4d-d32d-4a80-8fc0-d4446754a8ee service nova] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Updating instance_info_cache with network_info: [{"id": "462b7d76-b8d0-4374-8b29-da083c4ec28f", "address": "fa:16:3e:e5:9d:a6", "network": {"id": "3e4d69ef-0f6d-4d32-bcfa-0cae712a750e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1270397153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60fce4eef0d24de0a320670623085bb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap462b7d76-b8", "ovs_interfaceid": "462b7d76-b8d0-4374-8b29-da083c4ec28f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6bcf1322-1aad-4ffa-9231-7273376e4572", "address": "fa:16:3e:74:57:6e", "network": {"id": "a8dd3d50-aad0-4fe6-8986-98d0400bcaec", "bridge": "br-int", "label": "tempest-device-tagging-net1-1117474203", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.96", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "60fce4eef0d24de0a320670623085bb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bcf1322-1a", "ovs_interfaceid": "6bcf1322-1aad-4ffa-9231-7273376e4572", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fbacd963-6a62-4682-89a2-27f92a9f0ff2", "address": "fa:16:3e:34:dd:56", "network": {"id": "a8dd3d50-aad0-4fe6-8986-98d0400bcaec", "bridge": "br-int", "label": "tempest-device-tagging-net1-1117474203", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "60fce4eef0d24de0a320670623085bb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbacd963-6a", "ovs_interfaceid": "fbacd963-6a62-4682-89a2-27f92a9f0ff2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "46134046-ef40-4332-aa3f-044beaf6f991", "address": "fa:16:3e:d8:00:e9", "network": {"id": "a8dd3d50-aad0-4fe6-8986-98d0400bcaec", "bridge": "br-int", "label": "tempest-device-tagging-net1-1117474203", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "60fce4eef0d24de0a320670623085bb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46134046-ef", "ovs_interfaceid": "46134046-ef40-4332-aa3f-044beaf6f991", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "24888c49-a7a9-4f44-8f95-1174dba77750", "address": "fa:16:3e:38:2a:e5", "network": {"id": "a8dd3d50-aad0-4fe6-8986-98d0400bcaec", "bridge": "br-int", "label": "tempest-device-tagging-net1-1117474203", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "60fce4eef0d24de0a320670623085bb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24888c49-a7", "ovs_interfaceid": "24888c49-a7a9-4f44-8f95-1174dba77750", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5f7ca871-040f-460c-8709-7ca74ca282ba", "address": "fa:16:3e:4b:05:65", "network": {"id": "5cee0137-a429-434d-a7ce-0a8d2f9e41ea", "bridge": "br-int", "label": "tempest-device-tagging-net2-1427092874", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "60fce4eef0d24de0a320670623085bb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f7ca871-04", "ovs_interfaceid": "5f7ca871-040f-460c-8709-7ca74ca282ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "153c3e02-4aa9-4b9f-b03d-229f12e2ed68", "address": "fa:16:3e:a1:1f:ee", "network": {"id": "5cee0137-a429-434d-a7ce-0a8d2f9e41ea", "bridge": "br-int", "label": "tempest-device-tagging-net2-1427092874", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "60fce4eef0d24de0a320670623085bb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap153c3e02-4a", "ovs_interfaceid": "153c3e02-4aa9-4b9f-b03d-229f12e2ed68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:22:38 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-857efb78-ccef-42a7-9327-b14d9846e78c req-298ccf4d-d32d-4a80-8fc0-d4446754a8ee service nova] Releasing lock "refresh_cache-663933b0-95dc-4fba-b411-029f0552571d" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:22:39 user nova-compute[75226]: DEBUG nova.compute.manager [req-d3745213-28d1-4dfa-9f38-7296f0d87664 req-467c1046-1f1e-43e8-86c6-876758754aa7 service nova] [instance: 52fe0a91-9320-47d2-ac83-4f49260a0997] Received event network-changed-40569c42-220e-4c21-8b6c-b12dc4e111c5 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:22:39 user nova-compute[75226]: DEBUG nova.compute.manager [req-d3745213-28d1-4dfa-9f38-7296f0d87664 req-467c1046-1f1e-43e8-86c6-876758754aa7 service nova] [instance: 52fe0a91-9320-47d2-ac83-4f49260a0997] Refreshing instance network info cache due to event network-changed-40569c42-220e-4c21-8b6c-b12dc4e111c5. {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 01:22:39 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-d3745213-28d1-4dfa-9f38-7296f0d87664 req-467c1046-1f1e-43e8-86c6-876758754aa7 service nova] Acquiring lock "refresh_cache-52fe0a91-9320-47d2-ac83-4f49260a0997" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:22:39 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-d3745213-28d1-4dfa-9f38-7296f0d87664 req-467c1046-1f1e-43e8-86c6-876758754aa7 service nova] Acquired lock "refresh_cache-52fe0a91-9320-47d2-ac83-4f49260a0997" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:22:39 user nova-compute[75226]: DEBUG nova.network.neutron [req-d3745213-28d1-4dfa-9f38-7296f0d87664 req-467c1046-1f1e-43e8-86c6-876758754aa7 service nova] [instance: 52fe0a91-9320-47d2-ac83-4f49260a0997] Refreshing network info cache for port 40569c42-220e-4c21-8b6c-b12dc4e111c5 {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 01:22:39 user nova-compute[75226]: DEBUG nova.network.neutron [req-d3745213-28d1-4dfa-9f38-7296f0d87664 req-467c1046-1f1e-43e8-86c6-876758754aa7 service nova] [instance: 52fe0a91-9320-47d2-ac83-4f49260a0997] Updated VIF entry in instance network info cache for port 40569c42-220e-4c21-8b6c-b12dc4e111c5. {{(pid=75226) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 01:22:39 user nova-compute[75226]: DEBUG nova.network.neutron [req-d3745213-28d1-4dfa-9f38-7296f0d87664 req-467c1046-1f1e-43e8-86c6-876758754aa7 service nova] [instance: 52fe0a91-9320-47d2-ac83-4f49260a0997] Updating instance_info_cache with network_info: [{"id": "40569c42-220e-4c21-8b6c-b12dc4e111c5", "address": "fa:16:3e:ee:92:2e", "network": {"id": "413a22ba-ac08-4a82-ad4a-7be66b8b38d0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-885127095-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "339f5602853149bcad2f8416ee82a0c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40569c42-22", "ovs_interfaceid": "40569c42-220e-4c21-8b6c-b12dc4e111c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:22:39 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-d3745213-28d1-4dfa-9f38-7296f0d87664 req-467c1046-1f1e-43e8-86c6-876758754aa7 service nova] Releasing lock "refresh_cache-52fe0a91-9320-47d2-ac83-4f49260a0997" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:22:42 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:22:42 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:22:43 user nova-compute[75226]: INFO nova.virt.block_device [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Booting with volume 1b95a10d-6f61-48de-b7e5-de732f65f408 at /dev/vdc
Nov 17 01:22:43 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-c0ad2c49-2e0e-4e3b-8cc1-92b8bbbd5fcd tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] Acquiring lock "52fe0a91-9320-47d2-ac83-4f49260a0997" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:22:43 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-c0ad2c49-2e0e-4e3b-8cc1-92b8bbbd5fcd tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] Lock "52fe0a91-9320-47d2-ac83-4f49260a0997" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:22:43 user nova-compute[75226]: DEBUG nova.objects.instance [None req-c0ad2c49-2e0e-4e3b-8cc1-92b8bbbd5fcd tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] Lazy-loading 'flavor' on Instance uuid 52fe0a91-9320-47d2-ac83-4f49260a0997 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:22:43 user nova-compute[75226]: DEBUG os_brick.utils [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:22:43 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:22:43 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:22:43 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[0234ffa6-6365-47df-b4e6-2e721ae9514b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f62857db69\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:22:43 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:22:43 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-c0ad2c49-2e0e-4e3b-8cc1-92b8bbbd5fcd tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] Lock "52fe0a91-9320-47d2-ac83-4f49260a0997" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:22:43 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:22:43 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[abec02bb-6901-4a39-b08a-95425f5dc9f3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:22:43 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:22:43 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:22:43 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[8edb0205-bf6e-4e61-b60a-a9ae66fa7a95]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:22:43 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[5976cb90-dd1f-4f69-877b-535ad1543fa5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:22:43 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Running cmd (subprocess): nvme version {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:22:43 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] 'nvme version' failed. Not Retrying. {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 01:22:43 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] nvme not present on system {{(pid=75226) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 17 01:22:43 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:22:43 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 01:22:43 user nova-compute[75226]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 17 01:22:43 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dc5678f-ca46-4423-99aa-b77c80d343a0]: (4, '') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:22:43 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75226) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 17 01:22:43 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75226) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 17 01:22:43 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] LIGHTOS: no hostnqn found. {{(pid=75226) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 17 01:22:43 user nova-compute[75226]: DEBUG os_brick.utils [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f62857db69', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:22:43 user nova-compute[75226]: DEBUG nova.virt.block_device [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Updating existing volume attachment record: 8065968e-2d5f-4316-96a0-fde22ff47d2f {{(pid=75226) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 17 01:22:43 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-c0ad2c49-2e0e-4e3b-8cc1-92b8bbbd5fcd tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] Acquiring lock "52fe0a91-9320-47d2-ac83-4f49260a0997" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:22:43 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-c0ad2c49-2e0e-4e3b-8cc1-92b8bbbd5fcd tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] Lock "52fe0a91-9320-47d2-ac83-4f49260a0997" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:22:43 user nova-compute[75226]: INFO nova.compute.manager [None req-c0ad2c49-2e0e-4e3b-8cc1-92b8bbbd5fcd tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] [instance: 52fe0a91-9320-47d2-ac83-4f49260a0997] Attaching volume f8488f49-8126-431d-96f0-b75e4e32f09a to /dev/vdb
Nov 17 01:22:43 user nova-compute[75226]: DEBUG os_brick.utils [None req-c0ad2c49-2e0e-4e3b-8cc1-92b8bbbd5fcd tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:22:43 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:22:43 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:22:43 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[18c6c18a-84f3-4b2f-aa4d-a77e06c9c51d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f62857db69\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:22:43 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:22:43 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:22:43 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[358349a5-23f3-47b0-b493-ef29b5de50cf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:22:43 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:22:43 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:22:43 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[034de57b-e4f8-4143-b610-e2ada1ba3184]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:22:43 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[65234e48-c667-45a6-9c46-f43d0c7e3a64]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:22:43 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-c0ad2c49-2e0e-4e3b-8cc1-92b8bbbd5fcd tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] Running cmd (subprocess): nvme version {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:22:43 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-c0ad2c49-2e0e-4e3b-8cc1-92b8bbbd5fcd tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] 'nvme version' failed. Not Retrying. {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 01:22:43 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c0ad2c49-2e0e-4e3b-8cc1-92b8bbbd5fcd tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] nvme not present on system {{(pid=75226) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 17 01:22:43 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:22:43 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 01:22:43 user nova-compute[75226]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 17 01:22:43 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e32f7d5-71f5-4a3b-8d0c-5d72cc570346]: (4, '') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:22:43 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-c0ad2c49-2e0e-4e3b-8cc1-92b8bbbd5fcd tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75226) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 17 01:22:43 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-c0ad2c49-2e0e-4e3b-8cc1-92b8bbbd5fcd tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75226) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 17 01:22:43 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-c0ad2c49-2e0e-4e3b-8cc1-92b8bbbd5fcd tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] LIGHTOS: no hostnqn found. {{(pid=75226) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 17 01:22:43 user nova-compute[75226]: DEBUG os_brick.utils [None req-c0ad2c49-2e0e-4e3b-8cc1-92b8bbbd5fcd tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f62857db69', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:22:43 user nova-compute[75226]: DEBUG nova.virt.block_device [None req-c0ad2c49-2e0e-4e3b-8cc1-92b8bbbd5fcd tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] [instance: 52fe0a91-9320-47d2-ac83-4f49260a0997] Updating existing volume attachment record: d32b986c-2e66-4a3a-b145-cd2a315481c3 {{(pid=75226) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 17 01:22:47 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:22:47 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:22:52 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:22:54 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0ad2c49-2e0e-4e3b-8cc1-92b8bbbd5fcd tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] [instance: 52fe0a91-9320-47d2-ac83-4f49260a0997] Calling os-brick to attach iSCSI Volume {{(pid=75226) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 17 01:22:54 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ad2c49-2e0e-4e3b-8cc1-92b8bbbd5fcd tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc4cc36b490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f8488f49-8126-431d-96f0-b75e4e32f09a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QksbWwOu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:22:54 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-c0ad2c49-2e0e-4e3b-8cc1-92b8bbbd5fcd tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:22:54 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-c0ad2c49-2e0e-4e3b-8cc1-92b8bbbd5fcd tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:22:54 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-c0ad2c49-2e0e-4e3b-8cc1-92b8bbbd5fcd tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:22:54 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-c0ad2c49-2e0e-4e3b-8cc1-92b8bbbd5fcd tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:22:54 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-c0ad2c49-2e0e-4e3b-8cc1-92b8bbbd5fcd tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f8488f49-8126-431d-96f0-b75e4e32f09a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:22:54 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-c0ad2c49-2e0e-4e3b-8cc1-92b8bbbd5fcd tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f8488f49-8126-431d-96f0-b75e4e32f09a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:22:54 user nova-compute[75226]: INFO os_brick.initiator.connectors.iscsi [None req-c0ad2c49-2e0e-4e3b-8cc1-92b8bbbd5fcd tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 17 01:22:54 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8488f49-8126-431d-96f0-b75e4e32f09a -p 172.16.0.220:3260 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:22:54 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8488f49-8126-431d-96f0-b75e4e32f09a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:22:54 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[22bf00f1-fe77-4a22-af74-da3fa04f926a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:22:54 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ad2c49-2e0e-4e3b-8cc1-92b8bbbd5fcd tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 17 01:22:54 user nova-compute[75226]:  {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:22:54 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8488f49-8126-431d-96f0-b75e4e32f09a -p 172.16.0.220:3260 --interface default --op new {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:22:54 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8488f49-8126-431d-96f0-b75e4e32f09a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:22:54 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1acaf29-c1c7-446f-a651-b54f69bae2c2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f8488f49-8126-431d-96f0-b75e4e32f09a] added\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:22:54 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ad2c49-2e0e-4e3b-8cc1-92b8bbbd5fcd tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f8488f49-8126-431d-96f0-b75e4e32f09a] added
Nov 17 01:22:54 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:22:54 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8488f49-8126-431d-96f0-b75e4e32f09a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:22:54 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8488f49-8126-431d-96f0-b75e4e32f09a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:22:54 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[55c37efd-9b8a-4431-9e21-8f16c61d1e7e]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:22:54 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ad2c49-2e0e-4e3b-8cc1-92b8bbbd5fcd tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:22:54 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8488f49-8126-431d-96f0-b75e4e32f09a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:22:54 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8488f49-8126-431d-96f0-b75e4e32f09a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:22:54 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[5628b115-248b-4ffb-84c1-1cd590053623]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:22:54 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ad2c49-2e0e-4e3b-8cc1-92b8bbbd5fcd tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:22:54 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8488f49-8126-431d-96f0-b75e4e32f09a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QksbWwOu {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:22:54 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8488f49-8126-431d-96f0-b75e4e32f09a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QksbWwOu" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:22:54 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[d169a682-57ba-48e4-ae23-2893c64842c8]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:22:54 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ad2c49-2e0e-4e3b-8cc1-92b8bbbd5fcd tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QksbWwOu'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:22:54 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8488f49-8126-431d-96f0-b75e4e32f09a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:22:54 user nova-compute[75226]: DEBUG nova.compute.manager [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Start spawning the instance on the hypervisor. {{(pid=75226) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 17 01:22:54 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Creating instance directory {{(pid=75226) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 17 01:22:54 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Creating image(s)
Nov 17 01:22:54 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Did not create local disks {{(pid=75226) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 17 01:22:54 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Ensure instance console log exists: /opt/stack/data/nova/instances/663933b0-95dc-4fba-b411-029f0552571d/console.log {{(pid=75226) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 17 01:22:54 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:22:54 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:22:54 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:22:54 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Start _get_guest_xml network_info=[{"id": "462b7d76-b8d0-4374-8b29-da083c4ec28f", "address": "fa:16:3e:e5:9d:a6", "network": {"id": "3e4d69ef-0f6d-4d32-bcfa-0cae712a750e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1270397153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60fce4eef0d24de0a320670623085bb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap462b7d76-b8", "ovs_interfaceid": "462b7d76-b8d0-4374-8b29-da083c4ec28f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6bcf1322-1aad-4ffa-9231-7273376e4572", "address": "fa:16:3e:74:57:6e", "network": {"id": "a8dd3d50-aad0-4fe6-8986-98d0400bcaec", "bridge": "br-int", "label": "tempest-device-tagging-net1-1117474203", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.96", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "60fce4eef0d24de0a320670623085bb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bcf1322-1a", "ovs_interfaceid": "6bcf1322-1aad-4ffa-9231-7273376e4572", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fbacd963-6a62-4682-89a2-27f92a9f0ff2", "address": "fa:16:3e:34:dd:56", "network": {"id": "a8dd3d50-aad0-4fe6-8986-98d0400bcaec", "bridge": "br-int", "label": "tempest-device-tagging-net1-1117474203", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "60fce4eef0d24de0a320670623085bb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbacd963-6a", "ovs_interfaceid": "fbacd963-6a62-4682-89a2-27f92a9f0ff2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "46134046-ef40-4332-aa3f-044beaf6f991", "address": "fa:16:3e:d8:00:e9", "network": {"id": "a8dd3d50-aad0-4fe6-8986-98d0400bcaec", "bridge": "br-int", "label": "tempest-device-tagging-net1-1117474203", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "60fce4eef0d24de0a320670623085bb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46134046-ef", "ovs_interfaceid": "46134046-ef40-4332-aa3f-044beaf6f991", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "24888c49-a7a9-4f44-8f95-1174dba77750", "address": "fa:16:3e:38:2a:e5", "network": {"id": "a8dd3d50-aad0-4fe6-8986-98d0400bcaec", "bridge": "br-int", "label": "tempest-device-tagging-net1-1117474203", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "60fce4eef0d24de0a320670623085bb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24888c49-a7", "ovs_interfaceid": "24888c49-a7a9-4f44-8f95-1174dba77750", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5f7ca871-040f-460c-8709-7ca74ca282ba", "address": "fa:16:3e:4b:05:65", "network": {"id": "5cee0137-a429-434d-a7ce-0a8d2f9e41ea", "bridge": "br-int", "label": "tempest-device-tagging-net2-1427092874", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "60fce4eef0d24de0a320670623085bb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f7ca871-04", "ovs_interfaceid": "5f7ca871-040f-460c-8709-7ca74ca282ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "153c3e02-4aa9-4b9f-b03d-229f12e2ed68", "address": "fa:16:3e:a1:1f:ee", "network": {"id": "5cee0137-a429-434d-a7ce-0a8d2f9e41ea", "bridge": "br-int", "label": "tempest-device-tagging-net2-1427092874", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "60fce4eef0d24de0a320670623085bb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap153c3e02-4a", "ovs_interfaceid": "153c3e02-4aa9-4b9f-b03d-229f12e2ed68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T01:13:22Z,direct_url=<?>,disk_format='qcow2',id=0b369aea-6f3f-4690-9f01-229b90ab6310,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4e110cbf9a84362a6864a7732c435a1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T01:13:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:928c93b5-ae63-4e04-94ce-6059e7eaa7d6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gaMxGoKY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '663933b0-95dc-4fba-b411-029f0552571d', 'attached_at': '', 'detached_at': '', 'volume_id': '928c93b5-ae63-4e04-94ce-6059e7eaa7d6', 'serial': '928c93b5-ae63-4e04-94ce-6059e7eaa7d6'}, 'attachment_id': 'ed882383-ebd5-4387-89c3-824c50c45e85', 'device_type': 'disk', 'volume_type': None}, {'delete_on_termination': False, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'boot_index': 1, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:607b7fb8-097d-43ea-b13c-0825e015e14e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JLQISYnD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '663933b0-95dc-4fba-b411-029f0552571d', 'attached_at': '', 'detached_at': '', 'volume_id': '607b7fb8-097d-43ea-b13c-0825e015e14e', 'serial': '607b7fb8-097d-43ea-b13c-0825e015e14e'}, 'attachment_id': 'd60c693b-c245-446b-a4a9-cd19947f166e', 'device_type': 'disk', 'volume_type': None}, {'delete_on_termination': False, 'mount_device': '/dev/vdc', 'disk_bus': 'virtio', 'boot_index': 2, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1b95a10d-6f61-48de-b7e5-de732f65f408', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bdGTAkEp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '663933b0-95dc-4fba-b411-029f0552571d', 'attached_at': '', 'detached_at': '', 'volume_id': '1b95a10d-6f61-48de-b7e5-de732f65f408', 'serial': '1b95a10d-6f61-48de-b7e5-de732f65f408'}, 'attachment_id': '8065968e-2d5f-4316-96a0-fde22ff47d2f', 'device_type': 'disk', 'volume_type': None} {{(pid=75226) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 17 01:22:54 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8488f49-8126-431d-96f0-b75e4e32f09a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:22:54 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd236bf8-ce0d-49e6-b1f1-d88aa99dd993]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:22:54 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ad2c49-2e0e-4e3b-8cc1-92b8bbbd5fcd tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:22:54 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:22:54 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:22:54 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:22:54 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:22:54 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[759893b4-cd94-436a-8919-5c1b4e856ab7]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa7be6d3-d525-4aa3-bcc3-481465f2832b (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:22:54 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ad2c49-2e0e-4e3b-8cc1-92b8bbbd5fcd tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)
Nov 17 01:22:54 user nova-compute[75226]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa7be6d3-d525-4aa3-bcc3-481465f2832b (non-flash)
Nov 17 01:22:54 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:22:54 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ad2c49-2e0e-4e3b-8cc1-92b8bbbd5fcd tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)
Nov 17 01:22:54 user nova-compute[75226]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa7be6d3-d525-4aa3-bcc3-481465f2832b (non-flash)
Nov 17 01:22:54 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:22:54 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8488f49-8126-431d-96f0-b75e4e32f09a -p 172.16.0.220:3260 --login {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:22:54 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8488f49-8126-431d-96f0-b75e4e32f09a -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:22:54 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b5dfb9f-0e45-4344-9f8b-5aa2e47e0d84]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f8488f49-8126-431d-96f0-b75e4e32f09a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f8488f49-8126-431d-96f0-b75e4e32f09a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:22:54 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ad2c49-2e0e-4e3b-8cc1-92b8bbbd5fcd tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f8488f49-8126-431d-96f0-b75e4e32f09a, portal: 172.16.0.220,3260]
Nov 17 01:22:54 user nova-compute[75226]: Login to [iface: default, target: iqn.2010-10.org.openstack:f8488f49-8126-431d-96f0-b75e4e32f09a, portal: 172.16.0.220,3260] successful.
Nov 17 01:22:54 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:22:54 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8488f49-8126-431d-96f0-b75e4e32f09a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:22:54 user nova-compute[75226]: INFO nova.compute.manager [None req-f651c864-506a-45cb-9a27-c51323fe1542 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] [instance: ddfecefc-1e9b-4e6e-9995-855c8a061084] Unrescuing
Nov 17 01:22:54 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-f651c864-506a-45cb-9a27-c51323fe1542 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Acquiring lock "refresh_cache-ddfecefc-1e9b-4e6e-9995-855c8a061084" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:22:54 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-f651c864-506a-45cb-9a27-c51323fe1542 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Acquired lock "refresh_cache-ddfecefc-1e9b-4e6e-9995-855c8a061084" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:22:54 user nova-compute[75226]: DEBUG nova.network.neutron [None req-f651c864-506a-45cb-9a27-c51323fe1542 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] [instance: ddfecefc-1e9b-4e6e-9995-855c8a061084] Building network info cache for instance {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 01:22:54 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8488f49-8126-431d-96f0-b75e4e32f09a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:22:54 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[c30fb630-cf09-49b7-810a-d556c30b6b8a]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:22:54 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ad2c49-2e0e-4e3b-8cc1-92b8bbbd5fcd tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:22:54 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:22:54 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75226) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 17 01:22:54 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] CPU controller missing on host. {{(pid=75226) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 17 01:22:54 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75226) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 17 01:22:54 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] CPU controller found on host. {{(pid=75226) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 17 01:22:54 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75226) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 17 01:22:54 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-17T01:13:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T01:13:22Z,direct_url=<?>,disk_format='qcow2',id=0b369aea-6f3f-4690-9f01-229b90ab6310,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4e110cbf9a84362a6864a7732c435a1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T01:13:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 17 01:22:54 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Flavor limits 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 17 01:22:54 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Image limits 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 17 01:22:54 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Flavor pref 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 17 01:22:54 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Image pref 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 17 01:22:54 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 17 01:22:54 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 17 01:22:54 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75226) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 17 01:22:54 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Got 1 possible topologies {{(pid=75226) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 17 01:22:54 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 17 01:22:54 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 17 01:22:54 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Calling os-brick to attach iSCSI Volume {{(pid=75226) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 17 01:22:54 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc4cc36b490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:928c93b5-ae63-4e04-94ce-6059e7eaa7d6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gaMxGoKY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:22:54 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:22:54 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:22:54 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:22:54 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[b21c6a06-438d-4385-8abb-4b45d0874342]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa7be6d3-d525-4aa3-bcc3-481465f2832b (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8488f49-8126-431d-96f0-b75e4e32f09a (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:22:54 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ad2c49-2e0e-4e3b-8cc1-92b8bbbd5fcd tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)
Nov 17 01:22:54 user nova-compute[75226]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa7be6d3-d525-4aa3-bcc3-481465f2832b (non-flash)
Nov 17 01:22:54 user nova-compute[75226]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8488f49-8126-431d-96f0-b75e4e32f09a (non-flash)
Nov 17 01:22:54 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:22:54 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ad2c49-2e0e-4e3b-8cc1-92b8bbbd5fcd tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)
Nov 17 01:22:54 user nova-compute[75226]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa7be6d3-d525-4aa3-bcc3-481465f2832b (non-flash)
Nov 17 01:22:54 user nova-compute[75226]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8488f49-8126-431d-96f0-b75e4e32f09a (non-flash)
Nov 17 01:22:54 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:22:54 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-c0ad2c49-2e0e-4e3b-8cc1-92b8bbbd5fcd tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f8488f49-8126-431d-96f0-b75e4e32f09a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.352s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:22:54 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ad2c49-2e0e-4e3b-8cc1-92b8bbbd5fcd tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] Connected to 172.16.0.220:3260 {{(pid=75226) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 17 01:22:54 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-c0ad2c49-2e0e-4e3b-8cc1-92b8bbbd5fcd tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] HCTL ('33', '-', '-', 0) found on session 18 with lun 0 {{(pid=75226) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 17 01:22:54 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-c0ad2c49-2e0e-4e3b-8cc1-92b8bbbd5fcd tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75226) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 17 01:22:54 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:22:54 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.030s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:22:54 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3e7e714-5084-46c3-975b-050fc50dc968]: (4, ('- - 0', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:22:54 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-c0ad2c49-2e0e-4e3b-8cc1-92b8bbbd5fcd tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] Searching for a device in session 18 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75226) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 01:22:54 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ad2c49-2e0e-4e3b-8cc1-92b8bbbd5fcd tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:f8488f49-8126-431d-96f0-b75e4e32f09a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QksbWwOu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75226) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 17 01:22:55 user nova-compute[75226]: DEBUG nova.network.neutron [None req-f651c864-506a-45cb-9a27-c51323fe1542 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] [instance: ddfecefc-1e9b-4e6e-9995-855c8a061084] Updating instance_info_cache with network_info: [{"id": "f9a7562b-de63-4374-b43b-18e3cb3af710", "address": "fa:16:3e:94:21:00", "network": {"id": "8450ab2c-4f24-46cc-a6ec-644c02e2b3da", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-385219532-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6869af66e0cc47bf9cca02ea9b688a6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9a7562b-de", "ovs_interfaceid": "f9a7562b-de63-4374-b43b-18e3cb3af710", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:22:55 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-f651c864-506a-45cb-9a27-c51323fe1542 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Releasing lock "refresh_cache-ddfecefc-1e9b-4e6e-9995-855c8a061084" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:22:55 user nova-compute[75226]: DEBUG nova.objects.instance [None req-f651c864-506a-45cb-9a27-c51323fe1542 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Lazy-loading 'flavor' on Instance uuid ddfecefc-1e9b-4e6e-9995-855c8a061084 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:22:55 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:22:55 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:22:55 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:22:55 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:22:55 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-c0ad2c49-2e0e-4e3b-8cc1-92b8bbbd5fcd tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.395s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:22:55 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ad2c49-2e0e-4e3b-8cc1-92b8bbbd5fcd tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] <== connect_volume: return (1398ms) {'type': 'block', 'scsi_wwn': '26139386162393439', 'path': '/dev/sdb'} {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:22:55 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0ad2c49-2e0e-4e3b-8cc1-92b8bbbd5fcd tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] [instance: 52fe0a91-9320-47d2-ac83-4f49260a0997] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26139386162393439', 'path': '/dev/sdb'} {{(pid=75226) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 17 01:22:55 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.046s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:22:55 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:22:55 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:928c93b5-ae63-4e04-94ce-6059e7eaa7d6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:22:55 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:928c93b5-ae63-4e04-94ce-6059e7eaa7d6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:22:55 user nova-compute[75226]: INFO os_brick.initiator.connectors.iscsi [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 17 01:22:55 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:928c93b5-ae63-4e04-94ce-6059e7eaa7d6 -p 172.16.0.220:3260 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:22:55 user nova-compute[75226]: DEBUG nova.objects.instance [None req-c0ad2c49-2e0e-4e3b-8cc1-92b8bbbd5fcd tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] Lazy-loading 'flavor' on Instance uuid 52fe0a91-9320-47d2-ac83-4f49260a0997 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:22:55 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:928c93b5-ae63-4e04-94ce-6059e7eaa7d6 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:22:55 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[484e8497-50d6-4572-b687-e8c8eed6adc0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:22:55 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 17 01:22:55 user nova-compute[75226]:  {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:22:55 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:928c93b5-ae63-4e04-94ce-6059e7eaa7d6 -p 172.16.0.220:3260 --interface default --op new {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:22:55 user nova-compute[75226]: DEBUG nova.virt.libvirt.guest [None req-c0ad2c49-2e0e-4e3b-8cc1-92b8bbbd5fcd tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] attach device xml: <disk type="block" device="disk">
Nov 17 01:22:55 user nova-compute[75226]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 01:22:55 user nova-compute[75226]:   <source dev="/dev/sdb"/>
Nov 17 01:22:55 user nova-compute[75226]:   <target dev="vdb" bus="virtio"/>
Nov 17 01:22:55 user nova-compute[75226]:   <serial>f8488f49-8126-431d-96f0-b75e4e32f09a</serial>
Nov 17 01:22:55 user nova-compute[75226]: </disk>
Nov 17 01:22:55 user nova-compute[75226]:  {{(pid=75226) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 17 01:22:55 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:928c93b5-ae63-4e04-94ce-6059e7eaa7d6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:22:55 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e06cc4e-fe23-4a4a-8d58-f0d6ec30d381]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:928c93b5-ae63-4e04-94ce-6059e7eaa7d6] added\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:22:55 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:928c93b5-ae63-4e04-94ce-6059e7eaa7d6] added
Nov 17 01:22:55 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:22:55 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:928c93b5-ae63-4e04-94ce-6059e7eaa7d6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:22:55 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:928c93b5-ae63-4e04-94ce-6059e7eaa7d6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:22:55 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[4418aea3-935d-4a2b-b91a-5a2cdbb1d90e]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:22:55 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:22:55 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:928c93b5-ae63-4e04-94ce-6059e7eaa7d6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:22:55 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:928c93b5-ae63-4e04-94ce-6059e7eaa7d6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:22:55 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[fab1802a-f969-4375-81d3-be59a1df2c73]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:22:55 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:22:55 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:928c93b5-ae63-4e04-94ce-6059e7eaa7d6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gaMxGoKY {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:22:55 user nova-compute[75226]: DEBUG nova.compute.manager [req-be32b9c0-a4df-4c2e-9acf-2b9d18062a97 req-994e9317-c3f2-41c9-97bf-6e6e2c224c97 service nova] [instance: ddfecefc-1e9b-4e6e-9995-855c8a061084] Received event network-vif-unplugged-f9a7562b-de63-4374-b43b-18e3cb3af710 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:22:55 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-be32b9c0-a4df-4c2e-9acf-2b9d18062a97 req-994e9317-c3f2-41c9-97bf-6e6e2c224c97 service nova] Acquiring lock "ddfecefc-1e9b-4e6e-9995-855c8a061084-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:22:55 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-be32b9c0-a4df-4c2e-9acf-2b9d18062a97 req-994e9317-c3f2-41c9-97bf-6e6e2c224c97 service nova] Lock "ddfecefc-1e9b-4e6e-9995-855c8a061084-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:22:55 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-be32b9c0-a4df-4c2e-9acf-2b9d18062a97 req-994e9317-c3f2-41c9-97bf-6e6e2c224c97 service nova] Lock "ddfecefc-1e9b-4e6e-9995-855c8a061084-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:22:55 user nova-compute[75226]: DEBUG nova.compute.manager [req-be32b9c0-a4df-4c2e-9acf-2b9d18062a97 req-994e9317-c3f2-41c9-97bf-6e6e2c224c97 service nova] [instance: ddfecefc-1e9b-4e6e-9995-855c8a061084] No waiting events found dispatching network-vif-unplugged-f9a7562b-de63-4374-b43b-18e3cb3af710 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:22:55 user nova-compute[75226]: WARNING nova.compute.manager [req-be32b9c0-a4df-4c2e-9acf-2b9d18062a97 req-994e9317-c3f2-41c9-97bf-6e6e2c224c97 service nova] [instance: ddfecefc-1e9b-4e6e-9995-855c8a061084] Received unexpected event network-vif-unplugged-f9a7562b-de63-4374-b43b-18e3cb3af710 for instance with vm_state rescued and task_state unrescuing.
Nov 17 01:22:55 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:928c93b5-ae63-4e04-94ce-6059e7eaa7d6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gaMxGoKY" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:22:55 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ed5dcf5-a91b-468e-b8a6-deb42957382d]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:22:55 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gaMxGoKY'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:22:55 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:928c93b5-ae63-4e04-94ce-6059e7eaa7d6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:22:56 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:928c93b5-ae63-4e04-94ce-6059e7eaa7d6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:22:56 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[04400e4b-b91d-4b9d-a1a7-da22076ae1e1]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:22:56 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:22:56 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:22:56 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:22:56 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[74889a7f-d527-4344-a50c-0052cfd98907]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa7be6d3-d525-4aa3-bcc3-481465f2832b (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8488f49-8126-431d-96f0-b75e4e32f09a (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:22:56 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)
Nov 17 01:22:56 user nova-compute[75226]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa7be6d3-d525-4aa3-bcc3-481465f2832b (non-flash)
Nov 17 01:22:56 user nova-compute[75226]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8488f49-8126-431d-96f0-b75e4e32f09a (non-flash)
Nov 17 01:22:56 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:22:56 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)
Nov 17 01:22:56 user nova-compute[75226]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa7be6d3-d525-4aa3-bcc3-481465f2832b (non-flash)
Nov 17 01:22:56 user nova-compute[75226]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8488f49-8126-431d-96f0-b75e4e32f09a (non-flash)
Nov 17 01:22:56 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:22:56 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:928c93b5-ae63-4e04-94ce-6059e7eaa7d6 -p 172.16.0.220:3260 --login {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:22:56 user nova-compute[75226]: DEBUG nova.compute.manager [req-9ce5fa4c-cf55-4ca5-bd42-9e1e38b1cb57 req-7b71e649-fed5-4dba-b462-0c7d917d4616 service nova] [instance: ddfecefc-1e9b-4e6e-9995-855c8a061084] Received event network-changed-f9a7562b-de63-4374-b43b-18e3cb3af710 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:22:56 user nova-compute[75226]: DEBUG nova.compute.manager [req-9ce5fa4c-cf55-4ca5-bd42-9e1e38b1cb57 req-7b71e649-fed5-4dba-b462-0c7d917d4616 service nova] [instance: ddfecefc-1e9b-4e6e-9995-855c8a061084] Refreshing instance network info cache due to event network-changed-f9a7562b-de63-4374-b43b-18e3cb3af710. {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 01:22:56 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-9ce5fa4c-cf55-4ca5-bd42-9e1e38b1cb57 req-7b71e649-fed5-4dba-b462-0c7d917d4616 service nova] Acquiring lock "refresh_cache-ddfecefc-1e9b-4e6e-9995-855c8a061084" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:22:56 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-9ce5fa4c-cf55-4ca5-bd42-9e1e38b1cb57 req-7b71e649-fed5-4dba-b462-0c7d917d4616 service nova] Acquired lock "refresh_cache-ddfecefc-1e9b-4e6e-9995-855c8a061084" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:22:56 user nova-compute[75226]: DEBUG nova.network.neutron [req-9ce5fa4c-cf55-4ca5-bd42-9e1e38b1cb57 req-7b71e649-fed5-4dba-b462-0c7d917d4616 service nova] [instance: ddfecefc-1e9b-4e6e-9995-855c8a061084] Refreshing network info cache for port f9a7562b-de63-4374-b43b-18e3cb3af710 {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 01:22:56 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:928c93b5-ae63-4e04-94ce-6059e7eaa7d6 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:22:56 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b6ae2e0-4684-47c1-bc30-94898a6ace61]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:928c93b5-ae63-4e04-94ce-6059e7eaa7d6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:928c93b5-ae63-4e04-94ce-6059e7eaa7d6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:22:56 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:928c93b5-ae63-4e04-94ce-6059e7eaa7d6, portal: 172.16.0.220,3260]
Nov 17 01:22:56 user nova-compute[75226]: Login to [iface: default, target: iqn.2010-10.org.openstack:928c93b5-ae63-4e04-94ce-6059e7eaa7d6, portal: 172.16.0.220,3260] successful.
Nov 17 01:22:56 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:22:56 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:928c93b5-ae63-4e04-94ce-6059e7eaa7d6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:22:56 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:928c93b5-ae63-4e04-94ce-6059e7eaa7d6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:22:56 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[36a92324-23a8-4313-a29f-5c50b05de257]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:22:56 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:22:56 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:22:56 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:22:56 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c88a78d-f480-466d-9a48-d7ac63ad3741]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa7be6d3-d525-4aa3-bcc3-481465f2832b (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8488f49-8126-431d-96f0-b75e4e32f09a (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:928c93b5-ae63-4e04-94ce-6059e7eaa7d6 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:22:56 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)
Nov 17 01:22:56 user nova-compute[75226]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa7be6d3-d525-4aa3-bcc3-481465f2832b (non-flash)
Nov 17 01:22:56 user nova-compute[75226]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8488f49-8126-431d-96f0-b75e4e32f09a (non-flash)
Nov 17 01:22:56 user nova-compute[75226]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:928c93b5-ae63-4e04-94ce-6059e7eaa7d6 (non-flash)
Nov 17 01:22:56 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:22:56 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)
Nov 17 01:22:56 user nova-compute[75226]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa7be6d3-d525-4aa3-bcc3-481465f2832b (non-flash)
Nov 17 01:22:56 user nova-compute[75226]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8488f49-8126-431d-96f0-b75e4e32f09a (non-flash)
Nov 17 01:22:56 user nova-compute[75226]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:928c93b5-ae63-4e04-94ce-6059e7eaa7d6 (non-flash)
Nov 17 01:22:56 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:22:56 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:928c93b5-ae63-4e04-94ce-6059e7eaa7d6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.303s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:22:56 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Connected to 172.16.0.220:3260 {{(pid=75226) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 17 01:22:56 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] HCTL ('36', '-', '-', 0) found on session 19 with lun 0 {{(pid=75226) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 17 01:22:56 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75226) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 17 01:22:56 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:22:56 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:22:56 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff4476ba-9317-42d7-bfad-359b659c447d]: (4, ('- - 0', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:22:56 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Searching for a device in session 19 and hctl ['36', '*', '*', 0] yield: None {{(pid=75226) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 01:22:56 user nova-compute[75226]: DEBUG nova.network.neutron [req-9ce5fa4c-cf55-4ca5-bd42-9e1e38b1cb57 req-7b71e649-fed5-4dba-b462-0c7d917d4616 service nova] [instance: ddfecefc-1e9b-4e6e-9995-855c8a061084] Updated VIF entry in instance network info cache for port f9a7562b-de63-4374-b43b-18e3cb3af710. {{(pid=75226) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 01:22:56 user nova-compute[75226]: DEBUG nova.network.neutron [req-9ce5fa4c-cf55-4ca5-bd42-9e1e38b1cb57 req-7b71e649-fed5-4dba-b462-0c7d917d4616 service nova] [instance: ddfecefc-1e9b-4e6e-9995-855c8a061084] Updating instance_info_cache with network_info: [{"id": "f9a7562b-de63-4374-b43b-18e3cb3af710", "address": "fa:16:3e:94:21:00", "network": {"id": "8450ab2c-4f24-46cc-a6ec-644c02e2b3da", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-385219532-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6869af66e0cc47bf9cca02ea9b688a6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9a7562b-de", "ovs_interfaceid": "f9a7562b-de63-4374-b43b-18e3cb3af710", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:22:56 user nova-compute[75226]: INFO nova.virt.libvirt.driver [-] [instance: ddfecefc-1e9b-4e6e-9995-855c8a061084] Instance destroyed successfully.
Nov 17 01:22:56 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-9ce5fa4c-cf55-4ca5-bd42-9e1e38b1cb57 req-7b71e649-fed5-4dba-b462-0c7d917d4616 service nova] Releasing lock "refresh_cache-ddfecefc-1e9b-4e6e-9995-855c8a061084" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:22:56 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-c0ad2c49-2e0e-4e3b-8cc1-92b8bbbd5fcd tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] No BDM found with device name vda, not building metadata. {{(pid=75226) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 01:22:56 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-c0ad2c49-2e0e-4e3b-8cc1-92b8bbbd5fcd tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75226) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 01:22:56 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-c0ad2c49-2e0e-4e3b-8cc1-92b8bbbd5fcd tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] No VIF found with MAC fa:16:3e:ee:92:2e, not building metadata {{(pid=75226) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 01:22:56 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-c0ad2c49-2e0e-4e3b-8cc1-92b8bbbd5fcd tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] Lock "52fe0a91-9320-47d2-ac83-4f49260a0997" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.075s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:22:57 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Searching for a device in session 19 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75226) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 01:22:57 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:928c93b5-ae63-4e04-94ce-6059e7eaa7d6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gaMxGoKY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75226) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 17 01:22:57 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.333s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:22:57 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] <== connect_volume: return (2380ms) {'type': 'block', 'scsi_wwn': '23238326162653532', 'path': '/dev/sde'} {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:22:57 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23238326162653532', 'path': '/dev/sde'} {{(pid=75226) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 17 01:22:57 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Calling os-brick to attach iSCSI Volume {{(pid=75226) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 17 01:22:57 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc4cc36b490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:607b7fb8-097d-43ea-b13c-0825e015e14e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JLQISYnD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:22:57 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:22:57 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:22:57 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:22:57 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:22:57 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:607b7fb8-097d-43ea-b13c-0825e015e14e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:22:57 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:607b7fb8-097d-43ea-b13c-0825e015e14e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:22:57 user nova-compute[75226]: INFO os_brick.initiator.connectors.iscsi [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 17 01:22:57 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:607b7fb8-097d-43ea-b13c-0825e015e14e -p 172.16.0.220:3260 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:22:57 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:607b7fb8-097d-43ea-b13c-0825e015e14e -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:22:57 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[333e8381-916a-4175-ad70-32646a0ca604]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:22:57 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 17 01:22:57 user nova-compute[75226]:  {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:22:57 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:607b7fb8-097d-43ea-b13c-0825e015e14e -p 172.16.0.220:3260 --interface default --op new {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:22:57 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:607b7fb8-097d-43ea-b13c-0825e015e14e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:22:57 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[b23acd08-d4c6-485f-a482-b38f4d5a90e2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:607b7fb8-097d-43ea-b13c-0825e015e14e] added\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:22:57 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:607b7fb8-097d-43ea-b13c-0825e015e14e] added
Nov 17 01:22:57 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:22:57 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:607b7fb8-097d-43ea-b13c-0825e015e14e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:22:57 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:607b7fb8-097d-43ea-b13c-0825e015e14e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:22:57 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d7e4315-a429-402e-afbf-e8df1f2070c6]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:22:57 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:22:57 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:607b7fb8-097d-43ea-b13c-0825e015e14e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:22:57 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:607b7fb8-097d-43ea-b13c-0825e015e14e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:22:57 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[1874f899-bc68-4cc3-ac52-9483310dd752]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:22:57 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:22:57 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:607b7fb8-097d-43ea-b13c-0825e015e14e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JLQISYnD {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:22:57 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:607b7fb8-097d-43ea-b13c-0825e015e14e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JLQISYnD" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:22:57 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[a726e0f7-ecab-46c6-976f-adc30b4e92c1]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:22:57 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JLQISYnD'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:22:57 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:607b7fb8-097d-43ea-b13c-0825e015e14e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:22:57 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:607b7fb8-097d-43ea-b13c-0825e015e14e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:22:57 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[dab0a7a4-14d9-466a-8ed3-d90660a7f033]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:22:57 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:22:57 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:22:57 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:22:57 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[6024de0b-8095-4d7b-b202-952ab3a07a83]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa7be6d3-d525-4aa3-bcc3-481465f2832b (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8488f49-8126-431d-96f0-b75e4e32f09a (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:928c93b5-ae63-4e04-94ce-6059e7eaa7d6 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:22:57 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)
Nov 17 01:22:57 user nova-compute[75226]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa7be6d3-d525-4aa3-bcc3-481465f2832b (non-flash)
Nov 17 01:22:57 user nova-compute[75226]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8488f49-8126-431d-96f0-b75e4e32f09a (non-flash)
Nov 17 01:22:57 user nova-compute[75226]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:928c93b5-ae63-4e04-94ce-6059e7eaa7d6 (non-flash)
Nov 17 01:22:57 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:22:57 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)
Nov 17 01:22:57 user nova-compute[75226]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa7be6d3-d525-4aa3-bcc3-481465f2832b (non-flash)
Nov 17 01:22:57 user nova-compute[75226]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8488f49-8126-431d-96f0-b75e4e32f09a (non-flash)
Nov 17 01:22:57 user nova-compute[75226]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:928c93b5-ae63-4e04-94ce-6059e7eaa7d6 (non-flash)
Nov 17 01:22:57 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:22:57 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:607b7fb8-097d-43ea-b13c-0825e015e14e -p 172.16.0.220:3260 --login {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:22:57 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:22:57 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:607b7fb8-097d-43ea-b13c-0825e015e14e -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:22:57 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f58d354-a873-4d44-8141-9360f693da96]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:607b7fb8-097d-43ea-b13c-0825e015e14e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:607b7fb8-097d-43ea-b13c-0825e015e14e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:22:57 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:607b7fb8-097d-43ea-b13c-0825e015e14e, portal: 172.16.0.220,3260]
Nov 17 01:22:57 user nova-compute[75226]: Login to [iface: default, target: iqn.2010-10.org.openstack:607b7fb8-097d-43ea-b13c-0825e015e14e, portal: 172.16.0.220,3260] successful.
Nov 17 01:22:57 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:22:57 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:607b7fb8-097d-43ea-b13c-0825e015e14e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:22:57 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:607b7fb8-097d-43ea-b13c-0825e015e14e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:22:57 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a7cb398-1030-4ddb-a06c-50b9b5ff4992]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:22:57 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:22:57 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:22:57 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:22:57 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[3addd810-90c3-4827-8a3e-cddc16686b15]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa7be6d3-d525-4aa3-bcc3-481465f2832b (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8488f49-8126-431d-96f0-b75e4e32f09a (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:928c93b5-ae63-4e04-94ce-6059e7eaa7d6 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:607b7fb8-097d-43ea-b13c-0825e015e14e (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:22:57 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)
Nov 17 01:22:57 user nova-compute[75226]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa7be6d3-d525-4aa3-bcc3-481465f2832b (non-flash)
Nov 17 01:22:57 user nova-compute[75226]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8488f49-8126-431d-96f0-b75e4e32f09a (non-flash)
Nov 17 01:22:57 user nova-compute[75226]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:928c93b5-ae63-4e04-94ce-6059e7eaa7d6 (non-flash)
Nov 17 01:22:57 user nova-compute[75226]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:607b7fb8-097d-43ea-b13c-0825e015e14e (non-flash)
Nov 17 01:22:57 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:22:57 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)
Nov 17 01:22:57 user nova-compute[75226]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa7be6d3-d525-4aa3-bcc3-481465f2832b (non-flash)
Nov 17 01:22:57 user nova-compute[75226]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8488f49-8126-431d-96f0-b75e4e32f09a (non-flash)
Nov 17 01:22:57 user nova-compute[75226]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:928c93b5-ae63-4e04-94ce-6059e7eaa7d6 (non-flash)
Nov 17 01:22:57 user nova-compute[75226]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:607b7fb8-097d-43ea-b13c-0825e015e14e (non-flash)
Nov 17 01:22:57 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:22:57 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:607b7fb8-097d-43ea-b13c-0825e015e14e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.293s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:22:57 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Connected to 172.16.0.220:3260 {{(pid=75226) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 17 01:22:57 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] HCTL ('37', '-', '-', 0) found on session 20 with lun 0 {{(pid=75226) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 17 01:22:57 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75226) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 17 01:22:57 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:22:57 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:22:57 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9305a4e-a9d1-45f1-9dd2-0a4f3aad98a6]: (4, ('- - 0', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:22:57 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Searching for a device in session 20 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75226) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 01:22:57 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:607b7fb8-097d-43ea-b13c-0825e015e14e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JLQISYnD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75226) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 17 01:22:57 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:22:57 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:22:57 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:22:57 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:22:57 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:22:57 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:22:57 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:22:58 user nova-compute[75226]: DEBUG nova.compute.manager [req-debeaa83-f01b-4970-92bd-342c018cabdf req-a49a5f36-24e0-4e48-a822-64a9b2a66b30 service nova] [instance: ddfecefc-1e9b-4e6e-9995-855c8a061084] Received event network-vif-plugged-f9a7562b-de63-4374-b43b-18e3cb3af710 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:22:58 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-debeaa83-f01b-4970-92bd-342c018cabdf req-a49a5f36-24e0-4e48-a822-64a9b2a66b30 service nova] Acquiring lock "ddfecefc-1e9b-4e6e-9995-855c8a061084-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:22:58 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-debeaa83-f01b-4970-92bd-342c018cabdf req-a49a5f36-24e0-4e48-a822-64a9b2a66b30 service nova] Lock "ddfecefc-1e9b-4e6e-9995-855c8a061084-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:22:58 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-debeaa83-f01b-4970-92bd-342c018cabdf req-a49a5f36-24e0-4e48-a822-64a9b2a66b30 service nova] Lock "ddfecefc-1e9b-4e6e-9995-855c8a061084-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:22:58 user nova-compute[75226]: DEBUG nova.compute.manager [req-debeaa83-f01b-4970-92bd-342c018cabdf req-a49a5f36-24e0-4e48-a822-64a9b2a66b30 service nova] [instance: ddfecefc-1e9b-4e6e-9995-855c8a061084] No waiting events found dispatching network-vif-plugged-f9a7562b-de63-4374-b43b-18e3cb3af710 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:22:58 user nova-compute[75226]: WARNING nova.compute.manager [req-debeaa83-f01b-4970-92bd-342c018cabdf req-a49a5f36-24e0-4e48-a822-64a9b2a66b30 service nova] [instance: ddfecefc-1e9b-4e6e-9995-855c8a061084] Received unexpected event network-vif-plugged-f9a7562b-de63-4374-b43b-18e3cb3af710 for instance with vm_state rescued and task_state unrescuing.
Nov 17 01:22:58 user nova-compute[75226]: DEBUG nova.compute.manager [req-9f883268-7699-46a8-a242-a51a5b05fbf7 req-979cc169-de76-4883-ab25-37f7cbd073ca service nova] [instance: ddfecefc-1e9b-4e6e-9995-855c8a061084] Received event network-changed-f9a7562b-de63-4374-b43b-18e3cb3af710 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:22:58 user nova-compute[75226]: DEBUG nova.compute.manager [req-9f883268-7699-46a8-a242-a51a5b05fbf7 req-979cc169-de76-4883-ab25-37f7cbd073ca service nova] [instance: ddfecefc-1e9b-4e6e-9995-855c8a061084] Refreshing instance network info cache due to event network-changed-f9a7562b-de63-4374-b43b-18e3cb3af710. {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 01:22:58 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-9f883268-7699-46a8-a242-a51a5b05fbf7 req-979cc169-de76-4883-ab25-37f7cbd073ca service nova] Acquiring lock "refresh_cache-ddfecefc-1e9b-4e6e-9995-855c8a061084" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:22:58 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-9f883268-7699-46a8-a242-a51a5b05fbf7 req-979cc169-de76-4883-ab25-37f7cbd073ca service nova] Acquired lock "refresh_cache-ddfecefc-1e9b-4e6e-9995-855c8a061084" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:22:58 user nova-compute[75226]: DEBUG nova.network.neutron [req-9f883268-7699-46a8-a242-a51a5b05fbf7 req-979cc169-de76-4883-ab25-37f7cbd073ca service nova] [instance: ddfecefc-1e9b-4e6e-9995-855c8a061084] Refreshing network info cache for port f9a7562b-de63-4374-b43b-18e3cb3af710 {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 01:22:58 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:22:58 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.326s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:22:58 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] <== connect_volume: return (1327ms) {'type': 'block', 'scsi_wwn': '23364626163313365', 'path': '/dev/sdf'} {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:22:58 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23364626163313365', 'path': '/dev/sdf'} {{(pid=75226) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 17 01:22:58 user nova-compute[75226]: DEBUG nova.network.neutron [req-9f883268-7699-46a8-a242-a51a5b05fbf7 req-979cc169-de76-4883-ab25-37f7cbd073ca service nova] [instance: ddfecefc-1e9b-4e6e-9995-855c8a061084] Updated VIF entry in instance network info cache for port f9a7562b-de63-4374-b43b-18e3cb3af710. {{(pid=75226) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 01:22:58 user nova-compute[75226]: DEBUG nova.network.neutron [req-9f883268-7699-46a8-a242-a51a5b05fbf7 req-979cc169-de76-4883-ab25-37f7cbd073ca service nova] [instance: ddfecefc-1e9b-4e6e-9995-855c8a061084] Updating instance_info_cache with network_info: [{"id": "f9a7562b-de63-4374-b43b-18e3cb3af710", "address": "fa:16:3e:94:21:00", "network": {"id": "8450ab2c-4f24-46cc-a6ec-644c02e2b3da", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-385219532-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6869af66e0cc47bf9cca02ea9b688a6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9a7562b-de", "ovs_interfaceid": "f9a7562b-de63-4374-b43b-18e3cb3af710", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:22:58 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Calling os-brick to attach iSCSI Volume {{(pid=75226) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 17 01:22:58 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc4cc36b490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1b95a10d-6f61-48de-b7e5-de732f65f408', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bdGTAkEp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:22:58 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:22:58 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:22:58 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:22:58 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:22:58 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1b95a10d-6f61-48de-b7e5-de732f65f408" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:22:58 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1b95a10d-6f61-48de-b7e5-de732f65f408" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:22:58 user nova-compute[75226]: INFO os_brick.initiator.connectors.iscsi [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 17 01:22:58 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-9f883268-7699-46a8-a242-a51a5b05fbf7 req-979cc169-de76-4883-ab25-37f7cbd073ca service nova] Releasing lock "refresh_cache-ddfecefc-1e9b-4e6e-9995-855c8a061084" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:22:58 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b95a10d-6f61-48de-b7e5-de732f65f408 -p 172.16.0.220:3260 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:22:58 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b95a10d-6f61-48de-b7e5-de732f65f408 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:22:58 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb9474bd-73d7-45d2-95e0-c67eaf6c9fe9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:22:58 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 17 01:22:58 user nova-compute[75226]:  {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:22:58 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b95a10d-6f61-48de-b7e5-de732f65f408 -p 172.16.0.220:3260 --interface default --op new {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:22:58 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b95a10d-6f61-48de-b7e5-de732f65f408 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:22:58 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[19ca4a35-aa3e-43f7-8d5d-576453d1e06a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1b95a10d-6f61-48de-b7e5-de732f65f408] added\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:22:58 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1b95a10d-6f61-48de-b7e5-de732f65f408] added
Nov 17 01:22:58 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:22:58 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b95a10d-6f61-48de-b7e5-de732f65f408 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:22:58 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:22:58 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:22:58 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b95a10d-6f61-48de-b7e5-de732f65f408 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:22:58 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[0582ef37-b4cb-4495-89ba-e40b9e03872d]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:22:58 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:22:58 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b95a10d-6f61-48de-b7e5-de732f65f408 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:22:58 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:22:58 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b95a10d-6f61-48de-b7e5-de732f65f408 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:22:58 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f9f5497-1dc8-456e-884e-1b997a49fdd7]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:22:58 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:22:58 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b95a10d-6f61-48de-b7e5-de732f65f408 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bdGTAkEp {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:22:58 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b95a10d-6f61-48de-b7e5-de732f65f408 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bdGTAkEp" returned: 0 in 0.023s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:22:58 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe5b79da-e9d2-4bfd-9e13-794704bfefe0]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:22:58 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bdGTAkEp'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:22:58 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b95a10d-6f61-48de-b7e5-de732f65f408 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:22:58 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b95a10d-6f61-48de-b7e5-de732f65f408 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:22:58 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[beb3f937-f3a2-4649-9c71-fb76189065cb]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:22:58 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:22:58 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:22:58 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:22:58 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa654e32-674c-45da-952b-4b9273533be6]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa7be6d3-d525-4aa3-bcc3-481465f2832b (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8488f49-8126-431d-96f0-b75e4e32f09a (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:928c93b5-ae63-4e04-94ce-6059e7eaa7d6 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:607b7fb8-097d-43ea-b13c-0825e015e14e (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:22:58 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)
Nov 17 01:22:58 user nova-compute[75226]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa7be6d3-d525-4aa3-bcc3-481465f2832b (non-flash)
Nov 17 01:22:58 user nova-compute[75226]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8488f49-8126-431d-96f0-b75e4e32f09a (non-flash)
Nov 17 01:22:58 user nova-compute[75226]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:928c93b5-ae63-4e04-94ce-6059e7eaa7d6 (non-flash)
Nov 17 01:22:58 user nova-compute[75226]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:607b7fb8-097d-43ea-b13c-0825e015e14e (non-flash)
Nov 17 01:22:58 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:22:58 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)
Nov 17 01:22:58 user nova-compute[75226]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa7be6d3-d525-4aa3-bcc3-481465f2832b (non-flash)
Nov 17 01:22:58 user nova-compute[75226]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8488f49-8126-431d-96f0-b75e4e32f09a (non-flash)
Nov 17 01:22:58 user nova-compute[75226]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:928c93b5-ae63-4e04-94ce-6059e7eaa7d6 (non-flash)
Nov 17 01:22:58 user nova-compute[75226]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:607b7fb8-097d-43ea-b13c-0825e015e14e (non-flash)
Nov 17 01:22:58 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:22:58 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b95a10d-6f61-48de-b7e5-de732f65f408 -p 172.16.0.220:3260 --login {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:22:58 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b95a10d-6f61-48de-b7e5-de732f65f408 -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:22:58 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cf71cdd-321c-4547-b432-ee85b22c94da]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1b95a10d-6f61-48de-b7e5-de732f65f408, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1b95a10d-6f61-48de-b7e5-de732f65f408, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:22:58 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1b95a10d-6f61-48de-b7e5-de732f65f408, portal: 172.16.0.220,3260]
Nov 17 01:22:58 user nova-compute[75226]: Login to [iface: default, target: iqn.2010-10.org.openstack:1b95a10d-6f61-48de-b7e5-de732f65f408, portal: 172.16.0.220,3260] successful.
Nov 17 01:22:58 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:22:58 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b95a10d-6f61-48de-b7e5-de732f65f408 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:22:58 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b95a10d-6f61-48de-b7e5-de732f65f408 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:22:58 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[34f00ede-9836-4ba3-825a-f57e4d46de03]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:22:58 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:22:58 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:22:58 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:22:58 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5943ecd-d8bb-4878-9f7d-f8d30f68c756]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa7be6d3-d525-4aa3-bcc3-481465f2832b (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8488f49-8126-431d-96f0-b75e4e32f09a (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:928c93b5-ae63-4e04-94ce-6059e7eaa7d6 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:607b7fb8-097d-43ea-b13c-0825e015e14e (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b95a10d-6f61-48de-b7e5-de732f65f408 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:22:58 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)
Nov 17 01:22:58 user nova-compute[75226]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa7be6d3-d525-4aa3-bcc3-481465f2832b (non-flash)
Nov 17 01:22:58 user nova-compute[75226]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8488f49-8126-431d-96f0-b75e4e32f09a (non-flash)
Nov 17 01:22:58 user nova-compute[75226]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:928c93b5-ae63-4e04-94ce-6059e7eaa7d6 (non-flash)
Nov 17 01:22:58 user nova-compute[75226]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:607b7fb8-097d-43ea-b13c-0825e015e14e (non-flash)
Nov 17 01:22:58 user nova-compute[75226]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b95a10d-6f61-48de-b7e5-de732f65f408 (non-flash)
Nov 17 01:22:58 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:22:58 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)
Nov 17 01:22:58 user nova-compute[75226]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa7be6d3-d525-4aa3-bcc3-481465f2832b (non-flash)
Nov 17 01:22:58 user nova-compute[75226]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8488f49-8126-431d-96f0-b75e4e32f09a (non-flash)
Nov 17 01:22:58 user nova-compute[75226]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:928c93b5-ae63-4e04-94ce-6059e7eaa7d6 (non-flash)
Nov 17 01:22:58 user nova-compute[75226]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:607b7fb8-097d-43ea-b13c-0825e015e14e (non-flash)
Nov 17 01:22:58 user nova-compute[75226]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b95a10d-6f61-48de-b7e5-de732f65f408 (non-flash)
Nov 17 01:22:58 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:22:58 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1b95a10d-6f61-48de-b7e5-de732f65f408" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.338s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:22:58 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Connected to 172.16.0.220:3260 {{(pid=75226) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 17 01:22:58 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] HCTL ('38', '-', '-', 0) found on session 21 with lun 0 {{(pid=75226) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 17 01:22:58 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75226) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 17 01:22:58 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:22:58 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:22:58 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d82bbf5-0240-4305-8d2a-01ebde9c6c27]: (4, ('- - 0', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:22:58 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Searching for a device in session 21 and hctl ['38', '*', '*', 0] yield: None {{(pid=75226) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 01:22:59 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-63f3b3eb-5286-4387-a6cd-a36b65ac5e79 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] Acquiring lock "52fe0a91-9320-47d2-ac83-4f49260a0997" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:22:59 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-63f3b3eb-5286-4387-a6cd-a36b65ac5e79 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] Lock "52fe0a91-9320-47d2-ac83-4f49260a0997" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:22:59 user nova-compute[75226]: INFO nova.compute.manager [None req-63f3b3eb-5286-4387-a6cd-a36b65ac5e79 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] [instance: 52fe0a91-9320-47d2-ac83-4f49260a0997] Detaching volume f8488f49-8126-431d-96f0-b75e4e32f09a
Nov 17 01:22:59 user nova-compute[75226]: INFO nova.virt.block_device [None req-63f3b3eb-5286-4387-a6cd-a36b65ac5e79 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] [instance: 52fe0a91-9320-47d2-ac83-4f49260a0997] Attempting to driver detach volume f8488f49-8126-431d-96f0-b75e4e32f09a from mountpoint /dev/vdb
Nov 17 01:22:59 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-63f3b3eb-5286-4387-a6cd-a36b65ac5e79 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] Attempting to detach device vdb from instance 52fe0a91-9320-47d2-ac83-4f49260a0997 from the persistent domain config. {{(pid=75226) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 17 01:22:59 user nova-compute[75226]: DEBUG nova.virt.libvirt.guest [None req-63f3b3eb-5286-4387-a6cd-a36b65ac5e79 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] detach device xml: <disk type="block" device="disk">
Nov 17 01:22:59 user nova-compute[75226]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 01:22:59 user nova-compute[75226]:   <source dev="/dev/sdb"/>
Nov 17 01:22:59 user nova-compute[75226]:   <target dev="vdb" bus="virtio"/>
Nov 17 01:22:59 user nova-compute[75226]:   <serial>f8488f49-8126-431d-96f0-b75e4e32f09a</serial>
Nov 17 01:22:59 user nova-compute[75226]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 17 01:22:59 user nova-compute[75226]: </disk>
Nov 17 01:22:59 user nova-compute[75226]:  {{(pid=75226) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 17 01:22:59 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-63f3b3eb-5286-4387-a6cd-a36b65ac5e79 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] Successfully detached device vdb from instance 52fe0a91-9320-47d2-ac83-4f49260a0997 from the persistent domain config.
Nov 17 01:22:59 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-63f3b3eb-5286-4387-a6cd-a36b65ac5e79 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 52fe0a91-9320-47d2-ac83-4f49260a0997 from the live domain config. {{(pid=75226) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 17 01:22:59 user nova-compute[75226]: DEBUG nova.virt.libvirt.guest [None req-63f3b3eb-5286-4387-a6cd-a36b65ac5e79 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] detach device xml: <disk type="block" device="disk">
Nov 17 01:22:59 user nova-compute[75226]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 01:22:59 user nova-compute[75226]:   <source dev="/dev/sdb"/>
Nov 17 01:22:59 user nova-compute[75226]:   <target dev="vdb" bus="virtio"/>
Nov 17 01:22:59 user nova-compute[75226]:   <serial>f8488f49-8126-431d-96f0-b75e4e32f09a</serial>
Nov 17 01:22:59 user nova-compute[75226]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 17 01:22:59 user nova-compute[75226]: </disk>
Nov 17 01:22:59 user nova-compute[75226]:  {{(pid=75226) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 17 01:22:59 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-63f3b3eb-5286-4387-a6cd-a36b65ac5e79 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 52fe0a91-9320-47d2-ac83-4f49260a0997 {{(pid=75226) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 17 01:22:59 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Searching for a device in session 21 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75226) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 01:22:59 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:1b95a10d-6f61-48de-b7e5-de732f65f408', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bdGTAkEp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75226) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 17 01:22:59 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.368s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:22:59 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] <== connect_volume: return (1370ms) {'type': 'block', 'scsi_wwn': '26339616664303534', 'path': '/dev/sdg'} {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:22:59 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26339616664303534', 'path': '/dev/sdg'} {{(pid=75226) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 17 01:22:59 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-17T01:22:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1270422690',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1270422690',id=18,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFadtk54Tkvk6AHpu0dnlPf3MeX++Xu/axCXDSKF9N/sLaR9IMdsD+WpKf3bG29Bs36DoaNYGITDbnkh7PpUjSy8pAnsUxMlIERAERRQjtXzSRjHfrt6XPTg8j13L2IqSQ==',key_name='tempest-keypair-1791766942',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='60fce4eef0d24de0a320670623085bb6',ramdisk_id='',reservation_id='r-w2e090td',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1246897470',owner_user_name='tempest-TaggedBootDevicesTest_v242-1246897470-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T01:22:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='85f6f2dd0ff44b33874cde7e2e36482c',uuid=663933b0-95dc-4fba-b411-029f0552571d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "462b7d76-b8d0-4374-8b29-da083c4ec28f", "address": "fa:16:3e:e5:9d:a6", "network": {"id": "3e4d69ef-0f6d-4d32-bcfa-0cae712a750e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1270397153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60fce4eef0d24de0a320670623085bb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap462b7d76-b8", "ovs_interfaceid": "462b7d76-b8d0-4374-8b29-da083c4ec28f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75226) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 01:22:59 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Converting VIF {"id": "462b7d76-b8d0-4374-8b29-da083c4ec28f", "address": "fa:16:3e:e5:9d:a6", "network": {"id": "3e4d69ef-0f6d-4d32-bcfa-0cae712a750e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1270397153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60fce4eef0d24de0a320670623085bb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap462b7d76-b8", "ovs_interfaceid": "462b7d76-b8d0-4374-8b29-da083c4ec28f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:22:59 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:9d:a6,bridge_name='br-int',has_traffic_filtering=True,id=462b7d76-b8d0-4374-8b29-da083c4ec28f,network=Network(3e4d69ef-0f6d-4d32-bcfa-0cae712a750e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap462b7d76-b8') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:22:59 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-17T01:22:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1270422690',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1270422690',id=18,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFadtk54Tkvk6AHpu0dnlPf3MeX++Xu/axCXDSKF9N/sLaR9IMdsD+WpKf3bG29Bs36DoaNYGITDbnkh7PpUjSy8pAnsUxMlIERAERRQjtXzSRjHfrt6XPTg8j13L2IqSQ==',key_name='tempest-keypair-1791766942',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='60fce4eef0d24de0a320670623085bb6',ramdisk_id='',reservation_id='r-w2e090td',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1246897470',owner_user_name='tempest-TaggedBootDevicesTest_v242-1246897470-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T01:22:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='85f6f2dd0ff44b33874cde7e2e36482c',uuid=663933b0-95dc-4fba-b411-029f0552571d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6bcf1322-1aad-4ffa-9231-7273376e4572", "address": "fa:16:3e:74:57:6e", "network": {"id": "a8dd3d50-aad0-4fe6-8986-98d0400bcaec", "bridge": "br-int", "label": "tempest-device-tagging-net1-1117474203", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.96", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "60fce4eef0d24de0a320670623085bb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bcf1322-1a", "ovs_interfaceid": "6bcf1322-1aad-4ffa-9231-7273376e4572", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75226) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 01:22:59 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Converting VIF {"id": "6bcf1322-1aad-4ffa-9231-7273376e4572", "address": "fa:16:3e:74:57:6e", "network": {"id": "a8dd3d50-aad0-4fe6-8986-98d0400bcaec", "bridge": "br-int", "label": "tempest-device-tagging-net1-1117474203", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.96", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "60fce4eef0d24de0a320670623085bb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bcf1322-1a", "ovs_interfaceid": "6bcf1322-1aad-4ffa-9231-7273376e4572", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:22:59 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:57:6e,bridge_name='br-int',has_traffic_filtering=True,id=6bcf1322-1aad-4ffa-9231-7273376e4572,network=Network(a8dd3d50-aad0-4fe6-8986-98d0400bcaec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6bcf1322-1a') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:22:59 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-17T01:22:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1270422690',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1270422690',id=18,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFadtk54Tkvk6AHpu0dnlPf3MeX++Xu/axCXDSKF9N/sLaR9IMdsD+WpKf3bG29Bs36DoaNYGITDbnkh7PpUjSy8pAnsUxMlIERAERRQjtXzSRjHfrt6XPTg8j13L2IqSQ==',key_name='tempest-keypair-1791766942',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='60fce4eef0d24de0a320670623085bb6',ramdisk_id='',reservation_id='r-w2e090td',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1246897470',owner_user_name='tempest-TaggedBootDevicesTest_v242-1246897470-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T01:22:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='85f6f2dd0ff44b33874cde7e2e36482c',uuid=663933b0-95dc-4fba-b411-029f0552571d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fbacd963-6a62-4682-89a2-27f92a9f0ff2", "address": "fa:16:3e:34:dd:56", "network": {"id": "a8dd3d50-aad0-4fe6-8986-98d0400bcaec", "bridge": "br-int", "label": "tempest-device-tagging-net1-1117474203", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "60fce4eef0d24de0a320670623085bb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbacd963-6a", "ovs_interfaceid": "fbacd963-6a62-4682-89a2-27f92a9f0ff2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75226) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 01:22:59 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Converting VIF {"id": "fbacd963-6a62-4682-89a2-27f92a9f0ff2", "address": "fa:16:3e:34:dd:56", "network": {"id": "a8dd3d50-aad0-4fe6-8986-98d0400bcaec", "bridge": "br-int", "label": "tempest-device-tagging-net1-1117474203", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "60fce4eef0d24de0a320670623085bb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbacd963-6a", "ovs_interfaceid": "fbacd963-6a62-4682-89a2-27f92a9f0ff2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:22:59 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:dd:56,bridge_name='br-int',has_traffic_filtering=True,id=fbacd963-6a62-4682-89a2-27f92a9f0ff2,network=Network(a8dd3d50-aad0-4fe6-8986-98d0400bcaec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfbacd963-6a') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:22:59 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-17T01:22:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1270422690',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1270422690',id=18,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFadtk54Tkvk6AHpu0dnlPf3MeX++Xu/axCXDSKF9N/sLaR9IMdsD+WpKf3bG29Bs36DoaNYGITDbnkh7PpUjSy8pAnsUxMlIERAERRQjtXzSRjHfrt6XPTg8j13L2IqSQ==',key_name='tempest-keypair-1791766942',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='60fce4eef0d24de0a320670623085bb6',ramdisk_id='',reservation_id='r-w2e090td',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1246897470',owner_user_name='tempest-TaggedBootDevicesTest_v242-1246897470-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T01:22:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='85f6f2dd0ff44b33874cde7e2e36482c',uuid=663933b0-95dc-4fba-b411-029f0552571d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "46134046-ef40-4332-aa3f-044beaf6f991", "address": "fa:16:3e:d8:00:e9", "network": {"id": "a8dd3d50-aad0-4fe6-8986-98d0400bcaec", "bridge": "br-int", "label": "tempest-device-tagging-net1-1117474203", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "60fce4eef0d24de0a320670623085bb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46134046-ef", "ovs_interfaceid": "46134046-ef40-4332-aa3f-044beaf6f991", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75226) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 01:22:59 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Converting VIF {"id": "46134046-ef40-4332-aa3f-044beaf6f991", "address": "fa:16:3e:d8:00:e9", "network": {"id": "a8dd3d50-aad0-4fe6-8986-98d0400bcaec", "bridge": "br-int", "label": "tempest-device-tagging-net1-1117474203", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "60fce4eef0d24de0a320670623085bb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46134046-ef", "ovs_interfaceid": "46134046-ef40-4332-aa3f-044beaf6f991", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:22:59 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:00:e9,bridge_name='br-int',has_traffic_filtering=True,id=46134046-ef40-4332-aa3f-044beaf6f991,network=Network(a8dd3d50-aad0-4fe6-8986-98d0400bcaec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46134046-ef') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:22:59 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-17T01:22:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1270422690',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1270422690',id=18,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFadtk54Tkvk6AHpu0dnlPf3MeX++Xu/axCXDSKF9N/sLaR9IMdsD+WpKf3bG29Bs36DoaNYGITDbnkh7PpUjSy8pAnsUxMlIERAERRQjtXzSRjHfrt6XPTg8j13L2IqSQ==',key_name='tempest-keypair-1791766942',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='60fce4eef0d24de0a320670623085bb6',ramdisk_id='',reservation_id='r-w2e090td',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1246897470',owner_user_name='tempest-TaggedBootDevicesTest_v242-1246897470-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T01:22:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='85f6f2dd0ff44b33874cde7e2e36482c',uuid=663933b0-95dc-4fba-b411-029f0552571d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "24888c49-a7a9-4f44-8f95-1174dba77750", "address": "fa:16:3e:38:2a:e5", "network": {"id": "a8dd3d50-aad0-4fe6-8986-98d0400bcaec", "bridge": "br-int", "label": "tempest-device-tagging-net1-1117474203", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "60fce4eef0d24de0a320670623085bb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24888c49-a7", "ovs_interfaceid": "24888c49-a7a9-4f44-8f95-1174dba77750", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75226) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 01:22:59 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Converting VIF {"id": "24888c49-a7a9-4f44-8f95-1174dba77750", "address": "fa:16:3e:38:2a:e5", "network": {"id": "a8dd3d50-aad0-4fe6-8986-98d0400bcaec", "bridge": "br-int", "label": "tempest-device-tagging-net1-1117474203", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "60fce4eef0d24de0a320670623085bb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24888c49-a7", "ovs_interfaceid": "24888c49-a7a9-4f44-8f95-1174dba77750", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:22:59 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:2a:e5,bridge_name='br-int',has_traffic_filtering=True,id=24888c49-a7a9-4f44-8f95-1174dba77750,network=Network(a8dd3d50-aad0-4fe6-8986-98d0400bcaec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24888c49-a7') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:22:59 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-17T01:22:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1270422690',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1270422690',id=18,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFadtk54Tkvk6AHpu0dnlPf3MeX++Xu/axCXDSKF9N/sLaR9IMdsD+WpKf3bG29Bs36DoaNYGITDbnkh7PpUjSy8pAnsUxMlIERAERRQjtXzSRjHfrt6XPTg8j13L2IqSQ==',key_name='tempest-keypair-1791766942',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='60fce4eef0d24de0a320670623085bb6',ramdisk_id='',reservation_id='r-w2e090td',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1246897470',owner_user_name='tempest-TaggedBootDevicesTest_v242-1246897470-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T01:22:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='85f6f2dd0ff44b33874cde7e2e36482c',uuid=663933b0-95dc-4fba-b411-029f0552571d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5f7ca871-040f-460c-8709-7ca74ca282ba", "address": "fa:16:3e:4b:05:65", "network": {"id": "5cee0137-a429-434d-a7ce-0a8d2f9e41ea", "bridge": "br-int", "label": "tempest-device-tagging-net2-1427092874", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "60fce4eef0d24de0a320670623085bb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f7ca871-04", "ovs_interfaceid": "5f7ca871-040f-460c-8709-7ca74ca282ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75226) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 01:22:59 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Converting VIF {"id": "5f7ca871-040f-460c-8709-7ca74ca282ba", "address": "fa:16:3e:4b:05:65", "network": {"id": "5cee0137-a429-434d-a7ce-0a8d2f9e41ea", "bridge": "br-int", "label": "tempest-device-tagging-net2-1427092874", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "60fce4eef0d24de0a320670623085bb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f7ca871-04", "ovs_interfaceid": "5f7ca871-040f-460c-8709-7ca74ca282ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:22:59 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:05:65,bridge_name='br-int',has_traffic_filtering=True,id=5f7ca871-040f-460c-8709-7ca74ca282ba,network=Network(5cee0137-a429-434d-a7ce-0a8d2f9e41ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f7ca871-04') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:22:59 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-17T01:22:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1270422690',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1270422690',id=18,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFadtk54Tkvk6AHpu0dnlPf3MeX++Xu/axCXDSKF9N/sLaR9IMdsD+WpKf3bG29Bs36DoaNYGITDbnkh7PpUjSy8pAnsUxMlIERAERRQjtXzSRjHfrt6XPTg8j13L2IqSQ==',key_name='tempest-keypair-1791766942',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='60fce4eef0d24de0a320670623085bb6',ramdisk_id='',reservation_id='r-w2e090td',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1246897470',owner_user_name='tempest-TaggedBootDevicesTest_v242-1246897470-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T01:22:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='85f6f2dd0ff44b33874cde7e2e36482c',uuid=663933b0-95dc-4fba-b411-029f0552571d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "153c3e02-4aa9-4b9f-b03d-229f12e2ed68", "address": "fa:16:3e:a1:1f:ee", "network": {"id": "5cee0137-a429-434d-a7ce-0a8d2f9e41ea", "bridge": "br-int", "label": "tempest-device-tagging-net2-1427092874", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "60fce4eef0d24de0a320670623085bb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap153c3e02-4a", "ovs_interfaceid": "153c3e02-4aa9-4b9f-b03d-229f12e2ed68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75226) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 01:22:59 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Converting VIF {"id": "153c3e02-4aa9-4b9f-b03d-229f12e2ed68", "address": "fa:16:3e:a1:1f:ee", "network": {"id": "5cee0137-a429-434d-a7ce-0a8d2f9e41ea", "bridge": "br-int", "label": "tempest-device-tagging-net2-1427092874", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "60fce4eef0d24de0a320670623085bb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap153c3e02-4a", "ovs_interfaceid": "153c3e02-4aa9-4b9f-b03d-229f12e2ed68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:22:59 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:1f:ee,bridge_name='br-int',has_traffic_filtering=True,id=153c3e02-4aa9-4b9f-b03d-229f12e2ed68,network=Network(5cee0137-a429-434d-a7ce-0a8d2f9e41ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap153c3e02-4a') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:22:59 user nova-compute[75226]: DEBUG nova.objects.instance [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Lazy-loading 'pci_devices' on Instance uuid 663933b0-95dc-4fba-b411-029f0552571d {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:22:59 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:22:59 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:22:59 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:22:59 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:23:00 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:23:00 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:23:00 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:23:00 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75226) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 17 01:23:00 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] [instance: 663933b0-95dc-4fba-b411-029f0552571d] End _get_guest_xml xml=<domain type="kvm">
Nov 17 01:23:00 user nova-compute[75226]:   <uuid>663933b0-95dc-4fba-b411-029f0552571d</uuid>
Nov 17 01:23:00 user nova-compute[75226]:   <name>instance-00000012</name>
Nov 17 01:23:00 user nova-compute[75226]:   <memory>524288</memory>
Nov 17 01:23:00 user nova-compute[75226]:   <vcpu>1</vcpu>
Nov 17 01:23:00 user nova-compute[75226]:   <metadata>
Nov 17 01:23:00 user nova-compute[75226]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 17 01:23:00 user nova-compute[75226]:       <nova:package version="0.0.0"/>
Nov 17 01:23:00 user nova-compute[75226]:       <nova:name>tempest-device-tagging-server-1270422690</nova:name>
Nov 17 01:23:00 user nova-compute[75226]:       <nova:creationTime>2023-11-17 01:22:54</nova:creationTime>
Nov 17 01:23:00 user nova-compute[75226]:       <nova:flavor name="m1.tiny">
Nov 17 01:23:00 user nova-compute[75226]:         <nova:memory>512</nova:memory>
Nov 17 01:23:00 user nova-compute[75226]:         <nova:disk>1</nova:disk>
Nov 17 01:23:00 user nova-compute[75226]:         <nova:swap>0</nova:swap>
Nov 17 01:23:00 user nova-compute[75226]:         <nova:ephemeral>0</nova:ephemeral>
Nov 17 01:23:00 user nova-compute[75226]:         <nova:vcpus>1</nova:vcpus>
Nov 17 01:23:00 user nova-compute[75226]:       </nova:flavor>
Nov 17 01:23:00 user nova-compute[75226]:       <nova:owner>
Nov 17 01:23:00 user nova-compute[75226]:         <nova:user uuid="85f6f2dd0ff44b33874cde7e2e36482c">tempest-TaggedBootDevicesTest_v242-1246897470-project-member</nova:user>
Nov 17 01:23:00 user nova-compute[75226]:         <nova:project uuid="60fce4eef0d24de0a320670623085bb6">tempest-TaggedBootDevicesTest_v242-1246897470</nova:project>
Nov 17 01:23:00 user nova-compute[75226]:       </nova:owner>
Nov 17 01:23:00 user nova-compute[75226]:       <nova:root type="image" uuid="0b369aea-6f3f-4690-9f01-229b90ab6310"/>
Nov 17 01:23:00 user nova-compute[75226]:       <nova:ports>
Nov 17 01:23:00 user nova-compute[75226]:         <nova:port uuid="462b7d76-b8d0-4374-8b29-da083c4ec28f">
Nov 17 01:23:00 user nova-compute[75226]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 17 01:23:00 user nova-compute[75226]:         </nova:port>
Nov 17 01:23:00 user nova-compute[75226]:         <nova:port uuid="6bcf1322-1aad-4ffa-9231-7273376e4572">
Nov 17 01:23:00 user nova-compute[75226]:           <nova:ip type="fixed" address="10.1.1.96" ipVersion="4"/>
Nov 17 01:23:00 user nova-compute[75226]:         </nova:port>
Nov 17 01:23:00 user nova-compute[75226]:         <nova:port uuid="fbacd963-6a62-4682-89a2-27f92a9f0ff2">
Nov 17 01:23:00 user nova-compute[75226]:           <nova:ip type="fixed" address="10.1.1.178" ipVersion="4"/>
Nov 17 01:23:00 user nova-compute[75226]:         </nova:port>
Nov 17 01:23:00 user nova-compute[75226]:         <nova:port uuid="46134046-ef40-4332-aa3f-044beaf6f991">
Nov 17 01:23:00 user nova-compute[75226]:           <nova:ip type="fixed" address="10.1.1.108" ipVersion="4"/>
Nov 17 01:23:00 user nova-compute[75226]:         </nova:port>
Nov 17 01:23:00 user nova-compute[75226]:         <nova:port uuid="24888c49-a7a9-4f44-8f95-1174dba77750">
Nov 17 01:23:00 user nova-compute[75226]:           <nova:ip type="fixed" address="10.1.1.85" ipVersion="4"/>
Nov 17 01:23:00 user nova-compute[75226]:         </nova:port>
Nov 17 01:23:00 user nova-compute[75226]:         <nova:port uuid="5f7ca871-040f-460c-8709-7ca74ca282ba">
Nov 17 01:23:00 user nova-compute[75226]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 17 01:23:00 user nova-compute[75226]:         </nova:port>
Nov 17 01:23:00 user nova-compute[75226]:         <nova:port uuid="153c3e02-4aa9-4b9f-b03d-229f12e2ed68">
Nov 17 01:23:00 user nova-compute[75226]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 17 01:23:00 user nova-compute[75226]:         </nova:port>
Nov 17 01:23:00 user nova-compute[75226]:       </nova:ports>
Nov 17 01:23:00 user nova-compute[75226]:     </nova:instance>
Nov 17 01:23:00 user nova-compute[75226]:   </metadata>
Nov 17 01:23:00 user nova-compute[75226]:   <sysinfo type="smbios">
Nov 17 01:23:00 user nova-compute[75226]:     <system>
Nov 17 01:23:00 user nova-compute[75226]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 17 01:23:00 user nova-compute[75226]:       <entry name="product">OpenStack Nova</entry>
Nov 17 01:23:00 user nova-compute[75226]:       <entry name="version">0.0.0</entry>
Nov 17 01:23:00 user nova-compute[75226]:       <entry name="serial">663933b0-95dc-4fba-b411-029f0552571d</entry>
Nov 17 01:23:00 user nova-compute[75226]:       <entry name="uuid">663933b0-95dc-4fba-b411-029f0552571d</entry>
Nov 17 01:23:00 user nova-compute[75226]:       <entry name="family">Virtual Machine</entry>
Nov 17 01:23:00 user nova-compute[75226]:     </system>
Nov 17 01:23:00 user nova-compute[75226]:   </sysinfo>
Nov 17 01:23:00 user nova-compute[75226]:   <os>
Nov 17 01:23:00 user nova-compute[75226]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 17 01:23:00 user nova-compute[75226]:     <boot dev="hd"/>
Nov 17 01:23:00 user nova-compute[75226]:     <smbios mode="sysinfo"/>
Nov 17 01:23:00 user nova-compute[75226]:   </os>
Nov 17 01:23:00 user nova-compute[75226]:   <features>
Nov 17 01:23:00 user nova-compute[75226]:     <acpi/>
Nov 17 01:23:00 user nova-compute[75226]:     <apic/>
Nov 17 01:23:00 user nova-compute[75226]:     <vmcoreinfo/>
Nov 17 01:23:00 user nova-compute[75226]:   </features>
Nov 17 01:23:00 user nova-compute[75226]:   <clock offset="utc">
Nov 17 01:23:00 user nova-compute[75226]:     <timer name="pit" tickpolicy="delay"/>
Nov 17 01:23:00 user nova-compute[75226]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 17 01:23:00 user nova-compute[75226]:     <timer name="hpet" present="no"/>
Nov 17 01:23:00 user nova-compute[75226]:   </clock>
Nov 17 01:23:00 user nova-compute[75226]:   <cpu mode="custom" match="exact">
Nov 17 01:23:00 user nova-compute[75226]:     <model>Nehalem</model>
Nov 17 01:23:00 user nova-compute[75226]:     <topology sockets="1" cores="1" threads="1"/>
Nov 17 01:23:00 user nova-compute[75226]:   </cpu>
Nov 17 01:23:00 user nova-compute[75226]:   <devices>
Nov 17 01:23:00 user nova-compute[75226]:     <disk type="file" device="cdrom">
Nov 17 01:23:00 user nova-compute[75226]:       <driver name="qemu" type="raw" cache="none"/>
Nov 17 01:23:00 user nova-compute[75226]:       <source file="/opt/stack/data/nova/instances/663933b0-95dc-4fba-b411-029f0552571d/disk.config"/>
Nov 17 01:23:00 user nova-compute[75226]:       <target dev="hda" bus="ide"/>
Nov 17 01:23:00 user nova-compute[75226]:     </disk>
Nov 17 01:23:00 user nova-compute[75226]:     <disk type="block" device="disk">
Nov 17 01:23:00 user nova-compute[75226]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 01:23:00 user nova-compute[75226]:       <source dev="/dev/sde"/>
Nov 17 01:23:00 user nova-compute[75226]:       <target dev="vda" bus="virtio"/>
Nov 17 01:23:00 user nova-compute[75226]:       <serial>928c93b5-ae63-4e04-94ce-6059e7eaa7d6</serial>
Nov 17 01:23:00 user nova-compute[75226]:     </disk>
Nov 17 01:23:00 user nova-compute[75226]:     <disk type="block" device="disk">
Nov 17 01:23:00 user nova-compute[75226]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 01:23:00 user nova-compute[75226]:       <source dev="/dev/sdf"/>
Nov 17 01:23:00 user nova-compute[75226]:       <target dev="vdb" bus="virtio"/>
Nov 17 01:23:00 user nova-compute[75226]:       <serial>607b7fb8-097d-43ea-b13c-0825e015e14e</serial>
Nov 17 01:23:00 user nova-compute[75226]:     </disk>
Nov 17 01:23:00 user nova-compute[75226]:     <disk type="block" device="disk">
Nov 17 01:23:00 user nova-compute[75226]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 01:23:00 user nova-compute[75226]:       <source dev="/dev/sdg"/>
Nov 17 01:23:00 user nova-compute[75226]:       <target dev="vdc" bus="virtio"/>
Nov 17 01:23:00 user nova-compute[75226]:       <serial>1b95a10d-6f61-48de-b7e5-de732f65f408</serial>
Nov 17 01:23:00 user nova-compute[75226]:     </disk>
Nov 17 01:23:00 user nova-compute[75226]:     <interface type="ethernet">
Nov 17 01:23:00 user nova-compute[75226]:       <mac address="fa:16:3e:e5:9d:a6"/>
Nov 17 01:23:00 user nova-compute[75226]:       <model type="virtio"/>
Nov 17 01:23:00 user nova-compute[75226]:       <mtu size="1442"/>
Nov 17 01:23:00 user nova-compute[75226]:       <target dev="tap462b7d76-b8"/>
Nov 17 01:23:00 user nova-compute[75226]:     </interface>
Nov 17 01:23:00 user nova-compute[75226]:     <interface type="ethernet">
Nov 17 01:23:00 user nova-compute[75226]:       <mac address="fa:16:3e:74:57:6e"/>
Nov 17 01:23:00 user nova-compute[75226]:       <model type="virtio"/>
Nov 17 01:23:00 user nova-compute[75226]:       <mtu size="1442"/>
Nov 17 01:23:00 user nova-compute[75226]:       <target dev="tap6bcf1322-1a"/>
Nov 17 01:23:00 user nova-compute[75226]:     </interface>
Nov 17 01:23:00 user nova-compute[75226]:     <interface type="ethernet">
Nov 17 01:23:00 user nova-compute[75226]:       <mac address="fa:16:3e:34:dd:56"/>
Nov 17 01:23:00 user nova-compute[75226]:       <model type="virtio"/>
Nov 17 01:23:00 user nova-compute[75226]:       <mtu size="1442"/>
Nov 17 01:23:00 user nova-compute[75226]:       <target dev="tapfbacd963-6a"/>
Nov 17 01:23:00 user nova-compute[75226]:     </interface>
Nov 17 01:23:00 user nova-compute[75226]:     <interface type="ethernet">
Nov 17 01:23:00 user nova-compute[75226]:       <mac address="fa:16:3e:d8:00:e9"/>
Nov 17 01:23:00 user nova-compute[75226]:       <model type="virtio"/>
Nov 17 01:23:00 user nova-compute[75226]:       <mtu size="1442"/>
Nov 17 01:23:00 user nova-compute[75226]:       <target dev="tap46134046-ef"/>
Nov 17 01:23:00 user nova-compute[75226]:     </interface>
Nov 17 01:23:00 user nova-compute[75226]:     <interface type="ethernet">
Nov 17 01:23:00 user nova-compute[75226]:       <mac address="fa:16:3e:38:2a:e5"/>
Nov 17 01:23:00 user nova-compute[75226]:       <model type="virtio"/>
Nov 17 01:23:00 user nova-compute[75226]:       <mtu size="1442"/>
Nov 17 01:23:00 user nova-compute[75226]:       <target dev="tap24888c49-a7"/>
Nov 17 01:23:00 user nova-compute[75226]:     </interface>
Nov 17 01:23:00 user nova-compute[75226]:     <interface type="ethernet">
Nov 17 01:23:00 user nova-compute[75226]:       <mac address="fa:16:3e:4b:05:65"/>
Nov 17 01:23:00 user nova-compute[75226]:       <model type="virtio"/>
Nov 17 01:23:00 user nova-compute[75226]:       <mtu size="1442"/>
Nov 17 01:23:00 user nova-compute[75226]:       <target dev="tap5f7ca871-04"/>
Nov 17 01:23:00 user nova-compute[75226]:     </interface>
Nov 17 01:23:00 user nova-compute[75226]:     <interface type="ethernet">
Nov 17 01:23:00 user nova-compute[75226]:       <mac address="fa:16:3e:a1:1f:ee"/>
Nov 17 01:23:00 user nova-compute[75226]:       <model type="virtio"/>
Nov 17 01:23:00 user nova-compute[75226]:       <mtu size="1442"/>
Nov 17 01:23:00 user nova-compute[75226]:       <target dev="tap153c3e02-4a"/>
Nov 17 01:23:00 user nova-compute[75226]:     </interface>
Nov 17 01:23:00 user nova-compute[75226]:     <serial type="pty">
Nov 17 01:23:00 user nova-compute[75226]:       <log file="/opt/stack/data/nova/instances/663933b0-95dc-4fba-b411-029f0552571d/console.log" append="off"/>
Nov 17 01:23:00 user nova-compute[75226]:     </serial>
Nov 17 01:23:00 user nova-compute[75226]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 17 01:23:00 user nova-compute[75226]:     <video>
Nov 17 01:23:00 user nova-compute[75226]:       <model type="virtio"/>
Nov 17 01:23:00 user nova-compute[75226]:     </video>
Nov 17 01:23:00 user nova-compute[75226]:     <rng model="virtio">
Nov 17 01:23:00 user nova-compute[75226]:       <backend model="random">/dev/urandom</backend>
Nov 17 01:23:00 user nova-compute[75226]:     </rng>
Nov 17 01:23:00 user nova-compute[75226]:     <controller type="usb" index="0" model="none"/>
Nov 17 01:23:00 user nova-compute[75226]:     <memballoon model="virtio">
Nov 17 01:23:00 user nova-compute[75226]:       <stats period="10"/>
Nov 17 01:23:00 user nova-compute[75226]:     </memballoon>
Nov 17 01:23:00 user nova-compute[75226]:   </devices>
Nov 17 01:23:00 user nova-compute[75226]: </domain>
Nov 17 01:23:00 user nova-compute[75226]:  {{(pid=75226) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 17 01:23:00 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-17T01:22:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1270422690',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1270422690',id=18,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFadtk54Tkvk6AHpu0dnlPf3MeX++Xu/axCXDSKF9N/sLaR9IMdsD+WpKf3bG29Bs36DoaNYGITDbnkh7PpUjSy8pAnsUxMlIERAERRQjtXzSRjHfrt6XPTg8j13L2IqSQ==',key_name='tempest-keypair-1791766942',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='60fce4eef0d24de0a320670623085bb6',ramdisk_id='',reservation_id='r-w2e090td',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1246897470',owner_user_name='tempest-TaggedBootDevicesTest_v242-1246897470-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T01:22:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='85f6f2dd0ff44b33874cde7e2e36482c',uuid=663933b0-95dc-4fba-b411-029f0552571d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "462b7d76-b8d0-4374-8b29-da083c4ec28f", "address": "fa:16:3e:e5:9d:a6", "network": {"id": "3e4d69ef-0f6d-4d32-bcfa-0cae712a750e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1270397153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60fce4eef0d24de0a320670623085bb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap462b7d76-b8", "ovs_interfaceid": "462b7d76-b8d0-4374-8b29-da083c4ec28f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 17 01:23:00 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Converting VIF {"id": "462b7d76-b8d0-4374-8b29-da083c4ec28f", "address": "fa:16:3e:e5:9d:a6", "network": {"id": "3e4d69ef-0f6d-4d32-bcfa-0cae712a750e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1270397153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60fce4eef0d24de0a320670623085bb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap462b7d76-b8", "ovs_interfaceid": "462b7d76-b8d0-4374-8b29-da083c4ec28f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:23:00 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:9d:a6,bridge_name='br-int',has_traffic_filtering=True,id=462b7d76-b8d0-4374-8b29-da083c4ec28f,network=Network(3e4d69ef-0f6d-4d32-bcfa-0cae712a750e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap462b7d76-b8') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:23:00 user nova-compute[75226]: DEBUG os_vif [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:9d:a6,bridge_name='br-int',has_traffic_filtering=True,id=462b7d76-b8d0-4374-8b29-da083c4ec28f,network=Network(3e4d69ef-0f6d-4d32-bcfa-0cae712a750e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap462b7d76-b8') {{(pid=75226) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 17 01:23:00 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:23:00 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:23:00 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 17 01:23:00 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:23:00 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fe6eab8d-d57d-53af-9b39-d977521faaeb', '_type': 'linux-noop'}}, row=False) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:23:00 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:23:00 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:23:00 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:23:00 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap462b7d76-b8, may_exist=True, interface_attrs={}) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:23:00 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap462b7d76-b8, col_values=(('qos', UUID('9fc1f200-e204-478d-aa4e-b6e8ff1935be')),), if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:23:00 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap462b7d76-b8, col_values=(('external_ids', {'iface-id': '462b7d76-b8d0-4374-8b29-da083c4ec28f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e5:9d:a6', 'vm-uuid': '663933b0-95dc-4fba-b411-029f0552571d'}),), if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:23:00 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:23:00 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:23:00 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:23:00 user nova-compute[75226]: INFO os_vif [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:9d:a6,bridge_name='br-int',has_traffic_filtering=True,id=462b7d76-b8d0-4374-8b29-da083c4ec28f,network=Network(3e4d69ef-0f6d-4d32-bcfa-0cae712a750e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap462b7d76-b8')
Nov 17 01:23:00 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-17T01:22:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1270422690',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1270422690',id=18,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFadtk54Tkvk6AHpu0dnlPf3MeX++Xu/axCXDSKF9N/sLaR9IMdsD+WpKf3bG29Bs36DoaNYGITDbnkh7PpUjSy8pAnsUxMlIERAERRQjtXzSRjHfrt6XPTg8j13L2IqSQ==',key_name='tempest-keypair-1791766942',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='60fce4eef0d24de0a320670623085bb6',ramdisk_id='',reservation_id='r-w2e090td',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1246897470',owner_user_name='tempest-TaggedBootDevicesTest_v242-1246897470-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T01:22:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='85f6f2dd0ff44b33874cde7e2e36482c',uuid=663933b0-95dc-4fba-b411-029f0552571d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6bcf1322-1aad-4ffa-9231-7273376e4572", "address": "fa:16:3e:74:57:6e", "network": {"id": "a8dd3d50-aad0-4fe6-8986-98d0400bcaec", "bridge": "br-int", "label": "tempest-device-tagging-net1-1117474203", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.96", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "60fce4eef0d24de0a320670623085bb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bcf1322-1a", "ovs_interfaceid": "6bcf1322-1aad-4ffa-9231-7273376e4572", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75226) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 17 01:23:00 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Converting VIF {"id": "6bcf1322-1aad-4ffa-9231-7273376e4572", "address": "fa:16:3e:74:57:6e", "network": {"id": "a8dd3d50-aad0-4fe6-8986-98d0400bcaec", "bridge": "br-int", "label": "tempest-device-tagging-net1-1117474203", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.96", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "60fce4eef0d24de0a320670623085bb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bcf1322-1a", "ovs_interfaceid": "6bcf1322-1aad-4ffa-9231-7273376e4572", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:23:00 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:57:6e,bridge_name='br-int',has_traffic_filtering=True,id=6bcf1322-1aad-4ffa-9231-7273376e4572,network=Network(a8dd3d50-aad0-4fe6-8986-98d0400bcaec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6bcf1322-1a') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:23:00 user nova-compute[75226]: DEBUG os_vif [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:57:6e,bridge_name='br-int',has_traffic_filtering=True,id=6bcf1322-1aad-4ffa-9231-7273376e4572,network=Network(a8dd3d50-aad0-4fe6-8986-98d0400bcaec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6bcf1322-1a') {{(pid=75226) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 17 01:23:00 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:23:00 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:23:00 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 17 01:23:00 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:23:00 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bb55c0d9-457a-5da6-8208-ea2de083dcd6', '_type': 'linux-noop'}}, row=False) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:23:00 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:23:00 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:23:00 user nova-compute[75226]: DEBUG nova.compute.manager [req-99ac2e04-d7ce-4854-87a6-bc709f10eead req-1d125d1c-2c1c-4f2e-87f4-b4c074cdeeef service nova] [instance: ddfecefc-1e9b-4e6e-9995-855c8a061084] Received event network-vif-plugged-f9a7562b-de63-4374-b43b-18e3cb3af710 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:23:00 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-99ac2e04-d7ce-4854-87a6-bc709f10eead req-1d125d1c-2c1c-4f2e-87f4-b4c074cdeeef service nova] Acquiring lock "ddfecefc-1e9b-4e6e-9995-855c8a061084-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:23:00 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-99ac2e04-d7ce-4854-87a6-bc709f10eead req-1d125d1c-2c1c-4f2e-87f4-b4c074cdeeef service nova] Lock "ddfecefc-1e9b-4e6e-9995-855c8a061084-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:23:00 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-99ac2e04-d7ce-4854-87a6-bc709f10eead req-1d125d1c-2c1c-4f2e-87f4-b4c074cdeeef service nova] Lock "ddfecefc-1e9b-4e6e-9995-855c8a061084-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:23:00 user nova-compute[75226]: DEBUG nova.compute.manager [req-99ac2e04-d7ce-4854-87a6-bc709f10eead req-1d125d1c-2c1c-4f2e-87f4-b4c074cdeeef service nova] [instance: ddfecefc-1e9b-4e6e-9995-855c8a061084] No waiting events found dispatching network-vif-plugged-f9a7562b-de63-4374-b43b-18e3cb3af710 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:23:00 user nova-compute[75226]: WARNING nova.compute.manager [req-99ac2e04-d7ce-4854-87a6-bc709f10eead req-1d125d1c-2c1c-4f2e-87f4-b4c074cdeeef service nova] [instance: ddfecefc-1e9b-4e6e-9995-855c8a061084] Received unexpected event network-vif-plugged-f9a7562b-de63-4374-b43b-18e3cb3af710 for instance with vm_state rescued and task_state unrescuing.
Nov 17 01:23:00 user nova-compute[75226]: DEBUG nova.compute.manager [req-99ac2e04-d7ce-4854-87a6-bc709f10eead req-1d125d1c-2c1c-4f2e-87f4-b4c074cdeeef service nova] [instance: ddfecefc-1e9b-4e6e-9995-855c8a061084] Received event network-vif-plugged-f9a7562b-de63-4374-b43b-18e3cb3af710 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:23:00 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-99ac2e04-d7ce-4854-87a6-bc709f10eead req-1d125d1c-2c1c-4f2e-87f4-b4c074cdeeef service nova] Acquiring lock "ddfecefc-1e9b-4e6e-9995-855c8a061084-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:23:00 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-99ac2e04-d7ce-4854-87a6-bc709f10eead req-1d125d1c-2c1c-4f2e-87f4-b4c074cdeeef service nova] Lock "ddfecefc-1e9b-4e6e-9995-855c8a061084-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:23:00 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-99ac2e04-d7ce-4854-87a6-bc709f10eead req-1d125d1c-2c1c-4f2e-87f4-b4c074cdeeef service nova] Lock "ddfecefc-1e9b-4e6e-9995-855c8a061084-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:23:00 user nova-compute[75226]: DEBUG nova.compute.manager [req-99ac2e04-d7ce-4854-87a6-bc709f10eead req-1d125d1c-2c1c-4f2e-87f4-b4c074cdeeef service nova] [instance: ddfecefc-1e9b-4e6e-9995-855c8a061084] No waiting events found dispatching network-vif-plugged-f9a7562b-de63-4374-b43b-18e3cb3af710 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:23:00 user nova-compute[75226]: WARNING nova.compute.manager [req-99ac2e04-d7ce-4854-87a6-bc709f10eead req-1d125d1c-2c1c-4f2e-87f4-b4c074cdeeef service nova] [instance: ddfecefc-1e9b-4e6e-9995-855c8a061084] Received unexpected event network-vif-plugged-f9a7562b-de63-4374-b43b-18e3cb3af710 for instance with vm_state rescued and task_state unrescuing.
Nov 17 01:23:00 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:23:00 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6bcf1322-1a, may_exist=True, interface_attrs={}) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:23:00 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6bcf1322-1a, col_values=(('qos', UUID('ebe9fcca-1419-4944-8b31-58ad7406acc2')),), if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:23:00 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6bcf1322-1a, col_values=(('external_ids', {'iface-id': '6bcf1322-1aad-4ffa-9231-7273376e4572', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:74:57:6e', 'vm-uuid': '663933b0-95dc-4fba-b411-029f0552571d'}),), if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:23:00 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:23:00 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:23:00 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:23:00 user nova-compute[75226]: INFO os_vif [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:57:6e,bridge_name='br-int',has_traffic_filtering=True,id=6bcf1322-1aad-4ffa-9231-7273376e4572,network=Network(a8dd3d50-aad0-4fe6-8986-98d0400bcaec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6bcf1322-1a')
Nov 17 01:23:00 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-17T01:22:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1270422690',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1270422690',id=18,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFadtk54Tkvk6AHpu0dnlPf3MeX++Xu/axCXDSKF9N/sLaR9IMdsD+WpKf3bG29Bs36DoaNYGITDbnkh7PpUjSy8pAnsUxMlIERAERRQjtXzSRjHfrt6XPTg8j13L2IqSQ==',key_name='tempest-keypair-1791766942',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='60fce4eef0d24de0a320670623085bb6',ramdisk_id='',reservation_id='r-w2e090td',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1246897470',owner_user_name='tempest-TaggedBootDevicesTest_v242-1246897470-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T01:22:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='85f6f2dd0ff44b33874cde7e2e36482c',uuid=663933b0-95dc-4fba-b411-029f0552571d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fbacd963-6a62-4682-89a2-27f92a9f0ff2", "address": "fa:16:3e:34:dd:56", "network": {"id": "a8dd3d50-aad0-4fe6-8986-98d0400bcaec", "bridge": "br-int", "label": "tempest-device-tagging-net1-1117474203", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "60fce4eef0d24de0a320670623085bb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbacd963-6a", "ovs_interfaceid": "fbacd963-6a62-4682-89a2-27f92a9f0ff2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75226) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 17 01:23:00 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Converting VIF {"id": "fbacd963-6a62-4682-89a2-27f92a9f0ff2", "address": "fa:16:3e:34:dd:56", "network": {"id": "a8dd3d50-aad0-4fe6-8986-98d0400bcaec", "bridge": "br-int", "label": "tempest-device-tagging-net1-1117474203", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "60fce4eef0d24de0a320670623085bb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbacd963-6a", "ovs_interfaceid": "fbacd963-6a62-4682-89a2-27f92a9f0ff2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:23:00 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:dd:56,bridge_name='br-int',has_traffic_filtering=True,id=fbacd963-6a62-4682-89a2-27f92a9f0ff2,network=Network(a8dd3d50-aad0-4fe6-8986-98d0400bcaec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfbacd963-6a') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:23:00 user nova-compute[75226]: DEBUG os_vif [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:dd:56,bridge_name='br-int',has_traffic_filtering=True,id=fbacd963-6a62-4682-89a2-27f92a9f0ff2,network=Network(a8dd3d50-aad0-4fe6-8986-98d0400bcaec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfbacd963-6a') {{(pid=75226) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 17 01:23:00 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:23:00 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:23:00 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 17 01:23:00 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:23:00 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd0e12bcd-b3bf-5c6b-b6ea-2fd22caa4226', '_type': 'linux-noop'}}, row=False) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:23:00 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:23:00 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:23:00 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:23:00 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:23:00 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfbacd963-6a, may_exist=True, interface_attrs={}) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:23:00 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfbacd963-6a, col_values=(('qos', UUID('5483cd54-3d80-4611-b263-fc707d222931')),), if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:23:00 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfbacd963-6a, col_values=(('external_ids', {'iface-id': 'fbacd963-6a62-4682-89a2-27f92a9f0ff2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:34:dd:56', 'vm-uuid': '663933b0-95dc-4fba-b411-029f0552571d'}),), if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:23:00 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:23:00 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:23:00 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:23:00 user nova-compute[75226]: INFO os_vif [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:dd:56,bridge_name='br-int',has_traffic_filtering=True,id=fbacd963-6a62-4682-89a2-27f92a9f0ff2,network=Network(a8dd3d50-aad0-4fe6-8986-98d0400bcaec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfbacd963-6a')
Nov 17 01:23:00 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-17T01:22:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1270422690',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1270422690',id=18,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFadtk54Tkvk6AHpu0dnlPf3MeX++Xu/axCXDSKF9N/sLaR9IMdsD+WpKf3bG29Bs36DoaNYGITDbnkh7PpUjSy8pAnsUxMlIERAERRQjtXzSRjHfrt6XPTg8j13L2IqSQ==',key_name='tempest-keypair-1791766942',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='60fce4eef0d24de0a320670623085bb6',ramdisk_id='',reservation_id='r-w2e090td',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1246897470',owner_user_name='tempest-TaggedBootDevicesTest_v242-1246897470-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T01:22:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='85f6f2dd0ff44b33874cde7e2e36482c',uuid=663933b0-95dc-4fba-b411-029f0552571d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "46134046-ef40-4332-aa3f-044beaf6f991", "address": "fa:16:3e:d8:00:e9", "network": {"id": "a8dd3d50-aad0-4fe6-8986-98d0400bcaec", "bridge": "br-int", "label": "tempest-device-tagging-net1-1117474203", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "60fce4eef0d24de0a320670623085bb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46134046-ef", "ovs_interfaceid": "46134046-ef40-4332-aa3f-044beaf6f991", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 17 01:23:00 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Converting VIF {"id": "46134046-ef40-4332-aa3f-044beaf6f991", "address": "fa:16:3e:d8:00:e9", "network": {"id": "a8dd3d50-aad0-4fe6-8986-98d0400bcaec", "bridge": "br-int", "label": "tempest-device-tagging-net1-1117474203", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "60fce4eef0d24de0a320670623085bb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46134046-ef", "ovs_interfaceid": "46134046-ef40-4332-aa3f-044beaf6f991", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:23:00 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:00:e9,bridge_name='br-int',has_traffic_filtering=True,id=46134046-ef40-4332-aa3f-044beaf6f991,network=Network(a8dd3d50-aad0-4fe6-8986-98d0400bcaec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46134046-ef') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:23:00 user nova-compute[75226]: DEBUG os_vif [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:00:e9,bridge_name='br-int',has_traffic_filtering=True,id=46134046-ef40-4332-aa3f-044beaf6f991,network=Network(a8dd3d50-aad0-4fe6-8986-98d0400bcaec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46134046-ef') {{(pid=75226) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 17 01:23:00 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:23:00 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:23:00 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 17 01:23:00 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:23:00 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4b025603-29eb-52e4-b813-3e2dc90dbde4', '_type': 'linux-noop'}}, row=False) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:23:00 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:23:00 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:23:00 user nova-compute[75226]: DEBUG nova.compute.manager [None req-f651c864-506a-45cb-9a27-c51323fe1542 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] [instance: ddfecefc-1e9b-4e6e-9995-855c8a061084] Checking state {{(pid=75226) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 01:23:00 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:23:00 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:23:00 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap46134046-ef, may_exist=True, interface_attrs={}) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:23:00 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap46134046-ef, col_values=(('qos', UUID('8969ee0c-29a2-43cb-b463-520a9c2005a5')),), if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:23:00 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap46134046-ef, col_values=(('external_ids', {'iface-id': '46134046-ef40-4332-aa3f-044beaf6f991', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d8:00:e9', 'vm-uuid': '663933b0-95dc-4fba-b411-029f0552571d'}),), if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:23:00 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:23:00 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:23:00 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:23:00 user nova-compute[75226]: INFO os_vif [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:00:e9,bridge_name='br-int',has_traffic_filtering=True,id=46134046-ef40-4332-aa3f-044beaf6f991,network=Network(a8dd3d50-aad0-4fe6-8986-98d0400bcaec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46134046-ef')
Nov 17 01:23:00 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-17T01:22:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1270422690',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1270422690',id=18,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFadtk54Tkvk6AHpu0dnlPf3MeX++Xu/axCXDSKF9N/sLaR9IMdsD+WpKf3bG29Bs36DoaNYGITDbnkh7PpUjSy8pAnsUxMlIERAERRQjtXzSRjHfrt6XPTg8j13L2IqSQ==',key_name='tempest-keypair-1791766942',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='60fce4eef0d24de0a320670623085bb6',ramdisk_id='',reservation_id='r-w2e090td',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1246897470',owner_user_name='tempest-TaggedBootDevicesTest_v242-1246897470-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T01:22:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='85f6f2dd0ff44b33874cde7e2e36482c',uuid=663933b0-95dc-4fba-b411-029f0552571d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "24888c49-a7a9-4f44-8f95-1174dba77750", "address": "fa:16:3e:38:2a:e5", "network": {"id": "a8dd3d50-aad0-4fe6-8986-98d0400bcaec", "bridge": "br-int", "label": "tempest-device-tagging-net1-1117474203", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "60fce4eef0d24de0a320670623085bb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24888c49-a7", "ovs_interfaceid": "24888c49-a7a9-4f44-8f95-1174dba77750", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 17 01:23:00 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Converting VIF {"id": "24888c49-a7a9-4f44-8f95-1174dba77750", "address": "fa:16:3e:38:2a:e5", "network": {"id": "a8dd3d50-aad0-4fe6-8986-98d0400bcaec", "bridge": "br-int", "label": "tempest-device-tagging-net1-1117474203", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "60fce4eef0d24de0a320670623085bb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24888c49-a7", "ovs_interfaceid": "24888c49-a7a9-4f44-8f95-1174dba77750", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:23:00 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:2a:e5,bridge_name='br-int',has_traffic_filtering=True,id=24888c49-a7a9-4f44-8f95-1174dba77750,network=Network(a8dd3d50-aad0-4fe6-8986-98d0400bcaec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24888c49-a7') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:23:00 user nova-compute[75226]: DEBUG os_vif [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:2a:e5,bridge_name='br-int',has_traffic_filtering=True,id=24888c49-a7a9-4f44-8f95-1174dba77750,network=Network(a8dd3d50-aad0-4fe6-8986-98d0400bcaec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24888c49-a7') {{(pid=75226) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 17 01:23:00 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:23:00 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:23:00 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 17 01:23:00 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:23:00 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5224a933-434c-59a4-93d4-7564d5c2f750', '_type': 'linux-noop'}}, row=False) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:23:00 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:23:00 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:23:00 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:23:00 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:23:00 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap24888c49-a7, may_exist=True, interface_attrs={}) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:23:00 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap24888c49-a7, col_values=(('qos', UUID('b856b94f-5adf-46cd-981d-376dee612392')),), if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:23:00 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap24888c49-a7, col_values=(('external_ids', {'iface-id': '24888c49-a7a9-4f44-8f95-1174dba77750', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:38:2a:e5', 'vm-uuid': '663933b0-95dc-4fba-b411-029f0552571d'}),), if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:23:00 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:23:00 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:23:00 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddfecefc-1e9b-4e6e-9995-855c8a061084/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:23:00 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:23:00 user nova-compute[75226]: INFO os_vif [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:2a:e5,bridge_name='br-int',has_traffic_filtering=True,id=24888c49-a7a9-4f44-8f95-1174dba77750,network=Network(a8dd3d50-aad0-4fe6-8986-98d0400bcaec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24888c49-a7')
Nov 17 01:23:00 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-17T01:22:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1270422690',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1270422690',id=18,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFadtk54Tkvk6AHpu0dnlPf3MeX++Xu/axCXDSKF9N/sLaR9IMdsD+WpKf3bG29Bs36DoaNYGITDbnkh7PpUjSy8pAnsUxMlIERAERRQjtXzSRjHfrt6XPTg8j13L2IqSQ==',key_name='tempest-keypair-1791766942',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='60fce4eef0d24de0a320670623085bb6',ramdisk_id='',reservation_id='r-w2e090td',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1246897470',owner_user_name='tempest-TaggedBootDevicesTest_v242-1246897470-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T01:22:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='85f6f2dd0ff44b33874cde7e2e36482c',uuid=663933b0-95dc-4fba-b411-029f0552571d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5f7ca871-040f-460c-8709-7ca74ca282ba", "address": "fa:16:3e:4b:05:65", "network": {"id": "5cee0137-a429-434d-a7ce-0a8d2f9e41ea", "bridge": "br-int", "label": "tempest-device-tagging-net2-1427092874", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "60fce4eef0d24de0a320670623085bb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f7ca871-04", "ovs_interfaceid": "5f7ca871-040f-460c-8709-7ca74ca282ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 17 01:23:00 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Converting VIF {"id": "5f7ca871-040f-460c-8709-7ca74ca282ba", "address": "fa:16:3e:4b:05:65", "network": {"id": "5cee0137-a429-434d-a7ce-0a8d2f9e41ea", "bridge": "br-int", "label": "tempest-device-tagging-net2-1427092874", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "60fce4eef0d24de0a320670623085bb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f7ca871-04", "ovs_interfaceid": "5f7ca871-040f-460c-8709-7ca74ca282ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:23:00 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:05:65,bridge_name='br-int',has_traffic_filtering=True,id=5f7ca871-040f-460c-8709-7ca74ca282ba,network=Network(5cee0137-a429-434d-a7ce-0a8d2f9e41ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f7ca871-04') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:23:00 user nova-compute[75226]: DEBUG os_vif [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:05:65,bridge_name='br-int',has_traffic_filtering=True,id=5f7ca871-040f-460c-8709-7ca74ca282ba,network=Network(5cee0137-a429-434d-a7ce-0a8d2f9e41ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f7ca871-04') {{(pid=75226) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 17 01:23:00 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:23:00 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:23:00 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 17 01:23:00 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:23:00 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9a528fd6-0b4d-5f60-afd8-1e8106b20ffc', '_type': 'linux-noop'}}, row=False) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:23:00 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:23:00 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:23:00 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:23:00 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:23:00 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5f7ca871-04, may_exist=True, interface_attrs={}) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:23:00 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5f7ca871-04, col_values=(('qos', UUID('a7e38444-8591-4ebc-869d-d72d9d4a6271')),), if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:23:00 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5f7ca871-04, col_values=(('external_ids', {'iface-id': '5f7ca871-040f-460c-8709-7ca74ca282ba', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4b:05:65', 'vm-uuid': '663933b0-95dc-4fba-b411-029f0552571d'}),), if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:23:00 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:23:00 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:23:00 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:23:00 user nova-compute[75226]: INFO os_vif [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:05:65,bridge_name='br-int',has_traffic_filtering=True,id=5f7ca871-040f-460c-8709-7ca74ca282ba,network=Network(5cee0137-a429-434d-a7ce-0a8d2f9e41ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f7ca871-04')
Nov 17 01:23:00 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-17T01:22:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1270422690',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1270422690',id=18,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFadtk54Tkvk6AHpu0dnlPf3MeX++Xu/axCXDSKF9N/sLaR9IMdsD+WpKf3bG29Bs36DoaNYGITDbnkh7PpUjSy8pAnsUxMlIERAERRQjtXzSRjHfrt6XPTg8j13L2IqSQ==',key_name='tempest-keypair-1791766942',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='60fce4eef0d24de0a320670623085bb6',ramdisk_id='',reservation_id='r-w2e090td',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1246897470',owner_user_name='tempest-TaggedBootDevicesTest_v242-1246897470-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T01:22:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='85f6f2dd0ff44b33874cde7e2e36482c',uuid=663933b0-95dc-4fba-b411-029f0552571d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "153c3e02-4aa9-4b9f-b03d-229f12e2ed68", "address": "fa:16:3e:a1:1f:ee", "network": {"id": "5cee0137-a429-434d-a7ce-0a8d2f9e41ea", "bridge": "br-int", "label": "tempest-device-tagging-net2-1427092874", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "60fce4eef0d24de0a320670623085bb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap153c3e02-4a", "ovs_interfaceid": "153c3e02-4aa9-4b9f-b03d-229f12e2ed68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 17 01:23:00 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Converting VIF {"id": "153c3e02-4aa9-4b9f-b03d-229f12e2ed68", "address": "fa:16:3e:a1:1f:ee", "network": {"id": "5cee0137-a429-434d-a7ce-0a8d2f9e41ea", "bridge": "br-int", "label": "tempest-device-tagging-net2-1427092874", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "60fce4eef0d24de0a320670623085bb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap153c3e02-4a", "ovs_interfaceid": "153c3e02-4aa9-4b9f-b03d-229f12e2ed68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:23:00 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:1f:ee,bridge_name='br-int',has_traffic_filtering=True,id=153c3e02-4aa9-4b9f-b03d-229f12e2ed68,network=Network(5cee0137-a429-434d-a7ce-0a8d2f9e41ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap153c3e02-4a') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:23:00 user nova-compute[75226]: DEBUG os_vif [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:1f:ee,bridge_name='br-int',has_traffic_filtering=True,id=153c3e02-4aa9-4b9f-b03d-229f12e2ed68,network=Network(5cee0137-a429-434d-a7ce-0a8d2f9e41ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap153c3e02-4a') {{(pid=75226) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 17 01:23:00 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddfecefc-1e9b-4e6e-9995-855c8a061084/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:23:00 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:23:00 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:23:00 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 17 01:23:00 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddfecefc-1e9b-4e6e-9995-855c8a061084/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:23:00 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:23:00 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ad256d28-bb3e-5eb7-8346-1be82baa8403', '_type': 'linux-noop'}}, row=False) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:23:00 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:23:00 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:23:00 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:23:00 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:23:00 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap153c3e02-4a, may_exist=True, interface_attrs={}) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:23:00 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap153c3e02-4a, col_values=(('qos', UUID('8f6ecb02-17b5-44a9-ad95-7d86fbdb5c59')),), if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:23:00 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap153c3e02-4a, col_values=(('external_ids', {'iface-id': '153c3e02-4aa9-4b9f-b03d-229f12e2ed68', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a1:1f:ee', 'vm-uuid': '663933b0-95dc-4fba-b411-029f0552571d'}),), if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:23:00 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:23:00 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:23:00 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddfecefc-1e9b-4e6e-9995-855c8a061084/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:23:00 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75226) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 01:23:00 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:23:00 user nova-compute[75226]: INFO os_vif [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:1f:ee,bridge_name='br-int',has_traffic_filtering=True,id=153c3e02-4aa9-4b9f-b03d-229f12e2ed68,network=Network(5cee0137-a429-434d-a7ce-0a8d2f9e41ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap153c3e02-4a')
Nov 17 01:23:00 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38062487-67ca-4962-974f-81456aebe97b/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:23:00 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] No BDM found with device name hda, not building metadata. {{(pid=75226) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 01:23:00 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75226) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 01:23:00 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] No VIF found with MAC fa:16:3e:e5:9d:a6, not building metadata {{(pid=75226) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 01:23:00 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] No VIF found with MAC fa:16:3e:38:2a:e5, not building metadata {{(pid=75226) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 01:23:00 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Using config drive
Nov 17 01:23:00 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38062487-67ca-4962-974f-81456aebe97b/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:23:00 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38062487-67ca-4962-974f-81456aebe97b/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:23:01 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Creating config drive at /opt/stack/data/nova/instances/663933b0-95dc-4fba-b411-029f0552571d/disk.config
Nov 17 01:23:01 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/663933b0-95dc-4fba-b411-029f0552571d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpkhl9yvs6 {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:23:01 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38062487-67ca-4962-974f-81456aebe97b/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:23:01 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa84e575-bdad-45b9-80ce-86b1c2826fb0/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:23:01 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/663933b0-95dc-4fba-b411-029f0552571d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpkhl9yvs6" returned: 0 in 0.094s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:23:01 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa84e575-bdad-45b9-80ce-86b1c2826fb0/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:23:01 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa84e575-bdad-45b9-80ce-86b1c2826fb0/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:23:01 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa84e575-bdad-45b9-80ce-86b1c2826fb0/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:23:01 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fbdd8af-f608-4d73-92d9-ae0586814c1b/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:23:01 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fbdd8af-f608-4d73-92d9-ae0586814c1b/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:23:01 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fbdd8af-f608-4d73-92d9-ae0586814c1b/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:23:01 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fbdd8af-f608-4d73-92d9-ae0586814c1b/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:23:02 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/306054a8-4d0f-4913-b3b8-97aeeeec071c/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:23:02 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/306054a8-4d0f-4913-b3b8-97aeeeec071c/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:23:02 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/306054a8-4d0f-4913-b3b8-97aeeeec071c/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:23:02 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/306054a8-4d0f-4913-b3b8-97aeeeec071c/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:23:02 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:23:02 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:23:02 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:23:02 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:23:02 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:23:02 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:23:02 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:23:02 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c/disk --force-share --output=json" returned: 0 in 0.259s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:23:02 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/724b81dd-4531-4c99-850d-0bfcbfdf7bd4/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:23:03 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:23:03 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/724b81dd-4531-4c99-850d-0bfcbfdf7bd4/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:23:03 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/724b81dd-4531-4c99-850d-0bfcbfdf7bd4/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:23:03 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:23:03 user nova-compute[75226]: DEBUG nova.compute.manager [req-ffff9f71-cd05-40ce-a458-6e79689e7c42 req-b948e5bc-927f-4711-a0a2-bbc4d6a86337 service nova] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Received event network-vif-plugged-462b7d76-b8d0-4374-8b29-da083c4ec28f {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:23:03 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-ffff9f71-cd05-40ce-a458-6e79689e7c42 req-b948e5bc-927f-4711-a0a2-bbc4d6a86337 service nova] Acquiring lock "663933b0-95dc-4fba-b411-029f0552571d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:23:03 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-ffff9f71-cd05-40ce-a458-6e79689e7c42 req-b948e5bc-927f-4711-a0a2-bbc4d6a86337 service nova] Lock "663933b0-95dc-4fba-b411-029f0552571d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:23:03 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-ffff9f71-cd05-40ce-a458-6e79689e7c42 req-b948e5bc-927f-4711-a0a2-bbc4d6a86337 service nova] Lock "663933b0-95dc-4fba-b411-029f0552571d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:23:03 user nova-compute[75226]: DEBUG nova.compute.manager [req-ffff9f71-cd05-40ce-a458-6e79689e7c42 req-b948e5bc-927f-4711-a0a2-bbc4d6a86337 service nova] [instance: 663933b0-95dc-4fba-b411-029f0552571d] No waiting events found dispatching network-vif-plugged-462b7d76-b8d0-4374-8b29-da083c4ec28f {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:23:03 user nova-compute[75226]: WARNING nova.compute.manager [req-ffff9f71-cd05-40ce-a458-6e79689e7c42 req-b948e5bc-927f-4711-a0a2-bbc4d6a86337 service nova] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Received unexpected event network-vif-plugged-462b7d76-b8d0-4374-8b29-da083c4ec28f for instance with vm_state building and task_state spawning.
Nov 17 01:23:03 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/724b81dd-4531-4c99-850d-0bfcbfdf7bd4/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:23:03 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75226) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 01:23:03 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b7e9611-be35-4e51-b886-91a2fac0a653/disk.rescue --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:23:03 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:23:03 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:23:03 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:23:03 user nova-compute[75226]: DEBUG nova.compute.manager [req-6bb9ad6d-57b4-4a5e-9796-7c3e859e1ba3 req-bec01290-8adb-47d0-8647-509a39383b34 service nova] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Received event network-vif-plugged-6bcf1322-1aad-4ffa-9231-7273376e4572 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:23:03 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-6bb9ad6d-57b4-4a5e-9796-7c3e859e1ba3 req-bec01290-8adb-47d0-8647-509a39383b34 service nova] Acquiring lock "663933b0-95dc-4fba-b411-029f0552571d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:23:03 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-6bb9ad6d-57b4-4a5e-9796-7c3e859e1ba3 req-bec01290-8adb-47d0-8647-509a39383b34 service nova] Lock "663933b0-95dc-4fba-b411-029f0552571d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:23:03 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-6bb9ad6d-57b4-4a5e-9796-7c3e859e1ba3 req-bec01290-8adb-47d0-8647-509a39383b34 service nova] Lock "663933b0-95dc-4fba-b411-029f0552571d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:23:03 user nova-compute[75226]: DEBUG nova.compute.manager [req-6bb9ad6d-57b4-4a5e-9796-7c3e859e1ba3 req-bec01290-8adb-47d0-8647-509a39383b34 service nova] [instance: 663933b0-95dc-4fba-b411-029f0552571d] No waiting events found dispatching network-vif-plugged-6bcf1322-1aad-4ffa-9231-7273376e4572 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:23:03 user nova-compute[75226]: WARNING nova.compute.manager [req-6bb9ad6d-57b4-4a5e-9796-7c3e859e1ba3 req-bec01290-8adb-47d0-8647-509a39383b34 service nova] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Received unexpected event network-vif-plugged-6bcf1322-1aad-4ffa-9231-7273376e4572 for instance with vm_state building and task_state spawning.
Nov 17 01:23:03 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:23:03 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b7e9611-be35-4e51-b886-91a2fac0a653/disk.rescue --force-share --output=json" returned: 0 in 0.291s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:23:03 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b7e9611-be35-4e51-b886-91a2fac0a653/disk.rescue --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:23:03 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:23:03 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:23:03 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:23:03 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:23:03 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:23:03 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b7e9611-be35-4e51-b886-91a2fac0a653/disk.rescue --force-share --output=json" returned: 0 in 0.220s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:23:03 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52fe0a91-9320-47d2-ac83-4f49260a0997/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:23:04 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:23:04 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52fe0a91-9320-47d2-ac83-4f49260a0997/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:23:04 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52fe0a91-9320-47d2-ac83-4f49260a0997/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:23:04 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:23:04 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52fe0a91-9320-47d2-ac83-4f49260a0997/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:23:07 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:23:07 user nova-compute[75226]: DEBUG nova.compute.manager [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Instance event wait completed in 0 seconds for  {{(pid=75226) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 17 01:23:07 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Guest created on hypervisor {{(pid=75226) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 17 01:23:07 user nova-compute[75226]: DEBUG nova.compute.manager [req-708546b9-8cb5-4ba4-a0ec-38653348cb5f req-b0a51319-dc10-4399-9cac-7942cc5dde64 service nova] [instance: f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c] Received event network-changed-ed40e788-7338-4ecd-8204-008d4601131b {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:23:07 user nova-compute[75226]: DEBUG nova.compute.manager [req-708546b9-8cb5-4ba4-a0ec-38653348cb5f req-b0a51319-dc10-4399-9cac-7942cc5dde64 service nova] [instance: f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c] Refreshing instance network info cache due to event network-changed-ed40e788-7338-4ecd-8204-008d4601131b. {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 01:23:07 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-708546b9-8cb5-4ba4-a0ec-38653348cb5f req-b0a51319-dc10-4399-9cac-7942cc5dde64 service nova] Acquiring lock "refresh_cache-f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:23:07 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-708546b9-8cb5-4ba4-a0ec-38653348cb5f req-b0a51319-dc10-4399-9cac-7942cc5dde64 service nova] Acquired lock "refresh_cache-f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:23:07 user nova-compute[75226]: DEBUG nova.network.neutron [req-708546b9-8cb5-4ba4-a0ec-38653348cb5f req-b0a51319-dc10-4399-9cac-7942cc5dde64 service nova] [instance: f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c] Refreshing network info cache for port ed40e788-7338-4ecd-8204-008d4601131b {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 01:23:07 user nova-compute[75226]: DEBUG nova.compute.manager [req-f1bb818e-8ddc-49c7-ab01-9245665f711f req-6df8b70c-2a5b-4ebd-8cad-4a354960a51b service nova] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Received event network-vif-plugged-462b7d76-b8d0-4374-8b29-da083c4ec28f {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:23:07 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-f1bb818e-8ddc-49c7-ab01-9245665f711f req-6df8b70c-2a5b-4ebd-8cad-4a354960a51b service nova] Acquiring lock "663933b0-95dc-4fba-b411-029f0552571d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:23:07 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-f1bb818e-8ddc-49c7-ab01-9245665f711f req-6df8b70c-2a5b-4ebd-8cad-4a354960a51b service nova] Lock "663933b0-95dc-4fba-b411-029f0552571d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:23:07 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-f1bb818e-8ddc-49c7-ab01-9245665f711f req-6df8b70c-2a5b-4ebd-8cad-4a354960a51b service nova] Lock "663933b0-95dc-4fba-b411-029f0552571d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:23:07 user nova-compute[75226]: DEBUG nova.compute.manager [req-f1bb818e-8ddc-49c7-ab01-9245665f711f req-6df8b70c-2a5b-4ebd-8cad-4a354960a51b service nova] [instance: 663933b0-95dc-4fba-b411-029f0552571d] No waiting events found dispatching network-vif-plugged-462b7d76-b8d0-4374-8b29-da083c4ec28f {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:23:07 user nova-compute[75226]: WARNING nova.compute.manager [req-f1bb818e-8ddc-49c7-ab01-9245665f711f req-6df8b70c-2a5b-4ebd-8cad-4a354960a51b service nova] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Received unexpected event network-vif-plugged-462b7d76-b8d0-4374-8b29-da083c4ec28f for instance with vm_state building and task_state spawning.
Nov 17 01:23:07 user nova-compute[75226]: DEBUG nova.compute.manager [req-f1bb818e-8ddc-49c7-ab01-9245665f711f req-6df8b70c-2a5b-4ebd-8cad-4a354960a51b service nova] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Received event network-vif-plugged-fbacd963-6a62-4682-89a2-27f92a9f0ff2 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:23:07 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-f1bb818e-8ddc-49c7-ab01-9245665f711f req-6df8b70c-2a5b-4ebd-8cad-4a354960a51b service nova] Acquiring lock "663933b0-95dc-4fba-b411-029f0552571d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:23:07 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-f1bb818e-8ddc-49c7-ab01-9245665f711f req-6df8b70c-2a5b-4ebd-8cad-4a354960a51b service nova] Lock "663933b0-95dc-4fba-b411-029f0552571d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:23:07 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-f1bb818e-8ddc-49c7-ab01-9245665f711f req-6df8b70c-2a5b-4ebd-8cad-4a354960a51b service nova] Lock "663933b0-95dc-4fba-b411-029f0552571d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:23:07 user nova-compute[75226]: DEBUG nova.compute.manager [req-f1bb818e-8ddc-49c7-ab01-9245665f711f req-6df8b70c-2a5b-4ebd-8cad-4a354960a51b service nova] [instance: 663933b0-95dc-4fba-b411-029f0552571d] No waiting events found dispatching network-vif-plugged-fbacd963-6a62-4682-89a2-27f92a9f0ff2 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:23:07 user nova-compute[75226]: WARNING nova.compute.manager [req-f1bb818e-8ddc-49c7-ab01-9245665f711f req-6df8b70c-2a5b-4ebd-8cad-4a354960a51b service nova] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Received unexpected event network-vif-plugged-fbacd963-6a62-4682-89a2-27f92a9f0ff2 for instance with vm_state building and task_state spawning.
Nov 17 01:23:07 user nova-compute[75226]: DEBUG nova.compute.manager [req-f1bb818e-8ddc-49c7-ab01-9245665f711f req-6df8b70c-2a5b-4ebd-8cad-4a354960a51b service nova] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Received event network-vif-plugged-fbacd963-6a62-4682-89a2-27f92a9f0ff2 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:23:07 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-f1bb818e-8ddc-49c7-ab01-9245665f711f req-6df8b70c-2a5b-4ebd-8cad-4a354960a51b service nova] Acquiring lock "663933b0-95dc-4fba-b411-029f0552571d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:23:07 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-f1bb818e-8ddc-49c7-ab01-9245665f711f req-6df8b70c-2a5b-4ebd-8cad-4a354960a51b service nova] Lock "663933b0-95dc-4fba-b411-029f0552571d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:23:07 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-f1bb818e-8ddc-49c7-ab01-9245665f711f req-6df8b70c-2a5b-4ebd-8cad-4a354960a51b service nova] Lock "663933b0-95dc-4fba-b411-029f0552571d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:23:07 user nova-compute[75226]: DEBUG nova.compute.manager [req-f1bb818e-8ddc-49c7-ab01-9245665f711f req-6df8b70c-2a5b-4ebd-8cad-4a354960a51b service nova] [instance: 663933b0-95dc-4fba-b411-029f0552571d] No waiting events found dispatching network-vif-plugged-fbacd963-6a62-4682-89a2-27f92a9f0ff2 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:23:07 user nova-compute[75226]: WARNING nova.compute.manager [req-f1bb818e-8ddc-49c7-ab01-9245665f711f req-6df8b70c-2a5b-4ebd-8cad-4a354960a51b service nova] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Received unexpected event network-vif-plugged-fbacd963-6a62-4682-89a2-27f92a9f0ff2 for instance with vm_state building and task_state spawning.
Nov 17 01:23:07 user nova-compute[75226]: DEBUG nova.compute.manager [req-f1bb818e-8ddc-49c7-ab01-9245665f711f req-6df8b70c-2a5b-4ebd-8cad-4a354960a51b service nova] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Received event network-vif-plugged-24888c49-a7a9-4f44-8f95-1174dba77750 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:23:07 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-f1bb818e-8ddc-49c7-ab01-9245665f711f req-6df8b70c-2a5b-4ebd-8cad-4a354960a51b service nova] Acquiring lock "663933b0-95dc-4fba-b411-029f0552571d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:23:07 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-f1bb818e-8ddc-49c7-ab01-9245665f711f req-6df8b70c-2a5b-4ebd-8cad-4a354960a51b service nova] Lock "663933b0-95dc-4fba-b411-029f0552571d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:23:07 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-f1bb818e-8ddc-49c7-ab01-9245665f711f req-6df8b70c-2a5b-4ebd-8cad-4a354960a51b service nova] Lock "663933b0-95dc-4fba-b411-029f0552571d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:23:07 user nova-compute[75226]: DEBUG nova.compute.manager [req-f1bb818e-8ddc-49c7-ab01-9245665f711f req-6df8b70c-2a5b-4ebd-8cad-4a354960a51b service nova] [instance: 663933b0-95dc-4fba-b411-029f0552571d] No waiting events found dispatching network-vif-plugged-24888c49-a7a9-4f44-8f95-1174dba77750 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:23:07 user nova-compute[75226]: WARNING nova.compute.manager [req-f1bb818e-8ddc-49c7-ab01-9245665f711f req-6df8b70c-2a5b-4ebd-8cad-4a354960a51b service nova] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Received unexpected event network-vif-plugged-24888c49-a7a9-4f44-8f95-1174dba77750 for instance with vm_state building and task_state spawning.
Nov 17 01:23:07 user nova-compute[75226]: DEBUG nova.compute.manager [req-f1bb818e-8ddc-49c7-ab01-9245665f711f req-6df8b70c-2a5b-4ebd-8cad-4a354960a51b service nova] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Received event network-vif-plugged-24888c49-a7a9-4f44-8f95-1174dba77750 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:23:07 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-f1bb818e-8ddc-49c7-ab01-9245665f711f req-6df8b70c-2a5b-4ebd-8cad-4a354960a51b service nova] Acquiring lock "663933b0-95dc-4fba-b411-029f0552571d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:23:07 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-f1bb818e-8ddc-49c7-ab01-9245665f711f req-6df8b70c-2a5b-4ebd-8cad-4a354960a51b service nova] Lock "663933b0-95dc-4fba-b411-029f0552571d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:23:07 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-f1bb818e-8ddc-49c7-ab01-9245665f711f req-6df8b70c-2a5b-4ebd-8cad-4a354960a51b service nova] Lock "663933b0-95dc-4fba-b411-029f0552571d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:23:07 user nova-compute[75226]: DEBUG nova.compute.manager [req-f1bb818e-8ddc-49c7-ab01-9245665f711f req-6df8b70c-2a5b-4ebd-8cad-4a354960a51b service nova] [instance: 663933b0-95dc-4fba-b411-029f0552571d] No waiting events found dispatching network-vif-plugged-24888c49-a7a9-4f44-8f95-1174dba77750 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:23:07 user nova-compute[75226]: WARNING nova.compute.manager [req-f1bb818e-8ddc-49c7-ab01-9245665f711f req-6df8b70c-2a5b-4ebd-8cad-4a354960a51b service nova] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Received unexpected event network-vif-plugged-24888c49-a7a9-4f44-8f95-1174dba77750 for instance with vm_state building and task_state spawning.
Nov 17 01:23:07 user nova-compute[75226]: DEBUG nova.compute.manager [req-f1bb818e-8ddc-49c7-ab01-9245665f711f req-6df8b70c-2a5b-4ebd-8cad-4a354960a51b service nova] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Received event network-vif-plugged-153c3e02-4aa9-4b9f-b03d-229f12e2ed68 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:23:07 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-f1bb818e-8ddc-49c7-ab01-9245665f711f req-6df8b70c-2a5b-4ebd-8cad-4a354960a51b service nova] Acquiring lock "663933b0-95dc-4fba-b411-029f0552571d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:23:07 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-f1bb818e-8ddc-49c7-ab01-9245665f711f req-6df8b70c-2a5b-4ebd-8cad-4a354960a51b service nova] Lock "663933b0-95dc-4fba-b411-029f0552571d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:23:07 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-f1bb818e-8ddc-49c7-ab01-9245665f711f req-6df8b70c-2a5b-4ebd-8cad-4a354960a51b service nova] Lock "663933b0-95dc-4fba-b411-029f0552571d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:23:07 user nova-compute[75226]: DEBUG nova.compute.manager [req-f1bb818e-8ddc-49c7-ab01-9245665f711f req-6df8b70c-2a5b-4ebd-8cad-4a354960a51b service nova] [instance: 663933b0-95dc-4fba-b411-029f0552571d] No waiting events found dispatching network-vif-plugged-153c3e02-4aa9-4b9f-b03d-229f12e2ed68 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:23:07 user nova-compute[75226]: WARNING nova.compute.manager [req-f1bb818e-8ddc-49c7-ab01-9245665f711f req-6df8b70c-2a5b-4ebd-8cad-4a354960a51b service nova] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Received unexpected event network-vif-plugged-153c3e02-4aa9-4b9f-b03d-229f12e2ed68 for instance with vm_state building and task_state spawning.
Nov 17 01:23:07 user nova-compute[75226]: DEBUG nova.compute.manager [req-ad0d2747-ea73-473b-9ae4-3a46b238cb4b req-dec0125a-5e4d-44bb-92cc-7e8f629fdbf1 service nova] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Received event network-vif-plugged-6bcf1322-1aad-4ffa-9231-7273376e4572 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:23:07 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-ad0d2747-ea73-473b-9ae4-3a46b238cb4b req-dec0125a-5e4d-44bb-92cc-7e8f629fdbf1 service nova] Acquiring lock "663933b0-95dc-4fba-b411-029f0552571d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:23:07 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-ad0d2747-ea73-473b-9ae4-3a46b238cb4b req-dec0125a-5e4d-44bb-92cc-7e8f629fdbf1 service nova] Lock "663933b0-95dc-4fba-b411-029f0552571d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:23:07 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-ad0d2747-ea73-473b-9ae4-3a46b238cb4b req-dec0125a-5e4d-44bb-92cc-7e8f629fdbf1 service nova] Lock "663933b0-95dc-4fba-b411-029f0552571d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:23:07 user nova-compute[75226]: DEBUG nova.compute.manager [req-ad0d2747-ea73-473b-9ae4-3a46b238cb4b req-dec0125a-5e4d-44bb-92cc-7e8f629fdbf1 service nova] [instance: 663933b0-95dc-4fba-b411-029f0552571d] No waiting events found dispatching network-vif-plugged-6bcf1322-1aad-4ffa-9231-7273376e4572 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:23:07 user nova-compute[75226]: WARNING nova.compute.manager [req-ad0d2747-ea73-473b-9ae4-3a46b238cb4b req-dec0125a-5e4d-44bb-92cc-7e8f629fdbf1 service nova] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Received unexpected event network-vif-plugged-6bcf1322-1aad-4ffa-9231-7273376e4572 for instance with vm_state building and task_state spawning.
Nov 17 01:23:07 user nova-compute[75226]: DEBUG nova.compute.manager [req-ad0d2747-ea73-473b-9ae4-3a46b238cb4b req-dec0125a-5e4d-44bb-92cc-7e8f629fdbf1 service nova] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Received event network-vif-plugged-46134046-ef40-4332-aa3f-044beaf6f991 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:23:07 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-ad0d2747-ea73-473b-9ae4-3a46b238cb4b req-dec0125a-5e4d-44bb-92cc-7e8f629fdbf1 service nova] Acquiring lock "663933b0-95dc-4fba-b411-029f0552571d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:23:07 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-ad0d2747-ea73-473b-9ae4-3a46b238cb4b req-dec0125a-5e4d-44bb-92cc-7e8f629fdbf1 service nova] Lock "663933b0-95dc-4fba-b411-029f0552571d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:23:07 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-ad0d2747-ea73-473b-9ae4-3a46b238cb4b req-dec0125a-5e4d-44bb-92cc-7e8f629fdbf1 service nova] Lock "663933b0-95dc-4fba-b411-029f0552571d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:23:07 user nova-compute[75226]: DEBUG nova.compute.manager [req-ad0d2747-ea73-473b-9ae4-3a46b238cb4b req-dec0125a-5e4d-44bb-92cc-7e8f629fdbf1 service nova] [instance: 663933b0-95dc-4fba-b411-029f0552571d] No waiting events found dispatching network-vif-plugged-46134046-ef40-4332-aa3f-044beaf6f991 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:23:07 user nova-compute[75226]: WARNING nova.compute.manager [req-ad0d2747-ea73-473b-9ae4-3a46b238cb4b req-dec0125a-5e4d-44bb-92cc-7e8f629fdbf1 service nova] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Received unexpected event network-vif-plugged-46134046-ef40-4332-aa3f-044beaf6f991 for instance with vm_state building and task_state spawning.
Nov 17 01:23:07 user nova-compute[75226]: DEBUG nova.compute.manager [req-ad0d2747-ea73-473b-9ae4-3a46b238cb4b req-dec0125a-5e4d-44bb-92cc-7e8f629fdbf1 service nova] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Received event network-vif-plugged-46134046-ef40-4332-aa3f-044beaf6f991 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:23:07 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-ad0d2747-ea73-473b-9ae4-3a46b238cb4b req-dec0125a-5e4d-44bb-92cc-7e8f629fdbf1 service nova] Acquiring lock "663933b0-95dc-4fba-b411-029f0552571d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:23:07 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-ad0d2747-ea73-473b-9ae4-3a46b238cb4b req-dec0125a-5e4d-44bb-92cc-7e8f629fdbf1 service nova] Lock "663933b0-95dc-4fba-b411-029f0552571d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:23:07 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-ad0d2747-ea73-473b-9ae4-3a46b238cb4b req-dec0125a-5e4d-44bb-92cc-7e8f629fdbf1 service nova] Lock "663933b0-95dc-4fba-b411-029f0552571d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:23:07 user nova-compute[75226]: DEBUG nova.compute.manager [req-ad0d2747-ea73-473b-9ae4-3a46b238cb4b req-dec0125a-5e4d-44bb-92cc-7e8f629fdbf1 service nova] [instance: 663933b0-95dc-4fba-b411-029f0552571d] No waiting events found dispatching network-vif-plugged-46134046-ef40-4332-aa3f-044beaf6f991 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:23:07 user nova-compute[75226]: WARNING nova.compute.manager [req-ad0d2747-ea73-473b-9ae4-3a46b238cb4b req-dec0125a-5e4d-44bb-92cc-7e8f629fdbf1 service nova] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Received unexpected event network-vif-plugged-46134046-ef40-4332-aa3f-044beaf6f991 for instance with vm_state building and task_state spawning.
Nov 17 01:23:07 user nova-compute[75226]: DEBUG nova.compute.manager [req-bf13e058-5f12-46a5-aeef-5964dfd99bcb req-e2c1af94-2a4d-4a06-9816-83d9d23ebaa4 service nova] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Received event network-vif-plugged-5f7ca871-040f-460c-8709-7ca74ca282ba {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:23:07 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-bf13e058-5f12-46a5-aeef-5964dfd99bcb req-e2c1af94-2a4d-4a06-9816-83d9d23ebaa4 service nova] Acquiring lock "663933b0-95dc-4fba-b411-029f0552571d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:23:07 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-bf13e058-5f12-46a5-aeef-5964dfd99bcb req-e2c1af94-2a4d-4a06-9816-83d9d23ebaa4 service nova] Lock "663933b0-95dc-4fba-b411-029f0552571d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:23:07 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-bf13e058-5f12-46a5-aeef-5964dfd99bcb req-e2c1af94-2a4d-4a06-9816-83d9d23ebaa4 service nova] Lock "663933b0-95dc-4fba-b411-029f0552571d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:23:07 user nova-compute[75226]: DEBUG nova.compute.manager [req-bf13e058-5f12-46a5-aeef-5964dfd99bcb req-e2c1af94-2a4d-4a06-9816-83d9d23ebaa4 service nova] [instance: 663933b0-95dc-4fba-b411-029f0552571d] No waiting events found dispatching network-vif-plugged-5f7ca871-040f-460c-8709-7ca74ca282ba {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:23:07 user nova-compute[75226]: WARNING nova.compute.manager [req-bf13e058-5f12-46a5-aeef-5964dfd99bcb req-e2c1af94-2a4d-4a06-9816-83d9d23ebaa4 service nova] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Received unexpected event network-vif-plugged-5f7ca871-040f-460c-8709-7ca74ca282ba for instance with vm_state building and task_state spawning.
Nov 17 01:23:07 user nova-compute[75226]: DEBUG nova.compute.manager [req-bf13e058-5f12-46a5-aeef-5964dfd99bcb req-e2c1af94-2a4d-4a06-9816-83d9d23ebaa4 service nova] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Received event network-vif-plugged-5f7ca871-040f-460c-8709-7ca74ca282ba {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:23:07 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-bf13e058-5f12-46a5-aeef-5964dfd99bcb req-e2c1af94-2a4d-4a06-9816-83d9d23ebaa4 service nova] Acquiring lock "663933b0-95dc-4fba-b411-029f0552571d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:23:07 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-bf13e058-5f12-46a5-aeef-5964dfd99bcb req-e2c1af94-2a4d-4a06-9816-83d9d23ebaa4 service nova] Lock "663933b0-95dc-4fba-b411-029f0552571d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:23:07 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-bf13e058-5f12-46a5-aeef-5964dfd99bcb req-e2c1af94-2a4d-4a06-9816-83d9d23ebaa4 service nova] Lock "663933b0-95dc-4fba-b411-029f0552571d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:23:07 user nova-compute[75226]: DEBUG nova.compute.manager [req-bf13e058-5f12-46a5-aeef-5964dfd99bcb req-e2c1af94-2a4d-4a06-9816-83d9d23ebaa4 service nova] [instance: 663933b0-95dc-4fba-b411-029f0552571d] No waiting events found dispatching network-vif-plugged-5f7ca871-040f-460c-8709-7ca74ca282ba {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:23:07 user nova-compute[75226]: WARNING nova.compute.manager [req-bf13e058-5f12-46a5-aeef-5964dfd99bcb req-e2c1af94-2a4d-4a06-9816-83d9d23ebaa4 service nova] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Received unexpected event network-vif-plugged-5f7ca871-040f-460c-8709-7ca74ca282ba for instance with vm_state building and task_state spawning.
Nov 17 01:23:07 user nova-compute[75226]: DEBUG nova.compute.manager [req-7b4f730f-afc0-4b53-a872-f306252316dd req-67094f46-e44a-460e-94bb-154e8b181618 service nova] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Received event network-vif-plugged-153c3e02-4aa9-4b9f-b03d-229f12e2ed68 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:23:07 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-7b4f730f-afc0-4b53-a872-f306252316dd req-67094f46-e44a-460e-94bb-154e8b181618 service nova] Acquiring lock "663933b0-95dc-4fba-b411-029f0552571d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:23:07 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-7b4f730f-afc0-4b53-a872-f306252316dd req-67094f46-e44a-460e-94bb-154e8b181618 service nova] Lock "663933b0-95dc-4fba-b411-029f0552571d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:23:07 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-7b4f730f-afc0-4b53-a872-f306252316dd req-67094f46-e44a-460e-94bb-154e8b181618 service nova] Lock "663933b0-95dc-4fba-b411-029f0552571d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:23:07 user nova-compute[75226]: DEBUG nova.compute.manager [req-7b4f730f-afc0-4b53-a872-f306252316dd req-67094f46-e44a-460e-94bb-154e8b181618 service nova] [instance: 663933b0-95dc-4fba-b411-029f0552571d] No waiting events found dispatching network-vif-plugged-153c3e02-4aa9-4b9f-b03d-229f12e2ed68 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:23:07 user nova-compute[75226]: WARNING nova.compute.manager [req-7b4f730f-afc0-4b53-a872-f306252316dd req-67094f46-e44a-460e-94bb-154e8b181618 service nova] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Received unexpected event network-vif-plugged-153c3e02-4aa9-4b9f-b03d-229f12e2ed68 for instance with vm_state building and task_state spawning.
Nov 17 01:23:07 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:23:07 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e8364f0c-8a3b-4c0d-99e8-5e881ac3c08e tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Acquiring lock "f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:23:07 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e8364f0c-8a3b-4c0d-99e8-5e881ac3c08e tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Lock "f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:23:07 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:23:07 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:23:07 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Hypervisor/Node resource view: name=user free_ram=7698MB free_disk=25.09433364868164GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75226) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 17 01:23:07 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:23:07 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:23:07 user nova-compute[75226]: INFO nova.virt.libvirt.driver [-] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Instance spawned successfully.
Nov 17 01:23:07 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 17 01:23:07 user nova-compute[75226]: DEBUG nova.objects.instance [None req-e8364f0c-8a3b-4c0d-99e8-5e881ac3c08e tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Lazy-loading 'flavor' on Instance uuid f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:23:08 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Found default for hw_cdrom_bus of ide {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:23:08 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Found default for hw_disk_bus of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:23:08 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Found default for hw_input_bus of None {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:23:08 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Found default for hw_pointer_model of None {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:23:08 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Found default for hw_video_model of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:23:08 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Found default for hw_vif_model of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:23:08 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e8364f0c-8a3b-4c0d-99e8-5e881ac3c08e tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Lock "f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.089s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:23:08 user nova-compute[75226]: INFO nova.compute.manager [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Took 13.52 seconds to spawn the instance on the hypervisor.
Nov 17 01:23:08 user nova-compute[75226]: DEBUG nova.compute.manager [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Checking state {{(pid=75226) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 01:23:08 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e8364f0c-8a3b-4c0d-99e8-5e881ac3c08e tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Acquiring lock "f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:23:08 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e8364f0c-8a3b-4c0d-99e8-5e881ac3c08e tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Lock "f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:23:08 user nova-compute[75226]: INFO nova.compute.manager [None req-e8364f0c-8a3b-4c0d-99e8-5e881ac3c08e tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] [instance: f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c] Attaching volume dd06256f-5f5b-4cf6-962d-f77749280421 to /dev/vdb
Nov 17 01:23:08 user nova-compute[75226]: INFO nova.compute.manager [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Took 41.16 seconds to build instance.
Nov 17 01:23:08 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-f6fb9664-92a6-4c6f-aa05-0a681ce3b94d tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Lock "663933b0-95dc-4fba-b411-029f0552571d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 41.264s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:23:08 user nova-compute[75226]: DEBUG os_brick.utils [None req-e8364f0c-8a3b-4c0d-99e8-5e881ac3c08e tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:23:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:23:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:23:08 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb022af8-8c67-43f3-b2b4-db9070794a96]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f62857db69\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:23:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:23:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.024s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:23:08 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc663f53-9cc3-4071-bc06-8cdc6d4d1a9b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:23:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:23:08 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance aa84e575-bdad-45b9-80ce-86b1c2826fb0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:23:08 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance ddfecefc-1e9b-4e6e-9995-855c8a061084 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:23:08 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 724b81dd-4531-4c99-850d-0bfcbfdf7bd4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:23:08 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 6b7e9611-be35-4e51-b886-91a2fac0a653 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:23:08 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 52fe0a91-9320-47d2-ac83-4f49260a0997 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:23:08 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:23:08 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 2fbdd8af-f608-4d73-92d9-ae0586814c1b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:23:08 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 38062487-67ca-4962-974f-81456aebe97b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:23:08 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 306054a8-4d0f-4913-b3b8-97aeeeec071c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:23:08 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 663933b0-95dc-4fba-b411-029f0552571d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:23:08 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75226) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 17 01:23:08 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75226) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 17 01:23:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:23:08 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e6169e0-e4cf-4dc3-ba6b-e6ff5fa38d17]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:23:08 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[caec2fbe-d69a-487d-b00c-c0a2f0283c84]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:23:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e8364f0c-8a3b-4c0d-99e8-5e881ac3c08e tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Running cmd (subprocess): nvme version {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:23:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e8364f0c-8a3b-4c0d-99e8-5e881ac3c08e tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] 'nvme version' failed. Not Retrying. {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 01:23:08 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Refreshing inventories for resource provider f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 17 01:23:08 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e8364f0c-8a3b-4c0d-99e8-5e881ac3c08e tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] nvme not present on system {{(pid=75226) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 17 01:23:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:23:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 01:23:08 user nova-compute[75226]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 17 01:23:08 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[376a28c8-06cf-45ed-b3e5-2fca8d43052f]: (4, '') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:23:08 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-e8364f0c-8a3b-4c0d-99e8-5e881ac3c08e tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75226) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 17 01:23:08 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-e8364f0c-8a3b-4c0d-99e8-5e881ac3c08e tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75226) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 17 01:23:08 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-e8364f0c-8a3b-4c0d-99e8-5e881ac3c08e tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] LIGHTOS: no hostnqn found. {{(pid=75226) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 17 01:23:08 user nova-compute[75226]: DEBUG os_brick.utils [None req-e8364f0c-8a3b-4c0d-99e8-5e881ac3c08e tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] <== get_connector_properties: return (182ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f62857db69', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:23:08 user nova-compute[75226]: DEBUG nova.virt.block_device [None req-e8364f0c-8a3b-4c0d-99e8-5e881ac3c08e tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] [instance: f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c] Updating existing volume attachment record: 16d9e736-8829-4dbb-b794-bd5de56c721b {{(pid=75226) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 17 01:23:08 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Updating ProviderTree inventory for provider f431122b-abb2-4ecb-9e21-e3ec333d823b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 17 01:23:08 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Updating inventory in ProviderTree for provider f431122b-abb2-4ecb-9e21-e3ec333d823b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 17 01:23:08 user nova-compute[75226]: DEBUG nova.network.neutron [req-708546b9-8cb5-4ba4-a0ec-38653348cb5f req-b0a51319-dc10-4399-9cac-7942cc5dde64 service nova] [instance: f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c] Updated VIF entry in instance network info cache for port ed40e788-7338-4ecd-8204-008d4601131b. {{(pid=75226) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 01:23:08 user nova-compute[75226]: DEBUG nova.network.neutron [req-708546b9-8cb5-4ba4-a0ec-38653348cb5f req-b0a51319-dc10-4399-9cac-7942cc5dde64 service nova] [instance: f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c] Updating instance_info_cache with network_info: [{"id": "ed40e788-7338-4ecd-8204-008d4601131b", "address": "fa:16:3e:69:68:ce", "network": {"id": "c93f11a7-52c6-4379-a1fb-9a002876c221", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-985502177-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "054575d3dc66452091173b4c604b8c96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped40e788-73", "ovs_interfaceid": "ed40e788-7338-4ecd-8204-008d4601131b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:23:08 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-708546b9-8cb5-4ba4-a0ec-38653348cb5f req-b0a51319-dc10-4399-9cac-7942cc5dde64 service nova] Releasing lock "refresh_cache-f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:23:08 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Refreshing aggregate associations for resource provider f431122b-abb2-4ecb-9e21-e3ec333d823b, aggregates: None {{(pid=75226) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 17 01:23:08 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Refreshing trait associations for resource provider f431122b-abb2-4ecb-9e21-e3ec333d823b, traits: COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE42,HW_CPU_X86_SSE,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSSE3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_SATA {{(pid=75226) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 17 01:23:08 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:23:08 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:23:09 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Compute_service record updated for user:user {{(pid=75226) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 17 01:23:09 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.099s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:23:09 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:23:09 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Cleaning up deleted instances {{(pid=75226) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 17 01:23:09 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] There are 0 instances to clean {{(pid=75226) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 17 01:23:09 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:23:09 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75226) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 17 01:23:09 user nova-compute[75226]: DEBUG nova.compute.manager [req-9de03d6d-1384-4a73-b656-7d908c9d27c5 req-46b5bfa2-f1b9-4f3f-a7eb-8e85a0659c67 service nova] [instance: 2fbdd8af-f608-4d73-92d9-ae0586814c1b] Received event network-changed-4316e1ea-ca57-46b7-b415-7af7d3997c2c {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:23:09 user nova-compute[75226]: DEBUG nova.compute.manager [req-9de03d6d-1384-4a73-b656-7d908c9d27c5 req-46b5bfa2-f1b9-4f3f-a7eb-8e85a0659c67 service nova] [instance: 2fbdd8af-f608-4d73-92d9-ae0586814c1b] Refreshing instance network info cache due to event network-changed-4316e1ea-ca57-46b7-b415-7af7d3997c2c. {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 01:23:09 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-9de03d6d-1384-4a73-b656-7d908c9d27c5 req-46b5bfa2-f1b9-4f3f-a7eb-8e85a0659c67 service nova] Acquiring lock "refresh_cache-2fbdd8af-f608-4d73-92d9-ae0586814c1b" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:23:09 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-9de03d6d-1384-4a73-b656-7d908c9d27c5 req-46b5bfa2-f1b9-4f3f-a7eb-8e85a0659c67 service nova] Acquired lock "refresh_cache-2fbdd8af-f608-4d73-92d9-ae0586814c1b" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:23:09 user nova-compute[75226]: DEBUG nova.network.neutron [req-9de03d6d-1384-4a73-b656-7d908c9d27c5 req-46b5bfa2-f1b9-4f3f-a7eb-8e85a0659c67 service nova] [instance: 2fbdd8af-f608-4d73-92d9-ae0586814c1b] Refreshing network info cache for port 4316e1ea-ca57-46b7-b415-7af7d3997c2c {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 01:23:09 user nova-compute[75226]: DEBUG nova.network.neutron [req-9de03d6d-1384-4a73-b656-7d908c9d27c5 req-46b5bfa2-f1b9-4f3f-a7eb-8e85a0659c67 service nova] [instance: 2fbdd8af-f608-4d73-92d9-ae0586814c1b] Updated VIF entry in instance network info cache for port 4316e1ea-ca57-46b7-b415-7af7d3997c2c. {{(pid=75226) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 01:23:09 user nova-compute[75226]: DEBUG nova.network.neutron [req-9de03d6d-1384-4a73-b656-7d908c9d27c5 req-46b5bfa2-f1b9-4f3f-a7eb-8e85a0659c67 service nova] [instance: 2fbdd8af-f608-4d73-92d9-ae0586814c1b] Updating instance_info_cache with network_info: [{"id": "4316e1ea-ca57-46b7-b415-7af7d3997c2c", "address": "fa:16:3e:03:ba:fb", "network": {"id": "57d0e7ee-0b11-4e00-86f9-bb4a3c25c674", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1357446034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e38777e8baf745e79f31190da97406a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4316e1ea-ca", "ovs_interfaceid": "4316e1ea-ca57-46b7-b415-7af7d3997c2c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:23:09 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-9de03d6d-1384-4a73-b656-7d908c9d27c5 req-46b5bfa2-f1b9-4f3f-a7eb-8e85a0659c67 service nova] Releasing lock "refresh_cache-2fbdd8af-f608-4d73-92d9-ae0586814c1b" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:23:10 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:23:10 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:23:10 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Starting heal instance info cache {{(pid=75226) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 17 01:23:10 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Rebuilding the list of instances to heal {{(pid=75226) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 17 01:23:10 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "refresh_cache-aa84e575-bdad-45b9-80ce-86b1c2826fb0" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:23:10 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquired lock "refresh_cache-aa84e575-bdad-45b9-80ce-86b1c2826fb0" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:23:10 user nova-compute[75226]: DEBUG nova.network.neutron [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] [instance: aa84e575-bdad-45b9-80ce-86b1c2826fb0] Forcefully refreshing network info cache for instance {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 17 01:23:10 user nova-compute[75226]: DEBUG nova.objects.instance [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lazy-loading 'info_cache' on Instance uuid aa84e575-bdad-45b9-80ce-86b1c2826fb0 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:23:10 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-402ef0d4-d702-4569-a981-89fcdda982cc tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Acquiring lock "724b81dd-4531-4c99-850d-0bfcbfdf7bd4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:23:10 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-402ef0d4-d702-4569-a981-89fcdda982cc tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Lock "724b81dd-4531-4c99-850d-0bfcbfdf7bd4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:23:10 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-402ef0d4-d702-4569-a981-89fcdda982cc tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Acquiring lock "724b81dd-4531-4c99-850d-0bfcbfdf7bd4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:23:10 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-402ef0d4-d702-4569-a981-89fcdda982cc tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Lock "724b81dd-4531-4c99-850d-0bfcbfdf7bd4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:23:10 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-402ef0d4-d702-4569-a981-89fcdda982cc tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Lock "724b81dd-4531-4c99-850d-0bfcbfdf7bd4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:23:10 user nova-compute[75226]: INFO nova.compute.manager [None req-402ef0d4-d702-4569-a981-89fcdda982cc tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] [instance: 724b81dd-4531-4c99-850d-0bfcbfdf7bd4] Terminating instance
Nov 17 01:23:10 user nova-compute[75226]: DEBUG nova.compute.manager [None req-402ef0d4-d702-4569-a981-89fcdda982cc tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] [instance: 724b81dd-4531-4c99-850d-0bfcbfdf7bd4] Start destroying the instance on the hypervisor. {{(pid=75226) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 17 01:23:10 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:23:10 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:23:10 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:23:10 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:23:10 user nova-compute[75226]: DEBUG nova.compute.manager [req-6bf371b8-f5e0-4e79-a514-305500a35587 req-409c8dcf-d4ed-4d5c-97ed-7dd1b1144d49 service nova] [instance: 724b81dd-4531-4c99-850d-0bfcbfdf7bd4] Received event network-vif-unplugged-f9692d93-cc90-464e-a8ef-abb2a5bb8fe0 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:23:10 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-6bf371b8-f5e0-4e79-a514-305500a35587 req-409c8dcf-d4ed-4d5c-97ed-7dd1b1144d49 service nova] Acquiring lock "724b81dd-4531-4c99-850d-0bfcbfdf7bd4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:23:10 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-6bf371b8-f5e0-4e79-a514-305500a35587 req-409c8dcf-d4ed-4d5c-97ed-7dd1b1144d49 service nova] Lock "724b81dd-4531-4c99-850d-0bfcbfdf7bd4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:23:10 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-6bf371b8-f5e0-4e79-a514-305500a35587 req-409c8dcf-d4ed-4d5c-97ed-7dd1b1144d49 service nova] Lock "724b81dd-4531-4c99-850d-0bfcbfdf7bd4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:23:10 user nova-compute[75226]: DEBUG nova.compute.manager [req-6bf371b8-f5e0-4e79-a514-305500a35587 req-409c8dcf-d4ed-4d5c-97ed-7dd1b1144d49 service nova] [instance: 724b81dd-4531-4c99-850d-0bfcbfdf7bd4] No waiting events found dispatching network-vif-unplugged-f9692d93-cc90-464e-a8ef-abb2a5bb8fe0 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:23:10 user nova-compute[75226]: DEBUG nova.compute.manager [req-6bf371b8-f5e0-4e79-a514-305500a35587 req-409c8dcf-d4ed-4d5c-97ed-7dd1b1144d49 service nova] [instance: 724b81dd-4531-4c99-850d-0bfcbfdf7bd4] Received event network-vif-unplugged-f9692d93-cc90-464e-a8ef-abb2a5bb8fe0 for instance with task_state deleting. {{(pid=75226) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 17 01:23:11 user nova-compute[75226]: DEBUG nova.network.neutron [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] [instance: aa84e575-bdad-45b9-80ce-86b1c2826fb0] Updating instance_info_cache with network_info: [{"id": "734a9e23-26e5-4282-b842-62e0bb37c782", "address": "fa:16:3e:60:90:47", "network": {"id": "450540a3-ff7e-42fb-a0a6-808acd749943", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1503678778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6cb6f679ee4468d82cc7fb5d0f67be9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap734a9e23-26", "ovs_interfaceid": "734a9e23-26e5-4282-b842-62e0bb37c782", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:23:11 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Releasing lock "refresh_cache-aa84e575-bdad-45b9-80ce-86b1c2826fb0" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:23:11 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] [instance: aa84e575-bdad-45b9-80ce-86b1c2826fb0] Updated the network info_cache for instance {{(pid=75226) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 17 01:23:11 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:23:11 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:23:11 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:23:11 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:23:11 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75226) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 17 01:23:11 user nova-compute[75226]: INFO nova.virt.libvirt.driver [-] [instance: 724b81dd-4531-4c99-850d-0bfcbfdf7bd4] Instance destroyed successfully.
Nov 17 01:23:11 user nova-compute[75226]: DEBUG nova.objects.instance [None req-402ef0d4-d702-4569-a981-89fcdda982cc tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Lazy-loading 'resources' on Instance uuid 724b81dd-4531-4c99-850d-0bfcbfdf7bd4 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:23:11 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-402ef0d4-d702-4569-a981-89fcdda982cc tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:17:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1918757108',display_name='tempest-VolumesAdminNegativeTest-server-1918757108',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1918757108',id=4,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHz/4AeNYrJq3cjVcgbBFarFf/Y7cQqWDHHJVWLY2sAub0fsGTBcyR/kVR5FsLYCcm5VzBe4Kv/JoK/QFqqSbbW4dmwRj+kh+mvVyJu+Kyh26865sDa0LIqYImKwHwHIJQ==',key_name='tempest-keypair-1102038973',keypairs=<?>,launch_index=0,launched_at=2023-11-17T01:17:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8a364d502d8948ff8b255dd2531b6218',ramdisk_id='',reservation_id='r-ff0hq3ec',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-2120834708',owner_user_name='tempest-VolumesAdminNegativeTest-2120834708-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T01:17:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5f6fd5dfdd9a4a36b6965ffab1b7c1e4',uuid=724b81dd-4531-4c99-850d-0bfcbfdf7bd4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f9692d93-cc90-464e-a8ef-abb2a5bb8fe0", "address": "fa:16:3e:ac:88:c8", "network": {"id": "1c1e8b70-ab07-4bf6-896b-f8779c33ac07", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1634201097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a364d502d8948ff8b255dd2531b6218", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9692d93-cc", "ovs_interfaceid": "f9692d93-cc90-464e-a8ef-abb2a5bb8fe0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 17 01:23:11 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-402ef0d4-d702-4569-a981-89fcdda982cc tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Converting VIF {"id": "f9692d93-cc90-464e-a8ef-abb2a5bb8fe0", "address": "fa:16:3e:ac:88:c8", "network": {"id": "1c1e8b70-ab07-4bf6-896b-f8779c33ac07", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1634201097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a364d502d8948ff8b255dd2531b6218", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9692d93-cc", "ovs_interfaceid": "f9692d93-cc90-464e-a8ef-abb2a5bb8fe0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:23:11 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-402ef0d4-d702-4569-a981-89fcdda982cc tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ac:88:c8,bridge_name='br-int',has_traffic_filtering=True,id=f9692d93-cc90-464e-a8ef-abb2a5bb8fe0,network=Network(1c1e8b70-ab07-4bf6-896b-f8779c33ac07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9692d93-cc') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:23:11 user nova-compute[75226]: DEBUG os_vif [None req-402ef0d4-d702-4569-a981-89fcdda982cc tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ac:88:c8,bridge_name='br-int',has_traffic_filtering=True,id=f9692d93-cc90-464e-a8ef-abb2a5bb8fe0,network=Network(1c1e8b70-ab07-4bf6-896b-f8779c33ac07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9692d93-cc') {{(pid=75226) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 17 01:23:11 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:23:11 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf9692d93-cc, bridge=br-int, if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:23:11 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:23:11 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:23:11 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:23:11 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b5d59dcc-ee24-4aeb-8ab4-a98d96e4e219) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:23:11 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:23:11 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:23:11 user nova-compute[75226]: INFO os_vif [None req-402ef0d4-d702-4569-a981-89fcdda982cc tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ac:88:c8,bridge_name='br-int',has_traffic_filtering=True,id=f9692d93-cc90-464e-a8ef-abb2a5bb8fe0,network=Network(1c1e8b70-ab07-4bf6-896b-f8779c33ac07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9692d93-cc')
Nov 17 01:23:11 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-402ef0d4-d702-4569-a981-89fcdda982cc tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] [instance: 724b81dd-4531-4c99-850d-0bfcbfdf7bd4] Deleting instance files /opt/stack/data/nova/instances/724b81dd-4531-4c99-850d-0bfcbfdf7bd4_del
Nov 17 01:23:11 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-402ef0d4-d702-4569-a981-89fcdda982cc tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] [instance: 724b81dd-4531-4c99-850d-0bfcbfdf7bd4] Deletion of /opt/stack/data/nova/instances/724b81dd-4531-4c99-850d-0bfcbfdf7bd4_del complete
Nov 17 01:23:11 user nova-compute[75226]: INFO nova.compute.manager [None req-402ef0d4-d702-4569-a981-89fcdda982cc tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] [instance: 724b81dd-4531-4c99-850d-0bfcbfdf7bd4] Took 0.97 seconds to destroy the instance on the hypervisor.
Nov 17 01:23:11 user nova-compute[75226]: DEBUG oslo.service.loopingcall [None req-402ef0d4-d702-4569-a981-89fcdda982cc tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75226) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 17 01:23:11 user nova-compute[75226]: DEBUG nova.compute.manager [-] [instance: 724b81dd-4531-4c99-850d-0bfcbfdf7bd4] Deallocating network for instance {{(pid=75226) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 17 01:23:11 user nova-compute[75226]: DEBUG nova.network.neutron [-] [instance: 724b81dd-4531-4c99-850d-0bfcbfdf7bd4] deallocate_for_instance() {{(pid=75226) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 17 01:23:12 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-8f3b531c-b72c-4eb2-9cca-a7598113b13d tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Acquiring lock "2fbdd8af-f608-4d73-92d9-ae0586814c1b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:23:12 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-8f3b531c-b72c-4eb2-9cca-a7598113b13d tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Lock "2fbdd8af-f608-4d73-92d9-ae0586814c1b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:23:12 user nova-compute[75226]: DEBUG nova.objects.instance [None req-8f3b531c-b72c-4eb2-9cca-a7598113b13d tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Lazy-loading 'flavor' on Instance uuid 2fbdd8af-f608-4d73-92d9-ae0586814c1b {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:23:12 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-8f3b531c-b72c-4eb2-9cca-a7598113b13d tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Lock "2fbdd8af-f608-4d73-92d9-ae0586814c1b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:23:12 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-8f3b531c-b72c-4eb2-9cca-a7598113b13d tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Acquiring lock "2fbdd8af-f608-4d73-92d9-ae0586814c1b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:23:12 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-8f3b531c-b72c-4eb2-9cca-a7598113b13d tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Lock "2fbdd8af-f608-4d73-92d9-ae0586814c1b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:23:12 user nova-compute[75226]: INFO nova.compute.manager [None req-8f3b531c-b72c-4eb2-9cca-a7598113b13d tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: 2fbdd8af-f608-4d73-92d9-ae0586814c1b] Attaching volume 1fd0b73a-0d42-4e3d-a4f0-a9936d9bd1d4 to /dev/vdb
Nov 17 01:23:12 user nova-compute[75226]: DEBUG os_brick.utils [None req-8f3b531c-b72c-4eb2-9cca-a7598113b13d tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:23:12 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:23:12 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:23:12 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2b14fa6-02b2-4ac1-a5f6-1ee1e41caa71]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f62857db69\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:23:12 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:23:12 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:23:12 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[132b1186-0211-4ee8-adfc-21d0f7fafbb8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:23:12 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:23:12 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:23:12 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.026s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:23:12 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5c20c4f-d929-4243-8ed1-cbd29e1930d3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:23:12 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5715e06-c356-432b-a2b4-5debc6d8d97e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:23:12 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-8f3b531c-b72c-4eb2-9cca-a7598113b13d tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Running cmd (subprocess): nvme version {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:23:12 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-8f3b531c-b72c-4eb2-9cca-a7598113b13d tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] 'nvme version' failed. Not Retrying. {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 01:23:12 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8f3b531c-b72c-4eb2-9cca-a7598113b13d tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] nvme not present on system {{(pid=75226) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 17 01:23:12 user nova-compute[75226]: DEBUG nova.network.neutron [-] [instance: 724b81dd-4531-4c99-850d-0bfcbfdf7bd4] Updating instance_info_cache with network_info: [] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:23:12 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:23:12 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 01:23:12 user nova-compute[75226]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 17 01:23:12 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd740228-0faa-4546-b8c1-c614df13cfba]: (4, '') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:23:12 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-8f3b531c-b72c-4eb2-9cca-a7598113b13d tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75226) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 17 01:23:12 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-8f3b531c-b72c-4eb2-9cca-a7598113b13d tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75226) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 17 01:23:12 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-8f3b531c-b72c-4eb2-9cca-a7598113b13d tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] LIGHTOS: no hostnqn found. {{(pid=75226) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 17 01:23:12 user nova-compute[75226]: DEBUG os_brick.utils [None req-8f3b531c-b72c-4eb2-9cca-a7598113b13d tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] <== get_connector_properties: return (156ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f62857db69', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:23:12 user nova-compute[75226]: DEBUG nova.virt.block_device [None req-8f3b531c-b72c-4eb2-9cca-a7598113b13d tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: 2fbdd8af-f608-4d73-92d9-ae0586814c1b] Updating existing volume attachment record: c881ca99-04d1-4366-998e-87f67898bfba {{(pid=75226) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 17 01:23:12 user nova-compute[75226]: INFO nova.compute.manager [-] [instance: 724b81dd-4531-4c99-850d-0bfcbfdf7bd4] Took 1.27 seconds to deallocate network for instance.
Nov 17 01:23:12 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-402ef0d4-d702-4569-a981-89fcdda982cc tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:23:12 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-402ef0d4-d702-4569-a981-89fcdda982cc tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:23:12 user nova-compute[75226]: DEBUG nova.compute.manager [req-4634700f-e0f8-45fa-8d77-2c83a7fce530 req-0820ba28-f7bc-4aa5-94e5-fccc22c780ef service nova] [instance: 724b81dd-4531-4c99-850d-0bfcbfdf7bd4] Received event network-vif-plugged-f9692d93-cc90-464e-a8ef-abb2a5bb8fe0 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:23:12 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-4634700f-e0f8-45fa-8d77-2c83a7fce530 req-0820ba28-f7bc-4aa5-94e5-fccc22c780ef service nova] Acquiring lock "724b81dd-4531-4c99-850d-0bfcbfdf7bd4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:23:12 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-4634700f-e0f8-45fa-8d77-2c83a7fce530 req-0820ba28-f7bc-4aa5-94e5-fccc22c780ef service nova] Lock "724b81dd-4531-4c99-850d-0bfcbfdf7bd4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:23:12 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-4634700f-e0f8-45fa-8d77-2c83a7fce530 req-0820ba28-f7bc-4aa5-94e5-fccc22c780ef service nova] Lock "724b81dd-4531-4c99-850d-0bfcbfdf7bd4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:23:12 user nova-compute[75226]: DEBUG nova.compute.manager [req-4634700f-e0f8-45fa-8d77-2c83a7fce530 req-0820ba28-f7bc-4aa5-94e5-fccc22c780ef service nova] [instance: 724b81dd-4531-4c99-850d-0bfcbfdf7bd4] No waiting events found dispatching network-vif-plugged-f9692d93-cc90-464e-a8ef-abb2a5bb8fe0 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:23:12 user nova-compute[75226]: WARNING nova.compute.manager [req-4634700f-e0f8-45fa-8d77-2c83a7fce530 req-0820ba28-f7bc-4aa5-94e5-fccc22c780ef service nova] [instance: 724b81dd-4531-4c99-850d-0bfcbfdf7bd4] Received unexpected event network-vif-plugged-f9692d93-cc90-464e-a8ef-abb2a5bb8fe0 for instance with vm_state deleted and task_state None.
Nov 17 01:23:12 user nova-compute[75226]: DEBUG nova.compute.manager [req-4634700f-e0f8-45fa-8d77-2c83a7fce530 req-0820ba28-f7bc-4aa5-94e5-fccc22c780ef service nova] [instance: 724b81dd-4531-4c99-850d-0bfcbfdf7bd4] Received event network-vif-deleted-f9692d93-cc90-464e-a8ef-abb2a5bb8fe0 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:23:13 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-402ef0d4-d702-4569-a981-89fcdda982cc tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:23:13 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-402ef0d4-d702-4569-a981-89fcdda982cc tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:23:13 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-402ef0d4-d702-4569-a981-89fcdda982cc tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.444s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:23:13 user nova-compute[75226]: INFO nova.scheduler.client.report [None req-402ef0d4-d702-4569-a981-89fcdda982cc tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Deleted allocations for instance 724b81dd-4531-4c99-850d-0bfcbfdf7bd4
Nov 17 01:23:13 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-402ef0d4-d702-4569-a981-89fcdda982cc tempest-VolumesAdminNegativeTest-2120834708 tempest-VolumesAdminNegativeTest-2120834708-project-member] Lock "724b81dd-4531-4c99-850d-0bfcbfdf7bd4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.940s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:23:14 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e8364f0c-8a3b-4c0d-99e8-5e881ac3c08e tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] [instance: f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c] Calling os-brick to attach iSCSI Volume {{(pid=75226) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 17 01:23:14 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8364f0c-8a3b-4c0d-99e8-5e881ac3c08e tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc4cc36b490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LKfJojTl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:23:14 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-e8364f0c-8a3b-4c0d-99e8-5e881ac3c08e tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:23:14 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-e8364f0c-8a3b-4c0d-99e8-5e881ac3c08e tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:23:14 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-e8364f0c-8a3b-4c0d-99e8-5e881ac3c08e tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:23:14 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-e8364f0c-8a3b-4c0d-99e8-5e881ac3c08e tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:23:14 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-e8364f0c-8a3b-4c0d-99e8-5e881ac3c08e tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:23:14 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-e8364f0c-8a3b-4c0d-99e8-5e881ac3c08e tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:23:14 user nova-compute[75226]: INFO os_brick.initiator.connectors.iscsi [None req-e8364f0c-8a3b-4c0d-99e8-5e881ac3c08e tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 17 01:23:14 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421 -p 172.16.0.220:3260 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:23:14 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:23:14 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fa9e8df-ae85-4b6f-b0b4-0d68f3669c43]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:23:14 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8364f0c-8a3b-4c0d-99e8-5e881ac3c08e tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 17 01:23:14 user nova-compute[75226]:  {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:23:14 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421 -p 172.16.0.220:3260 --interface default --op new {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:23:14 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:23:14 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[f778bc32-b590-45b6-a90c-3471f0be81a4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421] added\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:23:14 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8364f0c-8a3b-4c0d-99e8-5e881ac3c08e tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421] added
Nov 17 01:23:14 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:23:14 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:23:14 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:23:14 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6049438-4f17-4022-9f29-f6e9b105ae0d]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:23:14 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8364f0c-8a3b-4c0d-99e8-5e881ac3c08e tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:23:14 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:23:14 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:23:14 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad33c86d-8b40-470e-aecd-4e90e48ab0f9]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:23:14 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8364f0c-8a3b-4c0d-99e8-5e881ac3c08e tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:23:14 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LKfJojTl {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:23:14 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LKfJojTl" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:23:14 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b05f318-8a1e-4144-a957-6eb50a46e59c]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:23:14 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8364f0c-8a3b-4c0d-99e8-5e881ac3c08e tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LKfJojTl'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:23:14 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:23:15 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:23:15 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[aadea69f-e7b7-469b-9fa3-bd8d59ad7399]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:23:15 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8364f0c-8a3b-4c0d-99e8-5e881ac3c08e tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:23:15 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:23:15 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:23:15 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc7322b9-bd09-44e4-bc64-a0487a0f8d09]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa7be6d3-d525-4aa3-bcc3-481465f2832b (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8488f49-8126-431d-96f0-b75e4e32f09a (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:928c93b5-ae63-4e04-94ce-6059e7eaa7d6 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:607b7fb8-097d-43ea-b13c-0825e015e14e (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b95a10d-6f61-48de-b7e5-de732f65f408 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:23:15 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8364f0c-8a3b-4c0d-99e8-5e881ac3c08e tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)
Nov 17 01:23:15 user nova-compute[75226]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa7be6d3-d525-4aa3-bcc3-481465f2832b (non-flash)
Nov 17 01:23:15 user nova-compute[75226]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8488f49-8126-431d-96f0-b75e4e32f09a (non-flash)
Nov 17 01:23:15 user nova-compute[75226]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:928c93b5-ae63-4e04-94ce-6059e7eaa7d6 (non-flash)
Nov 17 01:23:15 user nova-compute[75226]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:607b7fb8-097d-43ea-b13c-0825e015e14e (non-flash)
Nov 17 01:23:15 user nova-compute[75226]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b95a10d-6f61-48de-b7e5-de732f65f408 (non-flash)
Nov 17 01:23:15 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:23:15 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8364f0c-8a3b-4c0d-99e8-5e881ac3c08e tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)
Nov 17 01:23:15 user nova-compute[75226]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa7be6d3-d525-4aa3-bcc3-481465f2832b (non-flash)
Nov 17 01:23:15 user nova-compute[75226]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8488f49-8126-431d-96f0-b75e4e32f09a (non-flash)
Nov 17 01:23:15 user nova-compute[75226]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:928c93b5-ae63-4e04-94ce-6059e7eaa7d6 (non-flash)
Nov 17 01:23:15 user nova-compute[75226]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:607b7fb8-097d-43ea-b13c-0825e015e14e (non-flash)
Nov 17 01:23:15 user nova-compute[75226]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b95a10d-6f61-48de-b7e5-de732f65f408 (non-flash)
Nov 17 01:23:15 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:23:15 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421 -p 172.16.0.220:3260 --login {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:23:15 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:23:15 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[0591d2f8-63e0-40f3-a80a-f0db7d67b88f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:23:15 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8364f0c-8a3b-4c0d-99e8-5e881ac3c08e tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421, portal: 172.16.0.220,3260]
Nov 17 01:23:15 user nova-compute[75226]: Login to [iface: default, target: iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421, portal: 172.16.0.220,3260] successful.
Nov 17 01:23:15 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:23:15 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:23:15 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:23:15 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[34a5388b-4789-4bd6-8900-0c41ae76529c]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:23:15 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8364f0c-8a3b-4c0d-99e8-5e881ac3c08e tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:23:15 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:23:15 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:23:15 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6f98752-461e-4992-a39c-d43a08736a39]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa7be6d3-d525-4aa3-bcc3-481465f2832b (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8488f49-8126-431d-96f0-b75e4e32f09a (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:928c93b5-ae63-4e04-94ce-6059e7eaa7d6 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:607b7fb8-097d-43ea-b13c-0825e015e14e (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b95a10d-6f61-48de-b7e5-de732f65f408 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:23:15 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8364f0c-8a3b-4c0d-99e8-5e881ac3c08e tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)
Nov 17 01:23:15 user nova-compute[75226]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa7be6d3-d525-4aa3-bcc3-481465f2832b (non-flash)
Nov 17 01:23:15 user nova-compute[75226]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8488f49-8126-431d-96f0-b75e4e32f09a (non-flash)
Nov 17 01:23:15 user nova-compute[75226]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:928c93b5-ae63-4e04-94ce-6059e7eaa7d6 (non-flash)
Nov 17 01:23:15 user nova-compute[75226]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:607b7fb8-097d-43ea-b13c-0825e015e14e (non-flash)
Nov 17 01:23:15 user nova-compute[75226]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b95a10d-6f61-48de-b7e5-de732f65f408 (non-flash)
Nov 17 01:23:15 user nova-compute[75226]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421 (non-flash)
Nov 17 01:23:15 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:23:15 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8364f0c-8a3b-4c0d-99e8-5e881ac3c08e tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)
Nov 17 01:23:15 user nova-compute[75226]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa7be6d3-d525-4aa3-bcc3-481465f2832b (non-flash)
Nov 17 01:23:15 user nova-compute[75226]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8488f49-8126-431d-96f0-b75e4e32f09a (non-flash)
Nov 17 01:23:15 user nova-compute[75226]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:928c93b5-ae63-4e04-94ce-6059e7eaa7d6 (non-flash)
Nov 17 01:23:15 user nova-compute[75226]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:607b7fb8-097d-43ea-b13c-0825e015e14e (non-flash)
Nov 17 01:23:15 user nova-compute[75226]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b95a10d-6f61-48de-b7e5-de732f65f408 (non-flash)
Nov 17 01:23:15 user nova-compute[75226]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421 (non-flash)
Nov 17 01:23:15 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:23:15 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-e8364f0c-8a3b-4c0d-99e8-5e881ac3c08e tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.319s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:23:15 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8364f0c-8a3b-4c0d-99e8-5e881ac3c08e tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Connected to 172.16.0.220:3260 {{(pid=75226) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 17 01:23:15 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-e8364f0c-8a3b-4c0d-99e8-5e881ac3c08e tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] HCTL ('39', '-', '-', 0) found on session 22 with lun 0 {{(pid=75226) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 17 01:23:15 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-e8364f0c-8a3b-4c0d-99e8-5e881ac3c08e tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=75226) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 17 01:23:15 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:23:15 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:23:15 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab6ca443-62fb-4d67-9c25-fba5d16556b4]: (4, ('- - 0', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:23:15 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-e8364f0c-8a3b-4c0d-99e8-5e881ac3c08e tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Searching for a device in session 22 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=75226) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 01:23:15 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8364f0c-8a3b-4c0d-99e8-5e881ac3c08e tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LKfJojTl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75226) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 17 01:23:16 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-e8364f0c-8a3b-4c0d-99e8-5e881ac3c08e tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.361s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:23:16 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8364f0c-8a3b-4c0d-99e8-5e881ac3c08e tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] <== connect_volume: return (1362ms) {'type': 'block', 'scsi_wwn': '26461613436323565', 'path': '/dev/sdh'} {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:23:16 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e8364f0c-8a3b-4c0d-99e8-5e881ac3c08e tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] [instance: f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26461613436323565', 'path': '/dev/sdh'} {{(pid=75226) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 17 01:23:16 user nova-compute[75226]: DEBUG nova.objects.instance [None req-e8364f0c-8a3b-4c0d-99e8-5e881ac3c08e tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Lazy-loading 'flavor' on Instance uuid f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:23:16 user nova-compute[75226]: DEBUG nova.virt.libvirt.guest [None req-e8364f0c-8a3b-4c0d-99e8-5e881ac3c08e tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] attach device xml: <disk type="block" device="disk">
Nov 17 01:23:16 user nova-compute[75226]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 01:23:16 user nova-compute[75226]:   <source dev="/dev/sdh"/>
Nov 17 01:23:16 user nova-compute[75226]:   <target dev="vdb" bus="virtio"/>
Nov 17 01:23:16 user nova-compute[75226]:   <serial>dd06256f-5f5b-4cf6-962d-f77749280421</serial>
Nov 17 01:23:16 user nova-compute[75226]: </disk>
Nov 17 01:23:16 user nova-compute[75226]:  {{(pid=75226) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 17 01:23:16 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:23:16 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-e8364f0c-8a3b-4c0d-99e8-5e881ac3c08e tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] No BDM found with device name vda, not building metadata. {{(pid=75226) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 01:23:16 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-e8364f0c-8a3b-4c0d-99e8-5e881ac3c08e tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75226) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 01:23:16 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-e8364f0c-8a3b-4c0d-99e8-5e881ac3c08e tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] No VIF found with MAC fa:16:3e:69:68:ce, not building metadata {{(pid=75226) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 01:23:16 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e8364f0c-8a3b-4c0d-99e8-5e881ac3c08e tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Lock "f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.630s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:23:17 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-0bf6159b-8417-42b9-8f5e-beb5b3e32e96 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Acquiring lock "f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:23:17 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-0bf6159b-8417-42b9-8f5e-beb5b3e32e96 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Lock "f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:23:17 user nova-compute[75226]: DEBUG nova.compute.manager [None req-0bf6159b-8417-42b9-8f5e-beb5b3e32e96 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] [instance: f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c] Checking state {{(pid=75226) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 01:23:17 user nova-compute[75226]: DEBUG nova.compute.manager [None req-0bf6159b-8417-42b9-8f5e-beb5b3e32e96 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] [instance: f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=75226) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 17 01:23:17 user nova-compute[75226]: DEBUG nova.objects.instance [None req-0bf6159b-8417-42b9-8f5e-beb5b3e32e96 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Lazy-loading 'flavor' on Instance uuid f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:23:17 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:23:17 user nova-compute[75226]: DEBUG nova.compute.manager [req-e722c485-4107-430c-85ec-68a8a6e66ed8 req-184bb91e-1380-4e53-b171-b2f36e52842a service nova] [instance: f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c] Received event network-vif-unplugged-ed40e788-7338-4ecd-8204-008d4601131b {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:23:17 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-e722c485-4107-430c-85ec-68a8a6e66ed8 req-184bb91e-1380-4e53-b171-b2f36e52842a service nova] Acquiring lock "f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:23:17 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-e722c485-4107-430c-85ec-68a8a6e66ed8 req-184bb91e-1380-4e53-b171-b2f36e52842a service nova] Lock "f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:23:17 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-e722c485-4107-430c-85ec-68a8a6e66ed8 req-184bb91e-1380-4e53-b171-b2f36e52842a service nova] Lock "f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:23:17 user nova-compute[75226]: DEBUG nova.compute.manager [req-e722c485-4107-430c-85ec-68a8a6e66ed8 req-184bb91e-1380-4e53-b171-b2f36e52842a service nova] [instance: f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c] No waiting events found dispatching network-vif-unplugged-ed40e788-7338-4ecd-8204-008d4601131b {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:23:17 user nova-compute[75226]: WARNING nova.compute.manager [req-e722c485-4107-430c-85ec-68a8a6e66ed8 req-184bb91e-1380-4e53-b171-b2f36e52842a service nova] [instance: f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c] Received unexpected event network-vif-unplugged-ed40e788-7338-4ecd-8204-008d4601131b for instance with vm_state active and task_state powering-off.
Nov 17 01:23:17 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:23:18 user nova-compute[75226]: INFO nova.virt.libvirt.driver [-] [instance: f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c] Instance destroyed successfully.
Nov 17 01:23:18 user nova-compute[75226]: DEBUG nova.compute.manager [None req-0bf6159b-8417-42b9-8f5e-beb5b3e32e96 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] [instance: f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c] Checking state {{(pid=75226) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 01:23:18 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-0bf6159b-8417-42b9-8f5e-beb5b3e32e96 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Lock "f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 1.134s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:23:18 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f3b531c-b72c-4eb2-9cca-a7598113b13d tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: 2fbdd8af-f608-4d73-92d9-ae0586814c1b] Calling os-brick to attach iSCSI Volume {{(pid=75226) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 17 01:23:18 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f3b531c-b72c-4eb2-9cca-a7598113b13d tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc4cc36b490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1fd0b73a-0d42-4e3d-a4f0-a9936d9bd1d4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pBQMTVZW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:23:18 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-8f3b531c-b72c-4eb2-9cca-a7598113b13d tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:23:18 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-8f3b531c-b72c-4eb2-9cca-a7598113b13d tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:23:18 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-8f3b531c-b72c-4eb2-9cca-a7598113b13d tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:23:18 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-8f3b531c-b72c-4eb2-9cca-a7598113b13d tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:23:18 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-8f3b531c-b72c-4eb2-9cca-a7598113b13d tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1fd0b73a-0d42-4e3d-a4f0-a9936d9bd1d4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:23:18 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-8f3b531c-b72c-4eb2-9cca-a7598113b13d tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1fd0b73a-0d42-4e3d-a4f0-a9936d9bd1d4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:23:18 user nova-compute[75226]: INFO os_brick.initiator.connectors.iscsi [None req-8f3b531c-b72c-4eb2-9cca-a7598113b13d tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 17 01:23:18 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fd0b73a-0d42-4e3d-a4f0-a9936d9bd1d4 -p 172.16.0.220:3260 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:23:18 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fd0b73a-0d42-4e3d-a4f0-a9936d9bd1d4 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:23:18 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[4856c71d-0c17-40d9-bef4-6a4de4d83348]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:23:18 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f3b531c-b72c-4eb2-9cca-a7598113b13d tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 17 01:23:18 user nova-compute[75226]:  {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:23:18 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fd0b73a-0d42-4e3d-a4f0-a9936d9bd1d4 -p 172.16.0.220:3260 --interface default --op new {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:23:18 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fd0b73a-0d42-4e3d-a4f0-a9936d9bd1d4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:23:18 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2dca81d-f960-4b48-8cb0-d0fe950c9239]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1fd0b73a-0d42-4e3d-a4f0-a9936d9bd1d4] added\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:23:18 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f3b531c-b72c-4eb2-9cca-a7598113b13d tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1fd0b73a-0d42-4e3d-a4f0-a9936d9bd1d4] added
Nov 17 01:23:18 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:23:18 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fd0b73a-0d42-4e3d-a4f0-a9936d9bd1d4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:23:18 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fd0b73a-0d42-4e3d-a4f0-a9936d9bd1d4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:23:18 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c1c5be4-13aa-448d-beb5-cf7ce4fe614d]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:23:18 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f3b531c-b72c-4eb2-9cca-a7598113b13d tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:23:18 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fd0b73a-0d42-4e3d-a4f0-a9936d9bd1d4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:23:18 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fd0b73a-0d42-4e3d-a4f0-a9936d9bd1d4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:23:18 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[000a4fe9-b07a-4436-9a92-6818f07d9dbf]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:23:18 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f3b531c-b72c-4eb2-9cca-a7598113b13d tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:23:18 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fd0b73a-0d42-4e3d-a4f0-a9936d9bd1d4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pBQMTVZW {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:23:18 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fd0b73a-0d42-4e3d-a4f0-a9936d9bd1d4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pBQMTVZW" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:23:18 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc56bdcd-5448-43c9-af90-81fb68953ca6]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:23:18 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f3b531c-b72c-4eb2-9cca-a7598113b13d tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pBQMTVZW'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:23:18 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fd0b73a-0d42-4e3d-a4f0-a9936d9bd1d4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:23:18 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fd0b73a-0d42-4e3d-a4f0-a9936d9bd1d4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:23:18 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[36421b2f-7156-4359-9313-977ba726fcd7]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:23:18 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f3b531c-b72c-4eb2-9cca-a7598113b13d tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:23:18 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:23:18 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:23:18 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f606470-c423-4759-9ac3-9b87de5c7c49]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa7be6d3-d525-4aa3-bcc3-481465f2832b (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8488f49-8126-431d-96f0-b75e4e32f09a (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:928c93b5-ae63-4e04-94ce-6059e7eaa7d6 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:607b7fb8-097d-43ea-b13c-0825e015e14e (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b95a10d-6f61-48de-b7e5-de732f65f408 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:23:18 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f3b531c-b72c-4eb2-9cca-a7598113b13d tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)
Nov 17 01:23:18 user nova-compute[75226]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa7be6d3-d525-4aa3-bcc3-481465f2832b (non-flash)
Nov 17 01:23:18 user nova-compute[75226]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8488f49-8126-431d-96f0-b75e4e32f09a (non-flash)
Nov 17 01:23:18 user nova-compute[75226]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:928c93b5-ae63-4e04-94ce-6059e7eaa7d6 (non-flash)
Nov 17 01:23:18 user nova-compute[75226]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:607b7fb8-097d-43ea-b13c-0825e015e14e (non-flash)
Nov 17 01:23:18 user nova-compute[75226]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b95a10d-6f61-48de-b7e5-de732f65f408 (non-flash)
Nov 17 01:23:18 user nova-compute[75226]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421 (non-flash)
Nov 17 01:23:18 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:23:18 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f3b531c-b72c-4eb2-9cca-a7598113b13d tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)
Nov 17 01:23:18 user nova-compute[75226]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa7be6d3-d525-4aa3-bcc3-481465f2832b (non-flash)
Nov 17 01:23:18 user nova-compute[75226]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8488f49-8126-431d-96f0-b75e4e32f09a (non-flash)
Nov 17 01:23:18 user nova-compute[75226]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:928c93b5-ae63-4e04-94ce-6059e7eaa7d6 (non-flash)
Nov 17 01:23:18 user nova-compute[75226]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:607b7fb8-097d-43ea-b13c-0825e015e14e (non-flash)
Nov 17 01:23:18 user nova-compute[75226]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b95a10d-6f61-48de-b7e5-de732f65f408 (non-flash)
Nov 17 01:23:18 user nova-compute[75226]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421 (non-flash)
Nov 17 01:23:18 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:23:18 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fd0b73a-0d42-4e3d-a4f0-a9936d9bd1d4 -p 172.16.0.220:3260 --login {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:23:18 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fd0b73a-0d42-4e3d-a4f0-a9936d9bd1d4 -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:23:18 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[e386910e-53e3-45c4-b10e-7e792b169d20]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1fd0b73a-0d42-4e3d-a4f0-a9936d9bd1d4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1fd0b73a-0d42-4e3d-a4f0-a9936d9bd1d4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:23:18 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f3b531c-b72c-4eb2-9cca-a7598113b13d tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1fd0b73a-0d42-4e3d-a4f0-a9936d9bd1d4, portal: 172.16.0.220,3260]
Nov 17 01:23:18 user nova-compute[75226]: Login to [iface: default, target: iqn.2010-10.org.openstack:1fd0b73a-0d42-4e3d-a4f0-a9936d9bd1d4, portal: 172.16.0.220,3260] successful.
Nov 17 01:23:18 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:23:18 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fd0b73a-0d42-4e3d-a4f0-a9936d9bd1d4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:23:18 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fd0b73a-0d42-4e3d-a4f0-a9936d9bd1d4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:23:18 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[802291b2-71c8-4fa0-84d4-8928d94672f8]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:23:18 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f3b531c-b72c-4eb2-9cca-a7598113b13d tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:23:18 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:23:18 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:23:18 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cb4328c-bc58-4710-a338-fdfb2e32f4a7]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa7be6d3-d525-4aa3-bcc3-481465f2832b (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8488f49-8126-431d-96f0-b75e4e32f09a (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:928c93b5-ae63-4e04-94ce-6059e7eaa7d6 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:607b7fb8-097d-43ea-b13c-0825e015e14e (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b95a10d-6f61-48de-b7e5-de732f65f408 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fd0b73a-0d42-4e3d-a4f0-a9936d9bd1d4 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:23:18 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f3b531c-b72c-4eb2-9cca-a7598113b13d tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)
Nov 17 01:23:18 user nova-compute[75226]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa7be6d3-d525-4aa3-bcc3-481465f2832b (non-flash)
Nov 17 01:23:18 user nova-compute[75226]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8488f49-8126-431d-96f0-b75e4e32f09a (non-flash)
Nov 17 01:23:18 user nova-compute[75226]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:928c93b5-ae63-4e04-94ce-6059e7eaa7d6 (non-flash)
Nov 17 01:23:18 user nova-compute[75226]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:607b7fb8-097d-43ea-b13c-0825e015e14e (non-flash)
Nov 17 01:23:18 user nova-compute[75226]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b95a10d-6f61-48de-b7e5-de732f65f408 (non-flash)
Nov 17 01:23:18 user nova-compute[75226]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421 (non-flash)
Nov 17 01:23:18 user nova-compute[75226]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fd0b73a-0d42-4e3d-a4f0-a9936d9bd1d4 (non-flash)
Nov 17 01:23:18 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:23:18 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f3b531c-b72c-4eb2-9cca-a7598113b13d tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)
Nov 17 01:23:18 user nova-compute[75226]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa7be6d3-d525-4aa3-bcc3-481465f2832b (non-flash)
Nov 17 01:23:18 user nova-compute[75226]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8488f49-8126-431d-96f0-b75e4e32f09a (non-flash)
Nov 17 01:23:18 user nova-compute[75226]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:928c93b5-ae63-4e04-94ce-6059e7eaa7d6 (non-flash)
Nov 17 01:23:18 user nova-compute[75226]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:607b7fb8-097d-43ea-b13c-0825e015e14e (non-flash)
Nov 17 01:23:18 user nova-compute[75226]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b95a10d-6f61-48de-b7e5-de732f65f408 (non-flash)
Nov 17 01:23:18 user nova-compute[75226]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421 (non-flash)
Nov 17 01:23:18 user nova-compute[75226]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fd0b73a-0d42-4e3d-a4f0-a9936d9bd1d4 (non-flash)
Nov 17 01:23:18 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:23:19 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-8f3b531c-b72c-4eb2-9cca-a7598113b13d tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1fd0b73a-0d42-4e3d-a4f0-a9936d9bd1d4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.311s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:23:19 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f3b531c-b72c-4eb2-9cca-a7598113b13d tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Connected to 172.16.0.220:3260 {{(pid=75226) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 17 01:23:19 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-8f3b531c-b72c-4eb2-9cca-a7598113b13d tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] HCTL ('40', '-', '-', 0) found on session 23 with lun 0 {{(pid=75226) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 17 01:23:19 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-8f3b531c-b72c-4eb2-9cca-a7598113b13d tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=75226) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 17 01:23:19 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:23:19 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:23:19 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e998ddf-60e7-4244-9cf6-ccfa72dc30eb]: (4, ('- - 0', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:23:19 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-8f3b531c-b72c-4eb2-9cca-a7598113b13d tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Searching for a device in session 23 and hctl ['40', '*', '*', 0] yield: None {{(pid=75226) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 01:23:19 user nova-compute[75226]: DEBUG nova.compute.manager [req-0eb5f531-216c-4770-9cb6-3fccfb4b635a req-2eb066ca-6091-4629-8b87-720fb72d2f20 service nova] [instance: f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c] Received event network-vif-plugged-ed40e788-7338-4ecd-8204-008d4601131b {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:23:19 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-0eb5f531-216c-4770-9cb6-3fccfb4b635a req-2eb066ca-6091-4629-8b87-720fb72d2f20 service nova] Acquiring lock "f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:23:19 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-0eb5f531-216c-4770-9cb6-3fccfb4b635a req-2eb066ca-6091-4629-8b87-720fb72d2f20 service nova] Lock "f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:23:19 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-0eb5f531-216c-4770-9cb6-3fccfb4b635a req-2eb066ca-6091-4629-8b87-720fb72d2f20 service nova] Lock "f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:23:19 user nova-compute[75226]: DEBUG nova.compute.manager [req-0eb5f531-216c-4770-9cb6-3fccfb4b635a req-2eb066ca-6091-4629-8b87-720fb72d2f20 service nova] [instance: f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c] No waiting events found dispatching network-vif-plugged-ed40e788-7338-4ecd-8204-008d4601131b {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:23:19 user nova-compute[75226]: WARNING nova.compute.manager [req-0eb5f531-216c-4770-9cb6-3fccfb4b635a req-2eb066ca-6091-4629-8b87-720fb72d2f20 service nova] [instance: f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c] Received unexpected event network-vif-plugged-ed40e788-7338-4ecd-8204-008d4601131b for instance with vm_state stopped and task_state None.
Nov 17 01:23:19 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-63f3b3eb-5286-4387-a6cd-a36b65ac5e79 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 52fe0a91-9320-47d2-ac83-4f49260a0997 is timed out.
Nov 17 01:23:19 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-63f3b3eb-5286-4387-a6cd-a36b65ac5e79 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] Successfully detached device vdb from instance 52fe0a91-9320-47d2-ac83-4f49260a0997 from the live domain config.
Nov 17 01:23:19 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63f3b3eb-5286-4387-a6cd-a36b65ac5e79 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] [instance: 52fe0a91-9320-47d2-ac83-4f49260a0997] calling os-brick to detach iSCSI Volume {{(pid=75226) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 17 01:23:19 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-63f3b3eb-5286-4387-a6cd-a36b65ac5e79 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc4cc36b490>, {'target_iqn': 'iqn.2010-10.org.openstack:f8488f49-8126-431d-96f0-b75e4e32f09a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QksbWwOu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:23:19 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-63f3b3eb-5286-4387-a6cd-a36b65ac5e79 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:23:19 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-63f3b3eb-5286-4387-a6cd-a36b65ac5e79 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:23:20 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-8f3b531c-b72c-4eb2-9cca-a7598113b13d tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Searching for a device in session 23 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=75226) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 01:23:20 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f3b531c-b72c-4eb2-9cca-a7598113b13d tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:1fd0b73a-0d42-4e3d-a4f0-a9936d9bd1d4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pBQMTVZW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75226) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 17 01:23:20 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-8f3b531c-b72c-4eb2-9cca-a7598113b13d tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.346s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:23:20 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f3b531c-b72c-4eb2-9cca-a7598113b13d tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] <== connect_volume: return (1347ms) {'type': 'block', 'scsi_wwn': '26337626437383330', 'path': '/dev/sdi'} {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:23:20 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f3b531c-b72c-4eb2-9cca-a7598113b13d tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: 2fbdd8af-f608-4d73-92d9-ae0586814c1b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26337626437383330', 'path': '/dev/sdi'} {{(pid=75226) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 17 01:23:20 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-63f3b3eb-5286-4387-a6cd-a36b65ac5e79 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.352s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:23:20 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:23:20 user nova-compute[75226]: DEBUG nova.objects.instance [None req-8f3b531c-b72c-4eb2-9cca-a7598113b13d tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Lazy-loading 'flavor' on Instance uuid 2fbdd8af-f608-4d73-92d9-ae0586814c1b {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:23:20 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:23:20 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0940742-462f-42df-9102-236391147a48]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fa7be6d3-d525-4aa3-bcc3-481465f2832b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:928c93b5-ae63-4e04-94ce-6059e7eaa7d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1fd0b73a-0d42-4e3d-a4f0-a9936d9bd1d4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f8488f49-8126-431d-96f0-b75e4e32f09a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1b95a10d-6f61-48de-b7e5-de732f65f408\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:607b7fb8-097d-43ea-b13c-0825e015e14e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:23:20 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-63f3b3eb-5286-4387-a6cd-a36b65ac5e79 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 17 01:23:20 user nova-compute[75226]: No targets found.
Nov 17 01:23:20 user nova-compute[75226]: iSNS:
Nov 17 01:23:20 user nova-compute[75226]: No targets found.
Nov 17 01:23:20 user nova-compute[75226]: STATIC:
Nov 17 01:23:20 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:fa7be6d3-d525-4aa3-bcc3-481465f2832b
Nov 17 01:23:20 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:23:20 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:23:20 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:928c93b5-ae63-4e04-94ce-6059e7eaa7d6
Nov 17 01:23:20 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:23:20 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:23:20 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:1fd0b73a-0d42-4e3d-a4f0-a9936d9bd1d4
Nov 17 01:23:20 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:23:20 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:23:20 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:f8488f49-8126-431d-96f0-b75e4e32f09a
Nov 17 01:23:20 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:23:20 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:23:20 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8
Nov 17 01:23:20 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:23:20 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:23:20 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421
Nov 17 01:23:20 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:23:20 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:23:20 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:1b95a10d-6f61-48de-b7e5-de732f65f408
Nov 17 01:23:20 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:23:20 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:23:20 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:607b7fb8-097d-43ea-b13c-0825e015e14e
Nov 17 01:23:20 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:23:20 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:23:20 user nova-compute[75226]: FIRMWARE:
Nov 17 01:23:20 user nova-compute[75226]: No targets found.
Nov 17 01:23:20 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:23:20 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-63f3b3eb-5286-4387-a6cd-a36b65ac5e79 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 17 01:23:20 user nova-compute[75226]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 17 01:23:20 user nova-compute[75226]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75226) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 17 01:23:20 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-63f3b3eb-5286-4387-a6cd-a36b65ac5e79 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f8488f49-8126-431d-96f0-b75e4e32f09a', 0)] {{(pid=75226) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 17 01:23:20 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:23:20 user nova-compute[75226]: DEBUG nova.virt.libvirt.guest [None req-8f3b531c-b72c-4eb2-9cca-a7598113b13d tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] attach device xml: <disk type="block" device="disk">
Nov 17 01:23:20 user nova-compute[75226]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 01:23:20 user nova-compute[75226]:   <source dev="/dev/sdi"/>
Nov 17 01:23:20 user nova-compute[75226]:   <target dev="vdb" bus="virtio"/>
Nov 17 01:23:20 user nova-compute[75226]:   <serial>1fd0b73a-0d42-4e3d-a4f0-a9936d9bd1d4</serial>
Nov 17 01:23:20 user nova-compute[75226]: </disk>
Nov 17 01:23:20 user nova-compute[75226]:  {{(pid=75226) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 17 01:23:20 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:23:20 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c046a72-c257-4876-ba48-22f05861f717]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1b95a10d-6f61-48de-b7e5-de732f65f408\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1fd0b73a-0d42-4e3d-a4f0-a9936d9bd1d4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:607b7fb8-097d-43ea-b13c-0825e015e14e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:928c93b5-ae63-4e04-94ce-6059e7eaa7d6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f8488f49-8126-431d-96f0-b75e4e32f09a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa7be6d3-d525-4aa3-bcc3-481465f2832b\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:23:20 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:23:20 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:23:20 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f7234bb-d19d-44df-997a-82a04f872848]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa7be6d3-d525-4aa3-bcc3-481465f2832b (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8488f49-8126-431d-96f0-b75e4e32f09a (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:928c93b5-ae63-4e04-94ce-6059e7eaa7d6 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:607b7fb8-097d-43ea-b13c-0825e015e14e (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b95a10d-6f61-48de-b7e5-de732f65f408 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fd0b73a-0d42-4e3d-a4f0-a9936d9bd1d4 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:23:20 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-63f3b3eb-5286-4387-a6cd-a36b65ac5e79 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)
Nov 17 01:23:20 user nova-compute[75226]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa7be6d3-d525-4aa3-bcc3-481465f2832b (non-flash)
Nov 17 01:23:20 user nova-compute[75226]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8488f49-8126-431d-96f0-b75e4e32f09a (non-flash)
Nov 17 01:23:20 user nova-compute[75226]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:928c93b5-ae63-4e04-94ce-6059e7eaa7d6 (non-flash)
Nov 17 01:23:20 user nova-compute[75226]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:607b7fb8-097d-43ea-b13c-0825e015e14e (non-flash)
Nov 17 01:23:20 user nova-compute[75226]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b95a10d-6f61-48de-b7e5-de732f65f408 (non-flash)
Nov 17 01:23:20 user nova-compute[75226]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421 (non-flash)
Nov 17 01:23:20 user nova-compute[75226]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fd0b73a-0d42-4e3d-a4f0-a9936d9bd1d4 (non-flash)
Nov 17 01:23:20 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:23:20 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-63f3b3eb-5286-4387-a6cd-a36b65ac5e79 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)
Nov 17 01:23:20 user nova-compute[75226]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa7be6d3-d525-4aa3-bcc3-481465f2832b (non-flash)
Nov 17 01:23:20 user nova-compute[75226]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8488f49-8126-431d-96f0-b75e4e32f09a (non-flash)
Nov 17 01:23:20 user nova-compute[75226]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:928c93b5-ae63-4e04-94ce-6059e7eaa7d6 (non-flash)
Nov 17 01:23:20 user nova-compute[75226]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:607b7fb8-097d-43ea-b13c-0825e015e14e (non-flash)
Nov 17 01:23:20 user nova-compute[75226]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b95a10d-6f61-48de-b7e5-de732f65f408 (non-flash)
Nov 17 01:23:20 user nova-compute[75226]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421 (non-flash)
Nov 17 01:23:20 user nova-compute[75226]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fd0b73a-0d42-4e3d-a4f0-a9936d9bd1d4 (non-flash)
Nov 17 01:23:20 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:23:20 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-63f3b3eb-5286-4387-a6cd-a36b65ac5e79 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc4d4df7370>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f8488f49-8126-431d-96f0-b75e4e32f09a'): ({'sdb'}, set())}) {{(pid=75226) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 17 01:23:20 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-63f3b3eb-5286-4387-a6cd-a36b65ac5e79 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] Removing single pathed devices sdb {{(pid=75226) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 17 01:23:20 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:23:20 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:23:20 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f55ce6d-368a-484c-b873-7bb0307e161f]: (4, ('path checker states:\nup                  7\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:23:20 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:23:20 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:23:20 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[99174d7a-a184-418d-a37a-39a39666e762]: (4, ('ok\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:23:20 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-63f3b3eb-5286-4387-a6cd-a36b65ac5e79 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] Flushing IO for device /dev/sdb {{(pid=75226) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 17 01:23:20 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:23:20 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:23:20 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[9230f45e-7683-49fa-8e1f-e467d426799e]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:23:20 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-63f3b3eb-5286-4387-a6cd-a36b65ac5e79 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75226) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 17 01:23:20 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:23:20 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.068s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:23:20 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[49460fc4-1b25-4a6e-8866-b150db6949b8]: (4, ('1', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:23:20 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-63f3b3eb-5286-4387-a6cd-a36b65ac5e79 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75226) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 17 01:23:20 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-63f3b3eb-5286-4387-a6cd-a36b65ac5e79 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] SCSI volumes sdb have been removed. {{(pid=75226) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 17 01:23:20 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-63f3b3eb-5286-4387-a6cd-a36b65ac5e79 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f8488f49-8126-431d-96f0-b75e4e32f09a')] {{(pid=75226) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 17 01:23:20 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8488f49-8126-431d-96f0-b75e4e32f09a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:23:20 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8488f49-8126-431d-96f0-b75e4e32f09a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:23:20 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee7e6dc3-faa0-4cfb-88ea-d0fcc67de8cd]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:23:20 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-63f3b3eb-5286-4387-a6cd-a36b65ac5e79 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:23:20 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8488f49-8126-431d-96f0-b75e4e32f09a -p 172.16.0.220:3260 --logout {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:23:20 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8488f49-8126-431d-96f0-b75e4e32f09a -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:23:20 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4b38a03-789d-49d1-becc-de90c46e2905]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:f8488f49-8126-431d-96f0-b75e4e32f09a, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:f8488f49-8126-431d-96f0-b75e4e32f09a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:23:20 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-63f3b3eb-5286-4387-a6cd-a36b65ac5e79 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:f8488f49-8126-431d-96f0-b75e4e32f09a, portal: 172.16.0.220,3260]
Nov 17 01:23:20 user nova-compute[75226]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:f8488f49-8126-431d-96f0-b75e4e32f09a, portal: 172.16.0.220,3260] successful.
Nov 17 01:23:20 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:23:20 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8488f49-8126-431d-96f0-b75e4e32f09a -p 172.16.0.220:3260 --op delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:23:20 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8488f49-8126-431d-96f0-b75e4e32f09a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:23:20 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[596f6f07-8c4e-4bce-b8bc-42d51eaa72ef]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:23:20 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-63f3b3eb-5286-4387-a6cd-a36b65ac5e79 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:23:20 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-63f3b3eb-5286-4387-a6cd-a36b65ac5e79 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.365s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:23:20 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-63f3b3eb-5286-4387-a6cd-a36b65ac5e79 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] <== disconnect_volume: return (717ms) None {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:23:20 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63f3b3eb-5286-4387-a6cd-a36b65ac5e79 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] [instance: 52fe0a91-9320-47d2-ac83-4f49260a0997] Disconnected iSCSI Volume {{(pid=75226) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 17 01:23:20 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-8f3b531c-b72c-4eb2-9cca-a7598113b13d tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] No BDM found with device name vda, not building metadata. {{(pid=75226) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 01:23:20 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-8f3b531c-b72c-4eb2-9cca-a7598113b13d tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75226) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 01:23:20 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-8f3b531c-b72c-4eb2-9cca-a7598113b13d tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] No VIF found with MAC fa:16:3e:03:ba:fb, not building metadata {{(pid=75226) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 01:23:20 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-8f3b531c-b72c-4eb2-9cca-a7598113b13d tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Lock "2fbdd8af-f608-4d73-92d9-ae0586814c1b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.109s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:23:21 user nova-compute[75226]: DEBUG nova.objects.instance [None req-63f3b3eb-5286-4387-a6cd-a36b65ac5e79 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] Lazy-loading 'flavor' on Instance uuid 52fe0a91-9320-47d2-ac83-4f49260a0997 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:23:21 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-63f3b3eb-5286-4387-a6cd-a36b65ac5e79 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] Lock "52fe0a91-9320-47d2-ac83-4f49260a0997" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.107s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:23:21 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:23:22 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:23:23 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-dc6f9b63-318c-4cb8-8d52-ffd78f4db05f tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Acquiring lock "777fc3ab-09f0-414b-87f7-c806d2c5865d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:23:23 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-dc6f9b63-318c-4cb8-8d52-ffd78f4db05f tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Lock "777fc3ab-09f0-414b-87f7-c806d2c5865d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:23:23 user nova-compute[75226]: DEBUG nova.compute.manager [None req-dc6f9b63-318c-4cb8-8d52-ffd78f4db05f tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: 777fc3ab-09f0-414b-87f7-c806d2c5865d] Starting instance... {{(pid=75226) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 17 01:23:24 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-dc6f9b63-318c-4cb8-8d52-ffd78f4db05f tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:23:24 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-dc6f9b63-318c-4cb8-8d52-ffd78f4db05f tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:23:24 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-dc6f9b63-318c-4cb8-8d52-ffd78f4db05f tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75226) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 17 01:23:24 user nova-compute[75226]: INFO nova.compute.claims [None req-dc6f9b63-318c-4cb8-8d52-ffd78f4db05f tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: 777fc3ab-09f0-414b-87f7-c806d2c5865d] Claim successful on node user
Nov 17 01:23:24 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-dc6f9b63-318c-4cb8-8d52-ffd78f4db05f tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:23:24 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-dc6f9b63-318c-4cb8-8d52-ffd78f4db05f tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:23:24 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-dc6f9b63-318c-4cb8-8d52-ffd78f4db05f tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.746s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:23:24 user nova-compute[75226]: DEBUG nova.compute.manager [None req-dc6f9b63-318c-4cb8-8d52-ffd78f4db05f tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: 777fc3ab-09f0-414b-87f7-c806d2c5865d] Start building networks asynchronously for instance. {{(pid=75226) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 17 01:23:24 user nova-compute[75226]: DEBUG nova.compute.manager [None req-dc6f9b63-318c-4cb8-8d52-ffd78f4db05f tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: 777fc3ab-09f0-414b-87f7-c806d2c5865d] Allocating IP information in the background. {{(pid=75226) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 17 01:23:24 user nova-compute[75226]: DEBUG nova.network.neutron [None req-dc6f9b63-318c-4cb8-8d52-ffd78f4db05f tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: 777fc3ab-09f0-414b-87f7-c806d2c5865d] allocate_for_instance() {{(pid=75226) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 17 01:23:24 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-dc6f9b63-318c-4cb8-8d52-ffd78f4db05f tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: 777fc3ab-09f0-414b-87f7-c806d2c5865d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 17 01:23:25 user nova-compute[75226]: DEBUG nova.compute.manager [None req-dc6f9b63-318c-4cb8-8d52-ffd78f4db05f tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: 777fc3ab-09f0-414b-87f7-c806d2c5865d] Start building block device mappings for instance. {{(pid=75226) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 17 01:23:25 user nova-compute[75226]: DEBUG nova.policy [None req-dc6f9b63-318c-4cb8-8d52-ffd78f4db05f tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '642db538240b4ca1a367cf4ee9714f66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38777e8baf745e79f31190da97406a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75226) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 17 01:23:25 user nova-compute[75226]: DEBUG nova.compute.manager [None req-dc6f9b63-318c-4cb8-8d52-ffd78f4db05f tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: 777fc3ab-09f0-414b-87f7-c806d2c5865d] Start spawning the instance on the hypervisor. {{(pid=75226) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 17 01:23:25 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-dc6f9b63-318c-4cb8-8d52-ffd78f4db05f tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: 777fc3ab-09f0-414b-87f7-c806d2c5865d] Creating instance directory {{(pid=75226) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 17 01:23:25 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-dc6f9b63-318c-4cb8-8d52-ffd78f4db05f tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: 777fc3ab-09f0-414b-87f7-c806d2c5865d] Creating image(s)
Nov 17 01:23:25 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-dc6f9b63-318c-4cb8-8d52-ffd78f4db05f tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Acquiring lock "/opt/stack/data/nova/instances/777fc3ab-09f0-414b-87f7-c806d2c5865d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:23:25 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-dc6f9b63-318c-4cb8-8d52-ffd78f4db05f tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Lock "/opt/stack/data/nova/instances/777fc3ab-09f0-414b-87f7-c806d2c5865d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:23:25 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-dc6f9b63-318c-4cb8-8d52-ffd78f4db05f tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Lock "/opt/stack/data/nova/instances/777fc3ab-09f0-414b-87f7-c806d2c5865d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:23:25 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-dc6f9b63-318c-4cb8-8d52-ffd78f4db05f tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:23:25 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-dc6f9b63-318c-4cb8-8d52-ffd78f4db05f tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json" returned: 0 in 0.196s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:23:25 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-dc6f9b63-318c-4cb8-8d52-ffd78f4db05f tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Acquiring lock "a8a62c2546af3a2036b853250c5ac64d4c6b4371" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:23:25 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-dc6f9b63-318c-4cb8-8d52-ffd78f4db05f tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Lock "a8a62c2546af3a2036b853250c5ac64d4c6b4371" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:23:25 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-dc6f9b63-318c-4cb8-8d52-ffd78f4db05f tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:23:25 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-dc6f9b63-318c-4cb8-8d52-ffd78f4db05f tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json" returned: 0 in 0.177s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:23:25 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-dc6f9b63-318c-4cb8-8d52-ffd78f4db05f tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371,backing_fmt=raw /opt/stack/data/nova/instances/777fc3ab-09f0-414b-87f7-c806d2c5865d/disk 1073741824 {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:23:25 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-dc6f9b63-318c-4cb8-8d52-ffd78f4db05f tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371,backing_fmt=raw /opt/stack/data/nova/instances/777fc3ab-09f0-414b-87f7-c806d2c5865d/disk 1073741824" returned: 0 in 0.058s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:23:25 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-dc6f9b63-318c-4cb8-8d52-ffd78f4db05f tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Lock "a8a62c2546af3a2036b853250c5ac64d4c6b4371" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:23:25 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-dc6f9b63-318c-4cb8-8d52-ffd78f4db05f tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:23:25 user nova-compute[75226]: DEBUG nova.network.neutron [None req-dc6f9b63-318c-4cb8-8d52-ffd78f4db05f tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: 777fc3ab-09f0-414b-87f7-c806d2c5865d] Successfully created port: 72933cfe-e7c5-4e9e-a412-1a8fc994e629 {{(pid=75226) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 17 01:23:25 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-dc6f9b63-318c-4cb8-8d52-ffd78f4db05f tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json" returned: 0 in 0.198s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:23:25 user nova-compute[75226]: DEBUG nova.virt.disk.api [None req-dc6f9b63-318c-4cb8-8d52-ffd78f4db05f tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Checking if we can resize image /opt/stack/data/nova/instances/777fc3ab-09f0-414b-87f7-c806d2c5865d/disk. size=1073741824 {{(pid=75226) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 17 01:23:25 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-dc6f9b63-318c-4cb8-8d52-ffd78f4db05f tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/777fc3ab-09f0-414b-87f7-c806d2c5865d/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:23:26 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-dc6f9b63-318c-4cb8-8d52-ffd78f4db05f tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/777fc3ab-09f0-414b-87f7-c806d2c5865d/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:23:26 user nova-compute[75226]: DEBUG nova.virt.disk.api [None req-dc6f9b63-318c-4cb8-8d52-ffd78f4db05f tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Cannot resize image /opt/stack/data/nova/instances/777fc3ab-09f0-414b-87f7-c806d2c5865d/disk to a smaller size. {{(pid=75226) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 17 01:23:26 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-dc6f9b63-318c-4cb8-8d52-ffd78f4db05f tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: 777fc3ab-09f0-414b-87f7-c806d2c5865d] Created local disks {{(pid=75226) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 17 01:23:26 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-dc6f9b63-318c-4cb8-8d52-ffd78f4db05f tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: 777fc3ab-09f0-414b-87f7-c806d2c5865d] Ensure instance console log exists: /opt/stack/data/nova/instances/777fc3ab-09f0-414b-87f7-c806d2c5865d/console.log {{(pid=75226) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 17 01:23:26 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-dc6f9b63-318c-4cb8-8d52-ffd78f4db05f tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:23:26 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-dc6f9b63-318c-4cb8-8d52-ffd78f4db05f tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:23:26 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-dc6f9b63-318c-4cb8-8d52-ffd78f4db05f tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:23:26 user nova-compute[75226]: DEBUG nova.network.neutron [None req-dc6f9b63-318c-4cb8-8d52-ffd78f4db05f tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: 777fc3ab-09f0-414b-87f7-c806d2c5865d] Successfully updated port: 72933cfe-e7c5-4e9e-a412-1a8fc994e629 {{(pid=75226) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 17 01:23:26 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-dc6f9b63-318c-4cb8-8d52-ffd78f4db05f tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Acquiring lock "refresh_cache-777fc3ab-09f0-414b-87f7-c806d2c5865d" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:23:26 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-dc6f9b63-318c-4cb8-8d52-ffd78f4db05f tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Acquired lock "refresh_cache-777fc3ab-09f0-414b-87f7-c806d2c5865d" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:23:26 user nova-compute[75226]: DEBUG nova.network.neutron [None req-dc6f9b63-318c-4cb8-8d52-ffd78f4db05f tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: 777fc3ab-09f0-414b-87f7-c806d2c5865d] Building network info cache for instance {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 01:23:26 user nova-compute[75226]: DEBUG nova.compute.manager [req-4a301a00-4108-43f7-9b85-89b3b00778ca req-ad04e919-030b-436a-a213-9596194cf190 service nova] [instance: 777fc3ab-09f0-414b-87f7-c806d2c5865d] Received event network-changed-72933cfe-e7c5-4e9e-a412-1a8fc994e629 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:23:26 user nova-compute[75226]: DEBUG nova.compute.manager [req-4a301a00-4108-43f7-9b85-89b3b00778ca req-ad04e919-030b-436a-a213-9596194cf190 service nova] [instance: 777fc3ab-09f0-414b-87f7-c806d2c5865d] Refreshing instance network info cache due to event network-changed-72933cfe-e7c5-4e9e-a412-1a8fc994e629. {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 01:23:26 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-4a301a00-4108-43f7-9b85-89b3b00778ca req-ad04e919-030b-436a-a213-9596194cf190 service nova] Acquiring lock "refresh_cache-777fc3ab-09f0-414b-87f7-c806d2c5865d" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:23:26 user nova-compute[75226]: DEBUG nova.network.neutron [None req-dc6f9b63-318c-4cb8-8d52-ffd78f4db05f tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: 777fc3ab-09f0-414b-87f7-c806d2c5865d] Instance cache missing network info. {{(pid=75226) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 17 01:23:26 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:23:26 user nova-compute[75226]: DEBUG nova.network.neutron [None req-dc6f9b63-318c-4cb8-8d52-ffd78f4db05f tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: 777fc3ab-09f0-414b-87f7-c806d2c5865d] Updating instance_info_cache with network_info: [{"id": "72933cfe-e7c5-4e9e-a412-1a8fc994e629", "address": "fa:16:3e:d8:a4:f2", "network": {"id": "57d0e7ee-0b11-4e00-86f9-bb4a3c25c674", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1357446034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e38777e8baf745e79f31190da97406a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72933cfe-e7", "ovs_interfaceid": "72933cfe-e7c5-4e9e-a412-1a8fc994e629", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:23:26 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-dc6f9b63-318c-4cb8-8d52-ffd78f4db05f tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Releasing lock "refresh_cache-777fc3ab-09f0-414b-87f7-c806d2c5865d" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:23:26 user nova-compute[75226]: DEBUG nova.compute.manager [None req-dc6f9b63-318c-4cb8-8d52-ffd78f4db05f tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: 777fc3ab-09f0-414b-87f7-c806d2c5865d] Instance network_info: |[{"id": "72933cfe-e7c5-4e9e-a412-1a8fc994e629", "address": "fa:16:3e:d8:a4:f2", "network": {"id": "57d0e7ee-0b11-4e00-86f9-bb4a3c25c674", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1357446034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e38777e8baf745e79f31190da97406a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72933cfe-e7", "ovs_interfaceid": "72933cfe-e7c5-4e9e-a412-1a8fc994e629", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75226) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 17 01:23:26 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-4a301a00-4108-43f7-9b85-89b3b00778ca req-ad04e919-030b-436a-a213-9596194cf190 service nova] Acquired lock "refresh_cache-777fc3ab-09f0-414b-87f7-c806d2c5865d" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:23:26 user nova-compute[75226]: DEBUG nova.network.neutron [req-4a301a00-4108-43f7-9b85-89b3b00778ca req-ad04e919-030b-436a-a213-9596194cf190 service nova] [instance: 777fc3ab-09f0-414b-87f7-c806d2c5865d] Refreshing network info cache for port 72933cfe-e7c5-4e9e-a412-1a8fc994e629 {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 01:23:26 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-dc6f9b63-318c-4cb8-8d52-ffd78f4db05f tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: 777fc3ab-09f0-414b-87f7-c806d2c5865d] Start _get_guest_xml network_info=[{"id": "72933cfe-e7c5-4e9e-a412-1a8fc994e629", "address": "fa:16:3e:d8:a4:f2", "network": {"id": "57d0e7ee-0b11-4e00-86f9-bb4a3c25c674", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1357446034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e38777e8baf745e79f31190da97406a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72933cfe-e7", "ovs_interfaceid": "72933cfe-e7c5-4e9e-a412-1a8fc994e629", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T01:13:22Z,direct_url=<?>,disk_format='qcow2',id=0b369aea-6f3f-4690-9f01-229b90ab6310,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4e110cbf9a84362a6864a7732c435a1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T01:13:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '0b369aea-6f3f-4690-9f01-229b90ab6310'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75226) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 17 01:23:26 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-dc6f9b63-318c-4cb8-8d52-ffd78f4db05f tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:23:26 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-dc6f9b63-318c-4cb8-8d52-ffd78f4db05f tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:23:26 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-dc6f9b63-318c-4cb8-8d52-ffd78f4db05f tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75226) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 17 01:23:26 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-dc6f9b63-318c-4cb8-8d52-ffd78f4db05f tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] CPU controller missing on host. {{(pid=75226) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 17 01:23:26 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-dc6f9b63-318c-4cb8-8d52-ffd78f4db05f tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75226) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 17 01:23:26 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-dc6f9b63-318c-4cb8-8d52-ffd78f4db05f tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] CPU controller found on host. {{(pid=75226) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 17 01:23:26 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-dc6f9b63-318c-4cb8-8d52-ffd78f4db05f tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75226) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 17 01:23:26 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-dc6f9b63-318c-4cb8-8d52-ffd78f4db05f tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-17T01:13:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T01:13:22Z,direct_url=<?>,disk_format='qcow2',id=0b369aea-6f3f-4690-9f01-229b90ab6310,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4e110cbf9a84362a6864a7732c435a1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T01:13:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 17 01:23:26 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-dc6f9b63-318c-4cb8-8d52-ffd78f4db05f tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Flavor limits 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 17 01:23:26 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-dc6f9b63-318c-4cb8-8d52-ffd78f4db05f tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Image limits 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 17 01:23:26 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-dc6f9b63-318c-4cb8-8d52-ffd78f4db05f tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Flavor pref 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 17 01:23:26 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-dc6f9b63-318c-4cb8-8d52-ffd78f4db05f tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Image pref 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 17 01:23:26 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-dc6f9b63-318c-4cb8-8d52-ffd78f4db05f tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 17 01:23:26 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-dc6f9b63-318c-4cb8-8d52-ffd78f4db05f tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 17 01:23:26 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-dc6f9b63-318c-4cb8-8d52-ffd78f4db05f tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75226) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 17 01:23:26 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-dc6f9b63-318c-4cb8-8d52-ffd78f4db05f tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Got 1 possible topologies {{(pid=75226) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 17 01:23:26 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-dc6f9b63-318c-4cb8-8d52-ffd78f4db05f tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 17 01:23:26 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-dc6f9b63-318c-4cb8-8d52-ffd78f4db05f tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 17 01:23:26 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-dc6f9b63-318c-4cb8-8d52-ffd78f4db05f tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:23:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1306164410',display_name='tempest-AttachVolumeNegativeTest-server-1306164410',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1306164410',id=19,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNUQtuh3GpDt7mFZ41UwCB3hiK9pnZjRmaYlnAvfOGFthCUStkSU7N8JREFUo5HUL+8mgtOWM3c5bQnRfdijPDC4w0AaH+XVCgcAV+mmqFIyH7RKvwT/5vtUkvtqZ5jLHw==',key_name='tempest-keypair-260655181',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e38777e8baf745e79f31190da97406a0',ramdisk_id='',reservation_id='r-x54gz0ff',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-940905741',owner_user_name='tempest-AttachVolumeNegativeTest-940905741-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T01:23:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='642db538240b4ca1a367cf4ee9714f66',uuid=777fc3ab-09f0-414b-87f7-c806d2c5865d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "72933cfe-e7c5-4e9e-a412-1a8fc994e629", "address": "fa:16:3e:d8:a4:f2", "network": {"id": "57d0e7ee-0b11-4e00-86f9-bb4a3c25c674", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1357446034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e38777e8baf745e79f31190da97406a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72933cfe-e7", "ovs_interfaceid": "72933cfe-e7c5-4e9e-a412-1a8fc994e629", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75226) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 01:23:26 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-dc6f9b63-318c-4cb8-8d52-ffd78f4db05f tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Converting VIF {"id": "72933cfe-e7c5-4e9e-a412-1a8fc994e629", "address": "fa:16:3e:d8:a4:f2", "network": {"id": "57d0e7ee-0b11-4e00-86f9-bb4a3c25c674", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1357446034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e38777e8baf745e79f31190da97406a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72933cfe-e7", "ovs_interfaceid": "72933cfe-e7c5-4e9e-a412-1a8fc994e629", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:23:26 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-dc6f9b63-318c-4cb8-8d52-ffd78f4db05f tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:a4:f2,bridge_name='br-int',has_traffic_filtering=True,id=72933cfe-e7c5-4e9e-a412-1a8fc994e629,network=Network(57d0e7ee-0b11-4e00-86f9-bb4a3c25c674),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72933cfe-e7') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:23:26 user nova-compute[75226]: DEBUG nova.objects.instance [None req-dc6f9b63-318c-4cb8-8d52-ffd78f4db05f tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Lazy-loading 'pci_devices' on Instance uuid 777fc3ab-09f0-414b-87f7-c806d2c5865d {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:23:26 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-dc6f9b63-318c-4cb8-8d52-ffd78f4db05f tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: 777fc3ab-09f0-414b-87f7-c806d2c5865d] End _get_guest_xml xml=<domain type="kvm">
Nov 17 01:23:26 user nova-compute[75226]:   <uuid>777fc3ab-09f0-414b-87f7-c806d2c5865d</uuid>
Nov 17 01:23:26 user nova-compute[75226]:   <name>instance-00000013</name>
Nov 17 01:23:26 user nova-compute[75226]:   <memory>524288</memory>
Nov 17 01:23:26 user nova-compute[75226]:   <vcpu>1</vcpu>
Nov 17 01:23:26 user nova-compute[75226]:   <metadata>
Nov 17 01:23:26 user nova-compute[75226]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 17 01:23:26 user nova-compute[75226]:       <nova:package version="0.0.0"/>
Nov 17 01:23:26 user nova-compute[75226]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1306164410</nova:name>
Nov 17 01:23:26 user nova-compute[75226]:       <nova:creationTime>2023-11-17 01:23:26</nova:creationTime>
Nov 17 01:23:26 user nova-compute[75226]:       <nova:flavor name="m1.tiny">
Nov 17 01:23:26 user nova-compute[75226]:         <nova:memory>512</nova:memory>
Nov 17 01:23:26 user nova-compute[75226]:         <nova:disk>1</nova:disk>
Nov 17 01:23:26 user nova-compute[75226]:         <nova:swap>0</nova:swap>
Nov 17 01:23:26 user nova-compute[75226]:         <nova:ephemeral>0</nova:ephemeral>
Nov 17 01:23:26 user nova-compute[75226]:         <nova:vcpus>1</nova:vcpus>
Nov 17 01:23:26 user nova-compute[75226]:       </nova:flavor>
Nov 17 01:23:26 user nova-compute[75226]:       <nova:owner>
Nov 17 01:23:26 user nova-compute[75226]:         <nova:user uuid="642db538240b4ca1a367cf4ee9714f66">tempest-AttachVolumeNegativeTest-940905741-project-member</nova:user>
Nov 17 01:23:26 user nova-compute[75226]:         <nova:project uuid="e38777e8baf745e79f31190da97406a0">tempest-AttachVolumeNegativeTest-940905741</nova:project>
Nov 17 01:23:26 user nova-compute[75226]:       </nova:owner>
Nov 17 01:23:26 user nova-compute[75226]:       <nova:root type="image" uuid="0b369aea-6f3f-4690-9f01-229b90ab6310"/>
Nov 17 01:23:26 user nova-compute[75226]:       <nova:ports>
Nov 17 01:23:26 user nova-compute[75226]:         <nova:port uuid="72933cfe-e7c5-4e9e-a412-1a8fc994e629">
Nov 17 01:23:26 user nova-compute[75226]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 17 01:23:26 user nova-compute[75226]:         </nova:port>
Nov 17 01:23:26 user nova-compute[75226]:       </nova:ports>
Nov 17 01:23:26 user nova-compute[75226]:     </nova:instance>
Nov 17 01:23:26 user nova-compute[75226]:   </metadata>
Nov 17 01:23:26 user nova-compute[75226]:   <sysinfo type="smbios">
Nov 17 01:23:26 user nova-compute[75226]:     <system>
Nov 17 01:23:26 user nova-compute[75226]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 17 01:23:26 user nova-compute[75226]:       <entry name="product">OpenStack Nova</entry>
Nov 17 01:23:26 user nova-compute[75226]:       <entry name="version">0.0.0</entry>
Nov 17 01:23:26 user nova-compute[75226]:       <entry name="serial">777fc3ab-09f0-414b-87f7-c806d2c5865d</entry>
Nov 17 01:23:26 user nova-compute[75226]:       <entry name="uuid">777fc3ab-09f0-414b-87f7-c806d2c5865d</entry>
Nov 17 01:23:26 user nova-compute[75226]:       <entry name="family">Virtual Machine</entry>
Nov 17 01:23:26 user nova-compute[75226]:     </system>
Nov 17 01:23:26 user nova-compute[75226]:   </sysinfo>
Nov 17 01:23:26 user nova-compute[75226]:   <os>
Nov 17 01:23:26 user nova-compute[75226]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 17 01:23:26 user nova-compute[75226]:     <boot dev="hd"/>
Nov 17 01:23:26 user nova-compute[75226]:     <smbios mode="sysinfo"/>
Nov 17 01:23:26 user nova-compute[75226]:   </os>
Nov 17 01:23:26 user nova-compute[75226]:   <features>
Nov 17 01:23:26 user nova-compute[75226]:     <acpi/>
Nov 17 01:23:26 user nova-compute[75226]:     <apic/>
Nov 17 01:23:26 user nova-compute[75226]:     <vmcoreinfo/>
Nov 17 01:23:26 user nova-compute[75226]:   </features>
Nov 17 01:23:26 user nova-compute[75226]:   <clock offset="utc">
Nov 17 01:23:26 user nova-compute[75226]:     <timer name="pit" tickpolicy="delay"/>
Nov 17 01:23:26 user nova-compute[75226]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 17 01:23:26 user nova-compute[75226]:     <timer name="hpet" present="no"/>
Nov 17 01:23:26 user nova-compute[75226]:   </clock>
Nov 17 01:23:26 user nova-compute[75226]:   <cpu mode="custom" match="exact">
Nov 17 01:23:26 user nova-compute[75226]:     <model>Nehalem</model>
Nov 17 01:23:26 user nova-compute[75226]:     <topology sockets="1" cores="1" threads="1"/>
Nov 17 01:23:26 user nova-compute[75226]:   </cpu>
Nov 17 01:23:26 user nova-compute[75226]:   <devices>
Nov 17 01:23:26 user nova-compute[75226]:     <disk type="file" device="disk">
Nov 17 01:23:26 user nova-compute[75226]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 17 01:23:26 user nova-compute[75226]:       <source file="/opt/stack/data/nova/instances/777fc3ab-09f0-414b-87f7-c806d2c5865d/disk"/>
Nov 17 01:23:26 user nova-compute[75226]:       <target dev="vda" bus="virtio"/>
Nov 17 01:23:26 user nova-compute[75226]:     </disk>
Nov 17 01:23:26 user nova-compute[75226]:     <interface type="ethernet">
Nov 17 01:23:26 user nova-compute[75226]:       <mac address="fa:16:3e:d8:a4:f2"/>
Nov 17 01:23:26 user nova-compute[75226]:       <model type="virtio"/>
Nov 17 01:23:26 user nova-compute[75226]:       <mtu size="1442"/>
Nov 17 01:23:26 user nova-compute[75226]:       <target dev="tap72933cfe-e7"/>
Nov 17 01:23:26 user nova-compute[75226]:     </interface>
Nov 17 01:23:26 user nova-compute[75226]:     <serial type="pty">
Nov 17 01:23:26 user nova-compute[75226]:       <log file="/opt/stack/data/nova/instances/777fc3ab-09f0-414b-87f7-c806d2c5865d/console.log" append="off"/>
Nov 17 01:23:26 user nova-compute[75226]:     </serial>
Nov 17 01:23:26 user nova-compute[75226]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 17 01:23:26 user nova-compute[75226]:     <video>
Nov 17 01:23:26 user nova-compute[75226]:       <model type="virtio"/>
Nov 17 01:23:26 user nova-compute[75226]:     </video>
Nov 17 01:23:26 user nova-compute[75226]:     <rng model="virtio">
Nov 17 01:23:26 user nova-compute[75226]:       <backend model="random">/dev/urandom</backend>
Nov 17 01:23:26 user nova-compute[75226]:     </rng>
Nov 17 01:23:26 user nova-compute[75226]:     <controller type="usb" index="0" model="none"/>
Nov 17 01:23:26 user nova-compute[75226]:     <memballoon model="virtio">
Nov 17 01:23:26 user nova-compute[75226]:       <stats period="10"/>
Nov 17 01:23:26 user nova-compute[75226]:     </memballoon>
Nov 17 01:23:26 user nova-compute[75226]:   </devices>
Nov 17 01:23:26 user nova-compute[75226]: </domain>
Nov 17 01:23:26 user nova-compute[75226]:  {{(pid=75226) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 17 01:23:26 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-dc6f9b63-318c-4cb8-8d52-ffd78f4db05f tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:23:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1306164410',display_name='tempest-AttachVolumeNegativeTest-server-1306164410',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1306164410',id=19,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNUQtuh3GpDt7mFZ41UwCB3hiK9pnZjRmaYlnAvfOGFthCUStkSU7N8JREFUo5HUL+8mgtOWM3c5bQnRfdijPDC4w0AaH+XVCgcAV+mmqFIyH7RKvwT/5vtUkvtqZ5jLHw==',key_name='tempest-keypair-260655181',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e38777e8baf745e79f31190da97406a0',ramdisk_id='',reservation_id='r-x54gz0ff',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-940905741',owner_user_name='tempest-AttachVolumeNegativeTest-940905741-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T01:23:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='642db538240b4ca1a367cf4ee9714f66',uuid=777fc3ab-09f0-414b-87f7-c806d2c5865d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "72933cfe-e7c5-4e9e-a412-1a8fc994e629", "address": "fa:16:3e:d8:a4:f2", "network": {"id": "57d0e7ee-0b11-4e00-86f9-bb4a3c25c674", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1357446034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e38777e8baf745e79f31190da97406a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72933cfe-e7", "ovs_interfaceid": "72933cfe-e7c5-4e9e-a412-1a8fc994e629", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 17 01:23:26 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-dc6f9b63-318c-4cb8-8d52-ffd78f4db05f tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Converting VIF {"id": "72933cfe-e7c5-4e9e-a412-1a8fc994e629", "address": "fa:16:3e:d8:a4:f2", "network": {"id": "57d0e7ee-0b11-4e00-86f9-bb4a3c25c674", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1357446034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e38777e8baf745e79f31190da97406a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72933cfe-e7", "ovs_interfaceid": "72933cfe-e7c5-4e9e-a412-1a8fc994e629", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:23:26 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-dc6f9b63-318c-4cb8-8d52-ffd78f4db05f tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:a4:f2,bridge_name='br-int',has_traffic_filtering=True,id=72933cfe-e7c5-4e9e-a412-1a8fc994e629,network=Network(57d0e7ee-0b11-4e00-86f9-bb4a3c25c674),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72933cfe-e7') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:23:26 user nova-compute[75226]: DEBUG os_vif [None req-dc6f9b63-318c-4cb8-8d52-ffd78f4db05f tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:a4:f2,bridge_name='br-int',has_traffic_filtering=True,id=72933cfe-e7c5-4e9e-a412-1a8fc994e629,network=Network(57d0e7ee-0b11-4e00-86f9-bb4a3c25c674),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72933cfe-e7') {{(pid=75226) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 17 01:23:26 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:23:26 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:23:26 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 17 01:23:27 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:23:27 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '35180c32-cb48-54a0-9c81-0acc4a184195', '_type': 'linux-noop'}}, row=False) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:23:27 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:23:27 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:23:27 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:23:27 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:23:27 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap72933cfe-e7, may_exist=True, interface_attrs={}) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:23:27 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap72933cfe-e7, col_values=(('qos', UUID('cf6fcff1-9658-4dc9-9e89-545175dfab3b')),), if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:23:27 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap72933cfe-e7, col_values=(('external_ids', {'iface-id': '72933cfe-e7c5-4e9e-a412-1a8fc994e629', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d8:a4:f2', 'vm-uuid': '777fc3ab-09f0-414b-87f7-c806d2c5865d'}),), if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:23:27 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:23:27 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:23:27 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:23:27 user nova-compute[75226]: INFO os_vif [None req-dc6f9b63-318c-4cb8-8d52-ffd78f4db05f tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:a4:f2,bridge_name='br-int',has_traffic_filtering=True,id=72933cfe-e7c5-4e9e-a412-1a8fc994e629,network=Network(57d0e7ee-0b11-4e00-86f9-bb4a3c25c674),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72933cfe-e7')
Nov 17 01:23:27 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-dc6f9b63-318c-4cb8-8d52-ffd78f4db05f tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] No BDM found with device name vda, not building metadata. {{(pid=75226) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 01:23:27 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-dc6f9b63-318c-4cb8-8d52-ffd78f4db05f tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] No VIF found with MAC fa:16:3e:d8:a4:f2, not building metadata {{(pid=75226) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 01:23:27 user nova-compute[75226]: DEBUG nova.network.neutron [req-4a301a00-4108-43f7-9b85-89b3b00778ca req-ad04e919-030b-436a-a213-9596194cf190 service nova] [instance: 777fc3ab-09f0-414b-87f7-c806d2c5865d] Updated VIF entry in instance network info cache for port 72933cfe-e7c5-4e9e-a412-1a8fc994e629. {{(pid=75226) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 01:23:27 user nova-compute[75226]: DEBUG nova.network.neutron [req-4a301a00-4108-43f7-9b85-89b3b00778ca req-ad04e919-030b-436a-a213-9596194cf190 service nova] [instance: 777fc3ab-09f0-414b-87f7-c806d2c5865d] Updating instance_info_cache with network_info: [{"id": "72933cfe-e7c5-4e9e-a412-1a8fc994e629", "address": "fa:16:3e:d8:a4:f2", "network": {"id": "57d0e7ee-0b11-4e00-86f9-bb4a3c25c674", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1357446034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e38777e8baf745e79f31190da97406a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72933cfe-e7", "ovs_interfaceid": "72933cfe-e7c5-4e9e-a412-1a8fc994e629", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:23:27 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-4a301a00-4108-43f7-9b85-89b3b00778ca req-ad04e919-030b-436a-a213-9596194cf190 service nova] Releasing lock "refresh_cache-777fc3ab-09f0-414b-87f7-c806d2c5865d" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:23:27 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:23:27 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-2e42d11f-2e77-409f-bdeb-becfdae2d988 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Acquiring lock "ddfecefc-1e9b-4e6e-9995-855c8a061084" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:23:27 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-2e42d11f-2e77-409f-bdeb-becfdae2d988 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Lock "ddfecefc-1e9b-4e6e-9995-855c8a061084" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:23:27 user nova-compute[75226]: INFO nova.compute.manager [None req-2e42d11f-2e77-409f-bdeb-becfdae2d988 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] [instance: ddfecefc-1e9b-4e6e-9995-855c8a061084] Detaching volume fa7be6d3-d525-4aa3-bcc3-481465f2832b
Nov 17 01:23:27 user nova-compute[75226]: INFO nova.virt.block_device [None req-2e42d11f-2e77-409f-bdeb-becfdae2d988 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] [instance: ddfecefc-1e9b-4e6e-9995-855c8a061084] Attempting to driver detach volume fa7be6d3-d525-4aa3-bcc3-481465f2832b from mountpoint /dev/vdb
Nov 17 01:23:27 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-2e42d11f-2e77-409f-bdeb-becfdae2d988 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Attempting to detach device vdb from instance ddfecefc-1e9b-4e6e-9995-855c8a061084 from the persistent domain config. {{(pid=75226) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 17 01:23:27 user nova-compute[75226]: DEBUG nova.virt.libvirt.guest [None req-2e42d11f-2e77-409f-bdeb-becfdae2d988 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] detach device xml: <disk type="block" device="disk">
Nov 17 01:23:27 user nova-compute[75226]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 01:23:27 user nova-compute[75226]:   <source dev="/dev/sdd"/>
Nov 17 01:23:27 user nova-compute[75226]:   <target dev="vdb" bus="virtio"/>
Nov 17 01:23:27 user nova-compute[75226]:   <serial>fa7be6d3-d525-4aa3-bcc3-481465f2832b</serial>
Nov 17 01:23:27 user nova-compute[75226]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 17 01:23:27 user nova-compute[75226]: </disk>
Nov 17 01:23:27 user nova-compute[75226]:  {{(pid=75226) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 17 01:23:28 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-2e42d11f-2e77-409f-bdeb-becfdae2d988 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Successfully detached device vdb from instance ddfecefc-1e9b-4e6e-9995-855c8a061084 from the persistent domain config.
Nov 17 01:23:28 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-2e42d11f-2e77-409f-bdeb-becfdae2d988 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ddfecefc-1e9b-4e6e-9995-855c8a061084 from the live domain config. {{(pid=75226) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 17 01:23:28 user nova-compute[75226]: DEBUG nova.virt.libvirt.guest [None req-2e42d11f-2e77-409f-bdeb-becfdae2d988 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] detach device xml: <disk type="block" device="disk">
Nov 17 01:23:28 user nova-compute[75226]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 01:23:28 user nova-compute[75226]:   <source dev="/dev/sdd"/>
Nov 17 01:23:28 user nova-compute[75226]:   <target dev="vdb" bus="virtio"/>
Nov 17 01:23:28 user nova-compute[75226]:   <serial>fa7be6d3-d525-4aa3-bcc3-481465f2832b</serial>
Nov 17 01:23:28 user nova-compute[75226]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 17 01:23:28 user nova-compute[75226]: </disk>
Nov 17 01:23:28 user nova-compute[75226]:  {{(pid=75226) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 17 01:23:28 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:23:28 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:23:28 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:23:28 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:23:28 user nova-compute[75226]: DEBUG nova.compute.manager [req-7a64a6b2-05cb-4bb3-aaae-35d55fb04c74 req-070a11d2-5a57-4158-bb6f-db80d1c2f6c7 service nova] [instance: 777fc3ab-09f0-414b-87f7-c806d2c5865d] Received event network-vif-plugged-72933cfe-e7c5-4e9e-a412-1a8fc994e629 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:23:28 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-7a64a6b2-05cb-4bb3-aaae-35d55fb04c74 req-070a11d2-5a57-4158-bb6f-db80d1c2f6c7 service nova] Acquiring lock "777fc3ab-09f0-414b-87f7-c806d2c5865d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:23:28 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-7a64a6b2-05cb-4bb3-aaae-35d55fb04c74 req-070a11d2-5a57-4158-bb6f-db80d1c2f6c7 service nova] Lock "777fc3ab-09f0-414b-87f7-c806d2c5865d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:23:28 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-7a64a6b2-05cb-4bb3-aaae-35d55fb04c74 req-070a11d2-5a57-4158-bb6f-db80d1c2f6c7 service nova] Lock "777fc3ab-09f0-414b-87f7-c806d2c5865d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:23:28 user nova-compute[75226]: DEBUG nova.compute.manager [req-7a64a6b2-05cb-4bb3-aaae-35d55fb04c74 req-070a11d2-5a57-4158-bb6f-db80d1c2f6c7 service nova] [instance: 777fc3ab-09f0-414b-87f7-c806d2c5865d] No waiting events found dispatching network-vif-plugged-72933cfe-e7c5-4e9e-a412-1a8fc994e629 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:23:28 user nova-compute[75226]: WARNING nova.compute.manager [req-7a64a6b2-05cb-4bb3-aaae-35d55fb04c74 req-070a11d2-5a57-4158-bb6f-db80d1c2f6c7 service nova] [instance: 777fc3ab-09f0-414b-87f7-c806d2c5865d] Received unexpected event network-vif-plugged-72933cfe-e7c5-4e9e-a412-1a8fc994e629 for instance with vm_state building and task_state spawning.
Nov 17 01:23:28 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:23:28 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-2e42d11f-2e77-409f-bdeb-becfdae2d988 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ddfecefc-1e9b-4e6e-9995-855c8a061084 {{(pid=75226) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 17 01:23:28 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:23:30 user nova-compute[75226]: DEBUG nova.compute.manager [req-c1a6c759-449c-4a2c-8c3e-adeaec6f1c6d req-191cf455-0daf-4f06-802a-5dfcdddf5215 service nova] [instance: 777fc3ab-09f0-414b-87f7-c806d2c5865d] Received event network-vif-plugged-72933cfe-e7c5-4e9e-a412-1a8fc994e629 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:23:30 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-c1a6c759-449c-4a2c-8c3e-adeaec6f1c6d req-191cf455-0daf-4f06-802a-5dfcdddf5215 service nova] Acquiring lock "777fc3ab-09f0-414b-87f7-c806d2c5865d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:23:30 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-c1a6c759-449c-4a2c-8c3e-adeaec6f1c6d req-191cf455-0daf-4f06-802a-5dfcdddf5215 service nova] Lock "777fc3ab-09f0-414b-87f7-c806d2c5865d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:23:30 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-c1a6c759-449c-4a2c-8c3e-adeaec6f1c6d req-191cf455-0daf-4f06-802a-5dfcdddf5215 service nova] Lock "777fc3ab-09f0-414b-87f7-c806d2c5865d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:23:30 user nova-compute[75226]: DEBUG nova.compute.manager [req-c1a6c759-449c-4a2c-8c3e-adeaec6f1c6d req-191cf455-0daf-4f06-802a-5dfcdddf5215 service nova] [instance: 777fc3ab-09f0-414b-87f7-c806d2c5865d] No waiting events found dispatching network-vif-plugged-72933cfe-e7c5-4e9e-a412-1a8fc994e629 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:23:30 user nova-compute[75226]: WARNING nova.compute.manager [req-c1a6c759-449c-4a2c-8c3e-adeaec6f1c6d req-191cf455-0daf-4f06-802a-5dfcdddf5215 service nova] [instance: 777fc3ab-09f0-414b-87f7-c806d2c5865d] Received unexpected event network-vif-plugged-72933cfe-e7c5-4e9e-a412-1a8fc994e629 for instance with vm_state building and task_state spawning.
Nov 17 01:23:30 user nova-compute[75226]: DEBUG nova.compute.manager [None req-dc6f9b63-318c-4cb8-8d52-ffd78f4db05f tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: 777fc3ab-09f0-414b-87f7-c806d2c5865d] Instance event wait completed in 0 seconds for  {{(pid=75226) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 17 01:23:30 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-dc6f9b63-318c-4cb8-8d52-ffd78f4db05f tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: 777fc3ab-09f0-414b-87f7-c806d2c5865d] Guest created on hypervisor {{(pid=75226) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 17 01:23:30 user nova-compute[75226]: INFO nova.virt.libvirt.driver [-] [instance: 777fc3ab-09f0-414b-87f7-c806d2c5865d] Instance spawned successfully.
Nov 17 01:23:30 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-dc6f9b63-318c-4cb8-8d52-ffd78f4db05f tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: 777fc3ab-09f0-414b-87f7-c806d2c5865d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 17 01:23:30 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-dc6f9b63-318c-4cb8-8d52-ffd78f4db05f tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: 777fc3ab-09f0-414b-87f7-c806d2c5865d] Found default for hw_cdrom_bus of ide {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:23:30 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-dc6f9b63-318c-4cb8-8d52-ffd78f4db05f tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: 777fc3ab-09f0-414b-87f7-c806d2c5865d] Found default for hw_disk_bus of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:23:30 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-dc6f9b63-318c-4cb8-8d52-ffd78f4db05f tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: 777fc3ab-09f0-414b-87f7-c806d2c5865d] Found default for hw_input_bus of None {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:23:30 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-dc6f9b63-318c-4cb8-8d52-ffd78f4db05f tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: 777fc3ab-09f0-414b-87f7-c806d2c5865d] Found default for hw_pointer_model of None {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:23:30 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-dc6f9b63-318c-4cb8-8d52-ffd78f4db05f tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: 777fc3ab-09f0-414b-87f7-c806d2c5865d] Found default for hw_video_model of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:23:30 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-dc6f9b63-318c-4cb8-8d52-ffd78f4db05f tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: 777fc3ab-09f0-414b-87f7-c806d2c5865d] Found default for hw_vif_model of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:23:30 user nova-compute[75226]: INFO nova.compute.manager [None req-dc6f9b63-318c-4cb8-8d52-ffd78f4db05f tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: 777fc3ab-09f0-414b-87f7-c806d2c5865d] Took 5.80 seconds to spawn the instance on the hypervisor.
Nov 17 01:23:30 user nova-compute[75226]: DEBUG nova.compute.manager [None req-dc6f9b63-318c-4cb8-8d52-ffd78f4db05f tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: 777fc3ab-09f0-414b-87f7-c806d2c5865d] Checking state {{(pid=75226) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 01:23:31 user nova-compute[75226]: INFO nova.compute.manager [None req-dc6f9b63-318c-4cb8-8d52-ffd78f4db05f tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: 777fc3ab-09f0-414b-87f7-c806d2c5865d] Took 6.99 seconds to build instance.
Nov 17 01:23:31 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-dc6f9b63-318c-4cb8-8d52-ffd78f4db05f tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Lock "777fc3ab-09f0-414b-87f7-c806d2c5865d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.119s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:23:32 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:23:32 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:23:37 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:23:37 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:23:38 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:23:39 user nova-compute[75226]: DEBUG nova.compute.manager [req-59e0182e-fbc7-4f3c-bc98-55bc20895300 req-14db8a32-5248-4171-98cc-c9fe86c974e2 service nova] [instance: 38062487-67ca-4962-974f-81456aebe97b] Received event network-changed-b4bb80f3-212b-41bf-94a3-442865a852c7 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:23:39 user nova-compute[75226]: DEBUG nova.compute.manager [req-59e0182e-fbc7-4f3c-bc98-55bc20895300 req-14db8a32-5248-4171-98cc-c9fe86c974e2 service nova] [instance: 38062487-67ca-4962-974f-81456aebe97b] Refreshing instance network info cache due to event network-changed-b4bb80f3-212b-41bf-94a3-442865a852c7. {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 01:23:39 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-59e0182e-fbc7-4f3c-bc98-55bc20895300 req-14db8a32-5248-4171-98cc-c9fe86c974e2 service nova] Acquiring lock "refresh_cache-38062487-67ca-4962-974f-81456aebe97b" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:23:39 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-59e0182e-fbc7-4f3c-bc98-55bc20895300 req-14db8a32-5248-4171-98cc-c9fe86c974e2 service nova] Acquired lock "refresh_cache-38062487-67ca-4962-974f-81456aebe97b" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:23:39 user nova-compute[75226]: DEBUG nova.network.neutron [req-59e0182e-fbc7-4f3c-bc98-55bc20895300 req-14db8a32-5248-4171-98cc-c9fe86c974e2 service nova] [instance: 38062487-67ca-4962-974f-81456aebe97b] Refreshing network info cache for port b4bb80f3-212b-41bf-94a3-442865a852c7 {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 01:23:39 user nova-compute[75226]: DEBUG nova.network.neutron [req-59e0182e-fbc7-4f3c-bc98-55bc20895300 req-14db8a32-5248-4171-98cc-c9fe86c974e2 service nova] [instance: 38062487-67ca-4962-974f-81456aebe97b] Updated VIF entry in instance network info cache for port b4bb80f3-212b-41bf-94a3-442865a852c7. {{(pid=75226) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 01:23:39 user nova-compute[75226]: DEBUG nova.network.neutron [req-59e0182e-fbc7-4f3c-bc98-55bc20895300 req-14db8a32-5248-4171-98cc-c9fe86c974e2 service nova] [instance: 38062487-67ca-4962-974f-81456aebe97b] Updating instance_info_cache with network_info: [{"id": "b4bb80f3-212b-41bf-94a3-442865a852c7", "address": "fa:16:3e:ef:fd:97", "network": {"id": "9f39d3e5-b106-4bd9-b8ba-0f326e89c481", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-675861281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9042fe4ecc245dd97553f6e942c3e05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4bb80f3-21", "ovs_interfaceid": "b4bb80f3-212b-41bf-94a3-442865a852c7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:23:39 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-59e0182e-fbc7-4f3c-bc98-55bc20895300 req-14db8a32-5248-4171-98cc-c9fe86c974e2 service nova] Releasing lock "refresh_cache-38062487-67ca-4962-974f-81456aebe97b" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:23:40 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:23:42 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:23:42 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:23:44 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:23:45 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:23:45 user nova-compute[75226]: INFO nova.compute.manager [None req-81a90601-8b3e-4ffd-bec8-9a7e77889ec5 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 6b7e9611-be35-4e51-b886-91a2fac0a653] Unrescuing
Nov 17 01:23:45 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-81a90601-8b3e-4ffd-bec8-9a7e77889ec5 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Acquiring lock "refresh_cache-6b7e9611-be35-4e51-b886-91a2fac0a653" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:23:45 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-81a90601-8b3e-4ffd-bec8-9a7e77889ec5 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Acquired lock "refresh_cache-6b7e9611-be35-4e51-b886-91a2fac0a653" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:23:45 user nova-compute[75226]: DEBUG nova.network.neutron [None req-81a90601-8b3e-4ffd-bec8-9a7e77889ec5 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 6b7e9611-be35-4e51-b886-91a2fac0a653] Building network info cache for instance {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 01:23:46 user nova-compute[75226]: DEBUG nova.network.neutron [None req-81a90601-8b3e-4ffd-bec8-9a7e77889ec5 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 6b7e9611-be35-4e51-b886-91a2fac0a653] Updating instance_info_cache with network_info: [{"id": "657af53c-fc3a-45ab-81e5-b2eeea1c88d7", "address": "fa:16:3e:91:de:17", "network": {"id": "450540a3-ff7e-42fb-a0a6-808acd749943", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1503678778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6cb6f679ee4468d82cc7fb5d0f67be9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap657af53c-fc", "ovs_interfaceid": "657af53c-fc3a-45ab-81e5-b2eeea1c88d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:23:46 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-81a90601-8b3e-4ffd-bec8-9a7e77889ec5 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Releasing lock "refresh_cache-6b7e9611-be35-4e51-b886-91a2fac0a653" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:23:46 user nova-compute[75226]: DEBUG nova.objects.instance [None req-81a90601-8b3e-4ffd-bec8-9a7e77889ec5 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Lazy-loading 'flavor' on Instance uuid 6b7e9611-be35-4e51-b886-91a2fac0a653 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:23:46 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:23:46 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:23:46 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:23:46 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:23:46 user nova-compute[75226]: INFO nova.virt.libvirt.driver [-] [instance: 6b7e9611-be35-4e51-b886-91a2fac0a653] Instance destroyed successfully.
Nov 17 01:23:47 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:23:47 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:23:48 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:23:48 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:23:48 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:23:48 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:23:48 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:23:48 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-2e42d11f-2e77-409f-bdeb-becfdae2d988 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance ddfecefc-1e9b-4e6e-9995-855c8a061084 is timed out.
Nov 17 01:23:48 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-2e42d11f-2e77-409f-bdeb-becfdae2d988 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Successfully detached device vdb from instance ddfecefc-1e9b-4e6e-9995-855c8a061084 from the live domain config.
Nov 17 01:23:48 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e42d11f-2e77-409f-bdeb-becfdae2d988 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] [instance: ddfecefc-1e9b-4e6e-9995-855c8a061084] calling os-brick to detach iSCSI Volume {{(pid=75226) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 17 01:23:48 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e42d11f-2e77-409f-bdeb-becfdae2d988 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc4cc36b490>, {'target_iqn': 'iqn.2010-10.org.openstack:fa7be6d3-d525-4aa3-bcc3-481465f2832b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nBQYPyRW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:23:48 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-2e42d11f-2e77-409f-bdeb-becfdae2d988 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:23:48 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-2e42d11f-2e77-409f-bdeb-becfdae2d988 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:23:48 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-2e42d11f-2e77-409f-bdeb-becfdae2d988 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:23:48 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:23:48 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:23:48 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[53783dd9-e64b-4b96-bb6c-129113055dca]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fa7be6d3-d525-4aa3-bcc3-481465f2832b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:928c93b5-ae63-4e04-94ce-6059e7eaa7d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1fd0b73a-0d42-4e3d-a4f0-a9936d9bd1d4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1b95a10d-6f61-48de-b7e5-de732f65f408\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:607b7fb8-097d-43ea-b13c-0825e015e14e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:23:48 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e42d11f-2e77-409f-bdeb-becfdae2d988 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 17 01:23:48 user nova-compute[75226]: No targets found.
Nov 17 01:23:48 user nova-compute[75226]: iSNS:
Nov 17 01:23:48 user nova-compute[75226]: No targets found.
Nov 17 01:23:48 user nova-compute[75226]: STATIC:
Nov 17 01:23:48 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:fa7be6d3-d525-4aa3-bcc3-481465f2832b
Nov 17 01:23:48 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:23:48 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:23:48 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:928c93b5-ae63-4e04-94ce-6059e7eaa7d6
Nov 17 01:23:48 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:23:48 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:23:48 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:1fd0b73a-0d42-4e3d-a4f0-a9936d9bd1d4
Nov 17 01:23:48 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:23:48 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:23:48 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8
Nov 17 01:23:48 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:23:48 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:23:48 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421
Nov 17 01:23:48 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:23:48 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:23:48 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:1b95a10d-6f61-48de-b7e5-de732f65f408
Nov 17 01:23:48 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:23:48 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:23:48 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:607b7fb8-097d-43ea-b13c-0825e015e14e
Nov 17 01:23:48 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:23:48 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:23:48 user nova-compute[75226]: FIRMWARE:
Nov 17 01:23:48 user nova-compute[75226]: No targets found.
Nov 17 01:23:48 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:23:48 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e42d11f-2e77-409f-bdeb-becfdae2d988 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 17 01:23:48 user nova-compute[75226]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 17 01:23:48 user nova-compute[75226]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75226) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 17 01:23:48 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e42d11f-2e77-409f-bdeb-becfdae2d988 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fa7be6d3-d525-4aa3-bcc3-481465f2832b', 0)] {{(pid=75226) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 17 01:23:48 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:23:48 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:23:48 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[49c8ec2d-cbc5-4ed9-a3b9-25d5bf8ee99b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1b95a10d-6f61-48de-b7e5-de732f65f408\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1fd0b73a-0d42-4e3d-a4f0-a9936d9bd1d4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:607b7fb8-097d-43ea-b13c-0825e015e14e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:928c93b5-ae63-4e04-94ce-6059e7eaa7d6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa7be6d3-d525-4aa3-bcc3-481465f2832b\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:23:48 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:23:48 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:23:48 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dcbed19-8f8f-400e-80ba-7e4da2cb291c]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa7be6d3-d525-4aa3-bcc3-481465f2832b (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:928c93b5-ae63-4e04-94ce-6059e7eaa7d6 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:607b7fb8-097d-43ea-b13c-0825e015e14e (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b95a10d-6f61-48de-b7e5-de732f65f408 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fd0b73a-0d42-4e3d-a4f0-a9936d9bd1d4 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:23:48 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e42d11f-2e77-409f-bdeb-becfdae2d988 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)
Nov 17 01:23:48 user nova-compute[75226]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa7be6d3-d525-4aa3-bcc3-481465f2832b (non-flash)
Nov 17 01:23:48 user nova-compute[75226]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:928c93b5-ae63-4e04-94ce-6059e7eaa7d6 (non-flash)
Nov 17 01:23:48 user nova-compute[75226]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:607b7fb8-097d-43ea-b13c-0825e015e14e (non-flash)
Nov 17 01:23:48 user nova-compute[75226]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b95a10d-6f61-48de-b7e5-de732f65f408 (non-flash)
Nov 17 01:23:48 user nova-compute[75226]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421 (non-flash)
Nov 17 01:23:48 user nova-compute[75226]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fd0b73a-0d42-4e3d-a4f0-a9936d9bd1d4 (non-flash)
Nov 17 01:23:48 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:23:48 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e42d11f-2e77-409f-bdeb-becfdae2d988 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)
Nov 17 01:23:48 user nova-compute[75226]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa7be6d3-d525-4aa3-bcc3-481465f2832b (non-flash)
Nov 17 01:23:48 user nova-compute[75226]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:928c93b5-ae63-4e04-94ce-6059e7eaa7d6 (non-flash)
Nov 17 01:23:48 user nova-compute[75226]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:607b7fb8-097d-43ea-b13c-0825e015e14e (non-flash)
Nov 17 01:23:48 user nova-compute[75226]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b95a10d-6f61-48de-b7e5-de732f65f408 (non-flash)
Nov 17 01:23:48 user nova-compute[75226]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421 (non-flash)
Nov 17 01:23:48 user nova-compute[75226]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fd0b73a-0d42-4e3d-a4f0-a9936d9bd1d4 (non-flash)
Nov 17 01:23:48 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:23:48 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e42d11f-2e77-409f-bdeb-becfdae2d988 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc4b43ee440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fa7be6d3-d525-4aa3-bcc3-481465f2832b'): ({'sdd'}, set())}) {{(pid=75226) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 17 01:23:48 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-2e42d11f-2e77-409f-bdeb-becfdae2d988 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Removing single pathed devices sdd {{(pid=75226) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 17 01:23:48 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:23:48 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:23:48 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[57b08dec-ec1b-487f-bf5e-3b05610056f2]: (4, ('path checker states:\nup                  6\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:23:48 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:23:48 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:23:48 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d1e93b8-e5b8-4951-82bf-ab916f790853]: (4, ('ok\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:23:48 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-2e42d11f-2e77-409f-bdeb-becfdae2d988 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Flushing IO for device /dev/sdd {{(pid=75226) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 17 01:23:48 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:23:48 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:23:48 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[65f5fa7d-d668-4e09-8b99-ecdf10ee6682]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:23:48 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-2e42d11f-2e77-409f-bdeb-becfdae2d988 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75226) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 17 01:23:48 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:23:48 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.048s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:23:48 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[58d4ed87-b987-4f67-a4b8-7f7e66b6df18]: (4, ('1', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:23:48 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-2e42d11f-2e77-409f-bdeb-becfdae2d988 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75226) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 17 01:23:48 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-2e42d11f-2e77-409f-bdeb-becfdae2d988 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] SCSI volumes sdd have been removed. {{(pid=75226) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 17 01:23:48 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e42d11f-2e77-409f-bdeb-becfdae2d988 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fa7be6d3-d525-4aa3-bcc3-481465f2832b')] {{(pid=75226) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 17 01:23:48 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa7be6d3-d525-4aa3-bcc3-481465f2832b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:23:48 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa7be6d3-d525-4aa3-bcc3-481465f2832b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:23:48 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eb420f5-1fb6-40dc-9225-e3373d6488ed]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:23:48 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e42d11f-2e77-409f-bdeb-becfdae2d988 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:23:48 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa7be6d3-d525-4aa3-bcc3-481465f2832b -p 172.16.0.220:3260 --logout {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:23:49 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa7be6d3-d525-4aa3-bcc3-481465f2832b -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:23:49 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[29a39bf1-5b0c-4200-94bf-46502b362aeb]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:fa7be6d3-d525-4aa3-bcc3-481465f2832b, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:fa7be6d3-d525-4aa3-bcc3-481465f2832b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:23:49 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e42d11f-2e77-409f-bdeb-becfdae2d988 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:fa7be6d3-d525-4aa3-bcc3-481465f2832b, portal: 172.16.0.220,3260]
Nov 17 01:23:49 user nova-compute[75226]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:fa7be6d3-d525-4aa3-bcc3-481465f2832b, portal: 172.16.0.220,3260] successful.
Nov 17 01:23:49 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:23:49 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa7be6d3-d525-4aa3-bcc3-481465f2832b -p 172.16.0.220:3260 --op delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:23:49 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa7be6d3-d525-4aa3-bcc3-481465f2832b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:23:49 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb1cdbcb-6f5a-4dd4-9f48-7c7e41a7fa15]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:23:49 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e42d11f-2e77-409f-bdeb-becfdae2d988 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:23:49 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-2e42d11f-2e77-409f-bdeb-becfdae2d988 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.349s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:23:49 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e42d11f-2e77-409f-bdeb-becfdae2d988 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] <== disconnect_volume: return (351ms) None {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:23:49 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e42d11f-2e77-409f-bdeb-becfdae2d988 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] [instance: ddfecefc-1e9b-4e6e-9995-855c8a061084] Disconnected iSCSI Volume {{(pid=75226) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 17 01:23:49 user nova-compute[75226]: DEBUG nova.objects.instance [None req-2e42d11f-2e77-409f-bdeb-becfdae2d988 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Lazy-loading 'flavor' on Instance uuid ddfecefc-1e9b-4e6e-9995-855c8a061084 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:23:49 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-2e42d11f-2e77-409f-bdeb-becfdae2d988 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Lock "ddfecefc-1e9b-4e6e-9995-855c8a061084" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.024s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:23:50 user nova-compute[75226]: DEBUG nova.compute.manager [None req-81a90601-8b3e-4ffd-bec8-9a7e77889ec5 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 6b7e9611-be35-4e51-b886-91a2fac0a653] Checking state {{(pid=75226) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 01:23:52 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:23:52 user nova-compute[75226]: DEBUG nova.compute.manager [req-216f359f-6411-4988-848f-02c4b36fc1c4 req-9238903b-d84f-48aa-94d1-53ad288cef47 service nova] [instance: 6b7e9611-be35-4e51-b886-91a2fac0a653] Received event network-vif-unplugged-657af53c-fc3a-45ab-81e5-b2eeea1c88d7 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:23:52 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-216f359f-6411-4988-848f-02c4b36fc1c4 req-9238903b-d84f-48aa-94d1-53ad288cef47 service nova] Acquiring lock "6b7e9611-be35-4e51-b886-91a2fac0a653-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:23:52 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-216f359f-6411-4988-848f-02c4b36fc1c4 req-9238903b-d84f-48aa-94d1-53ad288cef47 service nova] Lock "6b7e9611-be35-4e51-b886-91a2fac0a653-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:23:52 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-216f359f-6411-4988-848f-02c4b36fc1c4 req-9238903b-d84f-48aa-94d1-53ad288cef47 service nova] Lock "6b7e9611-be35-4e51-b886-91a2fac0a653-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:23:52 user nova-compute[75226]: DEBUG nova.compute.manager [req-216f359f-6411-4988-848f-02c4b36fc1c4 req-9238903b-d84f-48aa-94d1-53ad288cef47 service nova] [instance: 6b7e9611-be35-4e51-b886-91a2fac0a653] No waiting events found dispatching network-vif-unplugged-657af53c-fc3a-45ab-81e5-b2eeea1c88d7 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:23:52 user nova-compute[75226]: WARNING nova.compute.manager [req-216f359f-6411-4988-848f-02c4b36fc1c4 req-9238903b-d84f-48aa-94d1-53ad288cef47 service nova] [instance: 6b7e9611-be35-4e51-b886-91a2fac0a653] Received unexpected event network-vif-unplugged-657af53c-fc3a-45ab-81e5-b2eeea1c88d7 for instance with vm_state active and task_state None.
Nov 17 01:23:52 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:23:52 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-34d8fd61-cb69-42b4-a4b5-363282aae2e4 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Acquiring lock "346967c5-6945-4cef-9eea-8415cb27c98f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:23:52 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-34d8fd61-cb69-42b4-a4b5-363282aae2e4 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Lock "346967c5-6945-4cef-9eea-8415cb27c98f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:23:52 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Triggering sync for uuid aa84e575-bdad-45b9-80ce-86b1c2826fb0 {{(pid=75226) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 17 01:23:52 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Triggering sync for uuid ddfecefc-1e9b-4e6e-9995-855c8a061084 {{(pid=75226) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 17 01:23:52 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Triggering sync for uuid 6b7e9611-be35-4e51-b886-91a2fac0a653 {{(pid=75226) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 17 01:23:52 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Triggering sync for uuid 52fe0a91-9320-47d2-ac83-4f49260a0997 {{(pid=75226) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 17 01:23:52 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Triggering sync for uuid f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c {{(pid=75226) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 17 01:23:52 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Triggering sync for uuid 2fbdd8af-f608-4d73-92d9-ae0586814c1b {{(pid=75226) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 17 01:23:52 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Triggering sync for uuid 38062487-67ca-4962-974f-81456aebe97b {{(pid=75226) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 17 01:23:52 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Triggering sync for uuid 306054a8-4d0f-4913-b3b8-97aeeeec071c {{(pid=75226) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 17 01:23:52 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Triggering sync for uuid 663933b0-95dc-4fba-b411-029f0552571d {{(pid=75226) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 17 01:23:52 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Triggering sync for uuid 777fc3ab-09f0-414b-87f7-c806d2c5865d {{(pid=75226) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 17 01:23:52 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "aa84e575-bdad-45b9-80ce-86b1c2826fb0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:23:52 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "aa84e575-bdad-45b9-80ce-86b1c2826fb0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:23:52 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "ddfecefc-1e9b-4e6e-9995-855c8a061084" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:23:52 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "ddfecefc-1e9b-4e6e-9995-855c8a061084" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:23:52 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "6b7e9611-be35-4e51-b886-91a2fac0a653" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:23:52 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "6b7e9611-be35-4e51-b886-91a2fac0a653" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:23:52 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "52fe0a91-9320-47d2-ac83-4f49260a0997" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:23:52 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "52fe0a91-9320-47d2-ac83-4f49260a0997" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:23:52 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:23:52 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:23:52 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "2fbdd8af-f608-4d73-92d9-ae0586814c1b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:23:52 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "2fbdd8af-f608-4d73-92d9-ae0586814c1b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:23:52 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "38062487-67ca-4962-974f-81456aebe97b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:23:52 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "38062487-67ca-4962-974f-81456aebe97b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:23:52 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "306054a8-4d0f-4913-b3b8-97aeeeec071c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:23:52 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "306054a8-4d0f-4913-b3b8-97aeeeec071c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:23:52 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "663933b0-95dc-4fba-b411-029f0552571d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:23:52 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "663933b0-95dc-4fba-b411-029f0552571d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:23:52 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "777fc3ab-09f0-414b-87f7-c806d2c5865d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:23:52 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "777fc3ab-09f0-414b-87f7-c806d2c5865d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:23:52 user nova-compute[75226]: DEBUG nova.compute.manager [None req-34d8fd61-cb69-42b4-a4b5-363282aae2e4 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] [instance: 346967c5-6945-4cef-9eea-8415cb27c98f] Starting instance... {{(pid=75226) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 17 01:23:52 user nova-compute[75226]: WARNING oslo_messaging._drivers.amqpdriver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Number of call queues is 11, greater than warning threshold: 10. There could be a leak. Increasing threshold to: 20
Nov 17 01:23:52 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "ddfecefc-1e9b-4e6e-9995-855c8a061084" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.087s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:23:52 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.090s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:23:52 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "6b7e9611-be35-4e51-b886-91a2fac0a653" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.099s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:23:52 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "306054a8-4d0f-4913-b3b8-97aeeeec071c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.105s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:23:52 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "2fbdd8af-f608-4d73-92d9-ae0586814c1b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.133s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:23:52 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "663933b0-95dc-4fba-b411-029f0552571d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.150s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:23:52 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "aa84e575-bdad-45b9-80ce-86b1c2826fb0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.157s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:23:52 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "52fe0a91-9320-47d2-ac83-4f49260a0997" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.162s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:23:52 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-34d8fd61-cb69-42b4-a4b5-363282aae2e4 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:23:52 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-34d8fd61-cb69-42b4-a4b5-363282aae2e4 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:23:52 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-34d8fd61-cb69-42b4-a4b5-363282aae2e4 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75226) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 17 01:23:52 user nova-compute[75226]: INFO nova.compute.claims [None req-34d8fd61-cb69-42b4-a4b5-363282aae2e4 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] [instance: 346967c5-6945-4cef-9eea-8415cb27c98f] Claim successful on node user
Nov 17 01:23:52 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "38062487-67ca-4962-974f-81456aebe97b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.182s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:23:52 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "777fc3ab-09f0-414b-87f7-c806d2c5865d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.185s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:23:52 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:23:52 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-8faf9d74-9c6c-4cdb-b4c7-7c1b6f6c3f32 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] Acquiring lock "52fe0a91-9320-47d2-ac83-4f49260a0997" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:23:52 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-8faf9d74-9c6c-4cdb-b4c7-7c1b6f6c3f32 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] Lock "52fe0a91-9320-47d2-ac83-4f49260a0997" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:23:52 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-8faf9d74-9c6c-4cdb-b4c7-7c1b6f6c3f32 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] Acquiring lock "52fe0a91-9320-47d2-ac83-4f49260a0997-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:23:52 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-8faf9d74-9c6c-4cdb-b4c7-7c1b6f6c3f32 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] Lock "52fe0a91-9320-47d2-ac83-4f49260a0997-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:23:52 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-8faf9d74-9c6c-4cdb-b4c7-7c1b6f6c3f32 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] Lock "52fe0a91-9320-47d2-ac83-4f49260a0997-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:23:52 user nova-compute[75226]: INFO nova.compute.manager [None req-8faf9d74-9c6c-4cdb-b4c7-7c1b6f6c3f32 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] [instance: 52fe0a91-9320-47d2-ac83-4f49260a0997] Terminating instance
Nov 17 01:23:52 user nova-compute[75226]: DEBUG nova.compute.manager [None req-8faf9d74-9c6c-4cdb-b4c7-7c1b6f6c3f32 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] [instance: 52fe0a91-9320-47d2-ac83-4f49260a0997] Start destroying the instance on the hypervisor. {{(pid=75226) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 17 01:23:52 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:23:52 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:23:52 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:23:53 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-34d8fd61-cb69-42b4-a4b5-363282aae2e4 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:23:53 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-34d8fd61-cb69-42b4-a4b5-363282aae2e4 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:23:53 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-34d8fd61-cb69-42b4-a4b5-363282aae2e4 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.500s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:23:53 user nova-compute[75226]: DEBUG nova.compute.manager [None req-34d8fd61-cb69-42b4-a4b5-363282aae2e4 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] [instance: 346967c5-6945-4cef-9eea-8415cb27c98f] Start building networks asynchronously for instance. {{(pid=75226) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 17 01:23:53 user nova-compute[75226]: DEBUG nova.compute.manager [None req-34d8fd61-cb69-42b4-a4b5-363282aae2e4 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] [instance: 346967c5-6945-4cef-9eea-8415cb27c98f] Allocating IP information in the background. {{(pid=75226) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 17 01:23:53 user nova-compute[75226]: DEBUG nova.network.neutron [None req-34d8fd61-cb69-42b4-a4b5-363282aae2e4 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] [instance: 346967c5-6945-4cef-9eea-8415cb27c98f] allocate_for_instance() {{(pid=75226) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 17 01:23:53 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-34d8fd61-cb69-42b4-a4b5-363282aae2e4 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] [instance: 346967c5-6945-4cef-9eea-8415cb27c98f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 17 01:23:53 user nova-compute[75226]: DEBUG nova.compute.manager [req-8e0b1e94-53a2-438e-a2eb-8a6f911c55bc req-2cc1e738-a75b-44fa-b8ec-131c6678bc81 service nova] [instance: 52fe0a91-9320-47d2-ac83-4f49260a0997] Received event network-vif-unplugged-40569c42-220e-4c21-8b6c-b12dc4e111c5 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:23:53 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-8e0b1e94-53a2-438e-a2eb-8a6f911c55bc req-2cc1e738-a75b-44fa-b8ec-131c6678bc81 service nova] Acquiring lock "52fe0a91-9320-47d2-ac83-4f49260a0997-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:23:53 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-8e0b1e94-53a2-438e-a2eb-8a6f911c55bc req-2cc1e738-a75b-44fa-b8ec-131c6678bc81 service nova] Lock "52fe0a91-9320-47d2-ac83-4f49260a0997-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:23:53 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-8e0b1e94-53a2-438e-a2eb-8a6f911c55bc req-2cc1e738-a75b-44fa-b8ec-131c6678bc81 service nova] Lock "52fe0a91-9320-47d2-ac83-4f49260a0997-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:23:53 user nova-compute[75226]: DEBUG nova.compute.manager [req-8e0b1e94-53a2-438e-a2eb-8a6f911c55bc req-2cc1e738-a75b-44fa-b8ec-131c6678bc81 service nova] [instance: 52fe0a91-9320-47d2-ac83-4f49260a0997] No waiting events found dispatching network-vif-unplugged-40569c42-220e-4c21-8b6c-b12dc4e111c5 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:23:53 user nova-compute[75226]: DEBUG nova.compute.manager [req-8e0b1e94-53a2-438e-a2eb-8a6f911c55bc req-2cc1e738-a75b-44fa-b8ec-131c6678bc81 service nova] [instance: 52fe0a91-9320-47d2-ac83-4f49260a0997] Received event network-vif-unplugged-40569c42-220e-4c21-8b6c-b12dc4e111c5 for instance with task_state deleting. {{(pid=75226) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 17 01:23:53 user nova-compute[75226]: DEBUG nova.compute.manager [None req-34d8fd61-cb69-42b4-a4b5-363282aae2e4 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] [instance: 346967c5-6945-4cef-9eea-8415cb27c98f] Start building block device mappings for instance. {{(pid=75226) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 17 01:23:53 user nova-compute[75226]: DEBUG nova.policy [None req-34d8fd61-cb69-42b4-a4b5-363282aae2e4 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ed6cfbd0e0124dd2a4092f0b087f416c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adaa172aeff64609a273bdc271806238', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75226) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 17 01:23:53 user nova-compute[75226]: INFO nova.virt.block_device [None req-34d8fd61-cb69-42b4-a4b5-363282aae2e4 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] [instance: 346967c5-6945-4cef-9eea-8415cb27c98f] Booting with volume c17ed19c-4452-4a79-b36a-07ddcd7d9404 at /dev/vda
Nov 17 01:23:53 user nova-compute[75226]: DEBUG os_brick.utils [None req-34d8fd61-cb69-42b4-a4b5-363282aae2e4 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:23:53 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:23:53 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:23:53 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[aefecb1e-6f4e-443e-8c07-cd2791a58539]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f62857db69\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:23:53 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:23:53 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:23:53 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[932c754e-1fa2-49d6-abc1-a194032156e0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:23:53 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:23:53 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:23:53 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e16c5ea-0b29-4f19-8730-62c1341638e0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:23:53 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[995f3924-a049-47a3-90fe-8682ad49f608]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:23:53 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-34d8fd61-cb69-42b4-a4b5-363282aae2e4 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Running cmd (subprocess): nvme version {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:23:53 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-34d8fd61-cb69-42b4-a4b5-363282aae2e4 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] 'nvme version' failed. Not Retrying. {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 01:23:53 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.nvmeof [None req-34d8fd61-cb69-42b4-a4b5-363282aae2e4 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] nvme not present on system {{(pid=75226) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 17 01:23:53 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:23:53 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 01:23:53 user nova-compute[75226]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 17 01:23:53 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[2564a604-71ef-47e7-be1d-b27e7b7765f2]: (4, '') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:23:53 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-34d8fd61-cb69-42b4-a4b5-363282aae2e4 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75226) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 17 01:23:53 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-34d8fd61-cb69-42b4-a4b5-363282aae2e4 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75226) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 17 01:23:53 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-34d8fd61-cb69-42b4-a4b5-363282aae2e4 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] LIGHTOS: no hostnqn found. {{(pid=75226) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 17 01:23:53 user nova-compute[75226]: DEBUG os_brick.utils [None req-34d8fd61-cb69-42b4-a4b5-363282aae2e4 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f62857db69', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:23:53 user nova-compute[75226]: DEBUG nova.virt.block_device [None req-34d8fd61-cb69-42b4-a4b5-363282aae2e4 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] [instance: 346967c5-6945-4cef-9eea-8415cb27c98f] Updating existing volume attachment record: 8e0000a6-8e3d-4d59-9f3a-8b19845ac7c0 {{(pid=75226) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 17 01:23:53 user nova-compute[75226]: INFO nova.virt.libvirt.driver [-] [instance: 52fe0a91-9320-47d2-ac83-4f49260a0997] Instance destroyed successfully.
Nov 17 01:23:53 user nova-compute[75226]: DEBUG nova.objects.instance [None req-8faf9d74-9c6c-4cdb-b4c7-7c1b6f6c3f32 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] Lazy-loading 'resources' on Instance uuid 52fe0a91-9320-47d2-ac83-4f49260a0997 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:23:53 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-8faf9d74-9c6c-4cdb-b4c7-7c1b6f6c3f32 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:20:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-2021125272',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-2021125272',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-2021125',id=13,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOByX3h5BvkplC/tYK6tBAVVzVst/GaAXZZ4Xkr5lIxcg22rMq+aNROVe5qtJBezb0nVCZUZonuThPHXSxX5EMjO5MecIyQyfnb6TE854o5anrYnCWMDNbGQ4jnQE8yp+A==',key_name='tempest-keypair-2013635682',keypairs=<?>,launch_index=0,launched_at=2023-11-17T01:20:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='339f5602853149bcad2f8416ee82a0c2',ramdisk_id='',reservation_id='r-9v9df3pe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1271757401',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T01:20:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='991e21017fde48ccbf2aab961434f0bc',uuid=52fe0a91-9320-47d2-ac83-4f49260a0997,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "40569c42-220e-4c21-8b6c-b12dc4e111c5", "address": "fa:16:3e:ee:92:2e", "network": {"id": "413a22ba-ac08-4a82-ad4a-7be66b8b38d0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-885127095-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "339f5602853149bcad2f8416ee82a0c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40569c42-22", "ovs_interfaceid": "40569c42-220e-4c21-8b6c-b12dc4e111c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 17 01:23:53 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-8faf9d74-9c6c-4cdb-b4c7-7c1b6f6c3f32 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] Converting VIF {"id": "40569c42-220e-4c21-8b6c-b12dc4e111c5", "address": "fa:16:3e:ee:92:2e", "network": {"id": "413a22ba-ac08-4a82-ad4a-7be66b8b38d0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-885127095-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "339f5602853149bcad2f8416ee82a0c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40569c42-22", "ovs_interfaceid": "40569c42-220e-4c21-8b6c-b12dc4e111c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:23:53 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-8faf9d74-9c6c-4cdb-b4c7-7c1b6f6c3f32 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ee:92:2e,bridge_name='br-int',has_traffic_filtering=True,id=40569c42-220e-4c21-8b6c-b12dc4e111c5,network=Network(413a22ba-ac08-4a82-ad4a-7be66b8b38d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40569c42-22') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:23:53 user nova-compute[75226]: DEBUG os_vif [None req-8faf9d74-9c6c-4cdb-b4c7-7c1b6f6c3f32 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ee:92:2e,bridge_name='br-int',has_traffic_filtering=True,id=40569c42-220e-4c21-8b6c-b12dc4e111c5,network=Network(413a22ba-ac08-4a82-ad4a-7be66b8b38d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40569c42-22') {{(pid=75226) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 17 01:23:53 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:23:53 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap40569c42-22, bridge=br-int, if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:23:53 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:23:53 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:23:53 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:23:53 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:23:53 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f60f33f5-d4de-4c7f-b8a7-1b2613669b04) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:23:53 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:23:53 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:23:53 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:23:53 user nova-compute[75226]: INFO os_vif [None req-8faf9d74-9c6c-4cdb-b4c7-7c1b6f6c3f32 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ee:92:2e,bridge_name='br-int',has_traffic_filtering=True,id=40569c42-220e-4c21-8b6c-b12dc4e111c5,network=Network(413a22ba-ac08-4a82-ad4a-7be66b8b38d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40569c42-22')
Nov 17 01:23:53 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-8faf9d74-9c6c-4cdb-b4c7-7c1b6f6c3f32 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] [instance: 52fe0a91-9320-47d2-ac83-4f49260a0997] Deleting instance files /opt/stack/data/nova/instances/52fe0a91-9320-47d2-ac83-4f49260a0997_del
Nov 17 01:23:53 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-8faf9d74-9c6c-4cdb-b4c7-7c1b6f6c3f32 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] [instance: 52fe0a91-9320-47d2-ac83-4f49260a0997] Deletion of /opt/stack/data/nova/instances/52fe0a91-9320-47d2-ac83-4f49260a0997_del complete
Nov 17 01:23:53 user nova-compute[75226]: INFO nova.compute.manager [None req-8faf9d74-9c6c-4cdb-b4c7-7c1b6f6c3f32 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] [instance: 52fe0a91-9320-47d2-ac83-4f49260a0997] Took 0.98 seconds to destroy the instance on the hypervisor.
Nov 17 01:23:53 user nova-compute[75226]: DEBUG oslo.service.loopingcall [None req-8faf9d74-9c6c-4cdb-b4c7-7c1b6f6c3f32 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75226) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 17 01:23:53 user nova-compute[75226]: DEBUG nova.compute.manager [-] [instance: 52fe0a91-9320-47d2-ac83-4f49260a0997] Deallocating network for instance {{(pid=75226) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 17 01:23:53 user nova-compute[75226]: DEBUG nova.network.neutron [-] [instance: 52fe0a91-9320-47d2-ac83-4f49260a0997] deallocate_for_instance() {{(pid=75226) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 17 01:23:54 user nova-compute[75226]: DEBUG nova.compute.manager [req-0a2a94bf-02cd-4cfd-84ca-ab28c55c9053 req-42c3d2c5-d875-4faa-ad9b-97ed0542c614 service nova] [instance: 6b7e9611-be35-4e51-b886-91a2fac0a653] Received event network-vif-plugged-657af53c-fc3a-45ab-81e5-b2eeea1c88d7 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:23:54 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-0a2a94bf-02cd-4cfd-84ca-ab28c55c9053 req-42c3d2c5-d875-4faa-ad9b-97ed0542c614 service nova] Acquiring lock "6b7e9611-be35-4e51-b886-91a2fac0a653-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:23:54 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-0a2a94bf-02cd-4cfd-84ca-ab28c55c9053 req-42c3d2c5-d875-4faa-ad9b-97ed0542c614 service nova] Lock "6b7e9611-be35-4e51-b886-91a2fac0a653-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:23:54 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-0a2a94bf-02cd-4cfd-84ca-ab28c55c9053 req-42c3d2c5-d875-4faa-ad9b-97ed0542c614 service nova] Lock "6b7e9611-be35-4e51-b886-91a2fac0a653-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:23:54 user nova-compute[75226]: DEBUG nova.compute.manager [req-0a2a94bf-02cd-4cfd-84ca-ab28c55c9053 req-42c3d2c5-d875-4faa-ad9b-97ed0542c614 service nova] [instance: 6b7e9611-be35-4e51-b886-91a2fac0a653] No waiting events found dispatching network-vif-plugged-657af53c-fc3a-45ab-81e5-b2eeea1c88d7 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:23:54 user nova-compute[75226]: WARNING nova.compute.manager [req-0a2a94bf-02cd-4cfd-84ca-ab28c55c9053 req-42c3d2c5-d875-4faa-ad9b-97ed0542c614 service nova] [instance: 6b7e9611-be35-4e51-b886-91a2fac0a653] Received unexpected event network-vif-plugged-657af53c-fc3a-45ab-81e5-b2eeea1c88d7 for instance with vm_state active and task_state None.
Nov 17 01:23:54 user nova-compute[75226]: DEBUG nova.compute.manager [req-0a2a94bf-02cd-4cfd-84ca-ab28c55c9053 req-42c3d2c5-d875-4faa-ad9b-97ed0542c614 service nova] [instance: 6b7e9611-be35-4e51-b886-91a2fac0a653] Received event network-vif-plugged-657af53c-fc3a-45ab-81e5-b2eeea1c88d7 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:23:54 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-0a2a94bf-02cd-4cfd-84ca-ab28c55c9053 req-42c3d2c5-d875-4faa-ad9b-97ed0542c614 service nova] Acquiring lock "6b7e9611-be35-4e51-b886-91a2fac0a653-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:23:54 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-0a2a94bf-02cd-4cfd-84ca-ab28c55c9053 req-42c3d2c5-d875-4faa-ad9b-97ed0542c614 service nova] Lock "6b7e9611-be35-4e51-b886-91a2fac0a653-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:23:54 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-0a2a94bf-02cd-4cfd-84ca-ab28c55c9053 req-42c3d2c5-d875-4faa-ad9b-97ed0542c614 service nova] Lock "6b7e9611-be35-4e51-b886-91a2fac0a653-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:23:54 user nova-compute[75226]: DEBUG nova.compute.manager [req-0a2a94bf-02cd-4cfd-84ca-ab28c55c9053 req-42c3d2c5-d875-4faa-ad9b-97ed0542c614 service nova] [instance: 6b7e9611-be35-4e51-b886-91a2fac0a653] No waiting events found dispatching network-vif-plugged-657af53c-fc3a-45ab-81e5-b2eeea1c88d7 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:23:54 user nova-compute[75226]: WARNING nova.compute.manager [req-0a2a94bf-02cd-4cfd-84ca-ab28c55c9053 req-42c3d2c5-d875-4faa-ad9b-97ed0542c614 service nova] [instance: 6b7e9611-be35-4e51-b886-91a2fac0a653] Received unexpected event network-vif-plugged-657af53c-fc3a-45ab-81e5-b2eeea1c88d7 for instance with vm_state active and task_state None.
Nov 17 01:23:54 user nova-compute[75226]: DEBUG nova.compute.manager [req-0a2a94bf-02cd-4cfd-84ca-ab28c55c9053 req-42c3d2c5-d875-4faa-ad9b-97ed0542c614 service nova] [instance: 6b7e9611-be35-4e51-b886-91a2fac0a653] Received event network-vif-plugged-657af53c-fc3a-45ab-81e5-b2eeea1c88d7 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:23:54 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-0a2a94bf-02cd-4cfd-84ca-ab28c55c9053 req-42c3d2c5-d875-4faa-ad9b-97ed0542c614 service nova] Acquiring lock "6b7e9611-be35-4e51-b886-91a2fac0a653-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:23:54 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-0a2a94bf-02cd-4cfd-84ca-ab28c55c9053 req-42c3d2c5-d875-4faa-ad9b-97ed0542c614 service nova] Lock "6b7e9611-be35-4e51-b886-91a2fac0a653-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:23:54 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-0a2a94bf-02cd-4cfd-84ca-ab28c55c9053 req-42c3d2c5-d875-4faa-ad9b-97ed0542c614 service nova] Lock "6b7e9611-be35-4e51-b886-91a2fac0a653-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:23:54 user nova-compute[75226]: DEBUG nova.compute.manager [req-0a2a94bf-02cd-4cfd-84ca-ab28c55c9053 req-42c3d2c5-d875-4faa-ad9b-97ed0542c614 service nova] [instance: 6b7e9611-be35-4e51-b886-91a2fac0a653] No waiting events found dispatching network-vif-plugged-657af53c-fc3a-45ab-81e5-b2eeea1c88d7 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:23:54 user nova-compute[75226]: WARNING nova.compute.manager [req-0a2a94bf-02cd-4cfd-84ca-ab28c55c9053 req-42c3d2c5-d875-4faa-ad9b-97ed0542c614 service nova] [instance: 6b7e9611-be35-4e51-b886-91a2fac0a653] Received unexpected event network-vif-plugged-657af53c-fc3a-45ab-81e5-b2eeea1c88d7 for instance with vm_state active and task_state None.
Nov 17 01:23:54 user nova-compute[75226]: DEBUG nova.network.neutron [None req-34d8fd61-cb69-42b4-a4b5-363282aae2e4 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] [instance: 346967c5-6945-4cef-9eea-8415cb27c98f] Successfully created port: aa5b3af3-4cac-4a2f-93b8-3b6d378a3486 {{(pid=75226) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 17 01:23:55 user nova-compute[75226]: DEBUG nova.network.neutron [-] [instance: 52fe0a91-9320-47d2-ac83-4f49260a0997] Updating instance_info_cache with network_info: [] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:23:55 user nova-compute[75226]: INFO nova.compute.manager [-] [instance: 52fe0a91-9320-47d2-ac83-4f49260a0997] Took 1.44 seconds to deallocate network for instance.
Nov 17 01:23:55 user nova-compute[75226]: DEBUG nova.compute.manager [req-bae4d45a-2c74-4492-8db3-e30edb5d3edd req-39bb4bb3-2c7b-4d85-a1d8-13d17448ae61 service nova] [instance: 52fe0a91-9320-47d2-ac83-4f49260a0997] Received event network-vif-deleted-40569c42-220e-4c21-8b6c-b12dc4e111c5 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:23:55 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-8faf9d74-9c6c-4cdb-b4c7-7c1b6f6c3f32 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:23:55 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-8faf9d74-9c6c-4cdb-b4c7-7c1b6f6c3f32 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:23:55 user nova-compute[75226]: DEBUG nova.compute.manager [req-4ddefd7c-756a-41f6-ad7f-19d90dcd54aa req-76b62be1-2048-482c-b07e-5d078f0a18db service nova] [instance: 52fe0a91-9320-47d2-ac83-4f49260a0997] Received event network-vif-plugged-40569c42-220e-4c21-8b6c-b12dc4e111c5 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:23:55 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-4ddefd7c-756a-41f6-ad7f-19d90dcd54aa req-76b62be1-2048-482c-b07e-5d078f0a18db service nova] Acquiring lock "52fe0a91-9320-47d2-ac83-4f49260a0997-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:23:55 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-4ddefd7c-756a-41f6-ad7f-19d90dcd54aa req-76b62be1-2048-482c-b07e-5d078f0a18db service nova] Lock "52fe0a91-9320-47d2-ac83-4f49260a0997-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:23:55 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-4ddefd7c-756a-41f6-ad7f-19d90dcd54aa req-76b62be1-2048-482c-b07e-5d078f0a18db service nova] Lock "52fe0a91-9320-47d2-ac83-4f49260a0997-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:23:55 user nova-compute[75226]: DEBUG nova.compute.manager [req-4ddefd7c-756a-41f6-ad7f-19d90dcd54aa req-76b62be1-2048-482c-b07e-5d078f0a18db service nova] [instance: 52fe0a91-9320-47d2-ac83-4f49260a0997] No waiting events found dispatching network-vif-plugged-40569c42-220e-4c21-8b6c-b12dc4e111c5 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:23:55 user nova-compute[75226]: WARNING nova.compute.manager [req-4ddefd7c-756a-41f6-ad7f-19d90dcd54aa req-76b62be1-2048-482c-b07e-5d078f0a18db service nova] [instance: 52fe0a91-9320-47d2-ac83-4f49260a0997] Received unexpected event network-vif-plugged-40569c42-220e-4c21-8b6c-b12dc4e111c5 for instance with vm_state deleted and task_state None.
Nov 17 01:23:55 user nova-compute[75226]: DEBUG nova.network.neutron [None req-34d8fd61-cb69-42b4-a4b5-363282aae2e4 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] [instance: 346967c5-6945-4cef-9eea-8415cb27c98f] Successfully updated port: aa5b3af3-4cac-4a2f-93b8-3b6d378a3486 {{(pid=75226) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 17 01:23:55 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-34d8fd61-cb69-42b4-a4b5-363282aae2e4 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Acquiring lock "refresh_cache-346967c5-6945-4cef-9eea-8415cb27c98f" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:23:55 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-34d8fd61-cb69-42b4-a4b5-363282aae2e4 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Acquired lock "refresh_cache-346967c5-6945-4cef-9eea-8415cb27c98f" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:23:55 user nova-compute[75226]: DEBUG nova.network.neutron [None req-34d8fd61-cb69-42b4-a4b5-363282aae2e4 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] [instance: 346967c5-6945-4cef-9eea-8415cb27c98f] Building network info cache for instance {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 01:23:55 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-8faf9d74-9c6c-4cdb-b4c7-7c1b6f6c3f32 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:23:55 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-8faf9d74-9c6c-4cdb-b4c7-7c1b6f6c3f32 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:23:55 user nova-compute[75226]: DEBUG nova.network.neutron [None req-34d8fd61-cb69-42b4-a4b5-363282aae2e4 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] [instance: 346967c5-6945-4cef-9eea-8415cb27c98f] Instance cache missing network info. {{(pid=75226) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 17 01:23:55 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-8faf9d74-9c6c-4cdb-b4c7-7c1b6f6c3f32 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.369s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:23:55 user nova-compute[75226]: INFO nova.scheduler.client.report [None req-8faf9d74-9c6c-4cdb-b4c7-7c1b6f6c3f32 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] Deleted allocations for instance 52fe0a91-9320-47d2-ac83-4f49260a0997
Nov 17 01:23:55 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-8faf9d74-9c6c-4cdb-b4c7-7c1b6f6c3f32 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401 tempest-TestServerVolumeAttachScenarioOldVersion-1271757401-project-member] Lock "52fe0a91-9320-47d2-ac83-4f49260a0997" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.971s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:23:55 user nova-compute[75226]: DEBUG nova.network.neutron [None req-34d8fd61-cb69-42b4-a4b5-363282aae2e4 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] [instance: 346967c5-6945-4cef-9eea-8415cb27c98f] Updating instance_info_cache with network_info: [{"id": "aa5b3af3-4cac-4a2f-93b8-3b6d378a3486", "address": "fa:16:3e:be:85:10", "network": {"id": "9335d73b-c260-49f3-8771-0dc21875a113", "bridge": "br-int", "label": "tempest-TestShelveInstance-1952470027-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adaa172aeff64609a273bdc271806238", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa5b3af3-4c", "ovs_interfaceid": "aa5b3af3-4cac-4a2f-93b8-3b6d378a3486", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:23:55 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-34d8fd61-cb69-42b4-a4b5-363282aae2e4 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Releasing lock "refresh_cache-346967c5-6945-4cef-9eea-8415cb27c98f" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:23:55 user nova-compute[75226]: DEBUG nova.compute.manager [None req-34d8fd61-cb69-42b4-a4b5-363282aae2e4 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] [instance: 346967c5-6945-4cef-9eea-8415cb27c98f] Instance network_info: |[{"id": "aa5b3af3-4cac-4a2f-93b8-3b6d378a3486", "address": "fa:16:3e:be:85:10", "network": {"id": "9335d73b-c260-49f3-8771-0dc21875a113", "bridge": "br-int", "label": "tempest-TestShelveInstance-1952470027-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adaa172aeff64609a273bdc271806238", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa5b3af3-4c", "ovs_interfaceid": "aa5b3af3-4cac-4a2f-93b8-3b6d378a3486", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75226) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 17 01:23:57 user nova-compute[75226]: DEBUG nova.compute.manager [req-bd66620b-69a8-416e-ab99-3b307235accf req-1101e970-155d-4383-9208-4baaa2e31616 service nova] [instance: 346967c5-6945-4cef-9eea-8415cb27c98f] Received event network-changed-aa5b3af3-4cac-4a2f-93b8-3b6d378a3486 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:23:57 user nova-compute[75226]: DEBUG nova.compute.manager [req-bd66620b-69a8-416e-ab99-3b307235accf req-1101e970-155d-4383-9208-4baaa2e31616 service nova] [instance: 346967c5-6945-4cef-9eea-8415cb27c98f] Refreshing instance network info cache due to event network-changed-aa5b3af3-4cac-4a2f-93b8-3b6d378a3486. {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 01:23:57 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-bd66620b-69a8-416e-ab99-3b307235accf req-1101e970-155d-4383-9208-4baaa2e31616 service nova] Acquiring lock "refresh_cache-346967c5-6945-4cef-9eea-8415cb27c98f" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:23:57 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-bd66620b-69a8-416e-ab99-3b307235accf req-1101e970-155d-4383-9208-4baaa2e31616 service nova] Acquired lock "refresh_cache-346967c5-6945-4cef-9eea-8415cb27c98f" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:23:57 user nova-compute[75226]: DEBUG nova.network.neutron [req-bd66620b-69a8-416e-ab99-3b307235accf req-1101e970-155d-4383-9208-4baaa2e31616 service nova] [instance: 346967c5-6945-4cef-9eea-8415cb27c98f] Refreshing network info cache for port aa5b3af3-4cac-4a2f-93b8-3b6d378a3486 {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 01:23:57 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:23:57 user nova-compute[75226]: DEBUG nova.network.neutron [req-bd66620b-69a8-416e-ab99-3b307235accf req-1101e970-155d-4383-9208-4baaa2e31616 service nova] [instance: 346967c5-6945-4cef-9eea-8415cb27c98f] Updated VIF entry in instance network info cache for port aa5b3af3-4cac-4a2f-93b8-3b6d378a3486. {{(pid=75226) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 01:23:57 user nova-compute[75226]: DEBUG nova.network.neutron [req-bd66620b-69a8-416e-ab99-3b307235accf req-1101e970-155d-4383-9208-4baaa2e31616 service nova] [instance: 346967c5-6945-4cef-9eea-8415cb27c98f] Updating instance_info_cache with network_info: [{"id": "aa5b3af3-4cac-4a2f-93b8-3b6d378a3486", "address": "fa:16:3e:be:85:10", "network": {"id": "9335d73b-c260-49f3-8771-0dc21875a113", "bridge": "br-int", "label": "tempest-TestShelveInstance-1952470027-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adaa172aeff64609a273bdc271806238", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa5b3af3-4c", "ovs_interfaceid": "aa5b3af3-4cac-4a2f-93b8-3b6d378a3486", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:23:57 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-bd66620b-69a8-416e-ab99-3b307235accf req-1101e970-155d-4383-9208-4baaa2e31616 service nova] Releasing lock "refresh_cache-346967c5-6945-4cef-9eea-8415cb27c98f" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:23:58 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:23:59 user nova-compute[75226]: DEBUG nova.compute.manager [None req-34d8fd61-cb69-42b4-a4b5-363282aae2e4 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] [instance: 346967c5-6945-4cef-9eea-8415cb27c98f] Start spawning the instance on the hypervisor. {{(pid=75226) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 17 01:23:59 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-34d8fd61-cb69-42b4-a4b5-363282aae2e4 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] [instance: 346967c5-6945-4cef-9eea-8415cb27c98f] Creating instance directory {{(pid=75226) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 17 01:23:59 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-34d8fd61-cb69-42b4-a4b5-363282aae2e4 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] [instance: 346967c5-6945-4cef-9eea-8415cb27c98f] Creating image(s)
Nov 17 01:23:59 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-34d8fd61-cb69-42b4-a4b5-363282aae2e4 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] [instance: 346967c5-6945-4cef-9eea-8415cb27c98f] Did not create local disks {{(pid=75226) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 17 01:23:59 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-34d8fd61-cb69-42b4-a4b5-363282aae2e4 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] [instance: 346967c5-6945-4cef-9eea-8415cb27c98f] Ensure instance console log exists: /opt/stack/data/nova/instances/346967c5-6945-4cef-9eea-8415cb27c98f/console.log {{(pid=75226) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 17 01:23:59 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-34d8fd61-cb69-42b4-a4b5-363282aae2e4 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:23:59 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-34d8fd61-cb69-42b4-a4b5-363282aae2e4 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:23:59 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-34d8fd61-cb69-42b4-a4b5-363282aae2e4 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:23:59 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-34d8fd61-cb69-42b4-a4b5-363282aae2e4 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] [instance: 346967c5-6945-4cef-9eea-8415cb27c98f] Start _get_guest_xml network_info=[{"id": "aa5b3af3-4cac-4a2f-93b8-3b6d378a3486", "address": "fa:16:3e:be:85:10", "network": {"id": "9335d73b-c260-49f3-8771-0dc21875a113", "bridge": "br-int", "label": "tempest-TestShelveInstance-1952470027-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adaa172aeff64609a273bdc271806238", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa5b3af3-4c", "ovs_interfaceid": "aa5b3af3-4cac-4a2f-93b8-3b6d378a3486", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c17ed19c-4452-4a79-b36a-07ddcd7d9404', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LimvaOGH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '346967c5-6945-4cef-9eea-8415cb27c98f', 'attached_at': '', 'detached_at': '', 'volume_id': 'c17ed19c-4452-4a79-b36a-07ddcd7d9404', 'serial': 'c17ed19c-4452-4a79-b36a-07ddcd7d9404'}, 'attachment_id': '8e0000a6-8e3d-4d59-9f3a-8b19845ac7c0', 'device_type': 'disk', 'volume_type': None} {{(pid=75226) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 17 01:23:59 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-34d8fd61-cb69-42b4-a4b5-363282aae2e4 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:23:59 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-34d8fd61-cb69-42b4-a4b5-363282aae2e4 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:23:59 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-34d8fd61-cb69-42b4-a4b5-363282aae2e4 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75226) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 17 01:23:59 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-34d8fd61-cb69-42b4-a4b5-363282aae2e4 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] CPU controller missing on host. {{(pid=75226) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 17 01:23:59 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-34d8fd61-cb69-42b4-a4b5-363282aae2e4 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75226) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 17 01:23:59 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-34d8fd61-cb69-42b4-a4b5-363282aae2e4 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] CPU controller found on host. {{(pid=75226) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 17 01:23:59 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-34d8fd61-cb69-42b4-a4b5-363282aae2e4 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75226) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 17 01:23:59 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-34d8fd61-cb69-42b4-a4b5-363282aae2e4 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-17T01:13:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 17 01:23:59 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-34d8fd61-cb69-42b4-a4b5-363282aae2e4 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Flavor limits 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 17 01:23:59 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-34d8fd61-cb69-42b4-a4b5-363282aae2e4 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Image limits 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 17 01:23:59 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-34d8fd61-cb69-42b4-a4b5-363282aae2e4 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Flavor pref 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 17 01:23:59 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-34d8fd61-cb69-42b4-a4b5-363282aae2e4 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Image pref 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 17 01:23:59 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-34d8fd61-cb69-42b4-a4b5-363282aae2e4 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 17 01:23:59 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-34d8fd61-cb69-42b4-a4b5-363282aae2e4 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 17 01:23:59 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-34d8fd61-cb69-42b4-a4b5-363282aae2e4 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75226) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 17 01:23:59 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-34d8fd61-cb69-42b4-a4b5-363282aae2e4 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Got 1 possible topologies {{(pid=75226) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 17 01:23:59 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-34d8fd61-cb69-42b4-a4b5-363282aae2e4 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 17 01:23:59 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-34d8fd61-cb69-42b4-a4b5-363282aae2e4 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 17 01:23:59 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34d8fd61-cb69-42b4-a4b5-363282aae2e4 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] [instance: 346967c5-6945-4cef-9eea-8415cb27c98f] Calling os-brick to attach iSCSI Volume {{(pid=75226) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 17 01:23:59 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d8fd61-cb69-42b4-a4b5-363282aae2e4 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc4cc36b490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c17ed19c-4452-4a79-b36a-07ddcd7d9404', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LimvaOGH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:23:59 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-34d8fd61-cb69-42b4-a4b5-363282aae2e4 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:23:59 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-34d8fd61-cb69-42b4-a4b5-363282aae2e4 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:23:59 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-34d8fd61-cb69-42b4-a4b5-363282aae2e4 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:23:59 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-34d8fd61-cb69-42b4-a4b5-363282aae2e4 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:23:59 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-34d8fd61-cb69-42b4-a4b5-363282aae2e4 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c17ed19c-4452-4a79-b36a-07ddcd7d9404" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:23:59 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-34d8fd61-cb69-42b4-a4b5-363282aae2e4 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c17ed19c-4452-4a79-b36a-07ddcd7d9404" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:23:59 user nova-compute[75226]: INFO os_brick.initiator.connectors.iscsi [None req-34d8fd61-cb69-42b4-a4b5-363282aae2e4 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 17 01:23:59 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c17ed19c-4452-4a79-b36a-07ddcd7d9404 -p 172.16.0.220:3260 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:23:59 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c17ed19c-4452-4a79-b36a-07ddcd7d9404 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:23:59 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[485c3da0-f4b4-4646-b423-42db725833af]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:23:59 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d8fd61-cb69-42b4-a4b5-363282aae2e4 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 17 01:23:59 user nova-compute[75226]:  {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:23:59 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c17ed19c-4452-4a79-b36a-07ddcd7d9404 -p 172.16.0.220:3260 --interface default --op new {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:23:59 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c17ed19c-4452-4a79-b36a-07ddcd7d9404 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:23:59 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[c79ff12d-c627-48a8-8ae6-da4a2018b9eb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c17ed19c-4452-4a79-b36a-07ddcd7d9404] added\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:23:59 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d8fd61-cb69-42b4-a4b5-363282aae2e4 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c17ed19c-4452-4a79-b36a-07ddcd7d9404] added
Nov 17 01:23:59 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:23:59 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c17ed19c-4452-4a79-b36a-07ddcd7d9404 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:23:59 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c17ed19c-4452-4a79-b36a-07ddcd7d9404 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:23:59 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[e341e576-ae25-4184-b2d9-60eede38f06a]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:23:59 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d8fd61-cb69-42b4-a4b5-363282aae2e4 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:23:59 user nova-compute[75226]: DEBUG nova.compute.manager [req-168224b9-60ed-4690-8bb0-505324fe3ffe req-01c3a5f6-0704-4166-a983-5b511ae54e63 service nova] [instance: 306054a8-4d0f-4913-b3b8-97aeeeec071c] Received event network-changed-9c6d2999-f11a-4cab-828c-993cc52b996c {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:23:59 user nova-compute[75226]: DEBUG nova.compute.manager [req-168224b9-60ed-4690-8bb0-505324fe3ffe req-01c3a5f6-0704-4166-a983-5b511ae54e63 service nova] [instance: 306054a8-4d0f-4913-b3b8-97aeeeec071c] Refreshing instance network info cache due to event network-changed-9c6d2999-f11a-4cab-828c-993cc52b996c. {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 01:23:59 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-168224b9-60ed-4690-8bb0-505324fe3ffe req-01c3a5f6-0704-4166-a983-5b511ae54e63 service nova] Acquiring lock "refresh_cache-306054a8-4d0f-4913-b3b8-97aeeeec071c" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:23:59 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-168224b9-60ed-4690-8bb0-505324fe3ffe req-01c3a5f6-0704-4166-a983-5b511ae54e63 service nova] Acquired lock "refresh_cache-306054a8-4d0f-4913-b3b8-97aeeeec071c" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:23:59 user nova-compute[75226]: DEBUG nova.network.neutron [req-168224b9-60ed-4690-8bb0-505324fe3ffe req-01c3a5f6-0704-4166-a983-5b511ae54e63 service nova] [instance: 306054a8-4d0f-4913-b3b8-97aeeeec071c] Refreshing network info cache for port 9c6d2999-f11a-4cab-828c-993cc52b996c {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 01:23:59 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c17ed19c-4452-4a79-b36a-07ddcd7d9404 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:23:59 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c17ed19c-4452-4a79-b36a-07ddcd7d9404 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:23:59 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6c20c51-2233-4bf4-8e6e-4821128185dc]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:23:59 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d8fd61-cb69-42b4-a4b5-363282aae2e4 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:23:59 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c17ed19c-4452-4a79-b36a-07ddcd7d9404 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LimvaOGH {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:23:59 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c17ed19c-4452-4a79-b36a-07ddcd7d9404 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LimvaOGH" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:23:59 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[6892267c-7147-4108-99ee-3ec7f826d138]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:23:59 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d8fd61-cb69-42b4-a4b5-363282aae2e4 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LimvaOGH'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:23:59 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c17ed19c-4452-4a79-b36a-07ddcd7d9404 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:23:59 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c17ed19c-4452-4a79-b36a-07ddcd7d9404 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:23:59 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[82484663-843f-4ecc-9326-ae588d967ee4]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:23:59 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d8fd61-cb69-42b4-a4b5-363282aae2e4 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:23:59 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:23:59 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:23:59 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fa13cc9-894e-43da-b28b-1848fd20b76f]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:928c93b5-ae63-4e04-94ce-6059e7eaa7d6 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:607b7fb8-097d-43ea-b13c-0825e015e14e (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b95a10d-6f61-48de-b7e5-de732f65f408 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fd0b73a-0d42-4e3d-a4f0-a9936d9bd1d4 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:23:59 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d8fd61-cb69-42b4-a4b5-363282aae2e4 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)
Nov 17 01:23:59 user nova-compute[75226]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:928c93b5-ae63-4e04-94ce-6059e7eaa7d6 (non-flash)
Nov 17 01:23:59 user nova-compute[75226]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:607b7fb8-097d-43ea-b13c-0825e015e14e (non-flash)
Nov 17 01:23:59 user nova-compute[75226]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b95a10d-6f61-48de-b7e5-de732f65f408 (non-flash)
Nov 17 01:23:59 user nova-compute[75226]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421 (non-flash)
Nov 17 01:23:59 user nova-compute[75226]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fd0b73a-0d42-4e3d-a4f0-a9936d9bd1d4 (non-flash)
Nov 17 01:23:59 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:23:59 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d8fd61-cb69-42b4-a4b5-363282aae2e4 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)
Nov 17 01:23:59 user nova-compute[75226]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:928c93b5-ae63-4e04-94ce-6059e7eaa7d6 (non-flash)
Nov 17 01:23:59 user nova-compute[75226]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:607b7fb8-097d-43ea-b13c-0825e015e14e (non-flash)
Nov 17 01:23:59 user nova-compute[75226]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b95a10d-6f61-48de-b7e5-de732f65f408 (non-flash)
Nov 17 01:23:59 user nova-compute[75226]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421 (non-flash)
Nov 17 01:23:59 user nova-compute[75226]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fd0b73a-0d42-4e3d-a4f0-a9936d9bd1d4 (non-flash)
Nov 17 01:23:59 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:23:59 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c17ed19c-4452-4a79-b36a-07ddcd7d9404 -p 172.16.0.220:3260 --login {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:23:59 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c17ed19c-4452-4a79-b36a-07ddcd7d9404 -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:23:59 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2f5381e-21f6-42fe-9626-b1a5a1fa375c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c17ed19c-4452-4a79-b36a-07ddcd7d9404, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c17ed19c-4452-4a79-b36a-07ddcd7d9404, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:23:59 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d8fd61-cb69-42b4-a4b5-363282aae2e4 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c17ed19c-4452-4a79-b36a-07ddcd7d9404, portal: 172.16.0.220,3260]
Nov 17 01:23:59 user nova-compute[75226]: Login to [iface: default, target: iqn.2010-10.org.openstack:c17ed19c-4452-4a79-b36a-07ddcd7d9404, portal: 172.16.0.220,3260] successful.
Nov 17 01:23:59 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:23:59 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c17ed19c-4452-4a79-b36a-07ddcd7d9404 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:23:59 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c17ed19c-4452-4a79-b36a-07ddcd7d9404 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:23:59 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[3721839f-f1d6-45e6-b7e3-8989f1d69990]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:23:59 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d8fd61-cb69-42b4-a4b5-363282aae2e4 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:23:59 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:23:59 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:23:59 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f93d0db-a8f9-4e38-9f45-13778e2ec334]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:928c93b5-ae63-4e04-94ce-6059e7eaa7d6 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:607b7fb8-097d-43ea-b13c-0825e015e14e (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b95a10d-6f61-48de-b7e5-de732f65f408 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fd0b73a-0d42-4e3d-a4f0-a9936d9bd1d4 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c17ed19c-4452-4a79-b36a-07ddcd7d9404 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:23:59 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d8fd61-cb69-42b4-a4b5-363282aae2e4 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)
Nov 17 01:23:59 user nova-compute[75226]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:928c93b5-ae63-4e04-94ce-6059e7eaa7d6 (non-flash)
Nov 17 01:23:59 user nova-compute[75226]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:607b7fb8-097d-43ea-b13c-0825e015e14e (non-flash)
Nov 17 01:23:59 user nova-compute[75226]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b95a10d-6f61-48de-b7e5-de732f65f408 (non-flash)
Nov 17 01:23:59 user nova-compute[75226]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421 (non-flash)
Nov 17 01:23:59 user nova-compute[75226]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fd0b73a-0d42-4e3d-a4f0-a9936d9bd1d4 (non-flash)
Nov 17 01:23:59 user nova-compute[75226]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c17ed19c-4452-4a79-b36a-07ddcd7d9404 (non-flash)
Nov 17 01:23:59 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:23:59 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d8fd61-cb69-42b4-a4b5-363282aae2e4 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)
Nov 17 01:23:59 user nova-compute[75226]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:928c93b5-ae63-4e04-94ce-6059e7eaa7d6 (non-flash)
Nov 17 01:23:59 user nova-compute[75226]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:607b7fb8-097d-43ea-b13c-0825e015e14e (non-flash)
Nov 17 01:23:59 user nova-compute[75226]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b95a10d-6f61-48de-b7e5-de732f65f408 (non-flash)
Nov 17 01:23:59 user nova-compute[75226]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421 (non-flash)
Nov 17 01:23:59 user nova-compute[75226]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fd0b73a-0d42-4e3d-a4f0-a9936d9bd1d4 (non-flash)
Nov 17 01:23:59 user nova-compute[75226]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c17ed19c-4452-4a79-b36a-07ddcd7d9404 (non-flash)
Nov 17 01:23:59 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:23:59 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-34d8fd61-cb69-42b4-a4b5-363282aae2e4 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c17ed19c-4452-4a79-b36a-07ddcd7d9404" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.306s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:23:59 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d8fd61-cb69-42b4-a4b5-363282aae2e4 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Connected to 172.16.0.220:3260 {{(pid=75226) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 17 01:23:59 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-34d8fd61-cb69-42b4-a4b5-363282aae2e4 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] HCTL ('33', '-', '-', 0) found on session 24 with lun 0 {{(pid=75226) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 17 01:23:59 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-34d8fd61-cb69-42b4-a4b5-363282aae2e4 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75226) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 17 01:23:59 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:23:59 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:23:59 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ec8a812-a3a6-44d9-9ed7-2e59a3d37b36]: (4, ('- - 0', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:23:59 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-34d8fd61-cb69-42b4-a4b5-363282aae2e4 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Searching for a device in session 24 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75226) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 01:23:59 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d8fd61-cb69-42b4-a4b5-363282aae2e4 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c17ed19c-4452-4a79-b36a-07ddcd7d9404', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LimvaOGH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75226) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 17 01:23:59 user nova-compute[75226]: DEBUG nova.network.neutron [req-168224b9-60ed-4690-8bb0-505324fe3ffe req-01c3a5f6-0704-4166-a983-5b511ae54e63 service nova] [instance: 306054a8-4d0f-4913-b3b8-97aeeeec071c] Updated VIF entry in instance network info cache for port 9c6d2999-f11a-4cab-828c-993cc52b996c. {{(pid=75226) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 01:23:59 user nova-compute[75226]: DEBUG nova.network.neutron [req-168224b9-60ed-4690-8bb0-505324fe3ffe req-01c3a5f6-0704-4166-a983-5b511ae54e63 service nova] [instance: 306054a8-4d0f-4913-b3b8-97aeeeec071c] Updating instance_info_cache with network_info: [{"id": "9c6d2999-f11a-4cab-828c-993cc52b996c", "address": "fa:16:3e:71:4a:e0", "network": {"id": "72724945-89ae-47c2-ac58-ea393837ada6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-308563626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fcdc65b510141e9b7c9a01401a97448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c6d2999-f1", "ovs_interfaceid": "9c6d2999-f11a-4cab-828c-993cc52b996c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:23:59 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-168224b9-60ed-4690-8bb0-505324fe3ffe req-01c3a5f6-0704-4166-a983-5b511ae54e63 service nova] Releasing lock "refresh_cache-306054a8-4d0f-4913-b3b8-97aeeeec071c" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:23:59 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:23:59 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:23:59 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:23:59 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:23:59 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:23:59 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:23:59 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:23:59 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75226) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 17 01:24:00 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddfecefc-1e9b-4e6e-9995-855c8a061084/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:24:00 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddfecefc-1e9b-4e6e-9995-855c8a061084/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:24:00 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddfecefc-1e9b-4e6e-9995-855c8a061084/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:24:00 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddfecefc-1e9b-4e6e-9995-855c8a061084/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:24:00 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38062487-67ca-4962-974f-81456aebe97b/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:24:00 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-34d8fd61-cb69-42b4-a4b5-363282aae2e4 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.343s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:24:00 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-34d8fd61-cb69-42b4-a4b5-363282aae2e4 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] <== connect_volume: return (1345ms) {'type': 'block', 'scsi_wwn': '26661623630623362', 'path': '/dev/sdb'} {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:24:00 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34d8fd61-cb69-42b4-a4b5-363282aae2e4 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] [instance: 346967c5-6945-4cef-9eea-8415cb27c98f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26661623630623362', 'path': '/dev/sdb'} {{(pid=75226) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 17 01:24:00 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38062487-67ca-4962-974f-81456aebe97b/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:24:00 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38062487-67ca-4962-974f-81456aebe97b/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:24:00 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-34d8fd61-cb69-42b4-a4b5-363282aae2e4 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:23:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1793645083',display_name='tempest-TestShelveInstance-server-1793645083',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1793645083',id=20,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIOvS4/tTht9hr1zXYQtzCR2u7iigZ7otRMVBOpropTrS4OyZyMoxHA9vJUOwRc9jjyn0792XF/jB+xhGlZyJPPlZyVyxaJGOABRR09r+ft/TyseT2oW3x5gSl4AxhHiWw==',key_name='tempest-TestShelveInstance-879048345',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='adaa172aeff64609a273bdc271806238',ramdisk_id='',reservation_id='r-rgcypk19',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1381460949',owner_user_name='tempest-TestShelveInstance-1381460949-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T01:23:53Z,user_data=None,user_id='ed6cfbd0e0124dd2a4092f0b087f416c',uuid=346967c5-6945-4cef-9eea-8415cb27c98f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aa5b3af3-4cac-4a2f-93b8-3b6d378a3486", "address": "fa:16:3e:be:85:10", "network": {"id": "9335d73b-c260-49f3-8771-0dc21875a113", "bridge": "br-int", "label": "tempest-TestShelveInstance-1952470027-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adaa172aeff64609a273bdc271806238", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa5b3af3-4c", "ovs_interfaceid": "aa5b3af3-4cac-4a2f-93b8-3b6d378a3486", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75226) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 01:24:00 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-34d8fd61-cb69-42b4-a4b5-363282aae2e4 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Converting VIF {"id": "aa5b3af3-4cac-4a2f-93b8-3b6d378a3486", "address": "fa:16:3e:be:85:10", "network": {"id": "9335d73b-c260-49f3-8771-0dc21875a113", "bridge": "br-int", "label": "tempest-TestShelveInstance-1952470027-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adaa172aeff64609a273bdc271806238", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa5b3af3-4c", "ovs_interfaceid": "aa5b3af3-4cac-4a2f-93b8-3b6d378a3486", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:24:00 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-34d8fd61-cb69-42b4-a4b5-363282aae2e4 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:85:10,bridge_name='br-int',has_traffic_filtering=True,id=aa5b3af3-4cac-4a2f-93b8-3b6d378a3486,network=Network(9335d73b-c260-49f3-8771-0dc21875a113),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa5b3af3-4c') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:24:00 user nova-compute[75226]: DEBUG nova.objects.instance [None req-34d8fd61-cb69-42b4-a4b5-363282aae2e4 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Lazy-loading 'pci_devices' on Instance uuid 346967c5-6945-4cef-9eea-8415cb27c98f {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:24:00 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-34d8fd61-cb69-42b4-a4b5-363282aae2e4 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] [instance: 346967c5-6945-4cef-9eea-8415cb27c98f] End _get_guest_xml xml=<domain type="kvm">
Nov 17 01:24:00 user nova-compute[75226]:   <uuid>346967c5-6945-4cef-9eea-8415cb27c98f</uuid>
Nov 17 01:24:00 user nova-compute[75226]:   <name>instance-00000014</name>
Nov 17 01:24:00 user nova-compute[75226]:   <memory>524288</memory>
Nov 17 01:24:00 user nova-compute[75226]:   <vcpu>1</vcpu>
Nov 17 01:24:00 user nova-compute[75226]:   <metadata>
Nov 17 01:24:00 user nova-compute[75226]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 17 01:24:00 user nova-compute[75226]:       <nova:package version="0.0.0"/>
Nov 17 01:24:00 user nova-compute[75226]:       <nova:name>tempest-TestShelveInstance-server-1793645083</nova:name>
Nov 17 01:24:00 user nova-compute[75226]:       <nova:creationTime>2023-11-17 01:23:59</nova:creationTime>
Nov 17 01:24:00 user nova-compute[75226]:       <nova:flavor name="m1.tiny">
Nov 17 01:24:00 user nova-compute[75226]:         <nova:memory>512</nova:memory>
Nov 17 01:24:00 user nova-compute[75226]:         <nova:disk>1</nova:disk>
Nov 17 01:24:00 user nova-compute[75226]:         <nova:swap>0</nova:swap>
Nov 17 01:24:00 user nova-compute[75226]:         <nova:ephemeral>0</nova:ephemeral>
Nov 17 01:24:00 user nova-compute[75226]:         <nova:vcpus>1</nova:vcpus>
Nov 17 01:24:00 user nova-compute[75226]:       </nova:flavor>
Nov 17 01:24:00 user nova-compute[75226]:       <nova:owner>
Nov 17 01:24:00 user nova-compute[75226]:         <nova:user uuid="ed6cfbd0e0124dd2a4092f0b087f416c">tempest-TestShelveInstance-1381460949-project-member</nova:user>
Nov 17 01:24:00 user nova-compute[75226]:         <nova:project uuid="adaa172aeff64609a273bdc271806238">tempest-TestShelveInstance-1381460949</nova:project>
Nov 17 01:24:00 user nova-compute[75226]:       </nova:owner>
Nov 17 01:24:00 user nova-compute[75226]:       <nova:ports>
Nov 17 01:24:00 user nova-compute[75226]:         <nova:port uuid="aa5b3af3-4cac-4a2f-93b8-3b6d378a3486">
Nov 17 01:24:00 user nova-compute[75226]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 17 01:24:00 user nova-compute[75226]:         </nova:port>
Nov 17 01:24:00 user nova-compute[75226]:       </nova:ports>
Nov 17 01:24:00 user nova-compute[75226]:     </nova:instance>
Nov 17 01:24:00 user nova-compute[75226]:   </metadata>
Nov 17 01:24:00 user nova-compute[75226]:   <sysinfo type="smbios">
Nov 17 01:24:00 user nova-compute[75226]:     <system>
Nov 17 01:24:00 user nova-compute[75226]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 17 01:24:00 user nova-compute[75226]:       <entry name="product">OpenStack Nova</entry>
Nov 17 01:24:00 user nova-compute[75226]:       <entry name="version">0.0.0</entry>
Nov 17 01:24:00 user nova-compute[75226]:       <entry name="serial">346967c5-6945-4cef-9eea-8415cb27c98f</entry>
Nov 17 01:24:00 user nova-compute[75226]:       <entry name="uuid">346967c5-6945-4cef-9eea-8415cb27c98f</entry>
Nov 17 01:24:00 user nova-compute[75226]:       <entry name="family">Virtual Machine</entry>
Nov 17 01:24:00 user nova-compute[75226]:     </system>
Nov 17 01:24:00 user nova-compute[75226]:   </sysinfo>
Nov 17 01:24:00 user nova-compute[75226]:   <os>
Nov 17 01:24:00 user nova-compute[75226]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 17 01:24:00 user nova-compute[75226]:     <boot dev="hd"/>
Nov 17 01:24:00 user nova-compute[75226]:     <smbios mode="sysinfo"/>
Nov 17 01:24:00 user nova-compute[75226]:   </os>
Nov 17 01:24:00 user nova-compute[75226]:   <features>
Nov 17 01:24:00 user nova-compute[75226]:     <acpi/>
Nov 17 01:24:00 user nova-compute[75226]:     <apic/>
Nov 17 01:24:00 user nova-compute[75226]:     <vmcoreinfo/>
Nov 17 01:24:00 user nova-compute[75226]:   </features>
Nov 17 01:24:00 user nova-compute[75226]:   <clock offset="utc">
Nov 17 01:24:00 user nova-compute[75226]:     <timer name="pit" tickpolicy="delay"/>
Nov 17 01:24:00 user nova-compute[75226]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 17 01:24:00 user nova-compute[75226]:     <timer name="hpet" present="no"/>
Nov 17 01:24:00 user nova-compute[75226]:   </clock>
Nov 17 01:24:00 user nova-compute[75226]:   <cpu mode="custom" match="exact">
Nov 17 01:24:00 user nova-compute[75226]:     <model>Nehalem</model>
Nov 17 01:24:00 user nova-compute[75226]:     <topology sockets="1" cores="1" threads="1"/>
Nov 17 01:24:00 user nova-compute[75226]:   </cpu>
Nov 17 01:24:00 user nova-compute[75226]:   <devices>
Nov 17 01:24:00 user nova-compute[75226]:     <disk type="block" device="disk">
Nov 17 01:24:00 user nova-compute[75226]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 01:24:00 user nova-compute[75226]:       <source dev="/dev/sdb"/>
Nov 17 01:24:00 user nova-compute[75226]:       <target dev="vda" bus="virtio"/>
Nov 17 01:24:00 user nova-compute[75226]:       <serial>c17ed19c-4452-4a79-b36a-07ddcd7d9404</serial>
Nov 17 01:24:00 user nova-compute[75226]:     </disk>
Nov 17 01:24:00 user nova-compute[75226]:     <interface type="ethernet">
Nov 17 01:24:00 user nova-compute[75226]:       <mac address="fa:16:3e:be:85:10"/>
Nov 17 01:24:00 user nova-compute[75226]:       <model type="virtio"/>
Nov 17 01:24:00 user nova-compute[75226]:       <mtu size="1442"/>
Nov 17 01:24:00 user nova-compute[75226]:       <target dev="tapaa5b3af3-4c"/>
Nov 17 01:24:00 user nova-compute[75226]:     </interface>
Nov 17 01:24:00 user nova-compute[75226]:     <serial type="pty">
Nov 17 01:24:00 user nova-compute[75226]:       <log file="/opt/stack/data/nova/instances/346967c5-6945-4cef-9eea-8415cb27c98f/console.log" append="off"/>
Nov 17 01:24:00 user nova-compute[75226]:     </serial>
Nov 17 01:24:00 user nova-compute[75226]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 17 01:24:00 user nova-compute[75226]:     <video>
Nov 17 01:24:00 user nova-compute[75226]:       <model type="virtio"/>
Nov 17 01:24:00 user nova-compute[75226]:     </video>
Nov 17 01:24:00 user nova-compute[75226]:     <rng model="virtio">
Nov 17 01:24:00 user nova-compute[75226]:       <backend model="random">/dev/urandom</backend>
Nov 17 01:24:00 user nova-compute[75226]:     </rng>
Nov 17 01:24:00 user nova-compute[75226]:     <controller type="usb" index="0" model="none"/>
Nov 17 01:24:00 user nova-compute[75226]:     <memballoon model="virtio">
Nov 17 01:24:00 user nova-compute[75226]:       <stats period="10"/>
Nov 17 01:24:00 user nova-compute[75226]:     </memballoon>
Nov 17 01:24:00 user nova-compute[75226]:   </devices>
Nov 17 01:24:00 user nova-compute[75226]: </domain>
Nov 17 01:24:00 user nova-compute[75226]:  {{(pid=75226) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 17 01:24:00 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-34d8fd61-cb69-42b4-a4b5-363282aae2e4 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:23:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1793645083',display_name='tempest-TestShelveInstance-server-1793645083',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1793645083',id=20,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIOvS4/tTht9hr1zXYQtzCR2u7iigZ7otRMVBOpropTrS4OyZyMoxHA9vJUOwRc9jjyn0792XF/jB+xhGlZyJPPlZyVyxaJGOABRR09r+ft/TyseT2oW3x5gSl4AxhHiWw==',key_name='tempest-TestShelveInstance-879048345',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='adaa172aeff64609a273bdc271806238',ramdisk_id='',reservation_id='r-rgcypk19',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1381460949',owner_user_name='tempest-TestShelveInstance-1381460949-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T01:23:53Z,user_data=None,user_id='ed6cfbd0e0124dd2a4092f0b087f416c',uuid=346967c5-6945-4cef-9eea-8415cb27c98f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aa5b3af3-4cac-4a2f-93b8-3b6d378a3486", "address": "fa:16:3e:be:85:10", "network": {"id": "9335d73b-c260-49f3-8771-0dc21875a113", "bridge": "br-int", "label": "tempest-TestShelveInstance-1952470027-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adaa172aeff64609a273bdc271806238", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa5b3af3-4c", "ovs_interfaceid": "aa5b3af3-4cac-4a2f-93b8-3b6d378a3486", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 17 01:24:00 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-34d8fd61-cb69-42b4-a4b5-363282aae2e4 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Converting VIF {"id": "aa5b3af3-4cac-4a2f-93b8-3b6d378a3486", "address": "fa:16:3e:be:85:10", "network": {"id": "9335d73b-c260-49f3-8771-0dc21875a113", "bridge": "br-int", "label": "tempest-TestShelveInstance-1952470027-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adaa172aeff64609a273bdc271806238", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa5b3af3-4c", "ovs_interfaceid": "aa5b3af3-4cac-4a2f-93b8-3b6d378a3486", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:24:00 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-34d8fd61-cb69-42b4-a4b5-363282aae2e4 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:85:10,bridge_name='br-int',has_traffic_filtering=True,id=aa5b3af3-4cac-4a2f-93b8-3b6d378a3486,network=Network(9335d73b-c260-49f3-8771-0dc21875a113),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa5b3af3-4c') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:24:00 user nova-compute[75226]: DEBUG os_vif [None req-34d8fd61-cb69-42b4-a4b5-363282aae2e4 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:85:10,bridge_name='br-int',has_traffic_filtering=True,id=aa5b3af3-4cac-4a2f-93b8-3b6d378a3486,network=Network(9335d73b-c260-49f3-8771-0dc21875a113),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa5b3af3-4c') {{(pid=75226) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 17 01:24:00 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:24:00 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:24:00 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 17 01:24:00 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:24:00 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '05ad7611-498c-5437-8596-a47863006e65', '_type': 'linux-noop'}}, row=False) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:24:00 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:24:00 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:24:00 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:24:00 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:24:00 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaa5b3af3-4c, may_exist=True, interface_attrs={}) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:24:00 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapaa5b3af3-4c, col_values=(('qos', UUID('138f4977-80e6-4086-854a-52328b085777')),), if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:24:00 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapaa5b3af3-4c, col_values=(('external_ids', {'iface-id': 'aa5b3af3-4cac-4a2f-93b8-3b6d378a3486', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:be:85:10', 'vm-uuid': '346967c5-6945-4cef-9eea-8415cb27c98f'}),), if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:24:00 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:24:00 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:24:00 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:24:00 user nova-compute[75226]: INFO os_vif [None req-34d8fd61-cb69-42b4-a4b5-363282aae2e4 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:85:10,bridge_name='br-int',has_traffic_filtering=True,id=aa5b3af3-4cac-4a2f-93b8-3b6d378a3486,network=Network(9335d73b-c260-49f3-8771-0dc21875a113),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa5b3af3-4c')
Nov 17 01:24:00 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-34d8fd61-cb69-42b4-a4b5-363282aae2e4 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] No BDM found with device name vda, not building metadata. {{(pid=75226) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 01:24:00 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-34d8fd61-cb69-42b4-a4b5-363282aae2e4 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] No VIF found with MAC fa:16:3e:be:85:10, not building metadata {{(pid=75226) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 01:24:00 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38062487-67ca-4962-974f-81456aebe97b/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:24:00 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa84e575-bdad-45b9-80ce-86b1c2826fb0/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:24:01 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa84e575-bdad-45b9-80ce-86b1c2826fb0/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:24:01 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa84e575-bdad-45b9-80ce-86b1c2826fb0/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:24:01 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e2205cf2-7127-4b05-94bf-8de2d2a32a61 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Acquiring lock "306054a8-4d0f-4913-b3b8-97aeeeec071c" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:24:01 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e2205cf2-7127-4b05-94bf-8de2d2a32a61 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Lock "306054a8-4d0f-4913-b3b8-97aeeeec071c" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:24:01 user nova-compute[75226]: INFO nova.compute.manager [None req-e2205cf2-7127-4b05-94bf-8de2d2a32a61 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] [instance: 306054a8-4d0f-4913-b3b8-97aeeeec071c] Shelving
Nov 17 01:24:01 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa84e575-bdad-45b9-80ce-86b1c2826fb0/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:24:01 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:24:01 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fbdd8af-f608-4d73-92d9-ae0586814c1b/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:24:01 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:24:01 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fbdd8af-f608-4d73-92d9-ae0586814c1b/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:24:01 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fbdd8af-f608-4d73-92d9-ae0586814c1b/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:24:01 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:24:01 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:24:01 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:24:01 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:24:01 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fbdd8af-f608-4d73-92d9-ae0586814c1b/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:24:01 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] skipping disk /dev/sdi (vdb) as it is a volume {{(pid=75226) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 01:24:01 user nova-compute[75226]: DEBUG nova.compute.manager [req-0d1f02c2-1667-4868-b74d-07d9fb98f749 req-7051d296-5d7e-44ff-8043-03b62a27b8d9 service nova] [instance: 306054a8-4d0f-4913-b3b8-97aeeeec071c] Received event network-vif-unplugged-9c6d2999-f11a-4cab-828c-993cc52b996c {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:24:01 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-0d1f02c2-1667-4868-b74d-07d9fb98f749 req-7051d296-5d7e-44ff-8043-03b62a27b8d9 service nova] Acquiring lock "306054a8-4d0f-4913-b3b8-97aeeeec071c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:24:01 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-0d1f02c2-1667-4868-b74d-07d9fb98f749 req-7051d296-5d7e-44ff-8043-03b62a27b8d9 service nova] Lock "306054a8-4d0f-4913-b3b8-97aeeeec071c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:24:01 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-0d1f02c2-1667-4868-b74d-07d9fb98f749 req-7051d296-5d7e-44ff-8043-03b62a27b8d9 service nova] Lock "306054a8-4d0f-4913-b3b8-97aeeeec071c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:24:01 user nova-compute[75226]: DEBUG nova.compute.manager [req-0d1f02c2-1667-4868-b74d-07d9fb98f749 req-7051d296-5d7e-44ff-8043-03b62a27b8d9 service nova] [instance: 306054a8-4d0f-4913-b3b8-97aeeeec071c] No waiting events found dispatching network-vif-unplugged-9c6d2999-f11a-4cab-828c-993cc52b996c {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:24:01 user nova-compute[75226]: WARNING nova.compute.manager [req-0d1f02c2-1667-4868-b74d-07d9fb98f749 req-7051d296-5d7e-44ff-8043-03b62a27b8d9 service nova] [instance: 306054a8-4d0f-4913-b3b8-97aeeeec071c] Received unexpected event network-vif-unplugged-9c6d2999-f11a-4cab-828c-993cc52b996c for instance with vm_state active and task_state shelving.
Nov 17 01:24:01 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/306054a8-4d0f-4913-b3b8-97aeeeec071c/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:24:01 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/306054a8-4d0f-4913-b3b8-97aeeeec071c/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:24:01 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/306054a8-4d0f-4913-b3b8-97aeeeec071c/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:24:02 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/306054a8-4d0f-4913-b3b8-97aeeeec071c/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:24:02 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:24:02 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:24:02 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:24:02 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:24:02 user nova-compute[75226]: INFO nova.virt.libvirt.driver [-] [instance: 306054a8-4d0f-4913-b3b8-97aeeeec071c] Instance destroyed successfully.
Nov 17 01:24:02 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:24:02 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:24:02 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:24:02 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=75226) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 01:24:02 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-e2205cf2-7127-4b05-94bf-8de2d2a32a61 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] [instance: 306054a8-4d0f-4913-b3b8-97aeeeec071c] Beginning cold snapshot process
Nov 17 01:24:02 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75226) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 01:24:02 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75226) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 01:24:02 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=75226) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 01:24:02 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/777fc3ab-09f0-414b-87f7-c806d2c5865d/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:24:02 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/777fc3ab-09f0-414b-87f7-c806d2c5865d/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:24:02 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/777fc3ab-09f0-414b-87f7-c806d2c5865d/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:24:02 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:24:02 user nova-compute[75226]: DEBUG nova.privsep.utils [None req-e2205cf2-7127-4b05-94bf-8de2d2a32a61 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75226) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 17 01:24:02 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e2205cf2-7127-4b05-94bf-8de2d2a32a61 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/306054a8-4d0f-4913-b3b8-97aeeeec071c/disk /opt/stack/data/nova/instances/snapshots/tmps7kjxx5q/820fa8b4a22d4308b7631b7d631c237f {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:24:02 user nova-compute[75226]: DEBUG nova.compute.manager [req-be86118b-496c-4848-bde6-7e319633d6d8 req-791269c2-dae0-48b9-8b60-861e7f4182a5 service nova] [instance: 346967c5-6945-4cef-9eea-8415cb27c98f] Received event network-vif-plugged-aa5b3af3-4cac-4a2f-93b8-3b6d378a3486 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:24:02 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-be86118b-496c-4848-bde6-7e319633d6d8 req-791269c2-dae0-48b9-8b60-861e7f4182a5 service nova] Acquiring lock "346967c5-6945-4cef-9eea-8415cb27c98f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:24:02 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-be86118b-496c-4848-bde6-7e319633d6d8 req-791269c2-dae0-48b9-8b60-861e7f4182a5 service nova] Lock "346967c5-6945-4cef-9eea-8415cb27c98f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:24:02 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-be86118b-496c-4848-bde6-7e319633d6d8 req-791269c2-dae0-48b9-8b60-861e7f4182a5 service nova] Lock "346967c5-6945-4cef-9eea-8415cb27c98f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:24:02 user nova-compute[75226]: DEBUG nova.compute.manager [req-be86118b-496c-4848-bde6-7e319633d6d8 req-791269c2-dae0-48b9-8b60-861e7f4182a5 service nova] [instance: 346967c5-6945-4cef-9eea-8415cb27c98f] No waiting events found dispatching network-vif-plugged-aa5b3af3-4cac-4a2f-93b8-3b6d378a3486 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:24:02 user nova-compute[75226]: WARNING nova.compute.manager [req-be86118b-496c-4848-bde6-7e319633d6d8 req-791269c2-dae0-48b9-8b60-861e7f4182a5 service nova] [instance: 346967c5-6945-4cef-9eea-8415cb27c98f] Received unexpected event network-vif-plugged-aa5b3af3-4cac-4a2f-93b8-3b6d378a3486 for instance with vm_state building and task_state spawning.
Nov 17 01:24:02 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/777fc3ab-09f0-414b-87f7-c806d2c5865d/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:24:02 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75226) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 01:24:04 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:24:04 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e2205cf2-7127-4b05-94bf-8de2d2a32a61 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/306054a8-4d0f-4913-b3b8-97aeeeec071c/disk /opt/stack/data/nova/instances/snapshots/tmps7kjxx5q/820fa8b4a22d4308b7631b7d631c237f" returned: 0 in 1.887s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:24:04 user nova-compute[75226]: DEBUG nova.compute.manager [req-b75780a5-d48c-432d-aad1-40238d22c3ee req-1bb8d9d4-b34e-4d69-840f-37503878c6a8 service nova] [instance: 306054a8-4d0f-4913-b3b8-97aeeeec071c] Received event network-vif-plugged-9c6d2999-f11a-4cab-828c-993cc52b996c {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:24:04 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-b75780a5-d48c-432d-aad1-40238d22c3ee req-1bb8d9d4-b34e-4d69-840f-37503878c6a8 service nova] Acquiring lock "306054a8-4d0f-4913-b3b8-97aeeeec071c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:24:04 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-b75780a5-d48c-432d-aad1-40238d22c3ee req-1bb8d9d4-b34e-4d69-840f-37503878c6a8 service nova] Lock "306054a8-4d0f-4913-b3b8-97aeeeec071c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:24:04 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-b75780a5-d48c-432d-aad1-40238d22c3ee req-1bb8d9d4-b34e-4d69-840f-37503878c6a8 service nova] Lock "306054a8-4d0f-4913-b3b8-97aeeeec071c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:24:04 user nova-compute[75226]: DEBUG nova.compute.manager [req-b75780a5-d48c-432d-aad1-40238d22c3ee req-1bb8d9d4-b34e-4d69-840f-37503878c6a8 service nova] [instance: 306054a8-4d0f-4913-b3b8-97aeeeec071c] No waiting events found dispatching network-vif-plugged-9c6d2999-f11a-4cab-828c-993cc52b996c {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:24:04 user nova-compute[75226]: WARNING nova.compute.manager [req-b75780a5-d48c-432d-aad1-40238d22c3ee req-1bb8d9d4-b34e-4d69-840f-37503878c6a8 service nova] [instance: 306054a8-4d0f-4913-b3b8-97aeeeec071c] Received unexpected event network-vif-plugged-9c6d2999-f11a-4cab-828c-993cc52b996c for instance with vm_state active and task_state shelving_image_pending_upload.
Nov 17 01:24:04 user nova-compute[75226]: DEBUG nova.compute.manager [None req-34d8fd61-cb69-42b4-a4b5-363282aae2e4 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] [instance: 346967c5-6945-4cef-9eea-8415cb27c98f] Instance event wait completed in 0 seconds for  {{(pid=75226) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 17 01:24:04 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-34d8fd61-cb69-42b4-a4b5-363282aae2e4 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] [instance: 346967c5-6945-4cef-9eea-8415cb27c98f] Guest created on hypervisor {{(pid=75226) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 17 01:24:04 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-e2205cf2-7127-4b05-94bf-8de2d2a32a61 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] [instance: 306054a8-4d0f-4913-b3b8-97aeeeec071c] Snapshot extracted, beginning image upload
Nov 17 01:24:04 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:24:04 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:24:04 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Hypervisor/Node resource view: name=user free_ram=7772MB free_disk=25.092899322509766GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75226) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 17 01:24:04 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:24:04 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:24:04 user nova-compute[75226]: INFO nova.virt.libvirt.driver [-] [instance: 346967c5-6945-4cef-9eea-8415cb27c98f] Instance spawned successfully.
Nov 17 01:24:04 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-34d8fd61-cb69-42b4-a4b5-363282aae2e4 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] [instance: 346967c5-6945-4cef-9eea-8415cb27c98f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 17 01:24:04 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-34d8fd61-cb69-42b4-a4b5-363282aae2e4 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] [instance: 346967c5-6945-4cef-9eea-8415cb27c98f] Found default for hw_cdrom_bus of ide {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:24:04 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-34d8fd61-cb69-42b4-a4b5-363282aae2e4 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] [instance: 346967c5-6945-4cef-9eea-8415cb27c98f] Found default for hw_disk_bus of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:24:04 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-34d8fd61-cb69-42b4-a4b5-363282aae2e4 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] [instance: 346967c5-6945-4cef-9eea-8415cb27c98f] Found default for hw_input_bus of None {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:24:04 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-34d8fd61-cb69-42b4-a4b5-363282aae2e4 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] [instance: 346967c5-6945-4cef-9eea-8415cb27c98f] Found default for hw_pointer_model of None {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:24:04 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-34d8fd61-cb69-42b4-a4b5-363282aae2e4 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] [instance: 346967c5-6945-4cef-9eea-8415cb27c98f] Found default for hw_video_model of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:24:04 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-34d8fd61-cb69-42b4-a4b5-363282aae2e4 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] [instance: 346967c5-6945-4cef-9eea-8415cb27c98f] Found default for hw_vif_model of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:24:04 user nova-compute[75226]: INFO nova.compute.manager [None req-34d8fd61-cb69-42b4-a4b5-363282aae2e4 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] [instance: 346967c5-6945-4cef-9eea-8415cb27c98f] Took 5.55 seconds to spawn the instance on the hypervisor.
Nov 17 01:24:04 user nova-compute[75226]: DEBUG nova.compute.manager [None req-34d8fd61-cb69-42b4-a4b5-363282aae2e4 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] [instance: 346967c5-6945-4cef-9eea-8415cb27c98f] Checking state {{(pid=75226) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 01:24:04 user nova-compute[75226]: DEBUG nova.compute.manager [req-0dab0cd0-b68a-4e81-9745-4d4453295270 req-68f407b3-53fb-487a-a25f-2c79795836e4 service nova] [instance: 346967c5-6945-4cef-9eea-8415cb27c98f] Received event network-vif-plugged-aa5b3af3-4cac-4a2f-93b8-3b6d378a3486 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:24:04 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-0dab0cd0-b68a-4e81-9745-4d4453295270 req-68f407b3-53fb-487a-a25f-2c79795836e4 service nova] Acquiring lock "346967c5-6945-4cef-9eea-8415cb27c98f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:24:04 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-0dab0cd0-b68a-4e81-9745-4d4453295270 req-68f407b3-53fb-487a-a25f-2c79795836e4 service nova] Lock "346967c5-6945-4cef-9eea-8415cb27c98f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:24:04 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-0dab0cd0-b68a-4e81-9745-4d4453295270 req-68f407b3-53fb-487a-a25f-2c79795836e4 service nova] Lock "346967c5-6945-4cef-9eea-8415cb27c98f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:24:04 user nova-compute[75226]: DEBUG nova.compute.manager [req-0dab0cd0-b68a-4e81-9745-4d4453295270 req-68f407b3-53fb-487a-a25f-2c79795836e4 service nova] [instance: 346967c5-6945-4cef-9eea-8415cb27c98f] No waiting events found dispatching network-vif-plugged-aa5b3af3-4cac-4a2f-93b8-3b6d378a3486 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:24:04 user nova-compute[75226]: WARNING nova.compute.manager [req-0dab0cd0-b68a-4e81-9745-4d4453295270 req-68f407b3-53fb-487a-a25f-2c79795836e4 service nova] [instance: 346967c5-6945-4cef-9eea-8415cb27c98f] Received unexpected event network-vif-plugged-aa5b3af3-4cac-4a2f-93b8-3b6d378a3486 for instance with vm_state building and task_state spawning.
Nov 17 01:24:04 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance aa84e575-bdad-45b9-80ce-86b1c2826fb0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:24:04 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance ddfecefc-1e9b-4e6e-9995-855c8a061084 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:24:04 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 6b7e9611-be35-4e51-b886-91a2fac0a653 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:24:04 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:24:04 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 2fbdd8af-f608-4d73-92d9-ae0586814c1b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:24:04 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 38062487-67ca-4962-974f-81456aebe97b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:24:04 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 306054a8-4d0f-4913-b3b8-97aeeeec071c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:24:04 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 663933b0-95dc-4fba-b411-029f0552571d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:24:04 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 777fc3ab-09f0-414b-87f7-c806d2c5865d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:24:04 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 346967c5-6945-4cef-9eea-8415cb27c98f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:24:04 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75226) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 17 01:24:04 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75226) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 17 01:24:04 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:24:04 user nova-compute[75226]: INFO nova.compute.manager [None req-34d8fd61-cb69-42b4-a4b5-363282aae2e4 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] [instance: 346967c5-6945-4cef-9eea-8415cb27c98f] Took 12.32 seconds to build instance.
Nov 17 01:24:04 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-34d8fd61-cb69-42b4-a4b5-363282aae2e4 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Lock "346967c5-6945-4cef-9eea-8415cb27c98f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.507s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:24:05 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:24:05 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:24:05 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Compute_service record updated for user:user {{(pid=75226) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 17 01:24:05 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.565s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:24:05 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:24:07 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:24:07 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Starting heal instance info cache {{(pid=75226) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 17 01:24:07 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "refresh_cache-ddfecefc-1e9b-4e6e-9995-855c8a061084" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:24:07 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquired lock "refresh_cache-ddfecefc-1e9b-4e6e-9995-855c8a061084" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:24:07 user nova-compute[75226]: DEBUG nova.network.neutron [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] [instance: ddfecefc-1e9b-4e6e-9995-855c8a061084] Forcefully refreshing network info cache for instance {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 17 01:24:07 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-e2205cf2-7127-4b05-94bf-8de2d2a32a61 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] [instance: 306054a8-4d0f-4913-b3b8-97aeeeec071c] Snapshot image upload complete
Nov 17 01:24:07 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e2205cf2-7127-4b05-94bf-8de2d2a32a61 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] [instance: 306054a8-4d0f-4913-b3b8-97aeeeec071c] Checking state {{(pid=75226) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 01:24:07 user nova-compute[75226]: INFO nova.compute.manager [None req-e2205cf2-7127-4b05-94bf-8de2d2a32a61 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] [instance: 306054a8-4d0f-4913-b3b8-97aeeeec071c] Shelve offloading
Nov 17 01:24:07 user nova-compute[75226]: INFO nova.virt.libvirt.driver [-] [instance: 306054a8-4d0f-4913-b3b8-97aeeeec071c] Instance destroyed successfully.
Nov 17 01:24:07 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e2205cf2-7127-4b05-94bf-8de2d2a32a61 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] [instance: 306054a8-4d0f-4913-b3b8-97aeeeec071c] Checking state {{(pid=75226) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 01:24:07 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e2205cf2-7127-4b05-94bf-8de2d2a32a61 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Acquiring lock "refresh_cache-306054a8-4d0f-4913-b3b8-97aeeeec071c" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:24:07 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e2205cf2-7127-4b05-94bf-8de2d2a32a61 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Acquired lock "refresh_cache-306054a8-4d0f-4913-b3b8-97aeeeec071c" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:24:07 user nova-compute[75226]: DEBUG nova.network.neutron [None req-e2205cf2-7127-4b05-94bf-8de2d2a32a61 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] [instance: 306054a8-4d0f-4913-b3b8-97aeeeec071c] Building network info cache for instance {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 01:24:07 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:24:07 user nova-compute[75226]: DEBUG nova.network.neutron [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] [instance: ddfecefc-1e9b-4e6e-9995-855c8a061084] Updating instance_info_cache with network_info: [{"id": "f9a7562b-de63-4374-b43b-18e3cb3af710", "address": "fa:16:3e:94:21:00", "network": {"id": "8450ab2c-4f24-46cc-a6ec-644c02e2b3da", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-385219532-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6869af66e0cc47bf9cca02ea9b688a6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9a7562b-de", "ovs_interfaceid": "f9a7562b-de63-4374-b43b-18e3cb3af710", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:24:07 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Releasing lock "refresh_cache-ddfecefc-1e9b-4e6e-9995-855c8a061084" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:24:07 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] [instance: ddfecefc-1e9b-4e6e-9995-855c8a061084] Updated the network info_cache for instance {{(pid=75226) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 17 01:24:07 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:24:07 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:24:07 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:24:07 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:24:07 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75226) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 17 01:24:08 user nova-compute[75226]: DEBUG nova.network.neutron [None req-e2205cf2-7127-4b05-94bf-8de2d2a32a61 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] [instance: 306054a8-4d0f-4913-b3b8-97aeeeec071c] Updating instance_info_cache with network_info: [{"id": "9c6d2999-f11a-4cab-828c-993cc52b996c", "address": "fa:16:3e:71:4a:e0", "network": {"id": "72724945-89ae-47c2-ac58-ea393837ada6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-308563626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fcdc65b510141e9b7c9a01401a97448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c6d2999-f1", "ovs_interfaceid": "9c6d2999-f11a-4cab-828c-993cc52b996c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:24:08 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e2205cf2-7127-4b05-94bf-8de2d2a32a61 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Releasing lock "refresh_cache-306054a8-4d0f-4913-b3b8-97aeeeec071c" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:24:08 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:24:08 user nova-compute[75226]: INFO nova.virt.libvirt.driver [-] [instance: 306054a8-4d0f-4913-b3b8-97aeeeec071c] Instance destroyed successfully.
Nov 17 01:24:08 user nova-compute[75226]: DEBUG nova.objects.instance [None req-e2205cf2-7127-4b05-94bf-8de2d2a32a61 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Lazy-loading 'resources' on Instance uuid 306054a8-4d0f-4913-b3b8-97aeeeec071c {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:24:09 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-e2205cf2-7127-4b05-94bf-8de2d2a32a61 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:22:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-523828380',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-523828380',id=17,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB8VZbi6odui0QRmSeooLxUmEz2+PJYm2i8ad1QX8czd8x79RdCiZHgEEKU0giPyPELai241fCLcP/Lw9LIxZnLDBi+bjdOFgz9iAt9ifW0YqhW6c0loV0dXybeEkqmBVQ==',key_name='tempest-keypair-1641360166',keypairs=<?>,launch_index=0,launched_at=2023-11-17T01:22:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='1fcdc65b510141e9b7c9a01401a97448',ramdisk_id='',reservation_id='r-7ael85gs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1321076871',owner_user_name='tempest-AttachVolumeShelveTestJSON-1321076871-project-member',shelved_at='2023-11-17T01:24:07.547973',shelved_host='user',shelved_image_id='cbc6eab0-2f12-4d46-a7cb-dcd6ec8fd06b'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T01:24:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2adb9c6cd5c443a7993f6f9d09da6346',uuid=306054a8-4d0f-4913-b3b8-97aeeeec071c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "9c6d2999-f11a-4cab-828c-993cc52b996c", "address": "fa:16:3e:71:4a:e0", "network": {"id": "72724945-89ae-47c2-ac58-ea393837ada6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-308563626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fcdc65b510141e9b7c9a01401a97448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c6d2999-f1", "ovs_interfaceid": "9c6d2999-f11a-4cab-828c-993cc52b996c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 17 01:24:09 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-e2205cf2-7127-4b05-94bf-8de2d2a32a61 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Converting VIF {"id": "9c6d2999-f11a-4cab-828c-993cc52b996c", "address": "fa:16:3e:71:4a:e0", "network": {"id": "72724945-89ae-47c2-ac58-ea393837ada6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-308563626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fcdc65b510141e9b7c9a01401a97448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c6d2999-f1", "ovs_interfaceid": "9c6d2999-f11a-4cab-828c-993cc52b996c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:24:09 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-e2205cf2-7127-4b05-94bf-8de2d2a32a61 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:4a:e0,bridge_name='br-int',has_traffic_filtering=True,id=9c6d2999-f11a-4cab-828c-993cc52b996c,network=Network(72724945-89ae-47c2-ac58-ea393837ada6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c6d2999-f1') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:24:09 user nova-compute[75226]: DEBUG os_vif [None req-e2205cf2-7127-4b05-94bf-8de2d2a32a61 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:4a:e0,bridge_name='br-int',has_traffic_filtering=True,id=9c6d2999-f11a-4cab-828c-993cc52b996c,network=Network(72724945-89ae-47c2-ac58-ea393837ada6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c6d2999-f1') {{(pid=75226) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 17 01:24:09 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:24:09 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9c6d2999-f1, bridge=br-int, if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:24:09 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:24:09 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:24:09 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:24:09 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:24:09 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0c335649-8039-4afc-a298-c1ee49d042a7) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:24:09 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:24:09 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:24:09 user nova-compute[75226]: DEBUG nova.compute.manager [req-2758b70e-a529-4d49-a3b3-1b9a04a559ee req-9b7f7b52-4322-447b-bd49-3f9f2be9900c service nova] [instance: 306054a8-4d0f-4913-b3b8-97aeeeec071c] Received event network-changed-9c6d2999-f11a-4cab-828c-993cc52b996c {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:24:09 user nova-compute[75226]: DEBUG nova.compute.manager [req-2758b70e-a529-4d49-a3b3-1b9a04a559ee req-9b7f7b52-4322-447b-bd49-3f9f2be9900c service nova] [instance: 306054a8-4d0f-4913-b3b8-97aeeeec071c] Refreshing instance network info cache due to event network-changed-9c6d2999-f11a-4cab-828c-993cc52b996c. {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 01:24:09 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-2758b70e-a529-4d49-a3b3-1b9a04a559ee req-9b7f7b52-4322-447b-bd49-3f9f2be9900c service nova] Acquiring lock "refresh_cache-306054a8-4d0f-4913-b3b8-97aeeeec071c" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:24:09 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-2758b70e-a529-4d49-a3b3-1b9a04a559ee req-9b7f7b52-4322-447b-bd49-3f9f2be9900c service nova] Acquired lock "refresh_cache-306054a8-4d0f-4913-b3b8-97aeeeec071c" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:24:09 user nova-compute[75226]: DEBUG nova.network.neutron [req-2758b70e-a529-4d49-a3b3-1b9a04a559ee req-9b7f7b52-4322-447b-bd49-3f9f2be9900c service nova] [instance: 306054a8-4d0f-4913-b3b8-97aeeeec071c] Refreshing network info cache for port 9c6d2999-f11a-4cab-828c-993cc52b996c {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 01:24:09 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:24:09 user nova-compute[75226]: INFO os_vif [None req-e2205cf2-7127-4b05-94bf-8de2d2a32a61 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:4a:e0,bridge_name='br-int',has_traffic_filtering=True,id=9c6d2999-f11a-4cab-828c-993cc52b996c,network=Network(72724945-89ae-47c2-ac58-ea393837ada6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c6d2999-f1')
Nov 17 01:24:09 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-e2205cf2-7127-4b05-94bf-8de2d2a32a61 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] [instance: 306054a8-4d0f-4913-b3b8-97aeeeec071c] Deleting instance files /opt/stack/data/nova/instances/306054a8-4d0f-4913-b3b8-97aeeeec071c_del
Nov 17 01:24:09 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-e2205cf2-7127-4b05-94bf-8de2d2a32a61 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] [instance: 306054a8-4d0f-4913-b3b8-97aeeeec071c] Deletion of /opt/stack/data/nova/instances/306054a8-4d0f-4913-b3b8-97aeeeec071c_del complete
Nov 17 01:24:09 user nova-compute[75226]: INFO nova.scheduler.client.report [None req-e2205cf2-7127-4b05-94bf-8de2d2a32a61 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Deleted allocations for instance 306054a8-4d0f-4913-b3b8-97aeeeec071c
Nov 17 01:24:09 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e2205cf2-7127-4b05-94bf-8de2d2a32a61 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:24:09 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e2205cf2-7127-4b05-94bf-8de2d2a32a61 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:24:09 user nova-compute[75226]: DEBUG nova.objects.instance [None req-e2205cf2-7127-4b05-94bf-8de2d2a32a61 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Lazy-loading 'numa_topology' on Instance uuid 306054a8-4d0f-4913-b3b8-97aeeeec071c {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:24:09 user nova-compute[75226]: DEBUG nova.objects.base [None req-e2205cf2-7127-4b05-94bf-8de2d2a32a61 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Object Instance<306054a8-4d0f-4913-b3b8-97aeeeec071c> lazy-loaded attributes: resources,numa_topology {{(pid=75226) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 17 01:24:09 user nova-compute[75226]: DEBUG nova.network.neutron [req-2758b70e-a529-4d49-a3b3-1b9a04a559ee req-9b7f7b52-4322-447b-bd49-3f9f2be9900c service nova] [instance: 306054a8-4d0f-4913-b3b8-97aeeeec071c] Updated VIF entry in instance network info cache for port 9c6d2999-f11a-4cab-828c-993cc52b996c. {{(pid=75226) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 01:24:09 user nova-compute[75226]: DEBUG nova.network.neutron [req-2758b70e-a529-4d49-a3b3-1b9a04a559ee req-9b7f7b52-4322-447b-bd49-3f9f2be9900c service nova] [instance: 306054a8-4d0f-4913-b3b8-97aeeeec071c] Updating instance_info_cache with network_info: [{"id": "9c6d2999-f11a-4cab-828c-993cc52b996c", "address": "fa:16:3e:71:4a:e0", "network": {"id": "72724945-89ae-47c2-ac58-ea393837ada6", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-308563626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fcdc65b510141e9b7c9a01401a97448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap9c6d2999-f1", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:24:09 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-2758b70e-a529-4d49-a3b3-1b9a04a559ee req-9b7f7b52-4322-447b-bd49-3f9f2be9900c service nova] Releasing lock "refresh_cache-306054a8-4d0f-4913-b3b8-97aeeeec071c" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:24:09 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-e2205cf2-7127-4b05-94bf-8de2d2a32a61 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:24:09 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-e2205cf2-7127-4b05-94bf-8de2d2a32a61 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:24:09 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e2205cf2-7127-4b05-94bf-8de2d2a32a61 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.344s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:24:09 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e2205cf2-7127-4b05-94bf-8de2d2a32a61 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Lock "306054a8-4d0f-4913-b3b8-97aeeeec071c" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 8.453s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:24:12 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:24:14 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:24:14 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:24:16 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:24:17 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:24:18 user nova-compute[75226]: DEBUG nova.compute.manager [req-8bac4dc2-37d3-4d47-ac02-38420d9d55b8 req-2bf28ade-963e-4db1-b53e-d2f7127b2907 service nova] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Received event network-changed-462b7d76-b8d0-4374-8b29-da083c4ec28f {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:24:18 user nova-compute[75226]: DEBUG nova.compute.manager [req-8bac4dc2-37d3-4d47-ac02-38420d9d55b8 req-2bf28ade-963e-4db1-b53e-d2f7127b2907 service nova] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Refreshing instance network info cache due to event network-changed-462b7d76-b8d0-4374-8b29-da083c4ec28f. {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 01:24:18 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-8bac4dc2-37d3-4d47-ac02-38420d9d55b8 req-2bf28ade-963e-4db1-b53e-d2f7127b2907 service nova] Acquiring lock "refresh_cache-663933b0-95dc-4fba-b411-029f0552571d" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:24:18 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-8bac4dc2-37d3-4d47-ac02-38420d9d55b8 req-2bf28ade-963e-4db1-b53e-d2f7127b2907 service nova] Acquired lock "refresh_cache-663933b0-95dc-4fba-b411-029f0552571d" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:24:18 user nova-compute[75226]: DEBUG nova.network.neutron [req-8bac4dc2-37d3-4d47-ac02-38420d9d55b8 req-2bf28ade-963e-4db1-b53e-d2f7127b2907 service nova] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Refreshing network info cache for port 462b7d76-b8d0-4374-8b29-da083c4ec28f {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 01:24:18 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-1bfce08d-85dd-4f41-ba8f-c1d969dee930 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Acquiring lock "ddfecefc-1e9b-4e6e-9995-855c8a061084" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:24:18 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-1bfce08d-85dd-4f41-ba8f-c1d969dee930 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Lock "ddfecefc-1e9b-4e6e-9995-855c8a061084" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:24:18 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-1bfce08d-85dd-4f41-ba8f-c1d969dee930 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Acquiring lock "ddfecefc-1e9b-4e6e-9995-855c8a061084-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:24:18 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-1bfce08d-85dd-4f41-ba8f-c1d969dee930 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Lock "ddfecefc-1e9b-4e6e-9995-855c8a061084-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:24:18 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-1bfce08d-85dd-4f41-ba8f-c1d969dee930 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Lock "ddfecefc-1e9b-4e6e-9995-855c8a061084-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:24:18 user nova-compute[75226]: INFO nova.compute.manager [None req-1bfce08d-85dd-4f41-ba8f-c1d969dee930 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] [instance: ddfecefc-1e9b-4e6e-9995-855c8a061084] Terminating instance
Nov 17 01:24:18 user nova-compute[75226]: DEBUG nova.compute.manager [None req-1bfce08d-85dd-4f41-ba8f-c1d969dee930 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] [instance: ddfecefc-1e9b-4e6e-9995-855c8a061084] Start destroying the instance on the hypervisor. {{(pid=75226) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 17 01:24:18 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:24:18 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:24:18 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:24:18 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:24:19 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:24:19 user nova-compute[75226]: DEBUG nova.network.neutron [req-8bac4dc2-37d3-4d47-ac02-38420d9d55b8 req-2bf28ade-963e-4db1-b53e-d2f7127b2907 service nova] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Updated VIF entry in instance network info cache for port 462b7d76-b8d0-4374-8b29-da083c4ec28f. {{(pid=75226) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 01:24:19 user nova-compute[75226]: DEBUG nova.network.neutron [req-8bac4dc2-37d3-4d47-ac02-38420d9d55b8 req-2bf28ade-963e-4db1-b53e-d2f7127b2907 service nova] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Updating instance_info_cache with network_info: [{"id": "462b7d76-b8d0-4374-8b29-da083c4ec28f", "address": "fa:16:3e:e5:9d:a6", "network": {"id": "3e4d69ef-0f6d-4d32-bcfa-0cae712a750e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1270397153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60fce4eef0d24de0a320670623085bb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap462b7d76-b8", "ovs_interfaceid": "462b7d76-b8d0-4374-8b29-da083c4ec28f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6bcf1322-1aad-4ffa-9231-7273376e4572", "address": "fa:16:3e:74:57:6e", "network": {"id": "a8dd3d50-aad0-4fe6-8986-98d0400bcaec", "bridge": "br-int", "label": "tempest-device-tagging-net1-1117474203", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.96", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "60fce4eef0d24de0a320670623085bb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bcf1322-1a", "ovs_interfaceid": "6bcf1322-1aad-4ffa-9231-7273376e4572", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fbacd963-6a62-4682-89a2-27f92a9f0ff2", "address": "fa:16:3e:34:dd:56", "network": {"id": "a8dd3d50-aad0-4fe6-8986-98d0400bcaec", "bridge": "br-int", "label": "tempest-device-tagging-net1-1117474203", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "60fce4eef0d24de0a320670623085bb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbacd963-6a", "ovs_interfaceid": "fbacd963-6a62-4682-89a2-27f92a9f0ff2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "46134046-ef40-4332-aa3f-044beaf6f991", "address": "fa:16:3e:d8:00:e9", "network": {"id": "a8dd3d50-aad0-4fe6-8986-98d0400bcaec", "bridge": "br-int", "label": "tempest-device-tagging-net1-1117474203", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "60fce4eef0d24de0a320670623085bb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46134046-ef", "ovs_interfaceid": "46134046-ef40-4332-aa3f-044beaf6f991", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "24888c49-a7a9-4f44-8f95-1174dba77750", "address": "fa:16:3e:38:2a:e5", "network": {"id": "a8dd3d50-aad0-4fe6-8986-98d0400bcaec", "bridge": "br-int", "label": "tempest-device-tagging-net1-1117474203", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "60fce4eef0d24de0a320670623085bb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24888c49-a7", "ovs_interfaceid": "24888c49-a7a9-4f44-8f95-1174dba77750", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5f7ca871-040f-460c-8709-7ca74ca282ba", "address": "fa:16:3e:4b:05:65", "network": {"id": "5cee0137-a429-434d-a7ce-0a8d2f9e41ea", "bridge": "br-int", "label": "tempest-device-tagging-net2-1427092874", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "60fce4eef0d24de0a320670623085bb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f7ca871-04", "ovs_interfaceid": "5f7ca871-040f-460c-8709-7ca74ca282ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "153c3e02-4aa9-4b9f-b03d-229f12e2ed68", "address": "fa:16:3e:a1:1f:ee", "network": {"id": "5cee0137-a429-434d-a7ce-0a8d2f9e41ea", "bridge": "br-int", "label": "tempest-device-tagging-net2-1427092874", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "60fce4eef0d24de0a320670623085bb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap153c3e02-4a", "ovs_interfaceid": "153c3e02-4aa9-4b9f-b03d-229f12e2ed68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:24:19 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-8bac4dc2-37d3-4d47-ac02-38420d9d55b8 req-2bf28ade-963e-4db1-b53e-d2f7127b2907 service nova] Releasing lock "refresh_cache-663933b0-95dc-4fba-b411-029f0552571d" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:24:19 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-dde3e683-0388-4a41-a371-fe136855fabc tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Acquiring lock "ee2187c9-8620-4fd2-ad8a-a054cd8393f3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:24:19 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-dde3e683-0388-4a41-a371-fe136855fabc tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Lock "ee2187c9-8620-4fd2-ad8a-a054cd8393f3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:24:19 user nova-compute[75226]: DEBUG nova.compute.manager [None req-dde3e683-0388-4a41-a371-fe136855fabc tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] [instance: ee2187c9-8620-4fd2-ad8a-a054cd8393f3] Starting instance... {{(pid=75226) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 17 01:24:19 user nova-compute[75226]: INFO nova.virt.libvirt.driver [-] [instance: ddfecefc-1e9b-4e6e-9995-855c8a061084] Instance destroyed successfully.
Nov 17 01:24:19 user nova-compute[75226]: DEBUG nova.objects.instance [None req-1bfce08d-85dd-4f41-ba8f-c1d969dee930 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Lazy-loading 'resources' on Instance uuid ddfecefc-1e9b-4e6e-9995-855c8a061084 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:24:19 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-dde3e683-0388-4a41-a371-fe136855fabc tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:24:19 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-dde3e683-0388-4a41-a371-fe136855fabc tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:24:19 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-dde3e683-0388-4a41-a371-fe136855fabc tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75226) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 17 01:24:19 user nova-compute[75226]: INFO nova.compute.claims [None req-dde3e683-0388-4a41-a371-fe136855fabc tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] [instance: ee2187c9-8620-4fd2-ad8a-a054cd8393f3] Claim successful on node user
Nov 17 01:24:19 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-1bfce08d-85dd-4f41-ba8f-c1d969dee930 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:17:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1305430160',display_name='tempest-ServerStableDeviceRescueTest-server-1305430160',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1305430160',id=3,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMpvCGoDARt2nfeOrZzYRwVyzyxP/aG4WAR20CLnxUZStgu3wTBvwojfCRlppCSQBs5b3NyOL+sqX0v7IlA3zj/BimKWwl8Hmvj+spsaJeKGpvZAX8jZPtApeiUgJwdeig==',key_name='tempest-keypair-904701876',keypairs=<?>,launch_index=0,launched_at=2023-11-17T01:21:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6869af66e0cc47bf9cca02ea9b688a6d',ramdisk_id='',reservation_id='r-oy7hjp6e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-358573654',owner_user_name='tempest-ServerStableDeviceRescueTest-358573654-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T01:23:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0a9b03e89f164c23a6e8e4d1b75ba07b',uuid=ddfecefc-1e9b-4e6e-9995-855c8a061084,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f9a7562b-de63-4374-b43b-18e3cb3af710", "address": "fa:16:3e:94:21:00", "network": {"id": "8450ab2c-4f24-46cc-a6ec-644c02e2b3da", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-385219532-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6869af66e0cc47bf9cca02ea9b688a6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9a7562b-de", "ovs_interfaceid": "f9a7562b-de63-4374-b43b-18e3cb3af710", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 17 01:24:19 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-1bfce08d-85dd-4f41-ba8f-c1d969dee930 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Converting VIF {"id": "f9a7562b-de63-4374-b43b-18e3cb3af710", "address": "fa:16:3e:94:21:00", "network": {"id": "8450ab2c-4f24-46cc-a6ec-644c02e2b3da", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-385219532-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6869af66e0cc47bf9cca02ea9b688a6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9a7562b-de", "ovs_interfaceid": "f9a7562b-de63-4374-b43b-18e3cb3af710", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:24:19 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-1bfce08d-85dd-4f41-ba8f-c1d969dee930 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:94:21:00,bridge_name='br-int',has_traffic_filtering=True,id=f9a7562b-de63-4374-b43b-18e3cb3af710,network=Network(8450ab2c-4f24-46cc-a6ec-644c02e2b3da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9a7562b-de') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:24:19 user nova-compute[75226]: DEBUG os_vif [None req-1bfce08d-85dd-4f41-ba8f-c1d969dee930 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:94:21:00,bridge_name='br-int',has_traffic_filtering=True,id=f9a7562b-de63-4374-b43b-18e3cb3af710,network=Network(8450ab2c-4f24-46cc-a6ec-644c02e2b3da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9a7562b-de') {{(pid=75226) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 17 01:24:19 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:24:19 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf9a7562b-de, bridge=br-int, if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:24:19 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:24:19 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:24:19 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:24:19 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:24:19 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6e27b8bd-397b-41ac-80ba-5df9a7ede753) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:24:19 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:24:19 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:24:19 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:24:19 user nova-compute[75226]: INFO os_vif [None req-1bfce08d-85dd-4f41-ba8f-c1d969dee930 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:94:21:00,bridge_name='br-int',has_traffic_filtering=True,id=f9a7562b-de63-4374-b43b-18e3cb3af710,network=Network(8450ab2c-4f24-46cc-a6ec-644c02e2b3da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9a7562b-de')
Nov 17 01:24:19 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-1bfce08d-85dd-4f41-ba8f-c1d969dee930 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] [instance: ddfecefc-1e9b-4e6e-9995-855c8a061084] Deleting instance files /opt/stack/data/nova/instances/ddfecefc-1e9b-4e6e-9995-855c8a061084_del
Nov 17 01:24:19 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-1bfce08d-85dd-4f41-ba8f-c1d969dee930 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] [instance: ddfecefc-1e9b-4e6e-9995-855c8a061084] Deletion of /opt/stack/data/nova/instances/ddfecefc-1e9b-4e6e-9995-855c8a061084_del complete
Nov 17 01:24:19 user nova-compute[75226]: INFO nova.compute.manager [None req-1bfce08d-85dd-4f41-ba8f-c1d969dee930 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] [instance: ddfecefc-1e9b-4e6e-9995-855c8a061084] Took 1.12 seconds to destroy the instance on the hypervisor.
Nov 17 01:24:19 user nova-compute[75226]: DEBUG oslo.service.loopingcall [None req-1bfce08d-85dd-4f41-ba8f-c1d969dee930 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75226) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 17 01:24:19 user nova-compute[75226]: DEBUG nova.compute.manager [-] [instance: ddfecefc-1e9b-4e6e-9995-855c8a061084] Deallocating network for instance {{(pid=75226) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 17 01:24:19 user nova-compute[75226]: DEBUG nova.network.neutron [-] [instance: ddfecefc-1e9b-4e6e-9995-855c8a061084] deallocate_for_instance() {{(pid=75226) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 17 01:24:19 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-dde3e683-0388-4a41-a371-fe136855fabc tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:24:19 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-dde3e683-0388-4a41-a371-fe136855fabc tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:24:20 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-dde3e683-0388-4a41-a371-fe136855fabc tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.418s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:24:20 user nova-compute[75226]: DEBUG nova.compute.manager [None req-dde3e683-0388-4a41-a371-fe136855fabc tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] [instance: ee2187c9-8620-4fd2-ad8a-a054cd8393f3] Start building networks asynchronously for instance. {{(pid=75226) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 17 01:24:20 user nova-compute[75226]: DEBUG nova.compute.manager [None req-dde3e683-0388-4a41-a371-fe136855fabc tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] [instance: ee2187c9-8620-4fd2-ad8a-a054cd8393f3] Allocating IP information in the background. {{(pid=75226) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 17 01:24:20 user nova-compute[75226]: DEBUG nova.network.neutron [None req-dde3e683-0388-4a41-a371-fe136855fabc tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] [instance: ee2187c9-8620-4fd2-ad8a-a054cd8393f3] allocate_for_instance() {{(pid=75226) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 17 01:24:20 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-dde3e683-0388-4a41-a371-fe136855fabc tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] [instance: ee2187c9-8620-4fd2-ad8a-a054cd8393f3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 17 01:24:20 user nova-compute[75226]: DEBUG nova.compute.manager [None req-dde3e683-0388-4a41-a371-fe136855fabc tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] [instance: ee2187c9-8620-4fd2-ad8a-a054cd8393f3] Start building block device mappings for instance. {{(pid=75226) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 17 01:24:20 user nova-compute[75226]: DEBUG nova.policy [None req-dde3e683-0388-4a41-a371-fe136855fabc tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f0952a7e2dd64bf2adb2e224965377ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c19f767dc7bb4024b3cbf1d8f5f8f2bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75226) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 17 01:24:20 user nova-compute[75226]: DEBUG nova.compute.manager [None req-dde3e683-0388-4a41-a371-fe136855fabc tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] [instance: ee2187c9-8620-4fd2-ad8a-a054cd8393f3] Start spawning the instance on the hypervisor. {{(pid=75226) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 17 01:24:20 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-dde3e683-0388-4a41-a371-fe136855fabc tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] [instance: ee2187c9-8620-4fd2-ad8a-a054cd8393f3] Creating instance directory {{(pid=75226) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 17 01:24:20 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-dde3e683-0388-4a41-a371-fe136855fabc tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] [instance: ee2187c9-8620-4fd2-ad8a-a054cd8393f3] Creating image(s)
Nov 17 01:24:20 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-dde3e683-0388-4a41-a371-fe136855fabc tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Acquiring lock "/opt/stack/data/nova/instances/ee2187c9-8620-4fd2-ad8a-a054cd8393f3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:24:20 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-dde3e683-0388-4a41-a371-fe136855fabc tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Lock "/opt/stack/data/nova/instances/ee2187c9-8620-4fd2-ad8a-a054cd8393f3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:24:20 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-dde3e683-0388-4a41-a371-fe136855fabc tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Lock "/opt/stack/data/nova/instances/ee2187c9-8620-4fd2-ad8a-a054cd8393f3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:24:20 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-dde3e683-0388-4a41-a371-fe136855fabc tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:24:20 user nova-compute[75226]: DEBUG nova.compute.manager [req-6b1e4c5b-1072-46df-b038-82f4c0b90a33 req-224e62e6-2ef3-46b0-b379-c7d092afe550 service nova] [instance: ddfecefc-1e9b-4e6e-9995-855c8a061084] Received event network-vif-unplugged-f9a7562b-de63-4374-b43b-18e3cb3af710 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:24:20 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-6b1e4c5b-1072-46df-b038-82f4c0b90a33 req-224e62e6-2ef3-46b0-b379-c7d092afe550 service nova] Acquiring lock "ddfecefc-1e9b-4e6e-9995-855c8a061084-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:24:20 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-6b1e4c5b-1072-46df-b038-82f4c0b90a33 req-224e62e6-2ef3-46b0-b379-c7d092afe550 service nova] Lock "ddfecefc-1e9b-4e6e-9995-855c8a061084-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:24:20 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-6b1e4c5b-1072-46df-b038-82f4c0b90a33 req-224e62e6-2ef3-46b0-b379-c7d092afe550 service nova] Lock "ddfecefc-1e9b-4e6e-9995-855c8a061084-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:24:20 user nova-compute[75226]: DEBUG nova.compute.manager [req-6b1e4c5b-1072-46df-b038-82f4c0b90a33 req-224e62e6-2ef3-46b0-b379-c7d092afe550 service nova] [instance: ddfecefc-1e9b-4e6e-9995-855c8a061084] No waiting events found dispatching network-vif-unplugged-f9a7562b-de63-4374-b43b-18e3cb3af710 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:24:20 user nova-compute[75226]: DEBUG nova.compute.manager [req-6b1e4c5b-1072-46df-b038-82f4c0b90a33 req-224e62e6-2ef3-46b0-b379-c7d092afe550 service nova] [instance: ddfecefc-1e9b-4e6e-9995-855c8a061084] Received event network-vif-unplugged-f9a7562b-de63-4374-b43b-18e3cb3af710 for instance with task_state deleting. {{(pid=75226) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 17 01:24:20 user nova-compute[75226]: DEBUG nova.compute.manager [req-6b1e4c5b-1072-46df-b038-82f4c0b90a33 req-224e62e6-2ef3-46b0-b379-c7d092afe550 service nova] [instance: ddfecefc-1e9b-4e6e-9995-855c8a061084] Received event network-vif-plugged-f9a7562b-de63-4374-b43b-18e3cb3af710 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:24:20 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-6b1e4c5b-1072-46df-b038-82f4c0b90a33 req-224e62e6-2ef3-46b0-b379-c7d092afe550 service nova] Acquiring lock "ddfecefc-1e9b-4e6e-9995-855c8a061084-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:24:20 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-6b1e4c5b-1072-46df-b038-82f4c0b90a33 req-224e62e6-2ef3-46b0-b379-c7d092afe550 service nova] Lock "ddfecefc-1e9b-4e6e-9995-855c8a061084-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:24:20 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-6b1e4c5b-1072-46df-b038-82f4c0b90a33 req-224e62e6-2ef3-46b0-b379-c7d092afe550 service nova] Lock "ddfecefc-1e9b-4e6e-9995-855c8a061084-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:24:20 user nova-compute[75226]: DEBUG nova.compute.manager [req-6b1e4c5b-1072-46df-b038-82f4c0b90a33 req-224e62e6-2ef3-46b0-b379-c7d092afe550 service nova] [instance: ddfecefc-1e9b-4e6e-9995-855c8a061084] No waiting events found dispatching network-vif-plugged-f9a7562b-de63-4374-b43b-18e3cb3af710 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:24:20 user nova-compute[75226]: WARNING nova.compute.manager [req-6b1e4c5b-1072-46df-b038-82f4c0b90a33 req-224e62e6-2ef3-46b0-b379-c7d092afe550 service nova] [instance: ddfecefc-1e9b-4e6e-9995-855c8a061084] Received unexpected event network-vif-plugged-f9a7562b-de63-4374-b43b-18e3cb3af710 for instance with vm_state active and task_state deleting.
Nov 17 01:24:20 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-dde3e683-0388-4a41-a371-fe136855fabc tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json" returned: 0 in 0.187s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:24:20 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-dde3e683-0388-4a41-a371-fe136855fabc tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Acquiring lock "a8a62c2546af3a2036b853250c5ac64d4c6b4371" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:24:20 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-dde3e683-0388-4a41-a371-fe136855fabc tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Lock "a8a62c2546af3a2036b853250c5ac64d4c6b4371" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:24:20 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-dde3e683-0388-4a41-a371-fe136855fabc tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:24:20 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-dde3e683-0388-4a41-a371-fe136855fabc tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json" returned: 0 in 0.171s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:24:20 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-dde3e683-0388-4a41-a371-fe136855fabc tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371,backing_fmt=raw /opt/stack/data/nova/instances/ee2187c9-8620-4fd2-ad8a-a054cd8393f3/disk 1073741824 {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:24:20 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-dde3e683-0388-4a41-a371-fe136855fabc tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371,backing_fmt=raw /opt/stack/data/nova/instances/ee2187c9-8620-4fd2-ad8a-a054cd8393f3/disk 1073741824" returned: 0 in 0.048s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:24:20 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-dde3e683-0388-4a41-a371-fe136855fabc tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Lock "a8a62c2546af3a2036b853250c5ac64d4c6b4371" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.225s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:24:20 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-dde3e683-0388-4a41-a371-fe136855fabc tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:24:20 user nova-compute[75226]: DEBUG nova.network.neutron [-] [instance: ddfecefc-1e9b-4e6e-9995-855c8a061084] Updating instance_info_cache with network_info: [] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:24:20 user nova-compute[75226]: DEBUG nova.compute.manager [req-d3deae84-9537-4239-81f5-66f3f5c9bf51 req-b6f9df01-66b5-499e-8b3c-2d2bb1413cba service nova] [instance: ddfecefc-1e9b-4e6e-9995-855c8a061084] Received event network-vif-deleted-f9a7562b-de63-4374-b43b-18e3cb3af710 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:24:20 user nova-compute[75226]: INFO nova.compute.manager [req-d3deae84-9537-4239-81f5-66f3f5c9bf51 req-b6f9df01-66b5-499e-8b3c-2d2bb1413cba service nova] [instance: ddfecefc-1e9b-4e6e-9995-855c8a061084] Neutron deleted interface f9a7562b-de63-4374-b43b-18e3cb3af710; detaching it from the instance and deleting it from the info cache
Nov 17 01:24:20 user nova-compute[75226]: DEBUG nova.network.neutron [req-d3deae84-9537-4239-81f5-66f3f5c9bf51 req-b6f9df01-66b5-499e-8b3c-2d2bb1413cba service nova] [instance: ddfecefc-1e9b-4e6e-9995-855c8a061084] Updating instance_info_cache with network_info: [] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:24:20 user nova-compute[75226]: INFO nova.compute.manager [-] [instance: ddfecefc-1e9b-4e6e-9995-855c8a061084] Took 1.15 seconds to deallocate network for instance.
Nov 17 01:24:20 user nova-compute[75226]: DEBUG nova.compute.manager [req-d3deae84-9537-4239-81f5-66f3f5c9bf51 req-b6f9df01-66b5-499e-8b3c-2d2bb1413cba service nova] [instance: ddfecefc-1e9b-4e6e-9995-855c8a061084] Detach interface failed, port_id=f9a7562b-de63-4374-b43b-18e3cb3af710, reason: Instance ddfecefc-1e9b-4e6e-9995-855c8a061084 could not be found. {{(pid=75226) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 17 01:24:20 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-1bfce08d-85dd-4f41-ba8f-c1d969dee930 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:24:20 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-1bfce08d-85dd-4f41-ba8f-c1d969dee930 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:24:21 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-dde3e683-0388-4a41-a371-fe136855fabc tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json" returned: 0 in 0.214s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:24:21 user nova-compute[75226]: DEBUG nova.virt.disk.api [None req-dde3e683-0388-4a41-a371-fe136855fabc tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ee2187c9-8620-4fd2-ad8a-a054cd8393f3/disk. size=1073741824 {{(pid=75226) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 17 01:24:21 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-dde3e683-0388-4a41-a371-fe136855fabc tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee2187c9-8620-4fd2-ad8a-a054cd8393f3/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:24:21 user nova-compute[75226]: DEBUG nova.network.neutron [None req-dde3e683-0388-4a41-a371-fe136855fabc tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] [instance: ee2187c9-8620-4fd2-ad8a-a054cd8393f3] Successfully created port: 1057ea4c-2ac4-40fa-8b2e-3b5888ea4d61 {{(pid=75226) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 17 01:24:21 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-dde3e683-0388-4a41-a371-fe136855fabc tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee2187c9-8620-4fd2-ad8a-a054cd8393f3/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:24:21 user nova-compute[75226]: DEBUG nova.virt.disk.api [None req-dde3e683-0388-4a41-a371-fe136855fabc tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Cannot resize image /opt/stack/data/nova/instances/ee2187c9-8620-4fd2-ad8a-a054cd8393f3/disk to a smaller size. {{(pid=75226) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 17 01:24:21 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-dde3e683-0388-4a41-a371-fe136855fabc tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] [instance: ee2187c9-8620-4fd2-ad8a-a054cd8393f3] Created local disks {{(pid=75226) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 17 01:24:21 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-dde3e683-0388-4a41-a371-fe136855fabc tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] [instance: ee2187c9-8620-4fd2-ad8a-a054cd8393f3] Ensure instance console log exists: /opt/stack/data/nova/instances/ee2187c9-8620-4fd2-ad8a-a054cd8393f3/console.log {{(pid=75226) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 17 01:24:21 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-dde3e683-0388-4a41-a371-fe136855fabc tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:24:21 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-dde3e683-0388-4a41-a371-fe136855fabc tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:24:21 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-dde3e683-0388-4a41-a371-fe136855fabc tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:24:21 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-1bfce08d-85dd-4f41-ba8f-c1d969dee930 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:24:21 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-1bfce08d-85dd-4f41-ba8f-c1d969dee930 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:24:21 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-1bfce08d-85dd-4f41-ba8f-c1d969dee930 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.454s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:24:21 user nova-compute[75226]: INFO nova.scheduler.client.report [None req-1bfce08d-85dd-4f41-ba8f-c1d969dee930 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Deleted allocations for instance ddfecefc-1e9b-4e6e-9995-855c8a061084
Nov 17 01:24:21 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-1e6637d7-5c42-47de-91ed-60a369b68ff3 tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Acquiring lock "663933b0-95dc-4fba-b411-029f0552571d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:24:21 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-1e6637d7-5c42-47de-91ed-60a369b68ff3 tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Lock "663933b0-95dc-4fba-b411-029f0552571d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:24:21 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-1e6637d7-5c42-47de-91ed-60a369b68ff3 tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Acquiring lock "663933b0-95dc-4fba-b411-029f0552571d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:24:21 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-1e6637d7-5c42-47de-91ed-60a369b68ff3 tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Lock "663933b0-95dc-4fba-b411-029f0552571d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:24:21 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-1e6637d7-5c42-47de-91ed-60a369b68ff3 tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Lock "663933b0-95dc-4fba-b411-029f0552571d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:24:21 user nova-compute[75226]: INFO nova.compute.manager [None req-1e6637d7-5c42-47de-91ed-60a369b68ff3 tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Terminating instance
Nov 17 01:24:21 user nova-compute[75226]: DEBUG nova.compute.manager [None req-1e6637d7-5c42-47de-91ed-60a369b68ff3 tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Start destroying the instance on the hypervisor. {{(pid=75226) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 17 01:24:21 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-1bfce08d-85dd-4f41-ba8f-c1d969dee930 tempest-ServerStableDeviceRescueTest-358573654 tempest-ServerStableDeviceRescueTest-358573654-project-member] Lock "ddfecefc-1e9b-4e6e-9995-855c8a061084" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.946s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:24:21 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:24:21 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:24:21 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:24:21 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:24:21 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:24:21 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:24:21 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:24:22 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:24:22 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:24:22 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:24:22 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:24:22 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:24:22 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:24:22 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:24:22 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:24:22 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:24:22 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:24:22 user nova-compute[75226]: DEBUG nova.compute.manager [req-f0830ff3-950b-467a-9429-f0cf70bf3de7 req-37110f4b-3558-4f50-91f1-4ca1a855a5b5 service nova] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Received event network-vif-unplugged-6bcf1322-1aad-4ffa-9231-7273376e4572 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:24:22 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-f0830ff3-950b-467a-9429-f0cf70bf3de7 req-37110f4b-3558-4f50-91f1-4ca1a855a5b5 service nova] Acquiring lock "663933b0-95dc-4fba-b411-029f0552571d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:24:22 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-f0830ff3-950b-467a-9429-f0cf70bf3de7 req-37110f4b-3558-4f50-91f1-4ca1a855a5b5 service nova] Lock "663933b0-95dc-4fba-b411-029f0552571d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:24:22 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-f0830ff3-950b-467a-9429-f0cf70bf3de7 req-37110f4b-3558-4f50-91f1-4ca1a855a5b5 service nova] Lock "663933b0-95dc-4fba-b411-029f0552571d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:24:22 user nova-compute[75226]: DEBUG nova.compute.manager [req-f0830ff3-950b-467a-9429-f0cf70bf3de7 req-37110f4b-3558-4f50-91f1-4ca1a855a5b5 service nova] [instance: 663933b0-95dc-4fba-b411-029f0552571d] No waiting events found dispatching network-vif-unplugged-6bcf1322-1aad-4ffa-9231-7273376e4572 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:24:22 user nova-compute[75226]: DEBUG nova.compute.manager [req-f0830ff3-950b-467a-9429-f0cf70bf3de7 req-37110f4b-3558-4f50-91f1-4ca1a855a5b5 service nova] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Received event network-vif-unplugged-6bcf1322-1aad-4ffa-9231-7273376e4572 for instance with task_state deleting. {{(pid=75226) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 17 01:24:22 user nova-compute[75226]: DEBUG nova.compute.manager [req-f0830ff3-950b-467a-9429-f0cf70bf3de7 req-37110f4b-3558-4f50-91f1-4ca1a855a5b5 service nova] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Received event network-vif-plugged-6bcf1322-1aad-4ffa-9231-7273376e4572 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:24:22 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-f0830ff3-950b-467a-9429-f0cf70bf3de7 req-37110f4b-3558-4f50-91f1-4ca1a855a5b5 service nova] Acquiring lock "663933b0-95dc-4fba-b411-029f0552571d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:24:22 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-f0830ff3-950b-467a-9429-f0cf70bf3de7 req-37110f4b-3558-4f50-91f1-4ca1a855a5b5 service nova] Lock "663933b0-95dc-4fba-b411-029f0552571d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:24:22 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-f0830ff3-950b-467a-9429-f0cf70bf3de7 req-37110f4b-3558-4f50-91f1-4ca1a855a5b5 service nova] Lock "663933b0-95dc-4fba-b411-029f0552571d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:24:22 user nova-compute[75226]: DEBUG nova.compute.manager [req-f0830ff3-950b-467a-9429-f0cf70bf3de7 req-37110f4b-3558-4f50-91f1-4ca1a855a5b5 service nova] [instance: 663933b0-95dc-4fba-b411-029f0552571d] No waiting events found dispatching network-vif-plugged-6bcf1322-1aad-4ffa-9231-7273376e4572 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:24:22 user nova-compute[75226]: WARNING nova.compute.manager [req-f0830ff3-950b-467a-9429-f0cf70bf3de7 req-37110f4b-3558-4f50-91f1-4ca1a855a5b5 service nova] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Received unexpected event network-vif-plugged-6bcf1322-1aad-4ffa-9231-7273376e4572 for instance with vm_state active and task_state deleting.
Nov 17 01:24:22 user nova-compute[75226]: DEBUG nova.compute.manager [req-f0830ff3-950b-467a-9429-f0cf70bf3de7 req-37110f4b-3558-4f50-91f1-4ca1a855a5b5 service nova] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Received event network-vif-unplugged-46134046-ef40-4332-aa3f-044beaf6f991 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:24:22 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-f0830ff3-950b-467a-9429-f0cf70bf3de7 req-37110f4b-3558-4f50-91f1-4ca1a855a5b5 service nova] Acquiring lock "663933b0-95dc-4fba-b411-029f0552571d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:24:22 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-f0830ff3-950b-467a-9429-f0cf70bf3de7 req-37110f4b-3558-4f50-91f1-4ca1a855a5b5 service nova] Lock "663933b0-95dc-4fba-b411-029f0552571d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:24:22 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-f0830ff3-950b-467a-9429-f0cf70bf3de7 req-37110f4b-3558-4f50-91f1-4ca1a855a5b5 service nova] Lock "663933b0-95dc-4fba-b411-029f0552571d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:24:22 user nova-compute[75226]: DEBUG nova.compute.manager [req-f0830ff3-950b-467a-9429-f0cf70bf3de7 req-37110f4b-3558-4f50-91f1-4ca1a855a5b5 service nova] [instance: 663933b0-95dc-4fba-b411-029f0552571d] No waiting events found dispatching network-vif-unplugged-46134046-ef40-4332-aa3f-044beaf6f991 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:24:22 user nova-compute[75226]: DEBUG nova.compute.manager [req-f0830ff3-950b-467a-9429-f0cf70bf3de7 req-37110f4b-3558-4f50-91f1-4ca1a855a5b5 service nova] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Received event network-vif-unplugged-46134046-ef40-4332-aa3f-044beaf6f991 for instance with task_state deleting. {{(pid=75226) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 17 01:24:22 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:24:22 user nova-compute[75226]: DEBUG nova.network.neutron [None req-dde3e683-0388-4a41-a371-fe136855fabc tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] [instance: ee2187c9-8620-4fd2-ad8a-a054cd8393f3] Successfully updated port: 1057ea4c-2ac4-40fa-8b2e-3b5888ea4d61 {{(pid=75226) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 17 01:24:22 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-dde3e683-0388-4a41-a371-fe136855fabc tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Acquiring lock "refresh_cache-ee2187c9-8620-4fd2-ad8a-a054cd8393f3" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:24:22 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-dde3e683-0388-4a41-a371-fe136855fabc tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Acquired lock "refresh_cache-ee2187c9-8620-4fd2-ad8a-a054cd8393f3" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:24:22 user nova-compute[75226]: DEBUG nova.network.neutron [None req-dde3e683-0388-4a41-a371-fe136855fabc tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] [instance: ee2187c9-8620-4fd2-ad8a-a054cd8393f3] Building network info cache for instance {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 01:24:22 user nova-compute[75226]: DEBUG nova.compute.manager [req-e6e7577e-7c9f-4b33-a52a-576516bf425f req-6be1bc0e-84d1-4348-858f-7bab4e5d76a1 service nova] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Received event network-vif-unplugged-5f7ca871-040f-460c-8709-7ca74ca282ba {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:24:22 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-e6e7577e-7c9f-4b33-a52a-576516bf425f req-6be1bc0e-84d1-4348-858f-7bab4e5d76a1 service nova] Acquiring lock "663933b0-95dc-4fba-b411-029f0552571d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:24:22 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-e6e7577e-7c9f-4b33-a52a-576516bf425f req-6be1bc0e-84d1-4348-858f-7bab4e5d76a1 service nova] Lock "663933b0-95dc-4fba-b411-029f0552571d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:24:22 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-e6e7577e-7c9f-4b33-a52a-576516bf425f req-6be1bc0e-84d1-4348-858f-7bab4e5d76a1 service nova] Lock "663933b0-95dc-4fba-b411-029f0552571d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:24:22 user nova-compute[75226]: DEBUG nova.compute.manager [req-e6e7577e-7c9f-4b33-a52a-576516bf425f req-6be1bc0e-84d1-4348-858f-7bab4e5d76a1 service nova] [instance: 663933b0-95dc-4fba-b411-029f0552571d] No waiting events found dispatching network-vif-unplugged-5f7ca871-040f-460c-8709-7ca74ca282ba {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:24:22 user nova-compute[75226]: DEBUG nova.compute.manager [req-e6e7577e-7c9f-4b33-a52a-576516bf425f req-6be1bc0e-84d1-4348-858f-7bab4e5d76a1 service nova] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Received event network-vif-unplugged-5f7ca871-040f-460c-8709-7ca74ca282ba for instance with task_state deleting. {{(pid=75226) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 17 01:24:22 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:24:22 user nova-compute[75226]: DEBUG nova.network.neutron [None req-dde3e683-0388-4a41-a371-fe136855fabc tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] [instance: ee2187c9-8620-4fd2-ad8a-a054cd8393f3] Instance cache missing network info. {{(pid=75226) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 17 01:24:22 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:24:22 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:24:22 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:24:23 user nova-compute[75226]: INFO nova.virt.libvirt.driver [-] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Instance destroyed successfully.
Nov 17 01:24:23 user nova-compute[75226]: DEBUG nova.objects.instance [None req-1e6637d7-5c42-47de-91ed-60a369b68ff3 tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Lazy-loading 'resources' on Instance uuid 663933b0-95dc-4fba-b411-029f0552571d {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:24:23 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-1e6637d7-5c42-47de-91ed-60a369b68ff3 tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-17T01:22:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1270422690',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1270422690',id=18,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFadtk54Tkvk6AHpu0dnlPf3MeX++Xu/axCXDSKF9N/sLaR9IMdsD+WpKf3bG29Bs36DoaNYGITDbnkh7PpUjSy8pAnsUxMlIERAERRQjtXzSRjHfrt6XPTg8j13L2IqSQ==',key_name='tempest-keypair-1791766942',keypairs=<?>,launch_index=0,launched_at=2023-11-17T01:23:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='60fce4eef0d24de0a320670623085bb6',ramdisk_id='',reservation_id='r-w2e090td',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1246897470',owner_user_name='tempest-TaggedBootDevicesTest_v242-1246897470-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T01:23:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='85f6f2dd0ff44b33874cde7e2e36482c',uuid=663933b0-95dc-4fba-b411-029f0552571d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "462b7d76-b8d0-4374-8b29-da083c4ec28f", "address": "fa:16:3e:e5:9d:a6", "network": {"id": "3e4d69ef-0f6d-4d32-bcfa-0cae712a750e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1270397153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60fce4eef0d24de0a320670623085bb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap462b7d76-b8", "ovs_interfaceid": "462b7d76-b8d0-4374-8b29-da083c4ec28f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 17 01:24:23 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-1e6637d7-5c42-47de-91ed-60a369b68ff3 tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Converting VIF {"id": "462b7d76-b8d0-4374-8b29-da083c4ec28f", "address": "fa:16:3e:e5:9d:a6", "network": {"id": "3e4d69ef-0f6d-4d32-bcfa-0cae712a750e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1270397153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60fce4eef0d24de0a320670623085bb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap462b7d76-b8", "ovs_interfaceid": "462b7d76-b8d0-4374-8b29-da083c4ec28f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:24:23 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-1e6637d7-5c42-47de-91ed-60a369b68ff3 tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e5:9d:a6,bridge_name='br-int',has_traffic_filtering=True,id=462b7d76-b8d0-4374-8b29-da083c4ec28f,network=Network(3e4d69ef-0f6d-4d32-bcfa-0cae712a750e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap462b7d76-b8') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:24:23 user nova-compute[75226]: DEBUG os_vif [None req-1e6637d7-5c42-47de-91ed-60a369b68ff3 tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e5:9d:a6,bridge_name='br-int',has_traffic_filtering=True,id=462b7d76-b8d0-4374-8b29-da083c4ec28f,network=Network(3e4d69ef-0f6d-4d32-bcfa-0cae712a750e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap462b7d76-b8') {{(pid=75226) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 17 01:24:23 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:24:23 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap462b7d76-b8, bridge=br-int, if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:24:23 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:24:23 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:24:23 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:24:23 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:24:23 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9fc1f200-e204-478d-aa4e-b6e8ff1935be) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:24:23 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:24:23 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:24:23 user nova-compute[75226]: DEBUG nova.compute.manager [req-c050ca7d-abed-437c-8f16-404755931974 req-e33be8d3-c88f-47a3-95cb-2858e7e5d98b service nova] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Received event network-vif-unplugged-462b7d76-b8d0-4374-8b29-da083c4ec28f {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:24:23 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-c050ca7d-abed-437c-8f16-404755931974 req-e33be8d3-c88f-47a3-95cb-2858e7e5d98b service nova] Acquiring lock "663933b0-95dc-4fba-b411-029f0552571d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:24:23 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-c050ca7d-abed-437c-8f16-404755931974 req-e33be8d3-c88f-47a3-95cb-2858e7e5d98b service nova] Lock "663933b0-95dc-4fba-b411-029f0552571d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:24:23 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-c050ca7d-abed-437c-8f16-404755931974 req-e33be8d3-c88f-47a3-95cb-2858e7e5d98b service nova] Lock "663933b0-95dc-4fba-b411-029f0552571d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:24:23 user nova-compute[75226]: DEBUG nova.compute.manager [req-c050ca7d-abed-437c-8f16-404755931974 req-e33be8d3-c88f-47a3-95cb-2858e7e5d98b service nova] [instance: 663933b0-95dc-4fba-b411-029f0552571d] No waiting events found dispatching network-vif-unplugged-462b7d76-b8d0-4374-8b29-da083c4ec28f {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:24:23 user nova-compute[75226]: DEBUG nova.compute.manager [req-c050ca7d-abed-437c-8f16-404755931974 req-e33be8d3-c88f-47a3-95cb-2858e7e5d98b service nova] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Received event network-vif-unplugged-462b7d76-b8d0-4374-8b29-da083c4ec28f for instance with task_state deleting. {{(pid=75226) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 17 01:24:23 user nova-compute[75226]: DEBUG nova.compute.manager [req-c050ca7d-abed-437c-8f16-404755931974 req-e33be8d3-c88f-47a3-95cb-2858e7e5d98b service nova] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Received event network-vif-plugged-462b7d76-b8d0-4374-8b29-da083c4ec28f {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:24:23 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-c050ca7d-abed-437c-8f16-404755931974 req-e33be8d3-c88f-47a3-95cb-2858e7e5d98b service nova] Acquiring lock "663933b0-95dc-4fba-b411-029f0552571d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:24:23 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-c050ca7d-abed-437c-8f16-404755931974 req-e33be8d3-c88f-47a3-95cb-2858e7e5d98b service nova] Lock "663933b0-95dc-4fba-b411-029f0552571d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:24:23 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-c050ca7d-abed-437c-8f16-404755931974 req-e33be8d3-c88f-47a3-95cb-2858e7e5d98b service nova] Lock "663933b0-95dc-4fba-b411-029f0552571d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:24:23 user nova-compute[75226]: DEBUG nova.compute.manager [req-c050ca7d-abed-437c-8f16-404755931974 req-e33be8d3-c88f-47a3-95cb-2858e7e5d98b service nova] [instance: 663933b0-95dc-4fba-b411-029f0552571d] No waiting events found dispatching network-vif-plugged-462b7d76-b8d0-4374-8b29-da083c4ec28f {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:24:23 user nova-compute[75226]: WARNING nova.compute.manager [req-c050ca7d-abed-437c-8f16-404755931974 req-e33be8d3-c88f-47a3-95cb-2858e7e5d98b service nova] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Received unexpected event network-vif-plugged-462b7d76-b8d0-4374-8b29-da083c4ec28f for instance with vm_state active and task_state deleting.
Nov 17 01:24:23 user nova-compute[75226]: DEBUG nova.compute.manager [req-c050ca7d-abed-437c-8f16-404755931974 req-e33be8d3-c88f-47a3-95cb-2858e7e5d98b service nova] [instance: ee2187c9-8620-4fd2-ad8a-a054cd8393f3] Received event network-changed-1057ea4c-2ac4-40fa-8b2e-3b5888ea4d61 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:24:23 user nova-compute[75226]: DEBUG nova.compute.manager [req-c050ca7d-abed-437c-8f16-404755931974 req-e33be8d3-c88f-47a3-95cb-2858e7e5d98b service nova] [instance: ee2187c9-8620-4fd2-ad8a-a054cd8393f3] Refreshing instance network info cache due to event network-changed-1057ea4c-2ac4-40fa-8b2e-3b5888ea4d61. {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 01:24:23 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-c050ca7d-abed-437c-8f16-404755931974 req-e33be8d3-c88f-47a3-95cb-2858e7e5d98b service nova] Acquiring lock "refresh_cache-ee2187c9-8620-4fd2-ad8a-a054cd8393f3" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:24:23 user nova-compute[75226]: DEBUG nova.network.neutron [None req-dde3e683-0388-4a41-a371-fe136855fabc tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] [instance: ee2187c9-8620-4fd2-ad8a-a054cd8393f3] Updating instance_info_cache with network_info: [{"id": "1057ea4c-2ac4-40fa-8b2e-3b5888ea4d61", "address": "fa:16:3e:4a:f5:8f", "network": {"id": "3d8c3322-c78d-4d3a-b8c7-ba12241b4c65", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1996535656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c19f767dc7bb4024b3cbf1d8f5f8f2bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1057ea4c-2a", "ovs_interfaceid": "1057ea4c-2ac4-40fa-8b2e-3b5888ea4d61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:24:23 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:24:23 user nova-compute[75226]: INFO os_vif [None req-1e6637d7-5c42-47de-91ed-60a369b68ff3 tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e5:9d:a6,bridge_name='br-int',has_traffic_filtering=True,id=462b7d76-b8d0-4374-8b29-da083c4ec28f,network=Network(3e4d69ef-0f6d-4d32-bcfa-0cae712a750e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap462b7d76-b8')
Nov 17 01:24:23 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-1e6637d7-5c42-47de-91ed-60a369b68ff3 tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-17T01:22:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1270422690',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1270422690',id=18,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFadtk54Tkvk6AHpu0dnlPf3MeX++Xu/axCXDSKF9N/sLaR9IMdsD+WpKf3bG29Bs36DoaNYGITDbnkh7PpUjSy8pAnsUxMlIERAERRQjtXzSRjHfrt6XPTg8j13L2IqSQ==',key_name='tempest-keypair-1791766942',keypairs=<?>,launch_index=0,launched_at=2023-11-17T01:23:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='60fce4eef0d24de0a320670623085bb6',ramdisk_id='',reservation_id='r-w2e090td',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1246897470',owner_user_name='tempest-TaggedBootDevicesTest_v242-1246897470-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T01:23:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='85f6f2dd0ff44b33874cde7e2e36482c',uuid=663933b0-95dc-4fba-b411-029f0552571d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6bcf1322-1aad-4ffa-9231-7273376e4572", "address": "fa:16:3e:74:57:6e", "network": {"id": "a8dd3d50-aad0-4fe6-8986-98d0400bcaec", "bridge": "br-int", "label": "tempest-device-tagging-net1-1117474203", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.96", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "60fce4eef0d24de0a320670623085bb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bcf1322-1a", "ovs_interfaceid": "6bcf1322-1aad-4ffa-9231-7273376e4572", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75226) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 17 01:24:23 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-1e6637d7-5c42-47de-91ed-60a369b68ff3 tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Converting VIF {"id": "6bcf1322-1aad-4ffa-9231-7273376e4572", "address": "fa:16:3e:74:57:6e", "network": {"id": "a8dd3d50-aad0-4fe6-8986-98d0400bcaec", "bridge": "br-int", "label": "tempest-device-tagging-net1-1117474203", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.96", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "60fce4eef0d24de0a320670623085bb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bcf1322-1a", "ovs_interfaceid": "6bcf1322-1aad-4ffa-9231-7273376e4572", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:24:23 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-1e6637d7-5c42-47de-91ed-60a369b68ff3 tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:57:6e,bridge_name='br-int',has_traffic_filtering=True,id=6bcf1322-1aad-4ffa-9231-7273376e4572,network=Network(a8dd3d50-aad0-4fe6-8986-98d0400bcaec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6bcf1322-1a') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:24:23 user nova-compute[75226]: DEBUG os_vif [None req-1e6637d7-5c42-47de-91ed-60a369b68ff3 tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:57:6e,bridge_name='br-int',has_traffic_filtering=True,id=6bcf1322-1aad-4ffa-9231-7273376e4572,network=Network(a8dd3d50-aad0-4fe6-8986-98d0400bcaec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6bcf1322-1a') {{(pid=75226) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 17 01:24:23 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:24:23 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6bcf1322-1a, bridge=br-int, if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:24:23 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:24:23 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:24:23 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-dde3e683-0388-4a41-a371-fe136855fabc tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Releasing lock "refresh_cache-ee2187c9-8620-4fd2-ad8a-a054cd8393f3" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:24:23 user nova-compute[75226]: DEBUG nova.compute.manager [None req-dde3e683-0388-4a41-a371-fe136855fabc tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] [instance: ee2187c9-8620-4fd2-ad8a-a054cd8393f3] Instance network_info: |[{"id": "1057ea4c-2ac4-40fa-8b2e-3b5888ea4d61", "address": "fa:16:3e:4a:f5:8f", "network": {"id": "3d8c3322-c78d-4d3a-b8c7-ba12241b4c65", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1996535656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c19f767dc7bb4024b3cbf1d8f5f8f2bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1057ea4c-2a", "ovs_interfaceid": "1057ea4c-2ac4-40fa-8b2e-3b5888ea4d61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75226) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 17 01:24:23 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-c050ca7d-abed-437c-8f16-404755931974 req-e33be8d3-c88f-47a3-95cb-2858e7e5d98b service nova] Acquired lock "refresh_cache-ee2187c9-8620-4fd2-ad8a-a054cd8393f3" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:24:23 user nova-compute[75226]: DEBUG nova.network.neutron [req-c050ca7d-abed-437c-8f16-404755931974 req-e33be8d3-c88f-47a3-95cb-2858e7e5d98b service nova] [instance: ee2187c9-8620-4fd2-ad8a-a054cd8393f3] Refreshing network info cache for port 1057ea4c-2ac4-40fa-8b2e-3b5888ea4d61 {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 01:24:23 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-dde3e683-0388-4a41-a371-fe136855fabc tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] [instance: ee2187c9-8620-4fd2-ad8a-a054cd8393f3] Start _get_guest_xml network_info=[{"id": "1057ea4c-2ac4-40fa-8b2e-3b5888ea4d61", "address": "fa:16:3e:4a:f5:8f", "network": {"id": "3d8c3322-c78d-4d3a-b8c7-ba12241b4c65", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1996535656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c19f767dc7bb4024b3cbf1d8f5f8f2bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1057ea4c-2a", "ovs_interfaceid": "1057ea4c-2ac4-40fa-8b2e-3b5888ea4d61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T01:13:22Z,direct_url=<?>,disk_format='qcow2',id=0b369aea-6f3f-4690-9f01-229b90ab6310,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4e110cbf9a84362a6864a7732c435a1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T01:13:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '0b369aea-6f3f-4690-9f01-229b90ab6310'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75226) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 17 01:24:23 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-dde3e683-0388-4a41-a371-fe136855fabc tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:24:23 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-dde3e683-0388-4a41-a371-fe136855fabc tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:24:23 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-dde3e683-0388-4a41-a371-fe136855fabc tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75226) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 17 01:24:23 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-dde3e683-0388-4a41-a371-fe136855fabc tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] CPU controller missing on host. {{(pid=75226) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 17 01:24:23 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-dde3e683-0388-4a41-a371-fe136855fabc tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75226) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 17 01:24:23 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-dde3e683-0388-4a41-a371-fe136855fabc tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] CPU controller found on host. {{(pid=75226) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 17 01:24:23 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-dde3e683-0388-4a41-a371-fe136855fabc tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75226) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 17 01:24:23 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-dde3e683-0388-4a41-a371-fe136855fabc tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-17T01:13:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T01:13:22Z,direct_url=<?>,disk_format='qcow2',id=0b369aea-6f3f-4690-9f01-229b90ab6310,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4e110cbf9a84362a6864a7732c435a1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T01:13:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 17 01:24:23 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-dde3e683-0388-4a41-a371-fe136855fabc tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Flavor limits 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 17 01:24:23 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-dde3e683-0388-4a41-a371-fe136855fabc tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Image limits 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 17 01:24:23 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-dde3e683-0388-4a41-a371-fe136855fabc tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Flavor pref 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 17 01:24:23 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-dde3e683-0388-4a41-a371-fe136855fabc tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Image pref 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 17 01:24:23 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-dde3e683-0388-4a41-a371-fe136855fabc tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 17 01:24:23 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-dde3e683-0388-4a41-a371-fe136855fabc tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 17 01:24:23 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-dde3e683-0388-4a41-a371-fe136855fabc tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75226) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 17 01:24:23 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-dde3e683-0388-4a41-a371-fe136855fabc tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Got 1 possible topologies {{(pid=75226) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 17 01:24:23 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-dde3e683-0388-4a41-a371-fe136855fabc tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 17 01:24:23 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-dde3e683-0388-4a41-a371-fe136855fabc tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 17 01:24:23 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-dde3e683-0388-4a41-a371-fe136855fabc tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:24:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1878692867',display_name='tempest-ServerActionsTestOtherB-server-1878692867',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1878692867',id=21,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBTPdFaRxKgPkRdKbUEvHAZcoj+dPC43zryXBmo0q5ihjaLD04DW9eJSP+KLH1T/XkmERKqJKOvG49EB5qtvQ6Fib4lL66B3axWTUVDvaaC20Rh3bH2XA1pGQ2EKVxiHfg==',key_name='tempest-keypair-1901957685',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c19f767dc7bb4024b3cbf1d8f5f8f2bf',ramdisk_id='',reservation_id='r-p9pzzoi2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-229085712',owner_user_name='tempest-ServerActionsTestOtherB-229085712-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T01:24:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f0952a7e2dd64bf2adb2e224965377ab',uuid=ee2187c9-8620-4fd2-ad8a-a054cd8393f3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1057ea4c-2ac4-40fa-8b2e-3b5888ea4d61", "address": "fa:16:3e:4a:f5:8f", "network": {"id": "3d8c3322-c78d-4d3a-b8c7-ba12241b4c65", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1996535656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c19f767dc7bb4024b3cbf1d8f5f8f2bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1057ea4c-2a", "ovs_interfaceid": "1057ea4c-2ac4-40fa-8b2e-3b5888ea4d61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75226) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 01:24:23 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-dde3e683-0388-4a41-a371-fe136855fabc tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Converting VIF {"id": "1057ea4c-2ac4-40fa-8b2e-3b5888ea4d61", "address": "fa:16:3e:4a:f5:8f", "network": {"id": "3d8c3322-c78d-4d3a-b8c7-ba12241b4c65", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1996535656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c19f767dc7bb4024b3cbf1d8f5f8f2bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1057ea4c-2a", "ovs_interfaceid": "1057ea4c-2ac4-40fa-8b2e-3b5888ea4d61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:24:23 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-dde3e683-0388-4a41-a371-fe136855fabc tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:f5:8f,bridge_name='br-int',has_traffic_filtering=True,id=1057ea4c-2ac4-40fa-8b2e-3b5888ea4d61,network=Network(3d8c3322-c78d-4d3a-b8c7-ba12241b4c65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1057ea4c-2a') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:24:23 user nova-compute[75226]: DEBUG nova.objects.instance [None req-dde3e683-0388-4a41-a371-fe136855fabc tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Lazy-loading 'pci_devices' on Instance uuid ee2187c9-8620-4fd2-ad8a-a054cd8393f3 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:24:23 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:24:23 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:24:23 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ebe9fcca-1419-4944-8b31-58ad7406acc2) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:24:23 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:24:23 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:24:23 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-dde3e683-0388-4a41-a371-fe136855fabc tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] [instance: ee2187c9-8620-4fd2-ad8a-a054cd8393f3] End _get_guest_xml xml=<domain type="kvm">
Nov 17 01:24:23 user nova-compute[75226]:   <uuid>ee2187c9-8620-4fd2-ad8a-a054cd8393f3</uuid>
Nov 17 01:24:23 user nova-compute[75226]:   <name>instance-00000015</name>
Nov 17 01:24:23 user nova-compute[75226]:   <memory>524288</memory>
Nov 17 01:24:23 user nova-compute[75226]:   <vcpu>1</vcpu>
Nov 17 01:24:23 user nova-compute[75226]:   <metadata>
Nov 17 01:24:23 user nova-compute[75226]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 17 01:24:23 user nova-compute[75226]:       <nova:package version="0.0.0"/>
Nov 17 01:24:23 user nova-compute[75226]:       <nova:name>tempest-ServerActionsTestOtherB-server-1878692867</nova:name>
Nov 17 01:24:23 user nova-compute[75226]:       <nova:creationTime>2023-11-17 01:24:23</nova:creationTime>
Nov 17 01:24:23 user nova-compute[75226]:       <nova:flavor name="m1.tiny">
Nov 17 01:24:23 user nova-compute[75226]:         <nova:memory>512</nova:memory>
Nov 17 01:24:23 user nova-compute[75226]:         <nova:disk>1</nova:disk>
Nov 17 01:24:23 user nova-compute[75226]:         <nova:swap>0</nova:swap>
Nov 17 01:24:23 user nova-compute[75226]:         <nova:ephemeral>0</nova:ephemeral>
Nov 17 01:24:23 user nova-compute[75226]:         <nova:vcpus>1</nova:vcpus>
Nov 17 01:24:23 user nova-compute[75226]:       </nova:flavor>
Nov 17 01:24:23 user nova-compute[75226]:       <nova:owner>
Nov 17 01:24:23 user nova-compute[75226]:         <nova:user uuid="f0952a7e2dd64bf2adb2e224965377ab">tempest-ServerActionsTestOtherB-229085712-project-member</nova:user>
Nov 17 01:24:23 user nova-compute[75226]:         <nova:project uuid="c19f767dc7bb4024b3cbf1d8f5f8f2bf">tempest-ServerActionsTestOtherB-229085712</nova:project>
Nov 17 01:24:23 user nova-compute[75226]:       </nova:owner>
Nov 17 01:24:23 user nova-compute[75226]:       <nova:root type="image" uuid="0b369aea-6f3f-4690-9f01-229b90ab6310"/>
Nov 17 01:24:23 user nova-compute[75226]:       <nova:ports>
Nov 17 01:24:23 user nova-compute[75226]:         <nova:port uuid="1057ea4c-2ac4-40fa-8b2e-3b5888ea4d61">
Nov 17 01:24:23 user nova-compute[75226]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 17 01:24:23 user nova-compute[75226]:         </nova:port>
Nov 17 01:24:23 user nova-compute[75226]:       </nova:ports>
Nov 17 01:24:23 user nova-compute[75226]:     </nova:instance>
Nov 17 01:24:23 user nova-compute[75226]:   </metadata>
Nov 17 01:24:23 user nova-compute[75226]:   <sysinfo type="smbios">
Nov 17 01:24:23 user nova-compute[75226]:     <system>
Nov 17 01:24:23 user nova-compute[75226]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 17 01:24:23 user nova-compute[75226]:       <entry name="product">OpenStack Nova</entry>
Nov 17 01:24:23 user nova-compute[75226]:       <entry name="version">0.0.0</entry>
Nov 17 01:24:23 user nova-compute[75226]:       <entry name="serial">ee2187c9-8620-4fd2-ad8a-a054cd8393f3</entry>
Nov 17 01:24:23 user nova-compute[75226]:       <entry name="uuid">ee2187c9-8620-4fd2-ad8a-a054cd8393f3</entry>
Nov 17 01:24:23 user nova-compute[75226]:       <entry name="family">Virtual Machine</entry>
Nov 17 01:24:23 user nova-compute[75226]:     </system>
Nov 17 01:24:23 user nova-compute[75226]:   </sysinfo>
Nov 17 01:24:23 user nova-compute[75226]:   <os>
Nov 17 01:24:23 user nova-compute[75226]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 17 01:24:23 user nova-compute[75226]:     <boot dev="hd"/>
Nov 17 01:24:23 user nova-compute[75226]:     <smbios mode="sysinfo"/>
Nov 17 01:24:23 user nova-compute[75226]:   </os>
Nov 17 01:24:23 user nova-compute[75226]:   <features>
Nov 17 01:24:23 user nova-compute[75226]:     <acpi/>
Nov 17 01:24:23 user nova-compute[75226]:     <apic/>
Nov 17 01:24:23 user nova-compute[75226]:     <vmcoreinfo/>
Nov 17 01:24:23 user nova-compute[75226]:   </features>
Nov 17 01:24:23 user nova-compute[75226]:   <clock offset="utc">
Nov 17 01:24:23 user nova-compute[75226]:     <timer name="pit" tickpolicy="delay"/>
Nov 17 01:24:23 user nova-compute[75226]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 17 01:24:23 user nova-compute[75226]:     <timer name="hpet" present="no"/>
Nov 17 01:24:23 user nova-compute[75226]:   </clock>
Nov 17 01:24:23 user nova-compute[75226]:   <cpu mode="custom" match="exact">
Nov 17 01:24:23 user nova-compute[75226]:     <model>Nehalem</model>
Nov 17 01:24:23 user nova-compute[75226]:     <topology sockets="1" cores="1" threads="1"/>
Nov 17 01:24:23 user nova-compute[75226]:   </cpu>
Nov 17 01:24:23 user nova-compute[75226]:   <devices>
Nov 17 01:24:23 user nova-compute[75226]:     <disk type="file" device="disk">
Nov 17 01:24:23 user nova-compute[75226]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 17 01:24:23 user nova-compute[75226]:       <source file="/opt/stack/data/nova/instances/ee2187c9-8620-4fd2-ad8a-a054cd8393f3/disk"/>
Nov 17 01:24:23 user nova-compute[75226]:       <target dev="vda" bus="virtio"/>
Nov 17 01:24:23 user nova-compute[75226]:     </disk>
Nov 17 01:24:23 user nova-compute[75226]:     <interface type="ethernet">
Nov 17 01:24:23 user nova-compute[75226]:       <mac address="fa:16:3e:4a:f5:8f"/>
Nov 17 01:24:23 user nova-compute[75226]:       <model type="virtio"/>
Nov 17 01:24:23 user nova-compute[75226]:       <mtu size="1442"/>
Nov 17 01:24:23 user nova-compute[75226]:       <target dev="tap1057ea4c-2a"/>
Nov 17 01:24:23 user nova-compute[75226]:     </interface>
Nov 17 01:24:23 user nova-compute[75226]:     <serial type="pty">
Nov 17 01:24:23 user nova-compute[75226]:       <log file="/opt/stack/data/nova/instances/ee2187c9-8620-4fd2-ad8a-a054cd8393f3/console.log" append="off"/>
Nov 17 01:24:23 user nova-compute[75226]:     </serial>
Nov 17 01:24:23 user nova-compute[75226]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 17 01:24:23 user nova-compute[75226]:     <video>
Nov 17 01:24:23 user nova-compute[75226]:       <model type="virtio"/>
Nov 17 01:24:23 user nova-compute[75226]:     </video>
Nov 17 01:24:23 user nova-compute[75226]:     <rng model="virtio">
Nov 17 01:24:23 user nova-compute[75226]:       <backend model="random">/dev/urandom</backend>
Nov 17 01:24:23 user nova-compute[75226]:     </rng>
Nov 17 01:24:23 user nova-compute[75226]:     <controller type="usb" index="0" model="none"/>
Nov 17 01:24:23 user nova-compute[75226]:     <memballoon model="virtio">
Nov 17 01:24:23 user nova-compute[75226]:       <stats period="10"/>
Nov 17 01:24:23 user nova-compute[75226]:     </memballoon>
Nov 17 01:24:23 user nova-compute[75226]:   </devices>
Nov 17 01:24:23 user nova-compute[75226]: </domain>
Nov 17 01:24:23 user nova-compute[75226]:  {{(pid=75226) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 17 01:24:23 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-dde3e683-0388-4a41-a371-fe136855fabc tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:24:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1878692867',display_name='tempest-ServerActionsTestOtherB-server-1878692867',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1878692867',id=21,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBTPdFaRxKgPkRdKbUEvHAZcoj+dPC43zryXBmo0q5ihjaLD04DW9eJSP+KLH1T/XkmERKqJKOvG49EB5qtvQ6Fib4lL66B3axWTUVDvaaC20Rh3bH2XA1pGQ2EKVxiHfg==',key_name='tempest-keypair-1901957685',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c19f767dc7bb4024b3cbf1d8f5f8f2bf',ramdisk_id='',reservation_id='r-p9pzzoi2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-229085712',owner_user_name='tempest-ServerActionsTestOtherB-229085712-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T01:24:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f0952a7e2dd64bf2adb2e224965377ab',uuid=ee2187c9-8620-4fd2-ad8a-a054cd8393f3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1057ea4c-2ac4-40fa-8b2e-3b5888ea4d61", "address": "fa:16:3e:4a:f5:8f", "network": {"id": "3d8c3322-c78d-4d3a-b8c7-ba12241b4c65", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1996535656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c19f767dc7bb4024b3cbf1d8f5f8f2bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1057ea4c-2a", "ovs_interfaceid": "1057ea4c-2ac4-40fa-8b2e-3b5888ea4d61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 17 01:24:23 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-dde3e683-0388-4a41-a371-fe136855fabc tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Converting VIF {"id": "1057ea4c-2ac4-40fa-8b2e-3b5888ea4d61", "address": "fa:16:3e:4a:f5:8f", "network": {"id": "3d8c3322-c78d-4d3a-b8c7-ba12241b4c65", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1996535656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c19f767dc7bb4024b3cbf1d8f5f8f2bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1057ea4c-2a", "ovs_interfaceid": "1057ea4c-2ac4-40fa-8b2e-3b5888ea4d61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:24:23 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-dde3e683-0388-4a41-a371-fe136855fabc tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:f5:8f,bridge_name='br-int',has_traffic_filtering=True,id=1057ea4c-2ac4-40fa-8b2e-3b5888ea4d61,network=Network(3d8c3322-c78d-4d3a-b8c7-ba12241b4c65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1057ea4c-2a') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:24:23 user nova-compute[75226]: DEBUG os_vif [None req-dde3e683-0388-4a41-a371-fe136855fabc tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:f5:8f,bridge_name='br-int',has_traffic_filtering=True,id=1057ea4c-2ac4-40fa-8b2e-3b5888ea4d61,network=Network(3d8c3322-c78d-4d3a-b8c7-ba12241b4c65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1057ea4c-2a') {{(pid=75226) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 17 01:24:23 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:24:23 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:24:23 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:24:23 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 17 01:24:23 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:24:23 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '647fd443-d41e-56b9-9ef8-81aab2673ffb', '_type': 'linux-noop'}}, row=False) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:24:23 user nova-compute[75226]: INFO os_vif [None req-1e6637d7-5c42-47de-91ed-60a369b68ff3 tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:57:6e,bridge_name='br-int',has_traffic_filtering=True,id=6bcf1322-1aad-4ffa-9231-7273376e4572,network=Network(a8dd3d50-aad0-4fe6-8986-98d0400bcaec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6bcf1322-1a')
Nov 17 01:24:23 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-1e6637d7-5c42-47de-91ed-60a369b68ff3 tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-17T01:22:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1270422690',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1270422690',id=18,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFadtk54Tkvk6AHpu0dnlPf3MeX++Xu/axCXDSKF9N/sLaR9IMdsD+WpKf3bG29Bs36DoaNYGITDbnkh7PpUjSy8pAnsUxMlIERAERRQjtXzSRjHfrt6XPTg8j13L2IqSQ==',key_name='tempest-keypair-1791766942',keypairs=<?>,launch_index=0,launched_at=2023-11-17T01:23:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='60fce4eef0d24de0a320670623085bb6',ramdisk_id='',reservation_id='r-w2e090td',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1246897470',owner_user_name='tempest-TaggedBootDevicesTest_v242-1246897470-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T01:23:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='85f6f2dd0ff44b33874cde7e2e36482c',uuid=663933b0-95dc-4fba-b411-029f0552571d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fbacd963-6a62-4682-89a2-27f92a9f0ff2", "address": "fa:16:3e:34:dd:56", "network": {"id": "a8dd3d50-aad0-4fe6-8986-98d0400bcaec", "bridge": "br-int", "label": "tempest-device-tagging-net1-1117474203", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "60fce4eef0d24de0a320670623085bb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbacd963-6a", "ovs_interfaceid": "fbacd963-6a62-4682-89a2-27f92a9f0ff2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75226) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 17 01:24:23 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-1e6637d7-5c42-47de-91ed-60a369b68ff3 tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Converting VIF {"id": "fbacd963-6a62-4682-89a2-27f92a9f0ff2", "address": "fa:16:3e:34:dd:56", "network": {"id": "a8dd3d50-aad0-4fe6-8986-98d0400bcaec", "bridge": "br-int", "label": "tempest-device-tagging-net1-1117474203", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "60fce4eef0d24de0a320670623085bb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbacd963-6a", "ovs_interfaceid": "fbacd963-6a62-4682-89a2-27f92a9f0ff2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:24:23 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-1e6637d7-5c42-47de-91ed-60a369b68ff3 tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:dd:56,bridge_name='br-int',has_traffic_filtering=True,id=fbacd963-6a62-4682-89a2-27f92a9f0ff2,network=Network(a8dd3d50-aad0-4fe6-8986-98d0400bcaec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfbacd963-6a') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:24:23 user nova-compute[75226]: DEBUG os_vif [None req-1e6637d7-5c42-47de-91ed-60a369b68ff3 tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:dd:56,bridge_name='br-int',has_traffic_filtering=True,id=fbacd963-6a62-4682-89a2-27f92a9f0ff2,network=Network(a8dd3d50-aad0-4fe6-8986-98d0400bcaec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfbacd963-6a') {{(pid=75226) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 17 01:24:23 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:24:23 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:24:23 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:24:23 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:24:23 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfbacd963-6a, bridge=br-int, if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:24:23 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:24:23 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:24:23 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:24:23 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:24:23 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1057ea4c-2a, may_exist=True, interface_attrs={}) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:24:23 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1057ea4c-2a, col_values=(('qos', UUID('ab8d4434-aa56-4b55-8ef7-d8a98253992b')),), if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:24:23 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1057ea4c-2a, col_values=(('external_ids', {'iface-id': '1057ea4c-2ac4-40fa-8b2e-3b5888ea4d61', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4a:f5:8f', 'vm-uuid': 'ee2187c9-8620-4fd2-ad8a-a054cd8393f3'}),), if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:24:23 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:24:23 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:24:23 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:24:23 user nova-compute[75226]: INFO os_vif [None req-dde3e683-0388-4a41-a371-fe136855fabc tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:f5:8f,bridge_name='br-int',has_traffic_filtering=True,id=1057ea4c-2ac4-40fa-8b2e-3b5888ea4d61,network=Network(3d8c3322-c78d-4d3a-b8c7-ba12241b4c65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1057ea4c-2a')
Nov 17 01:24:23 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:24:23 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5483cd54-3d80-4611-b263-fc707d222931) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:24:23 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:24:23 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:24:23 user nova-compute[75226]: INFO os_vif [None req-1e6637d7-5c42-47de-91ed-60a369b68ff3 tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:dd:56,bridge_name='br-int',has_traffic_filtering=True,id=fbacd963-6a62-4682-89a2-27f92a9f0ff2,network=Network(a8dd3d50-aad0-4fe6-8986-98d0400bcaec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfbacd963-6a')
Nov 17 01:24:23 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-1e6637d7-5c42-47de-91ed-60a369b68ff3 tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-17T01:22:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1270422690',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1270422690',id=18,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFadtk54Tkvk6AHpu0dnlPf3MeX++Xu/axCXDSKF9N/sLaR9IMdsD+WpKf3bG29Bs36DoaNYGITDbnkh7PpUjSy8pAnsUxMlIERAERRQjtXzSRjHfrt6XPTg8j13L2IqSQ==',key_name='tempest-keypair-1791766942',keypairs=<?>,launch_index=0,launched_at=2023-11-17T01:23:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='60fce4eef0d24de0a320670623085bb6',ramdisk_id='',reservation_id='r-w2e090td',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1246897470',owner_user_name='tempest-TaggedBootDevicesTest_v242-1246897470-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T01:23:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='85f6f2dd0ff44b33874cde7e2e36482c',uuid=663933b0-95dc-4fba-b411-029f0552571d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "46134046-ef40-4332-aa3f-044beaf6f991", "address": "fa:16:3e:d8:00:e9", "network": {"id": "a8dd3d50-aad0-4fe6-8986-98d0400bcaec", "bridge": "br-int", "label": "tempest-device-tagging-net1-1117474203", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "60fce4eef0d24de0a320670623085bb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46134046-ef", "ovs_interfaceid": "46134046-ef40-4332-aa3f-044beaf6f991", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 17 01:24:23 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-1e6637d7-5c42-47de-91ed-60a369b68ff3 tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Converting VIF {"id": "46134046-ef40-4332-aa3f-044beaf6f991", "address": "fa:16:3e:d8:00:e9", "network": {"id": "a8dd3d50-aad0-4fe6-8986-98d0400bcaec", "bridge": "br-int", "label": "tempest-device-tagging-net1-1117474203", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "60fce4eef0d24de0a320670623085bb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46134046-ef", "ovs_interfaceid": "46134046-ef40-4332-aa3f-044beaf6f991", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:24:23 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-1e6637d7-5c42-47de-91ed-60a369b68ff3 tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:00:e9,bridge_name='br-int',has_traffic_filtering=True,id=46134046-ef40-4332-aa3f-044beaf6f991,network=Network(a8dd3d50-aad0-4fe6-8986-98d0400bcaec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46134046-ef') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:24:23 user nova-compute[75226]: DEBUG os_vif [None req-1e6637d7-5c42-47de-91ed-60a369b68ff3 tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:00:e9,bridge_name='br-int',has_traffic_filtering=True,id=46134046-ef40-4332-aa3f-044beaf6f991,network=Network(a8dd3d50-aad0-4fe6-8986-98d0400bcaec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46134046-ef') {{(pid=75226) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 17 01:24:23 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:24:23 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap46134046-ef, bridge=br-int, if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:24:23 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:24:23 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-dde3e683-0388-4a41-a371-fe136855fabc tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] No BDM found with device name vda, not building metadata. {{(pid=75226) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 01:24:23 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-dde3e683-0388-4a41-a371-fe136855fabc tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] No VIF found with MAC fa:16:3e:4a:f5:8f, not building metadata {{(pid=75226) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 01:24:23 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:24:23 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:24:23 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8969ee0c-29a2-43cb-b463-520a9c2005a5) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:24:23 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:24:23 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:24:23 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:24:23 user nova-compute[75226]: INFO os_vif [None req-1e6637d7-5c42-47de-91ed-60a369b68ff3 tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:00:e9,bridge_name='br-int',has_traffic_filtering=True,id=46134046-ef40-4332-aa3f-044beaf6f991,network=Network(a8dd3d50-aad0-4fe6-8986-98d0400bcaec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46134046-ef')
Nov 17 01:24:23 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-1e6637d7-5c42-47de-91ed-60a369b68ff3 tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-17T01:22:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1270422690',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1270422690',id=18,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFadtk54Tkvk6AHpu0dnlPf3MeX++Xu/axCXDSKF9N/sLaR9IMdsD+WpKf3bG29Bs36DoaNYGITDbnkh7PpUjSy8pAnsUxMlIERAERRQjtXzSRjHfrt6XPTg8j13L2IqSQ==',key_name='tempest-keypair-1791766942',keypairs=<?>,launch_index=0,launched_at=2023-11-17T01:23:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='60fce4eef0d24de0a320670623085bb6',ramdisk_id='',reservation_id='r-w2e090td',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1246897470',owner_user_name='tempest-TaggedBootDevicesTest_v242-1246897470-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T01:23:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='85f6f2dd0ff44b33874cde7e2e36482c',uuid=663933b0-95dc-4fba-b411-029f0552571d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "24888c49-a7a9-4f44-8f95-1174dba77750", "address": "fa:16:3e:38:2a:e5", "network": {"id": "a8dd3d50-aad0-4fe6-8986-98d0400bcaec", "bridge": "br-int", "label": "tempest-device-tagging-net1-1117474203", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "60fce4eef0d24de0a320670623085bb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24888c49-a7", "ovs_interfaceid": "24888c49-a7a9-4f44-8f95-1174dba77750", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 17 01:24:23 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-1e6637d7-5c42-47de-91ed-60a369b68ff3 tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Converting VIF {"id": "24888c49-a7a9-4f44-8f95-1174dba77750", "address": "fa:16:3e:38:2a:e5", "network": {"id": "a8dd3d50-aad0-4fe6-8986-98d0400bcaec", "bridge": "br-int", "label": "tempest-device-tagging-net1-1117474203", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "60fce4eef0d24de0a320670623085bb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24888c49-a7", "ovs_interfaceid": "24888c49-a7a9-4f44-8f95-1174dba77750", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:24:23 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-1e6637d7-5c42-47de-91ed-60a369b68ff3 tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:2a:e5,bridge_name='br-int',has_traffic_filtering=True,id=24888c49-a7a9-4f44-8f95-1174dba77750,network=Network(a8dd3d50-aad0-4fe6-8986-98d0400bcaec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24888c49-a7') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:24:23 user nova-compute[75226]: DEBUG os_vif [None req-1e6637d7-5c42-47de-91ed-60a369b68ff3 tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:2a:e5,bridge_name='br-int',has_traffic_filtering=True,id=24888c49-a7a9-4f44-8f95-1174dba77750,network=Network(a8dd3d50-aad0-4fe6-8986-98d0400bcaec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24888c49-a7') {{(pid=75226) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 17 01:24:23 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:24:23 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap24888c49-a7, bridge=br-int, if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:24:23 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:24:23 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b856b94f-5adf-46cd-981d-376dee612392) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:24:24 user nova-compute[75226]: INFO os_vif [None req-1e6637d7-5c42-47de-91ed-60a369b68ff3 tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:2a:e5,bridge_name='br-int',has_traffic_filtering=True,id=24888c49-a7a9-4f44-8f95-1174dba77750,network=Network(a8dd3d50-aad0-4fe6-8986-98d0400bcaec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24888c49-a7')
Nov 17 01:24:24 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-1e6637d7-5c42-47de-91ed-60a369b68ff3 tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-17T01:22:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1270422690',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1270422690',id=18,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFadtk54Tkvk6AHpu0dnlPf3MeX++Xu/axCXDSKF9N/sLaR9IMdsD+WpKf3bG29Bs36DoaNYGITDbnkh7PpUjSy8pAnsUxMlIERAERRQjtXzSRjHfrt6XPTg8j13L2IqSQ==',key_name='tempest-keypair-1791766942',keypairs=<?>,launch_index=0,launched_at=2023-11-17T01:23:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='60fce4eef0d24de0a320670623085bb6',ramdisk_id='',reservation_id='r-w2e090td',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1246897470',owner_user_name='tempest-TaggedBootDevicesTest_v242-1246897470-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T01:23:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='85f6f2dd0ff44b33874cde7e2e36482c',uuid=663933b0-95dc-4fba-b411-029f0552571d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5f7ca871-040f-460c-8709-7ca74ca282ba", "address": "fa:16:3e:4b:05:65", "network": {"id": "5cee0137-a429-434d-a7ce-0a8d2f9e41ea", "bridge": "br-int", "label": "tempest-device-tagging-net2-1427092874", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "60fce4eef0d24de0a320670623085bb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f7ca871-04", "ovs_interfaceid": "5f7ca871-040f-460c-8709-7ca74ca282ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-1e6637d7-5c42-47de-91ed-60a369b68ff3 tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Converting VIF {"id": "5f7ca871-040f-460c-8709-7ca74ca282ba", "address": "fa:16:3e:4b:05:65", "network": {"id": "5cee0137-a429-434d-a7ce-0a8d2f9e41ea", "bridge": "br-int", "label": "tempest-device-tagging-net2-1427092874", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "60fce4eef0d24de0a320670623085bb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f7ca871-04", "ovs_interfaceid": "5f7ca871-040f-460c-8709-7ca74ca282ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-1e6637d7-5c42-47de-91ed-60a369b68ff3 tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:05:65,bridge_name='br-int',has_traffic_filtering=True,id=5f7ca871-040f-460c-8709-7ca74ca282ba,network=Network(5cee0137-a429-434d-a7ce-0a8d2f9e41ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f7ca871-04') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG os_vif [None req-1e6637d7-5c42-47de-91ed-60a369b68ff3 tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:05:65,bridge_name='br-int',has_traffic_filtering=True,id=5f7ca871-040f-460c-8709-7ca74ca282ba,network=Network(5cee0137-a429-434d-a7ce-0a8d2f9e41ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f7ca871-04') {{(pid=75226) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG nova.network.neutron [req-c050ca7d-abed-437c-8f16-404755931974 req-e33be8d3-c88f-47a3-95cb-2858e7e5d98b service nova] [instance: ee2187c9-8620-4fd2-ad8a-a054cd8393f3] Updated VIF entry in instance network info cache for port 1057ea4c-2ac4-40fa-8b2e-3b5888ea4d61. {{(pid=75226) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG nova.network.neutron [req-c050ca7d-abed-437c-8f16-404755931974 req-e33be8d3-c88f-47a3-95cb-2858e7e5d98b service nova] [instance: ee2187c9-8620-4fd2-ad8a-a054cd8393f3] Updating instance_info_cache with network_info: [{"id": "1057ea4c-2ac4-40fa-8b2e-3b5888ea4d61", "address": "fa:16:3e:4a:f5:8f", "network": {"id": "3d8c3322-c78d-4d3a-b8c7-ba12241b4c65", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1996535656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c19f767dc7bb4024b3cbf1d8f5f8f2bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1057ea4c-2a", "ovs_interfaceid": "1057ea4c-2ac4-40fa-8b2e-3b5888ea4d61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5f7ca871-04, bridge=br-int, if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-c050ca7d-abed-437c-8f16-404755931974 req-e33be8d3-c88f-47a3-95cb-2858e7e5d98b service nova] Releasing lock "refresh_cache-ee2187c9-8620-4fd2-ad8a-a054cd8393f3" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG nova.compute.manager [req-c050ca7d-abed-437c-8f16-404755931974 req-e33be8d3-c88f-47a3-95cb-2858e7e5d98b service nova] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Received event network-vif-unplugged-fbacd963-6a62-4682-89a2-27f92a9f0ff2 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-c050ca7d-abed-437c-8f16-404755931974 req-e33be8d3-c88f-47a3-95cb-2858e7e5d98b service nova] Acquiring lock "663933b0-95dc-4fba-b411-029f0552571d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-c050ca7d-abed-437c-8f16-404755931974 req-e33be8d3-c88f-47a3-95cb-2858e7e5d98b service nova] Lock "663933b0-95dc-4fba-b411-029f0552571d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-c050ca7d-abed-437c-8f16-404755931974 req-e33be8d3-c88f-47a3-95cb-2858e7e5d98b service nova] Lock "663933b0-95dc-4fba-b411-029f0552571d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG nova.compute.manager [req-c050ca7d-abed-437c-8f16-404755931974 req-e33be8d3-c88f-47a3-95cb-2858e7e5d98b service nova] [instance: 663933b0-95dc-4fba-b411-029f0552571d] No waiting events found dispatching network-vif-unplugged-fbacd963-6a62-4682-89a2-27f92a9f0ff2 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG nova.compute.manager [req-c050ca7d-abed-437c-8f16-404755931974 req-e33be8d3-c88f-47a3-95cb-2858e7e5d98b service nova] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Received event network-vif-unplugged-fbacd963-6a62-4682-89a2-27f92a9f0ff2 for instance with task_state deleting. {{(pid=75226) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a7e38444-8591-4ebc-869d-d72d9d4a6271) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:24:24 user nova-compute[75226]: INFO os_vif [None req-1e6637d7-5c42-47de-91ed-60a369b68ff3 tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:05:65,bridge_name='br-int',has_traffic_filtering=True,id=5f7ca871-040f-460c-8709-7ca74ca282ba,network=Network(5cee0137-a429-434d-a7ce-0a8d2f9e41ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f7ca871-04')
Nov 17 01:24:24 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-1e6637d7-5c42-47de-91ed-60a369b68ff3 tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-17T01:22:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1270422690',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1270422690',id=18,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFadtk54Tkvk6AHpu0dnlPf3MeX++Xu/axCXDSKF9N/sLaR9IMdsD+WpKf3bG29Bs36DoaNYGITDbnkh7PpUjSy8pAnsUxMlIERAERRQjtXzSRjHfrt6XPTg8j13L2IqSQ==',key_name='tempest-keypair-1791766942',keypairs=<?>,launch_index=0,launched_at=2023-11-17T01:23:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='60fce4eef0d24de0a320670623085bb6',ramdisk_id='',reservation_id='r-w2e090td',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1246897470',owner_user_name='tempest-TaggedBootDevicesTest_v242-1246897470-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T01:23:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='85f6f2dd0ff44b33874cde7e2e36482c',uuid=663933b0-95dc-4fba-b411-029f0552571d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "153c3e02-4aa9-4b9f-b03d-229f12e2ed68", "address": "fa:16:3e:a1:1f:ee", "network": {"id": "5cee0137-a429-434d-a7ce-0a8d2f9e41ea", "bridge": "br-int", "label": "tempest-device-tagging-net2-1427092874", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "60fce4eef0d24de0a320670623085bb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap153c3e02-4a", "ovs_interfaceid": "153c3e02-4aa9-4b9f-b03d-229f12e2ed68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-1e6637d7-5c42-47de-91ed-60a369b68ff3 tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Converting VIF {"id": "153c3e02-4aa9-4b9f-b03d-229f12e2ed68", "address": "fa:16:3e:a1:1f:ee", "network": {"id": "5cee0137-a429-434d-a7ce-0a8d2f9e41ea", "bridge": "br-int", "label": "tempest-device-tagging-net2-1427092874", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "60fce4eef0d24de0a320670623085bb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap153c3e02-4a", "ovs_interfaceid": "153c3e02-4aa9-4b9f-b03d-229f12e2ed68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-1e6637d7-5c42-47de-91ed-60a369b68ff3 tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:1f:ee,bridge_name='br-int',has_traffic_filtering=True,id=153c3e02-4aa9-4b9f-b03d-229f12e2ed68,network=Network(5cee0137-a429-434d-a7ce-0a8d2f9e41ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap153c3e02-4a') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG os_vif [None req-1e6637d7-5c42-47de-91ed-60a369b68ff3 tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:1f:ee,bridge_name='br-int',has_traffic_filtering=True,id=153c3e02-4aa9-4b9f-b03d-229f12e2ed68,network=Network(5cee0137-a429-434d-a7ce-0a8d2f9e41ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap153c3e02-4a') {{(pid=75226) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap153c3e02-4a, bridge=br-int, if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8f6ecb02-17b5-44a9-ad95-7d86fbdb5c59) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:24:24 user nova-compute[75226]: INFO os_vif [None req-1e6637d7-5c42-47de-91ed-60a369b68ff3 tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:1f:ee,bridge_name='br-int',has_traffic_filtering=True,id=153c3e02-4aa9-4b9f-b03d-229f12e2ed68,network=Network(5cee0137-a429-434d-a7ce-0a8d2f9e41ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap153c3e02-4a')
Nov 17 01:24:24 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e6637d7-5c42-47de-91ed-60a369b68ff3 tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] [instance: 663933b0-95dc-4fba-b411-029f0552571d] calling os-brick to detach iSCSI Volume {{(pid=75226) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e6637d7-5c42-47de-91ed-60a369b68ff3 tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc4cc36b490>, {'target_iqn': 'iqn.2010-10.org.openstack:1b95a10d-6f61-48de-b7e5-de732f65f408', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bdGTAkEp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:24:24 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-1e6637d7-5c42-47de-91ed-60a369b68ff3 tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:24:24 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-1e6637d7-5c42-47de-91ed-60a369b68ff3 tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-1e6637d7-5c42-47de-91ed-60a369b68ff3 tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fdebd15-9917-46ec-a5b6-109d410a086d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:928c93b5-ae63-4e04-94ce-6059e7eaa7d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1fd0b73a-0d42-4e3d-a4f0-a9936d9bd1d4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c17ed19c-4452-4a79-b36a-07ddcd7d9404\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1b95a10d-6f61-48de-b7e5-de732f65f408\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:607b7fb8-097d-43ea-b13c-0825e015e14e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e6637d7-5c42-47de-91ed-60a369b68ff3 tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 17 01:24:24 user nova-compute[75226]: No targets found.
Nov 17 01:24:24 user nova-compute[75226]: iSNS:
Nov 17 01:24:24 user nova-compute[75226]: No targets found.
Nov 17 01:24:24 user nova-compute[75226]: STATIC:
Nov 17 01:24:24 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:928c93b5-ae63-4e04-94ce-6059e7eaa7d6
Nov 17 01:24:24 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:24:24 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:24:24 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:1fd0b73a-0d42-4e3d-a4f0-a9936d9bd1d4
Nov 17 01:24:24 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:24:24 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:24:24 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8
Nov 17 01:24:24 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:24:24 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:24:24 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:c17ed19c-4452-4a79-b36a-07ddcd7d9404
Nov 17 01:24:24 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:24:24 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:24:24 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421
Nov 17 01:24:24 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:24:24 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:24:24 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:1b95a10d-6f61-48de-b7e5-de732f65f408
Nov 17 01:24:24 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:24:24 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:24:24 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:607b7fb8-097d-43ea-b13c-0825e015e14e
Nov 17 01:24:24 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:24:24 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:24:24 user nova-compute[75226]: FIRMWARE:
Nov 17 01:24:24 user nova-compute[75226]: No targets found.
Nov 17 01:24:24 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e6637d7-5c42-47de-91ed-60a369b68ff3 tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 17 01:24:24 user nova-compute[75226]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 17 01:24:24 user nova-compute[75226]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75226) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e6637d7-5c42-47de-91ed-60a369b68ff3 tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1b95a10d-6f61-48de-b7e5-de732f65f408', 0)] {{(pid=75226) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[0701b2ce-abb4-4369-b8a9-71e7f2a2ef18]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1b95a10d-6f61-48de-b7e5-de732f65f408\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1fd0b73a-0d42-4e3d-a4f0-a9936d9bd1d4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:607b7fb8-097d-43ea-b13c-0825e015e14e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:928c93b5-ae63-4e04-94ce-6059e7eaa7d6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c17ed19c-4452-4a79-b36a-07ddcd7d9404\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[95421bd1-95d8-42d7-83dc-6a0ce382fe39]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:928c93b5-ae63-4e04-94ce-6059e7eaa7d6 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:607b7fb8-097d-43ea-b13c-0825e015e14e (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b95a10d-6f61-48de-b7e5-de732f65f408 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fd0b73a-0d42-4e3d-a4f0-a9936d9bd1d4 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c17ed19c-4452-4a79-b36a-07ddcd7d9404 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e6637d7-5c42-47de-91ed-60a369b68ff3 tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)
Nov 17 01:24:24 user nova-compute[75226]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:928c93b5-ae63-4e04-94ce-6059e7eaa7d6 (non-flash)
Nov 17 01:24:24 user nova-compute[75226]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:607b7fb8-097d-43ea-b13c-0825e015e14e (non-flash)
Nov 17 01:24:24 user nova-compute[75226]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b95a10d-6f61-48de-b7e5-de732f65f408 (non-flash)
Nov 17 01:24:24 user nova-compute[75226]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421 (non-flash)
Nov 17 01:24:24 user nova-compute[75226]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fd0b73a-0d42-4e3d-a4f0-a9936d9bd1d4 (non-flash)
Nov 17 01:24:24 user nova-compute[75226]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c17ed19c-4452-4a79-b36a-07ddcd7d9404 (non-flash)
Nov 17 01:24:24 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e6637d7-5c42-47de-91ed-60a369b68ff3 tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)
Nov 17 01:24:24 user nova-compute[75226]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:928c93b5-ae63-4e04-94ce-6059e7eaa7d6 (non-flash)
Nov 17 01:24:24 user nova-compute[75226]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:607b7fb8-097d-43ea-b13c-0825e015e14e (non-flash)
Nov 17 01:24:24 user nova-compute[75226]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b95a10d-6f61-48de-b7e5-de732f65f408 (non-flash)
Nov 17 01:24:24 user nova-compute[75226]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421 (non-flash)
Nov 17 01:24:24 user nova-compute[75226]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fd0b73a-0d42-4e3d-a4f0-a9936d9bd1d4 (non-flash)
Nov 17 01:24:24 user nova-compute[75226]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c17ed19c-4452-4a79-b36a-07ddcd7d9404 (non-flash)
Nov 17 01:24:24 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e6637d7-5c42-47de-91ed-60a369b68ff3 tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc4d4322710>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1b95a10d-6f61-48de-b7e5-de732f65f408'): ({'sdg'}, set())}) {{(pid=75226) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-1e6637d7-5c42-47de-91ed-60a369b68ff3 tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Removing single pathed devices sdg {{(pid=75226) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed79b147-0399-46ba-b813-df58e8e489a6]: (4, ('path checker states:\nup                  6\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[a88f6c62-659a-4aa4-80e2-d7f18a9df3d5]: (4, ('ok\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-1e6637d7-5c42-47de-91ed-60a369b68ff3 tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Flushing IO for device /dev/sdg {{(pid=75226) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.012s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[f755c0c4-2ca5-4337-99a0-57b4a7e9f37b]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-1e6637d7-5c42-47de-91ed-60a369b68ff3 tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75226) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.046s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[07b30843-2ab7-4b62-9519-b9c7d607b43a]: (4, ('1', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-1e6637d7-5c42-47de-91ed-60a369b68ff3 tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75226) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-1e6637d7-5c42-47de-91ed-60a369b68ff3 tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] SCSI volumes sdg have been removed. {{(pid=75226) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e6637d7-5c42-47de-91ed-60a369b68ff3 tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1b95a10d-6f61-48de-b7e5-de732f65f408')] {{(pid=75226) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b95a10d-6f61-48de-b7e5-de732f65f408 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b95a10d-6f61-48de-b7e5-de732f65f408 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[020cb9b7-b554-4d59-a3ae-a1eef469ba52]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e6637d7-5c42-47de-91ed-60a369b68ff3 tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b95a10d-6f61-48de-b7e5-de732f65f408 -p 172.16.0.220:3260 --logout {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG nova.compute.manager [req-e4791803-a08a-43e6-8566-5cfa8a4bbfb3 req-c0033239-7e43-4df5-a754-b01adf0e5f67 service nova] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Received event network-vif-plugged-46134046-ef40-4332-aa3f-044beaf6f991 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-e4791803-a08a-43e6-8566-5cfa8a4bbfb3 req-c0033239-7e43-4df5-a754-b01adf0e5f67 service nova] Acquiring lock "663933b0-95dc-4fba-b411-029f0552571d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-e4791803-a08a-43e6-8566-5cfa8a4bbfb3 req-c0033239-7e43-4df5-a754-b01adf0e5f67 service nova] Lock "663933b0-95dc-4fba-b411-029f0552571d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-e4791803-a08a-43e6-8566-5cfa8a4bbfb3 req-c0033239-7e43-4df5-a754-b01adf0e5f67 service nova] Lock "663933b0-95dc-4fba-b411-029f0552571d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG nova.compute.manager [req-e4791803-a08a-43e6-8566-5cfa8a4bbfb3 req-c0033239-7e43-4df5-a754-b01adf0e5f67 service nova] [instance: 663933b0-95dc-4fba-b411-029f0552571d] No waiting events found dispatching network-vif-plugged-46134046-ef40-4332-aa3f-044beaf6f991 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:24:24 user nova-compute[75226]: WARNING nova.compute.manager [req-e4791803-a08a-43e6-8566-5cfa8a4bbfb3 req-c0033239-7e43-4df5-a754-b01adf0e5f67 service nova] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Received unexpected event network-vif-plugged-46134046-ef40-4332-aa3f-044beaf6f991 for instance with vm_state active and task_state deleting.
Nov 17 01:24:24 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b95a10d-6f61-48de-b7e5-de732f65f408 -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5dbeac5-7887-448b-bfa7-6b0c82fa5418]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:1b95a10d-6f61-48de-b7e5-de732f65f408, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:1b95a10d-6f61-48de-b7e5-de732f65f408, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e6637d7-5c42-47de-91ed-60a369b68ff3 tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:1b95a10d-6f61-48de-b7e5-de732f65f408, portal: 172.16.0.220,3260]
Nov 17 01:24:24 user nova-compute[75226]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:1b95a10d-6f61-48de-b7e5-de732f65f408, portal: 172.16.0.220,3260] successful.
Nov 17 01:24:24 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b95a10d-6f61-48de-b7e5-de732f65f408 -p 172.16.0.220:3260 --op delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b95a10d-6f61-48de-b7e5-de732f65f408 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[a21bff80-84ca-4244-a671-de260fe897db]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e6637d7-5c42-47de-91ed-60a369b68ff3 tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-1e6637d7-5c42-47de-91ed-60a369b68ff3 tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.345s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e6637d7-5c42-47de-91ed-60a369b68ff3 tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] <== disconnect_volume: return (346ms) None {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e6637d7-5c42-47de-91ed-60a369b68ff3 tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Disconnected iSCSI Volume {{(pid=75226) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e6637d7-5c42-47de-91ed-60a369b68ff3 tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] [instance: 663933b0-95dc-4fba-b411-029f0552571d] calling os-brick to detach iSCSI Volume {{(pid=75226) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e6637d7-5c42-47de-91ed-60a369b68ff3 tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc4cc36b490>, {'target_iqn': 'iqn.2010-10.org.openstack:607b7fb8-097d-43ea-b13c-0825e015e14e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JLQISYnD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:24:24 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-1e6637d7-5c42-47de-91ed-60a369b68ff3 tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:24:24 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-1e6637d7-5c42-47de-91ed-60a369b68ff3 tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-1e6637d7-5c42-47de-91ed-60a369b68ff3 tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cf1ad5e-ec63-46d9-a21b-e343a9b054e7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:928c93b5-ae63-4e04-94ce-6059e7eaa7d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1fd0b73a-0d42-4e3d-a4f0-a9936d9bd1d4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c17ed19c-4452-4a79-b36a-07ddcd7d9404\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:607b7fb8-097d-43ea-b13c-0825e015e14e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e6637d7-5c42-47de-91ed-60a369b68ff3 tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 17 01:24:24 user nova-compute[75226]: No targets found.
Nov 17 01:24:24 user nova-compute[75226]: iSNS:
Nov 17 01:24:24 user nova-compute[75226]: No targets found.
Nov 17 01:24:24 user nova-compute[75226]: STATIC:
Nov 17 01:24:24 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:928c93b5-ae63-4e04-94ce-6059e7eaa7d6
Nov 17 01:24:24 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:24:24 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:24:24 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:1fd0b73a-0d42-4e3d-a4f0-a9936d9bd1d4
Nov 17 01:24:24 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:24:24 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:24:24 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8
Nov 17 01:24:24 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:24:24 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:24:24 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:c17ed19c-4452-4a79-b36a-07ddcd7d9404
Nov 17 01:24:24 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:24:24 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:24:24 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421
Nov 17 01:24:24 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:24:24 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:24:24 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:607b7fb8-097d-43ea-b13c-0825e015e14e
Nov 17 01:24:24 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:24:24 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:24:24 user nova-compute[75226]: FIRMWARE:
Nov 17 01:24:24 user nova-compute[75226]: No targets found.
Nov 17 01:24:24 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e6637d7-5c42-47de-91ed-60a369b68ff3 tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 17 01:24:24 user nova-compute[75226]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 17 01:24:24 user nova-compute[75226]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75226) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e6637d7-5c42-47de-91ed-60a369b68ff3 tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:607b7fb8-097d-43ea-b13c-0825e015e14e', 0)] {{(pid=75226) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG nova.compute.manager [req-1e046f16-d52c-47a9-8651-bdde4198d8e8 req-0b8b66f0-29b0-404a-83a9-cb6c3cf92acb service nova] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Received event network-vif-plugged-5f7ca871-040f-460c-8709-7ca74ca282ba {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-1e046f16-d52c-47a9-8651-bdde4198d8e8 req-0b8b66f0-29b0-404a-83a9-cb6c3cf92acb service nova] Acquiring lock "663933b0-95dc-4fba-b411-029f0552571d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-1e046f16-d52c-47a9-8651-bdde4198d8e8 req-0b8b66f0-29b0-404a-83a9-cb6c3cf92acb service nova] Lock "663933b0-95dc-4fba-b411-029f0552571d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-1e046f16-d52c-47a9-8651-bdde4198d8e8 req-0b8b66f0-29b0-404a-83a9-cb6c3cf92acb service nova] Lock "663933b0-95dc-4fba-b411-029f0552571d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG nova.compute.manager [req-1e046f16-d52c-47a9-8651-bdde4198d8e8 req-0b8b66f0-29b0-404a-83a9-cb6c3cf92acb service nova] [instance: 663933b0-95dc-4fba-b411-029f0552571d] No waiting events found dispatching network-vif-plugged-5f7ca871-040f-460c-8709-7ca74ca282ba {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:24:24 user nova-compute[75226]: WARNING nova.compute.manager [req-1e046f16-d52c-47a9-8651-bdde4198d8e8 req-0b8b66f0-29b0-404a-83a9-cb6c3cf92acb service nova] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Received unexpected event network-vif-plugged-5f7ca871-040f-460c-8709-7ca74ca282ba for instance with vm_state active and task_state deleting.
Nov 17 01:24:24 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e6b75be-4b67-4d1a-88fd-2952f37f6ff5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1fd0b73a-0d42-4e3d-a4f0-a9936d9bd1d4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:607b7fb8-097d-43ea-b13c-0825e015e14e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:928c93b5-ae63-4e04-94ce-6059e7eaa7d6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c17ed19c-4452-4a79-b36a-07ddcd7d9404\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c2aa507-c717-420e-84ad-e013b6d72060]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:928c93b5-ae63-4e04-94ce-6059e7eaa7d6 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:607b7fb8-097d-43ea-b13c-0825e015e14e (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fd0b73a-0d42-4e3d-a4f0-a9936d9bd1d4 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c17ed19c-4452-4a79-b36a-07ddcd7d9404 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e6637d7-5c42-47de-91ed-60a369b68ff3 tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)
Nov 17 01:24:24 user nova-compute[75226]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:928c93b5-ae63-4e04-94ce-6059e7eaa7d6 (non-flash)
Nov 17 01:24:24 user nova-compute[75226]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:607b7fb8-097d-43ea-b13c-0825e015e14e (non-flash)
Nov 17 01:24:24 user nova-compute[75226]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421 (non-flash)
Nov 17 01:24:24 user nova-compute[75226]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fd0b73a-0d42-4e3d-a4f0-a9936d9bd1d4 (non-flash)
Nov 17 01:24:24 user nova-compute[75226]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c17ed19c-4452-4a79-b36a-07ddcd7d9404 (non-flash)
Nov 17 01:24:24 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e6637d7-5c42-47de-91ed-60a369b68ff3 tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)
Nov 17 01:24:24 user nova-compute[75226]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:928c93b5-ae63-4e04-94ce-6059e7eaa7d6 (non-flash)
Nov 17 01:24:24 user nova-compute[75226]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:607b7fb8-097d-43ea-b13c-0825e015e14e (non-flash)
Nov 17 01:24:24 user nova-compute[75226]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421 (non-flash)
Nov 17 01:24:24 user nova-compute[75226]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fd0b73a-0d42-4e3d-a4f0-a9936d9bd1d4 (non-flash)
Nov 17 01:24:24 user nova-compute[75226]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c17ed19c-4452-4a79-b36a-07ddcd7d9404 (non-flash)
Nov 17 01:24:24 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e6637d7-5c42-47de-91ed-60a369b68ff3 tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc4cc1fb760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:607b7fb8-097d-43ea-b13c-0825e015e14e'): ({'sdf'}, set())}) {{(pid=75226) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-1e6637d7-5c42-47de-91ed-60a369b68ff3 tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Removing single pathed devices sdf {{(pid=75226) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[08098c2f-a587-45f0-9e6e-469b1355f8ac]: (4, ('path checker states:\nup                  5\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[a209b23c-66e7-4c6a-bc0e-5381acbd6251]: (4, ('ok\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-1e6637d7-5c42-47de-91ed-60a369b68ff3 tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Flushing IO for device /dev/sdf {{(pid=75226) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.012s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[169b2cf6-a93d-4820-8e07-e264f6c449a1]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-1e6637d7-5c42-47de-91ed-60a369b68ff3 tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75226) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.040s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9cf748a-e74a-4a59-b163-9e3af2cd71b9]: (4, ('1', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-1e6637d7-5c42-47de-91ed-60a369b68ff3 tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75226) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-1e6637d7-5c42-47de-91ed-60a369b68ff3 tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] SCSI volumes sdf have been removed. {{(pid=75226) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e6637d7-5c42-47de-91ed-60a369b68ff3 tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:607b7fb8-097d-43ea-b13c-0825e015e14e')] {{(pid=75226) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:607b7fb8-097d-43ea-b13c-0825e015e14e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:607b7fb8-097d-43ea-b13c-0825e015e14e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4aa2555-f315-45d1-a254-322ffa66d608]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e6637d7-5c42-47de-91ed-60a369b68ff3 tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:607b7fb8-097d-43ea-b13c-0825e015e14e -p 172.16.0.220:3260 --logout {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:607b7fb8-097d-43ea-b13c-0825e015e14e -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aef3a8b-a568-4852-a910-4b1511963ced]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:607b7fb8-097d-43ea-b13c-0825e015e14e, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:607b7fb8-097d-43ea-b13c-0825e015e14e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e6637d7-5c42-47de-91ed-60a369b68ff3 tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:607b7fb8-097d-43ea-b13c-0825e015e14e, portal: 172.16.0.220,3260]
Nov 17 01:24:24 user nova-compute[75226]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:607b7fb8-097d-43ea-b13c-0825e015e14e, portal: 172.16.0.220,3260] successful.
Nov 17 01:24:24 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:607b7fb8-097d-43ea-b13c-0825e015e14e -p 172.16.0.220:3260 --op delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:607b7fb8-097d-43ea-b13c-0825e015e14e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[64f65a66-6310-461c-85e1-a390d9877c0b]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e6637d7-5c42-47de-91ed-60a369b68ff3 tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-1e6637d7-5c42-47de-91ed-60a369b68ff3 tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e6637d7-5c42-47de-91ed-60a369b68ff3 tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] <== disconnect_volume: return (309ms) None {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e6637d7-5c42-47de-91ed-60a369b68ff3 tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Disconnected iSCSI Volume {{(pid=75226) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e6637d7-5c42-47de-91ed-60a369b68ff3 tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] [instance: 663933b0-95dc-4fba-b411-029f0552571d] calling os-brick to detach iSCSI Volume {{(pid=75226) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e6637d7-5c42-47de-91ed-60a369b68ff3 tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc4cc36b490>, {'target_iqn': 'iqn.2010-10.org.openstack:928c93b5-ae63-4e04-94ce-6059e7eaa7d6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gaMxGoKY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:24:24 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-1e6637d7-5c42-47de-91ed-60a369b68ff3 tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:24:24 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-1e6637d7-5c42-47de-91ed-60a369b68ff3 tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-1e6637d7-5c42-47de-91ed-60a369b68ff3 tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[56f0203f-372b-4f18-8b46-d7f8aef0e28a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:928c93b5-ae63-4e04-94ce-6059e7eaa7d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1fd0b73a-0d42-4e3d-a4f0-a9936d9bd1d4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c17ed19c-4452-4a79-b36a-07ddcd7d9404\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e6637d7-5c42-47de-91ed-60a369b68ff3 tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 17 01:24:24 user nova-compute[75226]: No targets found.
Nov 17 01:24:24 user nova-compute[75226]: iSNS:
Nov 17 01:24:24 user nova-compute[75226]: No targets found.
Nov 17 01:24:24 user nova-compute[75226]: STATIC:
Nov 17 01:24:24 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:928c93b5-ae63-4e04-94ce-6059e7eaa7d6
Nov 17 01:24:24 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:24:24 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:24:24 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:1fd0b73a-0d42-4e3d-a4f0-a9936d9bd1d4
Nov 17 01:24:24 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:24:24 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:24:24 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8
Nov 17 01:24:24 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:24:24 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:24:24 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:c17ed19c-4452-4a79-b36a-07ddcd7d9404
Nov 17 01:24:24 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:24:24 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:24:24 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421
Nov 17 01:24:24 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:24:24 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:24:24 user nova-compute[75226]: FIRMWARE:
Nov 17 01:24:24 user nova-compute[75226]: No targets found.
Nov 17 01:24:24 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e6637d7-5c42-47de-91ed-60a369b68ff3 tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 17 01:24:24 user nova-compute[75226]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 17 01:24:24 user nova-compute[75226]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75226) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e6637d7-5c42-47de-91ed-60a369b68ff3 tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:928c93b5-ae63-4e04-94ce-6059e7eaa7d6', 0)] {{(pid=75226) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[a30c39b3-95d7-410c-adb5-a10dafd2ebff]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1fd0b73a-0d42-4e3d-a4f0-a9936d9bd1d4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:928c93b5-ae63-4e04-94ce-6059e7eaa7d6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c17ed19c-4452-4a79-b36a-07ddcd7d9404\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[8866fc3e-7384-4c26-bc45-40680392a07c]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:928c93b5-ae63-4e04-94ce-6059e7eaa7d6 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fd0b73a-0d42-4e3d-a4f0-a9936d9bd1d4 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c17ed19c-4452-4a79-b36a-07ddcd7d9404 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e6637d7-5c42-47de-91ed-60a369b68ff3 tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)
Nov 17 01:24:24 user nova-compute[75226]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:928c93b5-ae63-4e04-94ce-6059e7eaa7d6 (non-flash)
Nov 17 01:24:24 user nova-compute[75226]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421 (non-flash)
Nov 17 01:24:24 user nova-compute[75226]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fd0b73a-0d42-4e3d-a4f0-a9936d9bd1d4 (non-flash)
Nov 17 01:24:24 user nova-compute[75226]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c17ed19c-4452-4a79-b36a-07ddcd7d9404 (non-flash)
Nov 17 01:24:24 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e6637d7-5c42-47de-91ed-60a369b68ff3 tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)
Nov 17 01:24:24 user nova-compute[75226]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:928c93b5-ae63-4e04-94ce-6059e7eaa7d6 (non-flash)
Nov 17 01:24:24 user nova-compute[75226]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421 (non-flash)
Nov 17 01:24:24 user nova-compute[75226]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fd0b73a-0d42-4e3d-a4f0-a9936d9bd1d4 (non-flash)
Nov 17 01:24:24 user nova-compute[75226]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c17ed19c-4452-4a79-b36a-07ddcd7d9404 (non-flash)
Nov 17 01:24:24 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e6637d7-5c42-47de-91ed-60a369b68ff3 tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc4cc1fb760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:928c93b5-ae63-4e04-94ce-6059e7eaa7d6'): ({'sde'}, set())}) {{(pid=75226) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-1e6637d7-5c42-47de-91ed-60a369b68ff3 tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Removing single pathed devices sde {{(pid=75226) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 17 01:24:24 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:24:25 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:24:25 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[a585cb0e-1423-4649-8f20-cdc76d265a09]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:24:25 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:24:25 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:24:25 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcbfa613-2399-4266-b4f2-29b0408b2adb]: (4, ('ok\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:24:25 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-1e6637d7-5c42-47de-91ed-60a369b68ff3 tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Flushing IO for device /dev/sde {{(pid=75226) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 17 01:24:25 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:24:25 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:24:25 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcd7306a-8e2e-45fc-af03-a55971935fb7]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:24:25 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-1e6637d7-5c42-47de-91ed-60a369b68ff3 tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75226) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 17 01:24:25 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:24:25 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.042s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:24:25 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[818c4045-0044-4ac5-a9a1-8764b7167b89]: (4, ('1', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:24:25 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-1e6637d7-5c42-47de-91ed-60a369b68ff3 tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75226) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 17 01:24:25 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-1e6637d7-5c42-47de-91ed-60a369b68ff3 tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] SCSI volumes sde have been removed. {{(pid=75226) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 17 01:24:25 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e6637d7-5c42-47de-91ed-60a369b68ff3 tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:928c93b5-ae63-4e04-94ce-6059e7eaa7d6')] {{(pid=75226) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 17 01:24:25 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:928c93b5-ae63-4e04-94ce-6059e7eaa7d6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:24:25 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:928c93b5-ae63-4e04-94ce-6059e7eaa7d6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:24:25 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f967727-4e1b-416d-a21f-ee93c1c3b7cd]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:24:25 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e6637d7-5c42-47de-91ed-60a369b68ff3 tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:24:25 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:928c93b5-ae63-4e04-94ce-6059e7eaa7d6 -p 172.16.0.220:3260 --logout {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:24:25 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:24:25 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:928c93b5-ae63-4e04-94ce-6059e7eaa7d6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:24:25 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecbbfd60-b9d2-4276-a9b8-a978193f6bd7]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:928c93b5-ae63-4e04-94ce-6059e7eaa7d6, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:928c93b5-ae63-4e04-94ce-6059e7eaa7d6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:24:25 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e6637d7-5c42-47de-91ed-60a369b68ff3 tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:928c93b5-ae63-4e04-94ce-6059e7eaa7d6, portal: 172.16.0.220,3260]
Nov 17 01:24:25 user nova-compute[75226]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:928c93b5-ae63-4e04-94ce-6059e7eaa7d6, portal: 172.16.0.220,3260] successful.
Nov 17 01:24:25 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:24:25 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:928c93b5-ae63-4e04-94ce-6059e7eaa7d6 -p 172.16.0.220:3260 --op delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:24:25 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:24:25 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:24:25 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:928c93b5-ae63-4e04-94ce-6059e7eaa7d6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:24:25 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc49741f-4160-4be4-9c38-d93d258aad13]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:24:25 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:24:25 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e6637d7-5c42-47de-91ed-60a369b68ff3 tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:24:25 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-1e6637d7-5c42-47de-91ed-60a369b68ff3 tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:24:25 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e6637d7-5c42-47de-91ed-60a369b68ff3 tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] <== disconnect_volume: return (326ms) None {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:24:25 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e6637d7-5c42-47de-91ed-60a369b68ff3 tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Disconnected iSCSI Volume {{(pid=75226) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 17 01:24:25 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-1e6637d7-5c42-47de-91ed-60a369b68ff3 tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Deleting instance files /opt/stack/data/nova/instances/663933b0-95dc-4fba-b411-029f0552571d_del
Nov 17 01:24:25 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-1e6637d7-5c42-47de-91ed-60a369b68ff3 tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Deletion of /opt/stack/data/nova/instances/663933b0-95dc-4fba-b411-029f0552571d_del complete
Nov 17 01:24:25 user nova-compute[75226]: INFO nova.compute.manager [None req-1e6637d7-5c42-47de-91ed-60a369b68ff3 tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Took 3.77 seconds to destroy the instance on the hypervisor.
Nov 17 01:24:25 user nova-compute[75226]: DEBUG oslo.service.loopingcall [None req-1e6637d7-5c42-47de-91ed-60a369b68ff3 tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75226) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 17 01:24:25 user nova-compute[75226]: DEBUG nova.compute.manager [-] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Deallocating network for instance {{(pid=75226) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 17 01:24:25 user nova-compute[75226]: DEBUG nova.network.neutron [-] [instance: 663933b0-95dc-4fba-b411-029f0552571d] deallocate_for_instance() {{(pid=75226) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 17 01:24:25 user nova-compute[75226]: DEBUG nova.compute.manager [req-12ab995e-f828-4c2d-a323-ec5c4a3ad42e req-b9c2eb88-5213-4b65-b188-d5db5695e500 service nova] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Received event network-vif-plugged-fbacd963-6a62-4682-89a2-27f92a9f0ff2 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:24:25 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-12ab995e-f828-4c2d-a323-ec5c4a3ad42e req-b9c2eb88-5213-4b65-b188-d5db5695e500 service nova] Acquiring lock "663933b0-95dc-4fba-b411-029f0552571d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:24:25 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-12ab995e-f828-4c2d-a323-ec5c4a3ad42e req-b9c2eb88-5213-4b65-b188-d5db5695e500 service nova] Lock "663933b0-95dc-4fba-b411-029f0552571d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:24:25 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-12ab995e-f828-4c2d-a323-ec5c4a3ad42e req-b9c2eb88-5213-4b65-b188-d5db5695e500 service nova] Lock "663933b0-95dc-4fba-b411-029f0552571d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:24:25 user nova-compute[75226]: DEBUG nova.compute.manager [req-12ab995e-f828-4c2d-a323-ec5c4a3ad42e req-b9c2eb88-5213-4b65-b188-d5db5695e500 service nova] [instance: 663933b0-95dc-4fba-b411-029f0552571d] No waiting events found dispatching network-vif-plugged-fbacd963-6a62-4682-89a2-27f92a9f0ff2 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:24:25 user nova-compute[75226]: WARNING nova.compute.manager [req-12ab995e-f828-4c2d-a323-ec5c4a3ad42e req-b9c2eb88-5213-4b65-b188-d5db5695e500 service nova] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Received unexpected event network-vif-plugged-fbacd963-6a62-4682-89a2-27f92a9f0ff2 for instance with vm_state active and task_state deleting.
Nov 17 01:24:25 user nova-compute[75226]: DEBUG nova.compute.manager [req-12ab995e-f828-4c2d-a323-ec5c4a3ad42e req-b9c2eb88-5213-4b65-b188-d5db5695e500 service nova] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Received event network-vif-unplugged-24888c49-a7a9-4f44-8f95-1174dba77750 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:24:25 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-12ab995e-f828-4c2d-a323-ec5c4a3ad42e req-b9c2eb88-5213-4b65-b188-d5db5695e500 service nova] Acquiring lock "663933b0-95dc-4fba-b411-029f0552571d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:24:25 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-12ab995e-f828-4c2d-a323-ec5c4a3ad42e req-b9c2eb88-5213-4b65-b188-d5db5695e500 service nova] Lock "663933b0-95dc-4fba-b411-029f0552571d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:24:25 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-12ab995e-f828-4c2d-a323-ec5c4a3ad42e req-b9c2eb88-5213-4b65-b188-d5db5695e500 service nova] Lock "663933b0-95dc-4fba-b411-029f0552571d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:24:25 user nova-compute[75226]: DEBUG nova.compute.manager [req-12ab995e-f828-4c2d-a323-ec5c4a3ad42e req-b9c2eb88-5213-4b65-b188-d5db5695e500 service nova] [instance: 663933b0-95dc-4fba-b411-029f0552571d] No waiting events found dispatching network-vif-unplugged-24888c49-a7a9-4f44-8f95-1174dba77750 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:24:25 user nova-compute[75226]: DEBUG nova.compute.manager [req-12ab995e-f828-4c2d-a323-ec5c4a3ad42e req-b9c2eb88-5213-4b65-b188-d5db5695e500 service nova] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Received event network-vif-unplugged-24888c49-a7a9-4f44-8f95-1174dba77750 for instance with task_state deleting. {{(pid=75226) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 17 01:24:25 user nova-compute[75226]: DEBUG nova.compute.manager [req-12ab995e-f828-4c2d-a323-ec5c4a3ad42e req-b9c2eb88-5213-4b65-b188-d5db5695e500 service nova] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Received event network-vif-plugged-24888c49-a7a9-4f44-8f95-1174dba77750 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:24:25 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-12ab995e-f828-4c2d-a323-ec5c4a3ad42e req-b9c2eb88-5213-4b65-b188-d5db5695e500 service nova] Acquiring lock "663933b0-95dc-4fba-b411-029f0552571d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:24:25 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-12ab995e-f828-4c2d-a323-ec5c4a3ad42e req-b9c2eb88-5213-4b65-b188-d5db5695e500 service nova] Lock "663933b0-95dc-4fba-b411-029f0552571d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:24:25 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-12ab995e-f828-4c2d-a323-ec5c4a3ad42e req-b9c2eb88-5213-4b65-b188-d5db5695e500 service nova] Lock "663933b0-95dc-4fba-b411-029f0552571d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:24:25 user nova-compute[75226]: DEBUG nova.compute.manager [req-12ab995e-f828-4c2d-a323-ec5c4a3ad42e req-b9c2eb88-5213-4b65-b188-d5db5695e500 service nova] [instance: 663933b0-95dc-4fba-b411-029f0552571d] No waiting events found dispatching network-vif-plugged-24888c49-a7a9-4f44-8f95-1174dba77750 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:24:25 user nova-compute[75226]: WARNING nova.compute.manager [req-12ab995e-f828-4c2d-a323-ec5c4a3ad42e req-b9c2eb88-5213-4b65-b188-d5db5695e500 service nova] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Received unexpected event network-vif-plugged-24888c49-a7a9-4f44-8f95-1174dba77750 for instance with vm_state active and task_state deleting.
Nov 17 01:24:25 user nova-compute[75226]: DEBUG nova.compute.manager [req-12ab995e-f828-4c2d-a323-ec5c4a3ad42e req-b9c2eb88-5213-4b65-b188-d5db5695e500 service nova] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Received event network-vif-unplugged-153c3e02-4aa9-4b9f-b03d-229f12e2ed68 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:24:25 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-12ab995e-f828-4c2d-a323-ec5c4a3ad42e req-b9c2eb88-5213-4b65-b188-d5db5695e500 service nova] Acquiring lock "663933b0-95dc-4fba-b411-029f0552571d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:24:25 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-12ab995e-f828-4c2d-a323-ec5c4a3ad42e req-b9c2eb88-5213-4b65-b188-d5db5695e500 service nova] Lock "663933b0-95dc-4fba-b411-029f0552571d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:24:25 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-12ab995e-f828-4c2d-a323-ec5c4a3ad42e req-b9c2eb88-5213-4b65-b188-d5db5695e500 service nova] Lock "663933b0-95dc-4fba-b411-029f0552571d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:24:25 user nova-compute[75226]: DEBUG nova.compute.manager [req-12ab995e-f828-4c2d-a323-ec5c4a3ad42e req-b9c2eb88-5213-4b65-b188-d5db5695e500 service nova] [instance: 663933b0-95dc-4fba-b411-029f0552571d] No waiting events found dispatching network-vif-unplugged-153c3e02-4aa9-4b9f-b03d-229f12e2ed68 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:24:25 user nova-compute[75226]: DEBUG nova.compute.manager [req-12ab995e-f828-4c2d-a323-ec5c4a3ad42e req-b9c2eb88-5213-4b65-b188-d5db5695e500 service nova] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Received event network-vif-unplugged-153c3e02-4aa9-4b9f-b03d-229f12e2ed68 for instance with task_state deleting. {{(pid=75226) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 17 01:24:25 user nova-compute[75226]: DEBUG nova.compute.manager [req-12ab995e-f828-4c2d-a323-ec5c4a3ad42e req-b9c2eb88-5213-4b65-b188-d5db5695e500 service nova] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Received event network-vif-plugged-153c3e02-4aa9-4b9f-b03d-229f12e2ed68 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:24:25 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-12ab995e-f828-4c2d-a323-ec5c4a3ad42e req-b9c2eb88-5213-4b65-b188-d5db5695e500 service nova] Acquiring lock "663933b0-95dc-4fba-b411-029f0552571d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:24:25 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-12ab995e-f828-4c2d-a323-ec5c4a3ad42e req-b9c2eb88-5213-4b65-b188-d5db5695e500 service nova] Lock "663933b0-95dc-4fba-b411-029f0552571d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:24:25 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-12ab995e-f828-4c2d-a323-ec5c4a3ad42e req-b9c2eb88-5213-4b65-b188-d5db5695e500 service nova] Lock "663933b0-95dc-4fba-b411-029f0552571d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:24:25 user nova-compute[75226]: DEBUG nova.compute.manager [req-12ab995e-f828-4c2d-a323-ec5c4a3ad42e req-b9c2eb88-5213-4b65-b188-d5db5695e500 service nova] [instance: 663933b0-95dc-4fba-b411-029f0552571d] No waiting events found dispatching network-vif-plugged-153c3e02-4aa9-4b9f-b03d-229f12e2ed68 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:24:25 user nova-compute[75226]: WARNING nova.compute.manager [req-12ab995e-f828-4c2d-a323-ec5c4a3ad42e req-b9c2eb88-5213-4b65-b188-d5db5695e500 service nova] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Received unexpected event network-vif-plugged-153c3e02-4aa9-4b9f-b03d-229f12e2ed68 for instance with vm_state active and task_state deleting.
Nov 17 01:24:25 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:24:25 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:24:25 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:24:25 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:24:26 user nova-compute[75226]: DEBUG nova.compute.manager [req-1b608d6e-b00c-43ab-99d3-c3f16dc00b56 req-8ef7409f-e139-4cdf-a9e5-ceb990116f05 service nova] [instance: ee2187c9-8620-4fd2-ad8a-a054cd8393f3] Received event network-vif-plugged-1057ea4c-2ac4-40fa-8b2e-3b5888ea4d61 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:24:26 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-1b608d6e-b00c-43ab-99d3-c3f16dc00b56 req-8ef7409f-e139-4cdf-a9e5-ceb990116f05 service nova] Acquiring lock "ee2187c9-8620-4fd2-ad8a-a054cd8393f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:24:26 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-1b608d6e-b00c-43ab-99d3-c3f16dc00b56 req-8ef7409f-e139-4cdf-a9e5-ceb990116f05 service nova] Lock "ee2187c9-8620-4fd2-ad8a-a054cd8393f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:24:26 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-1b608d6e-b00c-43ab-99d3-c3f16dc00b56 req-8ef7409f-e139-4cdf-a9e5-ceb990116f05 service nova] Lock "ee2187c9-8620-4fd2-ad8a-a054cd8393f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:24:26 user nova-compute[75226]: DEBUG nova.compute.manager [req-1b608d6e-b00c-43ab-99d3-c3f16dc00b56 req-8ef7409f-e139-4cdf-a9e5-ceb990116f05 service nova] [instance: ee2187c9-8620-4fd2-ad8a-a054cd8393f3] No waiting events found dispatching network-vif-plugged-1057ea4c-2ac4-40fa-8b2e-3b5888ea4d61 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:24:26 user nova-compute[75226]: WARNING nova.compute.manager [req-1b608d6e-b00c-43ab-99d3-c3f16dc00b56 req-8ef7409f-e139-4cdf-a9e5-ceb990116f05 service nova] [instance: ee2187c9-8620-4fd2-ad8a-a054cd8393f3] Received unexpected event network-vif-plugged-1057ea4c-2ac4-40fa-8b2e-3b5888ea4d61 for instance with vm_state building and task_state spawning.
Nov 17 01:24:26 user nova-compute[75226]: DEBUG nova.compute.manager [req-1b608d6e-b00c-43ab-99d3-c3f16dc00b56 req-8ef7409f-e139-4cdf-a9e5-ceb990116f05 service nova] [instance: ee2187c9-8620-4fd2-ad8a-a054cd8393f3] Received event network-vif-plugged-1057ea4c-2ac4-40fa-8b2e-3b5888ea4d61 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:24:26 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-1b608d6e-b00c-43ab-99d3-c3f16dc00b56 req-8ef7409f-e139-4cdf-a9e5-ceb990116f05 service nova] Acquiring lock "ee2187c9-8620-4fd2-ad8a-a054cd8393f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:24:26 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-1b608d6e-b00c-43ab-99d3-c3f16dc00b56 req-8ef7409f-e139-4cdf-a9e5-ceb990116f05 service nova] Lock "ee2187c9-8620-4fd2-ad8a-a054cd8393f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:24:26 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-1b608d6e-b00c-43ab-99d3-c3f16dc00b56 req-8ef7409f-e139-4cdf-a9e5-ceb990116f05 service nova] Lock "ee2187c9-8620-4fd2-ad8a-a054cd8393f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:24:26 user nova-compute[75226]: DEBUG nova.compute.manager [req-1b608d6e-b00c-43ab-99d3-c3f16dc00b56 req-8ef7409f-e139-4cdf-a9e5-ceb990116f05 service nova] [instance: ee2187c9-8620-4fd2-ad8a-a054cd8393f3] No waiting events found dispatching network-vif-plugged-1057ea4c-2ac4-40fa-8b2e-3b5888ea4d61 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:24:26 user nova-compute[75226]: WARNING nova.compute.manager [req-1b608d6e-b00c-43ab-99d3-c3f16dc00b56 req-8ef7409f-e139-4cdf-a9e5-ceb990116f05 service nova] [instance: ee2187c9-8620-4fd2-ad8a-a054cd8393f3] Received unexpected event network-vif-plugged-1057ea4c-2ac4-40fa-8b2e-3b5888ea4d61 for instance with vm_state building and task_state spawning.
Nov 17 01:24:27 user nova-compute[75226]: DEBUG nova.compute.manager [None req-dde3e683-0388-4a41-a371-fe136855fabc tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] [instance: ee2187c9-8620-4fd2-ad8a-a054cd8393f3] Instance event wait completed in 0 seconds for  {{(pid=75226) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 17 01:24:27 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-dde3e683-0388-4a41-a371-fe136855fabc tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] [instance: ee2187c9-8620-4fd2-ad8a-a054cd8393f3] Guest created on hypervisor {{(pid=75226) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 17 01:24:27 user nova-compute[75226]: INFO nova.virt.libvirt.driver [-] [instance: ee2187c9-8620-4fd2-ad8a-a054cd8393f3] Instance spawned successfully.
Nov 17 01:24:27 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-dde3e683-0388-4a41-a371-fe136855fabc tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] [instance: ee2187c9-8620-4fd2-ad8a-a054cd8393f3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 17 01:24:27 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-dde3e683-0388-4a41-a371-fe136855fabc tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] [instance: ee2187c9-8620-4fd2-ad8a-a054cd8393f3] Found default for hw_cdrom_bus of ide {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:24:27 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-dde3e683-0388-4a41-a371-fe136855fabc tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] [instance: ee2187c9-8620-4fd2-ad8a-a054cd8393f3] Found default for hw_disk_bus of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:24:27 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-dde3e683-0388-4a41-a371-fe136855fabc tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] [instance: ee2187c9-8620-4fd2-ad8a-a054cd8393f3] Found default for hw_input_bus of None {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:24:27 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-dde3e683-0388-4a41-a371-fe136855fabc tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] [instance: ee2187c9-8620-4fd2-ad8a-a054cd8393f3] Found default for hw_pointer_model of None {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:24:27 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-dde3e683-0388-4a41-a371-fe136855fabc tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] [instance: ee2187c9-8620-4fd2-ad8a-a054cd8393f3] Found default for hw_video_model of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:24:27 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-dde3e683-0388-4a41-a371-fe136855fabc tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] [instance: ee2187c9-8620-4fd2-ad8a-a054cd8393f3] Found default for hw_vif_model of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:24:27 user nova-compute[75226]: INFO nova.compute.manager [None req-dde3e683-0388-4a41-a371-fe136855fabc tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] [instance: ee2187c9-8620-4fd2-ad8a-a054cd8393f3] Took 7.03 seconds to spawn the instance on the hypervisor.
Nov 17 01:24:27 user nova-compute[75226]: DEBUG nova.compute.manager [None req-dde3e683-0388-4a41-a371-fe136855fabc tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] [instance: ee2187c9-8620-4fd2-ad8a-a054cd8393f3] Checking state {{(pid=75226) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 01:24:27 user nova-compute[75226]: INFO nova.compute.manager [None req-dde3e683-0388-4a41-a371-fe136855fabc tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] [instance: ee2187c9-8620-4fd2-ad8a-a054cd8393f3] Took 7.95 seconds to build instance.
Nov 17 01:24:27 user nova-compute[75226]: DEBUG nova.compute.manager [req-428d1461-ec81-44e4-83f0-4dd46fdbc6f0 req-bd883c9d-0e87-4386-a804-aae6cb7636eb service nova] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Received event network-vif-deleted-46134046-ef40-4332-aa3f-044beaf6f991 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:24:27 user nova-compute[75226]: INFO nova.compute.manager [req-428d1461-ec81-44e4-83f0-4dd46fdbc6f0 req-bd883c9d-0e87-4386-a804-aae6cb7636eb service nova] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Neutron deleted interface 46134046-ef40-4332-aa3f-044beaf6f991; detaching it from the instance and deleting it from the info cache
Nov 17 01:24:27 user nova-compute[75226]: DEBUG nova.network.neutron [req-428d1461-ec81-44e4-83f0-4dd46fdbc6f0 req-bd883c9d-0e87-4386-a804-aae6cb7636eb service nova] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Updating instance_info_cache with network_info: [{"id": "462b7d76-b8d0-4374-8b29-da083c4ec28f", "address": "fa:16:3e:e5:9d:a6", "network": {"id": "3e4d69ef-0f6d-4d32-bcfa-0cae712a750e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1270397153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60fce4eef0d24de0a320670623085bb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap462b7d76-b8", "ovs_interfaceid": "462b7d76-b8d0-4374-8b29-da083c4ec28f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6bcf1322-1aad-4ffa-9231-7273376e4572", "address": "fa:16:3e:74:57:6e", "network": {"id": "a8dd3d50-aad0-4fe6-8986-98d0400bcaec", "bridge": "br-int", "label": "tempest-device-tagging-net1-1117474203", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.96", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "60fce4eef0d24de0a320670623085bb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bcf1322-1a", "ovs_interfaceid": "6bcf1322-1aad-4ffa-9231-7273376e4572", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fbacd963-6a62-4682-89a2-27f92a9f0ff2", "address": "fa:16:3e:34:dd:56", "network": {"id": "a8dd3d50-aad0-4fe6-8986-98d0400bcaec", "bridge": "br-int", "label": "tempest-device-tagging-net1-1117474203", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "60fce4eef0d24de0a320670623085bb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbacd963-6a", "ovs_interfaceid": "fbacd963-6a62-4682-89a2-27f92a9f0ff2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "24888c49-a7a9-4f44-8f95-1174dba77750", "address": "fa:16:3e:38:2a:e5", "network": {"id": "a8dd3d50-aad0-4fe6-8986-98d0400bcaec", "bridge": "br-int", "label": "tempest-device-tagging-net1-1117474203", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "60fce4eef0d24de0a320670623085bb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24888c49-a7", "ovs_interfaceid": "24888c49-a7a9-4f44-8f95-1174dba77750", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5f7ca871-040f-460c-8709-7ca74ca282ba", "address": "fa:16:3e:4b:05:65", "network": {"id": "5cee0137-a429-434d-a7ce-0a8d2f9e41ea", "bridge": "br-int", "label": "tempest-device-tagging-net2-1427092874", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "60fce4eef0d24de0a320670623085bb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f7ca871-04", "ovs_interfaceid": "5f7ca871-040f-460c-8709-7ca74ca282ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "153c3e02-4aa9-4b9f-b03d-229f12e2ed68", "address": "fa:16:3e:a1:1f:ee", "network": {"id": "5cee0137-a429-434d-a7ce-0a8d2f9e41ea", "bridge": "br-int", "label": "tempest-device-tagging-net2-1427092874", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "60fce4eef0d24de0a320670623085bb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap153c3e02-4a", "ovs_interfaceid": "153c3e02-4aa9-4b9f-b03d-229f12e2ed68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:24:27 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-dde3e683-0388-4a41-a371-fe136855fabc tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Lock "ee2187c9-8620-4fd2-ad8a-a054cd8393f3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.091s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:24:27 user nova-compute[75226]: DEBUG nova.compute.manager [req-428d1461-ec81-44e4-83f0-4dd46fdbc6f0 req-bd883c9d-0e87-4386-a804-aae6cb7636eb service nova] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Detach interface failed, port_id=46134046-ef40-4332-aa3f-044beaf6f991, reason: Instance 663933b0-95dc-4fba-b411-029f0552571d could not be found. {{(pid=75226) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 17 01:24:27 user nova-compute[75226]: DEBUG nova.compute.manager [req-428d1461-ec81-44e4-83f0-4dd46fdbc6f0 req-bd883c9d-0e87-4386-a804-aae6cb7636eb service nova] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Received event network-vif-deleted-5f7ca871-040f-460c-8709-7ca74ca282ba {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:24:27 user nova-compute[75226]: INFO nova.compute.manager [req-428d1461-ec81-44e4-83f0-4dd46fdbc6f0 req-bd883c9d-0e87-4386-a804-aae6cb7636eb service nova] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Neutron deleted interface 5f7ca871-040f-460c-8709-7ca74ca282ba; detaching it from the instance and deleting it from the info cache
Nov 17 01:24:27 user nova-compute[75226]: DEBUG nova.network.neutron [req-428d1461-ec81-44e4-83f0-4dd46fdbc6f0 req-bd883c9d-0e87-4386-a804-aae6cb7636eb service nova] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Updating instance_info_cache with network_info: [{"id": "462b7d76-b8d0-4374-8b29-da083c4ec28f", "address": "fa:16:3e:e5:9d:a6", "network": {"id": "3e4d69ef-0f6d-4d32-bcfa-0cae712a750e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1270397153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60fce4eef0d24de0a320670623085bb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap462b7d76-b8", "ovs_interfaceid": "462b7d76-b8d0-4374-8b29-da083c4ec28f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6bcf1322-1aad-4ffa-9231-7273376e4572", "address": "fa:16:3e:74:57:6e", "network": {"id": "a8dd3d50-aad0-4fe6-8986-98d0400bcaec", "bridge": "br-int", "label": "tempest-device-tagging-net1-1117474203", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.96", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "60fce4eef0d24de0a320670623085bb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bcf1322-1a", "ovs_interfaceid": "6bcf1322-1aad-4ffa-9231-7273376e4572", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fbacd963-6a62-4682-89a2-27f92a9f0ff2", "address": "fa:16:3e:34:dd:56", "network": {"id": "a8dd3d50-aad0-4fe6-8986-98d0400bcaec", "bridge": "br-int", "label": "tempest-device-tagging-net1-1117474203", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "60fce4eef0d24de0a320670623085bb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbacd963-6a", "ovs_interfaceid": "fbacd963-6a62-4682-89a2-27f92a9f0ff2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "24888c49-a7a9-4f44-8f95-1174dba77750", "address": "fa:16:3e:38:2a:e5", "network": {"id": "a8dd3d50-aad0-4fe6-8986-98d0400bcaec", "bridge": "br-int", "label": "tempest-device-tagging-net1-1117474203", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "60fce4eef0d24de0a320670623085bb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24888c49-a7", "ovs_interfaceid": "24888c49-a7a9-4f44-8f95-1174dba77750", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "153c3e02-4aa9-4b9f-b03d-229f12e2ed68", "address": "fa:16:3e:a1:1f:ee", "network": {"id": "5cee0137-a429-434d-a7ce-0a8d2f9e41ea", "bridge": "br-int", "label": "tempest-device-tagging-net2-1427092874", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "60fce4eef0d24de0a320670623085bb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap153c3e02-4a", "ovs_interfaceid": "153c3e02-4aa9-4b9f-b03d-229f12e2ed68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:24:27 user nova-compute[75226]: DEBUG nova.compute.manager [req-428d1461-ec81-44e4-83f0-4dd46fdbc6f0 req-bd883c9d-0e87-4386-a804-aae6cb7636eb service nova] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Detach interface failed, port_id=5f7ca871-040f-460c-8709-7ca74ca282ba, reason: Instance 663933b0-95dc-4fba-b411-029f0552571d could not be found. {{(pid=75226) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 17 01:24:27 user nova-compute[75226]: DEBUG nova.compute.manager [req-428d1461-ec81-44e4-83f0-4dd46fdbc6f0 req-bd883c9d-0e87-4386-a804-aae6cb7636eb service nova] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Received event network-vif-deleted-153c3e02-4aa9-4b9f-b03d-229f12e2ed68 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:24:27 user nova-compute[75226]: INFO nova.compute.manager [req-428d1461-ec81-44e4-83f0-4dd46fdbc6f0 req-bd883c9d-0e87-4386-a804-aae6cb7636eb service nova] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Neutron deleted interface 153c3e02-4aa9-4b9f-b03d-229f12e2ed68; detaching it from the instance and deleting it from the info cache
Nov 17 01:24:27 user nova-compute[75226]: DEBUG nova.network.neutron [req-428d1461-ec81-44e4-83f0-4dd46fdbc6f0 req-bd883c9d-0e87-4386-a804-aae6cb7636eb service nova] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Updating instance_info_cache with network_info: [{"id": "462b7d76-b8d0-4374-8b29-da083c4ec28f", "address": "fa:16:3e:e5:9d:a6", "network": {"id": "3e4d69ef-0f6d-4d32-bcfa-0cae712a750e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1270397153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60fce4eef0d24de0a320670623085bb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap462b7d76-b8", "ovs_interfaceid": "462b7d76-b8d0-4374-8b29-da083c4ec28f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6bcf1322-1aad-4ffa-9231-7273376e4572", "address": "fa:16:3e:74:57:6e", "network": {"id": "a8dd3d50-aad0-4fe6-8986-98d0400bcaec", "bridge": "br-int", "label": "tempest-device-tagging-net1-1117474203", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.96", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "60fce4eef0d24de0a320670623085bb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bcf1322-1a", "ovs_interfaceid": "6bcf1322-1aad-4ffa-9231-7273376e4572", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fbacd963-6a62-4682-89a2-27f92a9f0ff2", "address": "fa:16:3e:34:dd:56", "network": {"id": "a8dd3d50-aad0-4fe6-8986-98d0400bcaec", "bridge": "br-int", "label": "tempest-device-tagging-net1-1117474203", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "60fce4eef0d24de0a320670623085bb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbacd963-6a", "ovs_interfaceid": "fbacd963-6a62-4682-89a2-27f92a9f0ff2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "24888c49-a7a9-4f44-8f95-1174dba77750", "address": "fa:16:3e:38:2a:e5", "network": {"id": "a8dd3d50-aad0-4fe6-8986-98d0400bcaec", "bridge": "br-int", "label": "tempest-device-tagging-net1-1117474203", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "60fce4eef0d24de0a320670623085bb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24888c49-a7", "ovs_interfaceid": "24888c49-a7a9-4f44-8f95-1174dba77750", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:24:27 user nova-compute[75226]: DEBUG nova.compute.manager [req-428d1461-ec81-44e4-83f0-4dd46fdbc6f0 req-bd883c9d-0e87-4386-a804-aae6cb7636eb service nova] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Detach interface failed, port_id=153c3e02-4aa9-4b9f-b03d-229f12e2ed68, reason: Instance 663933b0-95dc-4fba-b411-029f0552571d could not be found. {{(pid=75226) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 17 01:24:27 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:24:28 user nova-compute[75226]: DEBUG nova.network.neutron [-] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Updating instance_info_cache with network_info: [] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:24:28 user nova-compute[75226]: INFO nova.compute.manager [-] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Took 3.28 seconds to deallocate network for instance.
Nov 17 01:24:29 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:24:29 user nova-compute[75226]: DEBUG nova.compute.manager [req-4eae9cf5-8d8f-4bcc-8b09-739fdc21f94a req-802b9bb1-a467-4f4e-84b6-569e50f976c6 service nova] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Received event network-vif-deleted-24888c49-a7a9-4f44-8f95-1174dba77750 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:24:29 user nova-compute[75226]: DEBUG nova.compute.manager [req-4eae9cf5-8d8f-4bcc-8b09-739fdc21f94a req-802b9bb1-a467-4f4e-84b6-569e50f976c6 service nova] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Received event network-vif-deleted-462b7d76-b8d0-4374-8b29-da083c4ec28f {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:24:31 user nova-compute[75226]: INFO nova.compute.manager [None req-1e6637d7-5c42-47de-91ed-60a369b68ff3 tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] [instance: 663933b0-95dc-4fba-b411-029f0552571d] Took 2.45 seconds to detach 3 volumes for instance.
Nov 17 01:24:31 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-1e6637d7-5c42-47de-91ed-60a369b68ff3 tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:24:31 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-1e6637d7-5c42-47de-91ed-60a369b68ff3 tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:24:31 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-1e6637d7-5c42-47de-91ed-60a369b68ff3 tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:24:31 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-1e6637d7-5c42-47de-91ed-60a369b68ff3 tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:24:31 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-1e6637d7-5c42-47de-91ed-60a369b68ff3 tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.309s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:24:31 user nova-compute[75226]: INFO nova.scheduler.client.report [None req-1e6637d7-5c42-47de-91ed-60a369b68ff3 tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Deleted allocations for instance 663933b0-95dc-4fba-b411-029f0552571d
Nov 17 01:24:31 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-1e6637d7-5c42-47de-91ed-60a369b68ff3 tempest-TaggedBootDevicesTest_v242-1246897470 tempest-TaggedBootDevicesTest_v242-1246897470-project-member] Lock "663933b0-95dc-4fba-b411-029f0552571d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 10.031s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:24:32 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:24:34 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:24:39 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:24:42 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:24:43 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:24:44 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:24:46 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:24:47 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:24:49 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:24:49 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:24:52 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:24:54 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:24:57 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:24:59 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:24:59 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:24:59 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:25:00 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:25:01 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:25:01 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:25:01 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:25:01 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:25:01 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:25:01 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75226) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 17 01:25:02 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee2187c9-8620-4fd2-ad8a-a054cd8393f3/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:25:02 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee2187c9-8620-4fd2-ad8a-a054cd8393f3/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:25:02 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee2187c9-8620-4fd2-ad8a-a054cd8393f3/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:25:02 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee2187c9-8620-4fd2-ad8a-a054cd8393f3/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:25:02 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38062487-67ca-4962-974f-81456aebe97b/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:25:02 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38062487-67ca-4962-974f-81456aebe97b/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:25:02 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38062487-67ca-4962-974f-81456aebe97b/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:25:02 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38062487-67ca-4962-974f-81456aebe97b/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:25:02 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa84e575-bdad-45b9-80ce-86b1c2826fb0/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:25:03 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa84e575-bdad-45b9-80ce-86b1c2826fb0/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:25:03 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa84e575-bdad-45b9-80ce-86b1c2826fb0/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:25:03 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa84e575-bdad-45b9-80ce-86b1c2826fb0/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:25:03 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fbdd8af-f608-4d73-92d9-ae0586814c1b/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:25:03 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fbdd8af-f608-4d73-92d9-ae0586814c1b/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:25:03 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fbdd8af-f608-4d73-92d9-ae0586814c1b/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:25:03 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fbdd8af-f608-4d73-92d9-ae0586814c1b/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:25:03 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] skipping disk /dev/sdi (vdb) as it is a volume {{(pid=75226) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 01:25:03 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:25:03 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:25:03 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:25:03 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:25:03 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=75226) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 01:25:04 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/777fc3ab-09f0-414b-87f7-c806d2c5865d/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:25:04 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/777fc3ab-09f0-414b-87f7-c806d2c5865d/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:25:04 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/777fc3ab-09f0-414b-87f7-c806d2c5865d/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:25:04 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:25:04 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/777fc3ab-09f0-414b-87f7-c806d2c5865d/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:25:04 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75226) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 01:25:04 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75226) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 01:25:04 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:25:04 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:25:04 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Hypervisor/Node resource view: name=user free_ram=8126MB free_disk=25.156864166259766GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75226) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 17 01:25:04 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:25:04 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:25:04 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance aa84e575-bdad-45b9-80ce-86b1c2826fb0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:25:04 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 6b7e9611-be35-4e51-b886-91a2fac0a653 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:25:04 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:25:04 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 2fbdd8af-f608-4d73-92d9-ae0586814c1b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:25:04 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 38062487-67ca-4962-974f-81456aebe97b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:25:04 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 777fc3ab-09f0-414b-87f7-c806d2c5865d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:25:04 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 346967c5-6945-4cef-9eea-8415cb27c98f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:25:04 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance ee2187c9-8620-4fd2-ad8a-a054cd8393f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:25:04 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75226) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 17 01:25:04 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75226) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 17 01:25:05 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:25:05 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:25:05 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Compute_service record updated for user:user {{(pid=75226) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 17 01:25:05 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.425s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:25:06 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:25:06 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Starting heal instance info cache {{(pid=75226) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 17 01:25:06 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "refresh_cache-6b7e9611-be35-4e51-b886-91a2fac0a653" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:25:06 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquired lock "refresh_cache-6b7e9611-be35-4e51-b886-91a2fac0a653" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:25:06 user nova-compute[75226]: DEBUG nova.network.neutron [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] [instance: 6b7e9611-be35-4e51-b886-91a2fac0a653] Forcefully refreshing network info cache for instance {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 17 01:25:06 user nova-compute[75226]: DEBUG nova.network.neutron [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] [instance: 6b7e9611-be35-4e51-b886-91a2fac0a653] Updating instance_info_cache with network_info: [{"id": "657af53c-fc3a-45ab-81e5-b2eeea1c88d7", "address": "fa:16:3e:91:de:17", "network": {"id": "450540a3-ff7e-42fb-a0a6-808acd749943", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1503678778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6cb6f679ee4468d82cc7fb5d0f67be9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap657af53c-fc", "ovs_interfaceid": "657af53c-fc3a-45ab-81e5-b2eeea1c88d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:25:06 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Releasing lock "refresh_cache-6b7e9611-be35-4e51-b886-91a2fac0a653" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:25:06 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] [instance: 6b7e9611-be35-4e51-b886-91a2fac0a653] Updated the network info_cache for instance {{(pid=75226) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 17 01:25:06 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:25:06 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:25:06 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:25:06 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:25:06 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75226) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 17 01:25:08 user nova-compute[75226]: DEBUG nova.objects.instance [None req-4ef4645d-96f6-4a49-94f3-0e025b3ee790 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Lazy-loading 'flavor' on Instance uuid f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:25:08 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-4ef4645d-96f6-4a49-94f3-0e025b3ee790 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Acquiring lock "refresh_cache-f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:25:08 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-4ef4645d-96f6-4a49-94f3-0e025b3ee790 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Acquired lock "refresh_cache-f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:25:08 user nova-compute[75226]: DEBUG nova.network.neutron [None req-4ef4645d-96f6-4a49-94f3-0e025b3ee790 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] [instance: f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c] Building network info cache for instance {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 01:25:08 user nova-compute[75226]: DEBUG nova.objects.instance [None req-4ef4645d-96f6-4a49-94f3-0e025b3ee790 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Lazy-loading 'info_cache' on Instance uuid f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:25:08 user nova-compute[75226]: DEBUG nova.objects.base [None req-4ef4645d-96f6-4a49-94f3-0e025b3ee790 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Object Instance<f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c> lazy-loaded attributes: flavor,info_cache {{(pid=75226) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 17 01:25:08 user nova-compute[75226]: DEBUG nova.network.neutron [None req-4ef4645d-96f6-4a49-94f3-0e025b3ee790 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] [instance: f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c] Updating instance_info_cache with network_info: [{"id": "ed40e788-7338-4ecd-8204-008d4601131b", "address": "fa:16:3e:69:68:ce", "network": {"id": "c93f11a7-52c6-4379-a1fb-9a002876c221", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-985502177-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "054575d3dc66452091173b4c604b8c96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped40e788-73", "ovs_interfaceid": "ed40e788-7338-4ecd-8204-008d4601131b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:25:08 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-4ef4645d-96f6-4a49-94f3-0e025b3ee790 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Releasing lock "refresh_cache-f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:25:08 user nova-compute[75226]: INFO nova.virt.libvirt.driver [-] [instance: f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c] Instance destroyed successfully.
Nov 17 01:25:08 user nova-compute[75226]: DEBUG nova.objects.instance [None req-4ef4645d-96f6-4a49-94f3-0e025b3ee790 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Lazy-loading 'resources' on Instance uuid f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:25:08 user nova-compute[75226]: DEBUG nova.objects.base [None req-4ef4645d-96f6-4a49-94f3-0e025b3ee790 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Object Instance<f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c> lazy-loaded attributes: flavor,info_cache,resources {{(pid=75226) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 17 01:25:08 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-4ef4645d-96f6-4a49-94f3-0e025b3ee790 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:21:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-980884499',display_name='tempest-AttachVolumeTestJSON-server-980884499',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-980884499',id=14,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEeERZjFkWxmLB8VU7feu2kYsY5hOpCoxndDBoQzV87owC8kzSgAjyPTw83uHfeVmkKFRyeTiQ9M6sBUaGKQxsiszNV9RLzq6OmxLI7Pi6/hF+7Z96DGb0RR92U15Os/9A==',key_name='tempest-keypair-1317105249',keypairs=<?>,launch_index=0,launched_at=2023-11-17T01:21:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='054575d3dc66452091173b4c604b8c96',ramdisk_id='',reservation_id='r-cjk2rxuv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-223132631',owner_user_name='tempest-AttachVolumeTestJSON-223132631-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T01:23:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c30381a66814427ba39e21c024136fee',uuid=f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "ed40e788-7338-4ecd-8204-008d4601131b", "address": "fa:16:3e:69:68:ce", "network": {"id": "c93f11a7-52c6-4379-a1fb-9a002876c221", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-985502177-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "054575d3dc66452091173b4c604b8c96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped40e788-73", "ovs_interfaceid": "ed40e788-7338-4ecd-8204-008d4601131b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 17 01:25:08 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-4ef4645d-96f6-4a49-94f3-0e025b3ee790 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Converting VIF {"id": "ed40e788-7338-4ecd-8204-008d4601131b", "address": "fa:16:3e:69:68:ce", "network": {"id": "c93f11a7-52c6-4379-a1fb-9a002876c221", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-985502177-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "054575d3dc66452091173b4c604b8c96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped40e788-73", "ovs_interfaceid": "ed40e788-7338-4ecd-8204-008d4601131b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:25:08 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-4ef4645d-96f6-4a49-94f3-0e025b3ee790 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:68:ce,bridge_name='br-int',has_traffic_filtering=True,id=ed40e788-7338-4ecd-8204-008d4601131b,network=Network(c93f11a7-52c6-4379-a1fb-9a002876c221),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped40e788-73') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:25:08 user nova-compute[75226]: DEBUG os_vif [None req-4ef4645d-96f6-4a49-94f3-0e025b3ee790 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:68:ce,bridge_name='br-int',has_traffic_filtering=True,id=ed40e788-7338-4ecd-8204-008d4601131b,network=Network(c93f11a7-52c6-4379-a1fb-9a002876c221),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped40e788-73') {{(pid=75226) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 17 01:25:08 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:25:08 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=taped40e788-73, bridge=br-int, if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:25:08 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:25:08 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:25:08 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:25:08 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e1caf1c8-ca88-45f7-9a99-394d22b2cdbf) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:25:08 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:25:08 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:25:08 user nova-compute[75226]: INFO os_vif [None req-4ef4645d-96f6-4a49-94f3-0e025b3ee790 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:68:ce,bridge_name='br-int',has_traffic_filtering=True,id=ed40e788-7338-4ecd-8204-008d4601131b,network=Network(c93f11a7-52c6-4379-a1fb-9a002876c221),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped40e788-73')
Nov 17 01:25:08 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4ef4645d-96f6-4a49-94f3-0e025b3ee790 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] [instance: f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c] calling os-brick to detach iSCSI Volume {{(pid=75226) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 17 01:25:08 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ef4645d-96f6-4a49-94f3-0e025b3ee790 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc4cc36b490>, {'target_iqn': 'iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LKfJojTl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:25:08 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-4ef4645d-96f6-4a49-94f3-0e025b3ee790 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:25:08 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-4ef4645d-96f6-4a49-94f3-0e025b3ee790 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:25:08 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-4ef4645d-96f6-4a49-94f3-0e025b3ee790 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:25:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:25:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:25:08 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[587a8e5e-5561-4438-ac8f-35ffbd08f1a1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1fd0b73a-0d42-4e3d-a4f0-a9936d9bd1d4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c17ed19c-4452-4a79-b36a-07ddcd7d9404\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:25:08 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ef4645d-96f6-4a49-94f3-0e025b3ee790 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 17 01:25:08 user nova-compute[75226]: No targets found.
Nov 17 01:25:08 user nova-compute[75226]: iSNS:
Nov 17 01:25:08 user nova-compute[75226]: No targets found.
Nov 17 01:25:08 user nova-compute[75226]: STATIC:
Nov 17 01:25:08 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:1fd0b73a-0d42-4e3d-a4f0-a9936d9bd1d4
Nov 17 01:25:08 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:25:08 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:25:08 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8
Nov 17 01:25:08 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:25:08 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:25:08 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:c17ed19c-4452-4a79-b36a-07ddcd7d9404
Nov 17 01:25:08 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:25:08 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:25:08 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421
Nov 17 01:25:08 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:25:08 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:25:08 user nova-compute[75226]: FIRMWARE:
Nov 17 01:25:08 user nova-compute[75226]: No targets found.
Nov 17 01:25:08 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:25:08 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ef4645d-96f6-4a49-94f3-0e025b3ee790 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 17 01:25:08 user nova-compute[75226]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 17 01:25:08 user nova-compute[75226]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75226) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 17 01:25:08 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ef4645d-96f6-4a49-94f3-0e025b3ee790 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421', 0)] {{(pid=75226) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 17 01:25:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:25:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:25:08 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[475af5d1-5ca7-4518-af05-feec4f03a012]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1fd0b73a-0d42-4e3d-a4f0-a9936d9bd1d4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c17ed19c-4452-4a79-b36a-07ddcd7d9404\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:25:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:25:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:25:08 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[300401fa-f511-48e3-9bf0-ff202e737578]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fd0b73a-0d42-4e3d-a4f0-a9936d9bd1d4 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c17ed19c-4452-4a79-b36a-07ddcd7d9404 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:25:08 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ef4645d-96f6-4a49-94f3-0e025b3ee790 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)
Nov 17 01:25:08 user nova-compute[75226]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421 (non-flash)
Nov 17 01:25:08 user nova-compute[75226]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fd0b73a-0d42-4e3d-a4f0-a9936d9bd1d4 (non-flash)
Nov 17 01:25:08 user nova-compute[75226]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c17ed19c-4452-4a79-b36a-07ddcd7d9404 (non-flash)
Nov 17 01:25:08 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:25:08 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ef4645d-96f6-4a49-94f3-0e025b3ee790 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)
Nov 17 01:25:08 user nova-compute[75226]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421 (non-flash)
Nov 17 01:25:08 user nova-compute[75226]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fd0b73a-0d42-4e3d-a4f0-a9936d9bd1d4 (non-flash)
Nov 17 01:25:08 user nova-compute[75226]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c17ed19c-4452-4a79-b36a-07ddcd7d9404 (non-flash)
Nov 17 01:25:08 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:25:08 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ef4645d-96f6-4a49-94f3-0e025b3ee790 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc4b420d750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421'): ({'sdh'}, set())}) {{(pid=75226) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 17 01:25:08 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-4ef4645d-96f6-4a49-94f3-0e025b3ee790 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Removing single pathed devices sdh {{(pid=75226) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 17 01:25:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:25:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:25:08 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[39ca47f2-0ca8-452d-928e-3f40bae4e25f]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:25:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:25:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:25:08 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4414609-5215-4ba2-a203-a73f563f0e8d]: (4, ('ok\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:25:08 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-4ef4645d-96f6-4a49-94f3-0e025b3ee790 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Flushing IO for device /dev/sdh {{(pid=75226) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 17 01:25:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:25:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.012s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:25:08 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fbe7e31-5787-49c3-9a3d-743eeed67551]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:25:08 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-4ef4645d-96f6-4a49-94f3-0e025b3ee790 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=75226) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 17 01:25:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:25:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.035s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:25:08 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[098441da-5c9e-4f74-835e-774296c1f07b]: (4, ('1', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:25:08 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-4ef4645d-96f6-4a49-94f3-0e025b3ee790 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=75226) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 17 01:25:08 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-4ef4645d-96f6-4a49-94f3-0e025b3ee790 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] SCSI volumes sdh have been removed. {{(pid=75226) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 17 01:25:08 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ef4645d-96f6-4a49-94f3-0e025b3ee790 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421')] {{(pid=75226) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 17 01:25:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:25:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:25:08 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[92cf6562-4279-4309-a6b5-690edf7ea49f]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:25:08 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ef4645d-96f6-4a49-94f3-0e025b3ee790 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:25:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421 -p 172.16.0.220:3260 --logout {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:25:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:25:08 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[490ec4dc-b8c7-4f8d-b8de-22d4fd198651]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:25:08 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ef4645d-96f6-4a49-94f3-0e025b3ee790 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421, portal: 172.16.0.220,3260]
Nov 17 01:25:08 user nova-compute[75226]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421, portal: 172.16.0.220,3260] successful.
Nov 17 01:25:08 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:25:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421 -p 172.16.0.220:3260 --op delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:25:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:25:08 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd187abe-7fdc-47b9-9d17-7dc8061546ba]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:25:08 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ef4645d-96f6-4a49-94f3-0e025b3ee790 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:25:08 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-4ef4645d-96f6-4a49-94f3-0e025b3ee790 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.284s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:25:08 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ef4645d-96f6-4a49-94f3-0e025b3ee790 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] <== disconnect_volume: return (285ms) None {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:25:08 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4ef4645d-96f6-4a49-94f3-0e025b3ee790 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] [instance: f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c] Disconnected iSCSI Volume {{(pid=75226) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 17 01:25:08 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-4ef4645d-96f6-4a49-94f3-0e025b3ee790 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] [instance: f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c] Start _get_guest_xml network_info=[{"id": "ed40e788-7338-4ecd-8204-008d4601131b", "address": "fa:16:3e:69:68:ce", "network": {"id": "c93f11a7-52c6-4379-a1fb-9a002876c221", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-985502177-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "054575d3dc66452091173b4c604b8c96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped40e788-73", "ovs_interfaceid": "ed40e788-7338-4ecd-8204-008d4601131b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=0b369aea-6f3f-4690-9f01-229b90ab6310,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '0b369aea-6f3f-4690-9f01-229b90ab6310'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'boot_index': None, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LKfJojTl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, 'status': 'reserved', 'instance': 'f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c', 'attached_at': '', 'detached_at': '', 'volume_id': 'dd06256f-5f5b-4cf6-962d-f77749280421', 'serial': 'dd06256f-5f5b-4cf6-962d-f77749280421'}, 'attachment_id': '16d9e736-8829-4dbb-b794-bd5de56c721b', 'device_type': 'disk', 'volume_type': None} {{(pid=75226) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 17 01:25:08 user nova-compute[75226]: DEBUG nova.objects.instance [None req-4ef4645d-96f6-4a49-94f3-0e025b3ee790 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Lazy-loading 'numa_topology' on Instance uuid f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:25:08 user nova-compute[75226]: DEBUG nova.objects.base [None req-4ef4645d-96f6-4a49-94f3-0e025b3ee790 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Object Instance<f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=75226) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 17 01:25:08 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-4ef4645d-96f6-4a49-94f3-0e025b3ee790 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:25:08 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-4ef4645d-96f6-4a49-94f3-0e025b3ee790 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:25:08 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-4ef4645d-96f6-4a49-94f3-0e025b3ee790 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75226) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 17 01:25:08 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-4ef4645d-96f6-4a49-94f3-0e025b3ee790 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] CPU controller missing on host. {{(pid=75226) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 17 01:25:08 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-4ef4645d-96f6-4a49-94f3-0e025b3ee790 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75226) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 17 01:25:08 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-4ef4645d-96f6-4a49-94f3-0e025b3ee790 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] CPU controller found on host. {{(pid=75226) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 17 01:25:08 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-4ef4645d-96f6-4a49-94f3-0e025b3ee790 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75226) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 17 01:25:08 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-4ef4645d-96f6-4a49-94f3-0e025b3ee790 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-17T01:13:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=0b369aea-6f3f-4690-9f01-229b90ab6310,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 17 01:25:08 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-4ef4645d-96f6-4a49-94f3-0e025b3ee790 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Flavor limits 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 17 01:25:08 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-4ef4645d-96f6-4a49-94f3-0e025b3ee790 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Image limits 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 17 01:25:08 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-4ef4645d-96f6-4a49-94f3-0e025b3ee790 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Flavor pref 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 17 01:25:08 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-4ef4645d-96f6-4a49-94f3-0e025b3ee790 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Image pref 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 17 01:25:08 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-4ef4645d-96f6-4a49-94f3-0e025b3ee790 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 17 01:25:08 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-4ef4645d-96f6-4a49-94f3-0e025b3ee790 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 17 01:25:08 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-4ef4645d-96f6-4a49-94f3-0e025b3ee790 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75226) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 17 01:25:08 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-4ef4645d-96f6-4a49-94f3-0e025b3ee790 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Got 1 possible topologies {{(pid=75226) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 17 01:25:08 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-4ef4645d-96f6-4a49-94f3-0e025b3ee790 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 17 01:25:08 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-4ef4645d-96f6-4a49-94f3-0e025b3ee790 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 17 01:25:08 user nova-compute[75226]: DEBUG nova.objects.instance [None req-4ef4645d-96f6-4a49-94f3-0e025b3ee790 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Lazy-loading 'vcpu_model' on Instance uuid f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:25:08 user nova-compute[75226]: DEBUG nova.objects.base [None req-4ef4645d-96f6-4a49-94f3-0e025b3ee790 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Object Instance<f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=75226) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 17 01:25:09 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4ef4645d-96f6-4a49-94f3-0e025b3ee790 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] [instance: f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c] Calling os-brick to attach iSCSI Volume {{(pid=75226) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 17 01:25:09 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ef4645d-96f6-4a49-94f3-0e025b3ee790 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc4cc36b490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LKfJojTl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:25:09 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-4ef4645d-96f6-4a49-94f3-0e025b3ee790 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:25:09 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-4ef4645d-96f6-4a49-94f3-0e025b3ee790 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:25:09 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-4ef4645d-96f6-4a49-94f3-0e025b3ee790 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:25:09 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-4ef4645d-96f6-4a49-94f3-0e025b3ee790 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:25:09 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-4ef4645d-96f6-4a49-94f3-0e025b3ee790 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:25:09 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-4ef4645d-96f6-4a49-94f3-0e025b3ee790 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:25:09 user nova-compute[75226]: INFO os_brick.initiator.connectors.iscsi [None req-4ef4645d-96f6-4a49-94f3-0e025b3ee790 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 17 01:25:09 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421 -p 172.16.0.220:3260 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:25:09 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:25:09 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[02a8939c-8743-45e3-b3da-6bdc1e0df21f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:25:09 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ef4645d-96f6-4a49-94f3-0e025b3ee790 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 17 01:25:09 user nova-compute[75226]:  {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:25:09 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421 -p 172.16.0.220:3260 --interface default --op new {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:25:09 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.016s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:25:09 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed15bd5c-6cf4-4bc1-9509-fead2d6e5197]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421] added\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:25:09 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ef4645d-96f6-4a49-94f3-0e025b3ee790 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421] added
Nov 17 01:25:09 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:25:09 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:25:09 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:25:09 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[89ba1a84-d4ec-475f-87fd-6a89b8184e68]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:25:09 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ef4645d-96f6-4a49-94f3-0e025b3ee790 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:25:09 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:25:09 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:25:09 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7289c87-1826-4696-b120-f3e826d88889]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:25:09 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ef4645d-96f6-4a49-94f3-0e025b3ee790 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:25:09 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LKfJojTl {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:25:09 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LKfJojTl" returned: 0 in 0.016s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:25:09 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[895b544f-c1c1-4de3-9f67-9dfd375effe5]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:25:09 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ef4645d-96f6-4a49-94f3-0e025b3ee790 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LKfJojTl'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:25:09 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:25:09 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:25:09 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[c156b932-97dc-4b19-9913-4af1281557dd]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:25:09 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ef4645d-96f6-4a49-94f3-0e025b3ee790 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:25:09 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:25:09 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:25:09 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb9d9e73-34b2-41a7-8435-ea0f67a9498f]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fd0b73a-0d42-4e3d-a4f0-a9936d9bd1d4 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c17ed19c-4452-4a79-b36a-07ddcd7d9404 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:25:09 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ef4645d-96f6-4a49-94f3-0e025b3ee790 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)
Nov 17 01:25:09 user nova-compute[75226]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fd0b73a-0d42-4e3d-a4f0-a9936d9bd1d4 (non-flash)
Nov 17 01:25:09 user nova-compute[75226]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c17ed19c-4452-4a79-b36a-07ddcd7d9404 (non-flash)
Nov 17 01:25:09 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:25:09 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ef4645d-96f6-4a49-94f3-0e025b3ee790 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)
Nov 17 01:25:09 user nova-compute[75226]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fd0b73a-0d42-4e3d-a4f0-a9936d9bd1d4 (non-flash)
Nov 17 01:25:09 user nova-compute[75226]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c17ed19c-4452-4a79-b36a-07ddcd7d9404 (non-flash)
Nov 17 01:25:09 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:25:09 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421 -p 172.16.0.220:3260 --login {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:25:09 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:25:09 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[8669f6f4-2b27-4527-a890-221452bfad19]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:25:09 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ef4645d-96f6-4a49-94f3-0e025b3ee790 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421, portal: 172.16.0.220,3260]
Nov 17 01:25:09 user nova-compute[75226]: Login to [iface: default, target: iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421, portal: 172.16.0.220,3260] successful.
Nov 17 01:25:09 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:25:09 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:25:09 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:25:09 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[f63bb86c-d76d-49b5-a214-a91f0398aad7]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:25:09 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ef4645d-96f6-4a49-94f3-0e025b3ee790 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:25:09 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:25:09 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:25:09 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[23a74b5c-bd57-47cc-843e-075f9c0111c4]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fd0b73a-0d42-4e3d-a4f0-a9936d9bd1d4 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c17ed19c-4452-4a79-b36a-07ddcd7d9404 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:25:09 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ef4645d-96f6-4a49-94f3-0e025b3ee790 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)
Nov 17 01:25:09 user nova-compute[75226]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fd0b73a-0d42-4e3d-a4f0-a9936d9bd1d4 (non-flash)
Nov 17 01:25:09 user nova-compute[75226]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c17ed19c-4452-4a79-b36a-07ddcd7d9404 (non-flash)
Nov 17 01:25:09 user nova-compute[75226]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421 (non-flash)
Nov 17 01:25:09 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:25:09 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ef4645d-96f6-4a49-94f3-0e025b3ee790 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)
Nov 17 01:25:09 user nova-compute[75226]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fd0b73a-0d42-4e3d-a4f0-a9936d9bd1d4 (non-flash)
Nov 17 01:25:09 user nova-compute[75226]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c17ed19c-4452-4a79-b36a-07ddcd7d9404 (non-flash)
Nov 17 01:25:09 user nova-compute[75226]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421 (non-flash)
Nov 17 01:25:09 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:25:09 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-4ef4645d-96f6-4a49-94f3-0e025b3ee790 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.268s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:25:09 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ef4645d-96f6-4a49-94f3-0e025b3ee790 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Connected to 172.16.0.220:3260 {{(pid=75226) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 17 01:25:09 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-4ef4645d-96f6-4a49-94f3-0e025b3ee790 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] HCTL ('35', '-', '-', 0) found on session 25 with lun 0 {{(pid=75226) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 17 01:25:09 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-4ef4645d-96f6-4a49-94f3-0e025b3ee790 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75226) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 17 01:25:09 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:25:09 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.015s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:25:09 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[2540b15e-68d8-4881-a23c-19b9639ea0ae]: (4, ('- - 0', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:25:09 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-4ef4645d-96f6-4a49-94f3-0e025b3ee790 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Searching for a device in session 25 and hctl ['35', '*', '*', 0] yield: None {{(pid=75226) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 01:25:10 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-4ef4645d-96f6-4a49-94f3-0e025b3ee790 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Searching for a device in session 25 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75226) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 01:25:10 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ef4645d-96f6-4a49-94f3-0e025b3ee790 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LKfJojTl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75226) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 17 01:25:10 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-4ef4645d-96f6-4a49-94f3-0e025b3ee790 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.295s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:25:10 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ef4645d-96f6-4a49-94f3-0e025b3ee790 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] <== connect_volume: return (1296ms) {'type': 'block', 'scsi_wwn': '26461613436323565', 'path': '/dev/sdd'} {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:25:10 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4ef4645d-96f6-4a49-94f3-0e025b3ee790 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] [instance: f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26461613436323565', 'path': '/dev/sdd'} {{(pid=75226) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 17 01:25:10 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-4ef4645d-96f6-4a49-94f3-0e025b3ee790 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:21:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-980884499',display_name='tempest-AttachVolumeTestJSON-server-980884499',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-980884499',id=14,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEeERZjFkWxmLB8VU7feu2kYsY5hOpCoxndDBoQzV87owC8kzSgAjyPTw83uHfeVmkKFRyeTiQ9M6sBUaGKQxsiszNV9RLzq6OmxLI7Pi6/hF+7Z96DGb0RR92U15Os/9A==',key_name='tempest-keypair-1317105249',keypairs=<?>,launch_index=0,launched_at=2023-11-17T01:21:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='054575d3dc66452091173b4c604b8c96',ramdisk_id='',reservation_id='r-cjk2rxuv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-223132631',owner_user_name='tempest-AttachVolumeTestJSON-223132631-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T01:23:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c30381a66814427ba39e21c024136fee',uuid=f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "ed40e788-7338-4ecd-8204-008d4601131b", "address": "fa:16:3e:69:68:ce", "network": {"id": "c93f11a7-52c6-4379-a1fb-9a002876c221", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-985502177-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "054575d3dc66452091173b4c604b8c96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped40e788-73", "ovs_interfaceid": "ed40e788-7338-4ecd-8204-008d4601131b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75226) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 01:25:10 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-4ef4645d-96f6-4a49-94f3-0e025b3ee790 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Converting VIF {"id": "ed40e788-7338-4ecd-8204-008d4601131b", "address": "fa:16:3e:69:68:ce", "network": {"id": "c93f11a7-52c6-4379-a1fb-9a002876c221", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-985502177-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "054575d3dc66452091173b4c604b8c96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped40e788-73", "ovs_interfaceid": "ed40e788-7338-4ecd-8204-008d4601131b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:25:10 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-4ef4645d-96f6-4a49-94f3-0e025b3ee790 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:68:ce,bridge_name='br-int',has_traffic_filtering=True,id=ed40e788-7338-4ecd-8204-008d4601131b,network=Network(c93f11a7-52c6-4379-a1fb-9a002876c221),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped40e788-73') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:25:10 user nova-compute[75226]: DEBUG nova.objects.instance [None req-4ef4645d-96f6-4a49-94f3-0e025b3ee790 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Lazy-loading 'pci_devices' on Instance uuid f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:25:10 user nova-compute[75226]: DEBUG nova.objects.base [None req-4ef4645d-96f6-4a49-94f3-0e025b3ee790 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Object Instance<f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=75226) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 17 01:25:10 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-4ef4645d-96f6-4a49-94f3-0e025b3ee790 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] [instance: f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c] End _get_guest_xml xml=<domain type="kvm">
Nov 17 01:25:10 user nova-compute[75226]:   <uuid>f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c</uuid>
Nov 17 01:25:10 user nova-compute[75226]:   <name>instance-0000000e</name>
Nov 17 01:25:10 user nova-compute[75226]:   <memory>524288</memory>
Nov 17 01:25:10 user nova-compute[75226]:   <vcpu>1</vcpu>
Nov 17 01:25:10 user nova-compute[75226]:   <metadata>
Nov 17 01:25:10 user nova-compute[75226]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 17 01:25:10 user nova-compute[75226]:       <nova:package version="0.0.0"/>
Nov 17 01:25:10 user nova-compute[75226]:       <nova:name>tempest-AttachVolumeTestJSON-server-980884499</nova:name>
Nov 17 01:25:10 user nova-compute[75226]:       <nova:creationTime>2023-11-17 01:25:08</nova:creationTime>
Nov 17 01:25:10 user nova-compute[75226]:       <nova:flavor name="m1.tiny">
Nov 17 01:25:10 user nova-compute[75226]:         <nova:memory>512</nova:memory>
Nov 17 01:25:10 user nova-compute[75226]:         <nova:disk>1</nova:disk>
Nov 17 01:25:10 user nova-compute[75226]:         <nova:swap>0</nova:swap>
Nov 17 01:25:10 user nova-compute[75226]:         <nova:ephemeral>0</nova:ephemeral>
Nov 17 01:25:10 user nova-compute[75226]:         <nova:vcpus>1</nova:vcpus>
Nov 17 01:25:10 user nova-compute[75226]:       </nova:flavor>
Nov 17 01:25:10 user nova-compute[75226]:       <nova:owner>
Nov 17 01:25:10 user nova-compute[75226]:         <nova:user uuid="c30381a66814427ba39e21c024136fee">tempest-AttachVolumeTestJSON-223132631-project-member</nova:user>
Nov 17 01:25:10 user nova-compute[75226]:         <nova:project uuid="054575d3dc66452091173b4c604b8c96">tempest-AttachVolumeTestJSON-223132631</nova:project>
Nov 17 01:25:10 user nova-compute[75226]:       </nova:owner>
Nov 17 01:25:10 user nova-compute[75226]:       <nova:root type="image" uuid="0b369aea-6f3f-4690-9f01-229b90ab6310"/>
Nov 17 01:25:10 user nova-compute[75226]:       <nova:ports>
Nov 17 01:25:10 user nova-compute[75226]:         <nova:port uuid="ed40e788-7338-4ecd-8204-008d4601131b">
Nov 17 01:25:10 user nova-compute[75226]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 17 01:25:10 user nova-compute[75226]:         </nova:port>
Nov 17 01:25:10 user nova-compute[75226]:       </nova:ports>
Nov 17 01:25:10 user nova-compute[75226]:     </nova:instance>
Nov 17 01:25:10 user nova-compute[75226]:   </metadata>
Nov 17 01:25:10 user nova-compute[75226]:   <sysinfo type="smbios">
Nov 17 01:25:10 user nova-compute[75226]:     <system>
Nov 17 01:25:10 user nova-compute[75226]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 17 01:25:10 user nova-compute[75226]:       <entry name="product">OpenStack Nova</entry>
Nov 17 01:25:10 user nova-compute[75226]:       <entry name="version">0.0.0</entry>
Nov 17 01:25:10 user nova-compute[75226]:       <entry name="serial">f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c</entry>
Nov 17 01:25:10 user nova-compute[75226]:       <entry name="uuid">f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c</entry>
Nov 17 01:25:10 user nova-compute[75226]:       <entry name="family">Virtual Machine</entry>
Nov 17 01:25:10 user nova-compute[75226]:     </system>
Nov 17 01:25:10 user nova-compute[75226]:   </sysinfo>
Nov 17 01:25:10 user nova-compute[75226]:   <os>
Nov 17 01:25:10 user nova-compute[75226]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 17 01:25:10 user nova-compute[75226]:     <boot dev="hd"/>
Nov 17 01:25:10 user nova-compute[75226]:     <smbios mode="sysinfo"/>
Nov 17 01:25:10 user nova-compute[75226]:   </os>
Nov 17 01:25:10 user nova-compute[75226]:   <features>
Nov 17 01:25:10 user nova-compute[75226]:     <acpi/>
Nov 17 01:25:10 user nova-compute[75226]:     <apic/>
Nov 17 01:25:10 user nova-compute[75226]:     <vmcoreinfo/>
Nov 17 01:25:10 user nova-compute[75226]:   </features>
Nov 17 01:25:10 user nova-compute[75226]:   <clock offset="utc">
Nov 17 01:25:10 user nova-compute[75226]:     <timer name="pit" tickpolicy="delay"/>
Nov 17 01:25:10 user nova-compute[75226]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 17 01:25:10 user nova-compute[75226]:     <timer name="hpet" present="no"/>
Nov 17 01:25:10 user nova-compute[75226]:   </clock>
Nov 17 01:25:10 user nova-compute[75226]:   <cpu mode="custom" match="exact">
Nov 17 01:25:10 user nova-compute[75226]:     <model>Nehalem</model>
Nov 17 01:25:10 user nova-compute[75226]:     <topology sockets="1" cores="1" threads="1"/>
Nov 17 01:25:10 user nova-compute[75226]:   </cpu>
Nov 17 01:25:10 user nova-compute[75226]:   <devices>
Nov 17 01:25:10 user nova-compute[75226]:     <disk type="file" device="disk">
Nov 17 01:25:10 user nova-compute[75226]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 17 01:25:10 user nova-compute[75226]:       <source file="/opt/stack/data/nova/instances/f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c/disk"/>
Nov 17 01:25:10 user nova-compute[75226]:       <target dev="vda" bus="virtio"/>
Nov 17 01:25:10 user nova-compute[75226]:     </disk>
Nov 17 01:25:10 user nova-compute[75226]:     <disk type="block" device="disk">
Nov 17 01:25:10 user nova-compute[75226]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 01:25:10 user nova-compute[75226]:       <source dev="/dev/sdd"/>
Nov 17 01:25:10 user nova-compute[75226]:       <target dev="vdb" bus="virtio"/>
Nov 17 01:25:10 user nova-compute[75226]:       <serial>dd06256f-5f5b-4cf6-962d-f77749280421</serial>
Nov 17 01:25:10 user nova-compute[75226]:     </disk>
Nov 17 01:25:10 user nova-compute[75226]:     <interface type="ethernet">
Nov 17 01:25:10 user nova-compute[75226]:       <mac address="fa:16:3e:69:68:ce"/>
Nov 17 01:25:10 user nova-compute[75226]:       <model type="virtio"/>
Nov 17 01:25:10 user nova-compute[75226]:       <mtu size="1442"/>
Nov 17 01:25:10 user nova-compute[75226]:       <target dev="taped40e788-73"/>
Nov 17 01:25:10 user nova-compute[75226]:     </interface>
Nov 17 01:25:10 user nova-compute[75226]:     <serial type="pty">
Nov 17 01:25:10 user nova-compute[75226]:       <log file="/opt/stack/data/nova/instances/f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c/console.log" append="off"/>
Nov 17 01:25:10 user nova-compute[75226]:     </serial>
Nov 17 01:25:10 user nova-compute[75226]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 17 01:25:10 user nova-compute[75226]:     <video>
Nov 17 01:25:10 user nova-compute[75226]:       <model type="virtio"/>
Nov 17 01:25:10 user nova-compute[75226]:     </video>
Nov 17 01:25:10 user nova-compute[75226]:     <rng model="virtio">
Nov 17 01:25:10 user nova-compute[75226]:       <backend model="random">/dev/urandom</backend>
Nov 17 01:25:10 user nova-compute[75226]:     </rng>
Nov 17 01:25:10 user nova-compute[75226]:     <controller type="usb" index="0" model="none"/>
Nov 17 01:25:10 user nova-compute[75226]:     <memballoon model="virtio">
Nov 17 01:25:10 user nova-compute[75226]:       <stats period="10"/>
Nov 17 01:25:10 user nova-compute[75226]:     </memballoon>
Nov 17 01:25:10 user nova-compute[75226]:   </devices>
Nov 17 01:25:10 user nova-compute[75226]: </domain>
Nov 17 01:25:10 user nova-compute[75226]:  {{(pid=75226) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 17 01:25:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-4ef4645d-96f6-4a49-94f3-0e025b3ee790 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:25:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-4ef4645d-96f6-4a49-94f3-0e025b3ee790 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:25:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-4ef4645d-96f6-4a49-94f3-0e025b3ee790 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:25:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-4ef4645d-96f6-4a49-94f3-0e025b3ee790 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:25:10 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-4ef4645d-96f6-4a49-94f3-0e025b3ee790 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75226) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 01:25:10 user nova-compute[75226]: DEBUG nova.objects.instance [None req-4ef4645d-96f6-4a49-94f3-0e025b3ee790 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Lazy-loading 'trusted_certs' on Instance uuid f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:25:10 user nova-compute[75226]: DEBUG nova.objects.base [None req-4ef4645d-96f6-4a49-94f3-0e025b3ee790 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Object Instance<f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=75226) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 17 01:25:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-4ef4645d-96f6-4a49-94f3-0e025b3ee790 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:25:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-4ef4645d-96f6-4a49-94f3-0e025b3ee790 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json" returned: 0 in 0.168s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:25:10 user nova-compute[75226]: DEBUG nova.virt.disk.api [None req-4ef4645d-96f6-4a49-94f3-0e025b3ee790 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c/disk. size=1073741824 {{(pid=75226) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 17 01:25:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-4ef4645d-96f6-4a49-94f3-0e025b3ee790 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:25:11 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-4ef4645d-96f6-4a49-94f3-0e025b3ee790 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:25:11 user nova-compute[75226]: DEBUG nova.virt.disk.api [None req-4ef4645d-96f6-4a49-94f3-0e025b3ee790 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Cannot resize image /opt/stack/data/nova/instances/f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c/disk to a smaller size. {{(pid=75226) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 17 01:25:11 user nova-compute[75226]: DEBUG nova.objects.instance [None req-4ef4645d-96f6-4a49-94f3-0e025b3ee790 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Lazy-loading 'migration_context' on Instance uuid f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:25:11 user nova-compute[75226]: DEBUG nova.objects.base [None req-4ef4645d-96f6-4a49-94f3-0e025b3ee790 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Object Instance<f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75226) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 17 01:25:11 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-4ef4645d-96f6-4a49-94f3-0e025b3ee790 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:21:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-980884499',display_name='tempest-AttachVolumeTestJSON-server-980884499',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-980884499',id=14,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEeERZjFkWxmLB8VU7feu2kYsY5hOpCoxndDBoQzV87owC8kzSgAjyPTw83uHfeVmkKFRyeTiQ9M6sBUaGKQxsiszNV9RLzq6OmxLI7Pi6/hF+7Z96DGb0RR92U15Os/9A==',key_name='tempest-keypair-1317105249',keypairs=<?>,launch_index=0,launched_at=2023-11-17T01:21:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='054575d3dc66452091173b4c604b8c96',ramdisk_id='',reservation_id='r-cjk2rxuv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-223132631',owner_user_name='tempest-AttachVolumeTestJSON-223132631-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T01:23:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c30381a66814427ba39e21c024136fee',uuid=f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "ed40e788-7338-4ecd-8204-008d4601131b", "address": "fa:16:3e:69:68:ce", "network": {"id": "c93f11a7-52c6-4379-a1fb-9a002876c221", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-985502177-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "054575d3dc66452091173b4c604b8c96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped40e788-73", "ovs_interfaceid": "ed40e788-7338-4ecd-8204-008d4601131b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 17 01:25:11 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-4ef4645d-96f6-4a49-94f3-0e025b3ee790 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Converting VIF {"id": "ed40e788-7338-4ecd-8204-008d4601131b", "address": "fa:16:3e:69:68:ce", "network": {"id": "c93f11a7-52c6-4379-a1fb-9a002876c221", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-985502177-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "054575d3dc66452091173b4c604b8c96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped40e788-73", "ovs_interfaceid": "ed40e788-7338-4ecd-8204-008d4601131b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:25:11 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-4ef4645d-96f6-4a49-94f3-0e025b3ee790 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:68:ce,bridge_name='br-int',has_traffic_filtering=True,id=ed40e788-7338-4ecd-8204-008d4601131b,network=Network(c93f11a7-52c6-4379-a1fb-9a002876c221),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped40e788-73') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:25:11 user nova-compute[75226]: DEBUG os_vif [None req-4ef4645d-96f6-4a49-94f3-0e025b3ee790 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:68:ce,bridge_name='br-int',has_traffic_filtering=True,id=ed40e788-7338-4ecd-8204-008d4601131b,network=Network(c93f11a7-52c6-4379-a1fb-9a002876c221),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped40e788-73') {{(pid=75226) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 17 01:25:11 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:25:11 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:25:11 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 17 01:25:11 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:25:11 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'afe1cc5f-9cdf-5f89-b0f4-4864cb3a3601', '_type': 'linux-noop'}}, row=False) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:25:11 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:25:11 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:25:11 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:25:11 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=taped40e788-73, may_exist=True, interface_attrs={}) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:25:11 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=taped40e788-73, col_values=(('qos', UUID('ef75a5d2-c72b-4f9a-91ee-8af4081732d5')),), if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:25:11 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=taped40e788-73, col_values=(('external_ids', {'iface-id': 'ed40e788-7338-4ecd-8204-008d4601131b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:69:68:ce', 'vm-uuid': 'f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c'}),), if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:25:11 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:25:11 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:25:11 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:25:11 user nova-compute[75226]: INFO os_vif [None req-4ef4645d-96f6-4a49-94f3-0e025b3ee790 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:68:ce,bridge_name='br-int',has_traffic_filtering=True,id=ed40e788-7338-4ecd-8204-008d4601131b,network=Network(c93f11a7-52c6-4379-a1fb-9a002876c221),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped40e788-73')
Nov 17 01:25:12 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:25:12 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:25:12 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:25:12 user nova-compute[75226]: DEBUG nova.compute.manager [req-72cf86ab-de4e-41b0-b62a-08502ac24c03 req-e89cf261-2326-4cf8-b62d-3eca58434236 service nova] [instance: f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c] Received event network-vif-plugged-ed40e788-7338-4ecd-8204-008d4601131b {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:25:12 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-72cf86ab-de4e-41b0-b62a-08502ac24c03 req-e89cf261-2326-4cf8-b62d-3eca58434236 service nova] Acquiring lock "f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:25:12 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-72cf86ab-de4e-41b0-b62a-08502ac24c03 req-e89cf261-2326-4cf8-b62d-3eca58434236 service nova] Lock "f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:25:12 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-72cf86ab-de4e-41b0-b62a-08502ac24c03 req-e89cf261-2326-4cf8-b62d-3eca58434236 service nova] Lock "f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:25:12 user nova-compute[75226]: DEBUG nova.compute.manager [req-72cf86ab-de4e-41b0-b62a-08502ac24c03 req-e89cf261-2326-4cf8-b62d-3eca58434236 service nova] [instance: f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c] No waiting events found dispatching network-vif-plugged-ed40e788-7338-4ecd-8204-008d4601131b {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:25:12 user nova-compute[75226]: WARNING nova.compute.manager [req-72cf86ab-de4e-41b0-b62a-08502ac24c03 req-e89cf261-2326-4cf8-b62d-3eca58434236 service nova] [instance: f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c] Received unexpected event network-vif-plugged-ed40e788-7338-4ecd-8204-008d4601131b for instance with vm_state stopped and task_state powering-on.
Nov 17 01:25:13 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:25:13 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:25:14 user nova-compute[75226]: DEBUG nova.compute.manager [req-6e0b7318-e016-475c-bd14-d3b4c7582433 req-1f2c9f86-b2e9-47ca-ba6f-1dc91e7e1b86 service nova] [instance: f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c] Received event network-vif-plugged-ed40e788-7338-4ecd-8204-008d4601131b {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:25:14 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-6e0b7318-e016-475c-bd14-d3b4c7582433 req-1f2c9f86-b2e9-47ca-ba6f-1dc91e7e1b86 service nova] Acquiring lock "f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:25:14 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-6e0b7318-e016-475c-bd14-d3b4c7582433 req-1f2c9f86-b2e9-47ca-ba6f-1dc91e7e1b86 service nova] Lock "f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:25:14 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-6e0b7318-e016-475c-bd14-d3b4c7582433 req-1f2c9f86-b2e9-47ca-ba6f-1dc91e7e1b86 service nova] Lock "f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:25:14 user nova-compute[75226]: DEBUG nova.compute.manager [req-6e0b7318-e016-475c-bd14-d3b4c7582433 req-1f2c9f86-b2e9-47ca-ba6f-1dc91e7e1b86 service nova] [instance: f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c] No waiting events found dispatching network-vif-plugged-ed40e788-7338-4ecd-8204-008d4601131b {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:25:14 user nova-compute[75226]: WARNING nova.compute.manager [req-6e0b7318-e016-475c-bd14-d3b4c7582433 req-1f2c9f86-b2e9-47ca-ba6f-1dc91e7e1b86 service nova] [instance: f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c] Received unexpected event network-vif-plugged-ed40e788-7338-4ecd-8204-008d4601131b for instance with vm_state stopped and task_state powering-on.
Nov 17 01:25:14 user nova-compute[75226]: DEBUG nova.compute.manager [None req-4ef4645d-96f6-4a49-94f3-0e025b3ee790 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] [instance: f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c] Instance event wait completed in 0 seconds for  {{(pid=75226) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 17 01:25:14 user nova-compute[75226]: INFO nova.virt.libvirt.driver [-] [instance: f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c] Instance rebooted successfully.
Nov 17 01:25:14 user nova-compute[75226]: DEBUG nova.compute.manager [None req-4ef4645d-96f6-4a49-94f3-0e025b3ee790 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] [instance: f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c] Checking state {{(pid=75226) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 01:25:14 user nova-compute[75226]: DEBUG nova.compute.manager [req-5d20fb50-25ca-4704-a486-8fc7ca00a9e5 req-bf528c36-c526-428d-8134-84ff78d94aad service nova] [instance: 777fc3ab-09f0-414b-87f7-c806d2c5865d] Received event network-changed-72933cfe-e7c5-4e9e-a412-1a8fc994e629 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:25:14 user nova-compute[75226]: DEBUG nova.compute.manager [req-5d20fb50-25ca-4704-a486-8fc7ca00a9e5 req-bf528c36-c526-428d-8134-84ff78d94aad service nova] [instance: 777fc3ab-09f0-414b-87f7-c806d2c5865d] Refreshing instance network info cache due to event network-changed-72933cfe-e7c5-4e9e-a412-1a8fc994e629. {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 01:25:14 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-5d20fb50-25ca-4704-a486-8fc7ca00a9e5 req-bf528c36-c526-428d-8134-84ff78d94aad service nova] Acquiring lock "refresh_cache-777fc3ab-09f0-414b-87f7-c806d2c5865d" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:25:14 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-5d20fb50-25ca-4704-a486-8fc7ca00a9e5 req-bf528c36-c526-428d-8134-84ff78d94aad service nova] Acquired lock "refresh_cache-777fc3ab-09f0-414b-87f7-c806d2c5865d" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:25:14 user nova-compute[75226]: DEBUG nova.network.neutron [req-5d20fb50-25ca-4704-a486-8fc7ca00a9e5 req-bf528c36-c526-428d-8134-84ff78d94aad service nova] [instance: 777fc3ab-09f0-414b-87f7-c806d2c5865d] Refreshing network info cache for port 72933cfe-e7c5-4e9e-a412-1a8fc994e629 {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 01:25:15 user nova-compute[75226]: DEBUG nova.network.neutron [req-5d20fb50-25ca-4704-a486-8fc7ca00a9e5 req-bf528c36-c526-428d-8134-84ff78d94aad service nova] [instance: 777fc3ab-09f0-414b-87f7-c806d2c5865d] Updated VIF entry in instance network info cache for port 72933cfe-e7c5-4e9e-a412-1a8fc994e629. {{(pid=75226) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 01:25:15 user nova-compute[75226]: DEBUG nova.network.neutron [req-5d20fb50-25ca-4704-a486-8fc7ca00a9e5 req-bf528c36-c526-428d-8134-84ff78d94aad service nova] [instance: 777fc3ab-09f0-414b-87f7-c806d2c5865d] Updating instance_info_cache with network_info: [{"id": "72933cfe-e7c5-4e9e-a412-1a8fc994e629", "address": "fa:16:3e:d8:a4:f2", "network": {"id": "57d0e7ee-0b11-4e00-86f9-bb4a3c25c674", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1357446034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e38777e8baf745e79f31190da97406a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72933cfe-e7", "ovs_interfaceid": "72933cfe-e7c5-4e9e-a412-1a8fc994e629", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:25:15 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-5d20fb50-25ca-4704-a486-8fc7ca00a9e5 req-bf528c36-c526-428d-8134-84ff78d94aad service nova] Releasing lock "refresh_cache-777fc3ab-09f0-414b-87f7-c806d2c5865d" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:25:15 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-cf28fef8-ffb8-4d0c-a93e-8ca14e6330b3 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Acquiring lock "777fc3ab-09f0-414b-87f7-c806d2c5865d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:25:15 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-cf28fef8-ffb8-4d0c-a93e-8ca14e6330b3 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Lock "777fc3ab-09f0-414b-87f7-c806d2c5865d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:25:15 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-cf28fef8-ffb8-4d0c-a93e-8ca14e6330b3 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Acquiring lock "777fc3ab-09f0-414b-87f7-c806d2c5865d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:25:15 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-cf28fef8-ffb8-4d0c-a93e-8ca14e6330b3 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Lock "777fc3ab-09f0-414b-87f7-c806d2c5865d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:25:15 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-cf28fef8-ffb8-4d0c-a93e-8ca14e6330b3 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Lock "777fc3ab-09f0-414b-87f7-c806d2c5865d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:25:15 user nova-compute[75226]: INFO nova.compute.manager [None req-cf28fef8-ffb8-4d0c-a93e-8ca14e6330b3 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: 777fc3ab-09f0-414b-87f7-c806d2c5865d] Terminating instance
Nov 17 01:25:15 user nova-compute[75226]: DEBUG nova.compute.manager [None req-cf28fef8-ffb8-4d0c-a93e-8ca14e6330b3 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: 777fc3ab-09f0-414b-87f7-c806d2c5865d] Start destroying the instance on the hypervisor. {{(pid=75226) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 17 01:25:15 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:25:15 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:25:15 user nova-compute[75226]: DEBUG nova.compute.manager [req-6ff16ee3-15ae-440b-9f50-6c1b6d2503da req-1cec645e-836c-4a94-b0a2-4e238ce06137 service nova] [instance: 777fc3ab-09f0-414b-87f7-c806d2c5865d] Received event network-vif-unplugged-72933cfe-e7c5-4e9e-a412-1a8fc994e629 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:25:15 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-6ff16ee3-15ae-440b-9f50-6c1b6d2503da req-1cec645e-836c-4a94-b0a2-4e238ce06137 service nova] Acquiring lock "777fc3ab-09f0-414b-87f7-c806d2c5865d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:25:15 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-6ff16ee3-15ae-440b-9f50-6c1b6d2503da req-1cec645e-836c-4a94-b0a2-4e238ce06137 service nova] Lock "777fc3ab-09f0-414b-87f7-c806d2c5865d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:25:15 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-6ff16ee3-15ae-440b-9f50-6c1b6d2503da req-1cec645e-836c-4a94-b0a2-4e238ce06137 service nova] Lock "777fc3ab-09f0-414b-87f7-c806d2c5865d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:25:15 user nova-compute[75226]: DEBUG nova.compute.manager [req-6ff16ee3-15ae-440b-9f50-6c1b6d2503da req-1cec645e-836c-4a94-b0a2-4e238ce06137 service nova] [instance: 777fc3ab-09f0-414b-87f7-c806d2c5865d] No waiting events found dispatching network-vif-unplugged-72933cfe-e7c5-4e9e-a412-1a8fc994e629 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:25:15 user nova-compute[75226]: DEBUG nova.compute.manager [req-6ff16ee3-15ae-440b-9f50-6c1b6d2503da req-1cec645e-836c-4a94-b0a2-4e238ce06137 service nova] [instance: 777fc3ab-09f0-414b-87f7-c806d2c5865d] Received event network-vif-unplugged-72933cfe-e7c5-4e9e-a412-1a8fc994e629 for instance with task_state deleting. {{(pid=75226) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 17 01:25:15 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:25:15 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:25:16 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:25:16 user nova-compute[75226]: INFO nova.virt.libvirt.driver [-] [instance: 777fc3ab-09f0-414b-87f7-c806d2c5865d] Instance destroyed successfully.
Nov 17 01:25:16 user nova-compute[75226]: DEBUG nova.objects.instance [None req-cf28fef8-ffb8-4d0c-a93e-8ca14e6330b3 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Lazy-loading 'resources' on Instance uuid 777fc3ab-09f0-414b-87f7-c806d2c5865d {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:25:16 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-cf28fef8-ffb8-4d0c-a93e-8ca14e6330b3 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:23:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1306164410',display_name='tempest-AttachVolumeNegativeTest-server-1306164410',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1306164410',id=19,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNUQtuh3GpDt7mFZ41UwCB3hiK9pnZjRmaYlnAvfOGFthCUStkSU7N8JREFUo5HUL+8mgtOWM3c5bQnRfdijPDC4w0AaH+XVCgcAV+mmqFIyH7RKvwT/5vtUkvtqZ5jLHw==',key_name='tempest-keypair-260655181',keypairs=<?>,launch_index=0,launched_at=2023-11-17T01:23:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e38777e8baf745e79f31190da97406a0',ramdisk_id='',reservation_id='r-x54gz0ff',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-940905741',owner_user_name='tempest-AttachVolumeNegativeTest-940905741-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T01:23:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='642db538240b4ca1a367cf4ee9714f66',uuid=777fc3ab-09f0-414b-87f7-c806d2c5865d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "72933cfe-e7c5-4e9e-a412-1a8fc994e629", "address": "fa:16:3e:d8:a4:f2", "network": {"id": "57d0e7ee-0b11-4e00-86f9-bb4a3c25c674", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1357446034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e38777e8baf745e79f31190da97406a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72933cfe-e7", "ovs_interfaceid": "72933cfe-e7c5-4e9e-a412-1a8fc994e629", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 17 01:25:16 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-cf28fef8-ffb8-4d0c-a93e-8ca14e6330b3 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Converting VIF {"id": "72933cfe-e7c5-4e9e-a412-1a8fc994e629", "address": "fa:16:3e:d8:a4:f2", "network": {"id": "57d0e7ee-0b11-4e00-86f9-bb4a3c25c674", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1357446034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e38777e8baf745e79f31190da97406a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72933cfe-e7", "ovs_interfaceid": "72933cfe-e7c5-4e9e-a412-1a8fc994e629", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:25:16 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-cf28fef8-ffb8-4d0c-a93e-8ca14e6330b3 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d8:a4:f2,bridge_name='br-int',has_traffic_filtering=True,id=72933cfe-e7c5-4e9e-a412-1a8fc994e629,network=Network(57d0e7ee-0b11-4e00-86f9-bb4a3c25c674),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72933cfe-e7') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:25:16 user nova-compute[75226]: DEBUG os_vif [None req-cf28fef8-ffb8-4d0c-a93e-8ca14e6330b3 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d8:a4:f2,bridge_name='br-int',has_traffic_filtering=True,id=72933cfe-e7c5-4e9e-a412-1a8fc994e629,network=Network(57d0e7ee-0b11-4e00-86f9-bb4a3c25c674),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72933cfe-e7') {{(pid=75226) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 17 01:25:16 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:25:16 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap72933cfe-e7, bridge=br-int, if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:25:16 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:25:16 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:25:16 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:25:16 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cf6fcff1-9658-4dc9-9e89-545175dfab3b) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:25:16 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:25:16 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:25:16 user nova-compute[75226]: INFO os_vif [None req-cf28fef8-ffb8-4d0c-a93e-8ca14e6330b3 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d8:a4:f2,bridge_name='br-int',has_traffic_filtering=True,id=72933cfe-e7c5-4e9e-a412-1a8fc994e629,network=Network(57d0e7ee-0b11-4e00-86f9-bb4a3c25c674),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72933cfe-e7')
Nov 17 01:25:16 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-cf28fef8-ffb8-4d0c-a93e-8ca14e6330b3 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: 777fc3ab-09f0-414b-87f7-c806d2c5865d] Deleting instance files /opt/stack/data/nova/instances/777fc3ab-09f0-414b-87f7-c806d2c5865d_del
Nov 17 01:25:16 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-cf28fef8-ffb8-4d0c-a93e-8ca14e6330b3 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: 777fc3ab-09f0-414b-87f7-c806d2c5865d] Deletion of /opt/stack/data/nova/instances/777fc3ab-09f0-414b-87f7-c806d2c5865d_del complete
Nov 17 01:25:16 user nova-compute[75226]: INFO nova.compute.manager [None req-cf28fef8-ffb8-4d0c-a93e-8ca14e6330b3 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: 777fc3ab-09f0-414b-87f7-c806d2c5865d] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 17 01:25:16 user nova-compute[75226]: DEBUG oslo.service.loopingcall [None req-cf28fef8-ffb8-4d0c-a93e-8ca14e6330b3 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75226) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 17 01:25:16 user nova-compute[75226]: DEBUG nova.compute.manager [-] [instance: 777fc3ab-09f0-414b-87f7-c806d2c5865d] Deallocating network for instance {{(pid=75226) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 17 01:25:16 user nova-compute[75226]: DEBUG nova.network.neutron [-] [instance: 777fc3ab-09f0-414b-87f7-c806d2c5865d] deallocate_for_instance() {{(pid=75226) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 17 01:25:16 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:25:17 user nova-compute[75226]: DEBUG nova.network.neutron [-] [instance: 777fc3ab-09f0-414b-87f7-c806d2c5865d] Updating instance_info_cache with network_info: [] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:25:17 user nova-compute[75226]: INFO nova.compute.manager [-] [instance: 777fc3ab-09f0-414b-87f7-c806d2c5865d] Took 0.76 seconds to deallocate network for instance.
Nov 17 01:25:17 user nova-compute[75226]: DEBUG nova.compute.manager [req-1bb2f248-9df1-48b1-8fda-815946435ace req-e6c9c3ae-007c-449d-95c0-56976177a337 service nova] [instance: 777fc3ab-09f0-414b-87f7-c806d2c5865d] Received event network-vif-deleted-72933cfe-e7c5-4e9e-a412-1a8fc994e629 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:25:17 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-cf28fef8-ffb8-4d0c-a93e-8ca14e6330b3 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:25:17 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-cf28fef8-ffb8-4d0c-a93e-8ca14e6330b3 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:25:17 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-cf28fef8-ffb8-4d0c-a93e-8ca14e6330b3 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:25:17 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-cf28fef8-ffb8-4d0c-a93e-8ca14e6330b3 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:25:17 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-cf28fef8-ffb8-4d0c-a93e-8ca14e6330b3 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.407s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:25:17 user nova-compute[75226]: INFO nova.scheduler.client.report [None req-cf28fef8-ffb8-4d0c-a93e-8ca14e6330b3 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Deleted allocations for instance 777fc3ab-09f0-414b-87f7-c806d2c5865d
Nov 17 01:25:17 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-cf28fef8-ffb8-4d0c-a93e-8ca14e6330b3 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Lock "777fc3ab-09f0-414b-87f7-c806d2c5865d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.287s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:25:17 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:25:17 user nova-compute[75226]: DEBUG nova.compute.manager [req-f1f30dae-7df4-4c15-8681-3d1172b2506a req-782d4bfc-cdc4-4928-a64c-02d67ab3a005 service nova] [instance: 777fc3ab-09f0-414b-87f7-c806d2c5865d] Received event network-vif-plugged-72933cfe-e7c5-4e9e-a412-1a8fc994e629 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:25:17 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-f1f30dae-7df4-4c15-8681-3d1172b2506a req-782d4bfc-cdc4-4928-a64c-02d67ab3a005 service nova] Acquiring lock "777fc3ab-09f0-414b-87f7-c806d2c5865d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:25:17 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-f1f30dae-7df4-4c15-8681-3d1172b2506a req-782d4bfc-cdc4-4928-a64c-02d67ab3a005 service nova] Lock "777fc3ab-09f0-414b-87f7-c806d2c5865d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:25:17 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-f1f30dae-7df4-4c15-8681-3d1172b2506a req-782d4bfc-cdc4-4928-a64c-02d67ab3a005 service nova] Lock "777fc3ab-09f0-414b-87f7-c806d2c5865d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:25:17 user nova-compute[75226]: DEBUG nova.compute.manager [req-f1f30dae-7df4-4c15-8681-3d1172b2506a req-782d4bfc-cdc4-4928-a64c-02d67ab3a005 service nova] [instance: 777fc3ab-09f0-414b-87f7-c806d2c5865d] No waiting events found dispatching network-vif-plugged-72933cfe-e7c5-4e9e-a412-1a8fc994e629 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:25:17 user nova-compute[75226]: WARNING nova.compute.manager [req-f1f30dae-7df4-4c15-8681-3d1172b2506a req-782d4bfc-cdc4-4928-a64c-02d67ab3a005 service nova] [instance: 777fc3ab-09f0-414b-87f7-c806d2c5865d] Received unexpected event network-vif-plugged-72933cfe-e7c5-4e9e-a412-1a8fc994e629 for instance with vm_state deleted and task_state None.
Nov 17 01:25:21 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:25:22 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:25:24 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:25:25 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-ec5a6b6c-3f19-402f-93d6-64df670027f3 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] Acquiring lock "4050d898-f2b8-46c2-86e3-702ceb41a701" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:25:25 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-ec5a6b6c-3f19-402f-93d6-64df670027f3 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] Lock "4050d898-f2b8-46c2-86e3-702ceb41a701" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:25:25 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:25:25 user nova-compute[75226]: DEBUG nova.compute.manager [None req-ec5a6b6c-3f19-402f-93d6-64df670027f3 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] [instance: 4050d898-f2b8-46c2-86e3-702ceb41a701] Starting instance... {{(pid=75226) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 17 01:25:25 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-ec5a6b6c-3f19-402f-93d6-64df670027f3 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:25:25 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-ec5a6b6c-3f19-402f-93d6-64df670027f3 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:25:25 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-ec5a6b6c-3f19-402f-93d6-64df670027f3 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75226) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 17 01:25:25 user nova-compute[75226]: INFO nova.compute.claims [None req-ec5a6b6c-3f19-402f-93d6-64df670027f3 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] [instance: 4050d898-f2b8-46c2-86e3-702ceb41a701] Claim successful on node user
Nov 17 01:25:26 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-ec5a6b6c-3f19-402f-93d6-64df670027f3 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:25:26 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-ec5a6b6c-3f19-402f-93d6-64df670027f3 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:25:26 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:25:26 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-ec5a6b6c-3f19-402f-93d6-64df670027f3 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.394s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:25:26 user nova-compute[75226]: DEBUG nova.compute.manager [None req-ec5a6b6c-3f19-402f-93d6-64df670027f3 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] [instance: 4050d898-f2b8-46c2-86e3-702ceb41a701] Start building networks asynchronously for instance. {{(pid=75226) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 17 01:25:26 user nova-compute[75226]: DEBUG nova.compute.manager [None req-ec5a6b6c-3f19-402f-93d6-64df670027f3 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] [instance: 4050d898-f2b8-46c2-86e3-702ceb41a701] Allocating IP information in the background. {{(pid=75226) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 17 01:25:26 user nova-compute[75226]: DEBUG nova.network.neutron [None req-ec5a6b6c-3f19-402f-93d6-64df670027f3 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] [instance: 4050d898-f2b8-46c2-86e3-702ceb41a701] allocate_for_instance() {{(pid=75226) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 17 01:25:26 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-ec5a6b6c-3f19-402f-93d6-64df670027f3 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] [instance: 4050d898-f2b8-46c2-86e3-702ceb41a701] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 17 01:25:26 user nova-compute[75226]: DEBUG nova.compute.manager [None req-ec5a6b6c-3f19-402f-93d6-64df670027f3 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] [instance: 4050d898-f2b8-46c2-86e3-702ceb41a701] Start building block device mappings for instance. {{(pid=75226) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 17 01:25:26 user nova-compute[75226]: DEBUG nova.policy [None req-ec5a6b6c-3f19-402f-93d6-64df670027f3 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '202fa7cd113b42f2b95bc2314255392e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd69aa270fc5b4749a65ea70c7ef30958', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75226) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 17 01:25:26 user nova-compute[75226]: DEBUG nova.compute.manager [None req-ec5a6b6c-3f19-402f-93d6-64df670027f3 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] [instance: 4050d898-f2b8-46c2-86e3-702ceb41a701] Start spawning the instance on the hypervisor. {{(pid=75226) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 17 01:25:26 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-ec5a6b6c-3f19-402f-93d6-64df670027f3 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] [instance: 4050d898-f2b8-46c2-86e3-702ceb41a701] Creating instance directory {{(pid=75226) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 17 01:25:26 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-ec5a6b6c-3f19-402f-93d6-64df670027f3 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] [instance: 4050d898-f2b8-46c2-86e3-702ceb41a701] Creating image(s)
Nov 17 01:25:26 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-ec5a6b6c-3f19-402f-93d6-64df670027f3 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] Acquiring lock "/opt/stack/data/nova/instances/4050d898-f2b8-46c2-86e3-702ceb41a701/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:25:26 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-ec5a6b6c-3f19-402f-93d6-64df670027f3 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] Lock "/opt/stack/data/nova/instances/4050d898-f2b8-46c2-86e3-702ceb41a701/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:25:26 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-ec5a6b6c-3f19-402f-93d6-64df670027f3 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] Lock "/opt/stack/data/nova/instances/4050d898-f2b8-46c2-86e3-702ceb41a701/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:25:26 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-ec5a6b6c-3f19-402f-93d6-64df670027f3 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:25:26 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-ec5a6b6c-3f19-402f-93d6-64df670027f3 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json" returned: 0 in 0.188s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:25:26 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-ec5a6b6c-3f19-402f-93d6-64df670027f3 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] Acquiring lock "a8a62c2546af3a2036b853250c5ac64d4c6b4371" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:25:26 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-ec5a6b6c-3f19-402f-93d6-64df670027f3 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] Lock "a8a62c2546af3a2036b853250c5ac64d4c6b4371" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:25:26 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-ec5a6b6c-3f19-402f-93d6-64df670027f3 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:25:26 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-ec5a6b6c-3f19-402f-93d6-64df670027f3 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json" returned: 0 in 0.182s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:25:26 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-ec5a6b6c-3f19-402f-93d6-64df670027f3 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371,backing_fmt=raw /opt/stack/data/nova/instances/4050d898-f2b8-46c2-86e3-702ceb41a701/disk 1073741824 {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:25:27 user nova-compute[75226]: DEBUG nova.network.neutron [None req-ec5a6b6c-3f19-402f-93d6-64df670027f3 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] [instance: 4050d898-f2b8-46c2-86e3-702ceb41a701] Successfully created port: 3b88e9ba-814a-4122-9e85-a70bd6d85ad0 {{(pid=75226) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 17 01:25:27 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-ec5a6b6c-3f19-402f-93d6-64df670027f3 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371,backing_fmt=raw /opt/stack/data/nova/instances/4050d898-f2b8-46c2-86e3-702ceb41a701/disk 1073741824" returned: 0 in 0.064s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:25:27 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-ec5a6b6c-3f19-402f-93d6-64df670027f3 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] Lock "a8a62c2546af3a2036b853250c5ac64d4c6b4371" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.254s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:25:27 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-ec5a6b6c-3f19-402f-93d6-64df670027f3 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:25:27 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-ec5a6b6c-3f19-402f-93d6-64df670027f3 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json" returned: 0 in 0.182s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:25:27 user nova-compute[75226]: DEBUG nova.virt.disk.api [None req-ec5a6b6c-3f19-402f-93d6-64df670027f3 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4050d898-f2b8-46c2-86e3-702ceb41a701/disk. size=1073741824 {{(pid=75226) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 17 01:25:27 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-ec5a6b6c-3f19-402f-93d6-64df670027f3 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4050d898-f2b8-46c2-86e3-702ceb41a701/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:25:27 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-ec5a6b6c-3f19-402f-93d6-64df670027f3 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4050d898-f2b8-46c2-86e3-702ceb41a701/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:25:27 user nova-compute[75226]: DEBUG nova.virt.disk.api [None req-ec5a6b6c-3f19-402f-93d6-64df670027f3 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] Cannot resize image /opt/stack/data/nova/instances/4050d898-f2b8-46c2-86e3-702ceb41a701/disk to a smaller size. {{(pid=75226) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 17 01:25:27 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-ec5a6b6c-3f19-402f-93d6-64df670027f3 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] [instance: 4050d898-f2b8-46c2-86e3-702ceb41a701] Created local disks {{(pid=75226) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 17 01:25:27 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-ec5a6b6c-3f19-402f-93d6-64df670027f3 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] [instance: 4050d898-f2b8-46c2-86e3-702ceb41a701] Ensure instance console log exists: /opt/stack/data/nova/instances/4050d898-f2b8-46c2-86e3-702ceb41a701/console.log {{(pid=75226) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 17 01:25:27 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-ec5a6b6c-3f19-402f-93d6-64df670027f3 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:25:27 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-ec5a6b6c-3f19-402f-93d6-64df670027f3 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:25:27 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-ec5a6b6c-3f19-402f-93d6-64df670027f3 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:25:27 user nova-compute[75226]: DEBUG nova.network.neutron [None req-ec5a6b6c-3f19-402f-93d6-64df670027f3 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] [instance: 4050d898-f2b8-46c2-86e3-702ceb41a701] Successfully updated port: 3b88e9ba-814a-4122-9e85-a70bd6d85ad0 {{(pid=75226) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 17 01:25:27 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-ec5a6b6c-3f19-402f-93d6-64df670027f3 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] Acquiring lock "refresh_cache-4050d898-f2b8-46c2-86e3-702ceb41a701" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:25:27 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-ec5a6b6c-3f19-402f-93d6-64df670027f3 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] Acquired lock "refresh_cache-4050d898-f2b8-46c2-86e3-702ceb41a701" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:25:27 user nova-compute[75226]: DEBUG nova.network.neutron [None req-ec5a6b6c-3f19-402f-93d6-64df670027f3 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] [instance: 4050d898-f2b8-46c2-86e3-702ceb41a701] Building network info cache for instance {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 01:25:27 user nova-compute[75226]: DEBUG nova.compute.manager [req-efc88113-024b-4d6f-8da1-08c76ea1f09d req-dd2050b9-28c9-498e-8d0b-46ffc93a1c87 service nova] [instance: 4050d898-f2b8-46c2-86e3-702ceb41a701] Received event network-changed-3b88e9ba-814a-4122-9e85-a70bd6d85ad0 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:25:27 user nova-compute[75226]: DEBUG nova.compute.manager [req-efc88113-024b-4d6f-8da1-08c76ea1f09d req-dd2050b9-28c9-498e-8d0b-46ffc93a1c87 service nova] [instance: 4050d898-f2b8-46c2-86e3-702ceb41a701] Refreshing instance network info cache due to event network-changed-3b88e9ba-814a-4122-9e85-a70bd6d85ad0. {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 01:25:27 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-efc88113-024b-4d6f-8da1-08c76ea1f09d req-dd2050b9-28c9-498e-8d0b-46ffc93a1c87 service nova] Acquiring lock "refresh_cache-4050d898-f2b8-46c2-86e3-702ceb41a701" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:25:27 user nova-compute[75226]: DEBUG nova.network.neutron [None req-ec5a6b6c-3f19-402f-93d6-64df670027f3 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] [instance: 4050d898-f2b8-46c2-86e3-702ceb41a701] Instance cache missing network info. {{(pid=75226) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 17 01:25:27 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:25:27 user nova-compute[75226]: DEBUG nova.network.neutron [None req-ec5a6b6c-3f19-402f-93d6-64df670027f3 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] [instance: 4050d898-f2b8-46c2-86e3-702ceb41a701] Updating instance_info_cache with network_info: [{"id": "3b88e9ba-814a-4122-9e85-a70bd6d85ad0", "address": "fa:16:3e:41:78:68", "network": {"id": "ded167af-70f6-45b1-beb4-2eca06a78205", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2145123005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d69aa270fc5b4749a65ea70c7ef30958", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b88e9ba-81", "ovs_interfaceid": "3b88e9ba-814a-4122-9e85-a70bd6d85ad0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:25:27 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-ec5a6b6c-3f19-402f-93d6-64df670027f3 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] Releasing lock "refresh_cache-4050d898-f2b8-46c2-86e3-702ceb41a701" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:25:27 user nova-compute[75226]: DEBUG nova.compute.manager [None req-ec5a6b6c-3f19-402f-93d6-64df670027f3 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] [instance: 4050d898-f2b8-46c2-86e3-702ceb41a701] Instance network_info: |[{"id": "3b88e9ba-814a-4122-9e85-a70bd6d85ad0", "address": "fa:16:3e:41:78:68", "network": {"id": "ded167af-70f6-45b1-beb4-2eca06a78205", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2145123005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d69aa270fc5b4749a65ea70c7ef30958", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b88e9ba-81", "ovs_interfaceid": "3b88e9ba-814a-4122-9e85-a70bd6d85ad0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75226) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 17 01:25:27 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-efc88113-024b-4d6f-8da1-08c76ea1f09d req-dd2050b9-28c9-498e-8d0b-46ffc93a1c87 service nova] Acquired lock "refresh_cache-4050d898-f2b8-46c2-86e3-702ceb41a701" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:25:27 user nova-compute[75226]: DEBUG nova.network.neutron [req-efc88113-024b-4d6f-8da1-08c76ea1f09d req-dd2050b9-28c9-498e-8d0b-46ffc93a1c87 service nova] [instance: 4050d898-f2b8-46c2-86e3-702ceb41a701] Refreshing network info cache for port 3b88e9ba-814a-4122-9e85-a70bd6d85ad0 {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 01:25:27 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-ec5a6b6c-3f19-402f-93d6-64df670027f3 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] [instance: 4050d898-f2b8-46c2-86e3-702ceb41a701] Start _get_guest_xml network_info=[{"id": "3b88e9ba-814a-4122-9e85-a70bd6d85ad0", "address": "fa:16:3e:41:78:68", "network": {"id": "ded167af-70f6-45b1-beb4-2eca06a78205", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2145123005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d69aa270fc5b4749a65ea70c7ef30958", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b88e9ba-81", "ovs_interfaceid": "3b88e9ba-814a-4122-9e85-a70bd6d85ad0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T01:13:22Z,direct_url=<?>,disk_format='qcow2',id=0b369aea-6f3f-4690-9f01-229b90ab6310,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4e110cbf9a84362a6864a7732c435a1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T01:13:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '0b369aea-6f3f-4690-9f01-229b90ab6310'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75226) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 17 01:25:28 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-ec5a6b6c-3f19-402f-93d6-64df670027f3 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:25:28 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-ec5a6b6c-3f19-402f-93d6-64df670027f3 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:25:28 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-ec5a6b6c-3f19-402f-93d6-64df670027f3 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75226) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 17 01:25:28 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-ec5a6b6c-3f19-402f-93d6-64df670027f3 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] CPU controller missing on host. {{(pid=75226) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 17 01:25:28 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-ec5a6b6c-3f19-402f-93d6-64df670027f3 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75226) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 17 01:25:28 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-ec5a6b6c-3f19-402f-93d6-64df670027f3 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] CPU controller found on host. {{(pid=75226) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 17 01:25:28 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-ec5a6b6c-3f19-402f-93d6-64df670027f3 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75226) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 17 01:25:28 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-ec5a6b6c-3f19-402f-93d6-64df670027f3 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-17T01:13:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T01:13:22Z,direct_url=<?>,disk_format='qcow2',id=0b369aea-6f3f-4690-9f01-229b90ab6310,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4e110cbf9a84362a6864a7732c435a1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T01:13:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 17 01:25:28 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-ec5a6b6c-3f19-402f-93d6-64df670027f3 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] Flavor limits 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 17 01:25:28 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-ec5a6b6c-3f19-402f-93d6-64df670027f3 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] Image limits 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 17 01:25:28 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-ec5a6b6c-3f19-402f-93d6-64df670027f3 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] Flavor pref 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 17 01:25:28 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-ec5a6b6c-3f19-402f-93d6-64df670027f3 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] Image pref 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 17 01:25:28 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-ec5a6b6c-3f19-402f-93d6-64df670027f3 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 17 01:25:28 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-ec5a6b6c-3f19-402f-93d6-64df670027f3 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 17 01:25:28 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-ec5a6b6c-3f19-402f-93d6-64df670027f3 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75226) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 17 01:25:28 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-ec5a6b6c-3f19-402f-93d6-64df670027f3 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] Got 1 possible topologies {{(pid=75226) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 17 01:25:28 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-ec5a6b6c-3f19-402f-93d6-64df670027f3 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 17 01:25:28 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-ec5a6b6c-3f19-402f-93d6-64df670027f3 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 17 01:25:28 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-ec5a6b6c-3f19-402f-93d6-64df670027f3 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:25:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-2022474190',display_name='tempest-ServersNegativeTestJSON-server-2022474190',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-2022474190',id=22,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d69aa270fc5b4749a65ea70c7ef30958',ramdisk_id='',reservation_id='r-ers3xohq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1569237592',owner_user_name='tempest-ServersNegativeTestJSON-1569237592-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T01:25:27Z,user_data=None,user_id='202fa7cd113b42f2b95bc2314255392e',uuid=4050d898-f2b8-46c2-86e3-702ceb41a701,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3b88e9ba-814a-4122-9e85-a70bd6d85ad0", "address": "fa:16:3e:41:78:68", "network": {"id": "ded167af-70f6-45b1-beb4-2eca06a78205", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2145123005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d69aa270fc5b4749a65ea70c7ef30958", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b88e9ba-81", "ovs_interfaceid": "3b88e9ba-814a-4122-9e85-a70bd6d85ad0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75226) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 01:25:28 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-ec5a6b6c-3f19-402f-93d6-64df670027f3 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] Converting VIF {"id": "3b88e9ba-814a-4122-9e85-a70bd6d85ad0", "address": "fa:16:3e:41:78:68", "network": {"id": "ded167af-70f6-45b1-beb4-2eca06a78205", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2145123005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d69aa270fc5b4749a65ea70c7ef30958", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b88e9ba-81", "ovs_interfaceid": "3b88e9ba-814a-4122-9e85-a70bd6d85ad0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:25:28 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-ec5a6b6c-3f19-402f-93d6-64df670027f3 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:78:68,bridge_name='br-int',has_traffic_filtering=True,id=3b88e9ba-814a-4122-9e85-a70bd6d85ad0,network=Network(ded167af-70f6-45b1-beb4-2eca06a78205),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b88e9ba-81') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:25:28 user nova-compute[75226]: DEBUG nova.objects.instance [None req-ec5a6b6c-3f19-402f-93d6-64df670027f3 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] Lazy-loading 'pci_devices' on Instance uuid 4050d898-f2b8-46c2-86e3-702ceb41a701 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:25:28 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-ec5a6b6c-3f19-402f-93d6-64df670027f3 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] [instance: 4050d898-f2b8-46c2-86e3-702ceb41a701] End _get_guest_xml xml=<domain type="kvm">
Nov 17 01:25:28 user nova-compute[75226]:   <uuid>4050d898-f2b8-46c2-86e3-702ceb41a701</uuid>
Nov 17 01:25:28 user nova-compute[75226]:   <name>instance-00000016</name>
Nov 17 01:25:28 user nova-compute[75226]:   <memory>524288</memory>
Nov 17 01:25:28 user nova-compute[75226]:   <vcpu>1</vcpu>
Nov 17 01:25:28 user nova-compute[75226]:   <metadata>
Nov 17 01:25:28 user nova-compute[75226]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 17 01:25:28 user nova-compute[75226]:       <nova:package version="0.0.0"/>
Nov 17 01:25:28 user nova-compute[75226]:       <nova:name>tempest-ServersNegativeTestJSON-server-2022474190</nova:name>
Nov 17 01:25:28 user nova-compute[75226]:       <nova:creationTime>2023-11-17 01:25:28</nova:creationTime>
Nov 17 01:25:28 user nova-compute[75226]:       <nova:flavor name="m1.tiny">
Nov 17 01:25:28 user nova-compute[75226]:         <nova:memory>512</nova:memory>
Nov 17 01:25:28 user nova-compute[75226]:         <nova:disk>1</nova:disk>
Nov 17 01:25:28 user nova-compute[75226]:         <nova:swap>0</nova:swap>
Nov 17 01:25:28 user nova-compute[75226]:         <nova:ephemeral>0</nova:ephemeral>
Nov 17 01:25:28 user nova-compute[75226]:         <nova:vcpus>1</nova:vcpus>
Nov 17 01:25:28 user nova-compute[75226]:       </nova:flavor>
Nov 17 01:25:28 user nova-compute[75226]:       <nova:owner>
Nov 17 01:25:28 user nova-compute[75226]:         <nova:user uuid="202fa7cd113b42f2b95bc2314255392e">tempest-ServersNegativeTestJSON-1569237592-project-member</nova:user>
Nov 17 01:25:28 user nova-compute[75226]:         <nova:project uuid="d69aa270fc5b4749a65ea70c7ef30958">tempest-ServersNegativeTestJSON-1569237592</nova:project>
Nov 17 01:25:28 user nova-compute[75226]:       </nova:owner>
Nov 17 01:25:28 user nova-compute[75226]:       <nova:root type="image" uuid="0b369aea-6f3f-4690-9f01-229b90ab6310"/>
Nov 17 01:25:28 user nova-compute[75226]:       <nova:ports>
Nov 17 01:25:28 user nova-compute[75226]:         <nova:port uuid="3b88e9ba-814a-4122-9e85-a70bd6d85ad0">
Nov 17 01:25:28 user nova-compute[75226]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 17 01:25:28 user nova-compute[75226]:         </nova:port>
Nov 17 01:25:28 user nova-compute[75226]:       </nova:ports>
Nov 17 01:25:28 user nova-compute[75226]:     </nova:instance>
Nov 17 01:25:28 user nova-compute[75226]:   </metadata>
Nov 17 01:25:28 user nova-compute[75226]:   <sysinfo type="smbios">
Nov 17 01:25:28 user nova-compute[75226]:     <system>
Nov 17 01:25:28 user nova-compute[75226]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 17 01:25:28 user nova-compute[75226]:       <entry name="product">OpenStack Nova</entry>
Nov 17 01:25:28 user nova-compute[75226]:       <entry name="version">0.0.0</entry>
Nov 17 01:25:28 user nova-compute[75226]:       <entry name="serial">4050d898-f2b8-46c2-86e3-702ceb41a701</entry>
Nov 17 01:25:28 user nova-compute[75226]:       <entry name="uuid">4050d898-f2b8-46c2-86e3-702ceb41a701</entry>
Nov 17 01:25:28 user nova-compute[75226]:       <entry name="family">Virtual Machine</entry>
Nov 17 01:25:28 user nova-compute[75226]:     </system>
Nov 17 01:25:28 user nova-compute[75226]:   </sysinfo>
Nov 17 01:25:28 user nova-compute[75226]:   <os>
Nov 17 01:25:28 user nova-compute[75226]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 17 01:25:28 user nova-compute[75226]:     <boot dev="hd"/>
Nov 17 01:25:28 user nova-compute[75226]:     <smbios mode="sysinfo"/>
Nov 17 01:25:28 user nova-compute[75226]:   </os>
Nov 17 01:25:28 user nova-compute[75226]:   <features>
Nov 17 01:25:28 user nova-compute[75226]:     <acpi/>
Nov 17 01:25:28 user nova-compute[75226]:     <apic/>
Nov 17 01:25:28 user nova-compute[75226]:     <vmcoreinfo/>
Nov 17 01:25:28 user nova-compute[75226]:   </features>
Nov 17 01:25:28 user nova-compute[75226]:   <clock offset="utc">
Nov 17 01:25:28 user nova-compute[75226]:     <timer name="pit" tickpolicy="delay"/>
Nov 17 01:25:28 user nova-compute[75226]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 17 01:25:28 user nova-compute[75226]:     <timer name="hpet" present="no"/>
Nov 17 01:25:28 user nova-compute[75226]:   </clock>
Nov 17 01:25:28 user nova-compute[75226]:   <cpu mode="custom" match="exact">
Nov 17 01:25:28 user nova-compute[75226]:     <model>Nehalem</model>
Nov 17 01:25:28 user nova-compute[75226]:     <topology sockets="1" cores="1" threads="1"/>
Nov 17 01:25:28 user nova-compute[75226]:   </cpu>
Nov 17 01:25:28 user nova-compute[75226]:   <devices>
Nov 17 01:25:28 user nova-compute[75226]:     <disk type="file" device="disk">
Nov 17 01:25:28 user nova-compute[75226]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 17 01:25:28 user nova-compute[75226]:       <source file="/opt/stack/data/nova/instances/4050d898-f2b8-46c2-86e3-702ceb41a701/disk"/>
Nov 17 01:25:28 user nova-compute[75226]:       <target dev="vda" bus="virtio"/>
Nov 17 01:25:28 user nova-compute[75226]:     </disk>
Nov 17 01:25:28 user nova-compute[75226]:     <interface type="ethernet">
Nov 17 01:25:28 user nova-compute[75226]:       <mac address="fa:16:3e:41:78:68"/>
Nov 17 01:25:28 user nova-compute[75226]:       <model type="virtio"/>
Nov 17 01:25:28 user nova-compute[75226]:       <mtu size="1442"/>
Nov 17 01:25:28 user nova-compute[75226]:       <target dev="tap3b88e9ba-81"/>
Nov 17 01:25:28 user nova-compute[75226]:     </interface>
Nov 17 01:25:28 user nova-compute[75226]:     <serial type="pty">
Nov 17 01:25:28 user nova-compute[75226]:       <log file="/opt/stack/data/nova/instances/4050d898-f2b8-46c2-86e3-702ceb41a701/console.log" append="off"/>
Nov 17 01:25:28 user nova-compute[75226]:     </serial>
Nov 17 01:25:28 user nova-compute[75226]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 17 01:25:28 user nova-compute[75226]:     <video>
Nov 17 01:25:28 user nova-compute[75226]:       <model type="virtio"/>
Nov 17 01:25:28 user nova-compute[75226]:     </video>
Nov 17 01:25:28 user nova-compute[75226]:     <rng model="virtio">
Nov 17 01:25:28 user nova-compute[75226]:       <backend model="random">/dev/urandom</backend>
Nov 17 01:25:28 user nova-compute[75226]:     </rng>
Nov 17 01:25:28 user nova-compute[75226]:     <controller type="usb" index="0" model="none"/>
Nov 17 01:25:28 user nova-compute[75226]:     <memballoon model="virtio">
Nov 17 01:25:28 user nova-compute[75226]:       <stats period="10"/>
Nov 17 01:25:28 user nova-compute[75226]:     </memballoon>
Nov 17 01:25:28 user nova-compute[75226]:   </devices>
Nov 17 01:25:28 user nova-compute[75226]: </domain>
Nov 17 01:25:28 user nova-compute[75226]:  {{(pid=75226) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 17 01:25:28 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-ec5a6b6c-3f19-402f-93d6-64df670027f3 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:25:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-2022474190',display_name='tempest-ServersNegativeTestJSON-server-2022474190',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-2022474190',id=22,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d69aa270fc5b4749a65ea70c7ef30958',ramdisk_id='',reservation_id='r-ers3xohq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1569237592',owner_user_name='tempest-ServersNegativeTestJSON-1569237592-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T01:25:27Z,user_data=None,user_id='202fa7cd113b42f2b95bc2314255392e',uuid=4050d898-f2b8-46c2-86e3-702ceb41a701,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3b88e9ba-814a-4122-9e85-a70bd6d85ad0", "address": "fa:16:3e:41:78:68", "network": {"id": "ded167af-70f6-45b1-beb4-2eca06a78205", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2145123005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d69aa270fc5b4749a65ea70c7ef30958", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b88e9ba-81", "ovs_interfaceid": "3b88e9ba-814a-4122-9e85-a70bd6d85ad0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 17 01:25:28 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-ec5a6b6c-3f19-402f-93d6-64df670027f3 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] Converting VIF {"id": "3b88e9ba-814a-4122-9e85-a70bd6d85ad0", "address": "fa:16:3e:41:78:68", "network": {"id": "ded167af-70f6-45b1-beb4-2eca06a78205", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2145123005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d69aa270fc5b4749a65ea70c7ef30958", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b88e9ba-81", "ovs_interfaceid": "3b88e9ba-814a-4122-9e85-a70bd6d85ad0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:25:28 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-ec5a6b6c-3f19-402f-93d6-64df670027f3 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:78:68,bridge_name='br-int',has_traffic_filtering=True,id=3b88e9ba-814a-4122-9e85-a70bd6d85ad0,network=Network(ded167af-70f6-45b1-beb4-2eca06a78205),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b88e9ba-81') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:25:28 user nova-compute[75226]: DEBUG os_vif [None req-ec5a6b6c-3f19-402f-93d6-64df670027f3 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:78:68,bridge_name='br-int',has_traffic_filtering=True,id=3b88e9ba-814a-4122-9e85-a70bd6d85ad0,network=Network(ded167af-70f6-45b1-beb4-2eca06a78205),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b88e9ba-81') {{(pid=75226) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 17 01:25:28 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:25:28 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:25:28 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 17 01:25:28 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:25:28 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '35c03656-db07-57ec-bd9d-e607675acfc2', '_type': 'linux-noop'}}, row=False) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:25:28 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:25:28 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:25:28 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3b88e9ba-81, may_exist=True, interface_attrs={}) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:25:28 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3b88e9ba-81, col_values=(('qos', UUID('cad72b51-9b7f-416e-ad61-7688b5bb2762')),), if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:25:28 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3b88e9ba-81, col_values=(('external_ids', {'iface-id': '3b88e9ba-814a-4122-9e85-a70bd6d85ad0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:41:78:68', 'vm-uuid': '4050d898-f2b8-46c2-86e3-702ceb41a701'}),), if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:25:28 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:25:28 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:25:28 user nova-compute[75226]: INFO os_vif [None req-ec5a6b6c-3f19-402f-93d6-64df670027f3 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:78:68,bridge_name='br-int',has_traffic_filtering=True,id=3b88e9ba-814a-4122-9e85-a70bd6d85ad0,network=Network(ded167af-70f6-45b1-beb4-2eca06a78205),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b88e9ba-81')
Nov 17 01:25:28 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-ec5a6b6c-3f19-402f-93d6-64df670027f3 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] No BDM found with device name vda, not building metadata. {{(pid=75226) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 01:25:28 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-ec5a6b6c-3f19-402f-93d6-64df670027f3 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] No VIF found with MAC fa:16:3e:41:78:68, not building metadata {{(pid=75226) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 01:25:28 user nova-compute[75226]: DEBUG nova.network.neutron [req-efc88113-024b-4d6f-8da1-08c76ea1f09d req-dd2050b9-28c9-498e-8d0b-46ffc93a1c87 service nova] [instance: 4050d898-f2b8-46c2-86e3-702ceb41a701] Updated VIF entry in instance network info cache for port 3b88e9ba-814a-4122-9e85-a70bd6d85ad0. {{(pid=75226) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 01:25:28 user nova-compute[75226]: DEBUG nova.network.neutron [req-efc88113-024b-4d6f-8da1-08c76ea1f09d req-dd2050b9-28c9-498e-8d0b-46ffc93a1c87 service nova] [instance: 4050d898-f2b8-46c2-86e3-702ceb41a701] Updating instance_info_cache with network_info: [{"id": "3b88e9ba-814a-4122-9e85-a70bd6d85ad0", "address": "fa:16:3e:41:78:68", "network": {"id": "ded167af-70f6-45b1-beb4-2eca06a78205", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2145123005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d69aa270fc5b4749a65ea70c7ef30958", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b88e9ba-81", "ovs_interfaceid": "3b88e9ba-814a-4122-9e85-a70bd6d85ad0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:25:28 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-efc88113-024b-4d6f-8da1-08c76ea1f09d req-dd2050b9-28c9-498e-8d0b-46ffc93a1c87 service nova] Releasing lock "refresh_cache-4050d898-f2b8-46c2-86e3-702ceb41a701" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:25:28 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:25:29 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:25:29 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:25:29 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:25:29 user nova-compute[75226]: DEBUG nova.compute.manager [req-5b0628db-e277-48fe-9d02-9322fb6417ba req-7ab16555-de3d-4af3-a329-234b9fabff2c service nova] [instance: 4050d898-f2b8-46c2-86e3-702ceb41a701] Received event network-vif-plugged-3b88e9ba-814a-4122-9e85-a70bd6d85ad0 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:25:29 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-5b0628db-e277-48fe-9d02-9322fb6417ba req-7ab16555-de3d-4af3-a329-234b9fabff2c service nova] Acquiring lock "4050d898-f2b8-46c2-86e3-702ceb41a701-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:25:29 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-5b0628db-e277-48fe-9d02-9322fb6417ba req-7ab16555-de3d-4af3-a329-234b9fabff2c service nova] Lock "4050d898-f2b8-46c2-86e3-702ceb41a701-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:25:29 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-5b0628db-e277-48fe-9d02-9322fb6417ba req-7ab16555-de3d-4af3-a329-234b9fabff2c service nova] Lock "4050d898-f2b8-46c2-86e3-702ceb41a701-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:25:29 user nova-compute[75226]: DEBUG nova.compute.manager [req-5b0628db-e277-48fe-9d02-9322fb6417ba req-7ab16555-de3d-4af3-a329-234b9fabff2c service nova] [instance: 4050d898-f2b8-46c2-86e3-702ceb41a701] No waiting events found dispatching network-vif-plugged-3b88e9ba-814a-4122-9e85-a70bd6d85ad0 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:25:29 user nova-compute[75226]: WARNING nova.compute.manager [req-5b0628db-e277-48fe-9d02-9322fb6417ba req-7ab16555-de3d-4af3-a329-234b9fabff2c service nova] [instance: 4050d898-f2b8-46c2-86e3-702ceb41a701] Received unexpected event network-vif-plugged-3b88e9ba-814a-4122-9e85-a70bd6d85ad0 for instance with vm_state building and task_state spawning.
Nov 17 01:25:30 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:25:30 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:25:30 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:25:31 user nova-compute[75226]: DEBUG nova.compute.manager [None req-ec5a6b6c-3f19-402f-93d6-64df670027f3 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] [instance: 4050d898-f2b8-46c2-86e3-702ceb41a701] Instance event wait completed in 0 seconds for  {{(pid=75226) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 17 01:25:31 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-ec5a6b6c-3f19-402f-93d6-64df670027f3 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] [instance: 4050d898-f2b8-46c2-86e3-702ceb41a701] Guest created on hypervisor {{(pid=75226) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 17 01:25:31 user nova-compute[75226]: INFO nova.virt.libvirt.driver [-] [instance: 4050d898-f2b8-46c2-86e3-702ceb41a701] Instance spawned successfully.
Nov 17 01:25:31 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-ec5a6b6c-3f19-402f-93d6-64df670027f3 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] [instance: 4050d898-f2b8-46c2-86e3-702ceb41a701] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 17 01:25:31 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-ec5a6b6c-3f19-402f-93d6-64df670027f3 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] [instance: 4050d898-f2b8-46c2-86e3-702ceb41a701] Found default for hw_cdrom_bus of ide {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:25:31 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-ec5a6b6c-3f19-402f-93d6-64df670027f3 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] [instance: 4050d898-f2b8-46c2-86e3-702ceb41a701] Found default for hw_disk_bus of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:25:31 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-ec5a6b6c-3f19-402f-93d6-64df670027f3 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] [instance: 4050d898-f2b8-46c2-86e3-702ceb41a701] Found default for hw_input_bus of None {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:25:31 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-ec5a6b6c-3f19-402f-93d6-64df670027f3 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] [instance: 4050d898-f2b8-46c2-86e3-702ceb41a701] Found default for hw_pointer_model of None {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:25:31 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-ec5a6b6c-3f19-402f-93d6-64df670027f3 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] [instance: 4050d898-f2b8-46c2-86e3-702ceb41a701] Found default for hw_video_model of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:25:31 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-ec5a6b6c-3f19-402f-93d6-64df670027f3 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] [instance: 4050d898-f2b8-46c2-86e3-702ceb41a701] Found default for hw_vif_model of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:25:31 user nova-compute[75226]: INFO nova.compute.manager [None req-ec5a6b6c-3f19-402f-93d6-64df670027f3 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] [instance: 4050d898-f2b8-46c2-86e3-702ceb41a701] Took 5.13 seconds to spawn the instance on the hypervisor.
Nov 17 01:25:31 user nova-compute[75226]: DEBUG nova.compute.manager [None req-ec5a6b6c-3f19-402f-93d6-64df670027f3 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] [instance: 4050d898-f2b8-46c2-86e3-702ceb41a701] Checking state {{(pid=75226) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 01:25:31 user nova-compute[75226]: DEBUG nova.compute.manager [req-f0fef5de-4ec8-44af-abfc-51152dabdd1f req-a4a26a27-a4c6-4a83-8e2f-73620aeb45d1 service nova] [instance: 4050d898-f2b8-46c2-86e3-702ceb41a701] Received event network-vif-plugged-3b88e9ba-814a-4122-9e85-a70bd6d85ad0 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:25:31 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-f0fef5de-4ec8-44af-abfc-51152dabdd1f req-a4a26a27-a4c6-4a83-8e2f-73620aeb45d1 service nova] Acquiring lock "4050d898-f2b8-46c2-86e3-702ceb41a701-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:25:31 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-f0fef5de-4ec8-44af-abfc-51152dabdd1f req-a4a26a27-a4c6-4a83-8e2f-73620aeb45d1 service nova] Lock "4050d898-f2b8-46c2-86e3-702ceb41a701-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:25:31 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-f0fef5de-4ec8-44af-abfc-51152dabdd1f req-a4a26a27-a4c6-4a83-8e2f-73620aeb45d1 service nova] Lock "4050d898-f2b8-46c2-86e3-702ceb41a701-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:25:31 user nova-compute[75226]: DEBUG nova.compute.manager [req-f0fef5de-4ec8-44af-abfc-51152dabdd1f req-a4a26a27-a4c6-4a83-8e2f-73620aeb45d1 service nova] [instance: 4050d898-f2b8-46c2-86e3-702ceb41a701] No waiting events found dispatching network-vif-plugged-3b88e9ba-814a-4122-9e85-a70bd6d85ad0 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:25:31 user nova-compute[75226]: WARNING nova.compute.manager [req-f0fef5de-4ec8-44af-abfc-51152dabdd1f req-a4a26a27-a4c6-4a83-8e2f-73620aeb45d1 service nova] [instance: 4050d898-f2b8-46c2-86e3-702ceb41a701] Received unexpected event network-vif-plugged-3b88e9ba-814a-4122-9e85-a70bd6d85ad0 for instance with vm_state building and task_state spawning.
Nov 17 01:25:31 user nova-compute[75226]: INFO nova.compute.manager [None req-ec5a6b6c-3f19-402f-93d6-64df670027f3 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] [instance: 4050d898-f2b8-46c2-86e3-702ceb41a701] Took 5.94 seconds to build instance.
Nov 17 01:25:31 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-ec5a6b6c-3f19-402f-93d6-64df670027f3 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] Lock "4050d898-f2b8-46c2-86e3-702ceb41a701" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.041s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:25:32 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:25:33 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:25:33 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-d22d1e08-1e04-4b64-9b0c-575bd6066657 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Acquiring lock "4dcdd769-bbfe-48e8-a876-8b2072b7baeb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:25:33 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-d22d1e08-1e04-4b64-9b0c-575bd6066657 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Lock "4dcdd769-bbfe-48e8-a876-8b2072b7baeb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:25:33 user nova-compute[75226]: DEBUG nova.compute.manager [None req-d22d1e08-1e04-4b64-9b0c-575bd6066657 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: 4dcdd769-bbfe-48e8-a876-8b2072b7baeb] Starting instance... {{(pid=75226) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 17 01:25:33 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-d22d1e08-1e04-4b64-9b0c-575bd6066657 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:25:33 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-d22d1e08-1e04-4b64-9b0c-575bd6066657 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:25:33 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-d22d1e08-1e04-4b64-9b0c-575bd6066657 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75226) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 17 01:25:33 user nova-compute[75226]: INFO nova.compute.claims [None req-d22d1e08-1e04-4b64-9b0c-575bd6066657 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: 4dcdd769-bbfe-48e8-a876-8b2072b7baeb] Claim successful on node user
Nov 17 01:25:33 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-d22d1e08-1e04-4b64-9b0c-575bd6066657 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:25:33 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-d22d1e08-1e04-4b64-9b0c-575bd6066657 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:25:33 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-d22d1e08-1e04-4b64-9b0c-575bd6066657 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.380s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:25:33 user nova-compute[75226]: DEBUG nova.compute.manager [None req-d22d1e08-1e04-4b64-9b0c-575bd6066657 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: 4dcdd769-bbfe-48e8-a876-8b2072b7baeb] Start building networks asynchronously for instance. {{(pid=75226) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 17 01:25:33 user nova-compute[75226]: DEBUG nova.compute.manager [None req-d22d1e08-1e04-4b64-9b0c-575bd6066657 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: 4dcdd769-bbfe-48e8-a876-8b2072b7baeb] Allocating IP information in the background. {{(pid=75226) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 17 01:25:33 user nova-compute[75226]: DEBUG nova.network.neutron [None req-d22d1e08-1e04-4b64-9b0c-575bd6066657 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: 4dcdd769-bbfe-48e8-a876-8b2072b7baeb] allocate_for_instance() {{(pid=75226) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 17 01:25:33 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-d22d1e08-1e04-4b64-9b0c-575bd6066657 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: 4dcdd769-bbfe-48e8-a876-8b2072b7baeb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 17 01:25:33 user nova-compute[75226]: DEBUG nova.compute.manager [None req-d22d1e08-1e04-4b64-9b0c-575bd6066657 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: 4dcdd769-bbfe-48e8-a876-8b2072b7baeb] Start building block device mappings for instance. {{(pid=75226) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 17 01:25:33 user nova-compute[75226]: DEBUG nova.policy [None req-d22d1e08-1e04-4b64-9b0c-575bd6066657 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a13dd8231937440185c9fc628c3bd5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9042fe4ecc245dd97553f6e942c3e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75226) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 17 01:25:34 user nova-compute[75226]: DEBUG nova.compute.manager [None req-d22d1e08-1e04-4b64-9b0c-575bd6066657 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: 4dcdd769-bbfe-48e8-a876-8b2072b7baeb] Start spawning the instance on the hypervisor. {{(pid=75226) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 17 01:25:34 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-d22d1e08-1e04-4b64-9b0c-575bd6066657 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: 4dcdd769-bbfe-48e8-a876-8b2072b7baeb] Creating instance directory {{(pid=75226) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 17 01:25:34 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-d22d1e08-1e04-4b64-9b0c-575bd6066657 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: 4dcdd769-bbfe-48e8-a876-8b2072b7baeb] Creating image(s)
Nov 17 01:25:34 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-d22d1e08-1e04-4b64-9b0c-575bd6066657 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Acquiring lock "/opt/stack/data/nova/instances/4dcdd769-bbfe-48e8-a876-8b2072b7baeb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:25:34 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-d22d1e08-1e04-4b64-9b0c-575bd6066657 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Lock "/opt/stack/data/nova/instances/4dcdd769-bbfe-48e8-a876-8b2072b7baeb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:25:34 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-d22d1e08-1e04-4b64-9b0c-575bd6066657 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Lock "/opt/stack/data/nova/instances/4dcdd769-bbfe-48e8-a876-8b2072b7baeb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:25:34 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-d22d1e08-1e04-4b64-9b0c-575bd6066657 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:25:34 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-d22d1e08-1e04-4b64-9b0c-575bd6066657 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json" returned: 0 in 0.233s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:25:34 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-d22d1e08-1e04-4b64-9b0c-575bd6066657 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Acquiring lock "a8a62c2546af3a2036b853250c5ac64d4c6b4371" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:25:34 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-d22d1e08-1e04-4b64-9b0c-575bd6066657 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Lock "a8a62c2546af3a2036b853250c5ac64d4c6b4371" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:25:34 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-d22d1e08-1e04-4b64-9b0c-575bd6066657 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:25:34 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-d22d1e08-1e04-4b64-9b0c-575bd6066657 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json" returned: 0 in 0.206s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:25:34 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-d22d1e08-1e04-4b64-9b0c-575bd6066657 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371,backing_fmt=raw /opt/stack/data/nova/instances/4dcdd769-bbfe-48e8-a876-8b2072b7baeb/disk 1073741824 {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:25:34 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:25:34 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-d22d1e08-1e04-4b64-9b0c-575bd6066657 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371,backing_fmt=raw /opt/stack/data/nova/instances/4dcdd769-bbfe-48e8-a876-8b2072b7baeb/disk 1073741824" returned: 0 in 0.078s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:25:34 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-d22d1e08-1e04-4b64-9b0c-575bd6066657 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Lock "a8a62c2546af3a2036b853250c5ac64d4c6b4371" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.290s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:25:34 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-d22d1e08-1e04-4b64-9b0c-575bd6066657 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:25:34 user nova-compute[75226]: DEBUG nova.network.neutron [None req-d22d1e08-1e04-4b64-9b0c-575bd6066657 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: 4dcdd769-bbfe-48e8-a876-8b2072b7baeb] Successfully created port: 89afa235-d910-4430-a95a-c173ba7a7048 {{(pid=75226) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 17 01:25:34 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-d22d1e08-1e04-4b64-9b0c-575bd6066657 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json" returned: 0 in 0.187s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:25:34 user nova-compute[75226]: DEBUG nova.virt.disk.api [None req-d22d1e08-1e04-4b64-9b0c-575bd6066657 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4dcdd769-bbfe-48e8-a876-8b2072b7baeb/disk. size=1073741824 {{(pid=75226) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 17 01:25:34 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-d22d1e08-1e04-4b64-9b0c-575bd6066657 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dcdd769-bbfe-48e8-a876-8b2072b7baeb/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:25:34 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-d22d1e08-1e04-4b64-9b0c-575bd6066657 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dcdd769-bbfe-48e8-a876-8b2072b7baeb/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:25:34 user nova-compute[75226]: DEBUG nova.virt.disk.api [None req-d22d1e08-1e04-4b64-9b0c-575bd6066657 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Cannot resize image /opt/stack/data/nova/instances/4dcdd769-bbfe-48e8-a876-8b2072b7baeb/disk to a smaller size. {{(pid=75226) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 17 01:25:34 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-d22d1e08-1e04-4b64-9b0c-575bd6066657 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: 4dcdd769-bbfe-48e8-a876-8b2072b7baeb] Created local disks {{(pid=75226) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 17 01:25:34 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-d22d1e08-1e04-4b64-9b0c-575bd6066657 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: 4dcdd769-bbfe-48e8-a876-8b2072b7baeb] Ensure instance console log exists: /opt/stack/data/nova/instances/4dcdd769-bbfe-48e8-a876-8b2072b7baeb/console.log {{(pid=75226) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 17 01:25:34 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-d22d1e08-1e04-4b64-9b0c-575bd6066657 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:25:34 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-d22d1e08-1e04-4b64-9b0c-575bd6066657 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:25:34 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-d22d1e08-1e04-4b64-9b0c-575bd6066657 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:25:35 user nova-compute[75226]: DEBUG nova.network.neutron [None req-d22d1e08-1e04-4b64-9b0c-575bd6066657 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: 4dcdd769-bbfe-48e8-a876-8b2072b7baeb] Successfully updated port: 89afa235-d910-4430-a95a-c173ba7a7048 {{(pid=75226) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 17 01:25:35 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-d22d1e08-1e04-4b64-9b0c-575bd6066657 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Acquiring lock "refresh_cache-4dcdd769-bbfe-48e8-a876-8b2072b7baeb" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:25:35 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-d22d1e08-1e04-4b64-9b0c-575bd6066657 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Acquired lock "refresh_cache-4dcdd769-bbfe-48e8-a876-8b2072b7baeb" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:25:35 user nova-compute[75226]: DEBUG nova.network.neutron [None req-d22d1e08-1e04-4b64-9b0c-575bd6066657 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: 4dcdd769-bbfe-48e8-a876-8b2072b7baeb] Building network info cache for instance {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 01:25:35 user nova-compute[75226]: DEBUG nova.compute.manager [req-c60a66f7-a929-4037-99cd-6094fdfd6170 req-287285c4-1caf-4ed5-b952-8735af80ebd1 service nova] [instance: 4dcdd769-bbfe-48e8-a876-8b2072b7baeb] Received event network-changed-89afa235-d910-4430-a95a-c173ba7a7048 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:25:35 user nova-compute[75226]: DEBUG nova.compute.manager [req-c60a66f7-a929-4037-99cd-6094fdfd6170 req-287285c4-1caf-4ed5-b952-8735af80ebd1 service nova] [instance: 4dcdd769-bbfe-48e8-a876-8b2072b7baeb] Refreshing instance network info cache due to event network-changed-89afa235-d910-4430-a95a-c173ba7a7048. {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 01:25:35 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-c60a66f7-a929-4037-99cd-6094fdfd6170 req-287285c4-1caf-4ed5-b952-8735af80ebd1 service nova] Acquiring lock "refresh_cache-4dcdd769-bbfe-48e8-a876-8b2072b7baeb" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:25:35 user nova-compute[75226]: DEBUG nova.network.neutron [None req-d22d1e08-1e04-4b64-9b0c-575bd6066657 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: 4dcdd769-bbfe-48e8-a876-8b2072b7baeb] Instance cache missing network info. {{(pid=75226) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 17 01:25:36 user nova-compute[75226]: DEBUG nova.network.neutron [None req-d22d1e08-1e04-4b64-9b0c-575bd6066657 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: 4dcdd769-bbfe-48e8-a876-8b2072b7baeb] Updating instance_info_cache with network_info: [{"id": "89afa235-d910-4430-a95a-c173ba7a7048", "address": "fa:16:3e:a8:19:37", "network": {"id": "9f39d3e5-b106-4bd9-b8ba-0f326e89c481", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-675861281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9042fe4ecc245dd97553f6e942c3e05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89afa235-d9", "ovs_interfaceid": "89afa235-d910-4430-a95a-c173ba7a7048", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:25:36 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-d22d1e08-1e04-4b64-9b0c-575bd6066657 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Releasing lock "refresh_cache-4dcdd769-bbfe-48e8-a876-8b2072b7baeb" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:25:36 user nova-compute[75226]: DEBUG nova.compute.manager [None req-d22d1e08-1e04-4b64-9b0c-575bd6066657 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: 4dcdd769-bbfe-48e8-a876-8b2072b7baeb] Instance network_info: |[{"id": "89afa235-d910-4430-a95a-c173ba7a7048", "address": "fa:16:3e:a8:19:37", "network": {"id": "9f39d3e5-b106-4bd9-b8ba-0f326e89c481", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-675861281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9042fe4ecc245dd97553f6e942c3e05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89afa235-d9", "ovs_interfaceid": "89afa235-d910-4430-a95a-c173ba7a7048", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75226) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 17 01:25:36 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-c60a66f7-a929-4037-99cd-6094fdfd6170 req-287285c4-1caf-4ed5-b952-8735af80ebd1 service nova] Acquired lock "refresh_cache-4dcdd769-bbfe-48e8-a876-8b2072b7baeb" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:25:36 user nova-compute[75226]: DEBUG nova.network.neutron [req-c60a66f7-a929-4037-99cd-6094fdfd6170 req-287285c4-1caf-4ed5-b952-8735af80ebd1 service nova] [instance: 4dcdd769-bbfe-48e8-a876-8b2072b7baeb] Refreshing network info cache for port 89afa235-d910-4430-a95a-c173ba7a7048 {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 01:25:36 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-d22d1e08-1e04-4b64-9b0c-575bd6066657 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: 4dcdd769-bbfe-48e8-a876-8b2072b7baeb] Start _get_guest_xml network_info=[{"id": "89afa235-d910-4430-a95a-c173ba7a7048", "address": "fa:16:3e:a8:19:37", "network": {"id": "9f39d3e5-b106-4bd9-b8ba-0f326e89c481", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-675861281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9042fe4ecc245dd97553f6e942c3e05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89afa235-d9", "ovs_interfaceid": "89afa235-d910-4430-a95a-c173ba7a7048", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T01:13:22Z,direct_url=<?>,disk_format='qcow2',id=0b369aea-6f3f-4690-9f01-229b90ab6310,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4e110cbf9a84362a6864a7732c435a1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T01:13:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '0b369aea-6f3f-4690-9f01-229b90ab6310'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75226) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 17 01:25:36 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-d22d1e08-1e04-4b64-9b0c-575bd6066657 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:25:36 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-d22d1e08-1e04-4b64-9b0c-575bd6066657 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:25:36 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-d22d1e08-1e04-4b64-9b0c-575bd6066657 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75226) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 17 01:25:36 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-d22d1e08-1e04-4b64-9b0c-575bd6066657 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] CPU controller missing on host. {{(pid=75226) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 17 01:25:36 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-d22d1e08-1e04-4b64-9b0c-575bd6066657 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75226) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 17 01:25:36 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-d22d1e08-1e04-4b64-9b0c-575bd6066657 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] CPU controller found on host. {{(pid=75226) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 17 01:25:36 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-d22d1e08-1e04-4b64-9b0c-575bd6066657 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75226) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 17 01:25:36 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-d22d1e08-1e04-4b64-9b0c-575bd6066657 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-17T01:13:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T01:13:22Z,direct_url=<?>,disk_format='qcow2',id=0b369aea-6f3f-4690-9f01-229b90ab6310,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4e110cbf9a84362a6864a7732c435a1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T01:13:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 17 01:25:36 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-d22d1e08-1e04-4b64-9b0c-575bd6066657 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Flavor limits 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 17 01:25:36 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-d22d1e08-1e04-4b64-9b0c-575bd6066657 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Image limits 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 17 01:25:36 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-d22d1e08-1e04-4b64-9b0c-575bd6066657 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Flavor pref 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 17 01:25:36 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-d22d1e08-1e04-4b64-9b0c-575bd6066657 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Image pref 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 17 01:25:36 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-d22d1e08-1e04-4b64-9b0c-575bd6066657 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 17 01:25:36 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-d22d1e08-1e04-4b64-9b0c-575bd6066657 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 17 01:25:36 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-d22d1e08-1e04-4b64-9b0c-575bd6066657 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75226) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 17 01:25:36 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-d22d1e08-1e04-4b64-9b0c-575bd6066657 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Got 1 possible topologies {{(pid=75226) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 17 01:25:36 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-d22d1e08-1e04-4b64-9b0c-575bd6066657 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 17 01:25:36 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-d22d1e08-1e04-4b64-9b0c-575bd6066657 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 17 01:25:36 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-d22d1e08-1e04-4b64-9b0c-575bd6066657 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:25:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1264841713',display_name='tempest-tempest.common.compute-instance-1264841713',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1264841713',id=23,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGOKbwek9F3YeeXoISPpS9+FDOrqOAqUhG9ukSmG/2nvRhlXurk6SPlW7mGAsx4jOBi7d45LHSKFtCo2RRjgggrHiA9jsTNQAxfCNWgvK2lGzcNS8ikfzoMNKYvTRylwaw==',key_name='tempest-keypair-1621147487',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f9042fe4ecc245dd97553f6e942c3e05',ramdisk_id='',reservation_id='r-g0p6okz5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2125452149',owner_user_name='tempest-ServerActionsTestOtherA-2125452149-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T01:25:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a13dd8231937440185c9fc628c3bd5db',uuid=4dcdd769-bbfe-48e8-a876-8b2072b7baeb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "89afa235-d910-4430-a95a-c173ba7a7048", "address": "fa:16:3e:a8:19:37", "network": {"id": "9f39d3e5-b106-4bd9-b8ba-0f326e89c481", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-675861281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9042fe4ecc245dd97553f6e942c3e05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89afa235-d9", "ovs_interfaceid": "89afa235-d910-4430-a95a-c173ba7a7048", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75226) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 01:25:36 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-d22d1e08-1e04-4b64-9b0c-575bd6066657 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Converting VIF {"id": "89afa235-d910-4430-a95a-c173ba7a7048", "address": "fa:16:3e:a8:19:37", "network": {"id": "9f39d3e5-b106-4bd9-b8ba-0f326e89c481", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-675861281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9042fe4ecc245dd97553f6e942c3e05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89afa235-d9", "ovs_interfaceid": "89afa235-d910-4430-a95a-c173ba7a7048", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:25:36 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-d22d1e08-1e04-4b64-9b0c-575bd6066657 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:19:37,bridge_name='br-int',has_traffic_filtering=True,id=89afa235-d910-4430-a95a-c173ba7a7048,network=Network(9f39d3e5-b106-4bd9-b8ba-0f326e89c481),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89afa235-d9') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:25:36 user nova-compute[75226]: DEBUG nova.objects.instance [None req-d22d1e08-1e04-4b64-9b0c-575bd6066657 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Lazy-loading 'pci_devices' on Instance uuid 4dcdd769-bbfe-48e8-a876-8b2072b7baeb {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:25:36 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-d22d1e08-1e04-4b64-9b0c-575bd6066657 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: 4dcdd769-bbfe-48e8-a876-8b2072b7baeb] End _get_guest_xml xml=<domain type="kvm">
Nov 17 01:25:36 user nova-compute[75226]:   <uuid>4dcdd769-bbfe-48e8-a876-8b2072b7baeb</uuid>
Nov 17 01:25:36 user nova-compute[75226]:   <name>instance-00000017</name>
Nov 17 01:25:36 user nova-compute[75226]:   <memory>524288</memory>
Nov 17 01:25:36 user nova-compute[75226]:   <vcpu>1</vcpu>
Nov 17 01:25:36 user nova-compute[75226]:   <metadata>
Nov 17 01:25:36 user nova-compute[75226]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 17 01:25:36 user nova-compute[75226]:       <nova:package version="0.0.0"/>
Nov 17 01:25:36 user nova-compute[75226]:       <nova:name>tempest-tempest.common.compute-instance-1264841713</nova:name>
Nov 17 01:25:36 user nova-compute[75226]:       <nova:creationTime>2023-11-17 01:25:36</nova:creationTime>
Nov 17 01:25:36 user nova-compute[75226]:       <nova:flavor name="m1.tiny">
Nov 17 01:25:36 user nova-compute[75226]:         <nova:memory>512</nova:memory>
Nov 17 01:25:36 user nova-compute[75226]:         <nova:disk>1</nova:disk>
Nov 17 01:25:36 user nova-compute[75226]:         <nova:swap>0</nova:swap>
Nov 17 01:25:36 user nova-compute[75226]:         <nova:ephemeral>0</nova:ephemeral>
Nov 17 01:25:36 user nova-compute[75226]:         <nova:vcpus>1</nova:vcpus>
Nov 17 01:25:36 user nova-compute[75226]:       </nova:flavor>
Nov 17 01:25:36 user nova-compute[75226]:       <nova:owner>
Nov 17 01:25:36 user nova-compute[75226]:         <nova:user uuid="a13dd8231937440185c9fc628c3bd5db">tempest-ServerActionsTestOtherA-2125452149-project-member</nova:user>
Nov 17 01:25:36 user nova-compute[75226]:         <nova:project uuid="f9042fe4ecc245dd97553f6e942c3e05">tempest-ServerActionsTestOtherA-2125452149</nova:project>
Nov 17 01:25:36 user nova-compute[75226]:       </nova:owner>
Nov 17 01:25:36 user nova-compute[75226]:       <nova:root type="image" uuid="0b369aea-6f3f-4690-9f01-229b90ab6310"/>
Nov 17 01:25:36 user nova-compute[75226]:       <nova:ports>
Nov 17 01:25:36 user nova-compute[75226]:         <nova:port uuid="89afa235-d910-4430-a95a-c173ba7a7048">
Nov 17 01:25:36 user nova-compute[75226]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 17 01:25:36 user nova-compute[75226]:         </nova:port>
Nov 17 01:25:36 user nova-compute[75226]:       </nova:ports>
Nov 17 01:25:36 user nova-compute[75226]:     </nova:instance>
Nov 17 01:25:36 user nova-compute[75226]:   </metadata>
Nov 17 01:25:36 user nova-compute[75226]:   <sysinfo type="smbios">
Nov 17 01:25:36 user nova-compute[75226]:     <system>
Nov 17 01:25:36 user nova-compute[75226]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 17 01:25:36 user nova-compute[75226]:       <entry name="product">OpenStack Nova</entry>
Nov 17 01:25:36 user nova-compute[75226]:       <entry name="version">0.0.0</entry>
Nov 17 01:25:36 user nova-compute[75226]:       <entry name="serial">4dcdd769-bbfe-48e8-a876-8b2072b7baeb</entry>
Nov 17 01:25:36 user nova-compute[75226]:       <entry name="uuid">4dcdd769-bbfe-48e8-a876-8b2072b7baeb</entry>
Nov 17 01:25:36 user nova-compute[75226]:       <entry name="family">Virtual Machine</entry>
Nov 17 01:25:36 user nova-compute[75226]:     </system>
Nov 17 01:25:36 user nova-compute[75226]:   </sysinfo>
Nov 17 01:25:36 user nova-compute[75226]:   <os>
Nov 17 01:25:36 user nova-compute[75226]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 17 01:25:36 user nova-compute[75226]:     <boot dev="hd"/>
Nov 17 01:25:36 user nova-compute[75226]:     <smbios mode="sysinfo"/>
Nov 17 01:25:36 user nova-compute[75226]:   </os>
Nov 17 01:25:36 user nova-compute[75226]:   <features>
Nov 17 01:25:36 user nova-compute[75226]:     <acpi/>
Nov 17 01:25:36 user nova-compute[75226]:     <apic/>
Nov 17 01:25:36 user nova-compute[75226]:     <vmcoreinfo/>
Nov 17 01:25:36 user nova-compute[75226]:   </features>
Nov 17 01:25:36 user nova-compute[75226]:   <clock offset="utc">
Nov 17 01:25:36 user nova-compute[75226]:     <timer name="pit" tickpolicy="delay"/>
Nov 17 01:25:36 user nova-compute[75226]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 17 01:25:36 user nova-compute[75226]:     <timer name="hpet" present="no"/>
Nov 17 01:25:36 user nova-compute[75226]:   </clock>
Nov 17 01:25:36 user nova-compute[75226]:   <cpu mode="custom" match="exact">
Nov 17 01:25:36 user nova-compute[75226]:     <model>Nehalem</model>
Nov 17 01:25:36 user nova-compute[75226]:     <topology sockets="1" cores="1" threads="1"/>
Nov 17 01:25:36 user nova-compute[75226]:   </cpu>
Nov 17 01:25:36 user nova-compute[75226]:   <devices>
Nov 17 01:25:36 user nova-compute[75226]:     <disk type="file" device="disk">
Nov 17 01:25:36 user nova-compute[75226]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 17 01:25:36 user nova-compute[75226]:       <source file="/opt/stack/data/nova/instances/4dcdd769-bbfe-48e8-a876-8b2072b7baeb/disk"/>
Nov 17 01:25:36 user nova-compute[75226]:       <target dev="vda" bus="virtio"/>
Nov 17 01:25:36 user nova-compute[75226]:     </disk>
Nov 17 01:25:36 user nova-compute[75226]:     <interface type="ethernet">
Nov 17 01:25:36 user nova-compute[75226]:       <mac address="fa:16:3e:a8:19:37"/>
Nov 17 01:25:36 user nova-compute[75226]:       <model type="virtio"/>
Nov 17 01:25:36 user nova-compute[75226]:       <mtu size="1442"/>
Nov 17 01:25:36 user nova-compute[75226]:       <target dev="tap89afa235-d9"/>
Nov 17 01:25:36 user nova-compute[75226]:     </interface>
Nov 17 01:25:36 user nova-compute[75226]:     <serial type="pty">
Nov 17 01:25:36 user nova-compute[75226]:       <log file="/opt/stack/data/nova/instances/4dcdd769-bbfe-48e8-a876-8b2072b7baeb/console.log" append="off"/>
Nov 17 01:25:36 user nova-compute[75226]:     </serial>
Nov 17 01:25:36 user nova-compute[75226]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 17 01:25:36 user nova-compute[75226]:     <video>
Nov 17 01:25:36 user nova-compute[75226]:       <model type="virtio"/>
Nov 17 01:25:36 user nova-compute[75226]:     </video>
Nov 17 01:25:36 user nova-compute[75226]:     <rng model="virtio">
Nov 17 01:25:36 user nova-compute[75226]:       <backend model="random">/dev/urandom</backend>
Nov 17 01:25:36 user nova-compute[75226]:     </rng>
Nov 17 01:25:36 user nova-compute[75226]:     <controller type="usb" index="0" model="none"/>
Nov 17 01:25:36 user nova-compute[75226]:     <memballoon model="virtio">
Nov 17 01:25:36 user nova-compute[75226]:       <stats period="10"/>
Nov 17 01:25:36 user nova-compute[75226]:     </memballoon>
Nov 17 01:25:36 user nova-compute[75226]:   </devices>
Nov 17 01:25:36 user nova-compute[75226]: </domain>
Nov 17 01:25:36 user nova-compute[75226]:  {{(pid=75226) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 17 01:25:36 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-d22d1e08-1e04-4b64-9b0c-575bd6066657 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:25:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1264841713',display_name='tempest-tempest.common.compute-instance-1264841713',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1264841713',id=23,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGOKbwek9F3YeeXoISPpS9+FDOrqOAqUhG9ukSmG/2nvRhlXurk6SPlW7mGAsx4jOBi7d45LHSKFtCo2RRjgggrHiA9jsTNQAxfCNWgvK2lGzcNS8ikfzoMNKYvTRylwaw==',key_name='tempest-keypair-1621147487',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f9042fe4ecc245dd97553f6e942c3e05',ramdisk_id='',reservation_id='r-g0p6okz5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2125452149',owner_user_name='tempest-ServerActionsTestOtherA-2125452149-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T01:25:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a13dd8231937440185c9fc628c3bd5db',uuid=4dcdd769-bbfe-48e8-a876-8b2072b7baeb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "89afa235-d910-4430-a95a-c173ba7a7048", "address": "fa:16:3e:a8:19:37", "network": {"id": "9f39d3e5-b106-4bd9-b8ba-0f326e89c481", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-675861281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9042fe4ecc245dd97553f6e942c3e05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89afa235-d9", "ovs_interfaceid": "89afa235-d910-4430-a95a-c173ba7a7048", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 17 01:25:36 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-d22d1e08-1e04-4b64-9b0c-575bd6066657 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Converting VIF {"id": "89afa235-d910-4430-a95a-c173ba7a7048", "address": "fa:16:3e:a8:19:37", "network": {"id": "9f39d3e5-b106-4bd9-b8ba-0f326e89c481", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-675861281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9042fe4ecc245dd97553f6e942c3e05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89afa235-d9", "ovs_interfaceid": "89afa235-d910-4430-a95a-c173ba7a7048", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:25:36 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-d22d1e08-1e04-4b64-9b0c-575bd6066657 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:19:37,bridge_name='br-int',has_traffic_filtering=True,id=89afa235-d910-4430-a95a-c173ba7a7048,network=Network(9f39d3e5-b106-4bd9-b8ba-0f326e89c481),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89afa235-d9') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:25:36 user nova-compute[75226]: DEBUG os_vif [None req-d22d1e08-1e04-4b64-9b0c-575bd6066657 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:19:37,bridge_name='br-int',has_traffic_filtering=True,id=89afa235-d910-4430-a95a-c173ba7a7048,network=Network(9f39d3e5-b106-4bd9-b8ba-0f326e89c481),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89afa235-d9') {{(pid=75226) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 17 01:25:36 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:25:36 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:25:36 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 17 01:25:36 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:25:36 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '760ee461-27ab-5ccf-b27f-f857f8fbc15f', '_type': 'linux-noop'}}, row=False) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:25:36 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:25:36 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:25:36 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:25:36 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap89afa235-d9, may_exist=True, interface_attrs={}) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:25:36 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap89afa235-d9, col_values=(('qos', UUID('0ce68e13-7285-4ce7-b293-5e92fcfa5517')),), if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:25:36 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap89afa235-d9, col_values=(('external_ids', {'iface-id': '89afa235-d910-4430-a95a-c173ba7a7048', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a8:19:37', 'vm-uuid': '4dcdd769-bbfe-48e8-a876-8b2072b7baeb'}),), if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:25:36 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:25:36 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:25:36 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:25:36 user nova-compute[75226]: INFO os_vif [None req-d22d1e08-1e04-4b64-9b0c-575bd6066657 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:19:37,bridge_name='br-int',has_traffic_filtering=True,id=89afa235-d910-4430-a95a-c173ba7a7048,network=Network(9f39d3e5-b106-4bd9-b8ba-0f326e89c481),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89afa235-d9')
Nov 17 01:25:36 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-d22d1e08-1e04-4b64-9b0c-575bd6066657 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] No BDM found with device name vda, not building metadata. {{(pid=75226) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 01:25:36 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-d22d1e08-1e04-4b64-9b0c-575bd6066657 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] No VIF found with MAC fa:16:3e:a8:19:37, not building metadata {{(pid=75226) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 01:25:37 user nova-compute[75226]: DEBUG nova.network.neutron [req-c60a66f7-a929-4037-99cd-6094fdfd6170 req-287285c4-1caf-4ed5-b952-8735af80ebd1 service nova] [instance: 4dcdd769-bbfe-48e8-a876-8b2072b7baeb] Updated VIF entry in instance network info cache for port 89afa235-d910-4430-a95a-c173ba7a7048. {{(pid=75226) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 01:25:37 user nova-compute[75226]: DEBUG nova.network.neutron [req-c60a66f7-a929-4037-99cd-6094fdfd6170 req-287285c4-1caf-4ed5-b952-8735af80ebd1 service nova] [instance: 4dcdd769-bbfe-48e8-a876-8b2072b7baeb] Updating instance_info_cache with network_info: [{"id": "89afa235-d910-4430-a95a-c173ba7a7048", "address": "fa:16:3e:a8:19:37", "network": {"id": "9f39d3e5-b106-4bd9-b8ba-0f326e89c481", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-675861281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9042fe4ecc245dd97553f6e942c3e05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89afa235-d9", "ovs_interfaceid": "89afa235-d910-4430-a95a-c173ba7a7048", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:25:37 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-c60a66f7-a929-4037-99cd-6094fdfd6170 req-287285c4-1caf-4ed5-b952-8735af80ebd1 service nova] Releasing lock "refresh_cache-4dcdd769-bbfe-48e8-a876-8b2072b7baeb" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:25:37 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:25:38 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-2c39a99f-6b19-4584-8bdc-d5e80f5b60e9 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Acquiring lock "2ea5a14b-c330-4a2b-926e-60e1b30f5981" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:25:38 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-2c39a99f-6b19-4584-8bdc-d5e80f5b60e9 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Lock "2ea5a14b-c330-4a2b-926e-60e1b30f5981" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:25:38 user nova-compute[75226]: DEBUG nova.compute.manager [None req-2c39a99f-6b19-4584-8bdc-d5e80f5b60e9 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 2ea5a14b-c330-4a2b-926e-60e1b30f5981] Starting instance... {{(pid=75226) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 17 01:25:38 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-2c39a99f-6b19-4584-8bdc-d5e80f5b60e9 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:25:38 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-2c39a99f-6b19-4584-8bdc-d5e80f5b60e9 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:25:38 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-2c39a99f-6b19-4584-8bdc-d5e80f5b60e9 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75226) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 17 01:25:38 user nova-compute[75226]: INFO nova.compute.claims [None req-2c39a99f-6b19-4584-8bdc-d5e80f5b60e9 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 2ea5a14b-c330-4a2b-926e-60e1b30f5981] Claim successful on node user
Nov 17 01:25:38 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:25:38 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:25:38 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:25:38 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:25:38 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:25:38 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-2c39a99f-6b19-4584-8bdc-d5e80f5b60e9 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:25:38 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-2c39a99f-6b19-4584-8bdc-d5e80f5b60e9 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:25:38 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-2c39a99f-6b19-4584-8bdc-d5e80f5b60e9 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.468s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:25:38 user nova-compute[75226]: DEBUG nova.compute.manager [None req-2c39a99f-6b19-4584-8bdc-d5e80f5b60e9 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 2ea5a14b-c330-4a2b-926e-60e1b30f5981] Start building networks asynchronously for instance. {{(pid=75226) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 17 01:25:38 user nova-compute[75226]: DEBUG nova.compute.manager [None req-2c39a99f-6b19-4584-8bdc-d5e80f5b60e9 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 2ea5a14b-c330-4a2b-926e-60e1b30f5981] Allocating IP information in the background. {{(pid=75226) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 17 01:25:38 user nova-compute[75226]: DEBUG nova.network.neutron [None req-2c39a99f-6b19-4584-8bdc-d5e80f5b60e9 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 2ea5a14b-c330-4a2b-926e-60e1b30f5981] allocate_for_instance() {{(pid=75226) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 17 01:25:38 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-2c39a99f-6b19-4584-8bdc-d5e80f5b60e9 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 2ea5a14b-c330-4a2b-926e-60e1b30f5981] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 17 01:25:38 user nova-compute[75226]: DEBUG nova.compute.manager [None req-2c39a99f-6b19-4584-8bdc-d5e80f5b60e9 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 2ea5a14b-c330-4a2b-926e-60e1b30f5981] Start building block device mappings for instance. {{(pid=75226) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 17 01:25:38 user nova-compute[75226]: DEBUG nova.policy [None req-2c39a99f-6b19-4584-8bdc-d5e80f5b60e9 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1b793ce05bf44b939a9fb5a914a04cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6cb6f679ee4468d82cc7fb5d0f67be9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75226) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 17 01:25:38 user nova-compute[75226]: DEBUG nova.compute.manager [None req-2c39a99f-6b19-4584-8bdc-d5e80f5b60e9 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 2ea5a14b-c330-4a2b-926e-60e1b30f5981] Start spawning the instance on the hypervisor. {{(pid=75226) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 17 01:25:38 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-2c39a99f-6b19-4584-8bdc-d5e80f5b60e9 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 2ea5a14b-c330-4a2b-926e-60e1b30f5981] Creating instance directory {{(pid=75226) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 17 01:25:38 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-2c39a99f-6b19-4584-8bdc-d5e80f5b60e9 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 2ea5a14b-c330-4a2b-926e-60e1b30f5981] Creating image(s)
Nov 17 01:25:38 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-2c39a99f-6b19-4584-8bdc-d5e80f5b60e9 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Acquiring lock "/opt/stack/data/nova/instances/2ea5a14b-c330-4a2b-926e-60e1b30f5981/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:25:38 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-2c39a99f-6b19-4584-8bdc-d5e80f5b60e9 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Lock "/opt/stack/data/nova/instances/2ea5a14b-c330-4a2b-926e-60e1b30f5981/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:25:38 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-2c39a99f-6b19-4584-8bdc-d5e80f5b60e9 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Lock "/opt/stack/data/nova/instances/2ea5a14b-c330-4a2b-926e-60e1b30f5981/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:25:38 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-2c39a99f-6b19-4584-8bdc-d5e80f5b60e9 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:25:39 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-2c39a99f-6b19-4584-8bdc-d5e80f5b60e9 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json" returned: 0 in 0.197s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:25:39 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-2c39a99f-6b19-4584-8bdc-d5e80f5b60e9 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Acquiring lock "a8a62c2546af3a2036b853250c5ac64d4c6b4371" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:25:39 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-2c39a99f-6b19-4584-8bdc-d5e80f5b60e9 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Lock "a8a62c2546af3a2036b853250c5ac64d4c6b4371" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:25:39 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-2c39a99f-6b19-4584-8bdc-d5e80f5b60e9 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:25:39 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-2c39a99f-6b19-4584-8bdc-d5e80f5b60e9 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json" returned: 0 in 0.193s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:25:39 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-2c39a99f-6b19-4584-8bdc-d5e80f5b60e9 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371,backing_fmt=raw /opt/stack/data/nova/instances/2ea5a14b-c330-4a2b-926e-60e1b30f5981/disk 1073741824 {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:25:39 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-2c39a99f-6b19-4584-8bdc-d5e80f5b60e9 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371,backing_fmt=raw /opt/stack/data/nova/instances/2ea5a14b-c330-4a2b-926e-60e1b30f5981/disk 1073741824" returned: 0 in 0.070s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:25:39 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-2c39a99f-6b19-4584-8bdc-d5e80f5b60e9 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Lock "a8a62c2546af3a2036b853250c5ac64d4c6b4371" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.271s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:25:39 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-2c39a99f-6b19-4584-8bdc-d5e80f5b60e9 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:25:39 user nova-compute[75226]: DEBUG nova.network.neutron [None req-2c39a99f-6b19-4584-8bdc-d5e80f5b60e9 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 2ea5a14b-c330-4a2b-926e-60e1b30f5981] Successfully created port: 86250373-f92f-4176-b242-382fa11f4e39 {{(pid=75226) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 17 01:25:39 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-2c39a99f-6b19-4584-8bdc-d5e80f5b60e9 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json" returned: 0 in 0.194s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:25:39 user nova-compute[75226]: DEBUG nova.virt.disk.api [None req-2c39a99f-6b19-4584-8bdc-d5e80f5b60e9 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2ea5a14b-c330-4a2b-926e-60e1b30f5981/disk. size=1073741824 {{(pid=75226) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 17 01:25:39 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-2c39a99f-6b19-4584-8bdc-d5e80f5b60e9 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ea5a14b-c330-4a2b-926e-60e1b30f5981/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:25:39 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-2c39a99f-6b19-4584-8bdc-d5e80f5b60e9 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ea5a14b-c330-4a2b-926e-60e1b30f5981/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:25:39 user nova-compute[75226]: DEBUG nova.virt.disk.api [None req-2c39a99f-6b19-4584-8bdc-d5e80f5b60e9 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Cannot resize image /opt/stack/data/nova/instances/2ea5a14b-c330-4a2b-926e-60e1b30f5981/disk to a smaller size. {{(pid=75226) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 17 01:25:39 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-2c39a99f-6b19-4584-8bdc-d5e80f5b60e9 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 2ea5a14b-c330-4a2b-926e-60e1b30f5981] Created local disks {{(pid=75226) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 17 01:25:39 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-2c39a99f-6b19-4584-8bdc-d5e80f5b60e9 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 2ea5a14b-c330-4a2b-926e-60e1b30f5981] Ensure instance console log exists: /opt/stack/data/nova/instances/2ea5a14b-c330-4a2b-926e-60e1b30f5981/console.log {{(pid=75226) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 17 01:25:39 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-2c39a99f-6b19-4584-8bdc-d5e80f5b60e9 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:25:39 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-2c39a99f-6b19-4584-8bdc-d5e80f5b60e9 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:25:39 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-2c39a99f-6b19-4584-8bdc-d5e80f5b60e9 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:25:39 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-73c31349-3114-4661-9fdf-9da5c2bd3e70 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Acquiring lock "d6555d72-6094-4ea9-b071-a3d3c8a300a9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:25:39 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-73c31349-3114-4661-9fdf-9da5c2bd3e70 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Lock "d6555d72-6094-4ea9-b071-a3d3c8a300a9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:25:39 user nova-compute[75226]: DEBUG nova.compute.manager [None req-73c31349-3114-4661-9fdf-9da5c2bd3e70 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] [instance: d6555d72-6094-4ea9-b071-a3d3c8a300a9] Starting instance... {{(pid=75226) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 17 01:25:39 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-73c31349-3114-4661-9fdf-9da5c2bd3e70 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:25:39 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-73c31349-3114-4661-9fdf-9da5c2bd3e70 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:25:39 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-73c31349-3114-4661-9fdf-9da5c2bd3e70 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75226) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 17 01:25:39 user nova-compute[75226]: INFO nova.compute.claims [None req-73c31349-3114-4661-9fdf-9da5c2bd3e70 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] [instance: d6555d72-6094-4ea9-b071-a3d3c8a300a9] Claim successful on node user
Nov 17 01:25:40 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-73c31349-3114-4661-9fdf-9da5c2bd3e70 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:25:40 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-73c31349-3114-4661-9fdf-9da5c2bd3e70 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:25:40 user nova-compute[75226]: DEBUG nova.network.neutron [None req-2c39a99f-6b19-4584-8bdc-d5e80f5b60e9 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 2ea5a14b-c330-4a2b-926e-60e1b30f5981] Successfully updated port: 86250373-f92f-4176-b242-382fa11f4e39 {{(pid=75226) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 17 01:25:40 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-2c39a99f-6b19-4584-8bdc-d5e80f5b60e9 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Acquiring lock "refresh_cache-2ea5a14b-c330-4a2b-926e-60e1b30f5981" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:25:40 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-2c39a99f-6b19-4584-8bdc-d5e80f5b60e9 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Acquired lock "refresh_cache-2ea5a14b-c330-4a2b-926e-60e1b30f5981" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:25:40 user nova-compute[75226]: DEBUG nova.network.neutron [None req-2c39a99f-6b19-4584-8bdc-d5e80f5b60e9 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 2ea5a14b-c330-4a2b-926e-60e1b30f5981] Building network info cache for instance {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 01:25:40 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-73c31349-3114-4661-9fdf-9da5c2bd3e70 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.535s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:25:40 user nova-compute[75226]: DEBUG nova.compute.manager [None req-73c31349-3114-4661-9fdf-9da5c2bd3e70 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] [instance: d6555d72-6094-4ea9-b071-a3d3c8a300a9] Start building networks asynchronously for instance. {{(pid=75226) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 17 01:25:40 user nova-compute[75226]: DEBUG nova.compute.manager [req-fee4c9f7-69b4-4e13-a3bc-4057445b23e3 req-d4e6fca2-5620-4398-a2b7-d456bae90d29 service nova] [instance: 2ea5a14b-c330-4a2b-926e-60e1b30f5981] Received event network-changed-86250373-f92f-4176-b242-382fa11f4e39 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:25:40 user nova-compute[75226]: DEBUG nova.compute.manager [req-fee4c9f7-69b4-4e13-a3bc-4057445b23e3 req-d4e6fca2-5620-4398-a2b7-d456bae90d29 service nova] [instance: 2ea5a14b-c330-4a2b-926e-60e1b30f5981] Refreshing instance network info cache due to event network-changed-86250373-f92f-4176-b242-382fa11f4e39. {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 01:25:40 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-fee4c9f7-69b4-4e13-a3bc-4057445b23e3 req-d4e6fca2-5620-4398-a2b7-d456bae90d29 service nova] Acquiring lock "refresh_cache-2ea5a14b-c330-4a2b-926e-60e1b30f5981" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:25:40 user nova-compute[75226]: DEBUG nova.network.neutron [None req-2c39a99f-6b19-4584-8bdc-d5e80f5b60e9 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 2ea5a14b-c330-4a2b-926e-60e1b30f5981] Instance cache missing network info. {{(pid=75226) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 17 01:25:40 user nova-compute[75226]: DEBUG nova.compute.manager [None req-73c31349-3114-4661-9fdf-9da5c2bd3e70 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] [instance: d6555d72-6094-4ea9-b071-a3d3c8a300a9] Allocating IP information in the background. {{(pid=75226) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 17 01:25:40 user nova-compute[75226]: DEBUG nova.network.neutron [None req-73c31349-3114-4661-9fdf-9da5c2bd3e70 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] [instance: d6555d72-6094-4ea9-b071-a3d3c8a300a9] allocate_for_instance() {{(pid=75226) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 17 01:25:40 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-73c31349-3114-4661-9fdf-9da5c2bd3e70 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] [instance: d6555d72-6094-4ea9-b071-a3d3c8a300a9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 17 01:25:40 user nova-compute[75226]: DEBUG nova.compute.manager [None req-73c31349-3114-4661-9fdf-9da5c2bd3e70 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] [instance: d6555d72-6094-4ea9-b071-a3d3c8a300a9] Start building block device mappings for instance. {{(pid=75226) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 17 01:25:40 user nova-compute[75226]: DEBUG nova.compute.manager [None req-d22d1e08-1e04-4b64-9b0c-575bd6066657 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: 4dcdd769-bbfe-48e8-a876-8b2072b7baeb] Instance event wait completed in 0 seconds for  {{(pid=75226) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 17 01:25:40 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-d22d1e08-1e04-4b64-9b0c-575bd6066657 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: 4dcdd769-bbfe-48e8-a876-8b2072b7baeb] Guest created on hypervisor {{(pid=75226) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 17 01:25:40 user nova-compute[75226]: INFO nova.virt.libvirt.driver [-] [instance: 4dcdd769-bbfe-48e8-a876-8b2072b7baeb] Instance spawned successfully.
Nov 17 01:25:40 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-d22d1e08-1e04-4b64-9b0c-575bd6066657 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: 4dcdd769-bbfe-48e8-a876-8b2072b7baeb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 17 01:25:40 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-d22d1e08-1e04-4b64-9b0c-575bd6066657 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: 4dcdd769-bbfe-48e8-a876-8b2072b7baeb] Found default for hw_cdrom_bus of ide {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:25:40 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-d22d1e08-1e04-4b64-9b0c-575bd6066657 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: 4dcdd769-bbfe-48e8-a876-8b2072b7baeb] Found default for hw_disk_bus of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:25:40 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-d22d1e08-1e04-4b64-9b0c-575bd6066657 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: 4dcdd769-bbfe-48e8-a876-8b2072b7baeb] Found default for hw_input_bus of None {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:25:40 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-d22d1e08-1e04-4b64-9b0c-575bd6066657 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: 4dcdd769-bbfe-48e8-a876-8b2072b7baeb] Found default for hw_pointer_model of None {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:25:40 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-d22d1e08-1e04-4b64-9b0c-575bd6066657 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: 4dcdd769-bbfe-48e8-a876-8b2072b7baeb] Found default for hw_video_model of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:25:40 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-d22d1e08-1e04-4b64-9b0c-575bd6066657 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: 4dcdd769-bbfe-48e8-a876-8b2072b7baeb] Found default for hw_vif_model of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:25:40 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-6c8a905d-f7fe-40e8-9334-767f01831c5b tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Acquiring lock "5c280142-8901-4f83-bde4-baaa097e05b0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:25:40 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-6c8a905d-f7fe-40e8-9334-767f01831c5b tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Lock "5c280142-8901-4f83-bde4-baaa097e05b0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:25:40 user nova-compute[75226]: DEBUG nova.compute.manager [None req-6c8a905d-f7fe-40e8-9334-767f01831c5b tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] [instance: 5c280142-8901-4f83-bde4-baaa097e05b0] Starting instance... {{(pid=75226) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 17 01:25:40 user nova-compute[75226]: DEBUG nova.policy [None req-73c31349-3114-4661-9fdf-9da5c2bd3e70 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '12f405f1486a4f5187e628c60f223e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2052a37a068e4d948c57560c0f4445e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75226) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 17 01:25:40 user nova-compute[75226]: DEBUG nova.compute.manager [None req-73c31349-3114-4661-9fdf-9da5c2bd3e70 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] [instance: d6555d72-6094-4ea9-b071-a3d3c8a300a9] Start spawning the instance on the hypervisor. {{(pid=75226) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 17 01:25:40 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-73c31349-3114-4661-9fdf-9da5c2bd3e70 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] [instance: d6555d72-6094-4ea9-b071-a3d3c8a300a9] Creating instance directory {{(pid=75226) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 17 01:25:40 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-73c31349-3114-4661-9fdf-9da5c2bd3e70 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] [instance: d6555d72-6094-4ea9-b071-a3d3c8a300a9] Creating image(s)
Nov 17 01:25:40 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-73c31349-3114-4661-9fdf-9da5c2bd3e70 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Acquiring lock "/opt/stack/data/nova/instances/d6555d72-6094-4ea9-b071-a3d3c8a300a9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:25:40 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-73c31349-3114-4661-9fdf-9da5c2bd3e70 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Lock "/opt/stack/data/nova/instances/d6555d72-6094-4ea9-b071-a3d3c8a300a9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:25:40 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-73c31349-3114-4661-9fdf-9da5c2bd3e70 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Lock "/opt/stack/data/nova/instances/d6555d72-6094-4ea9-b071-a3d3c8a300a9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:25:40 user nova-compute[75226]: INFO nova.compute.manager [None req-d22d1e08-1e04-4b64-9b0c-575bd6066657 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: 4dcdd769-bbfe-48e8-a876-8b2072b7baeb] Took 6.71 seconds to spawn the instance on the hypervisor.
Nov 17 01:25:40 user nova-compute[75226]: DEBUG nova.compute.manager [None req-d22d1e08-1e04-4b64-9b0c-575bd6066657 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: 4dcdd769-bbfe-48e8-a876-8b2072b7baeb] Checking state {{(pid=75226) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 01:25:40 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-73c31349-3114-4661-9fdf-9da5c2bd3e70 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:25:40 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-6c8a905d-f7fe-40e8-9334-767f01831c5b tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:25:40 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-6c8a905d-f7fe-40e8-9334-767f01831c5b tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:25:40 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-6c8a905d-f7fe-40e8-9334-767f01831c5b tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75226) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 17 01:25:40 user nova-compute[75226]: INFO nova.compute.claims [None req-6c8a905d-f7fe-40e8-9334-767f01831c5b tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] [instance: 5c280142-8901-4f83-bde4-baaa097e05b0] Claim successful on node user
Nov 17 01:25:40 user nova-compute[75226]: INFO nova.compute.manager [None req-d22d1e08-1e04-4b64-9b0c-575bd6066657 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: 4dcdd769-bbfe-48e8-a876-8b2072b7baeb] Took 7.56 seconds to build instance.
Nov 17 01:25:40 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-d22d1e08-1e04-4b64-9b0c-575bd6066657 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Lock "4dcdd769-bbfe-48e8-a876-8b2072b7baeb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.676s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:25:40 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-73c31349-3114-4661-9fdf-9da5c2bd3e70 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json" returned: 0 in 0.196s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:25:40 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-73c31349-3114-4661-9fdf-9da5c2bd3e70 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Acquiring lock "a8a62c2546af3a2036b853250c5ac64d4c6b4371" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:25:40 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-73c31349-3114-4661-9fdf-9da5c2bd3e70 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Lock "a8a62c2546af3a2036b853250c5ac64d4c6b4371" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:25:40 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-73c31349-3114-4661-9fdf-9da5c2bd3e70 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:25:41 user nova-compute[75226]: DEBUG nova.network.neutron [None req-2c39a99f-6b19-4584-8bdc-d5e80f5b60e9 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 2ea5a14b-c330-4a2b-926e-60e1b30f5981] Updating instance_info_cache with network_info: [{"id": "86250373-f92f-4176-b242-382fa11f4e39", "address": "fa:16:3e:54:1e:3c", "network": {"id": "450540a3-ff7e-42fb-a0a6-808acd749943", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1503678778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6cb6f679ee4468d82cc7fb5d0f67be9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86250373-f9", "ovs_interfaceid": "86250373-f92f-4176-b242-382fa11f4e39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:25:41 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-2c39a99f-6b19-4584-8bdc-d5e80f5b60e9 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Releasing lock "refresh_cache-2ea5a14b-c330-4a2b-926e-60e1b30f5981" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:25:41 user nova-compute[75226]: DEBUG nova.compute.manager [None req-2c39a99f-6b19-4584-8bdc-d5e80f5b60e9 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 2ea5a14b-c330-4a2b-926e-60e1b30f5981] Instance network_info: |[{"id": "86250373-f92f-4176-b242-382fa11f4e39", "address": "fa:16:3e:54:1e:3c", "network": {"id": "450540a3-ff7e-42fb-a0a6-808acd749943", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1503678778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6cb6f679ee4468d82cc7fb5d0f67be9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86250373-f9", "ovs_interfaceid": "86250373-f92f-4176-b242-382fa11f4e39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75226) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 17 01:25:41 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-fee4c9f7-69b4-4e13-a3bc-4057445b23e3 req-d4e6fca2-5620-4398-a2b7-d456bae90d29 service nova] Acquired lock "refresh_cache-2ea5a14b-c330-4a2b-926e-60e1b30f5981" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:25:41 user nova-compute[75226]: DEBUG nova.network.neutron [req-fee4c9f7-69b4-4e13-a3bc-4057445b23e3 req-d4e6fca2-5620-4398-a2b7-d456bae90d29 service nova] [instance: 2ea5a14b-c330-4a2b-926e-60e1b30f5981] Refreshing network info cache for port 86250373-f92f-4176-b242-382fa11f4e39 {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 01:25:41 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-2c39a99f-6b19-4584-8bdc-d5e80f5b60e9 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 2ea5a14b-c330-4a2b-926e-60e1b30f5981] Start _get_guest_xml network_info=[{"id": "86250373-f92f-4176-b242-382fa11f4e39", "address": "fa:16:3e:54:1e:3c", "network": {"id": "450540a3-ff7e-42fb-a0a6-808acd749943", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1503678778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6cb6f679ee4468d82cc7fb5d0f67be9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86250373-f9", "ovs_interfaceid": "86250373-f92f-4176-b242-382fa11f4e39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T01:13:22Z,direct_url=<?>,disk_format='qcow2',id=0b369aea-6f3f-4690-9f01-229b90ab6310,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4e110cbf9a84362a6864a7732c435a1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T01:13:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '0b369aea-6f3f-4690-9f01-229b90ab6310'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75226) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 17 01:25:41 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-73c31349-3114-4661-9fdf-9da5c2bd3e70 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json" returned: 0 in 0.184s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:25:41 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-73c31349-3114-4661-9fdf-9da5c2bd3e70 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371,backing_fmt=raw /opt/stack/data/nova/instances/d6555d72-6094-4ea9-b071-a3d3c8a300a9/disk 1073741824 {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:25:41 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-73c31349-3114-4661-9fdf-9da5c2bd3e70 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371,backing_fmt=raw /opt/stack/data/nova/instances/d6555d72-6094-4ea9-b071-a3d3c8a300a9/disk 1073741824" returned: 0 in 0.054s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:25:41 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-73c31349-3114-4661-9fdf-9da5c2bd3e70 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Lock "a8a62c2546af3a2036b853250c5ac64d4c6b4371" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:25:41 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-73c31349-3114-4661-9fdf-9da5c2bd3e70 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:25:41 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-2c39a99f-6b19-4584-8bdc-d5e80f5b60e9 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:25:41 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-2c39a99f-6b19-4584-8bdc-d5e80f5b60e9 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:25:41 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-2c39a99f-6b19-4584-8bdc-d5e80f5b60e9 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75226) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 17 01:25:41 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-2c39a99f-6b19-4584-8bdc-d5e80f5b60e9 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] CPU controller missing on host. {{(pid=75226) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 17 01:25:41 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-2c39a99f-6b19-4584-8bdc-d5e80f5b60e9 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75226) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 17 01:25:41 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-2c39a99f-6b19-4584-8bdc-d5e80f5b60e9 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] CPU controller found on host. {{(pid=75226) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 17 01:25:41 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-2c39a99f-6b19-4584-8bdc-d5e80f5b60e9 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75226) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 17 01:25:41 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-2c39a99f-6b19-4584-8bdc-d5e80f5b60e9 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-17T01:13:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T01:13:22Z,direct_url=<?>,disk_format='qcow2',id=0b369aea-6f3f-4690-9f01-229b90ab6310,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4e110cbf9a84362a6864a7732c435a1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T01:13:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 17 01:25:41 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-2c39a99f-6b19-4584-8bdc-d5e80f5b60e9 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Flavor limits 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 17 01:25:41 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-2c39a99f-6b19-4584-8bdc-d5e80f5b60e9 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Image limits 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 17 01:25:41 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-2c39a99f-6b19-4584-8bdc-d5e80f5b60e9 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Flavor pref 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 17 01:25:41 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-2c39a99f-6b19-4584-8bdc-d5e80f5b60e9 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Image pref 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 17 01:25:41 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-2c39a99f-6b19-4584-8bdc-d5e80f5b60e9 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 17 01:25:41 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-2c39a99f-6b19-4584-8bdc-d5e80f5b60e9 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 17 01:25:41 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-2c39a99f-6b19-4584-8bdc-d5e80f5b60e9 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75226) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 17 01:25:41 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-2c39a99f-6b19-4584-8bdc-d5e80f5b60e9 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Got 1 possible topologies {{(pid=75226) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 17 01:25:41 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-2c39a99f-6b19-4584-8bdc-d5e80f5b60e9 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 17 01:25:41 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-2c39a99f-6b19-4584-8bdc-d5e80f5b60e9 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 17 01:25:41 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-2c39a99f-6b19-4584-8bdc-d5e80f5b60e9 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:25:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1844763695',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1844763695',id=24,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e6cb6f679ee4468d82cc7fb5d0f67be9',ramdisk_id='',reservation_id='r-vcihpk6a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-76498640',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T01:25:39Z,user_data=None,user_id='1b793ce05bf44b939a9fb5a914a04cb0',uuid=2ea5a14b-c330-4a2b-926e-60e1b30f5981,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "86250373-f92f-4176-b242-382fa11f4e39", "address": "fa:16:3e:54:1e:3c", "network": {"id": "450540a3-ff7e-42fb-a0a6-808acd749943", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1503678778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6cb6f679ee4468d82cc7fb5d0f67be9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86250373-f9", "ovs_interfaceid": "86250373-f92f-4176-b242-382fa11f4e39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75226) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 01:25:41 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-2c39a99f-6b19-4584-8bdc-d5e80f5b60e9 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Converting VIF {"id": "86250373-f92f-4176-b242-382fa11f4e39", "address": "fa:16:3e:54:1e:3c", "network": {"id": "450540a3-ff7e-42fb-a0a6-808acd749943", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1503678778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6cb6f679ee4468d82cc7fb5d0f67be9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86250373-f9", "ovs_interfaceid": "86250373-f92f-4176-b242-382fa11f4e39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:25:41 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-2c39a99f-6b19-4584-8bdc-d5e80f5b60e9 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:1e:3c,bridge_name='br-int',has_traffic_filtering=True,id=86250373-f92f-4176-b242-382fa11f4e39,network=Network(450540a3-ff7e-42fb-a0a6-808acd749943),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86250373-f9') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:25:41 user nova-compute[75226]: DEBUG nova.objects.instance [None req-2c39a99f-6b19-4584-8bdc-d5e80f5b60e9 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Lazy-loading 'pci_devices' on Instance uuid 2ea5a14b-c330-4a2b-926e-60e1b30f5981 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:25:41 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-2c39a99f-6b19-4584-8bdc-d5e80f5b60e9 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 2ea5a14b-c330-4a2b-926e-60e1b30f5981] End _get_guest_xml xml=<domain type="kvm">
Nov 17 01:25:41 user nova-compute[75226]:   <uuid>2ea5a14b-c330-4a2b-926e-60e1b30f5981</uuid>
Nov 17 01:25:41 user nova-compute[75226]:   <name>instance-00000018</name>
Nov 17 01:25:41 user nova-compute[75226]:   <memory>524288</memory>
Nov 17 01:25:41 user nova-compute[75226]:   <vcpu>1</vcpu>
Nov 17 01:25:41 user nova-compute[75226]:   <metadata>
Nov 17 01:25:41 user nova-compute[75226]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 17 01:25:41 user nova-compute[75226]:       <nova:package version="0.0.0"/>
Nov 17 01:25:41 user nova-compute[75226]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1844763695</nova:name>
Nov 17 01:25:41 user nova-compute[75226]:       <nova:creationTime>2023-11-17 01:25:41</nova:creationTime>
Nov 17 01:25:41 user nova-compute[75226]:       <nova:flavor name="m1.tiny">
Nov 17 01:25:41 user nova-compute[75226]:         <nova:memory>512</nova:memory>
Nov 17 01:25:41 user nova-compute[75226]:         <nova:disk>1</nova:disk>
Nov 17 01:25:41 user nova-compute[75226]:         <nova:swap>0</nova:swap>
Nov 17 01:25:41 user nova-compute[75226]:         <nova:ephemeral>0</nova:ephemeral>
Nov 17 01:25:41 user nova-compute[75226]:         <nova:vcpus>1</nova:vcpus>
Nov 17 01:25:41 user nova-compute[75226]:       </nova:flavor>
Nov 17 01:25:41 user nova-compute[75226]:       <nova:owner>
Nov 17 01:25:41 user nova-compute[75226]:         <nova:user uuid="1b793ce05bf44b939a9fb5a914a04cb0">tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member</nova:user>
Nov 17 01:25:41 user nova-compute[75226]:         <nova:project uuid="e6cb6f679ee4468d82cc7fb5d0f67be9">tempest-ServerBootFromVolumeStableRescueTest-76498640</nova:project>
Nov 17 01:25:41 user nova-compute[75226]:       </nova:owner>
Nov 17 01:25:41 user nova-compute[75226]:       <nova:root type="image" uuid="0b369aea-6f3f-4690-9f01-229b90ab6310"/>
Nov 17 01:25:41 user nova-compute[75226]:       <nova:ports>
Nov 17 01:25:41 user nova-compute[75226]:         <nova:port uuid="86250373-f92f-4176-b242-382fa11f4e39">
Nov 17 01:25:41 user nova-compute[75226]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 17 01:25:41 user nova-compute[75226]:         </nova:port>
Nov 17 01:25:41 user nova-compute[75226]:       </nova:ports>
Nov 17 01:25:41 user nova-compute[75226]:     </nova:instance>
Nov 17 01:25:41 user nova-compute[75226]:   </metadata>
Nov 17 01:25:41 user nova-compute[75226]:   <sysinfo type="smbios">
Nov 17 01:25:41 user nova-compute[75226]:     <system>
Nov 17 01:25:41 user nova-compute[75226]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 17 01:25:41 user nova-compute[75226]:       <entry name="product">OpenStack Nova</entry>
Nov 17 01:25:41 user nova-compute[75226]:       <entry name="version">0.0.0</entry>
Nov 17 01:25:41 user nova-compute[75226]:       <entry name="serial">2ea5a14b-c330-4a2b-926e-60e1b30f5981</entry>
Nov 17 01:25:41 user nova-compute[75226]:       <entry name="uuid">2ea5a14b-c330-4a2b-926e-60e1b30f5981</entry>
Nov 17 01:25:41 user nova-compute[75226]:       <entry name="family">Virtual Machine</entry>
Nov 17 01:25:41 user nova-compute[75226]:     </system>
Nov 17 01:25:41 user nova-compute[75226]:   </sysinfo>
Nov 17 01:25:41 user nova-compute[75226]:   <os>
Nov 17 01:25:41 user nova-compute[75226]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 17 01:25:41 user nova-compute[75226]:     <boot dev="hd"/>
Nov 17 01:25:41 user nova-compute[75226]:     <smbios mode="sysinfo"/>
Nov 17 01:25:41 user nova-compute[75226]:   </os>
Nov 17 01:25:41 user nova-compute[75226]:   <features>
Nov 17 01:25:41 user nova-compute[75226]:     <acpi/>
Nov 17 01:25:41 user nova-compute[75226]:     <apic/>
Nov 17 01:25:41 user nova-compute[75226]:     <vmcoreinfo/>
Nov 17 01:25:41 user nova-compute[75226]:   </features>
Nov 17 01:25:41 user nova-compute[75226]:   <clock offset="utc">
Nov 17 01:25:41 user nova-compute[75226]:     <timer name="pit" tickpolicy="delay"/>
Nov 17 01:25:41 user nova-compute[75226]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 17 01:25:41 user nova-compute[75226]:     <timer name="hpet" present="no"/>
Nov 17 01:25:41 user nova-compute[75226]:   </clock>
Nov 17 01:25:41 user nova-compute[75226]:   <cpu mode="custom" match="exact">
Nov 17 01:25:41 user nova-compute[75226]:     <model>Nehalem</model>
Nov 17 01:25:41 user nova-compute[75226]:     <topology sockets="1" cores="1" threads="1"/>
Nov 17 01:25:41 user nova-compute[75226]:   </cpu>
Nov 17 01:25:41 user nova-compute[75226]:   <devices>
Nov 17 01:25:41 user nova-compute[75226]:     <disk type="file" device="disk">
Nov 17 01:25:41 user nova-compute[75226]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 17 01:25:41 user nova-compute[75226]:       <source file="/opt/stack/data/nova/instances/2ea5a14b-c330-4a2b-926e-60e1b30f5981/disk"/>
Nov 17 01:25:41 user nova-compute[75226]:       <target dev="vda" bus="virtio"/>
Nov 17 01:25:41 user nova-compute[75226]:     </disk>
Nov 17 01:25:41 user nova-compute[75226]:     <interface type="ethernet">
Nov 17 01:25:41 user nova-compute[75226]:       <mac address="fa:16:3e:54:1e:3c"/>
Nov 17 01:25:41 user nova-compute[75226]:       <model type="virtio"/>
Nov 17 01:25:41 user nova-compute[75226]:       <mtu size="1442"/>
Nov 17 01:25:41 user nova-compute[75226]:       <target dev="tap86250373-f9"/>
Nov 17 01:25:41 user nova-compute[75226]:     </interface>
Nov 17 01:25:41 user nova-compute[75226]:     <serial type="pty">
Nov 17 01:25:41 user nova-compute[75226]:       <log file="/opt/stack/data/nova/instances/2ea5a14b-c330-4a2b-926e-60e1b30f5981/console.log" append="off"/>
Nov 17 01:25:41 user nova-compute[75226]:     </serial>
Nov 17 01:25:41 user nova-compute[75226]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 17 01:25:41 user nova-compute[75226]:     <video>
Nov 17 01:25:41 user nova-compute[75226]:       <model type="virtio"/>
Nov 17 01:25:41 user nova-compute[75226]:     </video>
Nov 17 01:25:41 user nova-compute[75226]:     <rng model="virtio">
Nov 17 01:25:41 user nova-compute[75226]:       <backend model="random">/dev/urandom</backend>
Nov 17 01:25:41 user nova-compute[75226]:     </rng>
Nov 17 01:25:41 user nova-compute[75226]:     <controller type="usb" index="0" model="none"/>
Nov 17 01:25:41 user nova-compute[75226]:     <memballoon model="virtio">
Nov 17 01:25:41 user nova-compute[75226]:       <stats period="10"/>
Nov 17 01:25:41 user nova-compute[75226]:     </memballoon>
Nov 17 01:25:41 user nova-compute[75226]:   </devices>
Nov 17 01:25:41 user nova-compute[75226]: </domain>
Nov 17 01:25:41 user nova-compute[75226]:  {{(pid=75226) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 17 01:25:41 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-2c39a99f-6b19-4584-8bdc-d5e80f5b60e9 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:25:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1844763695',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1844763695',id=24,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e6cb6f679ee4468d82cc7fb5d0f67be9',ramdisk_id='',reservation_id='r-vcihpk6a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-76498640',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T01:25:39Z,user_data=None,user_id='1b793ce05bf44b939a9fb5a914a04cb0',uuid=2ea5a14b-c330-4a2b-926e-60e1b30f5981,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "86250373-f92f-4176-b242-382fa11f4e39", "address": "fa:16:3e:54:1e:3c", "network": {"id": "450540a3-ff7e-42fb-a0a6-808acd749943", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1503678778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6cb6f679ee4468d82cc7fb5d0f67be9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86250373-f9", "ovs_interfaceid": "86250373-f92f-4176-b242-382fa11f4e39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 17 01:25:41 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-2c39a99f-6b19-4584-8bdc-d5e80f5b60e9 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Converting VIF {"id": "86250373-f92f-4176-b242-382fa11f4e39", "address": "fa:16:3e:54:1e:3c", "network": {"id": "450540a3-ff7e-42fb-a0a6-808acd749943", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1503678778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6cb6f679ee4468d82cc7fb5d0f67be9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86250373-f9", "ovs_interfaceid": "86250373-f92f-4176-b242-382fa11f4e39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:25:41 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-2c39a99f-6b19-4584-8bdc-d5e80f5b60e9 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:1e:3c,bridge_name='br-int',has_traffic_filtering=True,id=86250373-f92f-4176-b242-382fa11f4e39,network=Network(450540a3-ff7e-42fb-a0a6-808acd749943),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86250373-f9') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:25:41 user nova-compute[75226]: DEBUG os_vif [None req-2c39a99f-6b19-4584-8bdc-d5e80f5b60e9 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:1e:3c,bridge_name='br-int',has_traffic_filtering=True,id=86250373-f92f-4176-b242-382fa11f4e39,network=Network(450540a3-ff7e-42fb-a0a6-808acd749943),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86250373-f9') {{(pid=75226) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 17 01:25:41 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:25:41 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:25:41 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 17 01:25:41 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:25:41 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4d53f70f-058f-5def-87ab-104c3f6fd230', '_type': 'linux-noop'}}, row=False) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:25:41 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:25:41 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:25:41 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:25:41 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:25:41 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap86250373-f9, may_exist=True, interface_attrs={}) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:25:41 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap86250373-f9, col_values=(('qos', UUID('12303430-70e7-4850-9976-d76202198e17')),), if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:25:41 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap86250373-f9, col_values=(('external_ids', {'iface-id': '86250373-f92f-4176-b242-382fa11f4e39', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:54:1e:3c', 'vm-uuid': '2ea5a14b-c330-4a2b-926e-60e1b30f5981'}),), if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:25:41 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:25:41 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:25:41 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:25:41 user nova-compute[75226]: INFO os_vif [None req-2c39a99f-6b19-4584-8bdc-d5e80f5b60e9 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:1e:3c,bridge_name='br-int',has_traffic_filtering=True,id=86250373-f92f-4176-b242-382fa11f4e39,network=Network(450540a3-ff7e-42fb-a0a6-808acd749943),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86250373-f9')
Nov 17 01:25:41 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-73c31349-3114-4661-9fdf-9da5c2bd3e70 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json" returned: 0 in 0.199s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:25:41 user nova-compute[75226]: DEBUG nova.virt.disk.api [None req-73c31349-3114-4661-9fdf-9da5c2bd3e70 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d6555d72-6094-4ea9-b071-a3d3c8a300a9/disk. size=1073741824 {{(pid=75226) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 17 01:25:41 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-73c31349-3114-4661-9fdf-9da5c2bd3e70 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6555d72-6094-4ea9-b071-a3d3c8a300a9/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:25:41 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-6c8a905d-f7fe-40e8-9334-767f01831c5b tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:25:41 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-2c39a99f-6b19-4584-8bdc-d5e80f5b60e9 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] No BDM found with device name vda, not building metadata. {{(pid=75226) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 01:25:41 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-2c39a99f-6b19-4584-8bdc-d5e80f5b60e9 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] No VIF found with MAC fa:16:3e:54:1e:3c, not building metadata {{(pid=75226) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 01:25:41 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-6c8a905d-f7fe-40e8-9334-767f01831c5b tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:25:41 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-73c31349-3114-4661-9fdf-9da5c2bd3e70 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6555d72-6094-4ea9-b071-a3d3c8a300a9/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:25:41 user nova-compute[75226]: DEBUG nova.virt.disk.api [None req-73c31349-3114-4661-9fdf-9da5c2bd3e70 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Cannot resize image /opt/stack/data/nova/instances/d6555d72-6094-4ea9-b071-a3d3c8a300a9/disk to a smaller size. {{(pid=75226) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 17 01:25:41 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-73c31349-3114-4661-9fdf-9da5c2bd3e70 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] [instance: d6555d72-6094-4ea9-b071-a3d3c8a300a9] Created local disks {{(pid=75226) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 17 01:25:41 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-73c31349-3114-4661-9fdf-9da5c2bd3e70 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] [instance: d6555d72-6094-4ea9-b071-a3d3c8a300a9] Ensure instance console log exists: /opt/stack/data/nova/instances/d6555d72-6094-4ea9-b071-a3d3c8a300a9/console.log {{(pid=75226) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 17 01:25:41 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-73c31349-3114-4661-9fdf-9da5c2bd3e70 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:25:41 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-73c31349-3114-4661-9fdf-9da5c2bd3e70 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:25:41 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-73c31349-3114-4661-9fdf-9da5c2bd3e70 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:25:41 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-6c8a905d-f7fe-40e8-9334-767f01831c5b tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.800s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:25:41 user nova-compute[75226]: DEBUG nova.compute.manager [None req-6c8a905d-f7fe-40e8-9334-767f01831c5b tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] [instance: 5c280142-8901-4f83-bde4-baaa097e05b0] Start building networks asynchronously for instance. {{(pid=75226) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 17 01:25:41 user nova-compute[75226]: DEBUG nova.compute.manager [None req-6c8a905d-f7fe-40e8-9334-767f01831c5b tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] [instance: 5c280142-8901-4f83-bde4-baaa097e05b0] Allocating IP information in the background. {{(pid=75226) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 17 01:25:41 user nova-compute[75226]: DEBUG nova.network.neutron [None req-6c8a905d-f7fe-40e8-9334-767f01831c5b tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] [instance: 5c280142-8901-4f83-bde4-baaa097e05b0] allocate_for_instance() {{(pid=75226) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 17 01:25:41 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-6c8a905d-f7fe-40e8-9334-767f01831c5b tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] [instance: 5c280142-8901-4f83-bde4-baaa097e05b0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 17 01:25:41 user nova-compute[75226]: DEBUG nova.compute.manager [None req-6c8a905d-f7fe-40e8-9334-767f01831c5b tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] [instance: 5c280142-8901-4f83-bde4-baaa097e05b0] Start building block device mappings for instance. {{(pid=75226) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 17 01:25:41 user nova-compute[75226]: DEBUG nova.network.neutron [None req-73c31349-3114-4661-9fdf-9da5c2bd3e70 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] [instance: d6555d72-6094-4ea9-b071-a3d3c8a300a9] Successfully created port: 1315a3d4-9d0a-4a65-8044-45959bf1f754 {{(pid=75226) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 17 01:25:41 user nova-compute[75226]: DEBUG nova.network.neutron [req-fee4c9f7-69b4-4e13-a3bc-4057445b23e3 req-d4e6fca2-5620-4398-a2b7-d456bae90d29 service nova] [instance: 2ea5a14b-c330-4a2b-926e-60e1b30f5981] Updated VIF entry in instance network info cache for port 86250373-f92f-4176-b242-382fa11f4e39. {{(pid=75226) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 01:25:41 user nova-compute[75226]: DEBUG nova.network.neutron [req-fee4c9f7-69b4-4e13-a3bc-4057445b23e3 req-d4e6fca2-5620-4398-a2b7-d456bae90d29 service nova] [instance: 2ea5a14b-c330-4a2b-926e-60e1b30f5981] Updating instance_info_cache with network_info: [{"id": "86250373-f92f-4176-b242-382fa11f4e39", "address": "fa:16:3e:54:1e:3c", "network": {"id": "450540a3-ff7e-42fb-a0a6-808acd749943", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1503678778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6cb6f679ee4468d82cc7fb5d0f67be9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86250373-f9", "ovs_interfaceid": "86250373-f92f-4176-b242-382fa11f4e39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:25:41 user nova-compute[75226]: DEBUG nova.policy [None req-6c8a905d-f7fe-40e8-9334-767f01831c5b tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '12f405f1486a4f5187e628c60f223e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2052a37a068e4d948c57560c0f4445e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75226) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 17 01:25:41 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-fee4c9f7-69b4-4e13-a3bc-4057445b23e3 req-d4e6fca2-5620-4398-a2b7-d456bae90d29 service nova] Releasing lock "refresh_cache-2ea5a14b-c330-4a2b-926e-60e1b30f5981" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:25:41 user nova-compute[75226]: DEBUG nova.compute.manager [None req-6c8a905d-f7fe-40e8-9334-767f01831c5b tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] [instance: 5c280142-8901-4f83-bde4-baaa097e05b0] Start spawning the instance on the hypervisor. {{(pid=75226) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 17 01:25:41 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-6c8a905d-f7fe-40e8-9334-767f01831c5b tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] [instance: 5c280142-8901-4f83-bde4-baaa097e05b0] Creating instance directory {{(pid=75226) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 17 01:25:41 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-6c8a905d-f7fe-40e8-9334-767f01831c5b tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] [instance: 5c280142-8901-4f83-bde4-baaa097e05b0] Creating image(s)
Nov 17 01:25:41 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-6c8a905d-f7fe-40e8-9334-767f01831c5b tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Acquiring lock "/opt/stack/data/nova/instances/5c280142-8901-4f83-bde4-baaa097e05b0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:25:41 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-6c8a905d-f7fe-40e8-9334-767f01831c5b tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Lock "/opt/stack/data/nova/instances/5c280142-8901-4f83-bde4-baaa097e05b0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:25:41 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-6c8a905d-f7fe-40e8-9334-767f01831c5b tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Lock "/opt/stack/data/nova/instances/5c280142-8901-4f83-bde4-baaa097e05b0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:25:41 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-6c8a905d-f7fe-40e8-9334-767f01831c5b tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:25:42 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-6c8a905d-f7fe-40e8-9334-767f01831c5b tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json" returned: 0 in 0.190s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:25:42 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-6c8a905d-f7fe-40e8-9334-767f01831c5b tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Acquiring lock "a8a62c2546af3a2036b853250c5ac64d4c6b4371" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:25:42 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-6c8a905d-f7fe-40e8-9334-767f01831c5b tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Lock "a8a62c2546af3a2036b853250c5ac64d4c6b4371" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:25:42 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-6c8a905d-f7fe-40e8-9334-767f01831c5b tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:25:42 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-6c8a905d-f7fe-40e8-9334-767f01831c5b tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json" returned: 0 in 0.196s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:25:42 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-6c8a905d-f7fe-40e8-9334-767f01831c5b tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371,backing_fmt=raw /opt/stack/data/nova/instances/5c280142-8901-4f83-bde4-baaa097e05b0/disk 1073741824 {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:25:42 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-6c8a905d-f7fe-40e8-9334-767f01831c5b tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371,backing_fmt=raw /opt/stack/data/nova/instances/5c280142-8901-4f83-bde4-baaa097e05b0/disk 1073741824" returned: 0 in 0.069s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:25:42 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-6c8a905d-f7fe-40e8-9334-767f01831c5b tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Lock "a8a62c2546af3a2036b853250c5ac64d4c6b4371" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.275s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:25:42 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-6c8a905d-f7fe-40e8-9334-767f01831c5b tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:25:42 user nova-compute[75226]: DEBUG nova.network.neutron [None req-73c31349-3114-4661-9fdf-9da5c2bd3e70 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] [instance: d6555d72-6094-4ea9-b071-a3d3c8a300a9] Successfully updated port: 1315a3d4-9d0a-4a65-8044-45959bf1f754 {{(pid=75226) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 17 01:25:42 user nova-compute[75226]: DEBUG nova.network.neutron [None req-6c8a905d-f7fe-40e8-9334-767f01831c5b tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] [instance: 5c280142-8901-4f83-bde4-baaa097e05b0] Successfully created port: 3f54cf07-6d64-4e03-a3f7-bab096a18e89 {{(pid=75226) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 17 01:25:42 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-73c31349-3114-4661-9fdf-9da5c2bd3e70 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Acquiring lock "refresh_cache-d6555d72-6094-4ea9-b071-a3d3c8a300a9" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:25:42 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-73c31349-3114-4661-9fdf-9da5c2bd3e70 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Acquired lock "refresh_cache-d6555d72-6094-4ea9-b071-a3d3c8a300a9" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:25:42 user nova-compute[75226]: DEBUG nova.network.neutron [None req-73c31349-3114-4661-9fdf-9da5c2bd3e70 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] [instance: d6555d72-6094-4ea9-b071-a3d3c8a300a9] Building network info cache for instance {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 01:25:42 user nova-compute[75226]: DEBUG nova.network.neutron [None req-73c31349-3114-4661-9fdf-9da5c2bd3e70 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] [instance: d6555d72-6094-4ea9-b071-a3d3c8a300a9] Instance cache missing network info. {{(pid=75226) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 17 01:25:42 user nova-compute[75226]: DEBUG nova.compute.manager [req-37c6d867-19dd-4b1d-916c-f783d55974d6 req-56af36c8-fad5-4e17-98ba-101a9421ed77 service nova] [instance: d6555d72-6094-4ea9-b071-a3d3c8a300a9] Received event network-changed-1315a3d4-9d0a-4a65-8044-45959bf1f754 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:25:42 user nova-compute[75226]: DEBUG nova.compute.manager [req-37c6d867-19dd-4b1d-916c-f783d55974d6 req-56af36c8-fad5-4e17-98ba-101a9421ed77 service nova] [instance: d6555d72-6094-4ea9-b071-a3d3c8a300a9] Refreshing instance network info cache due to event network-changed-1315a3d4-9d0a-4a65-8044-45959bf1f754. {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 01:25:42 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-37c6d867-19dd-4b1d-916c-f783d55974d6 req-56af36c8-fad5-4e17-98ba-101a9421ed77 service nova] Acquiring lock "refresh_cache-d6555d72-6094-4ea9-b071-a3d3c8a300a9" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:25:42 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-6c8a905d-f7fe-40e8-9334-767f01831c5b tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json" returned: 0 in 0.200s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:25:42 user nova-compute[75226]: DEBUG nova.virt.disk.api [None req-6c8a905d-f7fe-40e8-9334-767f01831c5b tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5c280142-8901-4f83-bde4-baaa097e05b0/disk. size=1073741824 {{(pid=75226) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 17 01:25:42 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-6c8a905d-f7fe-40e8-9334-767f01831c5b tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c280142-8901-4f83-bde4-baaa097e05b0/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:25:42 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:25:42 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-6c8a905d-f7fe-40e8-9334-767f01831c5b tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c280142-8901-4f83-bde4-baaa097e05b0/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:25:42 user nova-compute[75226]: DEBUG nova.virt.disk.api [None req-6c8a905d-f7fe-40e8-9334-767f01831c5b tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Cannot resize image /opt/stack/data/nova/instances/5c280142-8901-4f83-bde4-baaa097e05b0/disk to a smaller size. {{(pid=75226) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 17 01:25:42 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-6c8a905d-f7fe-40e8-9334-767f01831c5b tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] [instance: 5c280142-8901-4f83-bde4-baaa097e05b0] Created local disks {{(pid=75226) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 17 01:25:42 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-6c8a905d-f7fe-40e8-9334-767f01831c5b tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] [instance: 5c280142-8901-4f83-bde4-baaa097e05b0] Ensure instance console log exists: /opt/stack/data/nova/instances/5c280142-8901-4f83-bde4-baaa097e05b0/console.log {{(pid=75226) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 17 01:25:42 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-6c8a905d-f7fe-40e8-9334-767f01831c5b tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:25:42 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-6c8a905d-f7fe-40e8-9334-767f01831c5b tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:25:42 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-6c8a905d-f7fe-40e8-9334-767f01831c5b tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:25:42 user nova-compute[75226]: DEBUG nova.network.neutron [None req-73c31349-3114-4661-9fdf-9da5c2bd3e70 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] [instance: d6555d72-6094-4ea9-b071-a3d3c8a300a9] Updating instance_info_cache with network_info: [{"id": "1315a3d4-9d0a-4a65-8044-45959bf1f754", "address": "fa:16:3e:83:57:31", "network": {"id": "a9710b94-56f8-4cf6-9bb6-344b275e5bf2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-512340839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2052a37a068e4d948c57560c0f4445e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1315a3d4-9d", "ovs_interfaceid": "1315a3d4-9d0a-4a65-8044-45959bf1f754", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:25:42 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-73c31349-3114-4661-9fdf-9da5c2bd3e70 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Releasing lock "refresh_cache-d6555d72-6094-4ea9-b071-a3d3c8a300a9" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:25:42 user nova-compute[75226]: DEBUG nova.compute.manager [None req-73c31349-3114-4661-9fdf-9da5c2bd3e70 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] [instance: d6555d72-6094-4ea9-b071-a3d3c8a300a9] Instance network_info: |[{"id": "1315a3d4-9d0a-4a65-8044-45959bf1f754", "address": "fa:16:3e:83:57:31", "network": {"id": "a9710b94-56f8-4cf6-9bb6-344b275e5bf2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-512340839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2052a37a068e4d948c57560c0f4445e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1315a3d4-9d", "ovs_interfaceid": "1315a3d4-9d0a-4a65-8044-45959bf1f754", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75226) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 17 01:25:42 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-37c6d867-19dd-4b1d-916c-f783d55974d6 req-56af36c8-fad5-4e17-98ba-101a9421ed77 service nova] Acquired lock "refresh_cache-d6555d72-6094-4ea9-b071-a3d3c8a300a9" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:25:42 user nova-compute[75226]: DEBUG nova.network.neutron [req-37c6d867-19dd-4b1d-916c-f783d55974d6 req-56af36c8-fad5-4e17-98ba-101a9421ed77 service nova] [instance: d6555d72-6094-4ea9-b071-a3d3c8a300a9] Refreshing network info cache for port 1315a3d4-9d0a-4a65-8044-45959bf1f754 {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 01:25:42 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-73c31349-3114-4661-9fdf-9da5c2bd3e70 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] [instance: d6555d72-6094-4ea9-b071-a3d3c8a300a9] Start _get_guest_xml network_info=[{"id": "1315a3d4-9d0a-4a65-8044-45959bf1f754", "address": "fa:16:3e:83:57:31", "network": {"id": "a9710b94-56f8-4cf6-9bb6-344b275e5bf2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-512340839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2052a37a068e4d948c57560c0f4445e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1315a3d4-9d", "ovs_interfaceid": "1315a3d4-9d0a-4a65-8044-45959bf1f754", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T01:13:22Z,direct_url=<?>,disk_format='qcow2',id=0b369aea-6f3f-4690-9f01-229b90ab6310,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4e110cbf9a84362a6864a7732c435a1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T01:13:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '0b369aea-6f3f-4690-9f01-229b90ab6310'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75226) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 17 01:25:43 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:25:43 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-73c31349-3114-4661-9fdf-9da5c2bd3e70 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:25:43 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-73c31349-3114-4661-9fdf-9da5c2bd3e70 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:25:43 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:25:43 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-73c31349-3114-4661-9fdf-9da5c2bd3e70 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75226) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 17 01:25:43 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-73c31349-3114-4661-9fdf-9da5c2bd3e70 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] CPU controller missing on host. {{(pid=75226) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 17 01:25:43 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:25:43 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-73c31349-3114-4661-9fdf-9da5c2bd3e70 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75226) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 17 01:25:43 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-73c31349-3114-4661-9fdf-9da5c2bd3e70 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] CPU controller found on host. {{(pid=75226) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 17 01:25:43 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-73c31349-3114-4661-9fdf-9da5c2bd3e70 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75226) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 17 01:25:43 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-73c31349-3114-4661-9fdf-9da5c2bd3e70 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-17T01:13:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T01:13:22Z,direct_url=<?>,disk_format='qcow2',id=0b369aea-6f3f-4690-9f01-229b90ab6310,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4e110cbf9a84362a6864a7732c435a1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T01:13:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 17 01:25:43 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-73c31349-3114-4661-9fdf-9da5c2bd3e70 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Flavor limits 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 17 01:25:43 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-73c31349-3114-4661-9fdf-9da5c2bd3e70 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Image limits 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 17 01:25:43 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-73c31349-3114-4661-9fdf-9da5c2bd3e70 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Flavor pref 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 17 01:25:43 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-73c31349-3114-4661-9fdf-9da5c2bd3e70 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Image pref 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 17 01:25:43 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-73c31349-3114-4661-9fdf-9da5c2bd3e70 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 17 01:25:43 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-73c31349-3114-4661-9fdf-9da5c2bd3e70 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 17 01:25:43 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-73c31349-3114-4661-9fdf-9da5c2bd3e70 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75226) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 17 01:25:43 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-73c31349-3114-4661-9fdf-9da5c2bd3e70 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Got 1 possible topologies {{(pid=75226) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 17 01:25:43 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-73c31349-3114-4661-9fdf-9da5c2bd3e70 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 17 01:25:43 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-73c31349-3114-4661-9fdf-9da5c2bd3e70 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 17 01:25:43 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-73c31349-3114-4661-9fdf-9da5c2bd3e70 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:25:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1387314277',display_name='tempest-ServerRescueNegativeTestJSON-server-1387314277',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1387314277',id=25,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2052a37a068e4d948c57560c0f4445e4',ramdisk_id='',reservation_id='r-2jn9z0wx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-344970408',owner_user_name='tempest-ServerRescueNegativeTestJSON-344970408-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T01:25:41Z,user_data=None,user_id='12f405f1486a4f5187e628c60f223e98',uuid=d6555d72-6094-4ea9-b071-a3d3c8a300a9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1315a3d4-9d0a-4a65-8044-45959bf1f754", "address": "fa:16:3e:83:57:31", "network": {"id": "a9710b94-56f8-4cf6-9bb6-344b275e5bf2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-512340839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2052a37a068e4d948c57560c0f4445e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1315a3d4-9d", "ovs_interfaceid": "1315a3d4-9d0a-4a65-8044-45959bf1f754", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75226) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 01:25:43 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-73c31349-3114-4661-9fdf-9da5c2bd3e70 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Converting VIF {"id": "1315a3d4-9d0a-4a65-8044-45959bf1f754", "address": "fa:16:3e:83:57:31", "network": {"id": "a9710b94-56f8-4cf6-9bb6-344b275e5bf2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-512340839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2052a37a068e4d948c57560c0f4445e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1315a3d4-9d", "ovs_interfaceid": "1315a3d4-9d0a-4a65-8044-45959bf1f754", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:25:43 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-73c31349-3114-4661-9fdf-9da5c2bd3e70 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:57:31,bridge_name='br-int',has_traffic_filtering=True,id=1315a3d4-9d0a-4a65-8044-45959bf1f754,network=Network(a9710b94-56f8-4cf6-9bb6-344b275e5bf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1315a3d4-9d') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:25:43 user nova-compute[75226]: DEBUG nova.objects.instance [None req-73c31349-3114-4661-9fdf-9da5c2bd3e70 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Lazy-loading 'pci_devices' on Instance uuid d6555d72-6094-4ea9-b071-a3d3c8a300a9 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:25:43 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-73c31349-3114-4661-9fdf-9da5c2bd3e70 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] [instance: d6555d72-6094-4ea9-b071-a3d3c8a300a9] End _get_guest_xml xml=<domain type="kvm">
Nov 17 01:25:43 user nova-compute[75226]:   <uuid>d6555d72-6094-4ea9-b071-a3d3c8a300a9</uuid>
Nov 17 01:25:43 user nova-compute[75226]:   <name>instance-00000019</name>
Nov 17 01:25:43 user nova-compute[75226]:   <memory>524288</memory>
Nov 17 01:25:43 user nova-compute[75226]:   <vcpu>1</vcpu>
Nov 17 01:25:43 user nova-compute[75226]:   <metadata>
Nov 17 01:25:43 user nova-compute[75226]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 17 01:25:43 user nova-compute[75226]:       <nova:package version="0.0.0"/>
Nov 17 01:25:43 user nova-compute[75226]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1387314277</nova:name>
Nov 17 01:25:43 user nova-compute[75226]:       <nova:creationTime>2023-11-17 01:25:43</nova:creationTime>
Nov 17 01:25:43 user nova-compute[75226]:       <nova:flavor name="m1.tiny">
Nov 17 01:25:43 user nova-compute[75226]:         <nova:memory>512</nova:memory>
Nov 17 01:25:43 user nova-compute[75226]:         <nova:disk>1</nova:disk>
Nov 17 01:25:43 user nova-compute[75226]:         <nova:swap>0</nova:swap>
Nov 17 01:25:43 user nova-compute[75226]:         <nova:ephemeral>0</nova:ephemeral>
Nov 17 01:25:43 user nova-compute[75226]:         <nova:vcpus>1</nova:vcpus>
Nov 17 01:25:43 user nova-compute[75226]:       </nova:flavor>
Nov 17 01:25:43 user nova-compute[75226]:       <nova:owner>
Nov 17 01:25:43 user nova-compute[75226]:         <nova:user uuid="12f405f1486a4f5187e628c60f223e98">tempest-ServerRescueNegativeTestJSON-344970408-project-member</nova:user>
Nov 17 01:25:43 user nova-compute[75226]:         <nova:project uuid="2052a37a068e4d948c57560c0f4445e4">tempest-ServerRescueNegativeTestJSON-344970408</nova:project>
Nov 17 01:25:43 user nova-compute[75226]:       </nova:owner>
Nov 17 01:25:43 user nova-compute[75226]:       <nova:root type="image" uuid="0b369aea-6f3f-4690-9f01-229b90ab6310"/>
Nov 17 01:25:43 user nova-compute[75226]:       <nova:ports>
Nov 17 01:25:43 user nova-compute[75226]:         <nova:port uuid="1315a3d4-9d0a-4a65-8044-45959bf1f754">
Nov 17 01:25:43 user nova-compute[75226]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 17 01:25:43 user nova-compute[75226]:         </nova:port>
Nov 17 01:25:43 user nova-compute[75226]:       </nova:ports>
Nov 17 01:25:43 user nova-compute[75226]:     </nova:instance>
Nov 17 01:25:43 user nova-compute[75226]:   </metadata>
Nov 17 01:25:43 user nova-compute[75226]:   <sysinfo type="smbios">
Nov 17 01:25:43 user nova-compute[75226]:     <system>
Nov 17 01:25:43 user nova-compute[75226]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 17 01:25:43 user nova-compute[75226]:       <entry name="product">OpenStack Nova</entry>
Nov 17 01:25:43 user nova-compute[75226]:       <entry name="version">0.0.0</entry>
Nov 17 01:25:43 user nova-compute[75226]:       <entry name="serial">d6555d72-6094-4ea9-b071-a3d3c8a300a9</entry>
Nov 17 01:25:43 user nova-compute[75226]:       <entry name="uuid">d6555d72-6094-4ea9-b071-a3d3c8a300a9</entry>
Nov 17 01:25:43 user nova-compute[75226]:       <entry name="family">Virtual Machine</entry>
Nov 17 01:25:43 user nova-compute[75226]:     </system>
Nov 17 01:25:43 user nova-compute[75226]:   </sysinfo>
Nov 17 01:25:43 user nova-compute[75226]:   <os>
Nov 17 01:25:43 user nova-compute[75226]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 17 01:25:43 user nova-compute[75226]:     <boot dev="hd"/>
Nov 17 01:25:43 user nova-compute[75226]:     <smbios mode="sysinfo"/>
Nov 17 01:25:43 user nova-compute[75226]:   </os>
Nov 17 01:25:43 user nova-compute[75226]:   <features>
Nov 17 01:25:43 user nova-compute[75226]:     <acpi/>
Nov 17 01:25:43 user nova-compute[75226]:     <apic/>
Nov 17 01:25:43 user nova-compute[75226]:     <vmcoreinfo/>
Nov 17 01:25:43 user nova-compute[75226]:   </features>
Nov 17 01:25:43 user nova-compute[75226]:   <clock offset="utc">
Nov 17 01:25:43 user nova-compute[75226]:     <timer name="pit" tickpolicy="delay"/>
Nov 17 01:25:43 user nova-compute[75226]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 17 01:25:43 user nova-compute[75226]:     <timer name="hpet" present="no"/>
Nov 17 01:25:43 user nova-compute[75226]:   </clock>
Nov 17 01:25:43 user nova-compute[75226]:   <cpu mode="custom" match="exact">
Nov 17 01:25:43 user nova-compute[75226]:     <model>Nehalem</model>
Nov 17 01:25:43 user nova-compute[75226]:     <topology sockets="1" cores="1" threads="1"/>
Nov 17 01:25:43 user nova-compute[75226]:   </cpu>
Nov 17 01:25:43 user nova-compute[75226]:   <devices>
Nov 17 01:25:43 user nova-compute[75226]:     <disk type="file" device="disk">
Nov 17 01:25:43 user nova-compute[75226]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 17 01:25:43 user nova-compute[75226]:       <source file="/opt/stack/data/nova/instances/d6555d72-6094-4ea9-b071-a3d3c8a300a9/disk"/>
Nov 17 01:25:43 user nova-compute[75226]:       <target dev="vda" bus="virtio"/>
Nov 17 01:25:43 user nova-compute[75226]:     </disk>
Nov 17 01:25:43 user nova-compute[75226]:     <interface type="ethernet">
Nov 17 01:25:43 user nova-compute[75226]:       <mac address="fa:16:3e:83:57:31"/>
Nov 17 01:25:43 user nova-compute[75226]:       <model type="virtio"/>
Nov 17 01:25:43 user nova-compute[75226]:       <mtu size="1442"/>
Nov 17 01:25:43 user nova-compute[75226]:       <target dev="tap1315a3d4-9d"/>
Nov 17 01:25:43 user nova-compute[75226]:     </interface>
Nov 17 01:25:43 user nova-compute[75226]:     <serial type="pty">
Nov 17 01:25:43 user nova-compute[75226]:       <log file="/opt/stack/data/nova/instances/d6555d72-6094-4ea9-b071-a3d3c8a300a9/console.log" append="off"/>
Nov 17 01:25:43 user nova-compute[75226]:     </serial>
Nov 17 01:25:43 user nova-compute[75226]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 17 01:25:43 user nova-compute[75226]:     <video>
Nov 17 01:25:43 user nova-compute[75226]:       <model type="virtio"/>
Nov 17 01:25:43 user nova-compute[75226]:     </video>
Nov 17 01:25:43 user nova-compute[75226]:     <rng model="virtio">
Nov 17 01:25:43 user nova-compute[75226]:       <backend model="random">/dev/urandom</backend>
Nov 17 01:25:43 user nova-compute[75226]:     </rng>
Nov 17 01:25:43 user nova-compute[75226]:     <controller type="usb" index="0" model="none"/>
Nov 17 01:25:43 user nova-compute[75226]:     <memballoon model="virtio">
Nov 17 01:25:43 user nova-compute[75226]:       <stats period="10"/>
Nov 17 01:25:43 user nova-compute[75226]:     </memballoon>
Nov 17 01:25:43 user nova-compute[75226]:   </devices>
Nov 17 01:25:43 user nova-compute[75226]: </domain>
Nov 17 01:25:43 user nova-compute[75226]:  {{(pid=75226) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 17 01:25:43 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-73c31349-3114-4661-9fdf-9da5c2bd3e70 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:25:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1387314277',display_name='tempest-ServerRescueNegativeTestJSON-server-1387314277',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1387314277',id=25,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2052a37a068e4d948c57560c0f4445e4',ramdisk_id='',reservation_id='r-2jn9z0wx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-344970408',owner_user_name='tempest-ServerRescueNegativeTestJSON-344970408-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T01:25:41Z,user_data=None,user_id='12f405f1486a4f5187e628c60f223e98',uuid=d6555d72-6094-4ea9-b071-a3d3c8a300a9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1315a3d4-9d0a-4a65-8044-45959bf1f754", "address": "fa:16:3e:83:57:31", "network": {"id": "a9710b94-56f8-4cf6-9bb6-344b275e5bf2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-512340839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2052a37a068e4d948c57560c0f4445e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1315a3d4-9d", "ovs_interfaceid": "1315a3d4-9d0a-4a65-8044-45959bf1f754", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 17 01:25:43 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-73c31349-3114-4661-9fdf-9da5c2bd3e70 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Converting VIF {"id": "1315a3d4-9d0a-4a65-8044-45959bf1f754", "address": "fa:16:3e:83:57:31", "network": {"id": "a9710b94-56f8-4cf6-9bb6-344b275e5bf2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-512340839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2052a37a068e4d948c57560c0f4445e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1315a3d4-9d", "ovs_interfaceid": "1315a3d4-9d0a-4a65-8044-45959bf1f754", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:25:43 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-73c31349-3114-4661-9fdf-9da5c2bd3e70 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:57:31,bridge_name='br-int',has_traffic_filtering=True,id=1315a3d4-9d0a-4a65-8044-45959bf1f754,network=Network(a9710b94-56f8-4cf6-9bb6-344b275e5bf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1315a3d4-9d') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:25:43 user nova-compute[75226]: DEBUG os_vif [None req-73c31349-3114-4661-9fdf-9da5c2bd3e70 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:57:31,bridge_name='br-int',has_traffic_filtering=True,id=1315a3d4-9d0a-4a65-8044-45959bf1f754,network=Network(a9710b94-56f8-4cf6-9bb6-344b275e5bf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1315a3d4-9d') {{(pid=75226) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 17 01:25:43 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:25:43 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:25:43 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 17 01:25:43 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:25:43 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c46a388e-74c5-592e-828f-bd6cf36923e2', '_type': 'linux-noop'}}, row=False) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:25:43 user nova-compute[75226]: DEBUG nova.network.neutron [None req-6c8a905d-f7fe-40e8-9334-767f01831c5b tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] [instance: 5c280142-8901-4f83-bde4-baaa097e05b0] Successfully updated port: 3f54cf07-6d64-4e03-a3f7-bab096a18e89 {{(pid=75226) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 17 01:25:43 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-6c8a905d-f7fe-40e8-9334-767f01831c5b tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Acquiring lock "refresh_cache-5c280142-8901-4f83-bde4-baaa097e05b0" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:25:43 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-6c8a905d-f7fe-40e8-9334-767f01831c5b tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Acquired lock "refresh_cache-5c280142-8901-4f83-bde4-baaa097e05b0" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:25:43 user nova-compute[75226]: DEBUG nova.network.neutron [None req-6c8a905d-f7fe-40e8-9334-767f01831c5b tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] [instance: 5c280142-8901-4f83-bde4-baaa097e05b0] Building network info cache for instance {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 01:25:43 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:25:43 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:25:43 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:25:43 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1315a3d4-9d, may_exist=True, interface_attrs={}) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:25:43 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1315a3d4-9d, col_values=(('qos', UUID('50846ccd-7506-4407-b1c2-19885cbefbdd')),), if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:25:43 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1315a3d4-9d, col_values=(('external_ids', {'iface-id': '1315a3d4-9d0a-4a65-8044-45959bf1f754', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:83:57:31', 'vm-uuid': 'd6555d72-6094-4ea9-b071-a3d3c8a300a9'}),), if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:25:43 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:25:43 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:25:43 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:25:43 user nova-compute[75226]: INFO os_vif [None req-73c31349-3114-4661-9fdf-9da5c2bd3e70 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:57:31,bridge_name='br-int',has_traffic_filtering=True,id=1315a3d4-9d0a-4a65-8044-45959bf1f754,network=Network(a9710b94-56f8-4cf6-9bb6-344b275e5bf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1315a3d4-9d')
Nov 17 01:25:43 user nova-compute[75226]: DEBUG nova.compute.manager [req-d855f036-4f8e-4d26-b615-608a9fc609ed req-169bdc50-c056-433a-a63d-d4e9f69d66e2 service nova] [instance: 5c280142-8901-4f83-bde4-baaa097e05b0] Received event network-changed-3f54cf07-6d64-4e03-a3f7-bab096a18e89 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:25:43 user nova-compute[75226]: DEBUG nova.compute.manager [req-d855f036-4f8e-4d26-b615-608a9fc609ed req-169bdc50-c056-433a-a63d-d4e9f69d66e2 service nova] [instance: 5c280142-8901-4f83-bde4-baaa097e05b0] Refreshing instance network info cache due to event network-changed-3f54cf07-6d64-4e03-a3f7-bab096a18e89. {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 01:25:43 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-d855f036-4f8e-4d26-b615-608a9fc609ed req-169bdc50-c056-433a-a63d-d4e9f69d66e2 service nova] Acquiring lock "refresh_cache-5c280142-8901-4f83-bde4-baaa097e05b0" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:25:43 user nova-compute[75226]: DEBUG nova.network.neutron [None req-6c8a905d-f7fe-40e8-9334-767f01831c5b tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] [instance: 5c280142-8901-4f83-bde4-baaa097e05b0] Instance cache missing network info. {{(pid=75226) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 17 01:25:43 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-73c31349-3114-4661-9fdf-9da5c2bd3e70 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] No BDM found with device name vda, not building metadata. {{(pid=75226) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 01:25:43 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-73c31349-3114-4661-9fdf-9da5c2bd3e70 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] No VIF found with MAC fa:16:3e:83:57:31, not building metadata {{(pid=75226) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 01:25:43 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:25:43 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:25:43 user nova-compute[75226]: DEBUG nova.compute.manager [req-d2d48698-e284-4513-9ccc-0ca1a1511882 req-ba268442-ae6b-4dd0-9335-9adb4e1a913a service nova] [instance: 2ea5a14b-c330-4a2b-926e-60e1b30f5981] Received event network-vif-plugged-86250373-f92f-4176-b242-382fa11f4e39 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:25:43 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-d2d48698-e284-4513-9ccc-0ca1a1511882 req-ba268442-ae6b-4dd0-9335-9adb4e1a913a service nova] Acquiring lock "2ea5a14b-c330-4a2b-926e-60e1b30f5981-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:25:43 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-d2d48698-e284-4513-9ccc-0ca1a1511882 req-ba268442-ae6b-4dd0-9335-9adb4e1a913a service nova] Lock "2ea5a14b-c330-4a2b-926e-60e1b30f5981-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:25:43 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-d2d48698-e284-4513-9ccc-0ca1a1511882 req-ba268442-ae6b-4dd0-9335-9adb4e1a913a service nova] Lock "2ea5a14b-c330-4a2b-926e-60e1b30f5981-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:25:43 user nova-compute[75226]: DEBUG nova.compute.manager [req-d2d48698-e284-4513-9ccc-0ca1a1511882 req-ba268442-ae6b-4dd0-9335-9adb4e1a913a service nova] [instance: 2ea5a14b-c330-4a2b-926e-60e1b30f5981] No waiting events found dispatching network-vif-plugged-86250373-f92f-4176-b242-382fa11f4e39 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:25:43 user nova-compute[75226]: WARNING nova.compute.manager [req-d2d48698-e284-4513-9ccc-0ca1a1511882 req-ba268442-ae6b-4dd0-9335-9adb4e1a913a service nova] [instance: 2ea5a14b-c330-4a2b-926e-60e1b30f5981] Received unexpected event network-vif-plugged-86250373-f92f-4176-b242-382fa11f4e39 for instance with vm_state building and task_state spawning.
Nov 17 01:25:43 user nova-compute[75226]: DEBUG nova.network.neutron [None req-6c8a905d-f7fe-40e8-9334-767f01831c5b tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] [instance: 5c280142-8901-4f83-bde4-baaa097e05b0] Updating instance_info_cache with network_info: [{"id": "3f54cf07-6d64-4e03-a3f7-bab096a18e89", "address": "fa:16:3e:41:48:98", "network": {"id": "a9710b94-56f8-4cf6-9bb6-344b275e5bf2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-512340839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2052a37a068e4d948c57560c0f4445e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f54cf07-6d", "ovs_interfaceid": "3f54cf07-6d64-4e03-a3f7-bab096a18e89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:25:43 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-6c8a905d-f7fe-40e8-9334-767f01831c5b tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Releasing lock "refresh_cache-5c280142-8901-4f83-bde4-baaa097e05b0" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:25:43 user nova-compute[75226]: DEBUG nova.compute.manager [None req-6c8a905d-f7fe-40e8-9334-767f01831c5b tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] [instance: 5c280142-8901-4f83-bde4-baaa097e05b0] Instance network_info: |[{"id": "3f54cf07-6d64-4e03-a3f7-bab096a18e89", "address": "fa:16:3e:41:48:98", "network": {"id": "a9710b94-56f8-4cf6-9bb6-344b275e5bf2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-512340839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2052a37a068e4d948c57560c0f4445e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f54cf07-6d", "ovs_interfaceid": "3f54cf07-6d64-4e03-a3f7-bab096a18e89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75226) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 17 01:25:43 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-d855f036-4f8e-4d26-b615-608a9fc609ed req-169bdc50-c056-433a-a63d-d4e9f69d66e2 service nova] Acquired lock "refresh_cache-5c280142-8901-4f83-bde4-baaa097e05b0" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:25:43 user nova-compute[75226]: DEBUG nova.network.neutron [req-d855f036-4f8e-4d26-b615-608a9fc609ed req-169bdc50-c056-433a-a63d-d4e9f69d66e2 service nova] [instance: 5c280142-8901-4f83-bde4-baaa097e05b0] Refreshing network info cache for port 3f54cf07-6d64-4e03-a3f7-bab096a18e89 {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 01:25:43 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-6c8a905d-f7fe-40e8-9334-767f01831c5b tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] [instance: 5c280142-8901-4f83-bde4-baaa097e05b0] Start _get_guest_xml network_info=[{"id": "3f54cf07-6d64-4e03-a3f7-bab096a18e89", "address": "fa:16:3e:41:48:98", "network": {"id": "a9710b94-56f8-4cf6-9bb6-344b275e5bf2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-512340839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2052a37a068e4d948c57560c0f4445e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f54cf07-6d", "ovs_interfaceid": "3f54cf07-6d64-4e03-a3f7-bab096a18e89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T01:13:22Z,direct_url=<?>,disk_format='qcow2',id=0b369aea-6f3f-4690-9f01-229b90ab6310,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4e110cbf9a84362a6864a7732c435a1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T01:13:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '0b369aea-6f3f-4690-9f01-229b90ab6310'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75226) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 17 01:25:43 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-6c8a905d-f7fe-40e8-9334-767f01831c5b tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:25:43 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-6c8a905d-f7fe-40e8-9334-767f01831c5b tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:25:43 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-6c8a905d-f7fe-40e8-9334-767f01831c5b tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75226) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 17 01:25:43 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-6c8a905d-f7fe-40e8-9334-767f01831c5b tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] CPU controller missing on host. {{(pid=75226) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 17 01:25:43 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-6c8a905d-f7fe-40e8-9334-767f01831c5b tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75226) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 17 01:25:43 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-6c8a905d-f7fe-40e8-9334-767f01831c5b tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] CPU controller found on host. {{(pid=75226) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 17 01:25:43 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-6c8a905d-f7fe-40e8-9334-767f01831c5b tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75226) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 17 01:25:43 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-6c8a905d-f7fe-40e8-9334-767f01831c5b tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-17T01:13:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T01:13:22Z,direct_url=<?>,disk_format='qcow2',id=0b369aea-6f3f-4690-9f01-229b90ab6310,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4e110cbf9a84362a6864a7732c435a1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T01:13:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 17 01:25:43 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-6c8a905d-f7fe-40e8-9334-767f01831c5b tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Flavor limits 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 17 01:25:43 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-6c8a905d-f7fe-40e8-9334-767f01831c5b tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Image limits 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 17 01:25:43 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-6c8a905d-f7fe-40e8-9334-767f01831c5b tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Flavor pref 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 17 01:25:43 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-6c8a905d-f7fe-40e8-9334-767f01831c5b tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Image pref 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 17 01:25:43 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-6c8a905d-f7fe-40e8-9334-767f01831c5b tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 17 01:25:43 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-6c8a905d-f7fe-40e8-9334-767f01831c5b tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 17 01:25:43 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-6c8a905d-f7fe-40e8-9334-767f01831c5b tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75226) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 17 01:25:43 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-6c8a905d-f7fe-40e8-9334-767f01831c5b tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Got 1 possible topologies {{(pid=75226) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 17 01:25:43 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-6c8a905d-f7fe-40e8-9334-767f01831c5b tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 17 01:25:43 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-6c8a905d-f7fe-40e8-9334-767f01831c5b tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 17 01:25:43 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-6c8a905d-f7fe-40e8-9334-767f01831c5b tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:25:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1469039538',display_name='tempest-ServerRescueNegativeTestJSON-server-1469039538',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1469039538',id=26,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2052a37a068e4d948c57560c0f4445e4',ramdisk_id='',reservation_id='r-afes9mrt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-344970408',owner_user_name='tempest-ServerRescueNegativeTestJSON-344970408-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T01:25:42Z,user_data=None,user_id='12f405f1486a4f5187e628c60f223e98',uuid=5c280142-8901-4f83-bde4-baaa097e05b0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3f54cf07-6d64-4e03-a3f7-bab096a18e89", "address": "fa:16:3e:41:48:98", "network": {"id": "a9710b94-56f8-4cf6-9bb6-344b275e5bf2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-512340839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2052a37a068e4d948c57560c0f4445e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f54cf07-6d", "ovs_interfaceid": "3f54cf07-6d64-4e03-a3f7-bab096a18e89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75226) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 01:25:43 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-6c8a905d-f7fe-40e8-9334-767f01831c5b tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Converting VIF {"id": "3f54cf07-6d64-4e03-a3f7-bab096a18e89", "address": "fa:16:3e:41:48:98", "network": {"id": "a9710b94-56f8-4cf6-9bb6-344b275e5bf2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-512340839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2052a37a068e4d948c57560c0f4445e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f54cf07-6d", "ovs_interfaceid": "3f54cf07-6d64-4e03-a3f7-bab096a18e89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:25:43 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-6c8a905d-f7fe-40e8-9334-767f01831c5b tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:48:98,bridge_name='br-int',has_traffic_filtering=True,id=3f54cf07-6d64-4e03-a3f7-bab096a18e89,network=Network(a9710b94-56f8-4cf6-9bb6-344b275e5bf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f54cf07-6d') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:25:43 user nova-compute[75226]: DEBUG nova.objects.instance [None req-6c8a905d-f7fe-40e8-9334-767f01831c5b tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Lazy-loading 'pci_devices' on Instance uuid 5c280142-8901-4f83-bde4-baaa097e05b0 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:25:43 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-6c8a905d-f7fe-40e8-9334-767f01831c5b tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] [instance: 5c280142-8901-4f83-bde4-baaa097e05b0] End _get_guest_xml xml=<domain type="kvm">
Nov 17 01:25:43 user nova-compute[75226]:   <uuid>5c280142-8901-4f83-bde4-baaa097e05b0</uuid>
Nov 17 01:25:43 user nova-compute[75226]:   <name>instance-0000001a</name>
Nov 17 01:25:43 user nova-compute[75226]:   <memory>524288</memory>
Nov 17 01:25:43 user nova-compute[75226]:   <vcpu>1</vcpu>
Nov 17 01:25:43 user nova-compute[75226]:   <metadata>
Nov 17 01:25:43 user nova-compute[75226]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 17 01:25:43 user nova-compute[75226]:       <nova:package version="0.0.0"/>
Nov 17 01:25:43 user nova-compute[75226]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1469039538</nova:name>
Nov 17 01:25:43 user nova-compute[75226]:       <nova:creationTime>2023-11-17 01:25:43</nova:creationTime>
Nov 17 01:25:43 user nova-compute[75226]:       <nova:flavor name="m1.tiny">
Nov 17 01:25:43 user nova-compute[75226]:         <nova:memory>512</nova:memory>
Nov 17 01:25:43 user nova-compute[75226]:         <nova:disk>1</nova:disk>
Nov 17 01:25:43 user nova-compute[75226]:         <nova:swap>0</nova:swap>
Nov 17 01:25:43 user nova-compute[75226]:         <nova:ephemeral>0</nova:ephemeral>
Nov 17 01:25:43 user nova-compute[75226]:         <nova:vcpus>1</nova:vcpus>
Nov 17 01:25:43 user nova-compute[75226]:       </nova:flavor>
Nov 17 01:25:43 user nova-compute[75226]:       <nova:owner>
Nov 17 01:25:43 user nova-compute[75226]:         <nova:user uuid="12f405f1486a4f5187e628c60f223e98">tempest-ServerRescueNegativeTestJSON-344970408-project-member</nova:user>
Nov 17 01:25:43 user nova-compute[75226]:         <nova:project uuid="2052a37a068e4d948c57560c0f4445e4">tempest-ServerRescueNegativeTestJSON-344970408</nova:project>
Nov 17 01:25:43 user nova-compute[75226]:       </nova:owner>
Nov 17 01:25:43 user nova-compute[75226]:       <nova:root type="image" uuid="0b369aea-6f3f-4690-9f01-229b90ab6310"/>
Nov 17 01:25:43 user nova-compute[75226]:       <nova:ports>
Nov 17 01:25:43 user nova-compute[75226]:         <nova:port uuid="3f54cf07-6d64-4e03-a3f7-bab096a18e89">
Nov 17 01:25:43 user nova-compute[75226]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 17 01:25:43 user nova-compute[75226]:         </nova:port>
Nov 17 01:25:43 user nova-compute[75226]:       </nova:ports>
Nov 17 01:25:43 user nova-compute[75226]:     </nova:instance>
Nov 17 01:25:43 user nova-compute[75226]:   </metadata>
Nov 17 01:25:43 user nova-compute[75226]:   <sysinfo type="smbios">
Nov 17 01:25:43 user nova-compute[75226]:     <system>
Nov 17 01:25:43 user nova-compute[75226]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 17 01:25:43 user nova-compute[75226]:       <entry name="product">OpenStack Nova</entry>
Nov 17 01:25:43 user nova-compute[75226]:       <entry name="version">0.0.0</entry>
Nov 17 01:25:43 user nova-compute[75226]:       <entry name="serial">5c280142-8901-4f83-bde4-baaa097e05b0</entry>
Nov 17 01:25:43 user nova-compute[75226]:       <entry name="uuid">5c280142-8901-4f83-bde4-baaa097e05b0</entry>
Nov 17 01:25:43 user nova-compute[75226]:       <entry name="family">Virtual Machine</entry>
Nov 17 01:25:43 user nova-compute[75226]:     </system>
Nov 17 01:25:43 user nova-compute[75226]:   </sysinfo>
Nov 17 01:25:43 user nova-compute[75226]:   <os>
Nov 17 01:25:43 user nova-compute[75226]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 17 01:25:43 user nova-compute[75226]:     <boot dev="hd"/>
Nov 17 01:25:43 user nova-compute[75226]:     <smbios mode="sysinfo"/>
Nov 17 01:25:43 user nova-compute[75226]:   </os>
Nov 17 01:25:43 user nova-compute[75226]:   <features>
Nov 17 01:25:43 user nova-compute[75226]:     <acpi/>
Nov 17 01:25:43 user nova-compute[75226]:     <apic/>
Nov 17 01:25:43 user nova-compute[75226]:     <vmcoreinfo/>
Nov 17 01:25:43 user nova-compute[75226]:   </features>
Nov 17 01:25:43 user nova-compute[75226]:   <clock offset="utc">
Nov 17 01:25:43 user nova-compute[75226]:     <timer name="pit" tickpolicy="delay"/>
Nov 17 01:25:43 user nova-compute[75226]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 17 01:25:43 user nova-compute[75226]:     <timer name="hpet" present="no"/>
Nov 17 01:25:43 user nova-compute[75226]:   </clock>
Nov 17 01:25:43 user nova-compute[75226]:   <cpu mode="custom" match="exact">
Nov 17 01:25:43 user nova-compute[75226]:     <model>Nehalem</model>
Nov 17 01:25:43 user nova-compute[75226]:     <topology sockets="1" cores="1" threads="1"/>
Nov 17 01:25:43 user nova-compute[75226]:   </cpu>
Nov 17 01:25:43 user nova-compute[75226]:   <devices>
Nov 17 01:25:43 user nova-compute[75226]:     <disk type="file" device="disk">
Nov 17 01:25:43 user nova-compute[75226]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 17 01:25:43 user nova-compute[75226]:       <source file="/opt/stack/data/nova/instances/5c280142-8901-4f83-bde4-baaa097e05b0/disk"/>
Nov 17 01:25:43 user nova-compute[75226]:       <target dev="vda" bus="virtio"/>
Nov 17 01:25:43 user nova-compute[75226]:     </disk>
Nov 17 01:25:43 user nova-compute[75226]:     <interface type="ethernet">
Nov 17 01:25:43 user nova-compute[75226]:       <mac address="fa:16:3e:41:48:98"/>
Nov 17 01:25:43 user nova-compute[75226]:       <model type="virtio"/>
Nov 17 01:25:43 user nova-compute[75226]:       <mtu size="1442"/>
Nov 17 01:25:43 user nova-compute[75226]:       <target dev="tap3f54cf07-6d"/>
Nov 17 01:25:43 user nova-compute[75226]:     </interface>
Nov 17 01:25:43 user nova-compute[75226]:     <serial type="pty">
Nov 17 01:25:43 user nova-compute[75226]:       <log file="/opt/stack/data/nova/instances/5c280142-8901-4f83-bde4-baaa097e05b0/console.log" append="off"/>
Nov 17 01:25:43 user nova-compute[75226]:     </serial>
Nov 17 01:25:43 user nova-compute[75226]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 17 01:25:43 user nova-compute[75226]:     <video>
Nov 17 01:25:43 user nova-compute[75226]:       <model type="virtio"/>
Nov 17 01:25:43 user nova-compute[75226]:     </video>
Nov 17 01:25:43 user nova-compute[75226]:     <rng model="virtio">
Nov 17 01:25:43 user nova-compute[75226]:       <backend model="random">/dev/urandom</backend>
Nov 17 01:25:43 user nova-compute[75226]:     </rng>
Nov 17 01:25:43 user nova-compute[75226]:     <controller type="usb" index="0" model="none"/>
Nov 17 01:25:43 user nova-compute[75226]:     <memballoon model="virtio">
Nov 17 01:25:43 user nova-compute[75226]:       <stats period="10"/>
Nov 17 01:25:43 user nova-compute[75226]:     </memballoon>
Nov 17 01:25:43 user nova-compute[75226]:   </devices>
Nov 17 01:25:43 user nova-compute[75226]: </domain>
Nov 17 01:25:43 user nova-compute[75226]:  {{(pid=75226) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 17 01:25:43 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-6c8a905d-f7fe-40e8-9334-767f01831c5b tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:25:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1469039538',display_name='tempest-ServerRescueNegativeTestJSON-server-1469039538',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1469039538',id=26,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2052a37a068e4d948c57560c0f4445e4',ramdisk_id='',reservation_id='r-afes9mrt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-344970408',owner_user_name='tempest-ServerRescueNegativeTestJSON-344970408-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T01:25:42Z,user_data=None,user_id='12f405f1486a4f5187e628c60f223e98',uuid=5c280142-8901-4f83-bde4-baaa097e05b0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3f54cf07-6d64-4e03-a3f7-bab096a18e89", "address": "fa:16:3e:41:48:98", "network": {"id": "a9710b94-56f8-4cf6-9bb6-344b275e5bf2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-512340839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2052a37a068e4d948c57560c0f4445e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f54cf07-6d", "ovs_interfaceid": "3f54cf07-6d64-4e03-a3f7-bab096a18e89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 17 01:25:43 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-6c8a905d-f7fe-40e8-9334-767f01831c5b tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Converting VIF {"id": "3f54cf07-6d64-4e03-a3f7-bab096a18e89", "address": "fa:16:3e:41:48:98", "network": {"id": "a9710b94-56f8-4cf6-9bb6-344b275e5bf2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-512340839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2052a37a068e4d948c57560c0f4445e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f54cf07-6d", "ovs_interfaceid": "3f54cf07-6d64-4e03-a3f7-bab096a18e89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:25:43 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-6c8a905d-f7fe-40e8-9334-767f01831c5b tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:48:98,bridge_name='br-int',has_traffic_filtering=True,id=3f54cf07-6d64-4e03-a3f7-bab096a18e89,network=Network(a9710b94-56f8-4cf6-9bb6-344b275e5bf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f54cf07-6d') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:25:43 user nova-compute[75226]: DEBUG os_vif [None req-6c8a905d-f7fe-40e8-9334-767f01831c5b tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:48:98,bridge_name='br-int',has_traffic_filtering=True,id=3f54cf07-6d64-4e03-a3f7-bab096a18e89,network=Network(a9710b94-56f8-4cf6-9bb6-344b275e5bf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f54cf07-6d') {{(pid=75226) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 17 01:25:43 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:25:43 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:25:43 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 17 01:25:43 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:25:43 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cbd32d15-7dea-5d10-9a27-76eb81b76ff4', '_type': 'linux-noop'}}, row=False) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:25:43 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:25:43 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:25:43 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:25:43 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:25:43 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3f54cf07-6d, may_exist=True, interface_attrs={}) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:25:43 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3f54cf07-6d, col_values=(('qos', UUID('962dc591-9ac7-4ad1-88e9-c5b4f43c3f34')),), if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:25:43 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3f54cf07-6d, col_values=(('external_ids', {'iface-id': '3f54cf07-6d64-4e03-a3f7-bab096a18e89', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:41:48:98', 'vm-uuid': '5c280142-8901-4f83-bde4-baaa097e05b0'}),), if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:25:43 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:25:43 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:25:43 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:25:43 user nova-compute[75226]: INFO os_vif [None req-6c8a905d-f7fe-40e8-9334-767f01831c5b tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:48:98,bridge_name='br-int',has_traffic_filtering=True,id=3f54cf07-6d64-4e03-a3f7-bab096a18e89,network=Network(a9710b94-56f8-4cf6-9bb6-344b275e5bf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f54cf07-6d')
Nov 17 01:25:43 user nova-compute[75226]: DEBUG nova.network.neutron [req-37c6d867-19dd-4b1d-916c-f783d55974d6 req-56af36c8-fad5-4e17-98ba-101a9421ed77 service nova] [instance: d6555d72-6094-4ea9-b071-a3d3c8a300a9] Updated VIF entry in instance network info cache for port 1315a3d4-9d0a-4a65-8044-45959bf1f754. {{(pid=75226) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 01:25:43 user nova-compute[75226]: DEBUG nova.network.neutron [req-37c6d867-19dd-4b1d-916c-f783d55974d6 req-56af36c8-fad5-4e17-98ba-101a9421ed77 service nova] [instance: d6555d72-6094-4ea9-b071-a3d3c8a300a9] Updating instance_info_cache with network_info: [{"id": "1315a3d4-9d0a-4a65-8044-45959bf1f754", "address": "fa:16:3e:83:57:31", "network": {"id": "a9710b94-56f8-4cf6-9bb6-344b275e5bf2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-512340839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2052a37a068e4d948c57560c0f4445e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1315a3d4-9d", "ovs_interfaceid": "1315a3d4-9d0a-4a65-8044-45959bf1f754", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:25:44 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-37c6d867-19dd-4b1d-916c-f783d55974d6 req-56af36c8-fad5-4e17-98ba-101a9421ed77 service nova] Releasing lock "refresh_cache-d6555d72-6094-4ea9-b071-a3d3c8a300a9" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:25:44 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-6c8a905d-f7fe-40e8-9334-767f01831c5b tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] No BDM found with device name vda, not building metadata. {{(pid=75226) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 01:25:44 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-6c8a905d-f7fe-40e8-9334-767f01831c5b tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] No VIF found with MAC fa:16:3e:41:48:98, not building metadata {{(pid=75226) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 01:25:44 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:25:44 user nova-compute[75226]: DEBUG nova.network.neutron [req-d855f036-4f8e-4d26-b615-608a9fc609ed req-169bdc50-c056-433a-a63d-d4e9f69d66e2 service nova] [instance: 5c280142-8901-4f83-bde4-baaa097e05b0] Updated VIF entry in instance network info cache for port 3f54cf07-6d64-4e03-a3f7-bab096a18e89. {{(pid=75226) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 01:25:44 user nova-compute[75226]: DEBUG nova.network.neutron [req-d855f036-4f8e-4d26-b615-608a9fc609ed req-169bdc50-c056-433a-a63d-d4e9f69d66e2 service nova] [instance: 5c280142-8901-4f83-bde4-baaa097e05b0] Updating instance_info_cache with network_info: [{"id": "3f54cf07-6d64-4e03-a3f7-bab096a18e89", "address": "fa:16:3e:41:48:98", "network": {"id": "a9710b94-56f8-4cf6-9bb6-344b275e5bf2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-512340839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2052a37a068e4d948c57560c0f4445e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f54cf07-6d", "ovs_interfaceid": "3f54cf07-6d64-4e03-a3f7-bab096a18e89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:25:44 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-d855f036-4f8e-4d26-b615-608a9fc609ed req-169bdc50-c056-433a-a63d-d4e9f69d66e2 service nova] Releasing lock "refresh_cache-5c280142-8901-4f83-bde4-baaa097e05b0" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:25:45 user nova-compute[75226]: DEBUG nova.compute.manager [req-1e257f4a-f71d-4901-84ab-f5f2950b4a62 req-4006bfdd-b912-4f38-8d94-a1d6f3dd2e4d service nova] [instance: 4dcdd769-bbfe-48e8-a876-8b2072b7baeb] Received event network-vif-plugged-89afa235-d910-4430-a95a-c173ba7a7048 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:25:45 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-1e257f4a-f71d-4901-84ab-f5f2950b4a62 req-4006bfdd-b912-4f38-8d94-a1d6f3dd2e4d service nova] Acquiring lock "4dcdd769-bbfe-48e8-a876-8b2072b7baeb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:25:45 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-1e257f4a-f71d-4901-84ab-f5f2950b4a62 req-4006bfdd-b912-4f38-8d94-a1d6f3dd2e4d service nova] Lock "4dcdd769-bbfe-48e8-a876-8b2072b7baeb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:25:45 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-1e257f4a-f71d-4901-84ab-f5f2950b4a62 req-4006bfdd-b912-4f38-8d94-a1d6f3dd2e4d service nova] Lock "4dcdd769-bbfe-48e8-a876-8b2072b7baeb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:25:45 user nova-compute[75226]: DEBUG nova.compute.manager [req-1e257f4a-f71d-4901-84ab-f5f2950b4a62 req-4006bfdd-b912-4f38-8d94-a1d6f3dd2e4d service nova] [instance: 4dcdd769-bbfe-48e8-a876-8b2072b7baeb] No waiting events found dispatching network-vif-plugged-89afa235-d910-4430-a95a-c173ba7a7048 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:25:45 user nova-compute[75226]: WARNING nova.compute.manager [req-1e257f4a-f71d-4901-84ab-f5f2950b4a62 req-4006bfdd-b912-4f38-8d94-a1d6f3dd2e4d service nova] [instance: 4dcdd769-bbfe-48e8-a876-8b2072b7baeb] Received unexpected event network-vif-plugged-89afa235-d910-4430-a95a-c173ba7a7048 for instance with vm_state active and task_state None.
Nov 17 01:25:45 user nova-compute[75226]: DEBUG nova.compute.manager [req-1e257f4a-f71d-4901-84ab-f5f2950b4a62 req-4006bfdd-b912-4f38-8d94-a1d6f3dd2e4d service nova] [instance: 4dcdd769-bbfe-48e8-a876-8b2072b7baeb] Received event network-vif-plugged-89afa235-d910-4430-a95a-c173ba7a7048 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:25:45 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-1e257f4a-f71d-4901-84ab-f5f2950b4a62 req-4006bfdd-b912-4f38-8d94-a1d6f3dd2e4d service nova] Acquiring lock "4dcdd769-bbfe-48e8-a876-8b2072b7baeb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:25:45 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-1e257f4a-f71d-4901-84ab-f5f2950b4a62 req-4006bfdd-b912-4f38-8d94-a1d6f3dd2e4d service nova] Lock "4dcdd769-bbfe-48e8-a876-8b2072b7baeb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:25:45 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-1e257f4a-f71d-4901-84ab-f5f2950b4a62 req-4006bfdd-b912-4f38-8d94-a1d6f3dd2e4d service nova] Lock "4dcdd769-bbfe-48e8-a876-8b2072b7baeb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:25:45 user nova-compute[75226]: DEBUG nova.compute.manager [req-1e257f4a-f71d-4901-84ab-f5f2950b4a62 req-4006bfdd-b912-4f38-8d94-a1d6f3dd2e4d service nova] [instance: 4dcdd769-bbfe-48e8-a876-8b2072b7baeb] No waiting events found dispatching network-vif-plugged-89afa235-d910-4430-a95a-c173ba7a7048 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:25:45 user nova-compute[75226]: WARNING nova.compute.manager [req-1e257f4a-f71d-4901-84ab-f5f2950b4a62 req-4006bfdd-b912-4f38-8d94-a1d6f3dd2e4d service nova] [instance: 4dcdd769-bbfe-48e8-a876-8b2072b7baeb] Received unexpected event network-vif-plugged-89afa235-d910-4430-a95a-c173ba7a7048 for instance with vm_state active and task_state None.
Nov 17 01:25:45 user nova-compute[75226]: DEBUG nova.compute.manager [req-2b3045ba-6884-48a9-bd18-6b9b12360373 req-a66167eb-9a8e-4563-b5e5-ab5dae2d0f92 service nova] [instance: 2ea5a14b-c330-4a2b-926e-60e1b30f5981] Received event network-vif-plugged-86250373-f92f-4176-b242-382fa11f4e39 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:25:45 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-2b3045ba-6884-48a9-bd18-6b9b12360373 req-a66167eb-9a8e-4563-b5e5-ab5dae2d0f92 service nova] Acquiring lock "2ea5a14b-c330-4a2b-926e-60e1b30f5981-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:25:45 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-2b3045ba-6884-48a9-bd18-6b9b12360373 req-a66167eb-9a8e-4563-b5e5-ab5dae2d0f92 service nova] Lock "2ea5a14b-c330-4a2b-926e-60e1b30f5981-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:25:45 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-2b3045ba-6884-48a9-bd18-6b9b12360373 req-a66167eb-9a8e-4563-b5e5-ab5dae2d0f92 service nova] Lock "2ea5a14b-c330-4a2b-926e-60e1b30f5981-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:25:45 user nova-compute[75226]: DEBUG nova.compute.manager [req-2b3045ba-6884-48a9-bd18-6b9b12360373 req-a66167eb-9a8e-4563-b5e5-ab5dae2d0f92 service nova] [instance: 2ea5a14b-c330-4a2b-926e-60e1b30f5981] No waiting events found dispatching network-vif-plugged-86250373-f92f-4176-b242-382fa11f4e39 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:25:45 user nova-compute[75226]: WARNING nova.compute.manager [req-2b3045ba-6884-48a9-bd18-6b9b12360373 req-a66167eb-9a8e-4563-b5e5-ab5dae2d0f92 service nova] [instance: 2ea5a14b-c330-4a2b-926e-60e1b30f5981] Received unexpected event network-vif-plugged-86250373-f92f-4176-b242-382fa11f4e39 for instance with vm_state building and task_state spawning.
Nov 17 01:25:45 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:25:45 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:25:45 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:25:45 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:25:46 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-6dfbd79f-08b6-4551-ae5a-4b7db4a7b9fb tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Acquiring lock "346967c5-6945-4cef-9eea-8415cb27c98f" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:25:46 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-6dfbd79f-08b6-4551-ae5a-4b7db4a7b9fb tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Lock "346967c5-6945-4cef-9eea-8415cb27c98f" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:25:46 user nova-compute[75226]: INFO nova.compute.manager [None req-6dfbd79f-08b6-4551-ae5a-4b7db4a7b9fb tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] [instance: 346967c5-6945-4cef-9eea-8415cb27c98f] Shelve offloading
Nov 17 01:25:46 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:25:46 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:25:46 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:25:46 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:25:46 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:25:46 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:25:46 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:25:46 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:25:46 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:25:46 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:25:46 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:25:46 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:25:47 user nova-compute[75226]: INFO nova.virt.libvirt.driver [-] [instance: 346967c5-6945-4cef-9eea-8415cb27c98f] Instance destroyed successfully.
Nov 17 01:25:47 user nova-compute[75226]: DEBUG nova.compute.manager [None req-6dfbd79f-08b6-4551-ae5a-4b7db4a7b9fb tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] [instance: 346967c5-6945-4cef-9eea-8415cb27c98f] Checking state {{(pid=75226) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 01:25:47 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-6dfbd79f-08b6-4551-ae5a-4b7db4a7b9fb tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Acquiring lock "refresh_cache-346967c5-6945-4cef-9eea-8415cb27c98f" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:25:47 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-6dfbd79f-08b6-4551-ae5a-4b7db4a7b9fb tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Acquired lock "refresh_cache-346967c5-6945-4cef-9eea-8415cb27c98f" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:25:47 user nova-compute[75226]: DEBUG nova.network.neutron [None req-6dfbd79f-08b6-4551-ae5a-4b7db4a7b9fb tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] [instance: 346967c5-6945-4cef-9eea-8415cb27c98f] Building network info cache for instance {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 01:25:47 user nova-compute[75226]: DEBUG nova.compute.manager [req-1d6957a9-4ef6-4829-8078-f75f3a4e9faf req-eacdd9a2-95f7-49fb-8c26-f220e7a77ad7 service nova] [instance: 346967c5-6945-4cef-9eea-8415cb27c98f] Received event network-changed-aa5b3af3-4cac-4a2f-93b8-3b6d378a3486 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:25:47 user nova-compute[75226]: DEBUG nova.compute.manager [req-1d6957a9-4ef6-4829-8078-f75f3a4e9faf req-eacdd9a2-95f7-49fb-8c26-f220e7a77ad7 service nova] [instance: 346967c5-6945-4cef-9eea-8415cb27c98f] Refreshing instance network info cache due to event network-changed-aa5b3af3-4cac-4a2f-93b8-3b6d378a3486. {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 01:25:47 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-1d6957a9-4ef6-4829-8078-f75f3a4e9faf req-eacdd9a2-95f7-49fb-8c26-f220e7a77ad7 service nova] Acquiring lock "refresh_cache-346967c5-6945-4cef-9eea-8415cb27c98f" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:25:47 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:25:47 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:25:47 user nova-compute[75226]: DEBUG nova.compute.manager [req-309980e5-b07a-4a3a-8031-6c53e8a7b49a req-37275982-5833-4199-993e-9576971d0fa4 service nova] [instance: d6555d72-6094-4ea9-b071-a3d3c8a300a9] Received event network-vif-plugged-1315a3d4-9d0a-4a65-8044-45959bf1f754 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:25:47 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-309980e5-b07a-4a3a-8031-6c53e8a7b49a req-37275982-5833-4199-993e-9576971d0fa4 service nova] Acquiring lock "d6555d72-6094-4ea9-b071-a3d3c8a300a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:25:47 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-309980e5-b07a-4a3a-8031-6c53e8a7b49a req-37275982-5833-4199-993e-9576971d0fa4 service nova] Lock "d6555d72-6094-4ea9-b071-a3d3c8a300a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:25:47 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-309980e5-b07a-4a3a-8031-6c53e8a7b49a req-37275982-5833-4199-993e-9576971d0fa4 service nova] Lock "d6555d72-6094-4ea9-b071-a3d3c8a300a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:25:47 user nova-compute[75226]: DEBUG nova.compute.manager [req-309980e5-b07a-4a3a-8031-6c53e8a7b49a req-37275982-5833-4199-993e-9576971d0fa4 service nova] [instance: d6555d72-6094-4ea9-b071-a3d3c8a300a9] No waiting events found dispatching network-vif-plugged-1315a3d4-9d0a-4a65-8044-45959bf1f754 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:25:47 user nova-compute[75226]: WARNING nova.compute.manager [req-309980e5-b07a-4a3a-8031-6c53e8a7b49a req-37275982-5833-4199-993e-9576971d0fa4 service nova] [instance: d6555d72-6094-4ea9-b071-a3d3c8a300a9] Received unexpected event network-vif-plugged-1315a3d4-9d0a-4a65-8044-45959bf1f754 for instance with vm_state building and task_state spawning.
Nov 17 01:25:47 user nova-compute[75226]: DEBUG nova.compute.manager [req-309980e5-b07a-4a3a-8031-6c53e8a7b49a req-37275982-5833-4199-993e-9576971d0fa4 service nova] [instance: d6555d72-6094-4ea9-b071-a3d3c8a300a9] Received event network-vif-plugged-1315a3d4-9d0a-4a65-8044-45959bf1f754 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:25:47 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-309980e5-b07a-4a3a-8031-6c53e8a7b49a req-37275982-5833-4199-993e-9576971d0fa4 service nova] Acquiring lock "d6555d72-6094-4ea9-b071-a3d3c8a300a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:25:47 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-309980e5-b07a-4a3a-8031-6c53e8a7b49a req-37275982-5833-4199-993e-9576971d0fa4 service nova] Lock "d6555d72-6094-4ea9-b071-a3d3c8a300a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:25:47 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-309980e5-b07a-4a3a-8031-6c53e8a7b49a req-37275982-5833-4199-993e-9576971d0fa4 service nova] Lock "d6555d72-6094-4ea9-b071-a3d3c8a300a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:25:47 user nova-compute[75226]: DEBUG nova.compute.manager [req-309980e5-b07a-4a3a-8031-6c53e8a7b49a req-37275982-5833-4199-993e-9576971d0fa4 service nova] [instance: d6555d72-6094-4ea9-b071-a3d3c8a300a9] No waiting events found dispatching network-vif-plugged-1315a3d4-9d0a-4a65-8044-45959bf1f754 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:25:47 user nova-compute[75226]: WARNING nova.compute.manager [req-309980e5-b07a-4a3a-8031-6c53e8a7b49a req-37275982-5833-4199-993e-9576971d0fa4 service nova] [instance: d6555d72-6094-4ea9-b071-a3d3c8a300a9] Received unexpected event network-vif-plugged-1315a3d4-9d0a-4a65-8044-45959bf1f754 for instance with vm_state building and task_state spawning.
Nov 17 01:25:47 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:25:47 user nova-compute[75226]: DEBUG nova.network.neutron [None req-6dfbd79f-08b6-4551-ae5a-4b7db4a7b9fb tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] [instance: 346967c5-6945-4cef-9eea-8415cb27c98f] Updating instance_info_cache with network_info: [{"id": "aa5b3af3-4cac-4a2f-93b8-3b6d378a3486", "address": "fa:16:3e:be:85:10", "network": {"id": "9335d73b-c260-49f3-8771-0dc21875a113", "bridge": "br-int", "label": "tempest-TestShelveInstance-1952470027-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adaa172aeff64609a273bdc271806238", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa5b3af3-4c", "ovs_interfaceid": "aa5b3af3-4cac-4a2f-93b8-3b6d378a3486", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:25:47 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-6dfbd79f-08b6-4551-ae5a-4b7db4a7b9fb tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Releasing lock "refresh_cache-346967c5-6945-4cef-9eea-8415cb27c98f" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:25:47 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-1d6957a9-4ef6-4829-8078-f75f3a4e9faf req-eacdd9a2-95f7-49fb-8c26-f220e7a77ad7 service nova] Acquired lock "refresh_cache-346967c5-6945-4cef-9eea-8415cb27c98f" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:25:47 user nova-compute[75226]: DEBUG nova.network.neutron [req-1d6957a9-4ef6-4829-8078-f75f3a4e9faf req-eacdd9a2-95f7-49fb-8c26-f220e7a77ad7 service nova] [instance: 346967c5-6945-4cef-9eea-8415cb27c98f] Refreshing network info cache for port aa5b3af3-4cac-4a2f-93b8-3b6d378a3486 {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 01:25:47 user nova-compute[75226]: DEBUG nova.compute.manager [None req-2c39a99f-6b19-4584-8bdc-d5e80f5b60e9 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 2ea5a14b-c330-4a2b-926e-60e1b30f5981] Instance event wait completed in 0 seconds for  {{(pid=75226) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 17 01:25:47 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-2c39a99f-6b19-4584-8bdc-d5e80f5b60e9 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 2ea5a14b-c330-4a2b-926e-60e1b30f5981] Guest created on hypervisor {{(pid=75226) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 17 01:25:47 user nova-compute[75226]: INFO nova.virt.libvirt.driver [-] [instance: 2ea5a14b-c330-4a2b-926e-60e1b30f5981] Instance spawned successfully.
Nov 17 01:25:47 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-2c39a99f-6b19-4584-8bdc-d5e80f5b60e9 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 2ea5a14b-c330-4a2b-926e-60e1b30f5981] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 17 01:25:47 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-2c39a99f-6b19-4584-8bdc-d5e80f5b60e9 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 2ea5a14b-c330-4a2b-926e-60e1b30f5981] Found default for hw_cdrom_bus of ide {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:25:47 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-2c39a99f-6b19-4584-8bdc-d5e80f5b60e9 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 2ea5a14b-c330-4a2b-926e-60e1b30f5981] Found default for hw_disk_bus of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:25:47 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-2c39a99f-6b19-4584-8bdc-d5e80f5b60e9 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 2ea5a14b-c330-4a2b-926e-60e1b30f5981] Found default for hw_input_bus of None {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:25:47 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-2c39a99f-6b19-4584-8bdc-d5e80f5b60e9 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 2ea5a14b-c330-4a2b-926e-60e1b30f5981] Found default for hw_pointer_model of None {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:25:47 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-2c39a99f-6b19-4584-8bdc-d5e80f5b60e9 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 2ea5a14b-c330-4a2b-926e-60e1b30f5981] Found default for hw_video_model of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:25:47 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-2c39a99f-6b19-4584-8bdc-d5e80f5b60e9 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 2ea5a14b-c330-4a2b-926e-60e1b30f5981] Found default for hw_vif_model of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:25:47 user nova-compute[75226]: INFO nova.compute.manager [None req-2c39a99f-6b19-4584-8bdc-d5e80f5b60e9 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 2ea5a14b-c330-4a2b-926e-60e1b30f5981] Took 9.04 seconds to spawn the instance on the hypervisor.
Nov 17 01:25:47 user nova-compute[75226]: DEBUG nova.compute.manager [None req-2c39a99f-6b19-4584-8bdc-d5e80f5b60e9 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 2ea5a14b-c330-4a2b-926e-60e1b30f5981] Checking state {{(pid=75226) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 01:25:48 user nova-compute[75226]: INFO nova.compute.manager [None req-2c39a99f-6b19-4584-8bdc-d5e80f5b60e9 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 2ea5a14b-c330-4a2b-926e-60e1b30f5981] Took 9.89 seconds to build instance.
Nov 17 01:25:48 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-2c39a99f-6b19-4584-8bdc-d5e80f5b60e9 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Lock "2ea5a14b-c330-4a2b-926e-60e1b30f5981" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.991s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:25:48 user nova-compute[75226]: DEBUG nova.network.neutron [req-1d6957a9-4ef6-4829-8078-f75f3a4e9faf req-eacdd9a2-95f7-49fb-8c26-f220e7a77ad7 service nova] [instance: 346967c5-6945-4cef-9eea-8415cb27c98f] Updated VIF entry in instance network info cache for port aa5b3af3-4cac-4a2f-93b8-3b6d378a3486. {{(pid=75226) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 01:25:48 user nova-compute[75226]: DEBUG nova.network.neutron [req-1d6957a9-4ef6-4829-8078-f75f3a4e9faf req-eacdd9a2-95f7-49fb-8c26-f220e7a77ad7 service nova] [instance: 346967c5-6945-4cef-9eea-8415cb27c98f] Updating instance_info_cache with network_info: [{"id": "aa5b3af3-4cac-4a2f-93b8-3b6d378a3486", "address": "fa:16:3e:be:85:10", "network": {"id": "9335d73b-c260-49f3-8771-0dc21875a113", "bridge": "br-int", "label": "tempest-TestShelveInstance-1952470027-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adaa172aeff64609a273bdc271806238", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa5b3af3-4c", "ovs_interfaceid": "aa5b3af3-4cac-4a2f-93b8-3b6d378a3486", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:25:48 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-1d6957a9-4ef6-4829-8078-f75f3a4e9faf req-eacdd9a2-95f7-49fb-8c26-f220e7a77ad7 service nova] Releasing lock "refresh_cache-346967c5-6945-4cef-9eea-8415cb27c98f" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:25:48 user nova-compute[75226]: DEBUG nova.compute.manager [req-1d6957a9-4ef6-4829-8078-f75f3a4e9faf req-eacdd9a2-95f7-49fb-8c26-f220e7a77ad7 service nova] [instance: 346967c5-6945-4cef-9eea-8415cb27c98f] Received event network-vif-unplugged-aa5b3af3-4cac-4a2f-93b8-3b6d378a3486 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:25:48 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-1d6957a9-4ef6-4829-8078-f75f3a4e9faf req-eacdd9a2-95f7-49fb-8c26-f220e7a77ad7 service nova] Acquiring lock "346967c5-6945-4cef-9eea-8415cb27c98f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:25:48 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-1d6957a9-4ef6-4829-8078-f75f3a4e9faf req-eacdd9a2-95f7-49fb-8c26-f220e7a77ad7 service nova] Lock "346967c5-6945-4cef-9eea-8415cb27c98f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:25:48 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-1d6957a9-4ef6-4829-8078-f75f3a4e9faf req-eacdd9a2-95f7-49fb-8c26-f220e7a77ad7 service nova] Lock "346967c5-6945-4cef-9eea-8415cb27c98f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:25:48 user nova-compute[75226]: DEBUG nova.compute.manager [req-1d6957a9-4ef6-4829-8078-f75f3a4e9faf req-eacdd9a2-95f7-49fb-8c26-f220e7a77ad7 service nova] [instance: 346967c5-6945-4cef-9eea-8415cb27c98f] No waiting events found dispatching network-vif-unplugged-aa5b3af3-4cac-4a2f-93b8-3b6d378a3486 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:25:48 user nova-compute[75226]: WARNING nova.compute.manager [req-1d6957a9-4ef6-4829-8078-f75f3a4e9faf req-eacdd9a2-95f7-49fb-8c26-f220e7a77ad7 service nova] [instance: 346967c5-6945-4cef-9eea-8415cb27c98f] Received unexpected event network-vif-unplugged-aa5b3af3-4cac-4a2f-93b8-3b6d378a3486 for instance with vm_state active and task_state shelving.
Nov 17 01:25:48 user nova-compute[75226]: DEBUG nova.compute.manager [req-1d6957a9-4ef6-4829-8078-f75f3a4e9faf req-eacdd9a2-95f7-49fb-8c26-f220e7a77ad7 service nova] [instance: 346967c5-6945-4cef-9eea-8415cb27c98f] Received event network-vif-plugged-aa5b3af3-4cac-4a2f-93b8-3b6d378a3486 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:25:48 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-1d6957a9-4ef6-4829-8078-f75f3a4e9faf req-eacdd9a2-95f7-49fb-8c26-f220e7a77ad7 service nova] Acquiring lock "346967c5-6945-4cef-9eea-8415cb27c98f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:25:48 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-1d6957a9-4ef6-4829-8078-f75f3a4e9faf req-eacdd9a2-95f7-49fb-8c26-f220e7a77ad7 service nova] Lock "346967c5-6945-4cef-9eea-8415cb27c98f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:25:48 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-1d6957a9-4ef6-4829-8078-f75f3a4e9faf req-eacdd9a2-95f7-49fb-8c26-f220e7a77ad7 service nova] Lock "346967c5-6945-4cef-9eea-8415cb27c98f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:25:48 user nova-compute[75226]: DEBUG nova.compute.manager [req-1d6957a9-4ef6-4829-8078-f75f3a4e9faf req-eacdd9a2-95f7-49fb-8c26-f220e7a77ad7 service nova] [instance: 346967c5-6945-4cef-9eea-8415cb27c98f] No waiting events found dispatching network-vif-plugged-aa5b3af3-4cac-4a2f-93b8-3b6d378a3486 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:25:48 user nova-compute[75226]: WARNING nova.compute.manager [req-1d6957a9-4ef6-4829-8078-f75f3a4e9faf req-eacdd9a2-95f7-49fb-8c26-f220e7a77ad7 service nova] [instance: 346967c5-6945-4cef-9eea-8415cb27c98f] Received unexpected event network-vif-plugged-aa5b3af3-4cac-4a2f-93b8-3b6d378a3486 for instance with vm_state active and task_state shelving.
Nov 17 01:25:48 user nova-compute[75226]: DEBUG nova.compute.manager [req-1d6957a9-4ef6-4829-8078-f75f3a4e9faf req-eacdd9a2-95f7-49fb-8c26-f220e7a77ad7 service nova] [instance: 5c280142-8901-4f83-bde4-baaa097e05b0] Received event network-vif-plugged-3f54cf07-6d64-4e03-a3f7-bab096a18e89 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:25:48 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-1d6957a9-4ef6-4829-8078-f75f3a4e9faf req-eacdd9a2-95f7-49fb-8c26-f220e7a77ad7 service nova] Acquiring lock "5c280142-8901-4f83-bde4-baaa097e05b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:25:48 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-1d6957a9-4ef6-4829-8078-f75f3a4e9faf req-eacdd9a2-95f7-49fb-8c26-f220e7a77ad7 service nova] Lock "5c280142-8901-4f83-bde4-baaa097e05b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:25:48 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-1d6957a9-4ef6-4829-8078-f75f3a4e9faf req-eacdd9a2-95f7-49fb-8c26-f220e7a77ad7 service nova] Lock "5c280142-8901-4f83-bde4-baaa097e05b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:25:48 user nova-compute[75226]: DEBUG nova.compute.manager [req-1d6957a9-4ef6-4829-8078-f75f3a4e9faf req-eacdd9a2-95f7-49fb-8c26-f220e7a77ad7 service nova] [instance: 5c280142-8901-4f83-bde4-baaa097e05b0] No waiting events found dispatching network-vif-plugged-3f54cf07-6d64-4e03-a3f7-bab096a18e89 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:25:48 user nova-compute[75226]: WARNING nova.compute.manager [req-1d6957a9-4ef6-4829-8078-f75f3a4e9faf req-eacdd9a2-95f7-49fb-8c26-f220e7a77ad7 service nova] [instance: 5c280142-8901-4f83-bde4-baaa097e05b0] Received unexpected event network-vif-plugged-3f54cf07-6d64-4e03-a3f7-bab096a18e89 for instance with vm_state building and task_state spawning.
Nov 17 01:25:48 user nova-compute[75226]: DEBUG nova.compute.manager [req-1d6957a9-4ef6-4829-8078-f75f3a4e9faf req-eacdd9a2-95f7-49fb-8c26-f220e7a77ad7 service nova] [instance: 5c280142-8901-4f83-bde4-baaa097e05b0] Received event network-vif-plugged-3f54cf07-6d64-4e03-a3f7-bab096a18e89 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:25:48 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-1d6957a9-4ef6-4829-8078-f75f3a4e9faf req-eacdd9a2-95f7-49fb-8c26-f220e7a77ad7 service nova] Acquiring lock "5c280142-8901-4f83-bde4-baaa097e05b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:25:48 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-1d6957a9-4ef6-4829-8078-f75f3a4e9faf req-eacdd9a2-95f7-49fb-8c26-f220e7a77ad7 service nova] Lock "5c280142-8901-4f83-bde4-baaa097e05b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:25:48 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-1d6957a9-4ef6-4829-8078-f75f3a4e9faf req-eacdd9a2-95f7-49fb-8c26-f220e7a77ad7 service nova] Lock "5c280142-8901-4f83-bde4-baaa097e05b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:25:48 user nova-compute[75226]: DEBUG nova.compute.manager [req-1d6957a9-4ef6-4829-8078-f75f3a4e9faf req-eacdd9a2-95f7-49fb-8c26-f220e7a77ad7 service nova] [instance: 5c280142-8901-4f83-bde4-baaa097e05b0] No waiting events found dispatching network-vif-plugged-3f54cf07-6d64-4e03-a3f7-bab096a18e89 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:25:48 user nova-compute[75226]: WARNING nova.compute.manager [req-1d6957a9-4ef6-4829-8078-f75f3a4e9faf req-eacdd9a2-95f7-49fb-8c26-f220e7a77ad7 service nova] [instance: 5c280142-8901-4f83-bde4-baaa097e05b0] Received unexpected event network-vif-plugged-3f54cf07-6d64-4e03-a3f7-bab096a18e89 for instance with vm_state building and task_state spawning.
Nov 17 01:25:48 user nova-compute[75226]: INFO nova.virt.libvirt.driver [-] [instance: 346967c5-6945-4cef-9eea-8415cb27c98f] Instance destroyed successfully.
Nov 17 01:25:48 user nova-compute[75226]: DEBUG nova.objects.instance [None req-6dfbd79f-08b6-4551-ae5a-4b7db4a7b9fb tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Lazy-loading 'resources' on Instance uuid 346967c5-6945-4cef-9eea-8415cb27c98f {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:25:48 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-6dfbd79f-08b6-4551-ae5a-4b7db4a7b9fb tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:23:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1793645083',display_name='tempest-TestShelveInstance-server-1793645083',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1793645083',id=20,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIOvS4/tTht9hr1zXYQtzCR2u7iigZ7otRMVBOpropTrS4OyZyMoxHA9vJUOwRc9jjyn0792XF/jB+xhGlZyJPPlZyVyxaJGOABRR09r+ft/TyseT2oW3x5gSl4AxhHiWw==',key_name='tempest-TestShelveInstance-879048345',keypairs=<?>,launch_index=0,launched_at=2023-11-17T01:24:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='adaa172aeff64609a273bdc271806238',ramdisk_id='',reservation_id='r-rgcypk19',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1381460949',owner_user_name='tempest-TestShelveInstance-1381460949-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T01:24:05Z,user_data=None,user_id='ed6cfbd0e0124dd2a4092f0b087f416c',uuid=346967c5-6945-4cef-9eea-8415cb27c98f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "aa5b3af3-4cac-4a2f-93b8-3b6d378a3486", "address": "fa:16:3e:be:85:10", "network": {"id": "9335d73b-c260-49f3-8771-0dc21875a113", "bridge": "br-int", "label": "tempest-TestShelveInstance-1952470027-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adaa172aeff64609a273bdc271806238", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa5b3af3-4c", "ovs_interfaceid": "aa5b3af3-4cac-4a2f-93b8-3b6d378a3486", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 17 01:25:48 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-6dfbd79f-08b6-4551-ae5a-4b7db4a7b9fb tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Converting VIF {"id": "aa5b3af3-4cac-4a2f-93b8-3b6d378a3486", "address": "fa:16:3e:be:85:10", "network": {"id": "9335d73b-c260-49f3-8771-0dc21875a113", "bridge": "br-int", "label": "tempest-TestShelveInstance-1952470027-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adaa172aeff64609a273bdc271806238", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa5b3af3-4c", "ovs_interfaceid": "aa5b3af3-4cac-4a2f-93b8-3b6d378a3486", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:25:48 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-6dfbd79f-08b6-4551-ae5a-4b7db4a7b9fb tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:85:10,bridge_name='br-int',has_traffic_filtering=True,id=aa5b3af3-4cac-4a2f-93b8-3b6d378a3486,network=Network(9335d73b-c260-49f3-8771-0dc21875a113),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa5b3af3-4c') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:25:48 user nova-compute[75226]: DEBUG os_vif [None req-6dfbd79f-08b6-4551-ae5a-4b7db4a7b9fb tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:85:10,bridge_name='br-int',has_traffic_filtering=True,id=aa5b3af3-4cac-4a2f-93b8-3b6d378a3486,network=Network(9335d73b-c260-49f3-8771-0dc21875a113),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa5b3af3-4c') {{(pid=75226) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 17 01:25:48 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:25:48 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaa5b3af3-4c, bridge=br-int, if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:25:48 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:25:48 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:25:48 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:25:48 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=138f4977-80e6-4086-854a-52328b085777) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:25:48 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:25:48 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:25:48 user nova-compute[75226]: INFO os_vif [None req-6dfbd79f-08b6-4551-ae5a-4b7db4a7b9fb tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:85:10,bridge_name='br-int',has_traffic_filtering=True,id=aa5b3af3-4cac-4a2f-93b8-3b6d378a3486,network=Network(9335d73b-c260-49f3-8771-0dc21875a113),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa5b3af3-4c')
Nov 17 01:25:48 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6dfbd79f-08b6-4551-ae5a-4b7db4a7b9fb tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] [instance: 346967c5-6945-4cef-9eea-8415cb27c98f] calling os-brick to detach iSCSI Volume {{(pid=75226) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 17 01:25:48 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dfbd79f-08b6-4551-ae5a-4b7db4a7b9fb tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc4cc36b490>, {'target_iqn': 'iqn.2010-10.org.openstack:c17ed19c-4452-4a79-b36a-07ddcd7d9404', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LimvaOGH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:25:48 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-6dfbd79f-08b6-4551-ae5a-4b7db4a7b9fb tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:25:48 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-6dfbd79f-08b6-4551-ae5a-4b7db4a7b9fb tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:25:48 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-6dfbd79f-08b6-4551-ae5a-4b7db4a7b9fb tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:25:48 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:25:48 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:25:48 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[55010ffe-9a68-4bd9-89d6-659ff09092cc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1fd0b73a-0d42-4e3d-a4f0-a9936d9bd1d4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c17ed19c-4452-4a79-b36a-07ddcd7d9404\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:25:48 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dfbd79f-08b6-4551-ae5a-4b7db4a7b9fb tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 17 01:25:48 user nova-compute[75226]: No targets found.
Nov 17 01:25:48 user nova-compute[75226]: iSNS:
Nov 17 01:25:48 user nova-compute[75226]: No targets found.
Nov 17 01:25:48 user nova-compute[75226]: STATIC:
Nov 17 01:25:48 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:1fd0b73a-0d42-4e3d-a4f0-a9936d9bd1d4
Nov 17 01:25:48 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:25:48 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:25:48 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8
Nov 17 01:25:48 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:25:48 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:25:48 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:c17ed19c-4452-4a79-b36a-07ddcd7d9404
Nov 17 01:25:48 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:25:48 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:25:48 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421
Nov 17 01:25:48 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:25:48 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:25:48 user nova-compute[75226]: FIRMWARE:
Nov 17 01:25:48 user nova-compute[75226]: No targets found.
Nov 17 01:25:48 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:25:48 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dfbd79f-08b6-4551-ae5a-4b7db4a7b9fb tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 17 01:25:48 user nova-compute[75226]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 17 01:25:48 user nova-compute[75226]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75226) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 17 01:25:48 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dfbd79f-08b6-4551-ae5a-4b7db4a7b9fb tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c17ed19c-4452-4a79-b36a-07ddcd7d9404', 0)] {{(pid=75226) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 17 01:25:48 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:25:48 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:25:48 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[a11d34fa-4879-48e7-9f46-9565e0900173]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1fd0b73a-0d42-4e3d-a4f0-a9936d9bd1d4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c17ed19c-4452-4a79-b36a-07ddcd7d9404\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:25:48 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:25:48 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:25:48 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[5023f961-ef08-4eec-84da-81b712acbe52]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fd0b73a-0d42-4e3d-a4f0-a9936d9bd1d4 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c17ed19c-4452-4a79-b36a-07ddcd7d9404 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:25:48 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dfbd79f-08b6-4551-ae5a-4b7db4a7b9fb tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)
Nov 17 01:25:48 user nova-compute[75226]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fd0b73a-0d42-4e3d-a4f0-a9936d9bd1d4 (non-flash)
Nov 17 01:25:48 user nova-compute[75226]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c17ed19c-4452-4a79-b36a-07ddcd7d9404 (non-flash)
Nov 17 01:25:48 user nova-compute[75226]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421 (non-flash)
Nov 17 01:25:48 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:25:48 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dfbd79f-08b6-4551-ae5a-4b7db4a7b9fb tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)
Nov 17 01:25:48 user nova-compute[75226]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fd0b73a-0d42-4e3d-a4f0-a9936d9bd1d4 (non-flash)
Nov 17 01:25:48 user nova-compute[75226]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c17ed19c-4452-4a79-b36a-07ddcd7d9404 (non-flash)
Nov 17 01:25:48 user nova-compute[75226]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421 (non-flash)
Nov 17 01:25:48 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:25:48 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dfbd79f-08b6-4551-ae5a-4b7db4a7b9fb tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc4cc1bf880>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c17ed19c-4452-4a79-b36a-07ddcd7d9404'): ({'sdb'}, set())}) {{(pid=75226) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 17 01:25:48 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-6dfbd79f-08b6-4551-ae5a-4b7db4a7b9fb tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Removing single pathed devices sdb {{(pid=75226) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 17 01:25:48 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:25:48 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:25:48 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cc6f1c4-2ff9-4e53-a9fb-df3b30c24e32]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:25:48 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:25:48 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:25:48 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec498c09-0d60-4c2e-b7fc-5d3ce19fbd7b]: (4, ('ok\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:25:48 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-6dfbd79f-08b6-4551-ae5a-4b7db4a7b9fb tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Flushing IO for device /dev/sdb {{(pid=75226) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 17 01:25:48 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:25:48 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:25:48 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d520015-1624-4219-a2cd-914913d16b75]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:25:48 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-6dfbd79f-08b6-4551-ae5a-4b7db4a7b9fb tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75226) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 17 01:25:48 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:25:48 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:25:48 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[afa4954c-31cb-49ee-8c5b-13dc041b6e52]: (4, ('1', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:25:48 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-6dfbd79f-08b6-4551-ae5a-4b7db4a7b9fb tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75226) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 17 01:25:48 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-6dfbd79f-08b6-4551-ae5a-4b7db4a7b9fb tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] SCSI volumes sdb have been removed. {{(pid=75226) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 17 01:25:48 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dfbd79f-08b6-4551-ae5a-4b7db4a7b9fb tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c17ed19c-4452-4a79-b36a-07ddcd7d9404')] {{(pid=75226) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 17 01:25:48 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c17ed19c-4452-4a79-b36a-07ddcd7d9404 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:25:48 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c17ed19c-4452-4a79-b36a-07ddcd7d9404 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:25:48 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c046b26-bfc9-4399-b9f3-53e3530185d1]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:25:48 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dfbd79f-08b6-4551-ae5a-4b7db4a7b9fb tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:25:48 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c17ed19c-4452-4a79-b36a-07ddcd7d9404 -p 172.16.0.220:3260 --logout {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:25:48 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c17ed19c-4452-4a79-b36a-07ddcd7d9404 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:25:48 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[6057adb0-c72c-4d9d-b2da-c3a1a86b8ddf]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:c17ed19c-4452-4a79-b36a-07ddcd7d9404, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:c17ed19c-4452-4a79-b36a-07ddcd7d9404, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:25:48 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dfbd79f-08b6-4551-ae5a-4b7db4a7b9fb tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:c17ed19c-4452-4a79-b36a-07ddcd7d9404, portal: 172.16.0.220,3260]
Nov 17 01:25:48 user nova-compute[75226]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:c17ed19c-4452-4a79-b36a-07ddcd7d9404, portal: 172.16.0.220,3260] successful.
Nov 17 01:25:48 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:25:48 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c17ed19c-4452-4a79-b36a-07ddcd7d9404 -p 172.16.0.220:3260 --op delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:25:48 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c17ed19c-4452-4a79-b36a-07ddcd7d9404 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:25:48 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[15d53551-b55a-4e1a-81f3-6045d9bff7af]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:25:48 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dfbd79f-08b6-4551-ae5a-4b7db4a7b9fb tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:25:48 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-6dfbd79f-08b6-4551-ae5a-4b7db4a7b9fb tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:25:48 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dfbd79f-08b6-4551-ae5a-4b7db4a7b9fb tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] <== disconnect_volume: return (323ms) None {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:25:48 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6dfbd79f-08b6-4551-ae5a-4b7db4a7b9fb tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] [instance: 346967c5-6945-4cef-9eea-8415cb27c98f] Disconnected iSCSI Volume {{(pid=75226) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 17 01:25:48 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-6dfbd79f-08b6-4551-ae5a-4b7db4a7b9fb tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] [instance: 346967c5-6945-4cef-9eea-8415cb27c98f] Deleting instance files /opt/stack/data/nova/instances/346967c5-6945-4cef-9eea-8415cb27c98f_del
Nov 17 01:25:48 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-6dfbd79f-08b6-4551-ae5a-4b7db4a7b9fb tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] [instance: 346967c5-6945-4cef-9eea-8415cb27c98f] Deletion of /opt/stack/data/nova/instances/346967c5-6945-4cef-9eea-8415cb27c98f_del complete
Nov 17 01:25:49 user nova-compute[75226]: DEBUG nova.compute.manager [None req-6c8a905d-f7fe-40e8-9334-767f01831c5b tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] [instance: 5c280142-8901-4f83-bde4-baaa097e05b0] Instance event wait completed in 0 seconds for  {{(pid=75226) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 17 01:25:49 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-6c8a905d-f7fe-40e8-9334-767f01831c5b tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] [instance: 5c280142-8901-4f83-bde4-baaa097e05b0] Guest created on hypervisor {{(pid=75226) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 17 01:25:49 user nova-compute[75226]: DEBUG nova.compute.manager [None req-73c31349-3114-4661-9fdf-9da5c2bd3e70 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] [instance: d6555d72-6094-4ea9-b071-a3d3c8a300a9] Instance event wait completed in 0 seconds for  {{(pid=75226) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 17 01:25:49 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-73c31349-3114-4661-9fdf-9da5c2bd3e70 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] [instance: d6555d72-6094-4ea9-b071-a3d3c8a300a9] Guest created on hypervisor {{(pid=75226) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 17 01:25:49 user nova-compute[75226]: INFO nova.virt.libvirt.driver [-] [instance: 5c280142-8901-4f83-bde4-baaa097e05b0] Instance spawned successfully.
Nov 17 01:25:49 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-6c8a905d-f7fe-40e8-9334-767f01831c5b tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] [instance: 5c280142-8901-4f83-bde4-baaa097e05b0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 17 01:25:49 user nova-compute[75226]: INFO nova.virt.libvirt.driver [-] [instance: d6555d72-6094-4ea9-b071-a3d3c8a300a9] Instance spawned successfully.
Nov 17 01:25:49 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-73c31349-3114-4661-9fdf-9da5c2bd3e70 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] [instance: d6555d72-6094-4ea9-b071-a3d3c8a300a9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 17 01:25:49 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-6c8a905d-f7fe-40e8-9334-767f01831c5b tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] [instance: 5c280142-8901-4f83-bde4-baaa097e05b0] Found default for hw_cdrom_bus of ide {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:25:49 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-6c8a905d-f7fe-40e8-9334-767f01831c5b tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] [instance: 5c280142-8901-4f83-bde4-baaa097e05b0] Found default for hw_disk_bus of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:25:49 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-6c8a905d-f7fe-40e8-9334-767f01831c5b tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] [instance: 5c280142-8901-4f83-bde4-baaa097e05b0] Found default for hw_input_bus of None {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:25:49 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-6c8a905d-f7fe-40e8-9334-767f01831c5b tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] [instance: 5c280142-8901-4f83-bde4-baaa097e05b0] Found default for hw_pointer_model of None {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:25:49 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-6c8a905d-f7fe-40e8-9334-767f01831c5b tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] [instance: 5c280142-8901-4f83-bde4-baaa097e05b0] Found default for hw_video_model of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:25:49 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-6c8a905d-f7fe-40e8-9334-767f01831c5b tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] [instance: 5c280142-8901-4f83-bde4-baaa097e05b0] Found default for hw_vif_model of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:25:49 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-73c31349-3114-4661-9fdf-9da5c2bd3e70 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] [instance: d6555d72-6094-4ea9-b071-a3d3c8a300a9] Found default for hw_cdrom_bus of ide {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:25:49 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-73c31349-3114-4661-9fdf-9da5c2bd3e70 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] [instance: d6555d72-6094-4ea9-b071-a3d3c8a300a9] Found default for hw_disk_bus of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:25:49 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-73c31349-3114-4661-9fdf-9da5c2bd3e70 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] [instance: d6555d72-6094-4ea9-b071-a3d3c8a300a9] Found default for hw_input_bus of None {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:25:49 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-73c31349-3114-4661-9fdf-9da5c2bd3e70 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] [instance: d6555d72-6094-4ea9-b071-a3d3c8a300a9] Found default for hw_pointer_model of None {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:25:49 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-73c31349-3114-4661-9fdf-9da5c2bd3e70 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] [instance: d6555d72-6094-4ea9-b071-a3d3c8a300a9] Found default for hw_video_model of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:25:49 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-73c31349-3114-4661-9fdf-9da5c2bd3e70 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] [instance: d6555d72-6094-4ea9-b071-a3d3c8a300a9] Found default for hw_vif_model of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:25:49 user nova-compute[75226]: INFO nova.compute.manager [None req-6c8a905d-f7fe-40e8-9334-767f01831c5b tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] [instance: 5c280142-8901-4f83-bde4-baaa097e05b0] Took 7.49 seconds to spawn the instance on the hypervisor.
Nov 17 01:25:49 user nova-compute[75226]: DEBUG nova.compute.manager [None req-6c8a905d-f7fe-40e8-9334-767f01831c5b tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] [instance: 5c280142-8901-4f83-bde4-baaa097e05b0] Checking state {{(pid=75226) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 01:25:49 user nova-compute[75226]: DEBUG nova.compute.manager [req-02e5fd00-1f42-4917-b6ef-e7b7d8598cd3 req-cac89b4c-2b91-4f48-9de1-91cf7350a0a4 service nova] [instance: 346967c5-6945-4cef-9eea-8415cb27c98f] Received event network-changed-aa5b3af3-4cac-4a2f-93b8-3b6d378a3486 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:25:49 user nova-compute[75226]: DEBUG nova.compute.manager [req-02e5fd00-1f42-4917-b6ef-e7b7d8598cd3 req-cac89b4c-2b91-4f48-9de1-91cf7350a0a4 service nova] [instance: 346967c5-6945-4cef-9eea-8415cb27c98f] Refreshing instance network info cache due to event network-changed-aa5b3af3-4cac-4a2f-93b8-3b6d378a3486. {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 01:25:49 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-02e5fd00-1f42-4917-b6ef-e7b7d8598cd3 req-cac89b4c-2b91-4f48-9de1-91cf7350a0a4 service nova] Acquiring lock "refresh_cache-346967c5-6945-4cef-9eea-8415cb27c98f" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:25:49 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-02e5fd00-1f42-4917-b6ef-e7b7d8598cd3 req-cac89b4c-2b91-4f48-9de1-91cf7350a0a4 service nova] Acquired lock "refresh_cache-346967c5-6945-4cef-9eea-8415cb27c98f" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:25:49 user nova-compute[75226]: DEBUG nova.network.neutron [req-02e5fd00-1f42-4917-b6ef-e7b7d8598cd3 req-cac89b4c-2b91-4f48-9de1-91cf7350a0a4 service nova] [instance: 346967c5-6945-4cef-9eea-8415cb27c98f] Refreshing network info cache for port aa5b3af3-4cac-4a2f-93b8-3b6d378a3486 {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 01:25:49 user nova-compute[75226]: INFO nova.compute.manager [None req-73c31349-3114-4661-9fdf-9da5c2bd3e70 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] [instance: d6555d72-6094-4ea9-b071-a3d3c8a300a9] Took 8.69 seconds to spawn the instance on the hypervisor.
Nov 17 01:25:49 user nova-compute[75226]: DEBUG nova.compute.manager [None req-73c31349-3114-4661-9fdf-9da5c2bd3e70 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] [instance: d6555d72-6094-4ea9-b071-a3d3c8a300a9] Checking state {{(pid=75226) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 01:25:49 user nova-compute[75226]: INFO nova.compute.manager [None req-6c8a905d-f7fe-40e8-9334-767f01831c5b tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] [instance: 5c280142-8901-4f83-bde4-baaa097e05b0] Took 8.71 seconds to build instance.
Nov 17 01:25:49 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-6c8a905d-f7fe-40e8-9334-767f01831c5b tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Lock "5c280142-8901-4f83-bde4-baaa097e05b0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.842s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:25:49 user nova-compute[75226]: INFO nova.compute.manager [None req-73c31349-3114-4661-9fdf-9da5c2bd3e70 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] [instance: d6555d72-6094-4ea9-b071-a3d3c8a300a9] Took 9.64 seconds to build instance.
Nov 17 01:25:49 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-73c31349-3114-4661-9fdf-9da5c2bd3e70 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Lock "d6555d72-6094-4ea9-b071-a3d3c8a300a9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.748s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:25:49 user nova-compute[75226]: DEBUG nova.network.neutron [req-02e5fd00-1f42-4917-b6ef-e7b7d8598cd3 req-cac89b4c-2b91-4f48-9de1-91cf7350a0a4 service nova] [instance: 346967c5-6945-4cef-9eea-8415cb27c98f] Updated VIF entry in instance network info cache for port aa5b3af3-4cac-4a2f-93b8-3b6d378a3486. {{(pid=75226) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 01:25:49 user nova-compute[75226]: DEBUG nova.network.neutron [req-02e5fd00-1f42-4917-b6ef-e7b7d8598cd3 req-cac89b4c-2b91-4f48-9de1-91cf7350a0a4 service nova] [instance: 346967c5-6945-4cef-9eea-8415cb27c98f] Updating instance_info_cache with network_info: [{"id": "aa5b3af3-4cac-4a2f-93b8-3b6d378a3486", "address": "fa:16:3e:be:85:10", "network": {"id": "9335d73b-c260-49f3-8771-0dc21875a113", "bridge": null, "label": "tempest-TestShelveInstance-1952470027-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adaa172aeff64609a273bdc271806238", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapaa5b3af3-4c", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:25:49 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-02e5fd00-1f42-4917-b6ef-e7b7d8598cd3 req-cac89b4c-2b91-4f48-9de1-91cf7350a0a4 service nova] Releasing lock "refresh_cache-346967c5-6945-4cef-9eea-8415cb27c98f" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:25:50 user nova-compute[75226]: INFO nova.scheduler.client.report [None req-6dfbd79f-08b6-4551-ae5a-4b7db4a7b9fb tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Deleted allocations for instance 346967c5-6945-4cef-9eea-8415cb27c98f
Nov 17 01:25:50 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-6dfbd79f-08b6-4551-ae5a-4b7db4a7b9fb tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:25:50 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-6dfbd79f-08b6-4551-ae5a-4b7db4a7b9fb tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:25:50 user nova-compute[75226]: DEBUG nova.objects.instance [None req-6dfbd79f-08b6-4551-ae5a-4b7db4a7b9fb tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Lazy-loading 'numa_topology' on Instance uuid 346967c5-6945-4cef-9eea-8415cb27c98f {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:25:50 user nova-compute[75226]: DEBUG nova.objects.base [None req-6dfbd79f-08b6-4551-ae5a-4b7db4a7b9fb tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Object Instance<346967c5-6945-4cef-9eea-8415cb27c98f> lazy-loaded attributes: resources,numa_topology {{(pid=75226) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 17 01:25:50 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-6dfbd79f-08b6-4551-ae5a-4b7db4a7b9fb tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:25:50 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-6dfbd79f-08b6-4551-ae5a-4b7db4a7b9fb tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:25:50 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-6dfbd79f-08b6-4551-ae5a-4b7db4a7b9fb tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.434s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:25:50 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-6dfbd79f-08b6-4551-ae5a-4b7db4a7b9fb tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Lock "346967c5-6945-4cef-9eea-8415cb27c98f" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 4.580s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:25:52 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:25:53 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:25:53 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e60e2191-4135-4289-8be9-f9725d4441f7 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Acquiring lock "306054a8-4d0f-4913-b3b8-97aeeeec071c" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:25:53 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e60e2191-4135-4289-8be9-f9725d4441f7 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Lock "306054a8-4d0f-4913-b3b8-97aeeeec071c" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:25:53 user nova-compute[75226]: INFO nova.compute.manager [None req-e60e2191-4135-4289-8be9-f9725d4441f7 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] [instance: 306054a8-4d0f-4913-b3b8-97aeeeec071c] Unshelving
Nov 17 01:25:53 user nova-compute[75226]: INFO nova.virt.block_device [None req-e60e2191-4135-4289-8be9-f9725d4441f7 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] [instance: 306054a8-4d0f-4913-b3b8-97aeeeec071c] Booting with volume 29701267-6547-48b4-befc-b18ec2ab5e2c at /dev/vdc
Nov 17 01:25:53 user nova-compute[75226]: DEBUG os_brick.utils [None req-e60e2191-4135-4289-8be9-f9725d4441f7 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:25:53 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:25:53 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:25:53 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[a513a06e-ce8f-42e6-a5ff-9815425ea333]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f62857db69\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:25:53 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:25:54 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:25:54 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3d9c43f-5aa5-4411-b449-dfeb6a0f75a4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:25:54 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:25:54 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:25:54 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4150f40-674a-48c8-8337-8877966dcc18]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:25:54 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[d719d420-451c-4a62-9cec-7cd3a04dd010]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:25:54 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e60e2191-4135-4289-8be9-f9725d4441f7 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Running cmd (subprocess): nvme version {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:25:54 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e60e2191-4135-4289-8be9-f9725d4441f7 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] 'nvme version' failed. Not Retrying. {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 01:25:54 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e60e2191-4135-4289-8be9-f9725d4441f7 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] nvme not present on system {{(pid=75226) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 17 01:25:54 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:25:54 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 01:25:54 user nova-compute[75226]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 17 01:25:54 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[033904c5-cc01-4d5a-872a-9fcd354d4c3a]: (4, '') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:25:54 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-e60e2191-4135-4289-8be9-f9725d4441f7 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75226) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 17 01:25:54 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-e60e2191-4135-4289-8be9-f9725d4441f7 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75226) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 17 01:25:54 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-e60e2191-4135-4289-8be9-f9725d4441f7 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] LIGHTOS: no hostnqn found. {{(pid=75226) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 17 01:25:54 user nova-compute[75226]: DEBUG os_brick.utils [None req-e60e2191-4135-4289-8be9-f9725d4441f7 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] <== get_connector_properties: return (153ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f62857db69', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:25:54 user nova-compute[75226]: DEBUG nova.virt.block_device [None req-e60e2191-4135-4289-8be9-f9725d4441f7 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] [instance: 306054a8-4d0f-4913-b3b8-97aeeeec071c] Updating existing volume attachment record: 674a01cc-c49f-4cb8-b05a-55ce9f7865e8 {{(pid=75226) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 17 01:25:57 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:25:58 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:26:00 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e60e2191-4135-4289-8be9-f9725d4441f7 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:26:00 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e60e2191-4135-4289-8be9-f9725d4441f7 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:26:00 user nova-compute[75226]: DEBUG nova.objects.instance [None req-e60e2191-4135-4289-8be9-f9725d4441f7 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Lazy-loading 'pci_requests' on Instance uuid 306054a8-4d0f-4913-b3b8-97aeeeec071c {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:26:00 user nova-compute[75226]: DEBUG nova.objects.instance [None req-e60e2191-4135-4289-8be9-f9725d4441f7 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Lazy-loading 'numa_topology' on Instance uuid 306054a8-4d0f-4913-b3b8-97aeeeec071c {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:26:00 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-e60e2191-4135-4289-8be9-f9725d4441f7 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75226) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 17 01:26:00 user nova-compute[75226]: INFO nova.compute.claims [None req-e60e2191-4135-4289-8be9-f9725d4441f7 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] [instance: 306054a8-4d0f-4913-b3b8-97aeeeec071c] Claim successful on node user
Nov 17 01:26:00 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:26:00 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:26:00 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-e60e2191-4135-4289-8be9-f9725d4441f7 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:26:00 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-e60e2191-4135-4289-8be9-f9725d4441f7 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:26:01 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e60e2191-4135-4289-8be9-f9725d4441f7 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.624s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:26:01 user nova-compute[75226]: INFO nova.network.neutron [None req-e60e2191-4135-4289-8be9-f9725d4441f7 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] [instance: 306054a8-4d0f-4913-b3b8-97aeeeec071c] Updating port 9c6d2999-f11a-4cab-828c-993cc52b996c with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 17 01:26:01 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e60e2191-4135-4289-8be9-f9725d4441f7 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Acquiring lock "refresh_cache-306054a8-4d0f-4913-b3b8-97aeeeec071c" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:26:01 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e60e2191-4135-4289-8be9-f9725d4441f7 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Acquired lock "refresh_cache-306054a8-4d0f-4913-b3b8-97aeeeec071c" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:26:01 user nova-compute[75226]: DEBUG nova.network.neutron [None req-e60e2191-4135-4289-8be9-f9725d4441f7 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] [instance: 306054a8-4d0f-4913-b3b8-97aeeeec071c] Building network info cache for instance {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 01:26:01 user nova-compute[75226]: DEBUG nova.compute.manager [req-b2b5abb4-439c-4bae-8139-09bc84ce5eb9 req-b2239b23-e75e-42c8-82ae-422bcb2557e4 service nova] [instance: 306054a8-4d0f-4913-b3b8-97aeeeec071c] Received event network-changed-9c6d2999-f11a-4cab-828c-993cc52b996c {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:26:01 user nova-compute[75226]: DEBUG nova.compute.manager [req-b2b5abb4-439c-4bae-8139-09bc84ce5eb9 req-b2239b23-e75e-42c8-82ae-422bcb2557e4 service nova] [instance: 306054a8-4d0f-4913-b3b8-97aeeeec071c] Refreshing instance network info cache due to event network-changed-9c6d2999-f11a-4cab-828c-993cc52b996c. {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 01:26:01 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-b2b5abb4-439c-4bae-8139-09bc84ce5eb9 req-b2239b23-e75e-42c8-82ae-422bcb2557e4 service nova] Acquiring lock "refresh_cache-306054a8-4d0f-4913-b3b8-97aeeeec071c" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:26:01 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:26:02 user nova-compute[75226]: DEBUG nova.network.neutron [None req-e60e2191-4135-4289-8be9-f9725d4441f7 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] [instance: 306054a8-4d0f-4913-b3b8-97aeeeec071c] Updating instance_info_cache with network_info: [{"id": "9c6d2999-f11a-4cab-828c-993cc52b996c", "address": "fa:16:3e:71:4a:e0", "network": {"id": "72724945-89ae-47c2-ac58-ea393837ada6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-308563626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fcdc65b510141e9b7c9a01401a97448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c6d2999-f1", "ovs_interfaceid": "9c6d2999-f11a-4cab-828c-993cc52b996c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:26:02 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e60e2191-4135-4289-8be9-f9725d4441f7 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Releasing lock "refresh_cache-306054a8-4d0f-4913-b3b8-97aeeeec071c" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:26:02 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-e60e2191-4135-4289-8be9-f9725d4441f7 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] [instance: 306054a8-4d0f-4913-b3b8-97aeeeec071c] Creating instance directory {{(pid=75226) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 17 01:26:02 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-e60e2191-4135-4289-8be9-f9725d4441f7 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] [instance: 306054a8-4d0f-4913-b3b8-97aeeeec071c] Creating image(s)
Nov 17 01:26:02 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e60e2191-4135-4289-8be9-f9725d4441f7 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Acquiring lock "/opt/stack/data/nova/instances/306054a8-4d0f-4913-b3b8-97aeeeec071c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:26:02 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e60e2191-4135-4289-8be9-f9725d4441f7 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Lock "/opt/stack/data/nova/instances/306054a8-4d0f-4913-b3b8-97aeeeec071c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:26:02 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e60e2191-4135-4289-8be9-f9725d4441f7 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Lock "/opt/stack/data/nova/instances/306054a8-4d0f-4913-b3b8-97aeeeec071c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:26:02 user nova-compute[75226]: DEBUG nova.objects.instance [None req-e60e2191-4135-4289-8be9-f9725d4441f7 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Lazy-loading 'trusted_certs' on Instance uuid 306054a8-4d0f-4913-b3b8-97aeeeec071c {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:26:02 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-b2b5abb4-439c-4bae-8139-09bc84ce5eb9 req-b2239b23-e75e-42c8-82ae-422bcb2557e4 service nova] Acquired lock "refresh_cache-306054a8-4d0f-4913-b3b8-97aeeeec071c" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:26:02 user nova-compute[75226]: DEBUG nova.network.neutron [req-b2b5abb4-439c-4bae-8139-09bc84ce5eb9 req-b2239b23-e75e-42c8-82ae-422bcb2557e4 service nova] [instance: 306054a8-4d0f-4913-b3b8-97aeeeec071c] Refreshing network info cache for port 9c6d2999-f11a-4cab-828c-993cc52b996c {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 01:26:02 user nova-compute[75226]: DEBUG nova.objects.base [None req-e60e2191-4135-4289-8be9-f9725d4441f7 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Object Instance<306054a8-4d0f-4913-b3b8-97aeeeec071c> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75226) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 17 01:26:02 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e60e2191-4135-4289-8be9-f9725d4441f7 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Acquiring lock "d8d5653144b428d20b746276ec0860012540b47e" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:26:02 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e60e2191-4135-4289-8be9-f9725d4441f7 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Lock "d8d5653144b428d20b746276ec0860012540b47e" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:26:03 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e60e2191-4135-4289-8be9-f9725d4441f7 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8d5653144b428d20b746276ec0860012540b47e.part --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:26:03 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:26:03 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:26:03 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:26:03 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:26:03 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:26:03 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:26:03 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75226) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 17 01:26:03 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e60e2191-4135-4289-8be9-f9725d4441f7 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8d5653144b428d20b746276ec0860012540b47e.part --force-share --output=json" returned: 0 in 0.214s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:26:03 user nova-compute[75226]: DEBUG nova.virt.images [None req-e60e2191-4135-4289-8be9-f9725d4441f7 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] cbc6eab0-2f12-4d46-a7cb-dcd6ec8fd06b was qcow2, converting to raw {{(pid=75226) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 17 01:26:03 user nova-compute[75226]: DEBUG nova.privsep.utils [None req-e60e2191-4135-4289-8be9-f9725d4441f7 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75226) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 17 01:26:03 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e60e2191-4135-4289-8be9-f9725d4441f7 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d8d5653144b428d20b746276ec0860012540b47e.part /opt/stack/data/nova/instances/_base/d8d5653144b428d20b746276ec0860012540b47e.converted {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:26:04 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee2187c9-8620-4fd2-ad8a-a054cd8393f3/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:26:04 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e60e2191-4135-4289-8be9-f9725d4441f7 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d8d5653144b428d20b746276ec0860012540b47e.part /opt/stack/data/nova/instances/_base/d8d5653144b428d20b746276ec0860012540b47e.converted" returned: 0 in 0.477s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:26:04 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e60e2191-4135-4289-8be9-f9725d4441f7 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8d5653144b428d20b746276ec0860012540b47e.converted --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:26:04 user nova-compute[75226]: DEBUG nova.network.neutron [req-b2b5abb4-439c-4bae-8139-09bc84ce5eb9 req-b2239b23-e75e-42c8-82ae-422bcb2557e4 service nova] [instance: 306054a8-4d0f-4913-b3b8-97aeeeec071c] Updated VIF entry in instance network info cache for port 9c6d2999-f11a-4cab-828c-993cc52b996c. {{(pid=75226) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 01:26:04 user nova-compute[75226]: DEBUG nova.network.neutron [req-b2b5abb4-439c-4bae-8139-09bc84ce5eb9 req-b2239b23-e75e-42c8-82ae-422bcb2557e4 service nova] [instance: 306054a8-4d0f-4913-b3b8-97aeeeec071c] Updating instance_info_cache with network_info: [{"id": "9c6d2999-f11a-4cab-828c-993cc52b996c", "address": "fa:16:3e:71:4a:e0", "network": {"id": "72724945-89ae-47c2-ac58-ea393837ada6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-308563626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fcdc65b510141e9b7c9a01401a97448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c6d2999-f1", "ovs_interfaceid": "9c6d2999-f11a-4cab-828c-993cc52b996c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:26:04 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee2187c9-8620-4fd2-ad8a-a054cd8393f3/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:26:04 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee2187c9-8620-4fd2-ad8a-a054cd8393f3/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:26:04 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-b2b5abb4-439c-4bae-8139-09bc84ce5eb9 req-b2239b23-e75e-42c8-82ae-422bcb2557e4 service nova] Releasing lock "refresh_cache-306054a8-4d0f-4913-b3b8-97aeeeec071c" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:26:04 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e60e2191-4135-4289-8be9-f9725d4441f7 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8d5653144b428d20b746276ec0860012540b47e.converted --force-share --output=json" returned: 0 in 0.190s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:26:04 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e60e2191-4135-4289-8be9-f9725d4441f7 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Lock "d8d5653144b428d20b746276ec0860012540b47e" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.128s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:26:04 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e60e2191-4135-4289-8be9-f9725d4441f7 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8d5653144b428d20b746276ec0860012540b47e --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:26:04 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee2187c9-8620-4fd2-ad8a-a054cd8393f3/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:26:04 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38062487-67ca-4962-974f-81456aebe97b/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:26:04 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e60e2191-4135-4289-8be9-f9725d4441f7 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8d5653144b428d20b746276ec0860012540b47e --force-share --output=json" returned: 0 in 0.171s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:26:04 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e60e2191-4135-4289-8be9-f9725d4441f7 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Acquiring lock "d8d5653144b428d20b746276ec0860012540b47e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:26:04 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e60e2191-4135-4289-8be9-f9725d4441f7 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Lock "d8d5653144b428d20b746276ec0860012540b47e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:26:04 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e60e2191-4135-4289-8be9-f9725d4441f7 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8d5653144b428d20b746276ec0860012540b47e --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:26:04 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38062487-67ca-4962-974f-81456aebe97b/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:26:04 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38062487-67ca-4962-974f-81456aebe97b/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:26:04 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e60e2191-4135-4289-8be9-f9725d4441f7 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8d5653144b428d20b746276ec0860012540b47e --force-share --output=json" returned: 0 in 0.168s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:26:04 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e60e2191-4135-4289-8be9-f9725d4441f7 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8d5653144b428d20b746276ec0860012540b47e,backing_fmt=raw /opt/stack/data/nova/instances/306054a8-4d0f-4913-b3b8-97aeeeec071c/disk 1073741824 {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:26:04 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38062487-67ca-4962-974f-81456aebe97b/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:26:04 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa84e575-bdad-45b9-80ce-86b1c2826fb0/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:26:04 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e60e2191-4135-4289-8be9-f9725d4441f7 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8d5653144b428d20b746276ec0860012540b47e,backing_fmt=raw /opt/stack/data/nova/instances/306054a8-4d0f-4913-b3b8-97aeeeec071c/disk 1073741824" returned: 0 in 0.083s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:26:04 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e60e2191-4135-4289-8be9-f9725d4441f7 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Lock "d8d5653144b428d20b746276ec0860012540b47e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.265s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:26:04 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e60e2191-4135-4289-8be9-f9725d4441f7 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8d5653144b428d20b746276ec0860012540b47e --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:26:05 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa84e575-bdad-45b9-80ce-86b1c2826fb0/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:26:05 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa84e575-bdad-45b9-80ce-86b1c2826fb0/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:26:05 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e60e2191-4135-4289-8be9-f9725d4441f7 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8d5653144b428d20b746276ec0860012540b47e --force-share --output=json" returned: 0 in 0.171s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:26:05 user nova-compute[75226]: DEBUG nova.objects.instance [None req-e60e2191-4135-4289-8be9-f9725d4441f7 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Lazy-loading 'migration_context' on Instance uuid 306054a8-4d0f-4913-b3b8-97aeeeec071c {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:26:05 user nova-compute[75226]: DEBUG nova.objects.base [None req-e60e2191-4135-4289-8be9-f9725d4441f7 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Object Instance<306054a8-4d0f-4913-b3b8-97aeeeec071c> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75226) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 17 01:26:05 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-e60e2191-4135-4289-8be9-f9725d4441f7 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] [instance: 306054a8-4d0f-4913-b3b8-97aeeeec071c] Rebasing disk image.
Nov 17 01:26:05 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e60e2191-4135-4289-8be9-f9725d4441f7 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:26:05 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa84e575-bdad-45b9-80ce-86b1c2826fb0/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:26:05 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fbdd8af-f608-4d73-92d9-ae0586814c1b/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:26:05 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e60e2191-4135-4289-8be9-f9725d4441f7 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json" returned: 0 in 0.168s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:26:05 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e60e2191-4135-4289-8be9-f9725d4441f7 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 -F raw /opt/stack/data/nova/instances/306054a8-4d0f-4913-b3b8-97aeeeec071c/disk {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:26:05 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fbdd8af-f608-4d73-92d9-ae0586814c1b/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:26:05 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fbdd8af-f608-4d73-92d9-ae0586814c1b/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:26:05 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fbdd8af-f608-4d73-92d9-ae0586814c1b/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:26:05 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] skipping disk /dev/sdi (vdb) as it is a volume {{(pid=75226) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 01:26:05 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4050d898-f2b8-46c2-86e3-702ceb41a701/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:26:05 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4050d898-f2b8-46c2-86e3-702ceb41a701/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:26:05 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4050d898-f2b8-46c2-86e3-702ceb41a701/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:26:05 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4050d898-f2b8-46c2-86e3-702ceb41a701/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:26:05 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:26:06 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c/disk --force-share --output=json" returned: 0 in 0.367s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:26:06 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:26:06 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c/disk --force-share --output=json" returned: 0 in 0.456s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:26:06 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75226) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 01:26:06 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dcdd769-bbfe-48e8-a876-8b2072b7baeb/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:26:06 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dcdd769-bbfe-48e8-a876-8b2072b7baeb/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:26:06 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dcdd769-bbfe-48e8-a876-8b2072b7baeb/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:26:07 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-18c6848e-589e-4b0f-b96c-9c73e865bfcf tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Acquiring lock "2fbdd8af-f608-4d73-92d9-ae0586814c1b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:26:07 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-18c6848e-589e-4b0f-b96c-9c73e865bfcf tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Lock "2fbdd8af-f608-4d73-92d9-ae0586814c1b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:26:07 user nova-compute[75226]: INFO nova.compute.manager [None req-18c6848e-589e-4b0f-b96c-9c73e865bfcf tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: 2fbdd8af-f608-4d73-92d9-ae0586814c1b] Detaching volume 1fd0b73a-0d42-4e3d-a4f0-a9936d9bd1d4
Nov 17 01:26:07 user nova-compute[75226]: INFO nova.virt.block_device [None req-18c6848e-589e-4b0f-b96c-9c73e865bfcf tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: 2fbdd8af-f608-4d73-92d9-ae0586814c1b] Attempting to driver detach volume 1fd0b73a-0d42-4e3d-a4f0-a9936d9bd1d4 from mountpoint /dev/vdb
Nov 17 01:26:07 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-18c6848e-589e-4b0f-b96c-9c73e865bfcf tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Attempting to detach device vdb from instance 2fbdd8af-f608-4d73-92d9-ae0586814c1b from the persistent domain config. {{(pid=75226) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 17 01:26:07 user nova-compute[75226]: DEBUG nova.virt.libvirt.guest [None req-18c6848e-589e-4b0f-b96c-9c73e865bfcf tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] detach device xml: <disk type="block" device="disk">
Nov 17 01:26:07 user nova-compute[75226]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 01:26:07 user nova-compute[75226]:   <source dev="/dev/sdi"/>
Nov 17 01:26:07 user nova-compute[75226]:   <target dev="vdb" bus="virtio"/>
Nov 17 01:26:07 user nova-compute[75226]:   <serial>1fd0b73a-0d42-4e3d-a4f0-a9936d9bd1d4</serial>
Nov 17 01:26:07 user nova-compute[75226]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 17 01:26:07 user nova-compute[75226]: </disk>
Nov 17 01:26:07 user nova-compute[75226]:  {{(pid=75226) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 17 01:26:07 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-18c6848e-589e-4b0f-b96c-9c73e865bfcf tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Successfully detached device vdb from instance 2fbdd8af-f608-4d73-92d9-ae0586814c1b from the persistent domain config.
Nov 17 01:26:07 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-18c6848e-589e-4b0f-b96c-9c73e865bfcf tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2fbdd8af-f608-4d73-92d9-ae0586814c1b from the live domain config. {{(pid=75226) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 17 01:26:07 user nova-compute[75226]: DEBUG nova.virt.libvirt.guest [None req-18c6848e-589e-4b0f-b96c-9c73e865bfcf tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] detach device xml: <disk type="block" device="disk">
Nov 17 01:26:07 user nova-compute[75226]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 01:26:07 user nova-compute[75226]:   <source dev="/dev/sdi"/>
Nov 17 01:26:07 user nova-compute[75226]:   <target dev="vdb" bus="virtio"/>
Nov 17 01:26:07 user nova-compute[75226]:   <serial>1fd0b73a-0d42-4e3d-a4f0-a9936d9bd1d4</serial>
Nov 17 01:26:07 user nova-compute[75226]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 17 01:26:07 user nova-compute[75226]: </disk>
Nov 17 01:26:07 user nova-compute[75226]:  {{(pid=75226) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 17 01:26:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dcdd769-bbfe-48e8-a876-8b2072b7baeb/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:26:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ea5a14b-c330-4a2b-926e-60e1b30f5981/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:26:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ea5a14b-c330-4a2b-926e-60e1b30f5981/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:26:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ea5a14b-c330-4a2b-926e-60e1b30f5981/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:26:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e60e2191-4135-4289-8be9-f9725d4441f7 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 -F raw /opt/stack/data/nova/instances/306054a8-4d0f-4913-b3b8-97aeeeec071c/disk" returned: 0 in 2.182s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:26:07 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-e60e2191-4135-4289-8be9-f9725d4441f7 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] [instance: 306054a8-4d0f-4913-b3b8-97aeeeec071c] Created local disks {{(pid=75226) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 17 01:26:07 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-e60e2191-4135-4289-8be9-f9725d4441f7 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] [instance: 306054a8-4d0f-4913-b3b8-97aeeeec071c] Ensure instance console log exists: /opt/stack/data/nova/instances/306054a8-4d0f-4913-b3b8-97aeeeec071c/console.log {{(pid=75226) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 17 01:26:07 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e60e2191-4135-4289-8be9-f9725d4441f7 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:26:07 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e60e2191-4135-4289-8be9-f9725d4441f7 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:26:07 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e60e2191-4135-4289-8be9-f9725d4441f7 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:26:07 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-e60e2191-4135-4289-8be9-f9725d4441f7 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] [instance: 306054a8-4d0f-4913-b3b8-97aeeeec071c] Start _get_guest_xml network_info=[{"id": "9c6d2999-f11a-4cab-828c-993cc52b996c", "address": "fa:16:3e:71:4a:e0", "network": {"id": "72724945-89ae-47c2-ac58-ea393837ada6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-308563626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fcdc65b510141e9b7c9a01401a97448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c6d2999-f1", "ovs_interfaceid": "9c6d2999-f11a-4cab-828c-993cc52b996c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='bf6a13298f27af99d6f448a457fc2ae2',container_format='bare',created_at=2023-11-17T01:24:01Z,direct_url=<?>,disk_format='qcow2',id=cbc6eab0-2f12-4d46-a7cb-dcd6ec8fd06b,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-523828380-shelved',owner='1fcdc65b510141e9b7c9a01401a97448',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-17T01:24:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '0b369aea-6f3f-4690-9f01-229b90ab6310'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'mount_device': '/dev/vdc', 'disk_bus': 'virtio', 'boot_index': None, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:29701267-6547-48b4-befc-b18ec2ab5e2c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YyZkJfSx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '306054a8-4d0f-4913-b3b8-97aeeeec071c', 'attached_at': '', 'detached_at': '', 'volume_id': '29701267-6547-48b4-befc-b18ec2ab5e2c', 'serial': '29701267-6547-48b4-befc-b18ec2ab5e2c'}, 'attachment_id': '674a01cc-c49f-4cb8-b05a-55ce9f7865e8', 'device_type': 'disk', 'volume_type': None} {{(pid=75226) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 17 01:26:07 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-e60e2191-4135-4289-8be9-f9725d4441f7 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:26:07 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-e60e2191-4135-4289-8be9-f9725d4441f7 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:26:07 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-e60e2191-4135-4289-8be9-f9725d4441f7 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75226) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 17 01:26:07 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-e60e2191-4135-4289-8be9-f9725d4441f7 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] CPU controller missing on host. {{(pid=75226) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 17 01:26:07 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-e60e2191-4135-4289-8be9-f9725d4441f7 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75226) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 17 01:26:07 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-e60e2191-4135-4289-8be9-f9725d4441f7 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] CPU controller found on host. {{(pid=75226) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 17 01:26:07 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-e60e2191-4135-4289-8be9-f9725d4441f7 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75226) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 17 01:26:07 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-e60e2191-4135-4289-8be9-f9725d4441f7 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-17T01:13:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='bf6a13298f27af99d6f448a457fc2ae2',container_format='bare',created_at=2023-11-17T01:24:01Z,direct_url=<?>,disk_format='qcow2',id=cbc6eab0-2f12-4d46-a7cb-dcd6ec8fd06b,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-523828380-shelved',owner='1fcdc65b510141e9b7c9a01401a97448',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-17T01:24:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 17 01:26:07 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-e60e2191-4135-4289-8be9-f9725d4441f7 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Flavor limits 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 17 01:26:07 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-e60e2191-4135-4289-8be9-f9725d4441f7 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Image limits 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 17 01:26:07 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-e60e2191-4135-4289-8be9-f9725d4441f7 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Flavor pref 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 17 01:26:07 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-e60e2191-4135-4289-8be9-f9725d4441f7 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Image pref 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 17 01:26:07 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-e60e2191-4135-4289-8be9-f9725d4441f7 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 17 01:26:07 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-e60e2191-4135-4289-8be9-f9725d4441f7 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 17 01:26:07 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-e60e2191-4135-4289-8be9-f9725d4441f7 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75226) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 17 01:26:07 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-e60e2191-4135-4289-8be9-f9725d4441f7 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Got 1 possible topologies {{(pid=75226) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 17 01:26:07 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-e60e2191-4135-4289-8be9-f9725d4441f7 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 17 01:26:07 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-e60e2191-4135-4289-8be9-f9725d4441f7 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 17 01:26:07 user nova-compute[75226]: DEBUG nova.objects.instance [None req-e60e2191-4135-4289-8be9-f9725d4441f7 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Lazy-loading 'vcpu_model' on Instance uuid 306054a8-4d0f-4913-b3b8-97aeeeec071c {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:26:07 user nova-compute[75226]: DEBUG nova.objects.base [None req-e60e2191-4135-4289-8be9-f9725d4441f7 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Object Instance<306054a8-4d0f-4913-b3b8-97aeeeec071c> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75226) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 17 01:26:07 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e60e2191-4135-4289-8be9-f9725d4441f7 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] [instance: 306054a8-4d0f-4913-b3b8-97aeeeec071c] Calling os-brick to attach iSCSI Volume {{(pid=75226) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 17 01:26:07 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-e60e2191-4135-4289-8be9-f9725d4441f7 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc4cc36b490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:29701267-6547-48b4-befc-b18ec2ab5e2c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YyZkJfSx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:26:07 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-e60e2191-4135-4289-8be9-f9725d4441f7 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:26:07 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-e60e2191-4135-4289-8be9-f9725d4441f7 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:26:07 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-e60e2191-4135-4289-8be9-f9725d4441f7 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:26:07 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-e60e2191-4135-4289-8be9-f9725d4441f7 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:26:07 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-e60e2191-4135-4289-8be9-f9725d4441f7 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:29701267-6547-48b4-befc-b18ec2ab5e2c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:26:07 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-e60e2191-4135-4289-8be9-f9725d4441f7 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:29701267-6547-48b4-befc-b18ec2ab5e2c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:26:07 user nova-compute[75226]: INFO os_brick.initiator.connectors.iscsi [None req-e60e2191-4135-4289-8be9-f9725d4441f7 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 17 01:26:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29701267-6547-48b4-befc-b18ec2ab5e2c -p 172.16.0.220:3260 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:26:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29701267-6547-48b4-befc-b18ec2ab5e2c -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:26:07 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[c50c71a7-09c9-4cd4-bc2a-6dd2d70769f4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:26:07 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-e60e2191-4135-4289-8be9-f9725d4441f7 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 17 01:26:07 user nova-compute[75226]:  {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:26:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29701267-6547-48b4-befc-b18ec2ab5e2c -p 172.16.0.220:3260 --interface default --op new {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:26:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ea5a14b-c330-4a2b-926e-60e1b30f5981/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:26:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29701267-6547-48b4-befc-b18ec2ab5e2c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:26:07 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[cda48d3c-fc1a-4b88-b8d1-5166debbd6e5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:29701267-6547-48b4-befc-b18ec2ab5e2c] added\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:26:07 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-e60e2191-4135-4289-8be9-f9725d4441f7 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:29701267-6547-48b4-befc-b18ec2ab5e2c] added
Nov 17 01:26:07 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:26:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29701267-6547-48b4-befc-b18ec2ab5e2c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:26:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6555d72-6094-4ea9-b071-a3d3c8a300a9/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:26:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29701267-6547-48b4-befc-b18ec2ab5e2c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:26:07 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[c56b9a70-f107-4d2d-be03-a7a6d9fea8ac]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:26:07 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-e60e2191-4135-4289-8be9-f9725d4441f7 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:26:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29701267-6547-48b4-befc-b18ec2ab5e2c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:26:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29701267-6547-48b4-befc-b18ec2ab5e2c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:26:07 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca6c5df8-681e-47e3-9055-a7eb9c276407]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:26:07 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-e60e2191-4135-4289-8be9-f9725d4441f7 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:26:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29701267-6547-48b4-befc-b18ec2ab5e2c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YyZkJfSx {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:26:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29701267-6547-48b4-befc-b18ec2ab5e2c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YyZkJfSx" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:26:07 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cc6df64-ea20-4fbb-9a6b-b06069be9c56]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:26:07 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-e60e2191-4135-4289-8be9-f9725d4441f7 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YyZkJfSx'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:26:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29701267-6547-48b4-befc-b18ec2ab5e2c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:26:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29701267-6547-48b4-befc-b18ec2ab5e2c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:26:07 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[c256a757-409e-47fe-a8f5-9d486fb89469]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:26:07 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-e60e2191-4135-4289-8be9-f9725d4441f7 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:26:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:26:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:26:07 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd0f1ffb-a181-4121-a0e9-d937c23a9e96]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fd0b73a-0d42-4e3d-a4f0-a9936d9bd1d4 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:26:07 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-e60e2191-4135-4289-8be9-f9725d4441f7 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)
Nov 17 01:26:07 user nova-compute[75226]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fd0b73a-0d42-4e3d-a4f0-a9936d9bd1d4 (non-flash)
Nov 17 01:26:07 user nova-compute[75226]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421 (non-flash)
Nov 17 01:26:07 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:26:07 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-e60e2191-4135-4289-8be9-f9725d4441f7 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)
Nov 17 01:26:07 user nova-compute[75226]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fd0b73a-0d42-4e3d-a4f0-a9936d9bd1d4 (non-flash)
Nov 17 01:26:07 user nova-compute[75226]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421 (non-flash)
Nov 17 01:26:07 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:26:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29701267-6547-48b4-befc-b18ec2ab5e2c -p 172.16.0.220:3260 --login {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:26:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6555d72-6094-4ea9-b071-a3d3c8a300a9/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:26:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6555d72-6094-4ea9-b071-a3d3c8a300a9/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:26:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29701267-6547-48b4-befc-b18ec2ab5e2c -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:26:07 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[01ebd30d-e9b1-43b5-9489-1ca2c4b46038]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:29701267-6547-48b4-befc-b18ec2ab5e2c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:29701267-6547-48b4-befc-b18ec2ab5e2c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:26:07 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-e60e2191-4135-4289-8be9-f9725d4441f7 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:29701267-6547-48b4-befc-b18ec2ab5e2c, portal: 172.16.0.220,3260]
Nov 17 01:26:07 user nova-compute[75226]: Login to [iface: default, target: iqn.2010-10.org.openstack:29701267-6547-48b4-befc-b18ec2ab5e2c, portal: 172.16.0.220,3260] successful.
Nov 17 01:26:07 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:26:07 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-18c6848e-589e-4b0f-b96c-9c73e865bfcf tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2fbdd8af-f608-4d73-92d9-ae0586814c1b {{(pid=75226) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 17 01:26:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29701267-6547-48b4-befc-b18ec2ab5e2c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:26:07 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:26:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29701267-6547-48b4-befc-b18ec2ab5e2c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:26:07 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[257ba09b-07f3-4970-a8a1-76f193550fdc]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:26:07 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-e60e2191-4135-4289-8be9-f9725d4441f7 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:26:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:26:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:26:07 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9752628-0162-46e1-bcf9-91ac5ece3003]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fd0b73a-0d42-4e3d-a4f0-a9936d9bd1d4 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29701267-6547-48b4-befc-b18ec2ab5e2c (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:26:07 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-e60e2191-4135-4289-8be9-f9725d4441f7 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)
Nov 17 01:26:07 user nova-compute[75226]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fd0b73a-0d42-4e3d-a4f0-a9936d9bd1d4 (non-flash)
Nov 17 01:26:07 user nova-compute[75226]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421 (non-flash)
Nov 17 01:26:07 user nova-compute[75226]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29701267-6547-48b4-befc-b18ec2ab5e2c (non-flash)
Nov 17 01:26:07 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:26:07 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-e60e2191-4135-4289-8be9-f9725d4441f7 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)
Nov 17 01:26:07 user nova-compute[75226]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fd0b73a-0d42-4e3d-a4f0-a9936d9bd1d4 (non-flash)
Nov 17 01:26:07 user nova-compute[75226]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421 (non-flash)
Nov 17 01:26:07 user nova-compute[75226]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29701267-6547-48b4-befc-b18ec2ab5e2c (non-flash)
Nov 17 01:26:07 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:26:07 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-e60e2191-4135-4289-8be9-f9725d4441f7 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:29701267-6547-48b4-befc-b18ec2ab5e2c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.318s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:26:07 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-e60e2191-4135-4289-8be9-f9725d4441f7 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Connected to 172.16.0.220:3260 {{(pid=75226) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 17 01:26:07 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-e60e2191-4135-4289-8be9-f9725d4441f7 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] HCTL ('33', '-', '-', 0) found on session 26 with lun 0 {{(pid=75226) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 17 01:26:07 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-e60e2191-4135-4289-8be9-f9725d4441f7 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75226) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 17 01:26:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:26:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.023s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:26:07 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[e64a567b-6fc5-457a-a207-8c08bdf5a8d0]: (4, ('- - 0', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:26:07 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-e60e2191-4135-4289-8be9-f9725d4441f7 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Searching for a device in session 26 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75226) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 01:26:07 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-e60e2191-4135-4289-8be9-f9725d4441f7 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:29701267-6547-48b4-befc-b18ec2ab5e2c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YyZkJfSx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75226) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 17 01:26:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6555d72-6094-4ea9-b071-a3d3c8a300a9/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:26:07 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75226) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 01:26:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c280142-8901-4f83-bde4-baaa097e05b0/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:26:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c280142-8901-4f83-bde4-baaa097e05b0/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:26:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c280142-8901-4f83-bde4-baaa097e05b0/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:26:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c280142-8901-4f83-bde4-baaa097e05b0/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:26:08 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:26:08 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:26:08 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:26:08 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Hypervisor/Node resource view: name=user free_ram=7407MB free_disk=24.963123321533203GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75226) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 17 01:26:08 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:26:08 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:26:08 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-e60e2191-4135-4289-8be9-f9725d4441f7 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.357s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:26:08 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-e60e2191-4135-4289-8be9-f9725d4441f7 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] <== connect_volume: return (1358ms) {'type': 'block', 'scsi_wwn': '26134303266333134', 'path': '/dev/sdb'} {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:26:08 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e60e2191-4135-4289-8be9-f9725d4441f7 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] [instance: 306054a8-4d0f-4913-b3b8-97aeeeec071c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26134303266333134', 'path': '/dev/sdb'} {{(pid=75226) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 17 01:26:08 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance aa84e575-bdad-45b9-80ce-86b1c2826fb0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:26:08 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 6b7e9611-be35-4e51-b886-91a2fac0a653 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:26:08 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:26:08 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 2fbdd8af-f608-4d73-92d9-ae0586814c1b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:26:08 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 38062487-67ca-4962-974f-81456aebe97b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:26:08 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance ee2187c9-8620-4fd2-ad8a-a054cd8393f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:26:08 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 4050d898-f2b8-46c2-86e3-702ceb41a701 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:26:08 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 4dcdd769-bbfe-48e8-a876-8b2072b7baeb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:26:08 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 2ea5a14b-c330-4a2b-926e-60e1b30f5981 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:26:08 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance d6555d72-6094-4ea9-b071-a3d3c8a300a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:26:08 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 5c280142-8901-4f83-bde4-baaa097e05b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:26:08 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] [instance: 306054a8-4d0f-4913-b3b8-97aeeeec071c] Instance with task_state "spawning" is not being actively managed by this compute host but has allocations referencing this compute node (f431122b-abb2-4ecb-9e21-e3ec333d823b): {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. Skipping heal of allocations during the task state transition. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1777}}
Nov 17 01:26:08 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75226) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 17 01:26:08 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75226) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 17 01:26:08 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-e60e2191-4135-4289-8be9-f9725d4441f7 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-17T01:22:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-523828380',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-523828380',id=17,image_ref='cbc6eab0-2f12-4d46-a7cb-dcd6ec8fd06b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1641360166',keypairs=<?>,launch_index=0,launched_at=2023-11-17T01:22:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='1fcdc65b510141e9b7c9a01401a97448',ramdisk_id='',reservation_id='r-7ael85gs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1321076871',owner_user_name='tempest-AttachVolumeShelveTestJSON-1321076871-project-member',shelved_at='2023-11-17T01:24:07.547973',shelved_host='user',shelved_image_id='cbc6eab0-2f12-4d46-a7cb-dcd6ec8fd06b'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T01:25:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2adb9c6cd5c443a7993f6f9d09da6346',uuid=306054a8-4d0f-4913-b3b8-97aeeeec071c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "9c6d2999-f11a-4cab-828c-993cc52b996c", "address": "fa:16:3e:71:4a:e0", "network": {"id": "72724945-89ae-47c2-ac58-ea393837ada6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-308563626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fcdc65b510141e9b7c9a01401a97448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c6d2999-f1", "ovs_interfaceid": "9c6d2999-f11a-4cab-828c-993cc52b996c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75226) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 01:26:08 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-e60e2191-4135-4289-8be9-f9725d4441f7 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Converting VIF {"id": "9c6d2999-f11a-4cab-828c-993cc52b996c", "address": "fa:16:3e:71:4a:e0", "network": {"id": "72724945-89ae-47c2-ac58-ea393837ada6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-308563626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fcdc65b510141e9b7c9a01401a97448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c6d2999-f1", "ovs_interfaceid": "9c6d2999-f11a-4cab-828c-993cc52b996c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:26:08 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-e60e2191-4135-4289-8be9-f9725d4441f7 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:4a:e0,bridge_name='br-int',has_traffic_filtering=True,id=9c6d2999-f11a-4cab-828c-993cc52b996c,network=Network(72724945-89ae-47c2-ac58-ea393837ada6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c6d2999-f1') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:26:08 user nova-compute[75226]: DEBUG nova.objects.instance [None req-e60e2191-4135-4289-8be9-f9725d4441f7 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Lazy-loading 'pci_devices' on Instance uuid 306054a8-4d0f-4913-b3b8-97aeeeec071c {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:26:08 user nova-compute[75226]: DEBUG nova.objects.base [None req-e60e2191-4135-4289-8be9-f9725d4441f7 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Object Instance<306054a8-4d0f-4913-b3b8-97aeeeec071c> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75226) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 17 01:26:08 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-e60e2191-4135-4289-8be9-f9725d4441f7 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] [instance: 306054a8-4d0f-4913-b3b8-97aeeeec071c] End _get_guest_xml xml=<domain type="kvm">
Nov 17 01:26:08 user nova-compute[75226]:   <uuid>306054a8-4d0f-4913-b3b8-97aeeeec071c</uuid>
Nov 17 01:26:08 user nova-compute[75226]:   <name>instance-00000011</name>
Nov 17 01:26:08 user nova-compute[75226]:   <memory>524288</memory>
Nov 17 01:26:08 user nova-compute[75226]:   <vcpu>1</vcpu>
Nov 17 01:26:08 user nova-compute[75226]:   <metadata>
Nov 17 01:26:08 user nova-compute[75226]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 17 01:26:08 user nova-compute[75226]:       <nova:package version="0.0.0"/>
Nov 17 01:26:08 user nova-compute[75226]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-523828380</nova:name>
Nov 17 01:26:08 user nova-compute[75226]:       <nova:creationTime>2023-11-17 01:26:07</nova:creationTime>
Nov 17 01:26:08 user nova-compute[75226]:       <nova:flavor name="m1.tiny">
Nov 17 01:26:08 user nova-compute[75226]:         <nova:memory>512</nova:memory>
Nov 17 01:26:08 user nova-compute[75226]:         <nova:disk>1</nova:disk>
Nov 17 01:26:08 user nova-compute[75226]:         <nova:swap>0</nova:swap>
Nov 17 01:26:08 user nova-compute[75226]:         <nova:ephemeral>0</nova:ephemeral>
Nov 17 01:26:08 user nova-compute[75226]:         <nova:vcpus>1</nova:vcpus>
Nov 17 01:26:08 user nova-compute[75226]:       </nova:flavor>
Nov 17 01:26:08 user nova-compute[75226]:       <nova:owner>
Nov 17 01:26:08 user nova-compute[75226]:         <nova:user uuid="2adb9c6cd5c443a7993f6f9d09da6346">tempest-AttachVolumeShelveTestJSON-1321076871-project-member</nova:user>
Nov 17 01:26:08 user nova-compute[75226]:         <nova:project uuid="1fcdc65b510141e9b7c9a01401a97448">tempest-AttachVolumeShelveTestJSON-1321076871</nova:project>
Nov 17 01:26:08 user nova-compute[75226]:       </nova:owner>
Nov 17 01:26:08 user nova-compute[75226]:       <nova:root type="image" uuid="cbc6eab0-2f12-4d46-a7cb-dcd6ec8fd06b"/>
Nov 17 01:26:08 user nova-compute[75226]:       <nova:ports>
Nov 17 01:26:08 user nova-compute[75226]:         <nova:port uuid="9c6d2999-f11a-4cab-828c-993cc52b996c">
Nov 17 01:26:08 user nova-compute[75226]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 17 01:26:08 user nova-compute[75226]:         </nova:port>
Nov 17 01:26:08 user nova-compute[75226]:       </nova:ports>
Nov 17 01:26:08 user nova-compute[75226]:     </nova:instance>
Nov 17 01:26:08 user nova-compute[75226]:   </metadata>
Nov 17 01:26:08 user nova-compute[75226]:   <sysinfo type="smbios">
Nov 17 01:26:08 user nova-compute[75226]:     <system>
Nov 17 01:26:08 user nova-compute[75226]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 17 01:26:08 user nova-compute[75226]:       <entry name="product">OpenStack Nova</entry>
Nov 17 01:26:08 user nova-compute[75226]:       <entry name="version">0.0.0</entry>
Nov 17 01:26:08 user nova-compute[75226]:       <entry name="serial">306054a8-4d0f-4913-b3b8-97aeeeec071c</entry>
Nov 17 01:26:08 user nova-compute[75226]:       <entry name="uuid">306054a8-4d0f-4913-b3b8-97aeeeec071c</entry>
Nov 17 01:26:08 user nova-compute[75226]:       <entry name="family">Virtual Machine</entry>
Nov 17 01:26:08 user nova-compute[75226]:     </system>
Nov 17 01:26:08 user nova-compute[75226]:   </sysinfo>
Nov 17 01:26:08 user nova-compute[75226]:   <os>
Nov 17 01:26:08 user nova-compute[75226]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 17 01:26:08 user nova-compute[75226]:     <boot dev="hd"/>
Nov 17 01:26:08 user nova-compute[75226]:     <smbios mode="sysinfo"/>
Nov 17 01:26:08 user nova-compute[75226]:   </os>
Nov 17 01:26:08 user nova-compute[75226]:   <features>
Nov 17 01:26:08 user nova-compute[75226]:     <acpi/>
Nov 17 01:26:08 user nova-compute[75226]:     <apic/>
Nov 17 01:26:08 user nova-compute[75226]:     <vmcoreinfo/>
Nov 17 01:26:08 user nova-compute[75226]:   </features>
Nov 17 01:26:08 user nova-compute[75226]:   <clock offset="utc">
Nov 17 01:26:08 user nova-compute[75226]:     <timer name="pit" tickpolicy="delay"/>
Nov 17 01:26:08 user nova-compute[75226]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 17 01:26:08 user nova-compute[75226]:     <timer name="hpet" present="no"/>
Nov 17 01:26:08 user nova-compute[75226]:   </clock>
Nov 17 01:26:08 user nova-compute[75226]:   <cpu mode="custom" match="exact">
Nov 17 01:26:08 user nova-compute[75226]:     <model>Nehalem</model>
Nov 17 01:26:08 user nova-compute[75226]:     <topology sockets="1" cores="1" threads="1"/>
Nov 17 01:26:08 user nova-compute[75226]:   </cpu>
Nov 17 01:26:08 user nova-compute[75226]:   <devices>
Nov 17 01:26:08 user nova-compute[75226]:     <disk type="file" device="disk">
Nov 17 01:26:08 user nova-compute[75226]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 17 01:26:08 user nova-compute[75226]:       <source file="/opt/stack/data/nova/instances/306054a8-4d0f-4913-b3b8-97aeeeec071c/disk"/>
Nov 17 01:26:08 user nova-compute[75226]:       <target dev="vda" bus="virtio"/>
Nov 17 01:26:08 user nova-compute[75226]:     </disk>
Nov 17 01:26:08 user nova-compute[75226]:     <disk type="block" device="disk">
Nov 17 01:26:08 user nova-compute[75226]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 01:26:08 user nova-compute[75226]:       <source dev="/dev/sdb"/>
Nov 17 01:26:08 user nova-compute[75226]:       <target dev="vdc" bus="virtio"/>
Nov 17 01:26:08 user nova-compute[75226]:       <serial>29701267-6547-48b4-befc-b18ec2ab5e2c</serial>
Nov 17 01:26:08 user nova-compute[75226]:     </disk>
Nov 17 01:26:08 user nova-compute[75226]:     <interface type="ethernet">
Nov 17 01:26:08 user nova-compute[75226]:       <mac address="fa:16:3e:71:4a:e0"/>
Nov 17 01:26:08 user nova-compute[75226]:       <model type="virtio"/>
Nov 17 01:26:08 user nova-compute[75226]:       <mtu size="1442"/>
Nov 17 01:26:08 user nova-compute[75226]:       <target dev="tap9c6d2999-f1"/>
Nov 17 01:26:08 user nova-compute[75226]:     </interface>
Nov 17 01:26:08 user nova-compute[75226]:     <serial type="pty">
Nov 17 01:26:08 user nova-compute[75226]:       <log file="/opt/stack/data/nova/instances/306054a8-4d0f-4913-b3b8-97aeeeec071c/console.log" append="off"/>
Nov 17 01:26:08 user nova-compute[75226]:     </serial>
Nov 17 01:26:08 user nova-compute[75226]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 17 01:26:08 user nova-compute[75226]:     <video>
Nov 17 01:26:08 user nova-compute[75226]:       <model type="virtio"/>
Nov 17 01:26:08 user nova-compute[75226]:     </video>
Nov 17 01:26:08 user nova-compute[75226]:     <rng model="virtio">
Nov 17 01:26:08 user nova-compute[75226]:       <backend model="random">/dev/urandom</backend>
Nov 17 01:26:08 user nova-compute[75226]:     </rng>
Nov 17 01:26:08 user nova-compute[75226]:     <controller type="usb" index="0" model="none"/>
Nov 17 01:26:08 user nova-compute[75226]:     <memballoon model="virtio">
Nov 17 01:26:08 user nova-compute[75226]:       <stats period="10"/>
Nov 17 01:26:08 user nova-compute[75226]:     </memballoon>
Nov 17 01:26:08 user nova-compute[75226]:   </devices>
Nov 17 01:26:08 user nova-compute[75226]: </domain>
Nov 17 01:26:08 user nova-compute[75226]:  {{(pid=75226) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 17 01:26:08 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-e60e2191-4135-4289-8be9-f9725d4441f7 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-17T01:22:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-523828380',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-523828380',id=17,image_ref='cbc6eab0-2f12-4d46-a7cb-dcd6ec8fd06b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1641360166',keypairs=<?>,launch_index=0,launched_at=2023-11-17T01:22:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='1fcdc65b510141e9b7c9a01401a97448',ramdisk_id='',reservation_id='r-7ael85gs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1321076871',owner_user_name='tempest-AttachVolumeShelveTestJSON-1321076871-project-member',shelved_at='2023-11-17T01:24:07.547973',shelved_host='user',shelved_image_id='cbc6eab0-2f12-4d46-a7cb-dcd6ec8fd06b'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T01:25:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2adb9c6cd5c443a7993f6f9d09da6346',uuid=306054a8-4d0f-4913-b3b8-97aeeeec071c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "9c6d2999-f11a-4cab-828c-993cc52b996c", "address": "fa:16:3e:71:4a:e0", "network": {"id": "72724945-89ae-47c2-ac58-ea393837ada6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-308563626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fcdc65b510141e9b7c9a01401a97448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c6d2999-f1", "ovs_interfaceid": "9c6d2999-f11a-4cab-828c-993cc52b996c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 17 01:26:08 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-e60e2191-4135-4289-8be9-f9725d4441f7 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Converting VIF {"id": "9c6d2999-f11a-4cab-828c-993cc52b996c", "address": "fa:16:3e:71:4a:e0", "network": {"id": "72724945-89ae-47c2-ac58-ea393837ada6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-308563626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fcdc65b510141e9b7c9a01401a97448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c6d2999-f1", "ovs_interfaceid": "9c6d2999-f11a-4cab-828c-993cc52b996c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:26:08 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-e60e2191-4135-4289-8be9-f9725d4441f7 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:4a:e0,bridge_name='br-int',has_traffic_filtering=True,id=9c6d2999-f11a-4cab-828c-993cc52b996c,network=Network(72724945-89ae-47c2-ac58-ea393837ada6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c6d2999-f1') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:26:08 user nova-compute[75226]: DEBUG os_vif [None req-e60e2191-4135-4289-8be9-f9725d4441f7 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:4a:e0,bridge_name='br-int',has_traffic_filtering=True,id=9c6d2999-f11a-4cab-828c-993cc52b996c,network=Network(72724945-89ae-47c2-ac58-ea393837ada6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c6d2999-f1') {{(pid=75226) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 17 01:26:08 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:26:08 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:26:08 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 17 01:26:08 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:26:08 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'de28ce65-6941-5350-ae2c-94a5a3d66e7c', '_type': 'linux-noop'}}, row=False) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:26:08 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:26:08 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:26:08 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:26:08 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9c6d2999-f1, may_exist=True, interface_attrs={}) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:26:08 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9c6d2999-f1, col_values=(('qos', UUID('c4c08998-862b-420c-a9c9-e5de97bc91c1')),), if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:26:08 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9c6d2999-f1, col_values=(('external_ids', {'iface-id': '9c6d2999-f11a-4cab-828c-993cc52b996c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:71:4a:e0', 'vm-uuid': '306054a8-4d0f-4913-b3b8-97aeeeec071c'}),), if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:26:08 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:26:08 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:26:08 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:26:08 user nova-compute[75226]: INFO os_vif [None req-e60e2191-4135-4289-8be9-f9725d4441f7 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:4a:e0,bridge_name='br-int',has_traffic_filtering=True,id=9c6d2999-f11a-4cab-828c-993cc52b996c,network=Network(72724945-89ae-47c2-ac58-ea393837ada6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c6d2999-f1')
Nov 17 01:26:09 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-e60e2191-4135-4289-8be9-f9725d4441f7 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] No BDM found with device name vda, not building metadata. {{(pid=75226) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 01:26:09 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-e60e2191-4135-4289-8be9-f9725d4441f7 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75226) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 01:26:09 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-e60e2191-4135-4289-8be9-f9725d4441f7 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] No VIF found with MAC fa:16:3e:71:4a:e0, not building metadata {{(pid=75226) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 01:26:09 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:26:09 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:26:09 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Compute_service record updated for user:user {{(pid=75226) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 17 01:26:09 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.499s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:26:10 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:26:10 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:26:10 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:26:10 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:26:10 user nova-compute[75226]: DEBUG nova.compute.manager [req-7662fb7f-04b7-47da-9c6b-6e51b7d673b7 req-dcdf6337-8a70-45bc-8dd9-57d4919066df service nova] [instance: ee2187c9-8620-4fd2-ad8a-a054cd8393f3] Received event network-changed-1057ea4c-2ac4-40fa-8b2e-3b5888ea4d61 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:26:10 user nova-compute[75226]: DEBUG nova.compute.manager [req-7662fb7f-04b7-47da-9c6b-6e51b7d673b7 req-dcdf6337-8a70-45bc-8dd9-57d4919066df service nova] [instance: ee2187c9-8620-4fd2-ad8a-a054cd8393f3] Refreshing instance network info cache due to event network-changed-1057ea4c-2ac4-40fa-8b2e-3b5888ea4d61. {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 01:26:10 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-7662fb7f-04b7-47da-9c6b-6e51b7d673b7 req-dcdf6337-8a70-45bc-8dd9-57d4919066df service nova] Acquiring lock "refresh_cache-ee2187c9-8620-4fd2-ad8a-a054cd8393f3" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:26:10 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-7662fb7f-04b7-47da-9c6b-6e51b7d673b7 req-dcdf6337-8a70-45bc-8dd9-57d4919066df service nova] Acquired lock "refresh_cache-ee2187c9-8620-4fd2-ad8a-a054cd8393f3" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:26:10 user nova-compute[75226]: DEBUG nova.network.neutron [req-7662fb7f-04b7-47da-9c6b-6e51b7d673b7 req-dcdf6337-8a70-45bc-8dd9-57d4919066df service nova] [instance: ee2187c9-8620-4fd2-ad8a-a054cd8393f3] Refreshing network info cache for port 1057ea4c-2ac4-40fa-8b2e-3b5888ea4d61 {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 01:26:10 user nova-compute[75226]: DEBUG nova.compute.manager [req-72aa8525-a391-4041-9451-33a92a60663a req-219118ca-b501-4cca-9595-e501062743e4 service nova] [instance: 306054a8-4d0f-4913-b3b8-97aeeeec071c] Received event network-vif-plugged-9c6d2999-f11a-4cab-828c-993cc52b996c {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:26:10 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-72aa8525-a391-4041-9451-33a92a60663a req-219118ca-b501-4cca-9595-e501062743e4 service nova] Acquiring lock "306054a8-4d0f-4913-b3b8-97aeeeec071c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:26:10 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-72aa8525-a391-4041-9451-33a92a60663a req-219118ca-b501-4cca-9595-e501062743e4 service nova] Lock "306054a8-4d0f-4913-b3b8-97aeeeec071c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:26:10 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-72aa8525-a391-4041-9451-33a92a60663a req-219118ca-b501-4cca-9595-e501062743e4 service nova] Lock "306054a8-4d0f-4913-b3b8-97aeeeec071c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:26:10 user nova-compute[75226]: DEBUG nova.compute.manager [req-72aa8525-a391-4041-9451-33a92a60663a req-219118ca-b501-4cca-9595-e501062743e4 service nova] [instance: 306054a8-4d0f-4913-b3b8-97aeeeec071c] No waiting events found dispatching network-vif-plugged-9c6d2999-f11a-4cab-828c-993cc52b996c {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:26:10 user nova-compute[75226]: WARNING nova.compute.manager [req-72aa8525-a391-4041-9451-33a92a60663a req-219118ca-b501-4cca-9595-e501062743e4 service nova] [instance: 306054a8-4d0f-4913-b3b8-97aeeeec071c] Received unexpected event network-vif-plugged-9c6d2999-f11a-4cab-828c-993cc52b996c for instance with vm_state shelved_offloaded and task_state spawning.
Nov 17 01:26:10 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:26:10 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Starting heal instance info cache {{(pid=75226) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 17 01:26:10 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "refresh_cache-f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:26:10 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquired lock "refresh_cache-f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:26:10 user nova-compute[75226]: DEBUG nova.network.neutron [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] [instance: f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c] Forcefully refreshing network info cache for instance {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 17 01:26:10 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:26:10 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:26:10 user nova-compute[75226]: DEBUG nova.network.neutron [req-7662fb7f-04b7-47da-9c6b-6e51b7d673b7 req-dcdf6337-8a70-45bc-8dd9-57d4919066df service nova] [instance: ee2187c9-8620-4fd2-ad8a-a054cd8393f3] Updated VIF entry in instance network info cache for port 1057ea4c-2ac4-40fa-8b2e-3b5888ea4d61. {{(pid=75226) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 01:26:10 user nova-compute[75226]: DEBUG nova.network.neutron [req-7662fb7f-04b7-47da-9c6b-6e51b7d673b7 req-dcdf6337-8a70-45bc-8dd9-57d4919066df service nova] [instance: ee2187c9-8620-4fd2-ad8a-a054cd8393f3] Updating instance_info_cache with network_info: [{"id": "1057ea4c-2ac4-40fa-8b2e-3b5888ea4d61", "address": "fa:16:3e:4a:f5:8f", "network": {"id": "3d8c3322-c78d-4d3a-b8c7-ba12241b4c65", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1996535656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c19f767dc7bb4024b3cbf1d8f5f8f2bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1057ea4c-2a", "ovs_interfaceid": "1057ea4c-2ac4-40fa-8b2e-3b5888ea4d61", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:26:11 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-7662fb7f-04b7-47da-9c6b-6e51b7d673b7 req-dcdf6337-8a70-45bc-8dd9-57d4919066df service nova] Releasing lock "refresh_cache-ee2187c9-8620-4fd2-ad8a-a054cd8393f3" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:26:11 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:26:11 user nova-compute[75226]: DEBUG nova.network.neutron [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] [instance: f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c] Updating instance_info_cache with network_info: [{"id": "ed40e788-7338-4ecd-8204-008d4601131b", "address": "fa:16:3e:69:68:ce", "network": {"id": "c93f11a7-52c6-4379-a1fb-9a002876c221", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-985502177-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "054575d3dc66452091173b4c604b8c96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped40e788-73", "ovs_interfaceid": "ed40e788-7338-4ecd-8204-008d4601131b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:26:11 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Releasing lock "refresh_cache-f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:26:11 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] [instance: f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c] Updated the network info_cache for instance {{(pid=75226) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 17 01:26:11 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:26:11 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:26:11 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:26:11 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75226) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 17 01:26:12 user nova-compute[75226]: DEBUG nova.compute.manager [req-eecf4efd-fc10-42fb-9e86-65475dbf4c90 req-2e2712e0-3f30-4623-a6b1-8a1c85409370 service nova] [instance: 306054a8-4d0f-4913-b3b8-97aeeeec071c] Received event network-vif-plugged-9c6d2999-f11a-4cab-828c-993cc52b996c {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:26:12 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-eecf4efd-fc10-42fb-9e86-65475dbf4c90 req-2e2712e0-3f30-4623-a6b1-8a1c85409370 service nova] Acquiring lock "306054a8-4d0f-4913-b3b8-97aeeeec071c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:26:12 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-eecf4efd-fc10-42fb-9e86-65475dbf4c90 req-2e2712e0-3f30-4623-a6b1-8a1c85409370 service nova] Lock "306054a8-4d0f-4913-b3b8-97aeeeec071c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:26:12 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-eecf4efd-fc10-42fb-9e86-65475dbf4c90 req-2e2712e0-3f30-4623-a6b1-8a1c85409370 service nova] Lock "306054a8-4d0f-4913-b3b8-97aeeeec071c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:26:12 user nova-compute[75226]: DEBUG nova.compute.manager [req-eecf4efd-fc10-42fb-9e86-65475dbf4c90 req-2e2712e0-3f30-4623-a6b1-8a1c85409370 service nova] [instance: 306054a8-4d0f-4913-b3b8-97aeeeec071c] No waiting events found dispatching network-vif-plugged-9c6d2999-f11a-4cab-828c-993cc52b996c {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:26:12 user nova-compute[75226]: WARNING nova.compute.manager [req-eecf4efd-fc10-42fb-9e86-65475dbf4c90 req-2e2712e0-3f30-4623-a6b1-8a1c85409370 service nova] [instance: 306054a8-4d0f-4913-b3b8-97aeeeec071c] Received unexpected event network-vif-plugged-9c6d2999-f11a-4cab-828c-993cc52b996c for instance with vm_state shelved_offloaded and task_state spawning.
Nov 17 01:26:12 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e60e2191-4135-4289-8be9-f9725d4441f7 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] [instance: 306054a8-4d0f-4913-b3b8-97aeeeec071c] Instance event wait completed in 0 seconds for  {{(pid=75226) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 17 01:26:12 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-e60e2191-4135-4289-8be9-f9725d4441f7 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] [instance: 306054a8-4d0f-4913-b3b8-97aeeeec071c] Guest created on hypervisor {{(pid=75226) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 17 01:26:12 user nova-compute[75226]: INFO nova.virt.libvirt.driver [-] [instance: 306054a8-4d0f-4913-b3b8-97aeeeec071c] Instance spawned successfully.
Nov 17 01:26:12 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:26:12 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e60e2191-4135-4289-8be9-f9725d4441f7 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] [instance: 306054a8-4d0f-4913-b3b8-97aeeeec071c] Checking state {{(pid=75226) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 01:26:13 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e60e2191-4135-4289-8be9-f9725d4441f7 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Lock "306054a8-4d0f-4913-b3b8-97aeeeec071c" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 19.317s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:26:13 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:26:17 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:26:18 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:26:22 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:26:23 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:26:27 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-18c6848e-589e-4b0f-b96c-9c73e865bfcf tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 2fbdd8af-f608-4d73-92d9-ae0586814c1b is timed out.
Nov 17 01:26:27 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-18c6848e-589e-4b0f-b96c-9c73e865bfcf tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Successfully detached device vdb from instance 2fbdd8af-f608-4d73-92d9-ae0586814c1b from the live domain config.
Nov 17 01:26:27 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18c6848e-589e-4b0f-b96c-9c73e865bfcf tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: 2fbdd8af-f608-4d73-92d9-ae0586814c1b] calling os-brick to detach iSCSI Volume {{(pid=75226) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 17 01:26:27 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c6848e-589e-4b0f-b96c-9c73e865bfcf tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc4cc36b490>, {'target_iqn': 'iqn.2010-10.org.openstack:1fd0b73a-0d42-4e3d-a4f0-a9936d9bd1d4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pBQMTVZW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:26:27 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-18c6848e-589e-4b0f-b96c-9c73e865bfcf tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:26:27 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-18c6848e-589e-4b0f-b96c-9c73e865bfcf tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:26:27 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-18c6848e-589e-4b0f-b96c-9c73e865bfcf tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:26:27 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:26:27 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:26:27 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:26:27 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e85ef7a-7c01-4914-af1d-c187f0fb764c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1fd0b73a-0d42-4e3d-a4f0-a9936d9bd1d4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:29701267-6547-48b4-befc-b18ec2ab5e2c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:26:27 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c6848e-589e-4b0f-b96c-9c73e865bfcf tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 17 01:26:27 user nova-compute[75226]: No targets found.
Nov 17 01:26:27 user nova-compute[75226]: iSNS:
Nov 17 01:26:27 user nova-compute[75226]: No targets found.
Nov 17 01:26:27 user nova-compute[75226]: STATIC:
Nov 17 01:26:27 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:1fd0b73a-0d42-4e3d-a4f0-a9936d9bd1d4
Nov 17 01:26:27 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:26:27 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:26:27 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8
Nov 17 01:26:27 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:26:27 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:26:27 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:29701267-6547-48b4-befc-b18ec2ab5e2c
Nov 17 01:26:27 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:26:27 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:26:27 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421
Nov 17 01:26:27 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:26:27 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:26:27 user nova-compute[75226]: FIRMWARE:
Nov 17 01:26:27 user nova-compute[75226]: No targets found.
Nov 17 01:26:27 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:26:27 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c6848e-589e-4b0f-b96c-9c73e865bfcf tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 17 01:26:27 user nova-compute[75226]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 17 01:26:27 user nova-compute[75226]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75226) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 17 01:26:27 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c6848e-589e-4b0f-b96c-9c73e865bfcf tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1fd0b73a-0d42-4e3d-a4f0-a9936d9bd1d4', 0)] {{(pid=75226) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 17 01:26:27 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:26:27 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:26:27 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[afd39d14-fb9a-46f5-9a63-6117df953b28]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1fd0b73a-0d42-4e3d-a4f0-a9936d9bd1d4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:29701267-6547-48b4-befc-b18ec2ab5e2c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:26:27 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:26:27 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:26:27 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8e1748a-5749-4d8b-8f93-c805a3db2b7c]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fd0b73a-0d42-4e3d-a4f0-a9936d9bd1d4 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29701267-6547-48b4-befc-b18ec2ab5e2c (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:26:27 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c6848e-589e-4b0f-b96c-9c73e865bfcf tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)
Nov 17 01:26:27 user nova-compute[75226]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fd0b73a-0d42-4e3d-a4f0-a9936d9bd1d4 (non-flash)
Nov 17 01:26:27 user nova-compute[75226]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421 (non-flash)
Nov 17 01:26:27 user nova-compute[75226]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29701267-6547-48b4-befc-b18ec2ab5e2c (non-flash)
Nov 17 01:26:27 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:26:27 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c6848e-589e-4b0f-b96c-9c73e865bfcf tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)
Nov 17 01:26:27 user nova-compute[75226]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fd0b73a-0d42-4e3d-a4f0-a9936d9bd1d4 (non-flash)
Nov 17 01:26:27 user nova-compute[75226]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421 (non-flash)
Nov 17 01:26:27 user nova-compute[75226]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29701267-6547-48b4-befc-b18ec2ab5e2c (non-flash)
Nov 17 01:26:27 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:26:27 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c6848e-589e-4b0f-b96c-9c73e865bfcf tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc4b43e2cb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1fd0b73a-0d42-4e3d-a4f0-a9936d9bd1d4'): ({'sdi'}, set())}) {{(pid=75226) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 17 01:26:27 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-18c6848e-589e-4b0f-b96c-9c73e865bfcf tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Removing single pathed devices sdi {{(pid=75226) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 17 01:26:27 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:26:27 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:26:27 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[6568b0e7-1ab7-4ba5-8178-e11365f2afe7]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:26:27 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:26:27 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:26:27 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c312762-2554-4f1f-bfff-d149c4dcb25f]: (4, ('ok\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:26:27 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-18c6848e-589e-4b0f-b96c-9c73e865bfcf tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Flushing IO for device /dev/sdi {{(pid=75226) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 17 01:26:27 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:26:27 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.013s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:26:27 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[12e56be8-01e8-4378-93f7-66476996108c]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:26:27 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-18c6848e-589e-4b0f-b96c-9c73e865bfcf tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=75226) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 17 01:26:27 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:26:27 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.045s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:26:27 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b4c8683-7369-4356-8d59-6911c8a299e2]: (4, ('1', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:26:27 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-18c6848e-589e-4b0f-b96c-9c73e865bfcf tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=75226) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 17 01:26:27 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-18c6848e-589e-4b0f-b96c-9c73e865bfcf tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] SCSI volumes sdi have been removed. {{(pid=75226) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 17 01:26:27 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c6848e-589e-4b0f-b96c-9c73e865bfcf tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1fd0b73a-0d42-4e3d-a4f0-a9936d9bd1d4')] {{(pid=75226) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 17 01:26:27 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fd0b73a-0d42-4e3d-a4f0-a9936d9bd1d4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:26:28 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fd0b73a-0d42-4e3d-a4f0-a9936d9bd1d4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:26:28 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[228a714e-5847-4015-840f-9974a1b5b3de]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:26:28 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c6848e-589e-4b0f-b96c-9c73e865bfcf tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:26:28 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fd0b73a-0d42-4e3d-a4f0-a9936d9bd1d4 -p 172.16.0.220:3260 --logout {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:26:28 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fd0b73a-0d42-4e3d-a4f0-a9936d9bd1d4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:26:28 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[4db2b179-5b5a-401f-9e79-6746ee692c2f]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:1fd0b73a-0d42-4e3d-a4f0-a9936d9bd1d4, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:1fd0b73a-0d42-4e3d-a4f0-a9936d9bd1d4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:26:28 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c6848e-589e-4b0f-b96c-9c73e865bfcf tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:1fd0b73a-0d42-4e3d-a4f0-a9936d9bd1d4, portal: 172.16.0.220,3260]
Nov 17 01:26:28 user nova-compute[75226]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:1fd0b73a-0d42-4e3d-a4f0-a9936d9bd1d4, portal: 172.16.0.220,3260] successful.
Nov 17 01:26:28 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:26:28 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fd0b73a-0d42-4e3d-a4f0-a9936d9bd1d4 -p 172.16.0.220:3260 --op delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:26:28 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fd0b73a-0d42-4e3d-a4f0-a9936d9bd1d4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:26:28 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d1e714e-9b2b-434f-b56a-44e3da14d87a]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:26:28 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c6848e-589e-4b0f-b96c-9c73e865bfcf tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:26:28 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-18c6848e-589e-4b0f-b96c-9c73e865bfcf tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.303s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:26:28 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c6848e-589e-4b0f-b96c-9c73e865bfcf tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] <== disconnect_volume: return (304ms) None {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:26:28 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18c6848e-589e-4b0f-b96c-9c73e865bfcf tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: 2fbdd8af-f608-4d73-92d9-ae0586814c1b] Disconnected iSCSI Volume {{(pid=75226) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 17 01:26:28 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:26:28 user nova-compute[75226]: DEBUG nova.objects.instance [None req-18c6848e-589e-4b0f-b96c-9c73e865bfcf tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Lazy-loading 'flavor' on Instance uuid 2fbdd8af-f608-4d73-92d9-ae0586814c1b {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:26:29 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-18c6848e-589e-4b0f-b96c-9c73e865bfcf tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Lock "2fbdd8af-f608-4d73-92d9-ae0586814c1b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.972s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:26:32 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:26:33 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:26:37 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:26:38 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:26:42 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:26:43 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:26:48 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:26:53 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:26:57 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-48966688-73bc-4a75-b45a-eea9bb4f0f67 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Acquiring lock "2fbdd8af-f608-4d73-92d9-ae0586814c1b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:26:57 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-48966688-73bc-4a75-b45a-eea9bb4f0f67 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Lock "2fbdd8af-f608-4d73-92d9-ae0586814c1b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:26:57 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-48966688-73bc-4a75-b45a-eea9bb4f0f67 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Acquiring lock "2fbdd8af-f608-4d73-92d9-ae0586814c1b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:26:57 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-48966688-73bc-4a75-b45a-eea9bb4f0f67 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Lock "2fbdd8af-f608-4d73-92d9-ae0586814c1b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:26:57 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-48966688-73bc-4a75-b45a-eea9bb4f0f67 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Lock "2fbdd8af-f608-4d73-92d9-ae0586814c1b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:26:57 user nova-compute[75226]: INFO nova.compute.manager [None req-48966688-73bc-4a75-b45a-eea9bb4f0f67 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: 2fbdd8af-f608-4d73-92d9-ae0586814c1b] Terminating instance
Nov 17 01:26:57 user nova-compute[75226]: DEBUG nova.compute.manager [None req-48966688-73bc-4a75-b45a-eea9bb4f0f67 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: 2fbdd8af-f608-4d73-92d9-ae0586814c1b] Start destroying the instance on the hypervisor. {{(pid=75226) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 17 01:26:57 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:26:57 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:26:57 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:26:57 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:26:57 user nova-compute[75226]: DEBUG nova.compute.manager [req-7e4c666a-df85-45bf-8709-b6e0975b6fe2 req-681c8421-34b4-44b5-be51-e2cc866ff128 service nova] [instance: 2fbdd8af-f608-4d73-92d9-ae0586814c1b] Received event network-vif-unplugged-4316e1ea-ca57-46b7-b415-7af7d3997c2c {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:26:57 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-7e4c666a-df85-45bf-8709-b6e0975b6fe2 req-681c8421-34b4-44b5-be51-e2cc866ff128 service nova] Acquiring lock "2fbdd8af-f608-4d73-92d9-ae0586814c1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:26:57 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-7e4c666a-df85-45bf-8709-b6e0975b6fe2 req-681c8421-34b4-44b5-be51-e2cc866ff128 service nova] Lock "2fbdd8af-f608-4d73-92d9-ae0586814c1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:26:57 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-7e4c666a-df85-45bf-8709-b6e0975b6fe2 req-681c8421-34b4-44b5-be51-e2cc866ff128 service nova] Lock "2fbdd8af-f608-4d73-92d9-ae0586814c1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:26:57 user nova-compute[75226]: DEBUG nova.compute.manager [req-7e4c666a-df85-45bf-8709-b6e0975b6fe2 req-681c8421-34b4-44b5-be51-e2cc866ff128 service nova] [instance: 2fbdd8af-f608-4d73-92d9-ae0586814c1b] No waiting events found dispatching network-vif-unplugged-4316e1ea-ca57-46b7-b415-7af7d3997c2c {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:26:57 user nova-compute[75226]: DEBUG nova.compute.manager [req-7e4c666a-df85-45bf-8709-b6e0975b6fe2 req-681c8421-34b4-44b5-be51-e2cc866ff128 service nova] [instance: 2fbdd8af-f608-4d73-92d9-ae0586814c1b] Received event network-vif-unplugged-4316e1ea-ca57-46b7-b415-7af7d3997c2c for instance with task_state deleting. {{(pid=75226) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 17 01:26:58 user nova-compute[75226]: INFO nova.virt.libvirt.driver [-] [instance: 2fbdd8af-f608-4d73-92d9-ae0586814c1b] Instance destroyed successfully.
Nov 17 01:26:58 user nova-compute[75226]: DEBUG nova.objects.instance [None req-48966688-73bc-4a75-b45a-eea9bb4f0f67 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Lazy-loading 'resources' on Instance uuid 2fbdd8af-f608-4d73-92d9-ae0586814c1b {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:26:58 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-48966688-73bc-4a75-b45a-eea9bb4f0f67 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:21:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-85385458',display_name='tempest-AttachVolumeNegativeTest-server-85385458',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-85385458',id=15,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO46rXGsJCsUKsG3L7Os3VOXlmaB5wyNEisbmxrfpssXGrAoRL9/uQPOgg8odupEi8Teu8yo5I2pKiJ22pWTE11MHyiRwbAlyRujmIJ4NnYJnG02tDdnLQIMxdAi4teuoA==',key_name='tempest-keypair-1691716024',keypairs=<?>,launch_index=0,launched_at=2023-11-17T01:21:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e38777e8baf745e79f31190da97406a0',ramdisk_id='',reservation_id='r-8backq3o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-940905741',owner_user_name='tempest-AttachVolumeNegativeTest-940905741-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T01:21:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='642db538240b4ca1a367cf4ee9714f66',uuid=2fbdd8af-f608-4d73-92d9-ae0586814c1b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4316e1ea-ca57-46b7-b415-7af7d3997c2c", "address": "fa:16:3e:03:ba:fb", "network": {"id": "57d0e7ee-0b11-4e00-86f9-bb4a3c25c674", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1357446034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e38777e8baf745e79f31190da97406a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4316e1ea-ca", "ovs_interfaceid": "4316e1ea-ca57-46b7-b415-7af7d3997c2c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 17 01:26:58 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-48966688-73bc-4a75-b45a-eea9bb4f0f67 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Converting VIF {"id": "4316e1ea-ca57-46b7-b415-7af7d3997c2c", "address": "fa:16:3e:03:ba:fb", "network": {"id": "57d0e7ee-0b11-4e00-86f9-bb4a3c25c674", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1357446034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e38777e8baf745e79f31190da97406a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4316e1ea-ca", "ovs_interfaceid": "4316e1ea-ca57-46b7-b415-7af7d3997c2c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:26:58 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-48966688-73bc-4a75-b45a-eea9bb4f0f67 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:03:ba:fb,bridge_name='br-int',has_traffic_filtering=True,id=4316e1ea-ca57-46b7-b415-7af7d3997c2c,network=Network(57d0e7ee-0b11-4e00-86f9-bb4a3c25c674),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4316e1ea-ca') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:26:58 user nova-compute[75226]: DEBUG os_vif [None req-48966688-73bc-4a75-b45a-eea9bb4f0f67 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:03:ba:fb,bridge_name='br-int',has_traffic_filtering=True,id=4316e1ea-ca57-46b7-b415-7af7d3997c2c,network=Network(57d0e7ee-0b11-4e00-86f9-bb4a3c25c674),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4316e1ea-ca') {{(pid=75226) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 17 01:26:58 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:26:58 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4316e1ea-ca, bridge=br-int, if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:26:58 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:26:58 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:26:58 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:26:58 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dbe3d745-7b29-4be5-a480-c8f8c036faeb) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:26:58 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:26:58 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:26:58 user nova-compute[75226]: INFO os_vif [None req-48966688-73bc-4a75-b45a-eea9bb4f0f67 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:03:ba:fb,bridge_name='br-int',has_traffic_filtering=True,id=4316e1ea-ca57-46b7-b415-7af7d3997c2c,network=Network(57d0e7ee-0b11-4e00-86f9-bb4a3c25c674),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4316e1ea-ca')
Nov 17 01:26:58 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-48966688-73bc-4a75-b45a-eea9bb4f0f67 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: 2fbdd8af-f608-4d73-92d9-ae0586814c1b] Deleting instance files /opt/stack/data/nova/instances/2fbdd8af-f608-4d73-92d9-ae0586814c1b_del
Nov 17 01:26:58 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-48966688-73bc-4a75-b45a-eea9bb4f0f67 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: 2fbdd8af-f608-4d73-92d9-ae0586814c1b] Deletion of /opt/stack/data/nova/instances/2fbdd8af-f608-4d73-92d9-ae0586814c1b_del complete
Nov 17 01:26:58 user nova-compute[75226]: INFO nova.compute.manager [None req-48966688-73bc-4a75-b45a-eea9bb4f0f67 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: 2fbdd8af-f608-4d73-92d9-ae0586814c1b] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 17 01:26:58 user nova-compute[75226]: DEBUG oslo.service.loopingcall [None req-48966688-73bc-4a75-b45a-eea9bb4f0f67 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75226) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 17 01:26:58 user nova-compute[75226]: DEBUG nova.compute.manager [-] [instance: 2fbdd8af-f608-4d73-92d9-ae0586814c1b] Deallocating network for instance {{(pid=75226) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 17 01:26:58 user nova-compute[75226]: DEBUG nova.network.neutron [-] [instance: 2fbdd8af-f608-4d73-92d9-ae0586814c1b] deallocate_for_instance() {{(pid=75226) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 17 01:26:58 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:26:58 user nova-compute[75226]: DEBUG nova.network.neutron [-] [instance: 2fbdd8af-f608-4d73-92d9-ae0586814c1b] Updating instance_info_cache with network_info: [] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:26:58 user nova-compute[75226]: INFO nova.compute.manager [-] [instance: 2fbdd8af-f608-4d73-92d9-ae0586814c1b] Took 0.70 seconds to deallocate network for instance.
Nov 17 01:26:58 user nova-compute[75226]: DEBUG nova.compute.manager [req-c40a032a-e1a8-41ad-ac27-fe7a36085572 req-91dcf585-356b-4225-a59b-11496776ee60 service nova] [instance: 2fbdd8af-f608-4d73-92d9-ae0586814c1b] Received event network-vif-deleted-4316e1ea-ca57-46b7-b415-7af7d3997c2c {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:26:59 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-48966688-73bc-4a75-b45a-eea9bb4f0f67 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:26:59 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-48966688-73bc-4a75-b45a-eea9bb4f0f67 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:26:59 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-48966688-73bc-4a75-b45a-eea9bb4f0f67 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:26:59 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-17d77dac-53dc-41b1-a054-ea8890eda08f tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Acquiring lock "f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:26:59 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-17d77dac-53dc-41b1-a054-ea8890eda08f tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Lock "f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:26:59 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-48966688-73bc-4a75-b45a-eea9bb4f0f67 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:26:59 user nova-compute[75226]: INFO nova.compute.manager [None req-17d77dac-53dc-41b1-a054-ea8890eda08f tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] [instance: f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c] Detaching volume dd06256f-5f5b-4cf6-962d-f77749280421
Nov 17 01:26:59 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-48966688-73bc-4a75-b45a-eea9bb4f0f67 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.380s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:26:59 user nova-compute[75226]: INFO nova.scheduler.client.report [None req-48966688-73bc-4a75-b45a-eea9bb4f0f67 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Deleted allocations for instance 2fbdd8af-f608-4d73-92d9-ae0586814c1b
Nov 17 01:26:59 user nova-compute[75226]: INFO nova.virt.block_device [None req-17d77dac-53dc-41b1-a054-ea8890eda08f tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] [instance: f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c] Attempting to driver detach volume dd06256f-5f5b-4cf6-962d-f77749280421 from mountpoint /dev/vdb
Nov 17 01:26:59 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-17d77dac-53dc-41b1-a054-ea8890eda08f tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Attempting to detach device vdb from instance f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c from the persistent domain config. {{(pid=75226) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 17 01:26:59 user nova-compute[75226]: DEBUG nova.virt.libvirt.guest [None req-17d77dac-53dc-41b1-a054-ea8890eda08f tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] detach device xml: <disk type="block" device="disk">
Nov 17 01:26:59 user nova-compute[75226]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 01:26:59 user nova-compute[75226]:   <source dev="/dev/sdd"/>
Nov 17 01:26:59 user nova-compute[75226]:   <target dev="vdb" bus="virtio"/>
Nov 17 01:26:59 user nova-compute[75226]:   <serial>dd06256f-5f5b-4cf6-962d-f77749280421</serial>
Nov 17 01:26:59 user nova-compute[75226]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 17 01:26:59 user nova-compute[75226]: </disk>
Nov 17 01:26:59 user nova-compute[75226]:  {{(pid=75226) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 17 01:26:59 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-17d77dac-53dc-41b1-a054-ea8890eda08f tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Successfully detached device vdb from instance f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c from the persistent domain config.
Nov 17 01:26:59 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-17d77dac-53dc-41b1-a054-ea8890eda08f tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c from the live domain config. {{(pid=75226) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 17 01:26:59 user nova-compute[75226]: DEBUG nova.virt.libvirt.guest [None req-17d77dac-53dc-41b1-a054-ea8890eda08f tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] detach device xml: <disk type="block" device="disk">
Nov 17 01:26:59 user nova-compute[75226]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 01:26:59 user nova-compute[75226]:   <source dev="/dev/sdd"/>
Nov 17 01:26:59 user nova-compute[75226]:   <target dev="vdb" bus="virtio"/>
Nov 17 01:26:59 user nova-compute[75226]:   <serial>dd06256f-5f5b-4cf6-962d-f77749280421</serial>
Nov 17 01:26:59 user nova-compute[75226]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 17 01:26:59 user nova-compute[75226]: </disk>
Nov 17 01:26:59 user nova-compute[75226]:  {{(pid=75226) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 17 01:26:59 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-48966688-73bc-4a75-b45a-eea9bb4f0f67 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Lock "2fbdd8af-f608-4d73-92d9-ae0586814c1b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.153s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:26:59 user nova-compute[75226]: DEBUG nova.compute.manager [req-27f84e16-0a10-4e0f-9225-8861fc26276e req-54bf9881-f1a2-4984-b303-52620f9d3884 service nova] [instance: 2fbdd8af-f608-4d73-92d9-ae0586814c1b] Received event network-vif-plugged-4316e1ea-ca57-46b7-b415-7af7d3997c2c {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:26:59 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-27f84e16-0a10-4e0f-9225-8861fc26276e req-54bf9881-f1a2-4984-b303-52620f9d3884 service nova] Acquiring lock "2fbdd8af-f608-4d73-92d9-ae0586814c1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:26:59 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-27f84e16-0a10-4e0f-9225-8861fc26276e req-54bf9881-f1a2-4984-b303-52620f9d3884 service nova] Lock "2fbdd8af-f608-4d73-92d9-ae0586814c1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:26:59 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-27f84e16-0a10-4e0f-9225-8861fc26276e req-54bf9881-f1a2-4984-b303-52620f9d3884 service nova] Lock "2fbdd8af-f608-4d73-92d9-ae0586814c1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:26:59 user nova-compute[75226]: DEBUG nova.compute.manager [req-27f84e16-0a10-4e0f-9225-8861fc26276e req-54bf9881-f1a2-4984-b303-52620f9d3884 service nova] [instance: 2fbdd8af-f608-4d73-92d9-ae0586814c1b] No waiting events found dispatching network-vif-plugged-4316e1ea-ca57-46b7-b415-7af7d3997c2c {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:26:59 user nova-compute[75226]: WARNING nova.compute.manager [req-27f84e16-0a10-4e0f-9225-8861fc26276e req-54bf9881-f1a2-4984-b303-52620f9d3884 service nova] [instance: 2fbdd8af-f608-4d73-92d9-ae0586814c1b] Received unexpected event network-vif-plugged-4316e1ea-ca57-46b7-b415-7af7d3997c2c for instance with vm_state deleted and task_state None.
Nov 17 01:26:59 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-17d77dac-53dc-41b1-a054-ea8890eda08f tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c {{(pid=75226) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 17 01:27:00 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:27:01 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:27:01 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:27:02 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:27:02 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:27:02 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:27:02 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:27:02 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:27:02 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75226) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 17 01:27:03 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/306054a8-4d0f-4913-b3b8-97aeeeec071c/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:27:03 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:27:03 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/306054a8-4d0f-4913-b3b8-97aeeeec071c/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:27:03 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/306054a8-4d0f-4913-b3b8-97aeeeec071c/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:27:03 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/306054a8-4d0f-4913-b3b8-97aeeeec071c/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:27:03 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] skipping disk /dev/sdb (vdc) as it is a volume {{(pid=75226) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 01:27:03 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee2187c9-8620-4fd2-ad8a-a054cd8393f3/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:27:03 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee2187c9-8620-4fd2-ad8a-a054cd8393f3/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:27:03 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee2187c9-8620-4fd2-ad8a-a054cd8393f3/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:27:03 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee2187c9-8620-4fd2-ad8a-a054cd8393f3/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:27:03 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38062487-67ca-4962-974f-81456aebe97b/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:27:04 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38062487-67ca-4962-974f-81456aebe97b/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:27:04 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38062487-67ca-4962-974f-81456aebe97b/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:27:04 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38062487-67ca-4962-974f-81456aebe97b/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:27:04 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa84e575-bdad-45b9-80ce-86b1c2826fb0/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:27:04 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa84e575-bdad-45b9-80ce-86b1c2826fb0/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:27:04 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa84e575-bdad-45b9-80ce-86b1c2826fb0/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:27:04 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa84e575-bdad-45b9-80ce-86b1c2826fb0/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:27:04 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4050d898-f2b8-46c2-86e3-702ceb41a701/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:27:04 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4050d898-f2b8-46c2-86e3-702ceb41a701/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:27:04 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4050d898-f2b8-46c2-86e3-702ceb41a701/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:27:05 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4050d898-f2b8-46c2-86e3-702ceb41a701/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:27:05 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:27:05 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:27:05 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:27:05 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:27:05 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dcdd769-bbfe-48e8-a876-8b2072b7baeb/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:27:05 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dcdd769-bbfe-48e8-a876-8b2072b7baeb/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:27:05 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dcdd769-bbfe-48e8-a876-8b2072b7baeb/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:27:05 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dcdd769-bbfe-48e8-a876-8b2072b7baeb/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:27:05 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ea5a14b-c330-4a2b-926e-60e1b30f5981/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:27:05 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ea5a14b-c330-4a2b-926e-60e1b30f5981/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:27:05 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ea5a14b-c330-4a2b-926e-60e1b30f5981/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:27:06 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ea5a14b-c330-4a2b-926e-60e1b30f5981/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:27:06 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6555d72-6094-4ea9-b071-a3d3c8a300a9/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:27:06 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6555d72-6094-4ea9-b071-a3d3c8a300a9/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:27:06 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6555d72-6094-4ea9-b071-a3d3c8a300a9/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:27:06 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6555d72-6094-4ea9-b071-a3d3c8a300a9/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:27:06 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75226) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 01:27:06 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c280142-8901-4f83-bde4-baaa097e05b0/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:27:06 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c280142-8901-4f83-bde4-baaa097e05b0/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:27:06 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c280142-8901-4f83-bde4-baaa097e05b0/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:27:06 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c280142-8901-4f83-bde4-baaa097e05b0/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:27:07 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:27:07 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:27:07 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Hypervisor/Node resource view: name=user free_ram=7442MB free_disk=25.02926254272461GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75226) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 17 01:27:07 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:27:07 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:27:07 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance aa84e575-bdad-45b9-80ce-86b1c2826fb0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:27:07 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 6b7e9611-be35-4e51-b886-91a2fac0a653 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:27:07 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:27:07 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 38062487-67ca-4962-974f-81456aebe97b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:27:07 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance ee2187c9-8620-4fd2-ad8a-a054cd8393f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:27:07 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 4050d898-f2b8-46c2-86e3-702ceb41a701 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:27:07 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 4dcdd769-bbfe-48e8-a876-8b2072b7baeb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:27:07 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 2ea5a14b-c330-4a2b-926e-60e1b30f5981 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:27:07 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance d6555d72-6094-4ea9-b071-a3d3c8a300a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:27:07 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 5c280142-8901-4f83-bde4-baaa097e05b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:27:07 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 306054a8-4d0f-4913-b3b8-97aeeeec071c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:27:07 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75226) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 17 01:27:07 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75226) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 17 01:27:07 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:27:07 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:27:07 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Compute_service record updated for user:user {{(pid=75226) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 17 01:27:07 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.483s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:27:08 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:27:08 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:27:08 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:27:08 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:27:08 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:27:08 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:27:08 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Starting heal instance info cache {{(pid=75226) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 17 01:27:09 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "refresh_cache-38062487-67ca-4962-974f-81456aebe97b" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:27:09 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquired lock "refresh_cache-38062487-67ca-4962-974f-81456aebe97b" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:27:09 user nova-compute[75226]: DEBUG nova.network.neutron [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] [instance: 38062487-67ca-4962-974f-81456aebe97b] Forcefully refreshing network info cache for instance {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 17 01:27:09 user nova-compute[75226]: DEBUG nova.network.neutron [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] [instance: 38062487-67ca-4962-974f-81456aebe97b] Updating instance_info_cache with network_info: [{"id": "b4bb80f3-212b-41bf-94a3-442865a852c7", "address": "fa:16:3e:ef:fd:97", "network": {"id": "9f39d3e5-b106-4bd9-b8ba-0f326e89c481", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-675861281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9042fe4ecc245dd97553f6e942c3e05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4bb80f3-21", "ovs_interfaceid": "b4bb80f3-212b-41bf-94a3-442865a852c7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:27:09 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Releasing lock "refresh_cache-38062487-67ca-4962-974f-81456aebe97b" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:27:09 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] [instance: 38062487-67ca-4962-974f-81456aebe97b] Updated the network info_cache for instance {{(pid=75226) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 17 01:27:09 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:27:09 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75226) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 17 01:27:13 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:27:16 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-195ac3ff-6306-46ff-a510-53d4630952e4 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] Acquiring lock "fb140c60-d5e8-4849-8621-95e913becc45" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:27:16 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-195ac3ff-6306-46ff-a510-53d4630952e4 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] Lock "fb140c60-d5e8-4849-8621-95e913becc45" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:27:16 user nova-compute[75226]: DEBUG nova.compute.manager [None req-195ac3ff-6306-46ff-a510-53d4630952e4 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] [instance: fb140c60-d5e8-4849-8621-95e913becc45] Starting instance... {{(pid=75226) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 17 01:27:16 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-195ac3ff-6306-46ff-a510-53d4630952e4 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:27:16 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-195ac3ff-6306-46ff-a510-53d4630952e4 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:27:16 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-195ac3ff-6306-46ff-a510-53d4630952e4 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75226) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 17 01:27:16 user nova-compute[75226]: INFO nova.compute.claims [None req-195ac3ff-6306-46ff-a510-53d4630952e4 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] [instance: fb140c60-d5e8-4849-8621-95e913becc45] Claim successful on node user
Nov 17 01:27:17 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-195ac3ff-6306-46ff-a510-53d4630952e4 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:27:17 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-195ac3ff-6306-46ff-a510-53d4630952e4 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:27:17 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-195ac3ff-6306-46ff-a510-53d4630952e4 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.442s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:27:17 user nova-compute[75226]: DEBUG nova.compute.manager [None req-195ac3ff-6306-46ff-a510-53d4630952e4 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] [instance: fb140c60-d5e8-4849-8621-95e913becc45] Start building networks asynchronously for instance. {{(pid=75226) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 17 01:27:17 user nova-compute[75226]: DEBUG nova.compute.manager [None req-195ac3ff-6306-46ff-a510-53d4630952e4 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] [instance: fb140c60-d5e8-4849-8621-95e913becc45] Allocating IP information in the background. {{(pid=75226) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 17 01:27:17 user nova-compute[75226]: DEBUG nova.network.neutron [None req-195ac3ff-6306-46ff-a510-53d4630952e4 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] [instance: fb140c60-d5e8-4849-8621-95e913becc45] allocate_for_instance() {{(pid=75226) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 17 01:27:17 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-195ac3ff-6306-46ff-a510-53d4630952e4 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] [instance: fb140c60-d5e8-4849-8621-95e913becc45] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 17 01:27:17 user nova-compute[75226]: DEBUG nova.compute.manager [None req-195ac3ff-6306-46ff-a510-53d4630952e4 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] [instance: fb140c60-d5e8-4849-8621-95e913becc45] Start building block device mappings for instance. {{(pid=75226) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 17 01:27:17 user nova-compute[75226]: DEBUG nova.policy [None req-195ac3ff-6306-46ff-a510-53d4630952e4 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '202fa7cd113b42f2b95bc2314255392e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd69aa270fc5b4749a65ea70c7ef30958', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75226) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 17 01:27:17 user nova-compute[75226]: DEBUG nova.compute.manager [None req-195ac3ff-6306-46ff-a510-53d4630952e4 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] [instance: fb140c60-d5e8-4849-8621-95e913becc45] Start spawning the instance on the hypervisor. {{(pid=75226) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 17 01:27:17 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-195ac3ff-6306-46ff-a510-53d4630952e4 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] [instance: fb140c60-d5e8-4849-8621-95e913becc45] Creating instance directory {{(pid=75226) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 17 01:27:17 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-195ac3ff-6306-46ff-a510-53d4630952e4 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] [instance: fb140c60-d5e8-4849-8621-95e913becc45] Creating image(s)
Nov 17 01:27:17 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-195ac3ff-6306-46ff-a510-53d4630952e4 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] Acquiring lock "/opt/stack/data/nova/instances/fb140c60-d5e8-4849-8621-95e913becc45/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:27:17 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-195ac3ff-6306-46ff-a510-53d4630952e4 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] Lock "/opt/stack/data/nova/instances/fb140c60-d5e8-4849-8621-95e913becc45/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:27:17 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-195ac3ff-6306-46ff-a510-53d4630952e4 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] Lock "/opt/stack/data/nova/instances/fb140c60-d5e8-4849-8621-95e913becc45/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:27:17 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-195ac3ff-6306-46ff-a510-53d4630952e4 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:27:17 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-195ac3ff-6306-46ff-a510-53d4630952e4 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json" returned: 0 in 0.175s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:27:17 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-195ac3ff-6306-46ff-a510-53d4630952e4 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] Acquiring lock "a8a62c2546af3a2036b853250c5ac64d4c6b4371" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:27:17 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-195ac3ff-6306-46ff-a510-53d4630952e4 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] Lock "a8a62c2546af3a2036b853250c5ac64d4c6b4371" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:27:17 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-195ac3ff-6306-46ff-a510-53d4630952e4 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:27:18 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-195ac3ff-6306-46ff-a510-53d4630952e4 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json" returned: 0 in 0.172s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:27:18 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-195ac3ff-6306-46ff-a510-53d4630952e4 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371,backing_fmt=raw /opt/stack/data/nova/instances/fb140c60-d5e8-4849-8621-95e913becc45/disk 1073741824 {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:27:18 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-195ac3ff-6306-46ff-a510-53d4630952e4 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371,backing_fmt=raw /opt/stack/data/nova/instances/fb140c60-d5e8-4849-8621-95e913becc45/disk 1073741824" returned: 0 in 0.050s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:27:18 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-195ac3ff-6306-46ff-a510-53d4630952e4 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] Lock "a8a62c2546af3a2036b853250c5ac64d4c6b4371" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.230s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:27:18 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-195ac3ff-6306-46ff-a510-53d4630952e4 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:27:18 user nova-compute[75226]: DEBUG nova.network.neutron [None req-195ac3ff-6306-46ff-a510-53d4630952e4 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] [instance: fb140c60-d5e8-4849-8621-95e913becc45] Successfully created port: f0504d3e-b4f2-4f78-a50f-7f0736cf74fe {{(pid=75226) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 17 01:27:18 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:27:18 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-195ac3ff-6306-46ff-a510-53d4630952e4 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json" returned: 0 in 0.169s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:27:18 user nova-compute[75226]: DEBUG nova.virt.disk.api [None req-195ac3ff-6306-46ff-a510-53d4630952e4 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fb140c60-d5e8-4849-8621-95e913becc45/disk. size=1073741824 {{(pid=75226) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 17 01:27:18 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-195ac3ff-6306-46ff-a510-53d4630952e4 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb140c60-d5e8-4849-8621-95e913becc45/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:27:18 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-195ac3ff-6306-46ff-a510-53d4630952e4 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb140c60-d5e8-4849-8621-95e913becc45/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:27:18 user nova-compute[75226]: DEBUG nova.virt.disk.api [None req-195ac3ff-6306-46ff-a510-53d4630952e4 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] Cannot resize image /opt/stack/data/nova/instances/fb140c60-d5e8-4849-8621-95e913becc45/disk to a smaller size. {{(pid=75226) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 17 01:27:18 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-195ac3ff-6306-46ff-a510-53d4630952e4 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] [instance: fb140c60-d5e8-4849-8621-95e913becc45] Created local disks {{(pid=75226) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 17 01:27:18 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-195ac3ff-6306-46ff-a510-53d4630952e4 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] [instance: fb140c60-d5e8-4849-8621-95e913becc45] Ensure instance console log exists: /opt/stack/data/nova/instances/fb140c60-d5e8-4849-8621-95e913becc45/console.log {{(pid=75226) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 17 01:27:18 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-195ac3ff-6306-46ff-a510-53d4630952e4 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:27:18 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-195ac3ff-6306-46ff-a510-53d4630952e4 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:27:18 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-195ac3ff-6306-46ff-a510-53d4630952e4 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:27:18 user nova-compute[75226]: DEBUG nova.network.neutron [None req-195ac3ff-6306-46ff-a510-53d4630952e4 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] [instance: fb140c60-d5e8-4849-8621-95e913becc45] Successfully updated port: f0504d3e-b4f2-4f78-a50f-7f0736cf74fe {{(pid=75226) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 17 01:27:18 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-195ac3ff-6306-46ff-a510-53d4630952e4 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] Acquiring lock "refresh_cache-fb140c60-d5e8-4849-8621-95e913becc45" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:27:18 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-195ac3ff-6306-46ff-a510-53d4630952e4 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] Acquired lock "refresh_cache-fb140c60-d5e8-4849-8621-95e913becc45" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:27:18 user nova-compute[75226]: DEBUG nova.network.neutron [None req-195ac3ff-6306-46ff-a510-53d4630952e4 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] [instance: fb140c60-d5e8-4849-8621-95e913becc45] Building network info cache for instance {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 01:27:18 user nova-compute[75226]: DEBUG nova.network.neutron [None req-195ac3ff-6306-46ff-a510-53d4630952e4 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] [instance: fb140c60-d5e8-4849-8621-95e913becc45] Instance cache missing network info. {{(pid=75226) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 17 01:27:18 user nova-compute[75226]: DEBUG nova.compute.manager [req-a57d9c37-1038-47f9-9bd2-b1a828d0dc59 req-56a5d9ce-6704-4af4-88ef-5d291f29174c service nova] [instance: fb140c60-d5e8-4849-8621-95e913becc45] Received event network-changed-f0504d3e-b4f2-4f78-a50f-7f0736cf74fe {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:27:18 user nova-compute[75226]: DEBUG nova.compute.manager [req-a57d9c37-1038-47f9-9bd2-b1a828d0dc59 req-56a5d9ce-6704-4af4-88ef-5d291f29174c service nova] [instance: fb140c60-d5e8-4849-8621-95e913becc45] Refreshing instance network info cache due to event network-changed-f0504d3e-b4f2-4f78-a50f-7f0736cf74fe. {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 01:27:18 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-a57d9c37-1038-47f9-9bd2-b1a828d0dc59 req-56a5d9ce-6704-4af4-88ef-5d291f29174c service nova] Acquiring lock "refresh_cache-fb140c60-d5e8-4849-8621-95e913becc45" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:27:18 user nova-compute[75226]: DEBUG nova.network.neutron [None req-195ac3ff-6306-46ff-a510-53d4630952e4 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] [instance: fb140c60-d5e8-4849-8621-95e913becc45] Updating instance_info_cache with network_info: [{"id": "f0504d3e-b4f2-4f78-a50f-7f0736cf74fe", "address": "fa:16:3e:ed:bc:92", "network": {"id": "ded167af-70f6-45b1-beb4-2eca06a78205", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2145123005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d69aa270fc5b4749a65ea70c7ef30958", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0504d3e-b4", "ovs_interfaceid": "f0504d3e-b4f2-4f78-a50f-7f0736cf74fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:27:18 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-195ac3ff-6306-46ff-a510-53d4630952e4 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] Releasing lock "refresh_cache-fb140c60-d5e8-4849-8621-95e913becc45" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:27:18 user nova-compute[75226]: DEBUG nova.compute.manager [None req-195ac3ff-6306-46ff-a510-53d4630952e4 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] [instance: fb140c60-d5e8-4849-8621-95e913becc45] Instance network_info: |[{"id": "f0504d3e-b4f2-4f78-a50f-7f0736cf74fe", "address": "fa:16:3e:ed:bc:92", "network": {"id": "ded167af-70f6-45b1-beb4-2eca06a78205", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2145123005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d69aa270fc5b4749a65ea70c7ef30958", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0504d3e-b4", "ovs_interfaceid": "f0504d3e-b4f2-4f78-a50f-7f0736cf74fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75226) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 17 01:27:18 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-a57d9c37-1038-47f9-9bd2-b1a828d0dc59 req-56a5d9ce-6704-4af4-88ef-5d291f29174c service nova] Acquired lock "refresh_cache-fb140c60-d5e8-4849-8621-95e913becc45" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:27:18 user nova-compute[75226]: DEBUG nova.network.neutron [req-a57d9c37-1038-47f9-9bd2-b1a828d0dc59 req-56a5d9ce-6704-4af4-88ef-5d291f29174c service nova] [instance: fb140c60-d5e8-4849-8621-95e913becc45] Refreshing network info cache for port f0504d3e-b4f2-4f78-a50f-7f0736cf74fe {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 01:27:18 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-195ac3ff-6306-46ff-a510-53d4630952e4 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] [instance: fb140c60-d5e8-4849-8621-95e913becc45] Start _get_guest_xml network_info=[{"id": "f0504d3e-b4f2-4f78-a50f-7f0736cf74fe", "address": "fa:16:3e:ed:bc:92", "network": {"id": "ded167af-70f6-45b1-beb4-2eca06a78205", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2145123005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d69aa270fc5b4749a65ea70c7ef30958", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0504d3e-b4", "ovs_interfaceid": "f0504d3e-b4f2-4f78-a50f-7f0736cf74fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T01:13:22Z,direct_url=<?>,disk_format='qcow2',id=0b369aea-6f3f-4690-9f01-229b90ab6310,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4e110cbf9a84362a6864a7732c435a1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T01:13:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '0b369aea-6f3f-4690-9f01-229b90ab6310'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75226) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 17 01:27:18 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-195ac3ff-6306-46ff-a510-53d4630952e4 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:27:18 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-195ac3ff-6306-46ff-a510-53d4630952e4 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:27:19 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-195ac3ff-6306-46ff-a510-53d4630952e4 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75226) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 17 01:27:19 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-195ac3ff-6306-46ff-a510-53d4630952e4 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] CPU controller missing on host. {{(pid=75226) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 17 01:27:19 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-195ac3ff-6306-46ff-a510-53d4630952e4 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75226) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 17 01:27:19 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-195ac3ff-6306-46ff-a510-53d4630952e4 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] CPU controller found on host. {{(pid=75226) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 17 01:27:19 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-195ac3ff-6306-46ff-a510-53d4630952e4 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75226) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 17 01:27:19 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-195ac3ff-6306-46ff-a510-53d4630952e4 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-17T01:13:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T01:13:22Z,direct_url=<?>,disk_format='qcow2',id=0b369aea-6f3f-4690-9f01-229b90ab6310,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4e110cbf9a84362a6864a7732c435a1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T01:13:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 17 01:27:19 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-195ac3ff-6306-46ff-a510-53d4630952e4 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] Flavor limits 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 17 01:27:19 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-195ac3ff-6306-46ff-a510-53d4630952e4 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] Image limits 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 17 01:27:19 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-195ac3ff-6306-46ff-a510-53d4630952e4 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] Flavor pref 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 17 01:27:19 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-195ac3ff-6306-46ff-a510-53d4630952e4 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] Image pref 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 17 01:27:19 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-195ac3ff-6306-46ff-a510-53d4630952e4 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 17 01:27:19 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-195ac3ff-6306-46ff-a510-53d4630952e4 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 17 01:27:19 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-195ac3ff-6306-46ff-a510-53d4630952e4 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75226) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 17 01:27:19 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-195ac3ff-6306-46ff-a510-53d4630952e4 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] Got 1 possible topologies {{(pid=75226) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 17 01:27:19 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-195ac3ff-6306-46ff-a510-53d4630952e4 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 17 01:27:19 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-195ac3ff-6306-46ff-a510-53d4630952e4 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 17 01:27:19 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-195ac3ff-6306-46ff-a510-53d4630952e4 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:27:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-978991004',display_name='tempest-ServersNegativeTestJSON-server-978991004',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-978991004',id=27,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d69aa270fc5b4749a65ea70c7ef30958',ramdisk_id='',reservation_id='r-45jmyr4r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1569237592',owner_user_name='tempest-ServersNegativeTestJSON-1569237592-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T01:27:18Z,user_data=None,user_id='202fa7cd113b42f2b95bc2314255392e',uuid=fb140c60-d5e8-4849-8621-95e913becc45,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f0504d3e-b4f2-4f78-a50f-7f0736cf74fe", "address": "fa:16:3e:ed:bc:92", "network": {"id": "ded167af-70f6-45b1-beb4-2eca06a78205", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2145123005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d69aa270fc5b4749a65ea70c7ef30958", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0504d3e-b4", "ovs_interfaceid": "f0504d3e-b4f2-4f78-a50f-7f0736cf74fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75226) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 01:27:19 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-195ac3ff-6306-46ff-a510-53d4630952e4 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] Converting VIF {"id": "f0504d3e-b4f2-4f78-a50f-7f0736cf74fe", "address": "fa:16:3e:ed:bc:92", "network": {"id": "ded167af-70f6-45b1-beb4-2eca06a78205", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2145123005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d69aa270fc5b4749a65ea70c7ef30958", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0504d3e-b4", "ovs_interfaceid": "f0504d3e-b4f2-4f78-a50f-7f0736cf74fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:27:19 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-195ac3ff-6306-46ff-a510-53d4630952e4 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:bc:92,bridge_name='br-int',has_traffic_filtering=True,id=f0504d3e-b4f2-4f78-a50f-7f0736cf74fe,network=Network(ded167af-70f6-45b1-beb4-2eca06a78205),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0504d3e-b4') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:27:19 user nova-compute[75226]: DEBUG nova.objects.instance [None req-195ac3ff-6306-46ff-a510-53d4630952e4 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] Lazy-loading 'pci_devices' on Instance uuid fb140c60-d5e8-4849-8621-95e913becc45 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:27:19 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-195ac3ff-6306-46ff-a510-53d4630952e4 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] [instance: fb140c60-d5e8-4849-8621-95e913becc45] End _get_guest_xml xml=<domain type="kvm">
Nov 17 01:27:19 user nova-compute[75226]:   <uuid>fb140c60-d5e8-4849-8621-95e913becc45</uuid>
Nov 17 01:27:19 user nova-compute[75226]:   <name>instance-0000001b</name>
Nov 17 01:27:19 user nova-compute[75226]:   <memory>524288</memory>
Nov 17 01:27:19 user nova-compute[75226]:   <vcpu>1</vcpu>
Nov 17 01:27:19 user nova-compute[75226]:   <metadata>
Nov 17 01:27:19 user nova-compute[75226]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 17 01:27:19 user nova-compute[75226]:       <nova:package version="0.0.0"/>
Nov 17 01:27:19 user nova-compute[75226]:       <nova:name>tempest-ServersNegativeTestJSON-server-978991004</nova:name>
Nov 17 01:27:19 user nova-compute[75226]:       <nova:creationTime>2023-11-17 01:27:19</nova:creationTime>
Nov 17 01:27:19 user nova-compute[75226]:       <nova:flavor name="m1.tiny">
Nov 17 01:27:19 user nova-compute[75226]:         <nova:memory>512</nova:memory>
Nov 17 01:27:19 user nova-compute[75226]:         <nova:disk>1</nova:disk>
Nov 17 01:27:19 user nova-compute[75226]:         <nova:swap>0</nova:swap>
Nov 17 01:27:19 user nova-compute[75226]:         <nova:ephemeral>0</nova:ephemeral>
Nov 17 01:27:19 user nova-compute[75226]:         <nova:vcpus>1</nova:vcpus>
Nov 17 01:27:19 user nova-compute[75226]:       </nova:flavor>
Nov 17 01:27:19 user nova-compute[75226]:       <nova:owner>
Nov 17 01:27:19 user nova-compute[75226]:         <nova:user uuid="202fa7cd113b42f2b95bc2314255392e">tempest-ServersNegativeTestJSON-1569237592-project-member</nova:user>
Nov 17 01:27:19 user nova-compute[75226]:         <nova:project uuid="d69aa270fc5b4749a65ea70c7ef30958">tempest-ServersNegativeTestJSON-1569237592</nova:project>
Nov 17 01:27:19 user nova-compute[75226]:       </nova:owner>
Nov 17 01:27:19 user nova-compute[75226]:       <nova:root type="image" uuid="0b369aea-6f3f-4690-9f01-229b90ab6310"/>
Nov 17 01:27:19 user nova-compute[75226]:       <nova:ports>
Nov 17 01:27:19 user nova-compute[75226]:         <nova:port uuid="f0504d3e-b4f2-4f78-a50f-7f0736cf74fe">
Nov 17 01:27:19 user nova-compute[75226]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 17 01:27:19 user nova-compute[75226]:         </nova:port>
Nov 17 01:27:19 user nova-compute[75226]:       </nova:ports>
Nov 17 01:27:19 user nova-compute[75226]:     </nova:instance>
Nov 17 01:27:19 user nova-compute[75226]:   </metadata>
Nov 17 01:27:19 user nova-compute[75226]:   <sysinfo type="smbios">
Nov 17 01:27:19 user nova-compute[75226]:     <system>
Nov 17 01:27:19 user nova-compute[75226]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 17 01:27:19 user nova-compute[75226]:       <entry name="product">OpenStack Nova</entry>
Nov 17 01:27:19 user nova-compute[75226]:       <entry name="version">0.0.0</entry>
Nov 17 01:27:19 user nova-compute[75226]:       <entry name="serial">fb140c60-d5e8-4849-8621-95e913becc45</entry>
Nov 17 01:27:19 user nova-compute[75226]:       <entry name="uuid">fb140c60-d5e8-4849-8621-95e913becc45</entry>
Nov 17 01:27:19 user nova-compute[75226]:       <entry name="family">Virtual Machine</entry>
Nov 17 01:27:19 user nova-compute[75226]:     </system>
Nov 17 01:27:19 user nova-compute[75226]:   </sysinfo>
Nov 17 01:27:19 user nova-compute[75226]:   <os>
Nov 17 01:27:19 user nova-compute[75226]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 17 01:27:19 user nova-compute[75226]:     <boot dev="hd"/>
Nov 17 01:27:19 user nova-compute[75226]:     <smbios mode="sysinfo"/>
Nov 17 01:27:19 user nova-compute[75226]:   </os>
Nov 17 01:27:19 user nova-compute[75226]:   <features>
Nov 17 01:27:19 user nova-compute[75226]:     <acpi/>
Nov 17 01:27:19 user nova-compute[75226]:     <apic/>
Nov 17 01:27:19 user nova-compute[75226]:     <vmcoreinfo/>
Nov 17 01:27:19 user nova-compute[75226]:   </features>
Nov 17 01:27:19 user nova-compute[75226]:   <clock offset="utc">
Nov 17 01:27:19 user nova-compute[75226]:     <timer name="pit" tickpolicy="delay"/>
Nov 17 01:27:19 user nova-compute[75226]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 17 01:27:19 user nova-compute[75226]:     <timer name="hpet" present="no"/>
Nov 17 01:27:19 user nova-compute[75226]:   </clock>
Nov 17 01:27:19 user nova-compute[75226]:   <cpu mode="custom" match="exact">
Nov 17 01:27:19 user nova-compute[75226]:     <model>Nehalem</model>
Nov 17 01:27:19 user nova-compute[75226]:     <topology sockets="1" cores="1" threads="1"/>
Nov 17 01:27:19 user nova-compute[75226]:   </cpu>
Nov 17 01:27:19 user nova-compute[75226]:   <devices>
Nov 17 01:27:19 user nova-compute[75226]:     <disk type="file" device="disk">
Nov 17 01:27:19 user nova-compute[75226]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 17 01:27:19 user nova-compute[75226]:       <source file="/opt/stack/data/nova/instances/fb140c60-d5e8-4849-8621-95e913becc45/disk"/>
Nov 17 01:27:19 user nova-compute[75226]:       <target dev="vda" bus="virtio"/>
Nov 17 01:27:19 user nova-compute[75226]:     </disk>
Nov 17 01:27:19 user nova-compute[75226]:     <interface type="ethernet">
Nov 17 01:27:19 user nova-compute[75226]:       <mac address="fa:16:3e:ed:bc:92"/>
Nov 17 01:27:19 user nova-compute[75226]:       <model type="virtio"/>
Nov 17 01:27:19 user nova-compute[75226]:       <mtu size="1442"/>
Nov 17 01:27:19 user nova-compute[75226]:       <target dev="tapf0504d3e-b4"/>
Nov 17 01:27:19 user nova-compute[75226]:     </interface>
Nov 17 01:27:19 user nova-compute[75226]:     <serial type="pty">
Nov 17 01:27:19 user nova-compute[75226]:       <log file="/opt/stack/data/nova/instances/fb140c60-d5e8-4849-8621-95e913becc45/console.log" append="off"/>
Nov 17 01:27:19 user nova-compute[75226]:     </serial>
Nov 17 01:27:19 user nova-compute[75226]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 17 01:27:19 user nova-compute[75226]:     <video>
Nov 17 01:27:19 user nova-compute[75226]:       <model type="virtio"/>
Nov 17 01:27:19 user nova-compute[75226]:     </video>
Nov 17 01:27:19 user nova-compute[75226]:     <rng model="virtio">
Nov 17 01:27:19 user nova-compute[75226]:       <backend model="random">/dev/urandom</backend>
Nov 17 01:27:19 user nova-compute[75226]:     </rng>
Nov 17 01:27:19 user nova-compute[75226]:     <controller type="usb" index="0" model="none"/>
Nov 17 01:27:19 user nova-compute[75226]:     <memballoon model="virtio">
Nov 17 01:27:19 user nova-compute[75226]:       <stats period="10"/>
Nov 17 01:27:19 user nova-compute[75226]:     </memballoon>
Nov 17 01:27:19 user nova-compute[75226]:   </devices>
Nov 17 01:27:19 user nova-compute[75226]: </domain>
Nov 17 01:27:19 user nova-compute[75226]:  {{(pid=75226) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 17 01:27:19 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-195ac3ff-6306-46ff-a510-53d4630952e4 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:27:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-978991004',display_name='tempest-ServersNegativeTestJSON-server-978991004',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-978991004',id=27,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d69aa270fc5b4749a65ea70c7ef30958',ramdisk_id='',reservation_id='r-45jmyr4r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1569237592',owner_user_name='tempest-ServersNegativeTestJSON-1569237592-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T01:27:18Z,user_data=None,user_id='202fa7cd113b42f2b95bc2314255392e',uuid=fb140c60-d5e8-4849-8621-95e913becc45,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f0504d3e-b4f2-4f78-a50f-7f0736cf74fe", "address": "fa:16:3e:ed:bc:92", "network": {"id": "ded167af-70f6-45b1-beb4-2eca06a78205", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2145123005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d69aa270fc5b4749a65ea70c7ef30958", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0504d3e-b4", "ovs_interfaceid": "f0504d3e-b4f2-4f78-a50f-7f0736cf74fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 17 01:27:19 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-195ac3ff-6306-46ff-a510-53d4630952e4 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] Converting VIF {"id": "f0504d3e-b4f2-4f78-a50f-7f0736cf74fe", "address": "fa:16:3e:ed:bc:92", "network": {"id": "ded167af-70f6-45b1-beb4-2eca06a78205", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2145123005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d69aa270fc5b4749a65ea70c7ef30958", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0504d3e-b4", "ovs_interfaceid": "f0504d3e-b4f2-4f78-a50f-7f0736cf74fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:27:19 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-195ac3ff-6306-46ff-a510-53d4630952e4 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:bc:92,bridge_name='br-int',has_traffic_filtering=True,id=f0504d3e-b4f2-4f78-a50f-7f0736cf74fe,network=Network(ded167af-70f6-45b1-beb4-2eca06a78205),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0504d3e-b4') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:27:19 user nova-compute[75226]: DEBUG os_vif [None req-195ac3ff-6306-46ff-a510-53d4630952e4 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:bc:92,bridge_name='br-int',has_traffic_filtering=True,id=f0504d3e-b4f2-4f78-a50f-7f0736cf74fe,network=Network(ded167af-70f6-45b1-beb4-2eca06a78205),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0504d3e-b4') {{(pid=75226) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 17 01:27:19 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:27:19 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:27:19 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 17 01:27:19 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:27:19 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '314d7ee2-4887-5ed8-9398-3608d68f366c', '_type': 'linux-noop'}}, row=False) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:27:19 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:27:19 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:27:19 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:27:19 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf0504d3e-b4, may_exist=True, interface_attrs={}) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:27:19 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf0504d3e-b4, col_values=(('qos', UUID('94141d45-db52-4a76-97e7-f80dc3ad8d15')),), if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:27:19 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf0504d3e-b4, col_values=(('external_ids', {'iface-id': 'f0504d3e-b4f2-4f78-a50f-7f0736cf74fe', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ed:bc:92', 'vm-uuid': 'fb140c60-d5e8-4849-8621-95e913becc45'}),), if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:27:19 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:27:19 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:27:19 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:27:19 user nova-compute[75226]: INFO os_vif [None req-195ac3ff-6306-46ff-a510-53d4630952e4 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:bc:92,bridge_name='br-int',has_traffic_filtering=True,id=f0504d3e-b4f2-4f78-a50f-7f0736cf74fe,network=Network(ded167af-70f6-45b1-beb4-2eca06a78205),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0504d3e-b4')
Nov 17 01:27:19 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-195ac3ff-6306-46ff-a510-53d4630952e4 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] No BDM found with device name vda, not building metadata. {{(pid=75226) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 01:27:19 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-195ac3ff-6306-46ff-a510-53d4630952e4 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] No VIF found with MAC fa:16:3e:ed:bc:92, not building metadata {{(pid=75226) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 01:27:19 user nova-compute[75226]: DEBUG nova.network.neutron [req-a57d9c37-1038-47f9-9bd2-b1a828d0dc59 req-56a5d9ce-6704-4af4-88ef-5d291f29174c service nova] [instance: fb140c60-d5e8-4849-8621-95e913becc45] Updated VIF entry in instance network info cache for port f0504d3e-b4f2-4f78-a50f-7f0736cf74fe. {{(pid=75226) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 01:27:19 user nova-compute[75226]: DEBUG nova.network.neutron [req-a57d9c37-1038-47f9-9bd2-b1a828d0dc59 req-56a5d9ce-6704-4af4-88ef-5d291f29174c service nova] [instance: fb140c60-d5e8-4849-8621-95e913becc45] Updating instance_info_cache with network_info: [{"id": "f0504d3e-b4f2-4f78-a50f-7f0736cf74fe", "address": "fa:16:3e:ed:bc:92", "network": {"id": "ded167af-70f6-45b1-beb4-2eca06a78205", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2145123005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d69aa270fc5b4749a65ea70c7ef30958", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0504d3e-b4", "ovs_interfaceid": "f0504d3e-b4f2-4f78-a50f-7f0736cf74fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:27:19 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-a57d9c37-1038-47f9-9bd2-b1a828d0dc59 req-56a5d9ce-6704-4af4-88ef-5d291f29174c service nova] Releasing lock "refresh_cache-fb140c60-d5e8-4849-8621-95e913becc45" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:27:19 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-17d77dac-53dc-41b1-a054-ea8890eda08f tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c is timed out.
Nov 17 01:27:19 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-17d77dac-53dc-41b1-a054-ea8890eda08f tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Successfully detached device vdb from instance f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c from the live domain config.
Nov 17 01:27:19 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17d77dac-53dc-41b1-a054-ea8890eda08f tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] [instance: f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c] calling os-brick to detach iSCSI Volume {{(pid=75226) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 17 01:27:19 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-17d77dac-53dc-41b1-a054-ea8890eda08f tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc4cc36b490>, {'target_iqn': 'iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LKfJojTl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:27:19 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-17d77dac-53dc-41b1-a054-ea8890eda08f tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:27:19 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-17d77dac-53dc-41b1-a054-ea8890eda08f tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:27:19 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-17d77dac-53dc-41b1-a054-ea8890eda08f tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:27:19 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:27:19 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:27:19 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ad9b01e-2a12-4b51-b7d0-af04b57948bf]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:29701267-6547-48b4-befc-b18ec2ab5e2c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:27:19 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-17d77dac-53dc-41b1-a054-ea8890eda08f tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 17 01:27:19 user nova-compute[75226]: No targets found.
Nov 17 01:27:19 user nova-compute[75226]: iSNS:
Nov 17 01:27:19 user nova-compute[75226]: No targets found.
Nov 17 01:27:19 user nova-compute[75226]: STATIC:
Nov 17 01:27:19 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8
Nov 17 01:27:19 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:27:19 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:27:19 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:29701267-6547-48b4-befc-b18ec2ab5e2c
Nov 17 01:27:19 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:27:19 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:27:19 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421
Nov 17 01:27:19 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:27:19 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:27:19 user nova-compute[75226]: FIRMWARE:
Nov 17 01:27:19 user nova-compute[75226]: No targets found.
Nov 17 01:27:19 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:27:19 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-17d77dac-53dc-41b1-a054-ea8890eda08f tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 17 01:27:19 user nova-compute[75226]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 17 01:27:19 user nova-compute[75226]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75226) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 17 01:27:19 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-17d77dac-53dc-41b1-a054-ea8890eda08f tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421', 0)] {{(pid=75226) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 17 01:27:19 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:27:19 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:27:19 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7f07ed5-51cd-4c6d-a339-31edafbdbe10]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:29701267-6547-48b4-befc-b18ec2ab5e2c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:27:19 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:27:20 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:27:20 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b0437bf-1131-474d-bb05-18d72d9bf634]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29701267-6547-48b4-befc-b18ec2ab5e2c (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:27:20 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-17d77dac-53dc-41b1-a054-ea8890eda08f tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)
Nov 17 01:27:20 user nova-compute[75226]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421 (non-flash)
Nov 17 01:27:20 user nova-compute[75226]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29701267-6547-48b4-befc-b18ec2ab5e2c (non-flash)
Nov 17 01:27:20 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:27:20 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-17d77dac-53dc-41b1-a054-ea8890eda08f tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)
Nov 17 01:27:20 user nova-compute[75226]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421 (non-flash)
Nov 17 01:27:20 user nova-compute[75226]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29701267-6547-48b4-befc-b18ec2ab5e2c (non-flash)
Nov 17 01:27:20 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:27:20 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-17d77dac-53dc-41b1-a054-ea8890eda08f tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc4cc1bfbe0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421'): ({'sdd'}, set())}) {{(pid=75226) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 17 01:27:20 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-17d77dac-53dc-41b1-a054-ea8890eda08f tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Removing single pathed devices sdd {{(pid=75226) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 17 01:27:20 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:27:20 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:27:20 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[97347f8b-3f38-4ef1-838f-3d485b7ea8c8]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:27:20 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:27:20 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:27:20 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7f17a4c-b029-4f8c-89ae-a40d1d33d918]: (4, ('ok\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:27:20 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-17d77dac-53dc-41b1-a054-ea8890eda08f tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Flushing IO for device /dev/sdd {{(pid=75226) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 17 01:27:20 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:27:20 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:27:20 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[cebc8513-00be-4ee5-a3a4-9ed0184e9040]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:27:20 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-17d77dac-53dc-41b1-a054-ea8890eda08f tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75226) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 17 01:27:20 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:27:20 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.043s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:27:20 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[d92cc2a3-ad50-4805-b7c9-540208a936d2]: (4, ('1', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:27:20 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-17d77dac-53dc-41b1-a054-ea8890eda08f tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75226) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 17 01:27:20 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-17d77dac-53dc-41b1-a054-ea8890eda08f tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] SCSI volumes sdd have been removed. {{(pid=75226) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 17 01:27:20 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-17d77dac-53dc-41b1-a054-ea8890eda08f tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421')] {{(pid=75226) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 17 01:27:20 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:27:20 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:27:20 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a6970d9-b43b-4a10-a499-ffafbcdd448c]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:27:20 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-17d77dac-53dc-41b1-a054-ea8890eda08f tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:27:20 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421 -p 172.16.0.220:3260 --logout {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:27:20 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421 -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:27:20 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[24e5c292-e084-4aac-b5b8-6d71a07c8e66]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:27:20 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-17d77dac-53dc-41b1-a054-ea8890eda08f tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421, portal: 172.16.0.220,3260]
Nov 17 01:27:20 user nova-compute[75226]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421, portal: 172.16.0.220,3260] successful.
Nov 17 01:27:20 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:27:20 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421 -p 172.16.0.220:3260 --op delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:27:20 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd06256f-5f5b-4cf6-962d-f77749280421 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:27:20 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[83ee0d95-0e4e-46b1-b389-5f19882a084a]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:27:20 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-17d77dac-53dc-41b1-a054-ea8890eda08f tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:27:20 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-17d77dac-53dc-41b1-a054-ea8890eda08f tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.278s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:27:20 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-17d77dac-53dc-41b1-a054-ea8890eda08f tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] <== disconnect_volume: return (279ms) None {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:27:20 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17d77dac-53dc-41b1-a054-ea8890eda08f tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] [instance: f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c] Disconnected iSCSI Volume {{(pid=75226) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 17 01:27:20 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:27:20 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:27:20 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:27:20 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:27:20 user nova-compute[75226]: DEBUG nova.compute.manager [req-421bd8ec-253c-4bdf-bdb0-186d746dbc55 req-64f65d6d-77a5-498b-8d36-ec1bd03b6760 service nova] [instance: fb140c60-d5e8-4849-8621-95e913becc45] Received event network-vif-plugged-f0504d3e-b4f2-4f78-a50f-7f0736cf74fe {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:27:20 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-421bd8ec-253c-4bdf-bdb0-186d746dbc55 req-64f65d6d-77a5-498b-8d36-ec1bd03b6760 service nova] Acquiring lock "fb140c60-d5e8-4849-8621-95e913becc45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:27:20 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-421bd8ec-253c-4bdf-bdb0-186d746dbc55 req-64f65d6d-77a5-498b-8d36-ec1bd03b6760 service nova] Lock "fb140c60-d5e8-4849-8621-95e913becc45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:27:20 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-421bd8ec-253c-4bdf-bdb0-186d746dbc55 req-64f65d6d-77a5-498b-8d36-ec1bd03b6760 service nova] Lock "fb140c60-d5e8-4849-8621-95e913becc45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:27:20 user nova-compute[75226]: DEBUG nova.compute.manager [req-421bd8ec-253c-4bdf-bdb0-186d746dbc55 req-64f65d6d-77a5-498b-8d36-ec1bd03b6760 service nova] [instance: fb140c60-d5e8-4849-8621-95e913becc45] No waiting events found dispatching network-vif-plugged-f0504d3e-b4f2-4f78-a50f-7f0736cf74fe {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:27:20 user nova-compute[75226]: WARNING nova.compute.manager [req-421bd8ec-253c-4bdf-bdb0-186d746dbc55 req-64f65d6d-77a5-498b-8d36-ec1bd03b6760 service nova] [instance: fb140c60-d5e8-4849-8621-95e913becc45] Received unexpected event network-vif-plugged-f0504d3e-b4f2-4f78-a50f-7f0736cf74fe for instance with vm_state building and task_state spawning.
Nov 17 01:27:21 user nova-compute[75226]: DEBUG nova.objects.instance [None req-17d77dac-53dc-41b1-a054-ea8890eda08f tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Lazy-loading 'flavor' on Instance uuid f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:27:21 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-17d77dac-53dc-41b1-a054-ea8890eda08f tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Lock "f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.709s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:27:21 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-44757046-9279-466a-bcdf-62e8eec340d6 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Acquiring lock "f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:27:21 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-44757046-9279-466a-bcdf-62e8eec340d6 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Lock "f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:27:21 user nova-compute[75226]: DEBUG nova.compute.manager [None req-44757046-9279-466a-bcdf-62e8eec340d6 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] [instance: f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c] Checking state {{(pid=75226) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 01:27:21 user nova-compute[75226]: DEBUG nova.compute.manager [None req-44757046-9279-466a-bcdf-62e8eec340d6 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] [instance: f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=75226) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 17 01:27:21 user nova-compute[75226]: DEBUG nova.objects.instance [None req-44757046-9279-466a-bcdf-62e8eec340d6 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Lazy-loading 'flavor' on Instance uuid f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:27:21 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:27:21 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:27:21 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:27:22 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:27:22 user nova-compute[75226]: DEBUG nova.compute.manager [req-879cd4d8-ae0b-4097-a977-0beffae26505 req-b616c670-6384-4cea-8123-36dc1bc6fdeb service nova] [instance: f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c] Received event network-vif-unplugged-ed40e788-7338-4ecd-8204-008d4601131b {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:27:22 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-879cd4d8-ae0b-4097-a977-0beffae26505 req-b616c670-6384-4cea-8123-36dc1bc6fdeb service nova] Acquiring lock "f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:27:22 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-879cd4d8-ae0b-4097-a977-0beffae26505 req-b616c670-6384-4cea-8123-36dc1bc6fdeb service nova] Lock "f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:27:22 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-879cd4d8-ae0b-4097-a977-0beffae26505 req-b616c670-6384-4cea-8123-36dc1bc6fdeb service nova] Lock "f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:27:22 user nova-compute[75226]: DEBUG nova.compute.manager [req-879cd4d8-ae0b-4097-a977-0beffae26505 req-b616c670-6384-4cea-8123-36dc1bc6fdeb service nova] [instance: f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c] No waiting events found dispatching network-vif-unplugged-ed40e788-7338-4ecd-8204-008d4601131b {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:27:22 user nova-compute[75226]: WARNING nova.compute.manager [req-879cd4d8-ae0b-4097-a977-0beffae26505 req-b616c670-6384-4cea-8123-36dc1bc6fdeb service nova] [instance: f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c] Received unexpected event network-vif-unplugged-ed40e788-7338-4ecd-8204-008d4601131b for instance with vm_state active and task_state powering-off.
Nov 17 01:27:22 user nova-compute[75226]: DEBUG nova.compute.manager [None req-195ac3ff-6306-46ff-a510-53d4630952e4 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] [instance: fb140c60-d5e8-4849-8621-95e913becc45] Instance event wait completed in 0 seconds for  {{(pid=75226) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 17 01:27:22 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-195ac3ff-6306-46ff-a510-53d4630952e4 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] [instance: fb140c60-d5e8-4849-8621-95e913becc45] Guest created on hypervisor {{(pid=75226) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 17 01:27:22 user nova-compute[75226]: INFO nova.virt.libvirt.driver [-] [instance: fb140c60-d5e8-4849-8621-95e913becc45] Instance spawned successfully.
Nov 17 01:27:22 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-195ac3ff-6306-46ff-a510-53d4630952e4 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] [instance: fb140c60-d5e8-4849-8621-95e913becc45] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 17 01:27:22 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-195ac3ff-6306-46ff-a510-53d4630952e4 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] [instance: fb140c60-d5e8-4849-8621-95e913becc45] Found default for hw_cdrom_bus of ide {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:27:22 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-195ac3ff-6306-46ff-a510-53d4630952e4 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] [instance: fb140c60-d5e8-4849-8621-95e913becc45] Found default for hw_disk_bus of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:27:22 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-195ac3ff-6306-46ff-a510-53d4630952e4 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] [instance: fb140c60-d5e8-4849-8621-95e913becc45] Found default for hw_input_bus of None {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:27:22 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-195ac3ff-6306-46ff-a510-53d4630952e4 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] [instance: fb140c60-d5e8-4849-8621-95e913becc45] Found default for hw_pointer_model of None {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:27:22 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-195ac3ff-6306-46ff-a510-53d4630952e4 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] [instance: fb140c60-d5e8-4849-8621-95e913becc45] Found default for hw_video_model of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:27:22 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-195ac3ff-6306-46ff-a510-53d4630952e4 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] [instance: fb140c60-d5e8-4849-8621-95e913becc45] Found default for hw_vif_model of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:27:22 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:27:22 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:27:22 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:27:22 user nova-compute[75226]: INFO nova.virt.libvirt.driver [-] [instance: f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c] Instance destroyed successfully.
Nov 17 01:27:22 user nova-compute[75226]: DEBUG nova.compute.manager [None req-44757046-9279-466a-bcdf-62e8eec340d6 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] [instance: f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c] Checking state {{(pid=75226) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 01:27:22 user nova-compute[75226]: INFO nova.compute.manager [None req-195ac3ff-6306-46ff-a510-53d4630952e4 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] [instance: fb140c60-d5e8-4849-8621-95e913becc45] Took 5.02 seconds to spawn the instance on the hypervisor.
Nov 17 01:27:22 user nova-compute[75226]: DEBUG nova.compute.manager [None req-195ac3ff-6306-46ff-a510-53d4630952e4 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] [instance: fb140c60-d5e8-4849-8621-95e913becc45] Checking state {{(pid=75226) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 01:27:22 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:27:22 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-44757046-9279-466a-bcdf-62e8eec340d6 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Lock "f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.850s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:27:22 user nova-compute[75226]: DEBUG nova.compute.manager [req-b9427048-dde3-473d-8cea-89c7b26e65bd req-bc90525f-a198-40b6-8d66-203a60c97307 service nova] [instance: fb140c60-d5e8-4849-8621-95e913becc45] Received event network-vif-plugged-f0504d3e-b4f2-4f78-a50f-7f0736cf74fe {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:27:22 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-b9427048-dde3-473d-8cea-89c7b26e65bd req-bc90525f-a198-40b6-8d66-203a60c97307 service nova] Acquiring lock "fb140c60-d5e8-4849-8621-95e913becc45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:27:22 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-b9427048-dde3-473d-8cea-89c7b26e65bd req-bc90525f-a198-40b6-8d66-203a60c97307 service nova] Lock "fb140c60-d5e8-4849-8621-95e913becc45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:27:22 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-b9427048-dde3-473d-8cea-89c7b26e65bd req-bc90525f-a198-40b6-8d66-203a60c97307 service nova] Lock "fb140c60-d5e8-4849-8621-95e913becc45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:27:22 user nova-compute[75226]: DEBUG nova.compute.manager [req-b9427048-dde3-473d-8cea-89c7b26e65bd req-bc90525f-a198-40b6-8d66-203a60c97307 service nova] [instance: fb140c60-d5e8-4849-8621-95e913becc45] No waiting events found dispatching network-vif-plugged-f0504d3e-b4f2-4f78-a50f-7f0736cf74fe {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:27:22 user nova-compute[75226]: WARNING nova.compute.manager [req-b9427048-dde3-473d-8cea-89c7b26e65bd req-bc90525f-a198-40b6-8d66-203a60c97307 service nova] [instance: fb140c60-d5e8-4849-8621-95e913becc45] Received unexpected event network-vif-plugged-f0504d3e-b4f2-4f78-a50f-7f0736cf74fe for instance with vm_state building and task_state spawning.
Nov 17 01:27:22 user nova-compute[75226]: INFO nova.compute.manager [None req-195ac3ff-6306-46ff-a510-53d4630952e4 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] [instance: fb140c60-d5e8-4849-8621-95e913becc45] Took 5.83 seconds to build instance.
Nov 17 01:27:22 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-195ac3ff-6306-46ff-a510-53d4630952e4 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] Lock "fb140c60-d5e8-4849-8621-95e913becc45" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.921s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:27:22 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:27:23 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:27:23 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:27:23 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:27:23 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:27:23 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:27:23 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:27:23 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:27:24 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:27:24 user nova-compute[75226]: DEBUG nova.compute.manager [req-427d854b-d766-4fc7-a96a-f58c9b98ecdb req-17ae7ba5-dd78-4440-b932-8d948535192d service nova] [instance: f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c] Received event network-vif-plugged-ed40e788-7338-4ecd-8204-008d4601131b {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:27:24 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-427d854b-d766-4fc7-a96a-f58c9b98ecdb req-17ae7ba5-dd78-4440-b932-8d948535192d service nova] Acquiring lock "f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:27:24 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-427d854b-d766-4fc7-a96a-f58c9b98ecdb req-17ae7ba5-dd78-4440-b932-8d948535192d service nova] Lock "f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:27:24 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-427d854b-d766-4fc7-a96a-f58c9b98ecdb req-17ae7ba5-dd78-4440-b932-8d948535192d service nova] Lock "f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:27:24 user nova-compute[75226]: DEBUG nova.compute.manager [req-427d854b-d766-4fc7-a96a-f58c9b98ecdb req-17ae7ba5-dd78-4440-b932-8d948535192d service nova] [instance: f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c] No waiting events found dispatching network-vif-plugged-ed40e788-7338-4ecd-8204-008d4601131b {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:27:24 user nova-compute[75226]: WARNING nova.compute.manager [req-427d854b-d766-4fc7-a96a-f58c9b98ecdb req-17ae7ba5-dd78-4440-b932-8d948535192d service nova] [instance: f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c] Received unexpected event network-vif-plugged-ed40e788-7338-4ecd-8204-008d4601131b for instance with vm_state stopped and task_state None.
Nov 17 01:27:24 user nova-compute[75226]: DEBUG nova.compute.manager [req-427d854b-d766-4fc7-a96a-f58c9b98ecdb req-17ae7ba5-dd78-4440-b932-8d948535192d service nova] [instance: f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c] Received event network-vif-plugged-ed40e788-7338-4ecd-8204-008d4601131b {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:27:24 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-427d854b-d766-4fc7-a96a-f58c9b98ecdb req-17ae7ba5-dd78-4440-b932-8d948535192d service nova] Acquiring lock "f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:27:24 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-427d854b-d766-4fc7-a96a-f58c9b98ecdb req-17ae7ba5-dd78-4440-b932-8d948535192d service nova] Lock "f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:27:24 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-427d854b-d766-4fc7-a96a-f58c9b98ecdb req-17ae7ba5-dd78-4440-b932-8d948535192d service nova] Lock "f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:27:24 user nova-compute[75226]: DEBUG nova.compute.manager [req-427d854b-d766-4fc7-a96a-f58c9b98ecdb req-17ae7ba5-dd78-4440-b932-8d948535192d service nova] [instance: f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c] No waiting events found dispatching network-vif-plugged-ed40e788-7338-4ecd-8204-008d4601131b {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:27:24 user nova-compute[75226]: WARNING nova.compute.manager [req-427d854b-d766-4fc7-a96a-f58c9b98ecdb req-17ae7ba5-dd78-4440-b932-8d948535192d service nova] [instance: f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c] Received unexpected event network-vif-plugged-ed40e788-7338-4ecd-8204-008d4601131b for instance with vm_state stopped and task_state None.
Nov 17 01:27:24 user nova-compute[75226]: DEBUG nova.compute.manager [req-427d854b-d766-4fc7-a96a-f58c9b98ecdb req-17ae7ba5-dd78-4440-b932-8d948535192d service nova] [instance: f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c] Received event network-vif-plugged-ed40e788-7338-4ecd-8204-008d4601131b {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:27:24 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-427d854b-d766-4fc7-a96a-f58c9b98ecdb req-17ae7ba5-dd78-4440-b932-8d948535192d service nova] Acquiring lock "f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:27:24 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-427d854b-d766-4fc7-a96a-f58c9b98ecdb req-17ae7ba5-dd78-4440-b932-8d948535192d service nova] Lock "f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:27:24 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-427d854b-d766-4fc7-a96a-f58c9b98ecdb req-17ae7ba5-dd78-4440-b932-8d948535192d service nova] Lock "f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:27:24 user nova-compute[75226]: DEBUG nova.compute.manager [req-427d854b-d766-4fc7-a96a-f58c9b98ecdb req-17ae7ba5-dd78-4440-b932-8d948535192d service nova] [instance: f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c] No waiting events found dispatching network-vif-plugged-ed40e788-7338-4ecd-8204-008d4601131b {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:27:24 user nova-compute[75226]: WARNING nova.compute.manager [req-427d854b-d766-4fc7-a96a-f58c9b98ecdb req-17ae7ba5-dd78-4440-b932-8d948535192d service nova] [instance: f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c] Received unexpected event network-vif-plugged-ed40e788-7338-4ecd-8204-008d4601131b for instance with vm_state stopped and task_state None.
Nov 17 01:27:24 user nova-compute[75226]: DEBUG nova.compute.manager [req-427d854b-d766-4fc7-a96a-f58c9b98ecdb req-17ae7ba5-dd78-4440-b932-8d948535192d service nova] [instance: f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c] Received event network-vif-unplugged-ed40e788-7338-4ecd-8204-008d4601131b {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:27:24 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-427d854b-d766-4fc7-a96a-f58c9b98ecdb req-17ae7ba5-dd78-4440-b932-8d948535192d service nova] Acquiring lock "f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:27:24 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-427d854b-d766-4fc7-a96a-f58c9b98ecdb req-17ae7ba5-dd78-4440-b932-8d948535192d service nova] Lock "f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:27:24 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-427d854b-d766-4fc7-a96a-f58c9b98ecdb req-17ae7ba5-dd78-4440-b932-8d948535192d service nova] Lock "f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:27:24 user nova-compute[75226]: DEBUG nova.compute.manager [req-427d854b-d766-4fc7-a96a-f58c9b98ecdb req-17ae7ba5-dd78-4440-b932-8d948535192d service nova] [instance: f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c] No waiting events found dispatching network-vif-unplugged-ed40e788-7338-4ecd-8204-008d4601131b {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:27:24 user nova-compute[75226]: WARNING nova.compute.manager [req-427d854b-d766-4fc7-a96a-f58c9b98ecdb req-17ae7ba5-dd78-4440-b932-8d948535192d service nova] [instance: f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c] Received unexpected event network-vif-unplugged-ed40e788-7338-4ecd-8204-008d4601131b for instance with vm_state stopped and task_state None.
Nov 17 01:27:24 user nova-compute[75226]: DEBUG nova.compute.manager [req-427d854b-d766-4fc7-a96a-f58c9b98ecdb req-17ae7ba5-dd78-4440-b932-8d948535192d service nova] [instance: f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c] Received event network-vif-plugged-ed40e788-7338-4ecd-8204-008d4601131b {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:27:24 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-427d854b-d766-4fc7-a96a-f58c9b98ecdb req-17ae7ba5-dd78-4440-b932-8d948535192d service nova] Acquiring lock "f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:27:24 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-427d854b-d766-4fc7-a96a-f58c9b98ecdb req-17ae7ba5-dd78-4440-b932-8d948535192d service nova] Lock "f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:27:24 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-427d854b-d766-4fc7-a96a-f58c9b98ecdb req-17ae7ba5-dd78-4440-b932-8d948535192d service nova] Lock "f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:27:24 user nova-compute[75226]: DEBUG nova.compute.manager [req-427d854b-d766-4fc7-a96a-f58c9b98ecdb req-17ae7ba5-dd78-4440-b932-8d948535192d service nova] [instance: f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c] No waiting events found dispatching network-vif-plugged-ed40e788-7338-4ecd-8204-008d4601131b {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:27:24 user nova-compute[75226]: WARNING nova.compute.manager [req-427d854b-d766-4fc7-a96a-f58c9b98ecdb req-17ae7ba5-dd78-4440-b932-8d948535192d service nova] [instance: f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c] Received unexpected event network-vif-plugged-ed40e788-7338-4ecd-8204-008d4601131b for instance with vm_state stopped and task_state None.
Nov 17 01:27:24 user nova-compute[75226]: DEBUG nova.compute.manager [req-c7859483-5cb4-432a-bd6f-bd2d9e860281 req-92e13046-3fd8-4b73-a6bc-00bbae85ed5a service nova] [instance: 4dcdd769-bbfe-48e8-a876-8b2072b7baeb] Received event network-changed-89afa235-d910-4430-a95a-c173ba7a7048 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:27:24 user nova-compute[75226]: DEBUG nova.compute.manager [req-c7859483-5cb4-432a-bd6f-bd2d9e860281 req-92e13046-3fd8-4b73-a6bc-00bbae85ed5a service nova] [instance: 4dcdd769-bbfe-48e8-a876-8b2072b7baeb] Refreshing instance network info cache due to event network-changed-89afa235-d910-4430-a95a-c173ba7a7048. {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 01:27:24 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-c7859483-5cb4-432a-bd6f-bd2d9e860281 req-92e13046-3fd8-4b73-a6bc-00bbae85ed5a service nova] Acquiring lock "refresh_cache-4dcdd769-bbfe-48e8-a876-8b2072b7baeb" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:27:24 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-c7859483-5cb4-432a-bd6f-bd2d9e860281 req-92e13046-3fd8-4b73-a6bc-00bbae85ed5a service nova] Acquired lock "refresh_cache-4dcdd769-bbfe-48e8-a876-8b2072b7baeb" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:27:24 user nova-compute[75226]: DEBUG nova.network.neutron [req-c7859483-5cb4-432a-bd6f-bd2d9e860281 req-92e13046-3fd8-4b73-a6bc-00bbae85ed5a service nova] [instance: 4dcdd769-bbfe-48e8-a876-8b2072b7baeb] Refreshing network info cache for port 89afa235-d910-4430-a95a-c173ba7a7048 {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 01:27:24 user nova-compute[75226]: DEBUG nova.network.neutron [req-c7859483-5cb4-432a-bd6f-bd2d9e860281 req-92e13046-3fd8-4b73-a6bc-00bbae85ed5a service nova] [instance: 4dcdd769-bbfe-48e8-a876-8b2072b7baeb] Updated VIF entry in instance network info cache for port 89afa235-d910-4430-a95a-c173ba7a7048. {{(pid=75226) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 01:27:24 user nova-compute[75226]: DEBUG nova.network.neutron [req-c7859483-5cb4-432a-bd6f-bd2d9e860281 req-92e13046-3fd8-4b73-a6bc-00bbae85ed5a service nova] [instance: 4dcdd769-bbfe-48e8-a876-8b2072b7baeb] Updating instance_info_cache with network_info: [{"id": "89afa235-d910-4430-a95a-c173ba7a7048", "address": "fa:16:3e:a8:19:37", "network": {"id": "9f39d3e5-b106-4bd9-b8ba-0f326e89c481", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-675861281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9042fe4ecc245dd97553f6e942c3e05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89afa235-d9", "ovs_interfaceid": "89afa235-d910-4430-a95a-c173ba7a7048", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:27:24 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-c7859483-5cb4-432a-bd6f-bd2d9e860281 req-92e13046-3fd8-4b73-a6bc-00bbae85ed5a service nova] Releasing lock "refresh_cache-4dcdd769-bbfe-48e8-a876-8b2072b7baeb" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:27:24 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-2de3378f-c24c-4ead-8243-6425ead3bf0d tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Acquiring lock "4dcdd769-bbfe-48e8-a876-8b2072b7baeb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:27:24 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-2de3378f-c24c-4ead-8243-6425ead3bf0d tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Lock "4dcdd769-bbfe-48e8-a876-8b2072b7baeb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:27:24 user nova-compute[75226]: DEBUG nova.objects.instance [None req-2de3378f-c24c-4ead-8243-6425ead3bf0d tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Lazy-loading 'flavor' on Instance uuid 4dcdd769-bbfe-48e8-a876-8b2072b7baeb {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:27:24 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-2de3378f-c24c-4ead-8243-6425ead3bf0d tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Lock "4dcdd769-bbfe-48e8-a876-8b2072b7baeb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:27:24 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-2de3378f-c24c-4ead-8243-6425ead3bf0d tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Acquiring lock "4dcdd769-bbfe-48e8-a876-8b2072b7baeb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:27:24 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-2de3378f-c24c-4ead-8243-6425ead3bf0d tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Lock "4dcdd769-bbfe-48e8-a876-8b2072b7baeb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:27:24 user nova-compute[75226]: INFO nova.compute.manager [None req-2de3378f-c24c-4ead-8243-6425ead3bf0d tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: 4dcdd769-bbfe-48e8-a876-8b2072b7baeb] Attaching volume 528da57f-3100-4711-849f-f7a3a30ced14 to /dev/vdb
Nov 17 01:27:24 user nova-compute[75226]: DEBUG os_brick.utils [None req-2de3378f-c24c-4ead-8243-6425ead3bf0d tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:27:24 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:27:24 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:27:24 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9808c6e-0227-472d-afda-38ed09a3e1f2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f62857db69\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:27:24 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:27:25 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:27:25 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[262128e0-fd56-4a24-b40c-c23e0ab7b59c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:27:25 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:27:25 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:27:25 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[870f70bb-5378-4338-9d82-80f57b60bbe0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:27:25 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a57074e-fba3-4ba2-ab46-349f58821c8d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:27:25 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-2de3378f-c24c-4ead-8243-6425ead3bf0d tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Running cmd (subprocess): nvme version {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:27:25 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-2de3378f-c24c-4ead-8243-6425ead3bf0d tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] 'nvme version' failed. Not Retrying. {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 01:27:25 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2de3378f-c24c-4ead-8243-6425ead3bf0d tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] nvme not present on system {{(pid=75226) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 17 01:27:25 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:27:25 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 01:27:25 user nova-compute[75226]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 17 01:27:25 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea1a5eef-e626-4d83-b288-ac8a736df5e8]: (4, '') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:27:25 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-2de3378f-c24c-4ead-8243-6425ead3bf0d tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75226) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 17 01:27:25 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-2de3378f-c24c-4ead-8243-6425ead3bf0d tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75226) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 17 01:27:25 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-2de3378f-c24c-4ead-8243-6425ead3bf0d tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] LIGHTOS: no hostnqn found. {{(pid=75226) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 17 01:27:25 user nova-compute[75226]: DEBUG os_brick.utils [None req-2de3378f-c24c-4ead-8243-6425ead3bf0d tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f62857db69', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:27:25 user nova-compute[75226]: DEBUG nova.virt.block_device [None req-2de3378f-c24c-4ead-8243-6425ead3bf0d tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: 4dcdd769-bbfe-48e8-a876-8b2072b7baeb] Updating existing volume attachment record: 7043e5cc-1c67-46f8-bc19-71e53a6c7379 {{(pid=75226) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 17 01:27:27 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:27:28 user nova-compute[75226]: DEBUG nova.compute.manager [None req-ac79b949-4e72-47cc-8002-aefdd273f045 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 2ea5a14b-c330-4a2b-926e-60e1b30f5981] Checking state {{(pid=75226) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 01:27:29 user nova-compute[75226]: INFO nova.compute.manager [None req-ac79b949-4e72-47cc-8002-aefdd273f045 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 2ea5a14b-c330-4a2b-926e-60e1b30f5981] instance snapshotting
Nov 17 01:27:29 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:27:29 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-ac79b949-4e72-47cc-8002-aefdd273f045 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 2ea5a14b-c330-4a2b-926e-60e1b30f5981] Beginning live snapshot process
Nov 17 01:27:29 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-ac79b949-4e72-47cc-8002-aefdd273f045 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ea5a14b-c330-4a2b-926e-60e1b30f5981/disk --force-share --output=json -f qcow2 {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:27:29 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-ac79b949-4e72-47cc-8002-aefdd273f045 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ea5a14b-c330-4a2b-926e-60e1b30f5981/disk --force-share --output=json -f qcow2" returned: 0 in 0.177s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:27:29 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-ac79b949-4e72-47cc-8002-aefdd273f045 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ea5a14b-c330-4a2b-926e-60e1b30f5981/disk --force-share --output=json -f qcow2 {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:27:29 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-ac79b949-4e72-47cc-8002-aefdd273f045 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ea5a14b-c330-4a2b-926e-60e1b30f5981/disk --force-share --output=json -f qcow2" returned: 0 in 0.190s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:27:29 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-ac79b949-4e72-47cc-8002-aefdd273f045 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:27:29 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-ac79b949-4e72-47cc-8002-aefdd273f045 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json" returned: 0 in 0.172s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:27:29 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-ac79b949-4e72-47cc-8002-aefdd273f045 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpkx_wx6qm/fdf0511318814a7093eb895569b3a5ea.delta 1073741824 {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:27:29 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-ac79b949-4e72-47cc-8002-aefdd273f045 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpkx_wx6qm/fdf0511318814a7093eb895569b3a5ea.delta 1073741824" returned: 0 in 0.051s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:27:29 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-ac79b949-4e72-47cc-8002-aefdd273f045 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 2ea5a14b-c330-4a2b-926e-60e1b30f5981] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 17 01:27:30 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2de3378f-c24c-4ead-8243-6425ead3bf0d tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: 4dcdd769-bbfe-48e8-a876-8b2072b7baeb] Calling os-brick to attach iSCSI Volume {{(pid=75226) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 17 01:27:30 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de3378f-c24c-4ead-8243-6425ead3bf0d tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc4cc36b490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EwKBfZbN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:27:30 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-2de3378f-c24c-4ead-8243-6425ead3bf0d tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:27:30 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-2de3378f-c24c-4ead-8243-6425ead3bf0d tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:27:30 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-2de3378f-c24c-4ead-8243-6425ead3bf0d tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:27:30 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-2de3378f-c24c-4ead-8243-6425ead3bf0d tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:27:30 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-2de3378f-c24c-4ead-8243-6425ead3bf0d tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:27:30 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-2de3378f-c24c-4ead-8243-6425ead3bf0d tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:27:30 user nova-compute[75226]: INFO os_brick.initiator.connectors.iscsi [None req-2de3378f-c24c-4ead-8243-6425ead3bf0d tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 17 01:27:30 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14 -p 172.16.0.220:3260 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:27:30 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:27:30 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[a833328c-1c13-47e5-8971-4633202c69b3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:27:30 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de3378f-c24c-4ead-8243-6425ead3bf0d tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 17 01:27:30 user nova-compute[75226]:  {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:27:30 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14 -p 172.16.0.220:3260 --interface default --op new {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:27:30 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:27:30 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[85d39c95-1a6a-4e9b-a5a4-644d306119c4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14] added\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:27:30 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de3378f-c24c-4ead-8243-6425ead3bf0d tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14] added
Nov 17 01:27:30 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:27:30 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:27:30 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:27:30 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ce777ed-8a16-46b0-807d-196aa139d8b5]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:27:30 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de3378f-c24c-4ead-8243-6425ead3bf0d tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:27:30 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:27:30 user nova-compute[75226]: DEBUG nova.virt.libvirt.guest [None req-ac79b949-4e72-47cc-8002-aefdd273f045 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75226) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 17 01:27:30 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:27:30 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[61f4821e-5fe1-4323-a1fc-2d8f5dfef502]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:27:30 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de3378f-c24c-4ead-8243-6425ead3bf0d tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:27:30 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EwKBfZbN {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:27:30 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EwKBfZbN" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:27:30 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[64ed62d0-a0f0-4a2d-ad89-a1e2e1f39200]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:27:30 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de3378f-c24c-4ead-8243-6425ead3bf0d tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EwKBfZbN'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:27:30 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:27:30 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:27:30 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b1b0c69-0b4c-447c-94ed-3ac21acc83b2]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:27:30 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de3378f-c24c-4ead-8243-6425ead3bf0d tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:27:30 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:27:30 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:27:30 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a445958-df65-4d7a-8726-92e9f46dafd0]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29701267-6547-48b4-befc-b18ec2ab5e2c (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:27:30 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de3378f-c24c-4ead-8243-6425ead3bf0d tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)
Nov 17 01:27:30 user nova-compute[75226]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29701267-6547-48b4-befc-b18ec2ab5e2c (non-flash)
Nov 17 01:27:30 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:27:30 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de3378f-c24c-4ead-8243-6425ead3bf0d tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)
Nov 17 01:27:30 user nova-compute[75226]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29701267-6547-48b4-befc-b18ec2ab5e2c (non-flash)
Nov 17 01:27:30 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:27:30 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14 -p 172.16.0.220:3260 --login {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:27:30 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:27:30 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[db0b044e-fd3e-40e3-9d76-1dfffc895f99]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:27:30 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de3378f-c24c-4ead-8243-6425ead3bf0d tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14, portal: 172.16.0.220,3260]
Nov 17 01:27:30 user nova-compute[75226]: Login to [iface: default, target: iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14, portal: 172.16.0.220,3260] successful.
Nov 17 01:27:30 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:27:30 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:27:30 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:27:30 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[572af68b-bc7a-4ae7-a179-57d1eb86d318]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:27:30 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de3378f-c24c-4ead-8243-6425ead3bf0d tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:27:30 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:27:30 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:27:30 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d7906c2-338f-4229-9ed2-0946d6f0211a]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29701267-6547-48b4-befc-b18ec2ab5e2c (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:27:30 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de3378f-c24c-4ead-8243-6425ead3bf0d tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)
Nov 17 01:27:30 user nova-compute[75226]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29701267-6547-48b4-befc-b18ec2ab5e2c (non-flash)
Nov 17 01:27:30 user nova-compute[75226]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14 (non-flash)
Nov 17 01:27:30 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:27:30 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de3378f-c24c-4ead-8243-6425ead3bf0d tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)
Nov 17 01:27:30 user nova-compute[75226]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29701267-6547-48b4-befc-b18ec2ab5e2c (non-flash)
Nov 17 01:27:30 user nova-compute[75226]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14 (non-flash)
Nov 17 01:27:30 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:27:30 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-2de3378f-c24c-4ead-8243-6425ead3bf0d tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.308s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:27:30 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de3378f-c24c-4ead-8243-6425ead3bf0d tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Connected to 172.16.0.220:3260 {{(pid=75226) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 17 01:27:30 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-2de3378f-c24c-4ead-8243-6425ead3bf0d tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] HCTL ('35', '-', '-', 0) found on session 27 with lun 0 {{(pid=75226) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 17 01:27:30 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-2de3378f-c24c-4ead-8243-6425ead3bf0d tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75226) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 17 01:27:30 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:27:30 user nova-compute[75226]: INFO nova.compute.manager [None req-446e137d-2a48-477d-a7c4-b0ad33cf3553 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] [instance: 5c280142-8901-4f83-bde4-baaa097e05b0] Rescuing
Nov 17 01:27:30 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-446e137d-2a48-477d-a7c4-b0ad33cf3553 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Acquiring lock "refresh_cache-5c280142-8901-4f83-bde4-baaa097e05b0" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:27:30 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-446e137d-2a48-477d-a7c4-b0ad33cf3553 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Acquired lock "refresh_cache-5c280142-8901-4f83-bde4-baaa097e05b0" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:27:30 user nova-compute[75226]: DEBUG nova.network.neutron [None req-446e137d-2a48-477d-a7c4-b0ad33cf3553 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] [instance: 5c280142-8901-4f83-bde4-baaa097e05b0] Building network info cache for instance {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 01:27:30 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:27:30 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c206264-0b62-4f32-9535-b5c20e586751]: (4, ('- - 0', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:27:30 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-2de3378f-c24c-4ead-8243-6425ead3bf0d tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Searching for a device in session 27 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75226) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 01:27:30 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de3378f-c24c-4ead-8243-6425ead3bf0d tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EwKBfZbN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75226) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 17 01:27:31 user nova-compute[75226]: DEBUG nova.virt.libvirt.guest [None req-ac79b949-4e72-47cc-8002-aefdd273f045 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75226) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 17 01:27:31 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-ac79b949-4e72-47cc-8002-aefdd273f045 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 2ea5a14b-c330-4a2b-926e-60e1b30f5981] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 17 01:27:31 user nova-compute[75226]: DEBUG nova.privsep.utils [None req-ac79b949-4e72-47cc-8002-aefdd273f045 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75226) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 17 01:27:31 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-ac79b949-4e72-47cc-8002-aefdd273f045 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpkx_wx6qm/fdf0511318814a7093eb895569b3a5ea.delta /opt/stack/data/nova/instances/snapshots/tmpkx_wx6qm/fdf0511318814a7093eb895569b3a5ea {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:27:31 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-ac79b949-4e72-47cc-8002-aefdd273f045 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpkx_wx6qm/fdf0511318814a7093eb895569b3a5ea.delta /opt/stack/data/nova/instances/snapshots/tmpkx_wx6qm/fdf0511318814a7093eb895569b3a5ea" returned: 0 in 0.359s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:27:31 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-ac79b949-4e72-47cc-8002-aefdd273f045 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 2ea5a14b-c330-4a2b-926e-60e1b30f5981] Snapshot extracted, beginning image upload
Nov 17 01:27:31 user nova-compute[75226]: DEBUG nova.network.neutron [None req-446e137d-2a48-477d-a7c4-b0ad33cf3553 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] [instance: 5c280142-8901-4f83-bde4-baaa097e05b0] Updating instance_info_cache with network_info: [{"id": "3f54cf07-6d64-4e03-a3f7-bab096a18e89", "address": "fa:16:3e:41:48:98", "network": {"id": "a9710b94-56f8-4cf6-9bb6-344b275e5bf2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-512340839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2052a37a068e4d948c57560c0f4445e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f54cf07-6d", "ovs_interfaceid": "3f54cf07-6d64-4e03-a3f7-bab096a18e89", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:27:31 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-446e137d-2a48-477d-a7c4-b0ad33cf3553 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Releasing lock "refresh_cache-5c280142-8901-4f83-bde4-baaa097e05b0" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:27:31 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:27:31 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:27:31 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-2de3378f-c24c-4ead-8243-6425ead3bf0d tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.344s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:27:31 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de3378f-c24c-4ead-8243-6425ead3bf0d tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] <== connect_volume: return (1347ms) {'type': 'block', 'scsi_wwn': '26331623137356337', 'path': '/dev/sdd'} {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:27:31 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2de3378f-c24c-4ead-8243-6425ead3bf0d tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: 4dcdd769-bbfe-48e8-a876-8b2072b7baeb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26331623137356337', 'path': '/dev/sdd'} {{(pid=75226) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 17 01:27:31 user nova-compute[75226]: DEBUG nova.objects.instance [None req-2de3378f-c24c-4ead-8243-6425ead3bf0d tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Lazy-loading 'flavor' on Instance uuid 4dcdd769-bbfe-48e8-a876-8b2072b7baeb {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:27:31 user nova-compute[75226]: DEBUG nova.virt.libvirt.guest [None req-2de3378f-c24c-4ead-8243-6425ead3bf0d tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] attach device xml: <disk type="block" device="disk">
Nov 17 01:27:31 user nova-compute[75226]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 01:27:31 user nova-compute[75226]:   <source dev="/dev/sdd"/>
Nov 17 01:27:31 user nova-compute[75226]:   <target dev="vdb" bus="virtio"/>
Nov 17 01:27:31 user nova-compute[75226]:   <serial>528da57f-3100-4711-849f-f7a3a30ced14</serial>
Nov 17 01:27:31 user nova-compute[75226]: </disk>
Nov 17 01:27:31 user nova-compute[75226]:  {{(pid=75226) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 17 01:27:31 user nova-compute[75226]: DEBUG nova.compute.manager [req-afbb395e-ff6c-4b93-b20a-e6d4dfaa04fd req-ae614ed6-1fb2-42d4-938c-d7aae6a94561 service nova] [instance: 5c280142-8901-4f83-bde4-baaa097e05b0] Received event network-vif-unplugged-3f54cf07-6d64-4e03-a3f7-bab096a18e89 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:27:32 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-afbb395e-ff6c-4b93-b20a-e6d4dfaa04fd req-ae614ed6-1fb2-42d4-938c-d7aae6a94561 service nova] Acquiring lock "5c280142-8901-4f83-bde4-baaa097e05b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:27:32 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-afbb395e-ff6c-4b93-b20a-e6d4dfaa04fd req-ae614ed6-1fb2-42d4-938c-d7aae6a94561 service nova] Lock "5c280142-8901-4f83-bde4-baaa097e05b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:27:32 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-afbb395e-ff6c-4b93-b20a-e6d4dfaa04fd req-ae614ed6-1fb2-42d4-938c-d7aae6a94561 service nova] Lock "5c280142-8901-4f83-bde4-baaa097e05b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:27:32 user nova-compute[75226]: DEBUG nova.compute.manager [req-afbb395e-ff6c-4b93-b20a-e6d4dfaa04fd req-ae614ed6-1fb2-42d4-938c-d7aae6a94561 service nova] [instance: 5c280142-8901-4f83-bde4-baaa097e05b0] No waiting events found dispatching network-vif-unplugged-3f54cf07-6d64-4e03-a3f7-bab096a18e89 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:27:32 user nova-compute[75226]: WARNING nova.compute.manager [req-afbb395e-ff6c-4b93-b20a-e6d4dfaa04fd req-ae614ed6-1fb2-42d4-938c-d7aae6a94561 service nova] [instance: 5c280142-8901-4f83-bde4-baaa097e05b0] Received unexpected event network-vif-unplugged-3f54cf07-6d64-4e03-a3f7-bab096a18e89 for instance with vm_state active and task_state rescuing.
Nov 17 01:27:32 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:27:32 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:27:32 user nova-compute[75226]: INFO nova.virt.libvirt.driver [-] [instance: 5c280142-8901-4f83-bde4-baaa097e05b0] Instance destroyed successfully.
Nov 17 01:27:32 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-446e137d-2a48-477d-a7c4-b0ad33cf3553 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] [instance: 5c280142-8901-4f83-bde4-baaa097e05b0] Attempting rescue
Nov 17 01:27:32 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-446e137d-2a48-477d-a7c4-b0ad33cf3553 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75226) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 17 01:27:32 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-446e137d-2a48-477d-a7c4-b0ad33cf3553 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] [instance: 5c280142-8901-4f83-bde4-baaa097e05b0] Instance directory exists: not creating {{(pid=75226) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 17 01:27:32 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-446e137d-2a48-477d-a7c4-b0ad33cf3553 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] [instance: 5c280142-8901-4f83-bde4-baaa097e05b0] Creating image(s)
Nov 17 01:27:32 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-446e137d-2a48-477d-a7c4-b0ad33cf3553 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Acquiring lock "/opt/stack/data/nova/instances/5c280142-8901-4f83-bde4-baaa097e05b0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:27:32 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-446e137d-2a48-477d-a7c4-b0ad33cf3553 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Lock "/opt/stack/data/nova/instances/5c280142-8901-4f83-bde4-baaa097e05b0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:27:32 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-446e137d-2a48-477d-a7c4-b0ad33cf3553 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Lock "/opt/stack/data/nova/instances/5c280142-8901-4f83-bde4-baaa097e05b0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:27:32 user nova-compute[75226]: DEBUG nova.objects.instance [None req-446e137d-2a48-477d-a7c4-b0ad33cf3553 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Lazy-loading 'trusted_certs' on Instance uuid 5c280142-8901-4f83-bde4-baaa097e05b0 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:27:32 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-446e137d-2a48-477d-a7c4-b0ad33cf3553 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Acquiring lock "a8a62c2546af3a2036b853250c5ac64d4c6b4371" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:27:32 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-446e137d-2a48-477d-a7c4-b0ad33cf3553 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Lock "a8a62c2546af3a2036b853250c5ac64d4c6b4371" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:27:32 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-446e137d-2a48-477d-a7c4-b0ad33cf3553 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:27:32 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-2de3378f-c24c-4ead-8243-6425ead3bf0d tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] No BDM found with device name vda, not building metadata. {{(pid=75226) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 01:27:32 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-2de3378f-c24c-4ead-8243-6425ead3bf0d tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75226) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 01:27:32 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-2de3378f-c24c-4ead-8243-6425ead3bf0d tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] No VIF found with MAC fa:16:3e:a8:19:37, not building metadata {{(pid=75226) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 01:27:32 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-446e137d-2a48-477d-a7c4-b0ad33cf3553 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json" returned: 0 in 0.187s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:27:32 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-446e137d-2a48-477d-a7c4-b0ad33cf3553 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371,backing_fmt=raw /opt/stack/data/nova/instances/5c280142-8901-4f83-bde4-baaa097e05b0/disk.rescue {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:27:32 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-446e137d-2a48-477d-a7c4-b0ad33cf3553 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371,backing_fmt=raw /opt/stack/data/nova/instances/5c280142-8901-4f83-bde4-baaa097e05b0/disk.rescue" returned: 0 in 0.051s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:27:32 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-446e137d-2a48-477d-a7c4-b0ad33cf3553 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Lock "a8a62c2546af3a2036b853250c5ac64d4c6b4371" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:27:32 user nova-compute[75226]: DEBUG nova.objects.instance [None req-446e137d-2a48-477d-a7c4-b0ad33cf3553 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Lazy-loading 'migration_context' on Instance uuid 5c280142-8901-4f83-bde4-baaa097e05b0 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:27:32 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-2de3378f-c24c-4ead-8243-6425ead3bf0d tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Lock "4dcdd769-bbfe-48e8-a876-8b2072b7baeb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.916s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:27:32 user nova-compute[75226]: DEBUG nova.objects.base [None req-446e137d-2a48-477d-a7c4-b0ad33cf3553 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Object Instance<5c280142-8901-4f83-bde4-baaa097e05b0> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75226) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 17 01:27:32 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-446e137d-2a48-477d-a7c4-b0ad33cf3553 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] [instance: 5c280142-8901-4f83-bde4-baaa097e05b0] Created local disks {{(pid=75226) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 17 01:27:32 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-446e137d-2a48-477d-a7c4-b0ad33cf3553 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] [instance: 5c280142-8901-4f83-bde4-baaa097e05b0] Start _get_guest_xml network_info=[{"id": "3f54cf07-6d64-4e03-a3f7-bab096a18e89", "address": "fa:16:3e:41:48:98", "network": {"id": "a9710b94-56f8-4cf6-9bb6-344b275e5bf2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-512340839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-512340839-network", "vif_mac": "fa:16:3e:41:48:98"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2052a37a068e4d948c57560c0f4445e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f54cf07-6d", "ovs_interfaceid": "3f54cf07-6d64-4e03-a3f7-bab096a18e89", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T01:13:22Z,direct_url=<?>,disk_format='qcow2',id=0b369aea-6f3f-4690-9f01-229b90ab6310,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4e110cbf9a84362a6864a7732c435a1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T01:13:23Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '0b369aea-6f3f-4690-9f01-229b90ab6310', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75226) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 17 01:27:32 user nova-compute[75226]: DEBUG nova.objects.instance [None req-446e137d-2a48-477d-a7c4-b0ad33cf3553 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Lazy-loading 'resources' on Instance uuid 5c280142-8901-4f83-bde4-baaa097e05b0 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:27:32 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:27:32 user nova-compute[75226]: DEBUG nova.objects.base [None req-446e137d-2a48-477d-a7c4-b0ad33cf3553 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Object Instance<5c280142-8901-4f83-bde4-baaa097e05b0> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75226) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 17 01:27:32 user nova-compute[75226]: DEBUG nova.objects.instance [None req-446e137d-2a48-477d-a7c4-b0ad33cf3553 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Lazy-loading 'numa_topology' on Instance uuid 5c280142-8901-4f83-bde4-baaa097e05b0 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:27:32 user nova-compute[75226]: DEBUG nova.objects.base [None req-446e137d-2a48-477d-a7c4-b0ad33cf3553 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Object Instance<5c280142-8901-4f83-bde4-baaa097e05b0> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75226) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 17 01:27:32 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-446e137d-2a48-477d-a7c4-b0ad33cf3553 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:27:32 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-446e137d-2a48-477d-a7c4-b0ad33cf3553 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:27:32 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-446e137d-2a48-477d-a7c4-b0ad33cf3553 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75226) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 17 01:27:32 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-446e137d-2a48-477d-a7c4-b0ad33cf3553 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] CPU controller missing on host. {{(pid=75226) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 17 01:27:32 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-446e137d-2a48-477d-a7c4-b0ad33cf3553 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75226) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 17 01:27:32 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-446e137d-2a48-477d-a7c4-b0ad33cf3553 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] CPU controller found on host. {{(pid=75226) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 17 01:27:32 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-446e137d-2a48-477d-a7c4-b0ad33cf3553 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75226) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 17 01:27:32 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-446e137d-2a48-477d-a7c4-b0ad33cf3553 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-17T01:13:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T01:13:22Z,direct_url=<?>,disk_format='qcow2',id=0b369aea-6f3f-4690-9f01-229b90ab6310,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4e110cbf9a84362a6864a7732c435a1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T01:13:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 17 01:27:32 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-446e137d-2a48-477d-a7c4-b0ad33cf3553 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Flavor limits 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 17 01:27:32 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-446e137d-2a48-477d-a7c4-b0ad33cf3553 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Image limits 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 17 01:27:32 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-446e137d-2a48-477d-a7c4-b0ad33cf3553 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Flavor pref 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 17 01:27:32 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-446e137d-2a48-477d-a7c4-b0ad33cf3553 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Image pref 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 17 01:27:32 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-446e137d-2a48-477d-a7c4-b0ad33cf3553 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 17 01:27:32 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-446e137d-2a48-477d-a7c4-b0ad33cf3553 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 17 01:27:32 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-446e137d-2a48-477d-a7c4-b0ad33cf3553 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75226) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 17 01:27:32 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-446e137d-2a48-477d-a7c4-b0ad33cf3553 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Got 1 possible topologies {{(pid=75226) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 17 01:27:32 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-446e137d-2a48-477d-a7c4-b0ad33cf3553 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 17 01:27:32 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-446e137d-2a48-477d-a7c4-b0ad33cf3553 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 17 01:27:32 user nova-compute[75226]: DEBUG nova.objects.instance [None req-446e137d-2a48-477d-a7c4-b0ad33cf3553 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Lazy-loading 'vcpu_model' on Instance uuid 5c280142-8901-4f83-bde4-baaa097e05b0 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:27:32 user nova-compute[75226]: DEBUG nova.objects.base [None req-446e137d-2a48-477d-a7c4-b0ad33cf3553 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Object Instance<5c280142-8901-4f83-bde4-baaa097e05b0> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75226) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 17 01:27:32 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-446e137d-2a48-477d-a7c4-b0ad33cf3553 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:25:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1469039538',display_name='tempest-ServerRescueNegativeTestJSON-server-1469039538',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1469039538',id=26,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-17T01:25:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2052a37a068e4d948c57560c0f4445e4',ramdisk_id='',reservation_id='r-afes9mrt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-344970408',owner_user_name='tempest-ServerRescueNegativeTestJSON-344970408-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T01:25:49Z,user_data=None,user_id='12f405f1486a4f5187e628c60f223e98',uuid=5c280142-8901-4f83-bde4-baaa097e05b0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3f54cf07-6d64-4e03-a3f7-bab096a18e89", "address": "fa:16:3e:41:48:98", "network": {"id": "a9710b94-56f8-4cf6-9bb6-344b275e5bf2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-512340839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-512340839-network", "vif_mac": "fa:16:3e:41:48:98"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2052a37a068e4d948c57560c0f4445e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f54cf07-6d", "ovs_interfaceid": "3f54cf07-6d64-4e03-a3f7-bab096a18e89", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75226) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 01:27:32 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-446e137d-2a48-477d-a7c4-b0ad33cf3553 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Converting VIF {"id": "3f54cf07-6d64-4e03-a3f7-bab096a18e89", "address": "fa:16:3e:41:48:98", "network": {"id": "a9710b94-56f8-4cf6-9bb6-344b275e5bf2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-512340839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-512340839-network", "vif_mac": "fa:16:3e:41:48:98"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2052a37a068e4d948c57560c0f4445e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f54cf07-6d", "ovs_interfaceid": "3f54cf07-6d64-4e03-a3f7-bab096a18e89", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:27:32 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-446e137d-2a48-477d-a7c4-b0ad33cf3553 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:41:48:98,bridge_name='br-int',has_traffic_filtering=True,id=3f54cf07-6d64-4e03-a3f7-bab096a18e89,network=Network(a9710b94-56f8-4cf6-9bb6-344b275e5bf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f54cf07-6d') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:27:32 user nova-compute[75226]: DEBUG nova.objects.instance [None req-446e137d-2a48-477d-a7c4-b0ad33cf3553 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Lazy-loading 'pci_devices' on Instance uuid 5c280142-8901-4f83-bde4-baaa097e05b0 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:27:32 user nova-compute[75226]: DEBUG nova.objects.base [None req-446e137d-2a48-477d-a7c4-b0ad33cf3553 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Object Instance<5c280142-8901-4f83-bde4-baaa097e05b0> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75226) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 17 01:27:32 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-446e137d-2a48-477d-a7c4-b0ad33cf3553 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] [instance: 5c280142-8901-4f83-bde4-baaa097e05b0] End _get_guest_xml xml=<domain type="kvm">
Nov 17 01:27:32 user nova-compute[75226]:   <uuid>5c280142-8901-4f83-bde4-baaa097e05b0</uuid>
Nov 17 01:27:32 user nova-compute[75226]:   <name>instance-0000001a</name>
Nov 17 01:27:32 user nova-compute[75226]:   <memory>524288</memory>
Nov 17 01:27:32 user nova-compute[75226]:   <vcpu>1</vcpu>
Nov 17 01:27:32 user nova-compute[75226]:   <metadata>
Nov 17 01:27:32 user nova-compute[75226]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 17 01:27:32 user nova-compute[75226]:       <nova:package version="0.0.0"/>
Nov 17 01:27:32 user nova-compute[75226]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1469039538</nova:name>
Nov 17 01:27:32 user nova-compute[75226]:       <nova:creationTime>2023-11-17 01:27:32</nova:creationTime>
Nov 17 01:27:32 user nova-compute[75226]:       <nova:flavor name="m1.tiny">
Nov 17 01:27:32 user nova-compute[75226]:         <nova:memory>512</nova:memory>
Nov 17 01:27:32 user nova-compute[75226]:         <nova:disk>1</nova:disk>
Nov 17 01:27:32 user nova-compute[75226]:         <nova:swap>0</nova:swap>
Nov 17 01:27:32 user nova-compute[75226]:         <nova:ephemeral>0</nova:ephemeral>
Nov 17 01:27:32 user nova-compute[75226]:         <nova:vcpus>1</nova:vcpus>
Nov 17 01:27:32 user nova-compute[75226]:       </nova:flavor>
Nov 17 01:27:32 user nova-compute[75226]:       <nova:owner>
Nov 17 01:27:32 user nova-compute[75226]:         <nova:user uuid="12f405f1486a4f5187e628c60f223e98">tempest-ServerRescueNegativeTestJSON-344970408-project-member</nova:user>
Nov 17 01:27:32 user nova-compute[75226]:         <nova:project uuid="2052a37a068e4d948c57560c0f4445e4">tempest-ServerRescueNegativeTestJSON-344970408</nova:project>
Nov 17 01:27:32 user nova-compute[75226]:       </nova:owner>
Nov 17 01:27:32 user nova-compute[75226]:       <nova:root type="image" uuid="0b369aea-6f3f-4690-9f01-229b90ab6310"/>
Nov 17 01:27:32 user nova-compute[75226]:       <nova:ports>
Nov 17 01:27:32 user nova-compute[75226]:         <nova:port uuid="3f54cf07-6d64-4e03-a3f7-bab096a18e89">
Nov 17 01:27:32 user nova-compute[75226]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 17 01:27:32 user nova-compute[75226]:         </nova:port>
Nov 17 01:27:32 user nova-compute[75226]:       </nova:ports>
Nov 17 01:27:32 user nova-compute[75226]:     </nova:instance>
Nov 17 01:27:32 user nova-compute[75226]:   </metadata>
Nov 17 01:27:32 user nova-compute[75226]:   <sysinfo type="smbios">
Nov 17 01:27:32 user nova-compute[75226]:     <system>
Nov 17 01:27:32 user nova-compute[75226]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 17 01:27:32 user nova-compute[75226]:       <entry name="product">OpenStack Nova</entry>
Nov 17 01:27:32 user nova-compute[75226]:       <entry name="version">0.0.0</entry>
Nov 17 01:27:32 user nova-compute[75226]:       <entry name="serial">5c280142-8901-4f83-bde4-baaa097e05b0</entry>
Nov 17 01:27:32 user nova-compute[75226]:       <entry name="uuid">5c280142-8901-4f83-bde4-baaa097e05b0</entry>
Nov 17 01:27:32 user nova-compute[75226]:       <entry name="family">Virtual Machine</entry>
Nov 17 01:27:32 user nova-compute[75226]:     </system>
Nov 17 01:27:32 user nova-compute[75226]:   </sysinfo>
Nov 17 01:27:32 user nova-compute[75226]:   <os>
Nov 17 01:27:32 user nova-compute[75226]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 17 01:27:32 user nova-compute[75226]:     <smbios mode="sysinfo"/>
Nov 17 01:27:32 user nova-compute[75226]:   </os>
Nov 17 01:27:32 user nova-compute[75226]:   <features>
Nov 17 01:27:32 user nova-compute[75226]:     <acpi/>
Nov 17 01:27:32 user nova-compute[75226]:     <apic/>
Nov 17 01:27:32 user nova-compute[75226]:     <vmcoreinfo/>
Nov 17 01:27:32 user nova-compute[75226]:   </features>
Nov 17 01:27:32 user nova-compute[75226]:   <clock offset="utc">
Nov 17 01:27:32 user nova-compute[75226]:     <timer name="pit" tickpolicy="delay"/>
Nov 17 01:27:32 user nova-compute[75226]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 17 01:27:32 user nova-compute[75226]:     <timer name="hpet" present="no"/>
Nov 17 01:27:32 user nova-compute[75226]:   </clock>
Nov 17 01:27:32 user nova-compute[75226]:   <cpu mode="custom" match="exact">
Nov 17 01:27:32 user nova-compute[75226]:     <model>Nehalem</model>
Nov 17 01:27:32 user nova-compute[75226]:     <topology sockets="1" cores="1" threads="1"/>
Nov 17 01:27:32 user nova-compute[75226]:   </cpu>
Nov 17 01:27:32 user nova-compute[75226]:   <devices>
Nov 17 01:27:32 user nova-compute[75226]:     <disk type="file" device="disk">
Nov 17 01:27:32 user nova-compute[75226]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 17 01:27:32 user nova-compute[75226]:       <source file="/opt/stack/data/nova/instances/5c280142-8901-4f83-bde4-baaa097e05b0/disk.rescue"/>
Nov 17 01:27:32 user nova-compute[75226]:       <target dev="vda" bus="virtio"/>
Nov 17 01:27:32 user nova-compute[75226]:     </disk>
Nov 17 01:27:32 user nova-compute[75226]:     <disk type="file" device="disk">
Nov 17 01:27:32 user nova-compute[75226]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 17 01:27:32 user nova-compute[75226]:       <source file="/opt/stack/data/nova/instances/5c280142-8901-4f83-bde4-baaa097e05b0/disk"/>
Nov 17 01:27:32 user nova-compute[75226]:       <target dev="vdb" bus="virtio"/>
Nov 17 01:27:32 user nova-compute[75226]:     </disk>
Nov 17 01:27:32 user nova-compute[75226]:     <interface type="ethernet">
Nov 17 01:27:32 user nova-compute[75226]:       <mac address="fa:16:3e:41:48:98"/>
Nov 17 01:27:32 user nova-compute[75226]:       <model type="virtio"/>
Nov 17 01:27:32 user nova-compute[75226]:       <mtu size="1442"/>
Nov 17 01:27:32 user nova-compute[75226]:       <target dev="tap3f54cf07-6d"/>
Nov 17 01:27:32 user nova-compute[75226]:     </interface>
Nov 17 01:27:32 user nova-compute[75226]:     <serial type="pty">
Nov 17 01:27:32 user nova-compute[75226]:       <log file="/opt/stack/data/nova/instances/5c280142-8901-4f83-bde4-baaa097e05b0/console.log" append="off"/>
Nov 17 01:27:32 user nova-compute[75226]:     </serial>
Nov 17 01:27:32 user nova-compute[75226]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 17 01:27:32 user nova-compute[75226]:     <video>
Nov 17 01:27:32 user nova-compute[75226]:       <model type="virtio"/>
Nov 17 01:27:32 user nova-compute[75226]:     </video>
Nov 17 01:27:32 user nova-compute[75226]:     <rng model="virtio">
Nov 17 01:27:32 user nova-compute[75226]:       <backend model="random">/dev/urandom</backend>
Nov 17 01:27:32 user nova-compute[75226]:     </rng>
Nov 17 01:27:32 user nova-compute[75226]:     <controller type="usb" index="0" model="none"/>
Nov 17 01:27:32 user nova-compute[75226]:     <memballoon model="virtio">
Nov 17 01:27:32 user nova-compute[75226]:       <stats period="10"/>
Nov 17 01:27:32 user nova-compute[75226]:     </memballoon>
Nov 17 01:27:32 user nova-compute[75226]:   </devices>
Nov 17 01:27:32 user nova-compute[75226]: </domain>
Nov 17 01:27:32 user nova-compute[75226]:  {{(pid=75226) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 17 01:27:32 user nova-compute[75226]: INFO nova.virt.libvirt.driver [-] [instance: 5c280142-8901-4f83-bde4-baaa097e05b0] Instance destroyed successfully.
Nov 17 01:27:33 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-446e137d-2a48-477d-a7c4-b0ad33cf3553 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] No BDM found with device name vda, not building metadata. {{(pid=75226) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 01:27:33 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-446e137d-2a48-477d-a7c4-b0ad33cf3553 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75226) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 01:27:33 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-446e137d-2a48-477d-a7c4-b0ad33cf3553 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] No VIF found with MAC fa:16:3e:41:48:98, not building metadata {{(pid=75226) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 01:27:34 user nova-compute[75226]: DEBUG nova.compute.manager [req-886c4fc3-4c4d-4c41-8cee-ad38b9296239 req-c6a592dc-e6f6-4b1d-a761-661efebc5e54 service nova] [instance: 5c280142-8901-4f83-bde4-baaa097e05b0] Received event network-vif-plugged-3f54cf07-6d64-4e03-a3f7-bab096a18e89 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:27:34 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-886c4fc3-4c4d-4c41-8cee-ad38b9296239 req-c6a592dc-e6f6-4b1d-a761-661efebc5e54 service nova] Acquiring lock "5c280142-8901-4f83-bde4-baaa097e05b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:27:34 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-886c4fc3-4c4d-4c41-8cee-ad38b9296239 req-c6a592dc-e6f6-4b1d-a761-661efebc5e54 service nova] Lock "5c280142-8901-4f83-bde4-baaa097e05b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:27:34 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-886c4fc3-4c4d-4c41-8cee-ad38b9296239 req-c6a592dc-e6f6-4b1d-a761-661efebc5e54 service nova] Lock "5c280142-8901-4f83-bde4-baaa097e05b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:27:34 user nova-compute[75226]: DEBUG nova.compute.manager [req-886c4fc3-4c4d-4c41-8cee-ad38b9296239 req-c6a592dc-e6f6-4b1d-a761-661efebc5e54 service nova] [instance: 5c280142-8901-4f83-bde4-baaa097e05b0] No waiting events found dispatching network-vif-plugged-3f54cf07-6d64-4e03-a3f7-bab096a18e89 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:27:34 user nova-compute[75226]: WARNING nova.compute.manager [req-886c4fc3-4c4d-4c41-8cee-ad38b9296239 req-c6a592dc-e6f6-4b1d-a761-661efebc5e54 service nova] [instance: 5c280142-8901-4f83-bde4-baaa097e05b0] Received unexpected event network-vif-plugged-3f54cf07-6d64-4e03-a3f7-bab096a18e89 for instance with vm_state active and task_state rescuing.
Nov 17 01:27:34 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:27:34 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-ac79b949-4e72-47cc-8002-aefdd273f045 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 2ea5a14b-c330-4a2b-926e-60e1b30f5981] Snapshot image upload complete
Nov 17 01:27:34 user nova-compute[75226]: INFO nova.compute.manager [None req-ac79b949-4e72-47cc-8002-aefdd273f045 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 2ea5a14b-c330-4a2b-926e-60e1b30f5981] Took 5.15 seconds to snapshot the instance on the hypervisor.
Nov 17 01:27:34 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:27:34 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:27:34 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:27:34 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:27:34 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:27:34 user nova-compute[75226]: INFO nova.compute.manager [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: 4dcdd769-bbfe-48e8-a876-8b2072b7baeb] Rebuilding instance
Nov 17 01:27:34 user nova-compute[75226]: DEBUG nova.compute.manager [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: 4dcdd769-bbfe-48e8-a876-8b2072b7baeb] Checking state {{(pid=75226) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 01:27:34 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:27:34 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:27:35 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:27:35 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:27:35 user nova-compute[75226]: INFO nova.virt.libvirt.driver [-] [instance: 4dcdd769-bbfe-48e8-a876-8b2072b7baeb] Instance destroyed successfully.
Nov 17 01:27:35 user nova-compute[75226]: INFO nova.compute.manager [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: 4dcdd769-bbfe-48e8-a876-8b2072b7baeb] Detaching volume 528da57f-3100-4711-849f-f7a3a30ced14
Nov 17 01:27:35 user nova-compute[75226]: INFO nova.virt.block_device [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: 4dcdd769-bbfe-48e8-a876-8b2072b7baeb] Attempting to driver detach volume 528da57f-3100-4711-849f-f7a3a30ced14 from mountpoint /dev/vdb
Nov 17 01:27:35 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Attempting to detach device vdb from instance 4dcdd769-bbfe-48e8-a876-8b2072b7baeb from the persistent domain config. {{(pid=75226) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 17 01:27:35 user nova-compute[75226]: DEBUG nova.virt.libvirt.guest [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] detach device xml: <disk type="block" device="disk">
Nov 17 01:27:35 user nova-compute[75226]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 01:27:35 user nova-compute[75226]:   <source dev="/dev/sdd"/>
Nov 17 01:27:35 user nova-compute[75226]:   <target dev="vdb" bus="virtio"/>
Nov 17 01:27:35 user nova-compute[75226]:   <serial>528da57f-3100-4711-849f-f7a3a30ced14</serial>
Nov 17 01:27:35 user nova-compute[75226]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 17 01:27:35 user nova-compute[75226]: </disk>
Nov 17 01:27:35 user nova-compute[75226]:  {{(pid=75226) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 17 01:27:35 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Successfully detached device vdb from instance 4dcdd769-bbfe-48e8-a876-8b2072b7baeb from the persistent domain config.
Nov 17 01:27:35 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: 4dcdd769-bbfe-48e8-a876-8b2072b7baeb] calling os-brick to detach iSCSI Volume {{(pid=75226) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 17 01:27:35 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc4cc36b490>, {'target_iqn': 'iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EwKBfZbN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:27:35 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 17 01:27:35 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:27:35 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:27:35 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:27:36 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:27:36 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[2772a8aa-3d55-45da-868d-ba4a491f8ce7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:29701267-6547-48b4-befc-b18ec2ab5e2c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:27:36 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 17 01:27:36 user nova-compute[75226]: No targets found.
Nov 17 01:27:36 user nova-compute[75226]: iSNS:
Nov 17 01:27:36 user nova-compute[75226]: No targets found.
Nov 17 01:27:36 user nova-compute[75226]: STATIC:
Nov 17 01:27:36 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14
Nov 17 01:27:36 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:27:36 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:27:36 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8
Nov 17 01:27:36 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:27:36 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:27:36 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:29701267-6547-48b4-befc-b18ec2ab5e2c
Nov 17 01:27:36 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:27:36 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:27:36 user nova-compute[75226]: FIRMWARE:
Nov 17 01:27:36 user nova-compute[75226]: No targets found.
Nov 17 01:27:36 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:27:36 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 17 01:27:36 user nova-compute[75226]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 17 01:27:36 user nova-compute[75226]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75226) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 17 01:27:36 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14', 0)] {{(pid=75226) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 17 01:27:36 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:27:36 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:27:36 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[367945be-ded9-477e-97cf-b4df40862c7d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:29701267-6547-48b4-befc-b18ec2ab5e2c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:27:36 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:27:36 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:27:36 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[f21880a6-0cea-48e5-9778-fc7faed0ba16]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29701267-6547-48b4-befc-b18ec2ab5e2c (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:27:36 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)
Nov 17 01:27:36 user nova-compute[75226]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29701267-6547-48b4-befc-b18ec2ab5e2c (non-flash)
Nov 17 01:27:36 user nova-compute[75226]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14 (non-flash)
Nov 17 01:27:36 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:27:36 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)
Nov 17 01:27:36 user nova-compute[75226]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29701267-6547-48b4-befc-b18ec2ab5e2c (non-flash)
Nov 17 01:27:36 user nova-compute[75226]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14 (non-flash)
Nov 17 01:27:36 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:27:36 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc4d4c030a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14'): ({'sdd'}, set())}) {{(pid=75226) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 17 01:27:36 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Removing single pathed devices sdd {{(pid=75226) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 17 01:27:36 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:27:36 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:27:36 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[406e0ffa-8412-450b-ad9b-8230112e587e]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:27:36 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:27:36 user nova-compute[75226]: DEBUG nova.compute.manager [req-4e9cccd3-db3e-419d-8f0d-111b17e8e765 req-bbd956ad-a60b-435b-aa0f-70c34b06495b service nova] [instance: 5c280142-8901-4f83-bde4-baaa097e05b0] Received event network-vif-plugged-3f54cf07-6d64-4e03-a3f7-bab096a18e89 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:27:36 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-4e9cccd3-db3e-419d-8f0d-111b17e8e765 req-bbd956ad-a60b-435b-aa0f-70c34b06495b service nova] Acquiring lock "5c280142-8901-4f83-bde4-baaa097e05b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:27:36 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-4e9cccd3-db3e-419d-8f0d-111b17e8e765 req-bbd956ad-a60b-435b-aa0f-70c34b06495b service nova] Lock "5c280142-8901-4f83-bde4-baaa097e05b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:27:36 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-4e9cccd3-db3e-419d-8f0d-111b17e8e765 req-bbd956ad-a60b-435b-aa0f-70c34b06495b service nova] Lock "5c280142-8901-4f83-bde4-baaa097e05b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:27:36 user nova-compute[75226]: DEBUG nova.compute.manager [req-4e9cccd3-db3e-419d-8f0d-111b17e8e765 req-bbd956ad-a60b-435b-aa0f-70c34b06495b service nova] [instance: 5c280142-8901-4f83-bde4-baaa097e05b0] No waiting events found dispatching network-vif-plugged-3f54cf07-6d64-4e03-a3f7-bab096a18e89 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:27:36 user nova-compute[75226]: WARNING nova.compute.manager [req-4e9cccd3-db3e-419d-8f0d-111b17e8e765 req-bbd956ad-a60b-435b-aa0f-70c34b06495b service nova] [instance: 5c280142-8901-4f83-bde4-baaa097e05b0] Received unexpected event network-vif-plugged-3f54cf07-6d64-4e03-a3f7-bab096a18e89 for instance with vm_state active and task_state rescuing.
Nov 17 01:27:36 user nova-compute[75226]: DEBUG nova.compute.manager [req-4e9cccd3-db3e-419d-8f0d-111b17e8e765 req-bbd956ad-a60b-435b-aa0f-70c34b06495b service nova] [instance: 5c280142-8901-4f83-bde4-baaa097e05b0] Received event network-vif-plugged-3f54cf07-6d64-4e03-a3f7-bab096a18e89 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:27:36 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-4e9cccd3-db3e-419d-8f0d-111b17e8e765 req-bbd956ad-a60b-435b-aa0f-70c34b06495b service nova] Acquiring lock "5c280142-8901-4f83-bde4-baaa097e05b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:27:36 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-4e9cccd3-db3e-419d-8f0d-111b17e8e765 req-bbd956ad-a60b-435b-aa0f-70c34b06495b service nova] Lock "5c280142-8901-4f83-bde4-baaa097e05b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:27:36 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-4e9cccd3-db3e-419d-8f0d-111b17e8e765 req-bbd956ad-a60b-435b-aa0f-70c34b06495b service nova] Lock "5c280142-8901-4f83-bde4-baaa097e05b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:27:36 user nova-compute[75226]: DEBUG nova.compute.manager [req-4e9cccd3-db3e-419d-8f0d-111b17e8e765 req-bbd956ad-a60b-435b-aa0f-70c34b06495b service nova] [instance: 5c280142-8901-4f83-bde4-baaa097e05b0] No waiting events found dispatching network-vif-plugged-3f54cf07-6d64-4e03-a3f7-bab096a18e89 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:27:36 user nova-compute[75226]: WARNING nova.compute.manager [req-4e9cccd3-db3e-419d-8f0d-111b17e8e765 req-bbd956ad-a60b-435b-aa0f-70c34b06495b service nova] [instance: 5c280142-8901-4f83-bde4-baaa097e05b0] Received unexpected event network-vif-plugged-3f54cf07-6d64-4e03-a3f7-bab096a18e89 for instance with vm_state active and task_state rescuing.
Nov 17 01:27:36 user nova-compute[75226]: DEBUG nova.compute.manager [req-4e9cccd3-db3e-419d-8f0d-111b17e8e765 req-bbd956ad-a60b-435b-aa0f-70c34b06495b service nova] [instance: 4dcdd769-bbfe-48e8-a876-8b2072b7baeb] Received event network-vif-unplugged-89afa235-d910-4430-a95a-c173ba7a7048 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:27:36 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-4e9cccd3-db3e-419d-8f0d-111b17e8e765 req-bbd956ad-a60b-435b-aa0f-70c34b06495b service nova] Acquiring lock "4dcdd769-bbfe-48e8-a876-8b2072b7baeb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:27:36 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-4e9cccd3-db3e-419d-8f0d-111b17e8e765 req-bbd956ad-a60b-435b-aa0f-70c34b06495b service nova] Lock "4dcdd769-bbfe-48e8-a876-8b2072b7baeb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:27:36 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-4e9cccd3-db3e-419d-8f0d-111b17e8e765 req-bbd956ad-a60b-435b-aa0f-70c34b06495b service nova] Lock "4dcdd769-bbfe-48e8-a876-8b2072b7baeb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:27:36 user nova-compute[75226]: DEBUG nova.compute.manager [req-4e9cccd3-db3e-419d-8f0d-111b17e8e765 req-bbd956ad-a60b-435b-aa0f-70c34b06495b service nova] [instance: 4dcdd769-bbfe-48e8-a876-8b2072b7baeb] No waiting events found dispatching network-vif-unplugged-89afa235-d910-4430-a95a-c173ba7a7048 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:27:36 user nova-compute[75226]: WARNING nova.compute.manager [req-4e9cccd3-db3e-419d-8f0d-111b17e8e765 req-bbd956ad-a60b-435b-aa0f-70c34b06495b service nova] [instance: 4dcdd769-bbfe-48e8-a876-8b2072b7baeb] Received unexpected event network-vif-unplugged-89afa235-d910-4430-a95a-c173ba7a7048 for instance with vm_state active and task_state rebuilding.
Nov 17 01:27:36 user nova-compute[75226]: DEBUG nova.compute.manager [req-4e9cccd3-db3e-419d-8f0d-111b17e8e765 req-bbd956ad-a60b-435b-aa0f-70c34b06495b service nova] [instance: 4dcdd769-bbfe-48e8-a876-8b2072b7baeb] Received event network-vif-plugged-89afa235-d910-4430-a95a-c173ba7a7048 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:27:36 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-4e9cccd3-db3e-419d-8f0d-111b17e8e765 req-bbd956ad-a60b-435b-aa0f-70c34b06495b service nova] Acquiring lock "4dcdd769-bbfe-48e8-a876-8b2072b7baeb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:27:36 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-4e9cccd3-db3e-419d-8f0d-111b17e8e765 req-bbd956ad-a60b-435b-aa0f-70c34b06495b service nova] Lock "4dcdd769-bbfe-48e8-a876-8b2072b7baeb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:27:36 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-4e9cccd3-db3e-419d-8f0d-111b17e8e765 req-bbd956ad-a60b-435b-aa0f-70c34b06495b service nova] Lock "4dcdd769-bbfe-48e8-a876-8b2072b7baeb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:27:36 user nova-compute[75226]: DEBUG nova.compute.manager [req-4e9cccd3-db3e-419d-8f0d-111b17e8e765 req-bbd956ad-a60b-435b-aa0f-70c34b06495b service nova] [instance: 4dcdd769-bbfe-48e8-a876-8b2072b7baeb] No waiting events found dispatching network-vif-plugged-89afa235-d910-4430-a95a-c173ba7a7048 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:27:36 user nova-compute[75226]: WARNING nova.compute.manager [req-4e9cccd3-db3e-419d-8f0d-111b17e8e765 req-bbd956ad-a60b-435b-aa0f-70c34b06495b service nova] [instance: 4dcdd769-bbfe-48e8-a876-8b2072b7baeb] Received unexpected event network-vif-plugged-89afa235-d910-4430-a95a-c173ba7a7048 for instance with vm_state active and task_state rebuilding.
Nov 17 01:27:36 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:27:36 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[45ebf430-e31c-4da3-beca-b0aef0429164]: (4, ('ok\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:27:36 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Flushing IO for device /dev/sdd {{(pid=75226) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 17 01:27:36 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:27:36 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:27:36 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[1134ad47-9080-4d0d-b3a3-33c871498b35]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:27:36 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75226) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 17 01:27:36 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:27:36 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.061s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:27:36 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e047147-bfda-47c6-8d3b-d82d065d0f02]: (4, ('1', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:27:36 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75226) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 17 01:27:36 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] SCSI volumes sdd have been removed. {{(pid=75226) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 17 01:27:36 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14')] {{(pid=75226) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 17 01:27:36 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:27:36 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:27:36 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[10870016-86ad-4cb1-8084-13aac8709e1f]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:27:36 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:27:36 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14 -p 172.16.0.220:3260 --logout {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:27:36 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:27:36 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8766cb6-dd9d-47ee-846d-05162b750139]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:27:36 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14, portal: 172.16.0.220,3260]
Nov 17 01:27:36 user nova-compute[75226]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14, portal: 172.16.0.220,3260] successful.
Nov 17 01:27:36 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:27:36 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14 -p 172.16.0.220:3260 --op delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:27:36 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:27:36 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d7df543-af75-414b-ae6d-21068cb40513]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:27:36 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:27:36 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.343s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:27:36 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] <== disconnect_volume: return (344ms) None {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:27:36 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: 4dcdd769-bbfe-48e8-a876-8b2072b7baeb] Disconnected iSCSI Volume {{(pid=75226) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 17 01:27:36 user nova-compute[75226]: DEBUG nova.compute.manager [None req-446e137d-2a48-477d-a7c4-b0ad33cf3553 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] [instance: 5c280142-8901-4f83-bde4-baaa097e05b0] Checking state {{(pid=75226) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 01:27:37 user nova-compute[75226]: INFO nova.virt.libvirt.driver [-] [instance: 4dcdd769-bbfe-48e8-a876-8b2072b7baeb] Instance destroyed successfully.
Nov 17 01:27:37 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:25:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1264841713',display_name='tempest-ServerActionsTestOtherA-server-77073469',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1264841713',id=23,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGOKbwek9F3YeeXoISPpS9+FDOrqOAqUhG9ukSmG/2nvRhlXurk6SPlW7mGAsx4jOBi7d45LHSKFtCo2RRjgggrHiA9jsTNQAxfCNWgvK2lGzcNS8ikfzoMNKYvTRylwaw==',key_name='tempest-keypair-1621147487',keypairs=<?>,launch_index=0,launched_at=2023-11-17T01:25:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f9042fe4ecc245dd97553f6e942c3e05',ramdisk_id='',reservation_id='r-g0p6okz5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2125452149',owner_user_name='tempest-ServerActionsTestOtherA-2125452149-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T01:27:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a13dd8231937440185c9fc628c3bd5db',uuid=4dcdd769-bbfe-48e8-a876-8b2072b7baeb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "89afa235-d910-4430-a95a-c173ba7a7048", "address": "fa:16:3e:a8:19:37", "network": {"id": "9f39d3e5-b106-4bd9-b8ba-0f326e89c481", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-675861281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9042fe4ecc245dd97553f6e942c3e05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89afa235-d9", "ovs_interfaceid": "89afa235-d910-4430-a95a-c173ba7a7048", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 17 01:27:37 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Converting VIF {"id": "89afa235-d910-4430-a95a-c173ba7a7048", "address": "fa:16:3e:a8:19:37", "network": {"id": "9f39d3e5-b106-4bd9-b8ba-0f326e89c481", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-675861281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9042fe4ecc245dd97553f6e942c3e05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89afa235-d9", "ovs_interfaceid": "89afa235-d910-4430-a95a-c173ba7a7048", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:27:37 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a8:19:37,bridge_name='br-int',has_traffic_filtering=True,id=89afa235-d910-4430-a95a-c173ba7a7048,network=Network(9f39d3e5-b106-4bd9-b8ba-0f326e89c481),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89afa235-d9') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:27:37 user nova-compute[75226]: DEBUG os_vif [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a8:19:37,bridge_name='br-int',has_traffic_filtering=True,id=89afa235-d910-4430-a95a-c173ba7a7048,network=Network(9f39d3e5-b106-4bd9-b8ba-0f326e89c481),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89afa235-d9') {{(pid=75226) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 17 01:27:37 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:27:37 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap89afa235-d9, bridge=br-int, if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:27:37 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:27:37 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:27:37 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:27:37 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:27:37 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0ce68e13-7285-4ce7-b293-5e92fcfa5517) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:27:37 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:27:37 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:27:37 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:27:37 user nova-compute[75226]: INFO os_vif [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a8:19:37,bridge_name='br-int',has_traffic_filtering=True,id=89afa235-d910-4430-a95a-c173ba7a7048,network=Network(9f39d3e5-b106-4bd9-b8ba-0f326e89c481),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89afa235-d9')
Nov 17 01:27:37 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: 4dcdd769-bbfe-48e8-a876-8b2072b7baeb] calling os-brick to detach iSCSI Volume {{(pid=75226) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 17 01:27:37 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc4cc36b490>, {'target_iqn': 'iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EwKBfZbN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:27:37 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 17 01:27:37 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:27:37 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:27:37 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:27:37 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:27:37 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d51d127-955f-44b9-b4cb-ae8a65d2df20]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:29701267-6547-48b4-befc-b18ec2ab5e2c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:27:37 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 17 01:27:37 user nova-compute[75226]: No targets found.
Nov 17 01:27:37 user nova-compute[75226]: iSNS:
Nov 17 01:27:37 user nova-compute[75226]: No targets found.
Nov 17 01:27:37 user nova-compute[75226]: STATIC:
Nov 17 01:27:37 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8
Nov 17 01:27:37 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:27:37 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:27:37 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:29701267-6547-48b4-befc-b18ec2ab5e2c
Nov 17 01:27:37 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:27:37 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:27:37 user nova-compute[75226]: FIRMWARE:
Nov 17 01:27:37 user nova-compute[75226]: No targets found.
Nov 17 01:27:37 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:27:37 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 17 01:27:37 user nova-compute[75226]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 17 01:27:37 user nova-compute[75226]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75226) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 17 01:27:37 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14', 0)] {{(pid=75226) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 17 01:27:37 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:27:37 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:27:37 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbc7283b-3033-4c56-83f9-eb2b8d2e6d5d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:29701267-6547-48b4-befc-b18ec2ab5e2c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:27:37 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:27:37 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:27:37 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[72df0e51-e53e-4c39-b58b-cc2572bab4e8]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29701267-6547-48b4-befc-b18ec2ab5e2c (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:27:37 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)
Nov 17 01:27:37 user nova-compute[75226]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29701267-6547-48b4-befc-b18ec2ab5e2c (non-flash)
Nov 17 01:27:37 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:27:37 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)
Nov 17 01:27:37 user nova-compute[75226]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29701267-6547-48b4-befc-b18ec2ab5e2c (non-flash)
Nov 17 01:27:37 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:27:37 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc4b43ed480>, {}) {{(pid=75226) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 17 01:27:37 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Disconnecting from: [] {{(pid=75226) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 17 01:27:37 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.069s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:27:37 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] <== disconnect_volume: return (70ms) None {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:27:37 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: 4dcdd769-bbfe-48e8-a876-8b2072b7baeb] Disconnected iSCSI Volume {{(pid=75226) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 17 01:27:37 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: 4dcdd769-bbfe-48e8-a876-8b2072b7baeb] Deleting instance files /opt/stack/data/nova/instances/4dcdd769-bbfe-48e8-a876-8b2072b7baeb_del
Nov 17 01:27:37 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: 4dcdd769-bbfe-48e8-a876-8b2072b7baeb] Deletion of /opt/stack/data/nova/instances/4dcdd769-bbfe-48e8-a876-8b2072b7baeb_del complete
Nov 17 01:27:37 user nova-compute[75226]: INFO nova.virt.block_device [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: 4dcdd769-bbfe-48e8-a876-8b2072b7baeb] Booting with volume 528da57f-3100-4711-849f-f7a3a30ced14 at /dev/vdb
Nov 17 01:27:37 user nova-compute[75226]: DEBUG os_brick.utils [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:27:37 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:27:37 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:27:37 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[3feddf1a-5dd5-497b-b701-c50144f8a371]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f62857db69\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:27:37 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:27:37 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:27:37 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[a82fb7be-24b7-4126-9fd6-58cac336e4d0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:27:37 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:27:37 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:27:37 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[32725329-548f-4f56-b133-01582dbcf29e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:27:37 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[19002a65-987d-4e0b-a0b8-c8a8751f95bc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:27:37 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Running cmd (subprocess): nvme version {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:27:37 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] 'nvme version' failed. Not Retrying. {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 01:27:37 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.nvmeof [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] nvme not present on system {{(pid=75226) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 17 01:27:37 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:27:37 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 01:27:37 user nova-compute[75226]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 17 01:27:37 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a441022-a659-4a8e-97ad-8d54d71e7f9d]: (4, '') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:27:37 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75226) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 17 01:27:37 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75226) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 17 01:27:37 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] LIGHTOS: no hostnqn found. {{(pid=75226) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 17 01:27:37 user nova-compute[75226]: DEBUG os_brick.utils [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f62857db69', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:27:37 user nova-compute[75226]: DEBUG nova.virt.block_device [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: 4dcdd769-bbfe-48e8-a876-8b2072b7baeb] Updating existing volume attachment record: e096fd62-6134-4367-b014-8236038849eb {{(pid=75226) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 17 01:27:37 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-d274e320-acbd-44d1-9e53-ad07082f37e5 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Acquiring lock "346967c5-6945-4cef-9eea-8415cb27c98f" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:27:37 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-d274e320-acbd-44d1-9e53-ad07082f37e5 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Lock "346967c5-6945-4cef-9eea-8415cb27c98f" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:27:37 user nova-compute[75226]: INFO nova.compute.manager [None req-d274e320-acbd-44d1-9e53-ad07082f37e5 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] [instance: 346967c5-6945-4cef-9eea-8415cb27c98f] Unshelving
Nov 17 01:27:37 user nova-compute[75226]: INFO nova.virt.block_device [None req-d274e320-acbd-44d1-9e53-ad07082f37e5 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] [instance: 346967c5-6945-4cef-9eea-8415cb27c98f] Booting with volume c17ed19c-4452-4a79-b36a-07ddcd7d9404 at /dev/vda
Nov 17 01:27:37 user nova-compute[75226]: DEBUG os_brick.utils [None req-d274e320-acbd-44d1-9e53-ad07082f37e5 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:27:37 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:27:37 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:27:37 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[a33ae399-769c-4ccc-914b-7172205e2dd6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f62857db69\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:27:37 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:27:37 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:27:37 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[3942979a-ab35-4713-aa80-1db0b42c721f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:27:37 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:27:37 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.013s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:27:37 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[37e436e5-4181-4e90-8eee-80e2baa66ca6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:27:37 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa125f85-a093-4ca7-868f-8c32b251782e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:27:37 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-d274e320-acbd-44d1-9e53-ad07082f37e5 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Running cmd (subprocess): nvme version {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:27:37 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-d274e320-acbd-44d1-9e53-ad07082f37e5 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] 'nvme version' failed. Not Retrying. {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 01:27:37 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d274e320-acbd-44d1-9e53-ad07082f37e5 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] nvme not present on system {{(pid=75226) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 17 01:27:37 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:27:37 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 01:27:37 user nova-compute[75226]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 17 01:27:37 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[efd8300a-2938-444e-97d6-11b20cb98725]: (4, '') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:27:37 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-d274e320-acbd-44d1-9e53-ad07082f37e5 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75226) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 17 01:27:37 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-d274e320-acbd-44d1-9e53-ad07082f37e5 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75226) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 17 01:27:37 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-d274e320-acbd-44d1-9e53-ad07082f37e5 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] LIGHTOS: no hostnqn found. {{(pid=75226) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 17 01:27:37 user nova-compute[75226]: DEBUG os_brick.utils [None req-d274e320-acbd-44d1-9e53-ad07082f37e5 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f62857db69', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:27:37 user nova-compute[75226]: DEBUG nova.virt.block_device [None req-d274e320-acbd-44d1-9e53-ad07082f37e5 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] [instance: 346967c5-6945-4cef-9eea-8415cb27c98f] Updating existing volume attachment record: aa46282b-63c0-41f4-bc4d-4d9ac53f9659 {{(pid=75226) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 17 01:27:37 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:27:42 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:27:42 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:27:43 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: 4dcdd769-bbfe-48e8-a876-8b2072b7baeb] Creating instance directory {{(pid=75226) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 17 01:27:43 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: 4dcdd769-bbfe-48e8-a876-8b2072b7baeb] Creating image(s)
Nov 17 01:27:43 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Acquiring lock "/opt/stack/data/nova/instances/4dcdd769-bbfe-48e8-a876-8b2072b7baeb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:27:43 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Lock "/opt/stack/data/nova/instances/4dcdd769-bbfe-48e8-a876-8b2072b7baeb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:27:43 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Lock "/opt/stack/data/nova/instances/4dcdd769-bbfe-48e8-a876-8b2072b7baeb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:27:43 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:27:43 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json" returned: 0 in 0.186s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:27:43 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Acquiring lock "a8a62c2546af3a2036b853250c5ac64d4c6b4371" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:27:43 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Lock "a8a62c2546af3a2036b853250c5ac64d4c6b4371" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:27:43 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:27:43 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json" returned: 0 in 0.182s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:27:43 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371,backing_fmt=raw /opt/stack/data/nova/instances/4dcdd769-bbfe-48e8-a876-8b2072b7baeb/disk 1073741824 {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:27:43 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371,backing_fmt=raw /opt/stack/data/nova/instances/4dcdd769-bbfe-48e8-a876-8b2072b7baeb/disk 1073741824" returned: 0 in 0.058s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:27:43 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Lock "a8a62c2546af3a2036b853250c5ac64d4c6b4371" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.334s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:27:43 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:27:43 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json" returned: 0 in 0.189s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:27:43 user nova-compute[75226]: DEBUG nova.virt.disk.api [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4dcdd769-bbfe-48e8-a876-8b2072b7baeb/disk. size=1073741824 {{(pid=75226) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 17 01:27:43 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dcdd769-bbfe-48e8-a876-8b2072b7baeb/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:27:43 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-d274e320-acbd-44d1-9e53-ad07082f37e5 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:27:43 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-d274e320-acbd-44d1-9e53-ad07082f37e5 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:27:43 user nova-compute[75226]: DEBUG nova.objects.instance [None req-d274e320-acbd-44d1-9e53-ad07082f37e5 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Lazy-loading 'pci_requests' on Instance uuid 346967c5-6945-4cef-9eea-8415cb27c98f {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:27:43 user nova-compute[75226]: DEBUG nova.objects.instance [None req-d274e320-acbd-44d1-9e53-ad07082f37e5 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Lazy-loading 'numa_topology' on Instance uuid 346967c5-6945-4cef-9eea-8415cb27c98f {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:27:43 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-d274e320-acbd-44d1-9e53-ad07082f37e5 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75226) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 17 01:27:43 user nova-compute[75226]: INFO nova.compute.claims [None req-d274e320-acbd-44d1-9e53-ad07082f37e5 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] [instance: 346967c5-6945-4cef-9eea-8415cb27c98f] Claim successful on node user
Nov 17 01:27:44 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dcdd769-bbfe-48e8-a876-8b2072b7baeb/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:27:44 user nova-compute[75226]: DEBUG nova.virt.disk.api [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Cannot resize image /opt/stack/data/nova/instances/4dcdd769-bbfe-48e8-a876-8b2072b7baeb/disk to a smaller size. {{(pid=75226) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 17 01:27:44 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: 4dcdd769-bbfe-48e8-a876-8b2072b7baeb] Created local disks {{(pid=75226) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 17 01:27:44 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: 4dcdd769-bbfe-48e8-a876-8b2072b7baeb] Ensure instance console log exists: /opt/stack/data/nova/instances/4dcdd769-bbfe-48e8-a876-8b2072b7baeb/console.log {{(pid=75226) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 17 01:27:44 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:27:44 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:27:44 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:27:44 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: 4dcdd769-bbfe-48e8-a876-8b2072b7baeb] Start _get_guest_xml network_info=[{"id": "89afa235-d910-4430-a95a-c173ba7a7048", "address": "fa:16:3e:a8:19:37", "network": {"id": "9f39d3e5-b106-4bd9-b8ba-0f326e89c481", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-675861281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9042fe4ecc245dd97553f6e942c3e05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89afa235-d9", "ovs_interfaceid": "89afa235-d910-4430-a95a-c173ba7a7048", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T01:13:22Z,direct_url=<?>,disk_format='qcow2',id=0b369aea-6f3f-4690-9f01-229b90ab6310,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4e110cbf9a84362a6864a7732c435a1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T01:13:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '0b369aea-6f3f-4690-9f01-229b90ab6310'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'boot_index': None, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EwKBfZbN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4dcdd769-bbfe-48e8-a876-8b2072b7baeb', 'attached_at': '', 'detached_at': '', 'volume_id': '528da57f-3100-4711-849f-f7a3a30ced14', 'serial': '528da57f-3100-4711-849f-f7a3a30ced14'}, 'attachment_id': 'e096fd62-6134-4367-b014-8236038849eb', 'device_type': 'disk', 'volume_type': None} {{(pid=75226) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 17 01:27:44 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 17 01:27:44 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 17 01:27:44 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75226) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 17 01:27:44 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] CPU controller missing on host. {{(pid=75226) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 17 01:27:44 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75226) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 17 01:27:44 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] CPU controller found on host. {{(pid=75226) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 17 01:27:44 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75226) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 17 01:27:44 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-17T01:13:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T01:13:22Z,direct_url=<?>,disk_format='qcow2',id=0b369aea-6f3f-4690-9f01-229b90ab6310,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4e110cbf9a84362a6864a7732c435a1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T01:13:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 17 01:27:44 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Flavor limits 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 17 01:27:44 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Image limits 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 17 01:27:44 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Flavor pref 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 17 01:27:44 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Image pref 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 17 01:27:44 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 17 01:27:44 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 17 01:27:44 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75226) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 17 01:27:44 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Got 1 possible topologies {{(pid=75226) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 17 01:27:44 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 17 01:27:44 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 17 01:27:44 user nova-compute[75226]: DEBUG nova.objects.instance [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Lazy-loading 'vcpu_model' on Instance uuid 4dcdd769-bbfe-48e8-a876-8b2072b7baeb {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:27:44 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: 4dcdd769-bbfe-48e8-a876-8b2072b7baeb] Calling os-brick to attach iSCSI Volume {{(pid=75226) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 17 01:27:44 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc4cc36b490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EwKBfZbN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:27:44 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 17 01:27:44 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:27:44 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:27:44 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 17 01:27:44 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:27:44 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:27:44 user nova-compute[75226]: INFO os_brick.initiator.connectors.iscsi [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 17 01:27:44 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-1347f774-c6eb-485d-90fd-804f6e6752a8 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Acquiring lock "306054a8-4d0f-4913-b3b8-97aeeeec071c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:27:44 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-1347f774-c6eb-485d-90fd-804f6e6752a8 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Lock "306054a8-4d0f-4913-b3b8-97aeeeec071c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:27:44 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14 -p 172.16.0.220:3260 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:27:44 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:27:44 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8ea3c7f-69ee-4229-95f4-2427614f7a03]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:27:44 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 17 01:27:44 user nova-compute[75226]:  {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:27:44 user nova-compute[75226]: INFO nova.compute.manager [None req-1347f774-c6eb-485d-90fd-804f6e6752a8 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] [instance: 306054a8-4d0f-4913-b3b8-97aeeeec071c] Detaching volume 29701267-6547-48b4-befc-b18ec2ab5e2c
Nov 17 01:27:44 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14 -p 172.16.0.220:3260 --interface default --op new {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:27:44 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:27:44 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[694dbf7c-03bd-4e5d-aca4-4b3510472314]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14] added\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:27:44 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14] added
Nov 17 01:27:44 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:27:44 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:27:44 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:27:44 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[664b65b4-d9eb-4884-bfc9-921717bdba2c]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:27:44 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:27:44 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:27:44 user nova-compute[75226]: INFO nova.virt.block_device [None req-1347f774-c6eb-485d-90fd-804f6e6752a8 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] [instance: 306054a8-4d0f-4913-b3b8-97aeeeec071c] Attempting to driver detach volume 29701267-6547-48b4-befc-b18ec2ab5e2c from mountpoint /dev/vdc
Nov 17 01:27:44 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:27:44 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca849793-8e3e-4c25-8a99-95913a051d7c]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:27:44 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:27:44 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EwKBfZbN {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:27:44 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-1347f774-c6eb-485d-90fd-804f6e6752a8 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Attempting to detach device vdc from instance 306054a8-4d0f-4913-b3b8-97aeeeec071c from the persistent domain config. {{(pid=75226) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 17 01:27:44 user nova-compute[75226]: DEBUG nova.virt.libvirt.guest [None req-1347f774-c6eb-485d-90fd-804f6e6752a8 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] detach device xml: <disk type="block" device="disk">
Nov 17 01:27:44 user nova-compute[75226]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 01:27:44 user nova-compute[75226]:   <source dev="/dev/sdb"/>
Nov 17 01:27:44 user nova-compute[75226]:   <target dev="vdc" bus="virtio"/>
Nov 17 01:27:44 user nova-compute[75226]:   <serial>29701267-6547-48b4-befc-b18ec2ab5e2c</serial>
Nov 17 01:27:44 user nova-compute[75226]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 17 01:27:44 user nova-compute[75226]: </disk>
Nov 17 01:27:44 user nova-compute[75226]:  {{(pid=75226) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 17 01:27:44 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-1347f774-c6eb-485d-90fd-804f6e6752a8 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Successfully detached device vdc from instance 306054a8-4d0f-4913-b3b8-97aeeeec071c from the persistent domain config.
Nov 17 01:27:44 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-1347f774-c6eb-485d-90fd-804f6e6752a8 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 306054a8-4d0f-4913-b3b8-97aeeeec071c from the live domain config. {{(pid=75226) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 17 01:27:44 user nova-compute[75226]: DEBUG nova.virt.libvirt.guest [None req-1347f774-c6eb-485d-90fd-804f6e6752a8 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] detach device xml: <disk type="block" device="disk">
Nov 17 01:27:44 user nova-compute[75226]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 01:27:44 user nova-compute[75226]:   <source dev="/dev/sdb"/>
Nov 17 01:27:44 user nova-compute[75226]:   <target dev="vdc" bus="virtio"/>
Nov 17 01:27:44 user nova-compute[75226]:   <serial>29701267-6547-48b4-befc-b18ec2ab5e2c</serial>
Nov 17 01:27:44 user nova-compute[75226]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 17 01:27:44 user nova-compute[75226]: </disk>
Nov 17 01:27:44 user nova-compute[75226]:  {{(pid=75226) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 17 01:27:44 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EwKBfZbN" returned: 0 in 0.023s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:27:44 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[af8b5925-c8d6-44c5-bd79-131d3ceabdd6]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:27:44 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EwKBfZbN'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:27:44 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:27:44 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:27:44 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e96730b-7869-4053-88aa-4b0e31f8e544]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:27:44 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:27:44 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:27:44 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:27:44 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1599f19-7d1d-4829-bc4c-394475fe0fa0]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29701267-6547-48b4-befc-b18ec2ab5e2c (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:27:44 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)
Nov 17 01:27:44 user nova-compute[75226]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29701267-6547-48b4-befc-b18ec2ab5e2c (non-flash)
Nov 17 01:27:44 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:27:44 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)
Nov 17 01:27:44 user nova-compute[75226]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29701267-6547-48b4-befc-b18ec2ab5e2c (non-flash)
Nov 17 01:27:44 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:27:44 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14 -p 172.16.0.220:3260 --login {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:27:44 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:27:44 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4c76f82-2d03-4e2f-9052-3fb486252986]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:27:44 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14, portal: 172.16.0.220,3260]
Nov 17 01:27:44 user nova-compute[75226]: Login to [iface: default, target: iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14, portal: 172.16.0.220,3260] successful.
Nov 17 01:27:44 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:27:44 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:27:44 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:27:44 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3859879-5522-47dc-839a-2936610614a5]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:27:44 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:27:44 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:27:44 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-d274e320-acbd-44d1-9e53-ad07082f37e5 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:27:44 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-d274e320-acbd-44d1-9e53-ad07082f37e5 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:27:44 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:27:44 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aa897a5-0320-457e-8f68-30b6160d0b72]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29701267-6547-48b4-befc-b18ec2ab5e2c (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:27:44 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)
Nov 17 01:27:44 user nova-compute[75226]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29701267-6547-48b4-befc-b18ec2ab5e2c (non-flash)
Nov 17 01:27:44 user nova-compute[75226]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14 (non-flash)
Nov 17 01:27:44 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:27:44 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)
Nov 17 01:27:44 user nova-compute[75226]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29701267-6547-48b4-befc-b18ec2ab5e2c (non-flash)
Nov 17 01:27:44 user nova-compute[75226]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14 (non-flash)
Nov 17 01:27:44 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:27:44 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.337s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:27:44 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Connected to 172.16.0.220:3260 {{(pid=75226) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 17 01:27:44 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] HCTL ('35', '-', '-', 0) found on session 28 with lun 0 {{(pid=75226) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 17 01:27:44 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75226) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 17 01:27:44 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:27:44 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:27:44 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3983655-44b7-4bda-9baa-9abc157765f3]: (4, ('- - 0', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:27:44 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-d274e320-acbd-44d1-9e53-ad07082f37e5 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.597s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:27:44 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Searching for a device in session 28 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75226) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 01:27:44 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EwKBfZbN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75226) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 17 01:27:44 user nova-compute[75226]: INFO nova.network.neutron [None req-d274e320-acbd-44d1-9e53-ad07082f37e5 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] [instance: 346967c5-6945-4cef-9eea-8415cb27c98f] Updating port aa5b3af3-4cac-4a2f-93b8-3b6d378a3486 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 17 01:27:44 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-1347f774-c6eb-485d-90fd-804f6e6752a8 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 306054a8-4d0f-4913-b3b8-97aeeeec071c {{(pid=75226) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 17 01:27:45 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-d274e320-acbd-44d1-9e53-ad07082f37e5 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Acquiring lock "refresh_cache-346967c5-6945-4cef-9eea-8415cb27c98f" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:27:45 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-d274e320-acbd-44d1-9e53-ad07082f37e5 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Acquired lock "refresh_cache-346967c5-6945-4cef-9eea-8415cb27c98f" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:27:45 user nova-compute[75226]: DEBUG nova.network.neutron [None req-d274e320-acbd-44d1-9e53-ad07082f37e5 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] [instance: 346967c5-6945-4cef-9eea-8415cb27c98f] Building network info cache for instance {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 01:27:45 user nova-compute[75226]: DEBUG nova.compute.manager [req-7b0f51e4-d7de-4e06-aaed-e7eef5420fc5 req-21ac3df1-c3ba-4454-aa2f-cf6d823a7787 service nova] [instance: 346967c5-6945-4cef-9eea-8415cb27c98f] Received event network-changed-aa5b3af3-4cac-4a2f-93b8-3b6d378a3486 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:27:45 user nova-compute[75226]: DEBUG nova.compute.manager [req-7b0f51e4-d7de-4e06-aaed-e7eef5420fc5 req-21ac3df1-c3ba-4454-aa2f-cf6d823a7787 service nova] [instance: 346967c5-6945-4cef-9eea-8415cb27c98f] Refreshing instance network info cache due to event network-changed-aa5b3af3-4cac-4a2f-93b8-3b6d378a3486. {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 01:27:45 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-7b0f51e4-d7de-4e06-aaed-e7eef5420fc5 req-21ac3df1-c3ba-4454-aa2f-cf6d823a7787 service nova] Acquiring lock "refresh_cache-346967c5-6945-4cef-9eea-8415cb27c98f" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:27:45 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.375s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:27:45 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] <== connect_volume: return (1378ms) {'type': 'block', 'scsi_wwn': '26331623137356337', 'path': '/dev/sdd'} {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:27:45 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: 4dcdd769-bbfe-48e8-a876-8b2072b7baeb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26331623137356337', 'path': '/dev/sdd'} {{(pid=75226) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 17 01:27:45 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-17T01:25:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1264841713',display_name='tempest-ServerActionsTestOtherA-server-77073469',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1264841713',id=23,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGOKbwek9F3YeeXoISPpS9+FDOrqOAqUhG9ukSmG/2nvRhlXurk6SPlW7mGAsx4jOBi7d45LHSKFtCo2RRjgggrHiA9jsTNQAxfCNWgvK2lGzcNS8ikfzoMNKYvTRylwaw==',key_name='tempest-keypair-1621147487',keypairs=<?>,launch_index=0,launched_at=2023-11-17T01:25:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f9042fe4ecc245dd97553f6e942c3e05',ramdisk_id='',reservation_id='r-g0p6okz5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2125452149',owner_user_name='tempest-ServerActionsTestOtherA-2125452149-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T01:27:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a13dd8231937440185c9fc628c3bd5db',uuid=4dcdd769-bbfe-48e8-a876-8b2072b7baeb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "89afa235-d910-4430-a95a-c173ba7a7048", "address": "fa:16:3e:a8:19:37", "network": {"id": "9f39d3e5-b106-4bd9-b8ba-0f326e89c481", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-675861281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9042fe4ecc245dd97553f6e942c3e05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89afa235-d9", "ovs_interfaceid": "89afa235-d910-4430-a95a-c173ba7a7048", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75226) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 01:27:45 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Converting VIF {"id": "89afa235-d910-4430-a95a-c173ba7a7048", "address": "fa:16:3e:a8:19:37", "network": {"id": "9f39d3e5-b106-4bd9-b8ba-0f326e89c481", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-675861281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9042fe4ecc245dd97553f6e942c3e05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89afa235-d9", "ovs_interfaceid": "89afa235-d910-4430-a95a-c173ba7a7048", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:27:45 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a8:19:37,bridge_name='br-int',has_traffic_filtering=True,id=89afa235-d910-4430-a95a-c173ba7a7048,network=Network(9f39d3e5-b106-4bd9-b8ba-0f326e89c481),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89afa235-d9') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:27:45 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: 4dcdd769-bbfe-48e8-a876-8b2072b7baeb] End _get_guest_xml xml=<domain type="kvm">
Nov 17 01:27:45 user nova-compute[75226]:   <uuid>4dcdd769-bbfe-48e8-a876-8b2072b7baeb</uuid>
Nov 17 01:27:45 user nova-compute[75226]:   <name>instance-00000017</name>
Nov 17 01:27:45 user nova-compute[75226]:   <memory>524288</memory>
Nov 17 01:27:45 user nova-compute[75226]:   <vcpu>1</vcpu>
Nov 17 01:27:45 user nova-compute[75226]:   <metadata>
Nov 17 01:27:45 user nova-compute[75226]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 17 01:27:45 user nova-compute[75226]:       <nova:package version="0.0.0"/>
Nov 17 01:27:45 user nova-compute[75226]:       <nova:name>tempest-ServerActionsTestOtherA-server-77073469</nova:name>
Nov 17 01:27:45 user nova-compute[75226]:       <nova:creationTime>2023-11-17 01:27:44</nova:creationTime>
Nov 17 01:27:45 user nova-compute[75226]:       <nova:flavor name="m1.tiny">
Nov 17 01:27:45 user nova-compute[75226]:         <nova:memory>512</nova:memory>
Nov 17 01:27:45 user nova-compute[75226]:         <nova:disk>1</nova:disk>
Nov 17 01:27:45 user nova-compute[75226]:         <nova:swap>0</nova:swap>
Nov 17 01:27:45 user nova-compute[75226]:         <nova:ephemeral>0</nova:ephemeral>
Nov 17 01:27:45 user nova-compute[75226]:         <nova:vcpus>1</nova:vcpus>
Nov 17 01:27:45 user nova-compute[75226]:       </nova:flavor>
Nov 17 01:27:45 user nova-compute[75226]:       <nova:owner>
Nov 17 01:27:45 user nova-compute[75226]:         <nova:user uuid="a13dd8231937440185c9fc628c3bd5db">tempest-ServerActionsTestOtherA-2125452149-project-member</nova:user>
Nov 17 01:27:45 user nova-compute[75226]:         <nova:project uuid="f9042fe4ecc245dd97553f6e942c3e05">tempest-ServerActionsTestOtherA-2125452149</nova:project>
Nov 17 01:27:45 user nova-compute[75226]:       </nova:owner>
Nov 17 01:27:45 user nova-compute[75226]:       <nova:root type="image" uuid="0b369aea-6f3f-4690-9f01-229b90ab6310"/>
Nov 17 01:27:45 user nova-compute[75226]:       <nova:ports>
Nov 17 01:27:45 user nova-compute[75226]:         <nova:port uuid="89afa235-d910-4430-a95a-c173ba7a7048">
Nov 17 01:27:45 user nova-compute[75226]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 17 01:27:45 user nova-compute[75226]:         </nova:port>
Nov 17 01:27:45 user nova-compute[75226]:       </nova:ports>
Nov 17 01:27:45 user nova-compute[75226]:     </nova:instance>
Nov 17 01:27:45 user nova-compute[75226]:   </metadata>
Nov 17 01:27:45 user nova-compute[75226]:   <sysinfo type="smbios">
Nov 17 01:27:45 user nova-compute[75226]:     <system>
Nov 17 01:27:45 user nova-compute[75226]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 17 01:27:45 user nova-compute[75226]:       <entry name="product">OpenStack Nova</entry>
Nov 17 01:27:45 user nova-compute[75226]:       <entry name="version">0.0.0</entry>
Nov 17 01:27:45 user nova-compute[75226]:       <entry name="serial">4dcdd769-bbfe-48e8-a876-8b2072b7baeb</entry>
Nov 17 01:27:45 user nova-compute[75226]:       <entry name="uuid">4dcdd769-bbfe-48e8-a876-8b2072b7baeb</entry>
Nov 17 01:27:45 user nova-compute[75226]:       <entry name="family">Virtual Machine</entry>
Nov 17 01:27:45 user nova-compute[75226]:     </system>
Nov 17 01:27:45 user nova-compute[75226]:   </sysinfo>
Nov 17 01:27:45 user nova-compute[75226]:   <os>
Nov 17 01:27:45 user nova-compute[75226]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 17 01:27:45 user nova-compute[75226]:     <boot dev="hd"/>
Nov 17 01:27:45 user nova-compute[75226]:     <smbios mode="sysinfo"/>
Nov 17 01:27:45 user nova-compute[75226]:   </os>
Nov 17 01:27:45 user nova-compute[75226]:   <features>
Nov 17 01:27:45 user nova-compute[75226]:     <acpi/>
Nov 17 01:27:45 user nova-compute[75226]:     <apic/>
Nov 17 01:27:45 user nova-compute[75226]:     <vmcoreinfo/>
Nov 17 01:27:45 user nova-compute[75226]:   </features>
Nov 17 01:27:45 user nova-compute[75226]:   <clock offset="utc">
Nov 17 01:27:45 user nova-compute[75226]:     <timer name="pit" tickpolicy="delay"/>
Nov 17 01:27:45 user nova-compute[75226]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 17 01:27:45 user nova-compute[75226]:     <timer name="hpet" present="no"/>
Nov 17 01:27:45 user nova-compute[75226]:   </clock>
Nov 17 01:27:45 user nova-compute[75226]:   <cpu mode="custom" match="exact">
Nov 17 01:27:45 user nova-compute[75226]:     <model>Nehalem</model>
Nov 17 01:27:45 user nova-compute[75226]:     <topology sockets="1" cores="1" threads="1"/>
Nov 17 01:27:45 user nova-compute[75226]:   </cpu>
Nov 17 01:27:45 user nova-compute[75226]:   <devices>
Nov 17 01:27:45 user nova-compute[75226]:     <disk type="file" device="disk">
Nov 17 01:27:45 user nova-compute[75226]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 17 01:27:45 user nova-compute[75226]:       <source file="/opt/stack/data/nova/instances/4dcdd769-bbfe-48e8-a876-8b2072b7baeb/disk"/>
Nov 17 01:27:45 user nova-compute[75226]:       <target dev="vda" bus="virtio"/>
Nov 17 01:27:45 user nova-compute[75226]:     </disk>
Nov 17 01:27:45 user nova-compute[75226]:     <disk type="block" device="disk">
Nov 17 01:27:45 user nova-compute[75226]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 01:27:45 user nova-compute[75226]:       <source dev="/dev/sdd"/>
Nov 17 01:27:45 user nova-compute[75226]:       <target dev="vdb" bus="virtio"/>
Nov 17 01:27:45 user nova-compute[75226]:       <serial>528da57f-3100-4711-849f-f7a3a30ced14</serial>
Nov 17 01:27:45 user nova-compute[75226]:     </disk>
Nov 17 01:27:45 user nova-compute[75226]:     <interface type="ethernet">
Nov 17 01:27:45 user nova-compute[75226]:       <mac address="fa:16:3e:a8:19:37"/>
Nov 17 01:27:45 user nova-compute[75226]:       <model type="virtio"/>
Nov 17 01:27:45 user nova-compute[75226]:       <mtu size="1442"/>
Nov 17 01:27:45 user nova-compute[75226]:       <target dev="tap89afa235-d9"/>
Nov 17 01:27:45 user nova-compute[75226]:     </interface>
Nov 17 01:27:45 user nova-compute[75226]:     <serial type="pty">
Nov 17 01:27:45 user nova-compute[75226]:       <log file="/opt/stack/data/nova/instances/4dcdd769-bbfe-48e8-a876-8b2072b7baeb/console.log" append="off"/>
Nov 17 01:27:45 user nova-compute[75226]:     </serial>
Nov 17 01:27:45 user nova-compute[75226]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 17 01:27:45 user nova-compute[75226]:     <video>
Nov 17 01:27:45 user nova-compute[75226]:       <model type="virtio"/>
Nov 17 01:27:45 user nova-compute[75226]:     </video>
Nov 17 01:27:45 user nova-compute[75226]:     <rng model="virtio">
Nov 17 01:27:45 user nova-compute[75226]:       <backend model="random">/dev/urandom</backend>
Nov 17 01:27:45 user nova-compute[75226]:     </rng>
Nov 17 01:27:45 user nova-compute[75226]:     <controller type="usb" index="0" model="none"/>
Nov 17 01:27:45 user nova-compute[75226]:     <memballoon model="virtio">
Nov 17 01:27:45 user nova-compute[75226]:       <stats period="10"/>
Nov 17 01:27:45 user nova-compute[75226]:     </memballoon>
Nov 17 01:27:45 user nova-compute[75226]:   </devices>
Nov 17 01:27:45 user nova-compute[75226]: </domain>
Nov 17 01:27:45 user nova-compute[75226]:  {{(pid=75226) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 17 01:27:45 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-17T01:25:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1264841713',display_name='tempest-ServerActionsTestOtherA-server-77073469',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1264841713',id=23,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGOKbwek9F3YeeXoISPpS9+FDOrqOAqUhG9ukSmG/2nvRhlXurk6SPlW7mGAsx4jOBi7d45LHSKFtCo2RRjgggrHiA9jsTNQAxfCNWgvK2lGzcNS8ikfzoMNKYvTRylwaw==',key_name='tempest-keypair-1621147487',keypairs=<?>,launch_index=0,launched_at=2023-11-17T01:25:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f9042fe4ecc245dd97553f6e942c3e05',ramdisk_id='',reservation_id='r-g0p6okz5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2125452149',owner_user_name='tempest-ServerActionsTestOtherA-2125452149-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T01:27:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a13dd8231937440185c9fc628c3bd5db',uuid=4dcdd769-bbfe-48e8-a876-8b2072b7baeb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "89afa235-d910-4430-a95a-c173ba7a7048", "address": "fa:16:3e:a8:19:37", "network": {"id": "9f39d3e5-b106-4bd9-b8ba-0f326e89c481", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-675861281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9042fe4ecc245dd97553f6e942c3e05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89afa235-d9", "ovs_interfaceid": "89afa235-d910-4430-a95a-c173ba7a7048", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 17 01:27:45 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Converting VIF {"id": "89afa235-d910-4430-a95a-c173ba7a7048", "address": "fa:16:3e:a8:19:37", "network": {"id": "9f39d3e5-b106-4bd9-b8ba-0f326e89c481", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-675861281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9042fe4ecc245dd97553f6e942c3e05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89afa235-d9", "ovs_interfaceid": "89afa235-d910-4430-a95a-c173ba7a7048", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:27:45 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a8:19:37,bridge_name='br-int',has_traffic_filtering=True,id=89afa235-d910-4430-a95a-c173ba7a7048,network=Network(9f39d3e5-b106-4bd9-b8ba-0f326e89c481),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89afa235-d9') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:27:45 user nova-compute[75226]: DEBUG os_vif [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a8:19:37,bridge_name='br-int',has_traffic_filtering=True,id=89afa235-d910-4430-a95a-c173ba7a7048,network=Network(9f39d3e5-b106-4bd9-b8ba-0f326e89c481),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89afa235-d9') {{(pid=75226) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 17 01:27:45 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:27:45 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:27:45 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 17 01:27:45 user nova-compute[75226]: DEBUG nova.network.neutron [None req-d274e320-acbd-44d1-9e53-ad07082f37e5 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] [instance: 346967c5-6945-4cef-9eea-8415cb27c98f] Updating instance_info_cache with network_info: [{"id": "aa5b3af3-4cac-4a2f-93b8-3b6d378a3486", "address": "fa:16:3e:be:85:10", "network": {"id": "9335d73b-c260-49f3-8771-0dc21875a113", "bridge": "br-int", "label": "tempest-TestShelveInstance-1952470027-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adaa172aeff64609a273bdc271806238", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa5b3af3-4c", "ovs_interfaceid": "aa5b3af3-4cac-4a2f-93b8-3b6d378a3486", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:27:45 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:27:45 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '760ee461-27ab-5ccf-b27f-f857f8fbc15f', '_type': 'linux-noop'}}, row=False) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:27:45 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:27:45 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:27:45 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:27:45 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:27:45 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap89afa235-d9, may_exist=True, interface_attrs={}) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:27:45 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap89afa235-d9, col_values=(('qos', UUID('b6680288-00ed-458e-957d-d2f28ca11c41')),), if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:27:45 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap89afa235-d9, col_values=(('external_ids', {'iface-id': '89afa235-d910-4430-a95a-c173ba7a7048', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a8:19:37', 'vm-uuid': '4dcdd769-bbfe-48e8-a876-8b2072b7baeb'}),), if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:27:45 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-d274e320-acbd-44d1-9e53-ad07082f37e5 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Releasing lock "refresh_cache-346967c5-6945-4cef-9eea-8415cb27c98f" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:27:45 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-d274e320-acbd-44d1-9e53-ad07082f37e5 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] [instance: 346967c5-6945-4cef-9eea-8415cb27c98f] Creating instance directory {{(pid=75226) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 17 01:27:45 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-d274e320-acbd-44d1-9e53-ad07082f37e5 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] [instance: 346967c5-6945-4cef-9eea-8415cb27c98f] Creating image(s)
Nov 17 01:27:45 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-d274e320-acbd-44d1-9e53-ad07082f37e5 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] [instance: 346967c5-6945-4cef-9eea-8415cb27c98f] Did not create local disks {{(pid=75226) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 17 01:27:45 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-d274e320-acbd-44d1-9e53-ad07082f37e5 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] [instance: 346967c5-6945-4cef-9eea-8415cb27c98f] Ensure instance console log exists: /opt/stack/data/nova/instances/346967c5-6945-4cef-9eea-8415cb27c98f/console.log {{(pid=75226) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 17 01:27:45 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-d274e320-acbd-44d1-9e53-ad07082f37e5 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:27:45 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-d274e320-acbd-44d1-9e53-ad07082f37e5 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:27:45 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-d274e320-acbd-44d1-9e53-ad07082f37e5 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:27:45 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-d274e320-acbd-44d1-9e53-ad07082f37e5 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] [instance: 346967c5-6945-4cef-9eea-8415cb27c98f] Start _get_guest_xml network_info=[{"id": "aa5b3af3-4cac-4a2f-93b8-3b6d378a3486", "address": "fa:16:3e:be:85:10", "network": {"id": "9335d73b-c260-49f3-8771-0dc21875a113", "bridge": "br-int", "label": "tempest-TestShelveInstance-1952470027-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adaa172aeff64609a273bdc271806238", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa5b3af3-4c", "ovs_interfaceid": "aa5b3af3-4cac-4a2f-93b8-3b6d378a3486", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c17ed19c-4452-4a79-b36a-07ddcd7d9404', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LimvaOGH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '346967c5-6945-4cef-9eea-8415cb27c98f', 'attached_at': '', 'detached_at': '', 'volume_id': 'c17ed19c-4452-4a79-b36a-07ddcd7d9404', 'serial': 'c17ed19c-4452-4a79-b36a-07ddcd7d9404'}, 'attachment_id': 'aa46282b-63c0-41f4-bc4d-4d9ac53f9659', 'device_type': 'disk', 'volume_type': None} {{(pid=75226) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 17 01:27:45 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:27:45 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-7b0f51e4-d7de-4e06-aaed-e7eef5420fc5 req-21ac3df1-c3ba-4454-aa2f-cf6d823a7787 service nova] Acquired lock "refresh_cache-346967c5-6945-4cef-9eea-8415cb27c98f" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:27:45 user nova-compute[75226]: DEBUG nova.network.neutron [req-7b0f51e4-d7de-4e06-aaed-e7eef5420fc5 req-21ac3df1-c3ba-4454-aa2f-cf6d823a7787 service nova] [instance: 346967c5-6945-4cef-9eea-8415cb27c98f] Refreshing network info cache for port aa5b3af3-4cac-4a2f-93b8-3b6d378a3486 {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 01:27:45 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:27:45 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-d274e320-acbd-44d1-9e53-ad07082f37e5 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:27:45 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-d274e320-acbd-44d1-9e53-ad07082f37e5 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:27:45 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-d274e320-acbd-44d1-9e53-ad07082f37e5 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75226) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 17 01:27:45 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-d274e320-acbd-44d1-9e53-ad07082f37e5 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] CPU controller missing on host. {{(pid=75226) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 17 01:27:45 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:27:45 user nova-compute[75226]: INFO os_vif [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a8:19:37,bridge_name='br-int',has_traffic_filtering=True,id=89afa235-d910-4430-a95a-c173ba7a7048,network=Network(9f39d3e5-b106-4bd9-b8ba-0f326e89c481),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89afa235-d9')
Nov 17 01:27:45 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-d274e320-acbd-44d1-9e53-ad07082f37e5 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75226) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 17 01:27:45 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-d274e320-acbd-44d1-9e53-ad07082f37e5 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] CPU controller found on host. {{(pid=75226) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 17 01:27:45 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-d274e320-acbd-44d1-9e53-ad07082f37e5 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75226) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 17 01:27:45 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-d274e320-acbd-44d1-9e53-ad07082f37e5 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-17T01:13:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 17 01:27:45 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-d274e320-acbd-44d1-9e53-ad07082f37e5 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Flavor limits 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 17 01:27:45 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-d274e320-acbd-44d1-9e53-ad07082f37e5 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Image limits 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 17 01:27:45 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-d274e320-acbd-44d1-9e53-ad07082f37e5 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Flavor pref 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 17 01:27:45 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-d274e320-acbd-44d1-9e53-ad07082f37e5 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Image pref 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 17 01:27:45 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-d274e320-acbd-44d1-9e53-ad07082f37e5 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 17 01:27:45 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-d274e320-acbd-44d1-9e53-ad07082f37e5 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 17 01:27:45 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-d274e320-acbd-44d1-9e53-ad07082f37e5 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75226) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 17 01:27:45 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-d274e320-acbd-44d1-9e53-ad07082f37e5 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Got 1 possible topologies {{(pid=75226) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 17 01:27:45 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-d274e320-acbd-44d1-9e53-ad07082f37e5 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 17 01:27:45 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-d274e320-acbd-44d1-9e53-ad07082f37e5 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 17 01:27:45 user nova-compute[75226]: DEBUG nova.objects.instance [None req-d274e320-acbd-44d1-9e53-ad07082f37e5 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Lazy-loading 'vcpu_model' on Instance uuid 346967c5-6945-4cef-9eea-8415cb27c98f {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:27:45 user nova-compute[75226]: DEBUG nova.objects.base [None req-d274e320-acbd-44d1-9e53-ad07082f37e5 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Object Instance<346967c5-6945-4cef-9eea-8415cb27c98f> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=75226) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 17 01:27:45 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d274e320-acbd-44d1-9e53-ad07082f37e5 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] [instance: 346967c5-6945-4cef-9eea-8415cb27c98f] Calling os-brick to attach iSCSI Volume {{(pid=75226) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 17 01:27:45 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-d274e320-acbd-44d1-9e53-ad07082f37e5 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc4cc36b490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c17ed19c-4452-4a79-b36a-07ddcd7d9404', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LimvaOGH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:27:45 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-d274e320-acbd-44d1-9e53-ad07082f37e5 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:27:45 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-d274e320-acbd-44d1-9e53-ad07082f37e5 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:27:45 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-d274e320-acbd-44d1-9e53-ad07082f37e5 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:27:45 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-d274e320-acbd-44d1-9e53-ad07082f37e5 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:27:45 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-d274e320-acbd-44d1-9e53-ad07082f37e5 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c17ed19c-4452-4a79-b36a-07ddcd7d9404" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:27:45 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-d274e320-acbd-44d1-9e53-ad07082f37e5 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c17ed19c-4452-4a79-b36a-07ddcd7d9404" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:27:45 user nova-compute[75226]: INFO os_brick.initiator.connectors.iscsi [None req-d274e320-acbd-44d1-9e53-ad07082f37e5 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 17 01:27:45 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c17ed19c-4452-4a79-b36a-07ddcd7d9404 -p 172.16.0.220:3260 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:27:45 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c17ed19c-4452-4a79-b36a-07ddcd7d9404 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:27:45 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[e25865d9-4b68-4192-acac-c43f1f0f16b9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:27:45 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-d274e320-acbd-44d1-9e53-ad07082f37e5 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 17 01:27:45 user nova-compute[75226]:  {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:27:45 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c17ed19c-4452-4a79-b36a-07ddcd7d9404 -p 172.16.0.220:3260 --interface default --op new {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:27:45 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] No BDM found with device name vda, not building metadata. {{(pid=75226) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 01:27:45 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75226) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 01:27:45 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] No VIF found with MAC fa:16:3e:a8:19:37, not building metadata {{(pid=75226) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 01:27:45 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c17ed19c-4452-4a79-b36a-07ddcd7d9404 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:27:45 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[48628671-823b-45d3-b0ed-464b9c50bfa1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c17ed19c-4452-4a79-b36a-07ddcd7d9404] added\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:27:45 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-d274e320-acbd-44d1-9e53-ad07082f37e5 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c17ed19c-4452-4a79-b36a-07ddcd7d9404] added
Nov 17 01:27:45 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:27:45 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c17ed19c-4452-4a79-b36a-07ddcd7d9404 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:27:45 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c17ed19c-4452-4a79-b36a-07ddcd7d9404 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:27:45 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3def1ad-f955-4d90-ba07-ce11ec6f4efc]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:27:45 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-d274e320-acbd-44d1-9e53-ad07082f37e5 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:27:45 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c17ed19c-4452-4a79-b36a-07ddcd7d9404 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:27:45 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c17ed19c-4452-4a79-b36a-07ddcd7d9404 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:27:45 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ecf7adb-9679-48ed-91e0-171195864b7f]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:27:45 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-d274e320-acbd-44d1-9e53-ad07082f37e5 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:27:45 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c17ed19c-4452-4a79-b36a-07ddcd7d9404 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LimvaOGH {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:27:45 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c17ed19c-4452-4a79-b36a-07ddcd7d9404 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LimvaOGH" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:27:45 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ab61569-6833-4ae8-b0a8-ac8ea16d1ae6]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:27:45 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-d274e320-acbd-44d1-9e53-ad07082f37e5 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LimvaOGH'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:27:45 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c17ed19c-4452-4a79-b36a-07ddcd7d9404 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:27:45 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c17ed19c-4452-4a79-b36a-07ddcd7d9404 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:27:45 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[02834e4a-e011-4a83-a95c-820201b7e0ad]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:27:45 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-d274e320-acbd-44d1-9e53-ad07082f37e5 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:27:45 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:27:45 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:27:45 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[71e4054b-a587-4279-91ce-1db022814d0c]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29701267-6547-48b4-befc-b18ec2ab5e2c (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:27:45 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-d274e320-acbd-44d1-9e53-ad07082f37e5 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)
Nov 17 01:27:45 user nova-compute[75226]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29701267-6547-48b4-befc-b18ec2ab5e2c (non-flash)
Nov 17 01:27:45 user nova-compute[75226]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14 (non-flash)
Nov 17 01:27:45 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:27:45 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-d274e320-acbd-44d1-9e53-ad07082f37e5 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)
Nov 17 01:27:45 user nova-compute[75226]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29701267-6547-48b4-befc-b18ec2ab5e2c (non-flash)
Nov 17 01:27:45 user nova-compute[75226]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14 (non-flash)
Nov 17 01:27:45 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:27:45 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c17ed19c-4452-4a79-b36a-07ddcd7d9404 -p 172.16.0.220:3260 --login {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:27:45 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c17ed19c-4452-4a79-b36a-07ddcd7d9404 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:27:45 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2ba2885-f93c-4a6a-a48e-e8ebbb1149a2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c17ed19c-4452-4a79-b36a-07ddcd7d9404, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c17ed19c-4452-4a79-b36a-07ddcd7d9404, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:27:45 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-d274e320-acbd-44d1-9e53-ad07082f37e5 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c17ed19c-4452-4a79-b36a-07ddcd7d9404, portal: 172.16.0.220,3260]
Nov 17 01:27:45 user nova-compute[75226]: Login to [iface: default, target: iqn.2010-10.org.openstack:c17ed19c-4452-4a79-b36a-07ddcd7d9404, portal: 172.16.0.220,3260] successful.
Nov 17 01:27:45 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:27:45 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c17ed19c-4452-4a79-b36a-07ddcd7d9404 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:27:45 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c17ed19c-4452-4a79-b36a-07ddcd7d9404 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:27:45 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[8678ed86-3255-49d6-b299-504ad4271283]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:27:45 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-d274e320-acbd-44d1-9e53-ad07082f37e5 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:27:45 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:27:45 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:27:45 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e6403b2-669a-486a-8967-37f6c494dfcd]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29701267-6547-48b4-befc-b18ec2ab5e2c (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c17ed19c-4452-4a79-b36a-07ddcd7d9404 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:27:45 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-d274e320-acbd-44d1-9e53-ad07082f37e5 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)
Nov 17 01:27:45 user nova-compute[75226]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29701267-6547-48b4-befc-b18ec2ab5e2c (non-flash)
Nov 17 01:27:45 user nova-compute[75226]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14 (non-flash)
Nov 17 01:27:45 user nova-compute[75226]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c17ed19c-4452-4a79-b36a-07ddcd7d9404 (non-flash)
Nov 17 01:27:45 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:27:45 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-d274e320-acbd-44d1-9e53-ad07082f37e5 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)
Nov 17 01:27:45 user nova-compute[75226]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29701267-6547-48b4-befc-b18ec2ab5e2c (non-flash)
Nov 17 01:27:45 user nova-compute[75226]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14 (non-flash)
Nov 17 01:27:45 user nova-compute[75226]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c17ed19c-4452-4a79-b36a-07ddcd7d9404 (non-flash)
Nov 17 01:27:45 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:27:45 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-d274e320-acbd-44d1-9e53-ad07082f37e5 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c17ed19c-4452-4a79-b36a-07ddcd7d9404" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.276s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:27:45 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-d274e320-acbd-44d1-9e53-ad07082f37e5 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Connected to 172.16.0.220:3260 {{(pid=75226) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 17 01:27:45 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-d274e320-acbd-44d1-9e53-ad07082f37e5 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] HCTL ('36', '-', '-', 0) found on session 29 with lun 0 {{(pid=75226) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 17 01:27:45 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-d274e320-acbd-44d1-9e53-ad07082f37e5 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75226) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 17 01:27:45 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:27:45 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:27:45 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[f490d14a-d6b8-4751-a9c6-4629a66d7c26]: (4, ('- - 0', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:27:45 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-d274e320-acbd-44d1-9e53-ad07082f37e5 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Searching for a device in session 29 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75226) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 01:27:45 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-d274e320-acbd-44d1-9e53-ad07082f37e5 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:c17ed19c-4452-4a79-b36a-07ddcd7d9404', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LimvaOGH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75226) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 17 01:27:46 user nova-compute[75226]: DEBUG nova.network.neutron [req-7b0f51e4-d7de-4e06-aaed-e7eef5420fc5 req-21ac3df1-c3ba-4454-aa2f-cf6d823a7787 service nova] [instance: 346967c5-6945-4cef-9eea-8415cb27c98f] Updated VIF entry in instance network info cache for port aa5b3af3-4cac-4a2f-93b8-3b6d378a3486. {{(pid=75226) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 01:27:46 user nova-compute[75226]: DEBUG nova.network.neutron [req-7b0f51e4-d7de-4e06-aaed-e7eef5420fc5 req-21ac3df1-c3ba-4454-aa2f-cf6d823a7787 service nova] [instance: 346967c5-6945-4cef-9eea-8415cb27c98f] Updating instance_info_cache with network_info: [{"id": "aa5b3af3-4cac-4a2f-93b8-3b6d378a3486", "address": "fa:16:3e:be:85:10", "network": {"id": "9335d73b-c260-49f3-8771-0dc21875a113", "bridge": "br-int", "label": "tempest-TestShelveInstance-1952470027-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adaa172aeff64609a273bdc271806238", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa5b3af3-4c", "ovs_interfaceid": "aa5b3af3-4cac-4a2f-93b8-3b6d378a3486", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:27:46 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-7b0f51e4-d7de-4e06-aaed-e7eef5420fc5 req-21ac3df1-c3ba-4454-aa2f-cf6d823a7787 service nova] Releasing lock "refresh_cache-346967c5-6945-4cef-9eea-8415cb27c98f" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:27:46 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:27:46 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:27:46 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-d274e320-acbd-44d1-9e53-ad07082f37e5 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.311s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:27:46 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-d274e320-acbd-44d1-9e53-ad07082f37e5 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] <== connect_volume: return (1312ms) {'type': 'block', 'scsi_wwn': '26661623630623362', 'path': '/dev/sde'} {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:27:46 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d274e320-acbd-44d1-9e53-ad07082f37e5 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] [instance: 346967c5-6945-4cef-9eea-8415cb27c98f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26661623630623362', 'path': '/dev/sde'} {{(pid=75226) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 17 01:27:46 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:27:46 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:27:47 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-d274e320-acbd-44d1-9e53-ad07082f37e5 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-17T01:23:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1793645083',display_name='tempest-TestShelveInstance-server-1793645083',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1793645083',id=20,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-879048345',keypairs=<?>,launch_index=0,launched_at=2023-11-17T01:24:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='adaa172aeff64609a273bdc271806238',ramdisk_id='',reservation_id='r-rgcypk19',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1381460949',owner_user_name='tempest-TestShelveInstance-1381460949-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T01:27:38Z,user_data=None,user_id='ed6cfbd0e0124dd2a4092f0b087f416c',uuid=346967c5-6945-4cef-9eea-8415cb27c98f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "aa5b3af3-4cac-4a2f-93b8-3b6d378a3486", "address": "fa:16:3e:be:85:10", "network": {"id": "9335d73b-c260-49f3-8771-0dc21875a113", "bridge": "br-int", "label": "tempest-TestShelveInstance-1952470027-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adaa172aeff64609a273bdc271806238", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa5b3af3-4c", "ovs_interfaceid": "aa5b3af3-4cac-4a2f-93b8-3b6d378a3486", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75226) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 01:27:47 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-d274e320-acbd-44d1-9e53-ad07082f37e5 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Converting VIF {"id": "aa5b3af3-4cac-4a2f-93b8-3b6d378a3486", "address": "fa:16:3e:be:85:10", "network": {"id": "9335d73b-c260-49f3-8771-0dc21875a113", "bridge": "br-int", "label": "tempest-TestShelveInstance-1952470027-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adaa172aeff64609a273bdc271806238", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa5b3af3-4c", "ovs_interfaceid": "aa5b3af3-4cac-4a2f-93b8-3b6d378a3486", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:27:47 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-d274e320-acbd-44d1-9e53-ad07082f37e5 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:85:10,bridge_name='br-int',has_traffic_filtering=True,id=aa5b3af3-4cac-4a2f-93b8-3b6d378a3486,network=Network(9335d73b-c260-49f3-8771-0dc21875a113),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa5b3af3-4c') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:27:47 user nova-compute[75226]: DEBUG nova.objects.instance [None req-d274e320-acbd-44d1-9e53-ad07082f37e5 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Lazy-loading 'pci_devices' on Instance uuid 346967c5-6945-4cef-9eea-8415cb27c98f {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:27:47 user nova-compute[75226]: DEBUG nova.objects.base [None req-d274e320-acbd-44d1-9e53-ad07082f37e5 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Object Instance<346967c5-6945-4cef-9eea-8415cb27c98f> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=75226) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 17 01:27:47 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-d274e320-acbd-44d1-9e53-ad07082f37e5 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] [instance: 346967c5-6945-4cef-9eea-8415cb27c98f] End _get_guest_xml xml=<domain type="kvm">
Nov 17 01:27:47 user nova-compute[75226]:   <uuid>346967c5-6945-4cef-9eea-8415cb27c98f</uuid>
Nov 17 01:27:47 user nova-compute[75226]:   <name>instance-00000014</name>
Nov 17 01:27:47 user nova-compute[75226]:   <memory>524288</memory>
Nov 17 01:27:47 user nova-compute[75226]:   <vcpu>1</vcpu>
Nov 17 01:27:47 user nova-compute[75226]:   <metadata>
Nov 17 01:27:47 user nova-compute[75226]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 17 01:27:47 user nova-compute[75226]:       <nova:package version="0.0.0"/>
Nov 17 01:27:47 user nova-compute[75226]:       <nova:name>tempest-TestShelveInstance-server-1793645083</nova:name>
Nov 17 01:27:47 user nova-compute[75226]:       <nova:creationTime>2023-11-17 01:27:45</nova:creationTime>
Nov 17 01:27:47 user nova-compute[75226]:       <nova:flavor name="m1.tiny">
Nov 17 01:27:47 user nova-compute[75226]:         <nova:memory>512</nova:memory>
Nov 17 01:27:47 user nova-compute[75226]:         <nova:disk>1</nova:disk>
Nov 17 01:27:47 user nova-compute[75226]:         <nova:swap>0</nova:swap>
Nov 17 01:27:47 user nova-compute[75226]:         <nova:ephemeral>0</nova:ephemeral>
Nov 17 01:27:47 user nova-compute[75226]:         <nova:vcpus>1</nova:vcpus>
Nov 17 01:27:47 user nova-compute[75226]:       </nova:flavor>
Nov 17 01:27:47 user nova-compute[75226]:       <nova:owner>
Nov 17 01:27:47 user nova-compute[75226]:         <nova:user uuid="ed6cfbd0e0124dd2a4092f0b087f416c">tempest-TestShelveInstance-1381460949-project-member</nova:user>
Nov 17 01:27:47 user nova-compute[75226]:         <nova:project uuid="adaa172aeff64609a273bdc271806238">tempest-TestShelveInstance-1381460949</nova:project>
Nov 17 01:27:47 user nova-compute[75226]:       </nova:owner>
Nov 17 01:27:47 user nova-compute[75226]:       <nova:ports>
Nov 17 01:27:47 user nova-compute[75226]:         <nova:port uuid="aa5b3af3-4cac-4a2f-93b8-3b6d378a3486">
Nov 17 01:27:47 user nova-compute[75226]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 17 01:27:47 user nova-compute[75226]:         </nova:port>
Nov 17 01:27:47 user nova-compute[75226]:       </nova:ports>
Nov 17 01:27:47 user nova-compute[75226]:     </nova:instance>
Nov 17 01:27:47 user nova-compute[75226]:   </metadata>
Nov 17 01:27:47 user nova-compute[75226]:   <sysinfo type="smbios">
Nov 17 01:27:47 user nova-compute[75226]:     <system>
Nov 17 01:27:47 user nova-compute[75226]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 17 01:27:47 user nova-compute[75226]:       <entry name="product">OpenStack Nova</entry>
Nov 17 01:27:47 user nova-compute[75226]:       <entry name="version">0.0.0</entry>
Nov 17 01:27:47 user nova-compute[75226]:       <entry name="serial">346967c5-6945-4cef-9eea-8415cb27c98f</entry>
Nov 17 01:27:47 user nova-compute[75226]:       <entry name="uuid">346967c5-6945-4cef-9eea-8415cb27c98f</entry>
Nov 17 01:27:47 user nova-compute[75226]:       <entry name="family">Virtual Machine</entry>
Nov 17 01:27:47 user nova-compute[75226]:     </system>
Nov 17 01:27:47 user nova-compute[75226]:   </sysinfo>
Nov 17 01:27:47 user nova-compute[75226]:   <os>
Nov 17 01:27:47 user nova-compute[75226]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 17 01:27:47 user nova-compute[75226]:     <boot dev="hd"/>
Nov 17 01:27:47 user nova-compute[75226]:     <smbios mode="sysinfo"/>
Nov 17 01:27:47 user nova-compute[75226]:   </os>
Nov 17 01:27:47 user nova-compute[75226]:   <features>
Nov 17 01:27:47 user nova-compute[75226]:     <acpi/>
Nov 17 01:27:47 user nova-compute[75226]:     <apic/>
Nov 17 01:27:47 user nova-compute[75226]:     <vmcoreinfo/>
Nov 17 01:27:47 user nova-compute[75226]:   </features>
Nov 17 01:27:47 user nova-compute[75226]:   <clock offset="utc">
Nov 17 01:27:47 user nova-compute[75226]:     <timer name="pit" tickpolicy="delay"/>
Nov 17 01:27:47 user nova-compute[75226]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 17 01:27:47 user nova-compute[75226]:     <timer name="hpet" present="no"/>
Nov 17 01:27:47 user nova-compute[75226]:   </clock>
Nov 17 01:27:47 user nova-compute[75226]:   <cpu mode="custom" match="exact">
Nov 17 01:27:47 user nova-compute[75226]:     <model>Nehalem</model>
Nov 17 01:27:47 user nova-compute[75226]:     <topology sockets="1" cores="1" threads="1"/>
Nov 17 01:27:47 user nova-compute[75226]:   </cpu>
Nov 17 01:27:47 user nova-compute[75226]:   <devices>
Nov 17 01:27:47 user nova-compute[75226]:     <disk type="block" device="disk">
Nov 17 01:27:47 user nova-compute[75226]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 01:27:47 user nova-compute[75226]:       <source dev="/dev/sde"/>
Nov 17 01:27:47 user nova-compute[75226]:       <target dev="vda" bus="virtio"/>
Nov 17 01:27:47 user nova-compute[75226]:       <serial>c17ed19c-4452-4a79-b36a-07ddcd7d9404</serial>
Nov 17 01:27:47 user nova-compute[75226]:     </disk>
Nov 17 01:27:47 user nova-compute[75226]:     <interface type="ethernet">
Nov 17 01:27:47 user nova-compute[75226]:       <mac address="fa:16:3e:be:85:10"/>
Nov 17 01:27:47 user nova-compute[75226]:       <model type="virtio"/>
Nov 17 01:27:47 user nova-compute[75226]:       <mtu size="1442"/>
Nov 17 01:27:47 user nova-compute[75226]:       <target dev="tapaa5b3af3-4c"/>
Nov 17 01:27:47 user nova-compute[75226]:     </interface>
Nov 17 01:27:47 user nova-compute[75226]:     <serial type="pty">
Nov 17 01:27:47 user nova-compute[75226]:       <log file="/opt/stack/data/nova/instances/346967c5-6945-4cef-9eea-8415cb27c98f/console.log" append="off"/>
Nov 17 01:27:47 user nova-compute[75226]:     </serial>
Nov 17 01:27:47 user nova-compute[75226]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 17 01:27:47 user nova-compute[75226]:     <video>
Nov 17 01:27:47 user nova-compute[75226]:       <model type="virtio"/>
Nov 17 01:27:47 user nova-compute[75226]:     </video>
Nov 17 01:27:47 user nova-compute[75226]:     <rng model="virtio">
Nov 17 01:27:47 user nova-compute[75226]:       <backend model="random">/dev/urandom</backend>
Nov 17 01:27:47 user nova-compute[75226]:     </rng>
Nov 17 01:27:47 user nova-compute[75226]:     <controller type="usb" index="0" model="none"/>
Nov 17 01:27:47 user nova-compute[75226]:     <memballoon model="virtio">
Nov 17 01:27:47 user nova-compute[75226]:       <stats period="10"/>
Nov 17 01:27:47 user nova-compute[75226]:     </memballoon>
Nov 17 01:27:47 user nova-compute[75226]:   </devices>
Nov 17 01:27:47 user nova-compute[75226]: </domain>
Nov 17 01:27:47 user nova-compute[75226]:  {{(pid=75226) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 17 01:27:47 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-d274e320-acbd-44d1-9e53-ad07082f37e5 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-17T01:23:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1793645083',display_name='tempest-TestShelveInstance-server-1793645083',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1793645083',id=20,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-879048345',keypairs=<?>,launch_index=0,launched_at=2023-11-17T01:24:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='adaa172aeff64609a273bdc271806238',ramdisk_id='',reservation_id='r-rgcypk19',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1381460949',owner_user_name='tempest-TestShelveInstance-1381460949-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T01:27:38Z,user_data=None,user_id='ed6cfbd0e0124dd2a4092f0b087f416c',uuid=346967c5-6945-4cef-9eea-8415cb27c98f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "aa5b3af3-4cac-4a2f-93b8-3b6d378a3486", "address": "fa:16:3e:be:85:10", "network": {"id": "9335d73b-c260-49f3-8771-0dc21875a113", "bridge": "br-int", "label": "tempest-TestShelveInstance-1952470027-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adaa172aeff64609a273bdc271806238", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa5b3af3-4c", "ovs_interfaceid": "aa5b3af3-4cac-4a2f-93b8-3b6d378a3486", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 17 01:27:47 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-d274e320-acbd-44d1-9e53-ad07082f37e5 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Converting VIF {"id": "aa5b3af3-4cac-4a2f-93b8-3b6d378a3486", "address": "fa:16:3e:be:85:10", "network": {"id": "9335d73b-c260-49f3-8771-0dc21875a113", "bridge": "br-int", "label": "tempest-TestShelveInstance-1952470027-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adaa172aeff64609a273bdc271806238", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa5b3af3-4c", "ovs_interfaceid": "aa5b3af3-4cac-4a2f-93b8-3b6d378a3486", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:27:47 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-d274e320-acbd-44d1-9e53-ad07082f37e5 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:85:10,bridge_name='br-int',has_traffic_filtering=True,id=aa5b3af3-4cac-4a2f-93b8-3b6d378a3486,network=Network(9335d73b-c260-49f3-8771-0dc21875a113),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa5b3af3-4c') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:27:47 user nova-compute[75226]: DEBUG os_vif [None req-d274e320-acbd-44d1-9e53-ad07082f37e5 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:85:10,bridge_name='br-int',has_traffic_filtering=True,id=aa5b3af3-4cac-4a2f-93b8-3b6d378a3486,network=Network(9335d73b-c260-49f3-8771-0dc21875a113),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa5b3af3-4c') {{(pid=75226) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 17 01:27:47 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:27:47 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:27:47 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 17 01:27:47 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:27:47 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '05ad7611-498c-5437-8596-a47863006e65', '_type': 'linux-noop'}}, row=False) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:27:47 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:27:47 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:27:47 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:27:47 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:27:47 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaa5b3af3-4c, may_exist=True, interface_attrs={}) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:27:47 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapaa5b3af3-4c, col_values=(('qos', UUID('92ef469c-66c1-4ad6-87b7-88b52a5c277c')),), if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:27:47 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapaa5b3af3-4c, col_values=(('external_ids', {'iface-id': 'aa5b3af3-4cac-4a2f-93b8-3b6d378a3486', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:be:85:10', 'vm-uuid': '346967c5-6945-4cef-9eea-8415cb27c98f'}),), if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:27:47 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:27:47 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:27:47 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:27:47 user nova-compute[75226]: INFO os_vif [None req-d274e320-acbd-44d1-9e53-ad07082f37e5 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:85:10,bridge_name='br-int',has_traffic_filtering=True,id=aa5b3af3-4cac-4a2f-93b8-3b6d378a3486,network=Network(9335d73b-c260-49f3-8771-0dc21875a113),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa5b3af3-4c')
Nov 17 01:27:47 user nova-compute[75226]: DEBUG nova.compute.manager [req-05850286-77fa-4968-ba78-3832ccfbbd41 req-89bc9000-e2ae-4257-a606-53e56a87e0b1 service nova] [instance: 4dcdd769-bbfe-48e8-a876-8b2072b7baeb] Received event network-vif-plugged-89afa235-d910-4430-a95a-c173ba7a7048 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:27:47 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-05850286-77fa-4968-ba78-3832ccfbbd41 req-89bc9000-e2ae-4257-a606-53e56a87e0b1 service nova] Acquiring lock "4dcdd769-bbfe-48e8-a876-8b2072b7baeb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:27:47 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-05850286-77fa-4968-ba78-3832ccfbbd41 req-89bc9000-e2ae-4257-a606-53e56a87e0b1 service nova] Lock "4dcdd769-bbfe-48e8-a876-8b2072b7baeb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:27:47 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-05850286-77fa-4968-ba78-3832ccfbbd41 req-89bc9000-e2ae-4257-a606-53e56a87e0b1 service nova] Lock "4dcdd769-bbfe-48e8-a876-8b2072b7baeb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:27:47 user nova-compute[75226]: DEBUG nova.compute.manager [req-05850286-77fa-4968-ba78-3832ccfbbd41 req-89bc9000-e2ae-4257-a606-53e56a87e0b1 service nova] [instance: 4dcdd769-bbfe-48e8-a876-8b2072b7baeb] No waiting events found dispatching network-vif-plugged-89afa235-d910-4430-a95a-c173ba7a7048 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:27:47 user nova-compute[75226]: WARNING nova.compute.manager [req-05850286-77fa-4968-ba78-3832ccfbbd41 req-89bc9000-e2ae-4257-a606-53e56a87e0b1 service nova] [instance: 4dcdd769-bbfe-48e8-a876-8b2072b7baeb] Received unexpected event network-vif-plugged-89afa235-d910-4430-a95a-c173ba7a7048 for instance with vm_state active and task_state rebuild_spawning.
Nov 17 01:27:47 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-d274e320-acbd-44d1-9e53-ad07082f37e5 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] No BDM found with device name vda, not building metadata. {{(pid=75226) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 01:27:47 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-d274e320-acbd-44d1-9e53-ad07082f37e5 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] No VIF found with MAC fa:16:3e:be:85:10, not building metadata {{(pid=75226) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 01:27:47 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:27:47 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:27:47 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:27:48 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:27:48 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:27:48 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:27:48 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:27:49 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:27:49 user nova-compute[75226]: DEBUG nova.compute.manager [req-73c21d68-fdde-4184-a4f4-f45788d08457 req-9ff44e27-dd4a-46b1-9bcf-e18866d4bcf0 service nova] [instance: 4dcdd769-bbfe-48e8-a876-8b2072b7baeb] Received event network-vif-plugged-89afa235-d910-4430-a95a-c173ba7a7048 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:27:49 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-73c21d68-fdde-4184-a4f4-f45788d08457 req-9ff44e27-dd4a-46b1-9bcf-e18866d4bcf0 service nova] Acquiring lock "4dcdd769-bbfe-48e8-a876-8b2072b7baeb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:27:49 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-73c21d68-fdde-4184-a4f4-f45788d08457 req-9ff44e27-dd4a-46b1-9bcf-e18866d4bcf0 service nova] Lock "4dcdd769-bbfe-48e8-a876-8b2072b7baeb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:27:49 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-73c21d68-fdde-4184-a4f4-f45788d08457 req-9ff44e27-dd4a-46b1-9bcf-e18866d4bcf0 service nova] Lock "4dcdd769-bbfe-48e8-a876-8b2072b7baeb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:27:49 user nova-compute[75226]: DEBUG nova.compute.manager [req-73c21d68-fdde-4184-a4f4-f45788d08457 req-9ff44e27-dd4a-46b1-9bcf-e18866d4bcf0 service nova] [instance: 4dcdd769-bbfe-48e8-a876-8b2072b7baeb] No waiting events found dispatching network-vif-plugged-89afa235-d910-4430-a95a-c173ba7a7048 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:27:49 user nova-compute[75226]: WARNING nova.compute.manager [req-73c21d68-fdde-4184-a4f4-f45788d08457 req-9ff44e27-dd4a-46b1-9bcf-e18866d4bcf0 service nova] [instance: 4dcdd769-bbfe-48e8-a876-8b2072b7baeb] Received unexpected event network-vif-plugged-89afa235-d910-4430-a95a-c173ba7a7048 for instance with vm_state active and task_state rebuild_spawning.
Nov 17 01:27:49 user nova-compute[75226]: DEBUG nova.compute.manager [req-73c21d68-fdde-4184-a4f4-f45788d08457 req-9ff44e27-dd4a-46b1-9bcf-e18866d4bcf0 service nova] [instance: 346967c5-6945-4cef-9eea-8415cb27c98f] Received event network-vif-plugged-aa5b3af3-4cac-4a2f-93b8-3b6d378a3486 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:27:49 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-73c21d68-fdde-4184-a4f4-f45788d08457 req-9ff44e27-dd4a-46b1-9bcf-e18866d4bcf0 service nova] Acquiring lock "346967c5-6945-4cef-9eea-8415cb27c98f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:27:49 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-73c21d68-fdde-4184-a4f4-f45788d08457 req-9ff44e27-dd4a-46b1-9bcf-e18866d4bcf0 service nova] Lock "346967c5-6945-4cef-9eea-8415cb27c98f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:27:49 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-73c21d68-fdde-4184-a4f4-f45788d08457 req-9ff44e27-dd4a-46b1-9bcf-e18866d4bcf0 service nova] Lock "346967c5-6945-4cef-9eea-8415cb27c98f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:27:49 user nova-compute[75226]: DEBUG nova.compute.manager [req-73c21d68-fdde-4184-a4f4-f45788d08457 req-9ff44e27-dd4a-46b1-9bcf-e18866d4bcf0 service nova] [instance: 346967c5-6945-4cef-9eea-8415cb27c98f] No waiting events found dispatching network-vif-plugged-aa5b3af3-4cac-4a2f-93b8-3b6d378a3486 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:27:49 user nova-compute[75226]: WARNING nova.compute.manager [req-73c21d68-fdde-4184-a4f4-f45788d08457 req-9ff44e27-dd4a-46b1-9bcf-e18866d4bcf0 service nova] [instance: 346967c5-6945-4cef-9eea-8415cb27c98f] Received unexpected event network-vif-plugged-aa5b3af3-4cac-4a2f-93b8-3b6d378a3486 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 17 01:27:49 user nova-compute[75226]: DEBUG nova.compute.manager [req-73c21d68-fdde-4184-a4f4-f45788d08457 req-9ff44e27-dd4a-46b1-9bcf-e18866d4bcf0 service nova] [instance: 346967c5-6945-4cef-9eea-8415cb27c98f] Received event network-vif-plugged-aa5b3af3-4cac-4a2f-93b8-3b6d378a3486 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:27:49 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-73c21d68-fdde-4184-a4f4-f45788d08457 req-9ff44e27-dd4a-46b1-9bcf-e18866d4bcf0 service nova] Acquiring lock "346967c5-6945-4cef-9eea-8415cb27c98f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:27:49 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-73c21d68-fdde-4184-a4f4-f45788d08457 req-9ff44e27-dd4a-46b1-9bcf-e18866d4bcf0 service nova] Lock "346967c5-6945-4cef-9eea-8415cb27c98f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:27:49 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-73c21d68-fdde-4184-a4f4-f45788d08457 req-9ff44e27-dd4a-46b1-9bcf-e18866d4bcf0 service nova] Lock "346967c5-6945-4cef-9eea-8415cb27c98f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:27:49 user nova-compute[75226]: DEBUG nova.compute.manager [req-73c21d68-fdde-4184-a4f4-f45788d08457 req-9ff44e27-dd4a-46b1-9bcf-e18866d4bcf0 service nova] [instance: 346967c5-6945-4cef-9eea-8415cb27c98f] No waiting events found dispatching network-vif-plugged-aa5b3af3-4cac-4a2f-93b8-3b6d378a3486 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:27:49 user nova-compute[75226]: WARNING nova.compute.manager [req-73c21d68-fdde-4184-a4f4-f45788d08457 req-9ff44e27-dd4a-46b1-9bcf-e18866d4bcf0 service nova] [instance: 346967c5-6945-4cef-9eea-8415cb27c98f] Received unexpected event network-vif-plugged-aa5b3af3-4cac-4a2f-93b8-3b6d378a3486 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 17 01:27:49 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:27:49 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:27:49 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:27:50 user nova-compute[75226]: DEBUG nova.compute.manager [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: 4dcdd769-bbfe-48e8-a876-8b2072b7baeb] Instance event wait completed in 0 seconds for  {{(pid=75226) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 17 01:27:50 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: 4dcdd769-bbfe-48e8-a876-8b2072b7baeb] Guest created on hypervisor {{(pid=75226) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 17 01:27:50 user nova-compute[75226]: INFO nova.virt.libvirt.driver [-] [instance: 4dcdd769-bbfe-48e8-a876-8b2072b7baeb] Instance spawned successfully.
Nov 17 01:27:50 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: 4dcdd769-bbfe-48e8-a876-8b2072b7baeb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 17 01:27:50 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: 4dcdd769-bbfe-48e8-a876-8b2072b7baeb] Found default for hw_cdrom_bus of ide {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:27:50 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: 4dcdd769-bbfe-48e8-a876-8b2072b7baeb] Found default for hw_disk_bus of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:27:50 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: 4dcdd769-bbfe-48e8-a876-8b2072b7baeb] Found default for hw_input_bus of None {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:27:50 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: 4dcdd769-bbfe-48e8-a876-8b2072b7baeb] Found default for hw_pointer_model of None {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:27:50 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: 4dcdd769-bbfe-48e8-a876-8b2072b7baeb] Found default for hw_video_model of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:27:50 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: 4dcdd769-bbfe-48e8-a876-8b2072b7baeb] Found default for hw_vif_model of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:27:50 user nova-compute[75226]: DEBUG nova.compute.manager [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: 4dcdd769-bbfe-48e8-a876-8b2072b7baeb] Checking state {{(pid=75226) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 01:27:50 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:27:50 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:27:50 user nova-compute[75226]: DEBUG nova.objects.instance [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: 4dcdd769-bbfe-48e8-a876-8b2072b7baeb] Trying to apply a migration context that does not seem to be set for this instance {{(pid=75226) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 17 01:27:50 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-307f99ff-a29b-4eba-ac36-29f269965748 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.071s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:27:50 user nova-compute[75226]: DEBUG nova.compute.manager [None req-d274e320-acbd-44d1-9e53-ad07082f37e5 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] [instance: 346967c5-6945-4cef-9eea-8415cb27c98f] Instance event wait completed in 0 seconds for  {{(pid=75226) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 17 01:27:50 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-d274e320-acbd-44d1-9e53-ad07082f37e5 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] [instance: 346967c5-6945-4cef-9eea-8415cb27c98f] Guest created on hypervisor {{(pid=75226) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 17 01:27:50 user nova-compute[75226]: INFO nova.virt.libvirt.driver [-] [instance: 346967c5-6945-4cef-9eea-8415cb27c98f] Instance spawned successfully.
Nov 17 01:27:50 user nova-compute[75226]: DEBUG nova.compute.manager [None req-d274e320-acbd-44d1-9e53-ad07082f37e5 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] [instance: 346967c5-6945-4cef-9eea-8415cb27c98f] Checking state {{(pid=75226) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 01:27:50 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-d274e320-acbd-44d1-9e53-ad07082f37e5 tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Lock "346967c5-6945-4cef-9eea-8415cb27c98f" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 13.323s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:27:51 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-a9ff18a3-a441-4f52-b68a-d6a2319f9fad tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Acquiring lock "bef5f981-8fcb-4433-87bf-f958f3f57424" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:27:51 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-a9ff18a3-a441-4f52-b68a-d6a2319f9fad tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Lock "bef5f981-8fcb-4433-87bf-f958f3f57424" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:27:51 user nova-compute[75226]: DEBUG nova.compute.manager [None req-a9ff18a3-a441-4f52-b68a-d6a2319f9fad tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: bef5f981-8fcb-4433-87bf-f958f3f57424] Starting instance... {{(pid=75226) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 17 01:27:51 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-a9ff18a3-a441-4f52-b68a-d6a2319f9fad tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:27:51 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-a9ff18a3-a441-4f52-b68a-d6a2319f9fad tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:27:51 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-a9ff18a3-a441-4f52-b68a-d6a2319f9fad tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75226) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 17 01:27:51 user nova-compute[75226]: INFO nova.compute.claims [None req-a9ff18a3-a441-4f52-b68a-d6a2319f9fad tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: bef5f981-8fcb-4433-87bf-f958f3f57424] Claim successful on node user
Nov 17 01:27:51 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-a9ff18a3-a441-4f52-b68a-d6a2319f9fad tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:27:51 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-a9ff18a3-a441-4f52-b68a-d6a2319f9fad tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:27:51 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-a9ff18a3-a441-4f52-b68a-d6a2319f9fad tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.496s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:27:51 user nova-compute[75226]: DEBUG nova.compute.manager [None req-a9ff18a3-a441-4f52-b68a-d6a2319f9fad tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: bef5f981-8fcb-4433-87bf-f958f3f57424] Start building networks asynchronously for instance. {{(pid=75226) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 17 01:27:51 user nova-compute[75226]: DEBUG nova.compute.manager [None req-a9ff18a3-a441-4f52-b68a-d6a2319f9fad tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: bef5f981-8fcb-4433-87bf-f958f3f57424] Allocating IP information in the background. {{(pid=75226) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 17 01:27:51 user nova-compute[75226]: DEBUG nova.network.neutron [None req-a9ff18a3-a441-4f52-b68a-d6a2319f9fad tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: bef5f981-8fcb-4433-87bf-f958f3f57424] allocate_for_instance() {{(pid=75226) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 17 01:27:51 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-a9ff18a3-a441-4f52-b68a-d6a2319f9fad tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: bef5f981-8fcb-4433-87bf-f958f3f57424] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 17 01:27:51 user nova-compute[75226]: DEBUG nova.compute.manager [None req-a9ff18a3-a441-4f52-b68a-d6a2319f9fad tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: bef5f981-8fcb-4433-87bf-f958f3f57424] Start building block device mappings for instance. {{(pid=75226) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 17 01:27:52 user nova-compute[75226]: DEBUG nova.policy [None req-a9ff18a3-a441-4f52-b68a-d6a2319f9fad tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '642db538240b4ca1a367cf4ee9714f66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38777e8baf745e79f31190da97406a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75226) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 17 01:27:52 user nova-compute[75226]: DEBUG nova.compute.manager [None req-a9ff18a3-a441-4f52-b68a-d6a2319f9fad tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: bef5f981-8fcb-4433-87bf-f958f3f57424] Start spawning the instance on the hypervisor. {{(pid=75226) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 17 01:27:52 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-a9ff18a3-a441-4f52-b68a-d6a2319f9fad tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: bef5f981-8fcb-4433-87bf-f958f3f57424] Creating instance directory {{(pid=75226) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 17 01:27:52 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-a9ff18a3-a441-4f52-b68a-d6a2319f9fad tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: bef5f981-8fcb-4433-87bf-f958f3f57424] Creating image(s)
Nov 17 01:27:52 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-a9ff18a3-a441-4f52-b68a-d6a2319f9fad tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Acquiring lock "/opt/stack/data/nova/instances/bef5f981-8fcb-4433-87bf-f958f3f57424/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:27:52 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-a9ff18a3-a441-4f52-b68a-d6a2319f9fad tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Lock "/opt/stack/data/nova/instances/bef5f981-8fcb-4433-87bf-f958f3f57424/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:27:52 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-a9ff18a3-a441-4f52-b68a-d6a2319f9fad tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Lock "/opt/stack/data/nova/instances/bef5f981-8fcb-4433-87bf-f958f3f57424/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:27:52 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-a9ff18a3-a441-4f52-b68a-d6a2319f9fad tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:27:52 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:27:52 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-a9ff18a3-a441-4f52-b68a-d6a2319f9fad tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json" returned: 0 in 0.205s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:27:52 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-a9ff18a3-a441-4f52-b68a-d6a2319f9fad tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Acquiring lock "a8a62c2546af3a2036b853250c5ac64d4c6b4371" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:27:52 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-a9ff18a3-a441-4f52-b68a-d6a2319f9fad tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Lock "a8a62c2546af3a2036b853250c5ac64d4c6b4371" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:27:52 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-a9ff18a3-a441-4f52-b68a-d6a2319f9fad tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:27:52 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-a9ff18a3-a441-4f52-b68a-d6a2319f9fad tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json" returned: 0 in 0.187s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:27:52 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-a9ff18a3-a441-4f52-b68a-d6a2319f9fad tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371,backing_fmt=raw /opt/stack/data/nova/instances/bef5f981-8fcb-4433-87bf-f958f3f57424/disk 1073741824 {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:27:52 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-a9ff18a3-a441-4f52-b68a-d6a2319f9fad tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371,backing_fmt=raw /opt/stack/data/nova/instances/bef5f981-8fcb-4433-87bf-f958f3f57424/disk 1073741824" returned: 0 in 0.053s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:27:52 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-a9ff18a3-a441-4f52-b68a-d6a2319f9fad tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Lock "a8a62c2546af3a2036b853250c5ac64d4c6b4371" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:27:52 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-a9ff18a3-a441-4f52-b68a-d6a2319f9fad tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:27:52 user nova-compute[75226]: DEBUG nova.network.neutron [None req-a9ff18a3-a441-4f52-b68a-d6a2319f9fad tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: bef5f981-8fcb-4433-87bf-f958f3f57424] Successfully created port: cab29de8-39b1-4673-ac55-4e29c21d0d34 {{(pid=75226) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 17 01:27:52 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-a9ff18a3-a441-4f52-b68a-d6a2319f9fad tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json" returned: 0 in 0.195s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:27:52 user nova-compute[75226]: DEBUG nova.virt.disk.api [None req-a9ff18a3-a441-4f52-b68a-d6a2319f9fad tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bef5f981-8fcb-4433-87bf-f958f3f57424/disk. size=1073741824 {{(pid=75226) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 17 01:27:52 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-a9ff18a3-a441-4f52-b68a-d6a2319f9fad tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bef5f981-8fcb-4433-87bf-f958f3f57424/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:27:52 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:27:52 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-a9ff18a3-a441-4f52-b68a-d6a2319f9fad tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bef5f981-8fcb-4433-87bf-f958f3f57424/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:27:52 user nova-compute[75226]: DEBUG nova.virt.disk.api [None req-a9ff18a3-a441-4f52-b68a-d6a2319f9fad tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Cannot resize image /opt/stack/data/nova/instances/bef5f981-8fcb-4433-87bf-f958f3f57424/disk to a smaller size. {{(pid=75226) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 17 01:27:52 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-a9ff18a3-a441-4f52-b68a-d6a2319f9fad tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: bef5f981-8fcb-4433-87bf-f958f3f57424] Created local disks {{(pid=75226) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 17 01:27:52 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-a9ff18a3-a441-4f52-b68a-d6a2319f9fad tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: bef5f981-8fcb-4433-87bf-f958f3f57424] Ensure instance console log exists: /opt/stack/data/nova/instances/bef5f981-8fcb-4433-87bf-f958f3f57424/console.log {{(pid=75226) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 17 01:27:52 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-a9ff18a3-a441-4f52-b68a-d6a2319f9fad tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:27:52 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-a9ff18a3-a441-4f52-b68a-d6a2319f9fad tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:27:52 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-a9ff18a3-a441-4f52-b68a-d6a2319f9fad tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:27:53 user nova-compute[75226]: DEBUG nova.network.neutron [None req-a9ff18a3-a441-4f52-b68a-d6a2319f9fad tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: bef5f981-8fcb-4433-87bf-f958f3f57424] Successfully updated port: cab29de8-39b1-4673-ac55-4e29c21d0d34 {{(pid=75226) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 17 01:27:53 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-a9ff18a3-a441-4f52-b68a-d6a2319f9fad tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Acquiring lock "refresh_cache-bef5f981-8fcb-4433-87bf-f958f3f57424" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:27:53 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-a9ff18a3-a441-4f52-b68a-d6a2319f9fad tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Acquired lock "refresh_cache-bef5f981-8fcb-4433-87bf-f958f3f57424" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:27:53 user nova-compute[75226]: DEBUG nova.network.neutron [None req-a9ff18a3-a441-4f52-b68a-d6a2319f9fad tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: bef5f981-8fcb-4433-87bf-f958f3f57424] Building network info cache for instance {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 01:27:53 user nova-compute[75226]: DEBUG nova.compute.manager [req-6e62a494-1b62-4252-8507-b813d2dfa806 req-9ecf7063-2603-4433-838f-91b55bdfe8e6 service nova] [instance: bef5f981-8fcb-4433-87bf-f958f3f57424] Received event network-changed-cab29de8-39b1-4673-ac55-4e29c21d0d34 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:27:53 user nova-compute[75226]: DEBUG nova.compute.manager [req-6e62a494-1b62-4252-8507-b813d2dfa806 req-9ecf7063-2603-4433-838f-91b55bdfe8e6 service nova] [instance: bef5f981-8fcb-4433-87bf-f958f3f57424] Refreshing instance network info cache due to event network-changed-cab29de8-39b1-4673-ac55-4e29c21d0d34. {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 01:27:53 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-6e62a494-1b62-4252-8507-b813d2dfa806 req-9ecf7063-2603-4433-838f-91b55bdfe8e6 service nova] Acquiring lock "refresh_cache-bef5f981-8fcb-4433-87bf-f958f3f57424" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:27:53 user nova-compute[75226]: DEBUG nova.network.neutron [None req-a9ff18a3-a441-4f52-b68a-d6a2319f9fad tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: bef5f981-8fcb-4433-87bf-f958f3f57424] Instance cache missing network info. {{(pid=75226) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 17 01:27:53 user nova-compute[75226]: DEBUG nova.network.neutron [None req-a9ff18a3-a441-4f52-b68a-d6a2319f9fad tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: bef5f981-8fcb-4433-87bf-f958f3f57424] Updating instance_info_cache with network_info: [{"id": "cab29de8-39b1-4673-ac55-4e29c21d0d34", "address": "fa:16:3e:13:0e:d0", "network": {"id": "57d0e7ee-0b11-4e00-86f9-bb4a3c25c674", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1357446034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e38777e8baf745e79f31190da97406a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcab29de8-39", "ovs_interfaceid": "cab29de8-39b1-4673-ac55-4e29c21d0d34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:27:53 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-a9ff18a3-a441-4f52-b68a-d6a2319f9fad tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Releasing lock "refresh_cache-bef5f981-8fcb-4433-87bf-f958f3f57424" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:27:53 user nova-compute[75226]: DEBUG nova.compute.manager [None req-a9ff18a3-a441-4f52-b68a-d6a2319f9fad tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: bef5f981-8fcb-4433-87bf-f958f3f57424] Instance network_info: |[{"id": "cab29de8-39b1-4673-ac55-4e29c21d0d34", "address": "fa:16:3e:13:0e:d0", "network": {"id": "57d0e7ee-0b11-4e00-86f9-bb4a3c25c674", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1357446034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e38777e8baf745e79f31190da97406a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcab29de8-39", "ovs_interfaceid": "cab29de8-39b1-4673-ac55-4e29c21d0d34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75226) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 17 01:27:53 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-6e62a494-1b62-4252-8507-b813d2dfa806 req-9ecf7063-2603-4433-838f-91b55bdfe8e6 service nova] Acquired lock "refresh_cache-bef5f981-8fcb-4433-87bf-f958f3f57424" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:27:53 user nova-compute[75226]: DEBUG nova.network.neutron [req-6e62a494-1b62-4252-8507-b813d2dfa806 req-9ecf7063-2603-4433-838f-91b55bdfe8e6 service nova] [instance: bef5f981-8fcb-4433-87bf-f958f3f57424] Refreshing network info cache for port cab29de8-39b1-4673-ac55-4e29c21d0d34 {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 01:27:53 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-a9ff18a3-a441-4f52-b68a-d6a2319f9fad tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: bef5f981-8fcb-4433-87bf-f958f3f57424] Start _get_guest_xml network_info=[{"id": "cab29de8-39b1-4673-ac55-4e29c21d0d34", "address": "fa:16:3e:13:0e:d0", "network": {"id": "57d0e7ee-0b11-4e00-86f9-bb4a3c25c674", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1357446034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e38777e8baf745e79f31190da97406a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcab29de8-39", "ovs_interfaceid": "cab29de8-39b1-4673-ac55-4e29c21d0d34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T01:13:22Z,direct_url=<?>,disk_format='qcow2',id=0b369aea-6f3f-4690-9f01-229b90ab6310,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4e110cbf9a84362a6864a7732c435a1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T01:13:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '0b369aea-6f3f-4690-9f01-229b90ab6310'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75226) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 17 01:27:53 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-a9ff18a3-a441-4f52-b68a-d6a2319f9fad tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:27:53 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-a9ff18a3-a441-4f52-b68a-d6a2319f9fad tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:27:53 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-a9ff18a3-a441-4f52-b68a-d6a2319f9fad tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75226) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 17 01:27:53 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-a9ff18a3-a441-4f52-b68a-d6a2319f9fad tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] CPU controller missing on host. {{(pid=75226) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 17 01:27:53 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-a9ff18a3-a441-4f52-b68a-d6a2319f9fad tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75226) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 17 01:27:53 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-a9ff18a3-a441-4f52-b68a-d6a2319f9fad tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] CPU controller found on host. {{(pid=75226) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 17 01:27:53 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-a9ff18a3-a441-4f52-b68a-d6a2319f9fad tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75226) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 17 01:27:53 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-a9ff18a3-a441-4f52-b68a-d6a2319f9fad tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-17T01:13:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T01:13:22Z,direct_url=<?>,disk_format='qcow2',id=0b369aea-6f3f-4690-9f01-229b90ab6310,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4e110cbf9a84362a6864a7732c435a1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T01:13:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 17 01:27:53 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-a9ff18a3-a441-4f52-b68a-d6a2319f9fad tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Flavor limits 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 17 01:27:53 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-a9ff18a3-a441-4f52-b68a-d6a2319f9fad tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Image limits 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 17 01:27:53 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-a9ff18a3-a441-4f52-b68a-d6a2319f9fad tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Flavor pref 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 17 01:27:53 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-a9ff18a3-a441-4f52-b68a-d6a2319f9fad tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Image pref 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 17 01:27:53 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-a9ff18a3-a441-4f52-b68a-d6a2319f9fad tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 17 01:27:53 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-a9ff18a3-a441-4f52-b68a-d6a2319f9fad tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 17 01:27:53 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-a9ff18a3-a441-4f52-b68a-d6a2319f9fad tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75226) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 17 01:27:53 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-a9ff18a3-a441-4f52-b68a-d6a2319f9fad tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Got 1 possible topologies {{(pid=75226) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 17 01:27:53 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-a9ff18a3-a441-4f52-b68a-d6a2319f9fad tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 17 01:27:53 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-a9ff18a3-a441-4f52-b68a-d6a2319f9fad tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 17 01:27:53 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-a9ff18a3-a441-4f52-b68a-d6a2319f9fad tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:27:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-358531304',display_name='tempest-AttachVolumeNegativeTest-server-358531304',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-358531304',id=28,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOUE61hjaJTHLJruOzhQkIZRNw5oGH4YfX39cdcxF6KVbvCNzR7+PKun3r8tKC2OJAqvoWPt4aK1swEfIkSQh9hXlTW2LQThP/V9tlE6Dc1Pa9+uyVkmNbuh+BQ5AEaJqg==',key_name='tempest-keypair-133727568',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e38777e8baf745e79f31190da97406a0',ramdisk_id='',reservation_id='r-57i7cim0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-940905741',owner_user_name='tempest-AttachVolumeNegativeTest-940905741-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T01:27:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='642db538240b4ca1a367cf4ee9714f66',uuid=bef5f981-8fcb-4433-87bf-f958f3f57424,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cab29de8-39b1-4673-ac55-4e29c21d0d34", "address": "fa:16:3e:13:0e:d0", "network": {"id": "57d0e7ee-0b11-4e00-86f9-bb4a3c25c674", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1357446034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e38777e8baf745e79f31190da97406a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcab29de8-39", "ovs_interfaceid": "cab29de8-39b1-4673-ac55-4e29c21d0d34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75226) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 01:27:53 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-a9ff18a3-a441-4f52-b68a-d6a2319f9fad tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Converting VIF {"id": "cab29de8-39b1-4673-ac55-4e29c21d0d34", "address": "fa:16:3e:13:0e:d0", "network": {"id": "57d0e7ee-0b11-4e00-86f9-bb4a3c25c674", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1357446034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e38777e8baf745e79f31190da97406a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcab29de8-39", "ovs_interfaceid": "cab29de8-39b1-4673-ac55-4e29c21d0d34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:27:53 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-a9ff18a3-a441-4f52-b68a-d6a2319f9fad tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:0e:d0,bridge_name='br-int',has_traffic_filtering=True,id=cab29de8-39b1-4673-ac55-4e29c21d0d34,network=Network(57d0e7ee-0b11-4e00-86f9-bb4a3c25c674),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcab29de8-39') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:27:53 user nova-compute[75226]: DEBUG nova.objects.instance [None req-a9ff18a3-a441-4f52-b68a-d6a2319f9fad tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Lazy-loading 'pci_devices' on Instance uuid bef5f981-8fcb-4433-87bf-f958f3f57424 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:27:53 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-a9ff18a3-a441-4f52-b68a-d6a2319f9fad tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: bef5f981-8fcb-4433-87bf-f958f3f57424] End _get_guest_xml xml=<domain type="kvm">
Nov 17 01:27:53 user nova-compute[75226]:   <uuid>bef5f981-8fcb-4433-87bf-f958f3f57424</uuid>
Nov 17 01:27:53 user nova-compute[75226]:   <name>instance-0000001c</name>
Nov 17 01:27:53 user nova-compute[75226]:   <memory>524288</memory>
Nov 17 01:27:53 user nova-compute[75226]:   <vcpu>1</vcpu>
Nov 17 01:27:53 user nova-compute[75226]:   <metadata>
Nov 17 01:27:53 user nova-compute[75226]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 17 01:27:53 user nova-compute[75226]:       <nova:package version="0.0.0"/>
Nov 17 01:27:53 user nova-compute[75226]:       <nova:name>tempest-AttachVolumeNegativeTest-server-358531304</nova:name>
Nov 17 01:27:53 user nova-compute[75226]:       <nova:creationTime>2023-11-17 01:27:53</nova:creationTime>
Nov 17 01:27:53 user nova-compute[75226]:       <nova:flavor name="m1.tiny">
Nov 17 01:27:53 user nova-compute[75226]:         <nova:memory>512</nova:memory>
Nov 17 01:27:53 user nova-compute[75226]:         <nova:disk>1</nova:disk>
Nov 17 01:27:53 user nova-compute[75226]:         <nova:swap>0</nova:swap>
Nov 17 01:27:53 user nova-compute[75226]:         <nova:ephemeral>0</nova:ephemeral>
Nov 17 01:27:53 user nova-compute[75226]:         <nova:vcpus>1</nova:vcpus>
Nov 17 01:27:53 user nova-compute[75226]:       </nova:flavor>
Nov 17 01:27:53 user nova-compute[75226]:       <nova:owner>
Nov 17 01:27:53 user nova-compute[75226]:         <nova:user uuid="642db538240b4ca1a367cf4ee9714f66">tempest-AttachVolumeNegativeTest-940905741-project-member</nova:user>
Nov 17 01:27:53 user nova-compute[75226]:         <nova:project uuid="e38777e8baf745e79f31190da97406a0">tempest-AttachVolumeNegativeTest-940905741</nova:project>
Nov 17 01:27:53 user nova-compute[75226]:       </nova:owner>
Nov 17 01:27:53 user nova-compute[75226]:       <nova:root type="image" uuid="0b369aea-6f3f-4690-9f01-229b90ab6310"/>
Nov 17 01:27:53 user nova-compute[75226]:       <nova:ports>
Nov 17 01:27:53 user nova-compute[75226]:         <nova:port uuid="cab29de8-39b1-4673-ac55-4e29c21d0d34">
Nov 17 01:27:53 user nova-compute[75226]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 17 01:27:53 user nova-compute[75226]:         </nova:port>
Nov 17 01:27:53 user nova-compute[75226]:       </nova:ports>
Nov 17 01:27:53 user nova-compute[75226]:     </nova:instance>
Nov 17 01:27:53 user nova-compute[75226]:   </metadata>
Nov 17 01:27:53 user nova-compute[75226]:   <sysinfo type="smbios">
Nov 17 01:27:53 user nova-compute[75226]:     <system>
Nov 17 01:27:53 user nova-compute[75226]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 17 01:27:53 user nova-compute[75226]:       <entry name="product">OpenStack Nova</entry>
Nov 17 01:27:53 user nova-compute[75226]:       <entry name="version">0.0.0</entry>
Nov 17 01:27:53 user nova-compute[75226]:       <entry name="serial">bef5f981-8fcb-4433-87bf-f958f3f57424</entry>
Nov 17 01:27:53 user nova-compute[75226]:       <entry name="uuid">bef5f981-8fcb-4433-87bf-f958f3f57424</entry>
Nov 17 01:27:53 user nova-compute[75226]:       <entry name="family">Virtual Machine</entry>
Nov 17 01:27:53 user nova-compute[75226]:     </system>
Nov 17 01:27:53 user nova-compute[75226]:   </sysinfo>
Nov 17 01:27:53 user nova-compute[75226]:   <os>
Nov 17 01:27:53 user nova-compute[75226]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 17 01:27:53 user nova-compute[75226]:     <boot dev="hd"/>
Nov 17 01:27:53 user nova-compute[75226]:     <smbios mode="sysinfo"/>
Nov 17 01:27:53 user nova-compute[75226]:   </os>
Nov 17 01:27:53 user nova-compute[75226]:   <features>
Nov 17 01:27:53 user nova-compute[75226]:     <acpi/>
Nov 17 01:27:53 user nova-compute[75226]:     <apic/>
Nov 17 01:27:53 user nova-compute[75226]:     <vmcoreinfo/>
Nov 17 01:27:53 user nova-compute[75226]:   </features>
Nov 17 01:27:53 user nova-compute[75226]:   <clock offset="utc">
Nov 17 01:27:53 user nova-compute[75226]:     <timer name="pit" tickpolicy="delay"/>
Nov 17 01:27:53 user nova-compute[75226]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 17 01:27:53 user nova-compute[75226]:     <timer name="hpet" present="no"/>
Nov 17 01:27:53 user nova-compute[75226]:   </clock>
Nov 17 01:27:53 user nova-compute[75226]:   <cpu mode="custom" match="exact">
Nov 17 01:27:53 user nova-compute[75226]:     <model>Nehalem</model>
Nov 17 01:27:53 user nova-compute[75226]:     <topology sockets="1" cores="1" threads="1"/>
Nov 17 01:27:53 user nova-compute[75226]:   </cpu>
Nov 17 01:27:53 user nova-compute[75226]:   <devices>
Nov 17 01:27:53 user nova-compute[75226]:     <disk type="file" device="disk">
Nov 17 01:27:53 user nova-compute[75226]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 17 01:27:53 user nova-compute[75226]:       <source file="/opt/stack/data/nova/instances/bef5f981-8fcb-4433-87bf-f958f3f57424/disk"/>
Nov 17 01:27:53 user nova-compute[75226]:       <target dev="vda" bus="virtio"/>
Nov 17 01:27:53 user nova-compute[75226]:     </disk>
Nov 17 01:27:53 user nova-compute[75226]:     <interface type="ethernet">
Nov 17 01:27:53 user nova-compute[75226]:       <mac address="fa:16:3e:13:0e:d0"/>
Nov 17 01:27:53 user nova-compute[75226]:       <model type="virtio"/>
Nov 17 01:27:53 user nova-compute[75226]:       <mtu size="1442"/>
Nov 17 01:27:53 user nova-compute[75226]:       <target dev="tapcab29de8-39"/>
Nov 17 01:27:53 user nova-compute[75226]:     </interface>
Nov 17 01:27:53 user nova-compute[75226]:     <serial type="pty">
Nov 17 01:27:53 user nova-compute[75226]:       <log file="/opt/stack/data/nova/instances/bef5f981-8fcb-4433-87bf-f958f3f57424/console.log" append="off"/>
Nov 17 01:27:53 user nova-compute[75226]:     </serial>
Nov 17 01:27:53 user nova-compute[75226]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 17 01:27:53 user nova-compute[75226]:     <video>
Nov 17 01:27:53 user nova-compute[75226]:       <model type="virtio"/>
Nov 17 01:27:53 user nova-compute[75226]:     </video>
Nov 17 01:27:53 user nova-compute[75226]:     <rng model="virtio">
Nov 17 01:27:53 user nova-compute[75226]:       <backend model="random">/dev/urandom</backend>
Nov 17 01:27:53 user nova-compute[75226]:     </rng>
Nov 17 01:27:53 user nova-compute[75226]:     <controller type="usb" index="0" model="none"/>
Nov 17 01:27:53 user nova-compute[75226]:     <memballoon model="virtio">
Nov 17 01:27:53 user nova-compute[75226]:       <stats period="10"/>
Nov 17 01:27:53 user nova-compute[75226]:     </memballoon>
Nov 17 01:27:53 user nova-compute[75226]:   </devices>
Nov 17 01:27:53 user nova-compute[75226]: </domain>
Nov 17 01:27:53 user nova-compute[75226]:  {{(pid=75226) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 17 01:27:53 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-a9ff18a3-a441-4f52-b68a-d6a2319f9fad tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:27:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-358531304',display_name='tempest-AttachVolumeNegativeTest-server-358531304',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-358531304',id=28,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOUE61hjaJTHLJruOzhQkIZRNw5oGH4YfX39cdcxF6KVbvCNzR7+PKun3r8tKC2OJAqvoWPt4aK1swEfIkSQh9hXlTW2LQThP/V9tlE6Dc1Pa9+uyVkmNbuh+BQ5AEaJqg==',key_name='tempest-keypair-133727568',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e38777e8baf745e79f31190da97406a0',ramdisk_id='',reservation_id='r-57i7cim0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-940905741',owner_user_name='tempest-AttachVolumeNegativeTest-940905741-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T01:27:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='642db538240b4ca1a367cf4ee9714f66',uuid=bef5f981-8fcb-4433-87bf-f958f3f57424,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cab29de8-39b1-4673-ac55-4e29c21d0d34", "address": "fa:16:3e:13:0e:d0", "network": {"id": "57d0e7ee-0b11-4e00-86f9-bb4a3c25c674", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1357446034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e38777e8baf745e79f31190da97406a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcab29de8-39", "ovs_interfaceid": "cab29de8-39b1-4673-ac55-4e29c21d0d34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 17 01:27:53 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-a9ff18a3-a441-4f52-b68a-d6a2319f9fad tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Converting VIF {"id": "cab29de8-39b1-4673-ac55-4e29c21d0d34", "address": "fa:16:3e:13:0e:d0", "network": {"id": "57d0e7ee-0b11-4e00-86f9-bb4a3c25c674", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1357446034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e38777e8baf745e79f31190da97406a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcab29de8-39", "ovs_interfaceid": "cab29de8-39b1-4673-ac55-4e29c21d0d34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:27:53 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-a9ff18a3-a441-4f52-b68a-d6a2319f9fad tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:0e:d0,bridge_name='br-int',has_traffic_filtering=True,id=cab29de8-39b1-4673-ac55-4e29c21d0d34,network=Network(57d0e7ee-0b11-4e00-86f9-bb4a3c25c674),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcab29de8-39') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:27:53 user nova-compute[75226]: DEBUG os_vif [None req-a9ff18a3-a441-4f52-b68a-d6a2319f9fad tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:0e:d0,bridge_name='br-int',has_traffic_filtering=True,id=cab29de8-39b1-4673-ac55-4e29c21d0d34,network=Network(57d0e7ee-0b11-4e00-86f9-bb4a3c25c674),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcab29de8-39') {{(pid=75226) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 17 01:27:53 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:27:53 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:27:53 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 17 01:27:53 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:27:53 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '83a8e9fe-a8f4-53fb-93df-c3794058ac0b', '_type': 'linux-noop'}}, row=False) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:27:53 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:27:53 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:27:53 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:27:53 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcab29de8-39, may_exist=True, interface_attrs={}) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:27:53 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcab29de8-39, col_values=(('qos', UUID('b5c0e37d-6c97-4d99-ac46-041b8c73de0b')),), if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:27:53 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcab29de8-39, col_values=(('external_ids', {'iface-id': 'cab29de8-39b1-4673-ac55-4e29c21d0d34', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:13:0e:d0', 'vm-uuid': 'bef5f981-8fcb-4433-87bf-f958f3f57424'}),), if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:27:53 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:27:53 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:27:53 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:27:53 user nova-compute[75226]: INFO os_vif [None req-a9ff18a3-a441-4f52-b68a-d6a2319f9fad tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:0e:d0,bridge_name='br-int',has_traffic_filtering=True,id=cab29de8-39b1-4673-ac55-4e29c21d0d34,network=Network(57d0e7ee-0b11-4e00-86f9-bb4a3c25c674),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcab29de8-39')
Nov 17 01:27:53 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-a9ff18a3-a441-4f52-b68a-d6a2319f9fad tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] No BDM found with device name vda, not building metadata. {{(pid=75226) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 01:27:53 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-a9ff18a3-a441-4f52-b68a-d6a2319f9fad tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] No VIF found with MAC fa:16:3e:13:0e:d0, not building metadata {{(pid=75226) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 01:27:54 user nova-compute[75226]: DEBUG nova.network.neutron [req-6e62a494-1b62-4252-8507-b813d2dfa806 req-9ecf7063-2603-4433-838f-91b55bdfe8e6 service nova] [instance: bef5f981-8fcb-4433-87bf-f958f3f57424] Updated VIF entry in instance network info cache for port cab29de8-39b1-4673-ac55-4e29c21d0d34. {{(pid=75226) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 01:27:54 user nova-compute[75226]: DEBUG nova.network.neutron [req-6e62a494-1b62-4252-8507-b813d2dfa806 req-9ecf7063-2603-4433-838f-91b55bdfe8e6 service nova] [instance: bef5f981-8fcb-4433-87bf-f958f3f57424] Updating instance_info_cache with network_info: [{"id": "cab29de8-39b1-4673-ac55-4e29c21d0d34", "address": "fa:16:3e:13:0e:d0", "network": {"id": "57d0e7ee-0b11-4e00-86f9-bb4a3c25c674", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1357446034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e38777e8baf745e79f31190da97406a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcab29de8-39", "ovs_interfaceid": "cab29de8-39b1-4673-ac55-4e29c21d0d34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:27:54 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-6e62a494-1b62-4252-8507-b813d2dfa806 req-9ecf7063-2603-4433-838f-91b55bdfe8e6 service nova] Releasing lock "refresh_cache-bef5f981-8fcb-4433-87bf-f958f3f57424" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:27:55 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:27:55 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:27:55 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:27:55 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:27:55 user nova-compute[75226]: DEBUG nova.compute.manager [req-b9ca995a-6db7-4185-ba58-24e090f474bc req-7599c4be-aa22-4bca-abd4-574e217d4478 service nova] [instance: bef5f981-8fcb-4433-87bf-f958f3f57424] Received event network-vif-plugged-cab29de8-39b1-4673-ac55-4e29c21d0d34 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:27:55 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-b9ca995a-6db7-4185-ba58-24e090f474bc req-7599c4be-aa22-4bca-abd4-574e217d4478 service nova] Acquiring lock "bef5f981-8fcb-4433-87bf-f958f3f57424-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:27:55 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-b9ca995a-6db7-4185-ba58-24e090f474bc req-7599c4be-aa22-4bca-abd4-574e217d4478 service nova] Lock "bef5f981-8fcb-4433-87bf-f958f3f57424-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:27:55 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-b9ca995a-6db7-4185-ba58-24e090f474bc req-7599c4be-aa22-4bca-abd4-574e217d4478 service nova] Lock "bef5f981-8fcb-4433-87bf-f958f3f57424-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:27:55 user nova-compute[75226]: DEBUG nova.compute.manager [req-b9ca995a-6db7-4185-ba58-24e090f474bc req-7599c4be-aa22-4bca-abd4-574e217d4478 service nova] [instance: bef5f981-8fcb-4433-87bf-f958f3f57424] No waiting events found dispatching network-vif-plugged-cab29de8-39b1-4673-ac55-4e29c21d0d34 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:27:55 user nova-compute[75226]: WARNING nova.compute.manager [req-b9ca995a-6db7-4185-ba58-24e090f474bc req-7599c4be-aa22-4bca-abd4-574e217d4478 service nova] [instance: bef5f981-8fcb-4433-87bf-f958f3f57424] Received unexpected event network-vif-plugged-cab29de8-39b1-4673-ac55-4e29c21d0d34 for instance with vm_state building and task_state spawning.
Nov 17 01:27:55 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:27:55 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:27:55 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:27:55 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:27:55 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:27:57 user nova-compute[75226]: DEBUG nova.compute.manager [None req-a9ff18a3-a441-4f52-b68a-d6a2319f9fad tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: bef5f981-8fcb-4433-87bf-f958f3f57424] Instance event wait completed in 0 seconds for  {{(pid=75226) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 17 01:27:57 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-a9ff18a3-a441-4f52-b68a-d6a2319f9fad tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: bef5f981-8fcb-4433-87bf-f958f3f57424] Guest created on hypervisor {{(pid=75226) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 17 01:27:57 user nova-compute[75226]: INFO nova.virt.libvirt.driver [-] [instance: bef5f981-8fcb-4433-87bf-f958f3f57424] Instance spawned successfully.
Nov 17 01:27:57 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-a9ff18a3-a441-4f52-b68a-d6a2319f9fad tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: bef5f981-8fcb-4433-87bf-f958f3f57424] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 17 01:27:57 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-a9ff18a3-a441-4f52-b68a-d6a2319f9fad tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: bef5f981-8fcb-4433-87bf-f958f3f57424] Found default for hw_cdrom_bus of ide {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:27:57 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-a9ff18a3-a441-4f52-b68a-d6a2319f9fad tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: bef5f981-8fcb-4433-87bf-f958f3f57424] Found default for hw_disk_bus of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:27:57 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-a9ff18a3-a441-4f52-b68a-d6a2319f9fad tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: bef5f981-8fcb-4433-87bf-f958f3f57424] Found default for hw_input_bus of None {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:27:57 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-a9ff18a3-a441-4f52-b68a-d6a2319f9fad tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: bef5f981-8fcb-4433-87bf-f958f3f57424] Found default for hw_pointer_model of None {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:27:57 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-a9ff18a3-a441-4f52-b68a-d6a2319f9fad tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: bef5f981-8fcb-4433-87bf-f958f3f57424] Found default for hw_video_model of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:27:57 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-a9ff18a3-a441-4f52-b68a-d6a2319f9fad tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: bef5f981-8fcb-4433-87bf-f958f3f57424] Found default for hw_vif_model of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:27:57 user nova-compute[75226]: INFO nova.compute.manager [None req-a9ff18a3-a441-4f52-b68a-d6a2319f9fad tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: bef5f981-8fcb-4433-87bf-f958f3f57424] Took 5.54 seconds to spawn the instance on the hypervisor.
Nov 17 01:27:57 user nova-compute[75226]: DEBUG nova.compute.manager [None req-a9ff18a3-a441-4f52-b68a-d6a2319f9fad tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: bef5f981-8fcb-4433-87bf-f958f3f57424] Checking state {{(pid=75226) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 01:27:57 user nova-compute[75226]: INFO nova.compute.manager [None req-a9ff18a3-a441-4f52-b68a-d6a2319f9fad tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: bef5f981-8fcb-4433-87bf-f958f3f57424] Took 6.38 seconds to build instance.
Nov 17 01:27:57 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-a9ff18a3-a441-4f52-b68a-d6a2319f9fad tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Lock "bef5f981-8fcb-4433-87bf-f958f3f57424" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.478s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:27:57 user nova-compute[75226]: DEBUG nova.compute.manager [req-e7ee7aa9-cc0b-43b7-8cac-14aae21cdf69 req-acefbe06-8dfd-49e6-9208-019184513047 service nova] [instance: bef5f981-8fcb-4433-87bf-f958f3f57424] Received event network-vif-plugged-cab29de8-39b1-4673-ac55-4e29c21d0d34 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:27:57 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-e7ee7aa9-cc0b-43b7-8cac-14aae21cdf69 req-acefbe06-8dfd-49e6-9208-019184513047 service nova] Acquiring lock "bef5f981-8fcb-4433-87bf-f958f3f57424-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:27:57 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-e7ee7aa9-cc0b-43b7-8cac-14aae21cdf69 req-acefbe06-8dfd-49e6-9208-019184513047 service nova] Lock "bef5f981-8fcb-4433-87bf-f958f3f57424-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:27:57 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-e7ee7aa9-cc0b-43b7-8cac-14aae21cdf69 req-acefbe06-8dfd-49e6-9208-019184513047 service nova] Lock "bef5f981-8fcb-4433-87bf-f958f3f57424-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:27:57 user nova-compute[75226]: DEBUG nova.compute.manager [req-e7ee7aa9-cc0b-43b7-8cac-14aae21cdf69 req-acefbe06-8dfd-49e6-9208-019184513047 service nova] [instance: bef5f981-8fcb-4433-87bf-f958f3f57424] No waiting events found dispatching network-vif-plugged-cab29de8-39b1-4673-ac55-4e29c21d0d34 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:27:57 user nova-compute[75226]: WARNING nova.compute.manager [req-e7ee7aa9-cc0b-43b7-8cac-14aae21cdf69 req-acefbe06-8dfd-49e6-9208-019184513047 service nova] [instance: bef5f981-8fcb-4433-87bf-f958f3f57424] Received unexpected event network-vif-plugged-cab29de8-39b1-4673-ac55-4e29c21d0d34 for instance with vm_state active and task_state None.
Nov 17 01:27:57 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:27:57 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:27:58 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:28:01 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:28:02 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:28:02 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:28:03 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:28:03 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:28:03 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:28:03 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:28:04 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:28:04 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:28:04 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:28:04 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75226) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 17 01:28:04 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa84e575-bdad-45b9-80ce-86b1c2826fb0/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:28:04 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa84e575-bdad-45b9-80ce-86b1c2826fb0/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:28:04 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa84e575-bdad-45b9-80ce-86b1c2826fb0/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:28:04 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa84e575-bdad-45b9-80ce-86b1c2826fb0/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:28:04 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee2187c9-8620-4fd2-ad8a-a054cd8393f3/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:28:04 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-50544b28-b9a9-4f7a-a572-5dcd399e8a58 tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Acquiring lock "ee2187c9-8620-4fd2-ad8a-a054cd8393f3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:28:04 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-50544b28-b9a9-4f7a-a572-5dcd399e8a58 tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Lock "ee2187c9-8620-4fd2-ad8a-a054cd8393f3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:28:04 user nova-compute[75226]: DEBUG nova.objects.instance [None req-50544b28-b9a9-4f7a-a572-5dcd399e8a58 tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Lazy-loading 'flavor' on Instance uuid ee2187c9-8620-4fd2-ad8a-a054cd8393f3 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:28:04 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-1347f774-c6eb-485d-90fd-804f6e6752a8 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 306054a8-4d0f-4913-b3b8-97aeeeec071c is timed out.
Nov 17 01:28:04 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-1347f774-c6eb-485d-90fd-804f6e6752a8 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Successfully detached device vdc from instance 306054a8-4d0f-4913-b3b8-97aeeeec071c from the live domain config.
Nov 17 01:28:04 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-50544b28-b9a9-4f7a-a572-5dcd399e8a58 tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Lock "ee2187c9-8620-4fd2-ad8a-a054cd8393f3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:28:04 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1347f774-c6eb-485d-90fd-804f6e6752a8 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] [instance: 306054a8-4d0f-4913-b3b8-97aeeeec071c] calling os-brick to detach iSCSI Volume {{(pid=75226) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 17 01:28:04 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-1347f774-c6eb-485d-90fd-804f6e6752a8 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc4cc36b490>, {'target_iqn': 'iqn.2010-10.org.openstack:29701267-6547-48b4-befc-b18ec2ab5e2c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YyZkJfSx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:28:04 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-1347f774-c6eb-485d-90fd-804f6e6752a8 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:28:04 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-1347f774-c6eb-485d-90fd-804f6e6752a8 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:28:04 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-1347f774-c6eb-485d-90fd-804f6e6752a8 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:28:04 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:28:04 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:28:04 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3c7db85-316b-4045-8a61-5291e0a4f19a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c17ed19c-4452-4a79-b36a-07ddcd7d9404\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:29701267-6547-48b4-befc-b18ec2ab5e2c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:28:04 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-1347f774-c6eb-485d-90fd-804f6e6752a8 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 17 01:28:04 user nova-compute[75226]: No targets found.
Nov 17 01:28:04 user nova-compute[75226]: iSNS:
Nov 17 01:28:04 user nova-compute[75226]: No targets found.
Nov 17 01:28:04 user nova-compute[75226]: STATIC:
Nov 17 01:28:04 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14
Nov 17 01:28:04 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:28:04 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:28:04 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8
Nov 17 01:28:04 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:28:04 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:28:04 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:c17ed19c-4452-4a79-b36a-07ddcd7d9404
Nov 17 01:28:04 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:28:04 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:28:04 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:29701267-6547-48b4-befc-b18ec2ab5e2c
Nov 17 01:28:04 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:28:04 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:28:04 user nova-compute[75226]: FIRMWARE:
Nov 17 01:28:04 user nova-compute[75226]: No targets found.
Nov 17 01:28:04 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:28:04 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-1347f774-c6eb-485d-90fd-804f6e6752a8 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 17 01:28:04 user nova-compute[75226]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 17 01:28:04 user nova-compute[75226]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75226) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 17 01:28:04 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-1347f774-c6eb-485d-90fd-804f6e6752a8 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:29701267-6547-48b4-befc-b18ec2ab5e2c', 0)] {{(pid=75226) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 17 01:28:04 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:28:04 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:28:04 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[16e24a8a-61fd-4c79-b09a-35960a17f470]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:29701267-6547-48b4-befc-b18ec2ab5e2c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c17ed19c-4452-4a79-b36a-07ddcd7d9404\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:28:04 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:28:04 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee2187c9-8620-4fd2-ad8a-a054cd8393f3/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:28:04 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:28:04 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[52bb0750-2860-4d34-84af-b3e4b3262549]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29701267-6547-48b4-befc-b18ec2ab5e2c (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c17ed19c-4452-4a79-b36a-07ddcd7d9404 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:28:04 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee2187c9-8620-4fd2-ad8a-a054cd8393f3/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:28:04 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-1347f774-c6eb-485d-90fd-804f6e6752a8 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)
Nov 17 01:28:04 user nova-compute[75226]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29701267-6547-48b4-befc-b18ec2ab5e2c (non-flash)
Nov 17 01:28:04 user nova-compute[75226]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14 (non-flash)
Nov 17 01:28:04 user nova-compute[75226]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c17ed19c-4452-4a79-b36a-07ddcd7d9404 (non-flash)
Nov 17 01:28:04 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:28:04 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-1347f774-c6eb-485d-90fd-804f6e6752a8 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)
Nov 17 01:28:04 user nova-compute[75226]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29701267-6547-48b4-befc-b18ec2ab5e2c (non-flash)
Nov 17 01:28:04 user nova-compute[75226]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14 (non-flash)
Nov 17 01:28:04 user nova-compute[75226]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c17ed19c-4452-4a79-b36a-07ddcd7d9404 (non-flash)
Nov 17 01:28:04 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:28:04 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-1347f774-c6eb-485d-90fd-804f6e6752a8 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc4b4253c70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:29701267-6547-48b4-befc-b18ec2ab5e2c'): ({'sdb'}, set())}) {{(pid=75226) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 17 01:28:04 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-1347f774-c6eb-485d-90fd-804f6e6752a8 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Removing single pathed devices sdb {{(pid=75226) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 17 01:28:04 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:28:04 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:28:04 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[35685cde-3046-4e93-886c-f810f30ed766]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:28:04 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:28:04 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-50544b28-b9a9-4f7a-a572-5dcd399e8a58 tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Acquiring lock "ee2187c9-8620-4fd2-ad8a-a054cd8393f3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:28:04 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-50544b28-b9a9-4f7a-a572-5dcd399e8a58 tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Lock "ee2187c9-8620-4fd2-ad8a-a054cd8393f3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:28:04 user nova-compute[75226]: INFO nova.compute.manager [None req-50544b28-b9a9-4f7a-a572-5dcd399e8a58 tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] [instance: ee2187c9-8620-4fd2-ad8a-a054cd8393f3] Attaching volume 1bdffe6a-77b2-4ed9-9d93-5e432bde62ba to /dev/vdb
Nov 17 01:28:04 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.025s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:28:04 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f9ec1db-44e7-455b-b084-0e30be556d15]: (4, ('ok\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:28:04 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-1347f774-c6eb-485d-90fd-804f6e6752a8 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Flushing IO for device /dev/sdb {{(pid=75226) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 17 01:28:04 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:28:04 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:28:04 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[5082347a-59d4-44ef-8222-00b9387e86cf]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:28:04 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-1347f774-c6eb-485d-90fd-804f6e6752a8 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75226) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 17 01:28:04 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:28:04 user nova-compute[75226]: DEBUG os_brick.utils [None req-50544b28-b9a9-4f7a-a572-5dcd399e8a58 tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:28:04 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:28:04 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[c027a379-51b5-4ff2-8c10-3f2f1867bb3e]: (4, ('1', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:28:04 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-1347f774-c6eb-485d-90fd-804f6e6752a8 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75226) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 17 01:28:04 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-1347f774-c6eb-485d-90fd-804f6e6752a8 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] SCSI volumes sdb have been removed. {{(pid=75226) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 17 01:28:04 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-1347f774-c6eb-485d-90fd-804f6e6752a8 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:29701267-6547-48b4-befc-b18ec2ab5e2c')] {{(pid=75226) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 17 01:28:04 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:28:04 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29701267-6547-48b4-befc-b18ec2ab5e2c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:28:04 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:28:04 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9b2bdf7-80d3-450f-b61d-5de735e65e38]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f62857db69\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:28:04 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:28:04 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29701267-6547-48b4-befc-b18ec2ab5e2c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:28:04 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec8a135d-7f44-4292-9ca3-1f55e2f84f7e]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:28:04 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-1347f774-c6eb-485d-90fd-804f6e6752a8 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:28:04 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29701267-6547-48b4-befc-b18ec2ab5e2c -p 172.16.0.220:3260 --logout {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:28:04 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:28:04 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[14f396f5-3c04-4d54-aad3-b7c3f4cb0c47]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:28:05 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:28:05 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee2187c9-8620-4fd2-ad8a-a054cd8393f3/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:28:05 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:28:05 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fbe1518-c08c-4d15-b33f-497b8eefbbd4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:28:05 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[6947a739-e722-4152-ab5e-ae54c5f43769]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:28:05 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-50544b28-b9a9-4f7a-a572-5dcd399e8a58 tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Running cmd (subprocess): nvme version {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:28:05 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-50544b28-b9a9-4f7a-a572-5dcd399e8a58 tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] 'nvme version' failed. Not Retrying. {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 01:28:05 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29701267-6547-48b4-befc-b18ec2ab5e2c -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:28:05 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[09fdab60-9424-485c-9708-412ab214b747]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:29701267-6547-48b4-befc-b18ec2ab5e2c, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:29701267-6547-48b4-befc-b18ec2ab5e2c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:28:05 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.nvmeof [None req-50544b28-b9a9-4f7a-a572-5dcd399e8a58 tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] nvme not present on system {{(pid=75226) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 17 01:28:05 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-1347f774-c6eb-485d-90fd-804f6e6752a8 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:29701267-6547-48b4-befc-b18ec2ab5e2c, portal: 172.16.0.220,3260]
Nov 17 01:28:05 user nova-compute[75226]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:29701267-6547-48b4-befc-b18ec2ab5e2c, portal: 172.16.0.220,3260] successful.
Nov 17 01:28:05 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:28:05 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:28:05 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6555d72-6094-4ea9-b071-a3d3c8a300a9/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:28:05 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29701267-6547-48b4-befc-b18ec2ab5e2c -p 172.16.0.220:3260 --op delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:28:05 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 01:28:05 user nova-compute[75226]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 17 01:28:05 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[af7f1d39-f525-46fb-93e8-2dae976e9864]: (4, '') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:28:05 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29701267-6547-48b4-befc-b18ec2ab5e2c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:28:05 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[00440689-77e2-42fc-9b66-6903fbd0d714]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:28:05 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-1347f774-c6eb-485d-90fd-804f6e6752a8 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:28:05 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-1347f774-c6eb-485d-90fd-804f6e6752a8 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.389s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:28:05 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-1347f774-c6eb-485d-90fd-804f6e6752a8 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] <== disconnect_volume: return (390ms) None {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:28:05 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1347f774-c6eb-485d-90fd-804f6e6752a8 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] [instance: 306054a8-4d0f-4913-b3b8-97aeeeec071c] Disconnected iSCSI Volume {{(pid=75226) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 17 01:28:05 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-50544b28-b9a9-4f7a-a572-5dcd399e8a58 tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75226) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 17 01:28:05 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-50544b28-b9a9-4f7a-a572-5dcd399e8a58 tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75226) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 17 01:28:05 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-50544b28-b9a9-4f7a-a572-5dcd399e8a58 tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] LIGHTOS: no hostnqn found. {{(pid=75226) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 17 01:28:05 user nova-compute[75226]: DEBUG os_brick.utils [None req-50544b28-b9a9-4f7a-a572-5dcd399e8a58 tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] <== get_connector_properties: return (165ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f62857db69', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:28:05 user nova-compute[75226]: DEBUG nova.virt.block_device [None req-50544b28-b9a9-4f7a-a572-5dcd399e8a58 tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] [instance: ee2187c9-8620-4fd2-ad8a-a054cd8393f3] Updating existing volume attachment record: 6c009851-a9ab-454e-b1f7-7d506135f4f1 {{(pid=75226) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 17 01:28:05 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6555d72-6094-4ea9-b071-a3d3c8a300a9/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:28:05 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6555d72-6094-4ea9-b071-a3d3c8a300a9/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:28:05 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6555d72-6094-4ea9-b071-a3d3c8a300a9/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:28:05 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38062487-67ca-4962-974f-81456aebe97b/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:28:05 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38062487-67ca-4962-974f-81456aebe97b/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:28:05 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38062487-67ca-4962-974f-81456aebe97b/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:28:05 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38062487-67ca-4962-974f-81456aebe97b/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:28:05 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75226) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 01:28:05 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75226) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 01:28:05 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c280142-8901-4f83-bde4-baaa097e05b0/disk.rescue --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:28:05 user nova-compute[75226]: DEBUG nova.objects.instance [None req-1347f774-c6eb-485d-90fd-804f6e6752a8 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Lazy-loading 'flavor' on Instance uuid 306054a8-4d0f-4913-b3b8-97aeeeec071c {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:28:05 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-1347f774-c6eb-485d-90fd-804f6e6752a8 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Lock "306054a8-4d0f-4913-b3b8-97aeeeec071c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.749s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:28:06 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c280142-8901-4f83-bde4-baaa097e05b0/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:28:06 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c280142-8901-4f83-bde4-baaa097e05b0/disk.rescue --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:28:06 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c280142-8901-4f83-bde4-baaa097e05b0/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:28:06 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c280142-8901-4f83-bde4-baaa097e05b0/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:28:06 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c280142-8901-4f83-bde4-baaa097e05b0/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:28:06 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c280142-8901-4f83-bde4-baaa097e05b0/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:28:06 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c280142-8901-4f83-bde4-baaa097e05b0/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:28:06 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4050d898-f2b8-46c2-86e3-702ceb41a701/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:28:06 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4050d898-f2b8-46c2-86e3-702ceb41a701/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:28:06 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4050d898-f2b8-46c2-86e3-702ceb41a701/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:28:06 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4050d898-f2b8-46c2-86e3-702ceb41a701/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:28:06 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bef5f981-8fcb-4433-87bf-f958f3f57424/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:28:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bef5f981-8fcb-4433-87bf-f958f3f57424/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:28:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bef5f981-8fcb-4433-87bf-f958f3f57424/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:28:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bef5f981-8fcb-4433-87bf-f958f3f57424/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:28:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:28:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:28:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:28:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:28:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/306054a8-4d0f-4913-b3b8-97aeeeec071c/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:28:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/306054a8-4d0f-4913-b3b8-97aeeeec071c/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:28:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/306054a8-4d0f-4913-b3b8-97aeeeec071c/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:28:07 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:28:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/306054a8-4d0f-4913-b3b8-97aeeeec071c/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:28:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb140c60-d5e8-4849-8621-95e913becc45/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:28:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb140c60-d5e8-4849-8621-95e913becc45/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:28:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb140c60-d5e8-4849-8621-95e913becc45/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:28:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb140c60-d5e8-4849-8621-95e913becc45/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:28:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ea5a14b-c330-4a2b-926e-60e1b30f5981/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:28:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ea5a14b-c330-4a2b-926e-60e1b30f5981/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:28:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ea5a14b-c330-4a2b-926e-60e1b30f5981/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:28:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ea5a14b-c330-4a2b-926e-60e1b30f5981/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:28:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dcdd769-bbfe-48e8-a876-8b2072b7baeb/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:28:08 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:28:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dcdd769-bbfe-48e8-a876-8b2072b7baeb/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:28:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dcdd769-bbfe-48e8-a876-8b2072b7baeb/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:28:09 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dcdd769-bbfe-48e8-a876-8b2072b7baeb/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:28:09 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75226) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 01:28:09 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:28:09 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:28:09 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Hypervisor/Node resource view: name=user free_ram=7245MB free_disk=24.945411682128906GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75226) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 17 01:28:09 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:28:09 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:28:09 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance aa84e575-bdad-45b9-80ce-86b1c2826fb0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:28:09 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 6b7e9611-be35-4e51-b886-91a2fac0a653 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:28:09 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:28:09 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 38062487-67ca-4962-974f-81456aebe97b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:28:09 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance ee2187c9-8620-4fd2-ad8a-a054cd8393f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:28:09 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 4050d898-f2b8-46c2-86e3-702ceb41a701 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:28:09 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 4dcdd769-bbfe-48e8-a876-8b2072b7baeb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:28:09 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 2ea5a14b-c330-4a2b-926e-60e1b30f5981 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:28:09 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance d6555d72-6094-4ea9-b071-a3d3c8a300a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:28:09 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 5c280142-8901-4f83-bde4-baaa097e05b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:28:09 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 306054a8-4d0f-4913-b3b8-97aeeeec071c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:28:09 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance fb140c60-d5e8-4849-8621-95e913becc45 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:28:09 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 346967c5-6945-4cef-9eea-8415cb27c98f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:28:09 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance bef5f981-8fcb-4433-87bf-f958f3f57424 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:28:09 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=75226) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 17 01:28:09 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=12GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=75226) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 17 01:28:09 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Refreshing inventories for resource provider f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 17 01:28:09 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Updating ProviderTree inventory for provider f431122b-abb2-4ecb-9e21-e3ec333d823b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 17 01:28:09 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Updating inventory in ProviderTree for provider f431122b-abb2-4ecb-9e21-e3ec333d823b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 17 01:28:09 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Refreshing aggregate associations for resource provider f431122b-abb2-4ecb-9e21-e3ec333d823b, aggregates: None {{(pid=75226) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 17 01:28:09 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Refreshing trait associations for resource provider f431122b-abb2-4ecb-9e21-e3ec333d823b, traits: COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE42,HW_CPU_X86_SSE,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSSE3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_SATA {{(pid=75226) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 17 01:28:10 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:28:10 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:28:10 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Compute_service record updated for user:user {{(pid=75226) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 17 01:28:10 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.865s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:28:10 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:28:10 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Cleaning up deleted instances {{(pid=75226) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 17 01:28:10 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] There are 0 instances to clean {{(pid=75226) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 17 01:28:10 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:28:10 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75226) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 17 01:28:10 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-50544b28-b9a9-4f7a-a572-5dcd399e8a58 tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] [instance: ee2187c9-8620-4fd2-ad8a-a054cd8393f3] Calling os-brick to attach iSCSI Volume {{(pid=75226) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 17 01:28:10 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-50544b28-b9a9-4f7a-a572-5dcd399e8a58 tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc4cc36b490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qFQXscng', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:28:10 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-50544b28-b9a9-4f7a-a572-5dcd399e8a58 tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:28:10 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-50544b28-b9a9-4f7a-a572-5dcd399e8a58 tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:28:10 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-50544b28-b9a9-4f7a-a572-5dcd399e8a58 tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:28:10 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-50544b28-b9a9-4f7a-a572-5dcd399e8a58 tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:28:10 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-50544b28-b9a9-4f7a-a572-5dcd399e8a58 tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:28:10 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-50544b28-b9a9-4f7a-a572-5dcd399e8a58 tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:28:10 user nova-compute[75226]: INFO os_brick.initiator.connectors.iscsi [None req-50544b28-b9a9-4f7a-a572-5dcd399e8a58 tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 17 01:28:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba -p 172.16.0.220:3260 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:28:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:28:10 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b7fd31a-0e12-4a8c-a858-d02e18e54971]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:28:10 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-50544b28-b9a9-4f7a-a572-5dcd399e8a58 tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 17 01:28:10 user nova-compute[75226]:  {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:28:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba -p 172.16.0.220:3260 --interface default --op new {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:28:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:28:10 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d6eb11d-3a50-47b3-9f6d-161929df4074]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba] added\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:28:10 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-50544b28-b9a9-4f7a-a572-5dcd399e8a58 tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba] added
Nov 17 01:28:10 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:28:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:28:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:28:10 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc360adc-a917-4f6c-81f2-ff54d2bca749]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:28:10 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-50544b28-b9a9-4f7a-a572-5dcd399e8a58 tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:28:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:28:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:28:10 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8c489f9-be17-45ee-b745-c9ecea636a82]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:28:10 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-50544b28-b9a9-4f7a-a572-5dcd399e8a58 tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:28:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qFQXscng {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:28:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qFQXscng" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:28:10 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[33534705-39d4-41d9-9ece-bd6ab511d9bc]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:28:10 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-50544b28-b9a9-4f7a-a572-5dcd399e8a58 tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qFQXscng'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:28:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:28:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:28:10 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e890d46-d556-4224-a6d6-84fdb9919cf3]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:28:10 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-50544b28-b9a9-4f7a-a572-5dcd399e8a58 tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:28:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:28:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:28:10 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[896549aa-7a56-4fef-9e43-22d2e0a357e1]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c17ed19c-4452-4a79-b36a-07ddcd7d9404 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:28:10 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-50544b28-b9a9-4f7a-a572-5dcd399e8a58 tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)
Nov 17 01:28:10 user nova-compute[75226]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14 (non-flash)
Nov 17 01:28:10 user nova-compute[75226]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c17ed19c-4452-4a79-b36a-07ddcd7d9404 (non-flash)
Nov 17 01:28:10 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:28:10 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-50544b28-b9a9-4f7a-a572-5dcd399e8a58 tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)
Nov 17 01:28:10 user nova-compute[75226]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14 (non-flash)
Nov 17 01:28:10 user nova-compute[75226]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c17ed19c-4452-4a79-b36a-07ddcd7d9404 (non-flash)
Nov 17 01:28:10 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:28:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba -p 172.16.0.220:3260 --login {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:28:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:28:10 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e4f1653-e879-48e1-bfe7-7cff6932d023]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:28:10 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-50544b28-b9a9-4f7a-a572-5dcd399e8a58 tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba, portal: 172.16.0.220,3260]
Nov 17 01:28:10 user nova-compute[75226]: Login to [iface: default, target: iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba, portal: 172.16.0.220,3260] successful.
Nov 17 01:28:10 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:28:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:28:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:28:10 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[491b31b4-2e83-44d6-9d83-1d893f4263c2]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:28:10 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-50544b28-b9a9-4f7a-a572-5dcd399e8a58 tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:28:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:28:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:28:10 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c0c491c-55cf-4a3e-b0f8-195c65ca932e]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c17ed19c-4452-4a79-b36a-07ddcd7d9404 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:28:10 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-50544b28-b9a9-4f7a-a572-5dcd399e8a58 tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)
Nov 17 01:28:10 user nova-compute[75226]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14 (non-flash)
Nov 17 01:28:10 user nova-compute[75226]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c17ed19c-4452-4a79-b36a-07ddcd7d9404 (non-flash)
Nov 17 01:28:10 user nova-compute[75226]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba (non-flash)
Nov 17 01:28:10 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:28:10 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-50544b28-b9a9-4f7a-a572-5dcd399e8a58 tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)
Nov 17 01:28:10 user nova-compute[75226]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14 (non-flash)
Nov 17 01:28:10 user nova-compute[75226]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c17ed19c-4452-4a79-b36a-07ddcd7d9404 (non-flash)
Nov 17 01:28:10 user nova-compute[75226]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba (non-flash)
Nov 17 01:28:10 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:28:10 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-50544b28-b9a9-4f7a-a572-5dcd399e8a58 tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.360s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:28:10 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-50544b28-b9a9-4f7a-a572-5dcd399e8a58 tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Connected to 172.16.0.220:3260 {{(pid=75226) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 17 01:28:10 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-50544b28-b9a9-4f7a-a572-5dcd399e8a58 tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] HCTL ('33', '-', '-', 0) found on session 30 with lun 0 {{(pid=75226) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 17 01:28:10 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-50544b28-b9a9-4f7a-a572-5dcd399e8a58 tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75226) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 17 01:28:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:28:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:28:10 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[1feec58b-141e-4801-ac89-9ecde3315db0]: (4, ('- - 0', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:28:10 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-50544b28-b9a9-4f7a-a572-5dcd399e8a58 tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Searching for a device in session 30 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75226) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 01:28:10 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-50544b28-b9a9-4f7a-a572-5dcd399e8a58 tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qFQXscng', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75226) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 17 01:28:11 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-50544b28-b9a9-4f7a-a572-5dcd399e8a58 tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.395s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:28:11 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-50544b28-b9a9-4f7a-a572-5dcd399e8a58 tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] <== connect_volume: return (1396ms) {'type': 'block', 'scsi_wwn': '26365326232616566', 'path': '/dev/sdb'} {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:28:11 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-50544b28-b9a9-4f7a-a572-5dcd399e8a58 tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] [instance: ee2187c9-8620-4fd2-ad8a-a054cd8393f3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26365326232616566', 'path': '/dev/sdb'} {{(pid=75226) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 17 01:28:11 user nova-compute[75226]: DEBUG nova.objects.instance [None req-50544b28-b9a9-4f7a-a572-5dcd399e8a58 tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Lazy-loading 'flavor' on Instance uuid ee2187c9-8620-4fd2-ad8a-a054cd8393f3 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:28:11 user nova-compute[75226]: DEBUG nova.virt.libvirt.guest [None req-50544b28-b9a9-4f7a-a572-5dcd399e8a58 tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] attach device xml: <disk type="block" device="disk">
Nov 17 01:28:11 user nova-compute[75226]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 01:28:11 user nova-compute[75226]:   <source dev="/dev/sdb"/>
Nov 17 01:28:11 user nova-compute[75226]:   <target dev="vdb" bus="virtio"/>
Nov 17 01:28:11 user nova-compute[75226]:   <serial>1bdffe6a-77b2-4ed9-9d93-5e432bde62ba</serial>
Nov 17 01:28:11 user nova-compute[75226]: </disk>
Nov 17 01:28:11 user nova-compute[75226]:  {{(pid=75226) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 17 01:28:12 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-50544b28-b9a9-4f7a-a572-5dcd399e8a58 tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] No BDM found with device name vda, not building metadata. {{(pid=75226) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 01:28:12 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-50544b28-b9a9-4f7a-a572-5dcd399e8a58 tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75226) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 01:28:12 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-50544b28-b9a9-4f7a-a572-5dcd399e8a58 tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] No VIF found with MAC fa:16:3e:4a:f5:8f, not building metadata {{(pid=75226) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 01:28:12 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-50544b28-b9a9-4f7a-a572-5dcd399e8a58 tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Lock "ee2187c9-8620-4fd2-ad8a-a054cd8393f3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.601s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:28:12 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:28:13 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:28:13 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Starting heal instance info cache {{(pid=75226) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 17 01:28:13 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "refresh_cache-306054a8-4d0f-4913-b3b8-97aeeeec071c" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:28:13 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquired lock "refresh_cache-306054a8-4d0f-4913-b3b8-97aeeeec071c" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:28:13 user nova-compute[75226]: DEBUG nova.network.neutron [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] [instance: 306054a8-4d0f-4913-b3b8-97aeeeec071c] Forcefully refreshing network info cache for instance {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 17 01:28:13 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:28:14 user nova-compute[75226]: DEBUG nova.network.neutron [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] [instance: 306054a8-4d0f-4913-b3b8-97aeeeec071c] Updating instance_info_cache with network_info: [{"id": "9c6d2999-f11a-4cab-828c-993cc52b996c", "address": "fa:16:3e:71:4a:e0", "network": {"id": "72724945-89ae-47c2-ac58-ea393837ada6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-308563626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fcdc65b510141e9b7c9a01401a97448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c6d2999-f1", "ovs_interfaceid": "9c6d2999-f11a-4cab-828c-993cc52b996c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:28:14 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Releasing lock "refresh_cache-306054a8-4d0f-4913-b3b8-97aeeeec071c" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:28:14 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] [instance: 306054a8-4d0f-4913-b3b8-97aeeeec071c] Updated the network info_cache for instance {{(pid=75226) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 17 01:28:14 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:28:14 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:28:14 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:28:14 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75226) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 17 01:28:14 user nova-compute[75226]: DEBUG nova.compute.manager [None req-712875b6-982c-43a5-ace6-755ac80c734d tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] [instance: ee2187c9-8620-4fd2-ad8a-a054cd8393f3] Stashing vm_state: active {{(pid=75226) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 17 01:28:14 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-712875b6-982c-43a5-ace6-755ac80c734d tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:28:14 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-712875b6-982c-43a5-ace6-755ac80c734d tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:28:14 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-712875b6-982c-43a5-ace6-755ac80c734d tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75226) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 17 01:28:14 user nova-compute[75226]: INFO nova.compute.claims [None req-712875b6-982c-43a5-ace6-755ac80c734d tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] [instance: ee2187c9-8620-4fd2-ad8a-a054cd8393f3] Claim successful on node user
Nov 17 01:28:15 user nova-compute[75226]: INFO nova.compute.resource_tracker [None req-712875b6-982c-43a5-ace6-755ac80c734d tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] [instance: ee2187c9-8620-4fd2-ad8a-a054cd8393f3] Updating resource usage from migration 96afa0fa-c757-4cd5-beaa-0507610ab24f
Nov 17 01:28:15 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-712875b6-982c-43a5-ace6-755ac80c734d tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:28:15 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-712875b6-982c-43a5-ace6-755ac80c734d tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:28:15 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-712875b6-982c-43a5-ace6-755ac80c734d tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.519s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:28:15 user nova-compute[75226]: INFO nova.compute.manager [None req-712875b6-982c-43a5-ace6-755ac80c734d tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] [instance: ee2187c9-8620-4fd2-ad8a-a054cd8393f3] Migrating
Nov 17 01:28:15 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-712875b6-982c-43a5-ace6-755ac80c734d tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:28:15 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-712875b6-982c-43a5-ace6-755ac80c734d tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Acquired lock "compute-rpcapi-router" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:28:15 user nova-compute[75226]: INFO nova.compute.rpcapi [None req-712875b6-982c-43a5-ace6-755ac80c734d tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Nov 17 01:28:15 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-712875b6-982c-43a5-ace6-755ac80c734d tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Releasing lock "compute-rpcapi-router" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:28:15 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-712875b6-982c-43a5-ace6-755ac80c734d tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Acquiring lock "refresh_cache-ee2187c9-8620-4fd2-ad8a-a054cd8393f3" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:28:15 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-712875b6-982c-43a5-ace6-755ac80c734d tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Acquired lock "refresh_cache-ee2187c9-8620-4fd2-ad8a-a054cd8393f3" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:28:15 user nova-compute[75226]: DEBUG nova.network.neutron [None req-712875b6-982c-43a5-ace6-755ac80c734d tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] [instance: ee2187c9-8620-4fd2-ad8a-a054cd8393f3] Building network info cache for instance {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 01:28:15 user nova-compute[75226]: DEBUG nova.network.neutron [None req-712875b6-982c-43a5-ace6-755ac80c734d tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] [instance: ee2187c9-8620-4fd2-ad8a-a054cd8393f3] Updating instance_info_cache with network_info: [{"id": "1057ea4c-2ac4-40fa-8b2e-3b5888ea4d61", "address": "fa:16:3e:4a:f5:8f", "network": {"id": "3d8c3322-c78d-4d3a-b8c7-ba12241b4c65", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1996535656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c19f767dc7bb4024b3cbf1d8f5f8f2bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1057ea4c-2a", "ovs_interfaceid": "1057ea4c-2ac4-40fa-8b2e-3b5888ea4d61", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:28:15 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-712875b6-982c-43a5-ace6-755ac80c734d tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Releasing lock "refresh_cache-ee2187c9-8620-4fd2-ad8a-a054cd8393f3" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:28:16 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-712875b6-982c-43a5-ace6-755ac80c734d tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] [instance: ee2187c9-8620-4fd2-ad8a-a054cd8393f3] Starting migrate_disk_and_power_off {{(pid=75226) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 17 01:28:16 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:28:16 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:28:16 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:28:16 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:28:16 user nova-compute[75226]: DEBUG nova.compute.manager [req-8bf250db-e659-4f2e-bc4a-a28bc7fa9dce req-73f2caa5-acf7-4182-8f4e-e5e39eca8156 service nova] [instance: ee2187c9-8620-4fd2-ad8a-a054cd8393f3] Received event network-vif-unplugged-1057ea4c-2ac4-40fa-8b2e-3b5888ea4d61 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:28:16 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-8bf250db-e659-4f2e-bc4a-a28bc7fa9dce req-73f2caa5-acf7-4182-8f4e-e5e39eca8156 service nova] Acquiring lock "ee2187c9-8620-4fd2-ad8a-a054cd8393f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:28:16 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-8bf250db-e659-4f2e-bc4a-a28bc7fa9dce req-73f2caa5-acf7-4182-8f4e-e5e39eca8156 service nova] Lock "ee2187c9-8620-4fd2-ad8a-a054cd8393f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:28:16 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-8bf250db-e659-4f2e-bc4a-a28bc7fa9dce req-73f2caa5-acf7-4182-8f4e-e5e39eca8156 service nova] Lock "ee2187c9-8620-4fd2-ad8a-a054cd8393f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:28:16 user nova-compute[75226]: DEBUG nova.compute.manager [req-8bf250db-e659-4f2e-bc4a-a28bc7fa9dce req-73f2caa5-acf7-4182-8f4e-e5e39eca8156 service nova] [instance: ee2187c9-8620-4fd2-ad8a-a054cd8393f3] No waiting events found dispatching network-vif-unplugged-1057ea4c-2ac4-40fa-8b2e-3b5888ea4d61 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:28:16 user nova-compute[75226]: WARNING nova.compute.manager [req-8bf250db-e659-4f2e-bc4a-a28bc7fa9dce req-73f2caa5-acf7-4182-8f4e-e5e39eca8156 service nova] [instance: ee2187c9-8620-4fd2-ad8a-a054cd8393f3] Received unexpected event network-vif-unplugged-1057ea4c-2ac4-40fa-8b2e-3b5888ea4d61 for instance with vm_state active and task_state resize_migrating.
Nov 17 01:28:16 user nova-compute[75226]: INFO nova.virt.libvirt.driver [-] [instance: ee2187c9-8620-4fd2-ad8a-a054cd8393f3] Instance destroyed successfully.
Nov 17 01:28:16 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-712875b6-982c-43a5-ace6-755ac80c734d tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:24:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1878692867',display_name='tempest-ServerActionsTestOtherB-server-1878692867',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1878692867',id=21,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBTPdFaRxKgPkRdKbUEvHAZcoj+dPC43zryXBmo0q5ihjaLD04DW9eJSP+KLH1T/XkmERKqJKOvG49EB5qtvQ6Fib4lL66B3axWTUVDvaaC20Rh3bH2XA1pGQ2EKVxiHfg==',key_name='tempest-keypair-1901957685',keypairs=<?>,launch_index=0,launched_at=2023-11-17T01:24:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c19f767dc7bb4024b3cbf1d8f5f8f2bf',ramdisk_id='',reservation_id='r-p9pzzoi2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-229085712',owner_user_name='tempest-ServerActionsTestOtherB-229085712-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T01:28:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f0952a7e2dd64bf2adb2e224965377ab',uuid=ee2187c9-8620-4fd2-ad8a-a054cd8393f3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1057ea4c-2ac4-40fa-8b2e-3b5888ea4d61", "address": "fa:16:3e:4a:f5:8f", "network": {"id": "3d8c3322-c78d-4d3a-b8c7-ba12241b4c65", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1996535656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1996535656-network", "vif_mac": "fa:16:3e:4a:f5:8f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c19f767dc7bb4024b3cbf1d8f5f8f2bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1057ea4c-2a", "ovs_interfaceid": "1057ea4c-2ac4-40fa-8b2e-3b5888ea4d61", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 17 01:28:16 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-712875b6-982c-43a5-ace6-755ac80c734d tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Converting VIF {"id": "1057ea4c-2ac4-40fa-8b2e-3b5888ea4d61", "address": "fa:16:3e:4a:f5:8f", "network": {"id": "3d8c3322-c78d-4d3a-b8c7-ba12241b4c65", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1996535656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1996535656-network", "vif_mac": "fa:16:3e:4a:f5:8f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c19f767dc7bb4024b3cbf1d8f5f8f2bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1057ea4c-2a", "ovs_interfaceid": "1057ea4c-2ac4-40fa-8b2e-3b5888ea4d61", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:28:16 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-712875b6-982c-43a5-ace6-755ac80c734d tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4a:f5:8f,bridge_name='br-int',has_traffic_filtering=True,id=1057ea4c-2ac4-40fa-8b2e-3b5888ea4d61,network=Network(3d8c3322-c78d-4d3a-b8c7-ba12241b4c65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1057ea4c-2a') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:28:16 user nova-compute[75226]: DEBUG os_vif [None req-712875b6-982c-43a5-ace6-755ac80c734d tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4a:f5:8f,bridge_name='br-int',has_traffic_filtering=True,id=1057ea4c-2ac4-40fa-8b2e-3b5888ea4d61,network=Network(3d8c3322-c78d-4d3a-b8c7-ba12241b4c65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1057ea4c-2a') {{(pid=75226) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 17 01:28:16 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:28:16 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1057ea4c-2a, bridge=br-int, if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:28:16 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:28:16 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:28:16 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:28:16 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:28:16 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ab8d4434-aa56-4b55-8ef7-d8a98253992b) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:28:16 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:28:16 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:28:16 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:28:16 user nova-compute[75226]: INFO os_vif [None req-712875b6-982c-43a5-ace6-755ac80c734d tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4a:f5:8f,bridge_name='br-int',has_traffic_filtering=True,id=1057ea4c-2ac4-40fa-8b2e-3b5888ea4d61,network=Network(3d8c3322-c78d-4d3a-b8c7-ba12241b4c65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1057ea4c-2a')
Nov 17 01:28:16 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-712875b6-982c-43a5-ace6-755ac80c734d tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] [instance: ee2187c9-8620-4fd2-ad8a-a054cd8393f3] calling os-brick to detach iSCSI Volume {{(pid=75226) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 17 01:28:16 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-712875b6-982c-43a5-ace6-755ac80c734d tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc4cc36b490>, {'target_iqn': 'iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qFQXscng', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:28:16 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-712875b6-982c-43a5-ace6-755ac80c734d tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:28:16 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-712875b6-982c-43a5-ace6-755ac80c734d tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:28:16 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-712875b6-982c-43a5-ace6-755ac80c734d tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:28:16 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:28:16 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:28:16 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a71ab9d-9d4b-40da-bde2-95b232f31bac]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c17ed19c-4452-4a79-b36a-07ddcd7d9404\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:28:16 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-712875b6-982c-43a5-ace6-755ac80c734d tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 17 01:28:16 user nova-compute[75226]: No targets found.
Nov 17 01:28:16 user nova-compute[75226]: iSNS:
Nov 17 01:28:16 user nova-compute[75226]: No targets found.
Nov 17 01:28:16 user nova-compute[75226]: STATIC:
Nov 17 01:28:16 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14
Nov 17 01:28:16 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:28:16 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:28:16 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba
Nov 17 01:28:16 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:28:16 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:28:16 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8
Nov 17 01:28:16 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:28:16 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:28:16 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:c17ed19c-4452-4a79-b36a-07ddcd7d9404
Nov 17 01:28:16 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:28:16 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:28:16 user nova-compute[75226]: FIRMWARE:
Nov 17 01:28:16 user nova-compute[75226]: No targets found.
Nov 17 01:28:16 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:28:16 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-712875b6-982c-43a5-ace6-755ac80c734d tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 17 01:28:16 user nova-compute[75226]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 17 01:28:16 user nova-compute[75226]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75226) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 17 01:28:16 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-712875b6-982c-43a5-ace6-755ac80c734d tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba', 0)] {{(pid=75226) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 17 01:28:16 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:28:16 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:28:16 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[2915464f-6f5a-4bc2-a12b-be040bcb310d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c17ed19c-4452-4a79-b36a-07ddcd7d9404\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:28:16 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:28:17 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:28:17 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[52b8e434-b5f9-4d8a-9316-52e9ca770338]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c17ed19c-4452-4a79-b36a-07ddcd7d9404 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:28:17 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-712875b6-982c-43a5-ace6-755ac80c734d tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)
Nov 17 01:28:17 user nova-compute[75226]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14 (non-flash)
Nov 17 01:28:17 user nova-compute[75226]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c17ed19c-4452-4a79-b36a-07ddcd7d9404 (non-flash)
Nov 17 01:28:17 user nova-compute[75226]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba (non-flash)
Nov 17 01:28:17 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:28:17 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-712875b6-982c-43a5-ace6-755ac80c734d tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)
Nov 17 01:28:17 user nova-compute[75226]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14 (non-flash)
Nov 17 01:28:17 user nova-compute[75226]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c17ed19c-4452-4a79-b36a-07ddcd7d9404 (non-flash)
Nov 17 01:28:17 user nova-compute[75226]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba (non-flash)
Nov 17 01:28:17 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:28:17 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-712875b6-982c-43a5-ace6-755ac80c734d tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc4b4133640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba'): ({'sdb'}, set())}) {{(pid=75226) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 17 01:28:17 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-712875b6-982c-43a5-ace6-755ac80c734d tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Removing single pathed devices sdb {{(pid=75226) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 17 01:28:17 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:28:17 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:28:17 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff3cd948-b258-4059-b025-ba86772bf62a]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:28:17 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:28:17 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:28:17 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[23cdf05f-eb38-4f44-9378-3f936de3919c]: (4, ('ok\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:28:17 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-712875b6-982c-43a5-ace6-755ac80c734d tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Flushing IO for device /dev/sdb {{(pid=75226) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 17 01:28:17 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:28:17 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:28:17 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[606620c7-1a3e-4f72-8131-56327a2b385e]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:28:17 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-712875b6-982c-43a5-ace6-755ac80c734d tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75226) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 17 01:28:17 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:28:17 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:28:17 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[ead6f786-0540-4063-a2f6-eab7051af42f]: (4, ('1', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:28:17 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-712875b6-982c-43a5-ace6-755ac80c734d tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75226) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 17 01:28:17 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-712875b6-982c-43a5-ace6-755ac80c734d tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] SCSI volumes sdb have been removed. {{(pid=75226) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 17 01:28:17 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-712875b6-982c-43a5-ace6-755ac80c734d tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba')] {{(pid=75226) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 17 01:28:17 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:28:17 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:28:17 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8297c89-65f8-4d97-9336-d802ebd990d9]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:28:17 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-712875b6-982c-43a5-ace6-755ac80c734d tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:28:17 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba -p 172.16.0.220:3260 --logout {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:28:17 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:28:17 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[10a32783-93bc-4900-9d06-5f2211bbd15d]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:28:17 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-712875b6-982c-43a5-ace6-755ac80c734d tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba, portal: 172.16.0.220,3260]
Nov 17 01:28:17 user nova-compute[75226]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba, portal: 172.16.0.220,3260] successful.
Nov 17 01:28:17 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:28:17 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba -p 172.16.0.220:3260 --op delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:28:17 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:28:17 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed61c9ad-7db5-457b-beb5-04af48ef14ac]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:28:17 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-712875b6-982c-43a5-ace6-755ac80c734d tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:28:17 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-712875b6-982c-43a5-ace6-755ac80c734d tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:28:17 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-712875b6-982c-43a5-ace6-755ac80c734d tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] <== disconnect_volume: return (307ms) None {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:28:17 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-712875b6-982c-43a5-ace6-755ac80c734d tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] [instance: ee2187c9-8620-4fd2-ad8a-a054cd8393f3] Disconnected iSCSI Volume {{(pid=75226) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 17 01:28:17 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-712875b6-982c-43a5-ace6-755ac80c734d tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee2187c9-8620-4fd2-ad8a-a054cd8393f3/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:28:17 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-712875b6-982c-43a5-ace6-755ac80c734d tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee2187c9-8620-4fd2-ad8a-a054cd8393f3/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:28:17 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-712875b6-982c-43a5-ace6-755ac80c734d tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee2187c9-8620-4fd2-ad8a-a054cd8393f3/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:28:17 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-712875b6-982c-43a5-ace6-755ac80c734d tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee2187c9-8620-4fd2-ad8a-a054cd8393f3/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:28:17 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-712875b6-982c-43a5-ace6-755ac80c734d tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75226) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 01:28:17 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-712875b6-982c-43a5-ace6-755ac80c734d tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/ee2187c9-8620-4fd2-ad8a-a054cd8393f3_resize/disk /opt/stack/data/nova/instances/ee2187c9-8620-4fd2-ad8a-a054cd8393f3/disk {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:28:17 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:28:17 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-712875b6-982c-43a5-ace6-755ac80c734d tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] CMD "cp -r /opt/stack/data/nova/instances/ee2187c9-8620-4fd2-ad8a-a054cd8393f3_resize/disk /opt/stack/data/nova/instances/ee2187c9-8620-4fd2-ad8a-a054cd8393f3/disk" returned: 0 in 0.318s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:28:17 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-712875b6-982c-43a5-ace6-755ac80c734d tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/ee2187c9-8620-4fd2-ad8a-a054cd8393f3_resize/disk.info /opt/stack/data/nova/instances/ee2187c9-8620-4fd2-ad8a-a054cd8393f3/disk.info {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:28:17 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-712875b6-982c-43a5-ace6-755ac80c734d tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] CMD "cp -r /opt/stack/data/nova/instances/ee2187c9-8620-4fd2-ad8a-a054cd8393f3_resize/disk.info /opt/stack/data/nova/instances/ee2187c9-8620-4fd2-ad8a-a054cd8393f3/disk.info" returned: 0 in 0.034s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:28:18 user nova-compute[75226]: DEBUG nova.compute.manager [req-8c8cb0d0-7ba8-4c05-9d36-28ae8a201a80 req-cfbfae55-1abb-4019-b51d-09b8996920f2 service nova] [instance: ee2187c9-8620-4fd2-ad8a-a054cd8393f3] Received event network-vif-plugged-1057ea4c-2ac4-40fa-8b2e-3b5888ea4d61 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:28:18 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-8c8cb0d0-7ba8-4c05-9d36-28ae8a201a80 req-cfbfae55-1abb-4019-b51d-09b8996920f2 service nova] Acquiring lock "ee2187c9-8620-4fd2-ad8a-a054cd8393f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:28:18 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-8c8cb0d0-7ba8-4c05-9d36-28ae8a201a80 req-cfbfae55-1abb-4019-b51d-09b8996920f2 service nova] Lock "ee2187c9-8620-4fd2-ad8a-a054cd8393f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:28:18 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-8c8cb0d0-7ba8-4c05-9d36-28ae8a201a80 req-cfbfae55-1abb-4019-b51d-09b8996920f2 service nova] Lock "ee2187c9-8620-4fd2-ad8a-a054cd8393f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:28:18 user nova-compute[75226]: DEBUG nova.compute.manager [req-8c8cb0d0-7ba8-4c05-9d36-28ae8a201a80 req-cfbfae55-1abb-4019-b51d-09b8996920f2 service nova] [instance: ee2187c9-8620-4fd2-ad8a-a054cd8393f3] No waiting events found dispatching network-vif-plugged-1057ea4c-2ac4-40fa-8b2e-3b5888ea4d61 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:28:18 user nova-compute[75226]: WARNING nova.compute.manager [req-8c8cb0d0-7ba8-4c05-9d36-28ae8a201a80 req-cfbfae55-1abb-4019-b51d-09b8996920f2 service nova] [instance: ee2187c9-8620-4fd2-ad8a-a054cd8393f3] Received unexpected event network-vif-plugged-1057ea4c-2ac4-40fa-8b2e-3b5888ea4d61 for instance with vm_state active and task_state resize_migrating.
Nov 17 01:28:18 user nova-compute[75226]: DEBUG nova.network.neutron [None req-712875b6-982c-43a5-ace6-755ac80c734d tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] [instance: ee2187c9-8620-4fd2-ad8a-a054cd8393f3] Port 1057ea4c-2ac4-40fa-8b2e-3b5888ea4d61 binding to destination host user is already ACTIVE {{(pid=75226) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 17 01:28:19 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-712875b6-982c-43a5-ace6-755ac80c734d tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Acquiring lock "ee2187c9-8620-4fd2-ad8a-a054cd8393f3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:28:19 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-712875b6-982c-43a5-ace6-755ac80c734d tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Lock "ee2187c9-8620-4fd2-ad8a-a054cd8393f3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:28:19 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-712875b6-982c-43a5-ace6-755ac80c734d tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Lock "ee2187c9-8620-4fd2-ad8a-a054cd8393f3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:28:19 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-712875b6-982c-43a5-ace6-755ac80c734d tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Acquiring lock "refresh_cache-ee2187c9-8620-4fd2-ad8a-a054cd8393f3" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:28:19 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-712875b6-982c-43a5-ace6-755ac80c734d tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Acquired lock "refresh_cache-ee2187c9-8620-4fd2-ad8a-a054cd8393f3" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:28:19 user nova-compute[75226]: DEBUG nova.network.neutron [None req-712875b6-982c-43a5-ace6-755ac80c734d tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] [instance: ee2187c9-8620-4fd2-ad8a-a054cd8393f3] Building network info cache for instance {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 01:28:19 user nova-compute[75226]: DEBUG nova.network.neutron [None req-712875b6-982c-43a5-ace6-755ac80c734d tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] [instance: ee2187c9-8620-4fd2-ad8a-a054cd8393f3] Updating instance_info_cache with network_info: [{"id": "1057ea4c-2ac4-40fa-8b2e-3b5888ea4d61", "address": "fa:16:3e:4a:f5:8f", "network": {"id": "3d8c3322-c78d-4d3a-b8c7-ba12241b4c65", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1996535656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c19f767dc7bb4024b3cbf1d8f5f8f2bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1057ea4c-2a", "ovs_interfaceid": "1057ea4c-2ac4-40fa-8b2e-3b5888ea4d61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:28:19 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-712875b6-982c-43a5-ace6-755ac80c734d tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Releasing lock "refresh_cache-ee2187c9-8620-4fd2-ad8a-a054cd8393f3" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:28:20 user nova-compute[75226]: DEBUG os_brick.utils [None req-712875b6-982c-43a5-ace6-755ac80c734d tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:28:20 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:28:20 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:28:20 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddb3ba15-c83e-4d98-8b66-0ba20f106ab4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f62857db69\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:28:20 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:28:20 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:28:20 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ef5a4d9-4b45-4bd9-8d43-8523fc14039a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:28:20 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:28:20 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:28:20 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[0336cdc6-c670-440e-97a3-17036dadf5f1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:28:20 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ef70fc8-1143-49b7-b1f7-1ae83817a685]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:28:20 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-712875b6-982c-43a5-ace6-755ac80c734d tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Running cmd (subprocess): nvme version {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:28:20 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-712875b6-982c-43a5-ace6-755ac80c734d tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] 'nvme version' failed. Not Retrying. {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 01:28:20 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.nvmeof [None req-712875b6-982c-43a5-ace6-755ac80c734d tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] nvme not present on system {{(pid=75226) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 17 01:28:20 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:28:20 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 01:28:20 user nova-compute[75226]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 17 01:28:20 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[174c68be-b24b-48e5-b873-2ae44ef47276]: (4, '') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:28:20 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-712875b6-982c-43a5-ace6-755ac80c734d tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75226) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 17 01:28:20 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-712875b6-982c-43a5-ace6-755ac80c734d tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75226) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 17 01:28:20 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-712875b6-982c-43a5-ace6-755ac80c734d tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] LIGHTOS: no hostnqn found. {{(pid=75226) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 17 01:28:20 user nova-compute[75226]: DEBUG os_brick.utils [None req-712875b6-982c-43a5-ace6-755ac80c734d tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f62857db69', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:28:21 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:28:22 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:28:25 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-712875b6-982c-43a5-ace6-755ac80c734d tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] [instance: ee2187c9-8620-4fd2-ad8a-a054cd8393f3] Starting finish_migration {{(pid=75226) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 17 01:28:25 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-712875b6-982c-43a5-ace6-755ac80c734d tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] [instance: ee2187c9-8620-4fd2-ad8a-a054cd8393f3] Instance directory exists: not creating {{(pid=75226) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 17 01:28:25 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-712875b6-982c-43a5-ace6-755ac80c734d tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] [instance: ee2187c9-8620-4fd2-ad8a-a054cd8393f3] Creating image(s)
Nov 17 01:28:25 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-712875b6-982c-43a5-ace6-755ac80c734d tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:28:25 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-712875b6-982c-43a5-ace6-755ac80c734d tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json" returned: 0 in 0.172s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:28:25 user nova-compute[75226]: DEBUG nova.virt.disk.api [None req-712875b6-982c-43a5-ace6-755ac80c734d tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ee2187c9-8620-4fd2-ad8a-a054cd8393f3/disk. size=21474836480 {{(pid=75226) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 17 01:28:25 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-712875b6-982c-43a5-ace6-755ac80c734d tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee2187c9-8620-4fd2-ad8a-a054cd8393f3/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:28:25 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-712875b6-982c-43a5-ace6-755ac80c734d tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee2187c9-8620-4fd2-ad8a-a054cd8393f3/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:28:25 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-712875b6-982c-43a5-ace6-755ac80c734d tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/ee2187c9-8620-4fd2-ad8a-a054cd8393f3/disk 21474836480 {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:28:26 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-712875b6-982c-43a5-ace6-755ac80c734d tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/ee2187c9-8620-4fd2-ad8a-a054cd8393f3/disk 21474836480" returned: 0 in 0.246s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:28:26 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-712875b6-982c-43a5-ace6-755ac80c734d tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] [instance: ee2187c9-8620-4fd2-ad8a-a054cd8393f3] Did not create local disks {{(pid=75226) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 17 01:28:26 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-712875b6-982c-43a5-ace6-755ac80c734d tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] [instance: ee2187c9-8620-4fd2-ad8a-a054cd8393f3] Ensure instance console log exists: /opt/stack/data/nova/instances/ee2187c9-8620-4fd2-ad8a-a054cd8393f3/console.log {{(pid=75226) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 17 01:28:26 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-712875b6-982c-43a5-ace6-755ac80c734d tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:28:26 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-712875b6-982c-43a5-ace6-755ac80c734d tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:28:26 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-712875b6-982c-43a5-ace6-755ac80c734d tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:28:26 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-712875b6-982c-43a5-ace6-755ac80c734d tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] [instance: ee2187c9-8620-4fd2-ad8a-a054cd8393f3] Start _get_guest_xml network_info=[{"id": "1057ea4c-2ac4-40fa-8b2e-3b5888ea4d61", "address": "fa:16:3e:4a:f5:8f", "network": {"id": "3d8c3322-c78d-4d3a-b8c7-ba12241b4c65", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1996535656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1996535656-network", "vif_mac": "fa:16:3e:4a:f5:8f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c19f767dc7bb4024b3cbf1d8f5f8f2bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1057ea4c-2a", "ovs_interfaceid": "1057ea4c-2ac4-40fa-8b2e-3b5888ea4d61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T01:13:22Z,direct_url=<?>,disk_format='qcow2',id=0b369aea-6f3f-4690-9f01-229b90ab6310,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4e110cbf9a84362a6864a7732c435a1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T01:13:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '0b369aea-6f3f-4690-9f01-229b90ab6310'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'boot_index': None, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qFQXscng', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'ee2187c9-8620-4fd2-ad8a-a054cd8393f3', 'attached_at': '2023-11-17T01:28:25.000000', 'detached_at': '', 'volume_id': '1bdffe6a-77b2-4ed9-9d93-5e432bde62ba', 'serial': '1bdffe6a-77b2-4ed9-9d93-5e432bde62ba'}, 'attachment_id': '5ac1086f-882c-4307-8b6e-190c1fa5e522', 'device_type': 'disk', 'volume_type': None} {{(pid=75226) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 17 01:28:26 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-712875b6-982c-43a5-ace6-755ac80c734d tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:28:26 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-712875b6-982c-43a5-ace6-755ac80c734d tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:28:26 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-712875b6-982c-43a5-ace6-755ac80c734d tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75226) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 17 01:28:26 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-712875b6-982c-43a5-ace6-755ac80c734d tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] CPU controller missing on host. {{(pid=75226) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 17 01:28:26 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-712875b6-982c-43a5-ace6-755ac80c734d tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75226) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 17 01:28:26 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-712875b6-982c-43a5-ace6-755ac80c734d tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] CPU controller found on host. {{(pid=75226) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 17 01:28:26 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-712875b6-982c-43a5-ace6-755ac80c734d tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75226) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 17 01:28:26 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-712875b6-982c-43a5-ace6-755ac80c734d tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-17T01:13:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T01:13:22Z,direct_url=<?>,disk_format='qcow2',id=0b369aea-6f3f-4690-9f01-229b90ab6310,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4e110cbf9a84362a6864a7732c435a1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T01:13:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 17 01:28:26 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-712875b6-982c-43a5-ace6-755ac80c734d tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Flavor limits 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 17 01:28:26 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-712875b6-982c-43a5-ace6-755ac80c734d tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Image limits 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 17 01:28:26 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-712875b6-982c-43a5-ace6-755ac80c734d tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Flavor pref 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 17 01:28:26 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-712875b6-982c-43a5-ace6-755ac80c734d tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Image pref 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 17 01:28:26 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-712875b6-982c-43a5-ace6-755ac80c734d tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 17 01:28:26 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-712875b6-982c-43a5-ace6-755ac80c734d tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 17 01:28:26 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-712875b6-982c-43a5-ace6-755ac80c734d tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75226) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 17 01:28:26 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-712875b6-982c-43a5-ace6-755ac80c734d tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Got 1 possible topologies {{(pid=75226) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 17 01:28:26 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-712875b6-982c-43a5-ace6-755ac80c734d tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 17 01:28:26 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-712875b6-982c-43a5-ace6-755ac80c734d tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 17 01:28:26 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-712875b6-982c-43a5-ace6-755ac80c734d tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] [instance: ee2187c9-8620-4fd2-ad8a-a054cd8393f3] Calling os-brick to attach iSCSI Volume {{(pid=75226) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 17 01:28:26 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-712875b6-982c-43a5-ace6-755ac80c734d tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc4cc36b490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qFQXscng', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:28:26 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-712875b6-982c-43a5-ace6-755ac80c734d tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:28:26 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-712875b6-982c-43a5-ace6-755ac80c734d tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:28:26 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-712875b6-982c-43a5-ace6-755ac80c734d tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:28:26 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-712875b6-982c-43a5-ace6-755ac80c734d tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:28:26 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-712875b6-982c-43a5-ace6-755ac80c734d tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:28:26 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-712875b6-982c-43a5-ace6-755ac80c734d tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:28:26 user nova-compute[75226]: INFO os_brick.initiator.connectors.iscsi [None req-712875b6-982c-43a5-ace6-755ac80c734d tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 17 01:28:26 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba -p 172.16.0.220:3260 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:28:26 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:28:26 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cb36751-1c71-4261-b07e-e77a8e835299]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:28:26 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-712875b6-982c-43a5-ace6-755ac80c734d tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 17 01:28:26 user nova-compute[75226]:  {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:28:26 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba -p 172.16.0.220:3260 --interface default --op new {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:28:26 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:28:26 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[05f9f514-c900-4aae-806e-f47df340092c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba] added\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:28:26 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-712875b6-982c-43a5-ace6-755ac80c734d tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba] added
Nov 17 01:28:26 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:28:26 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:28:26 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:28:26 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[a02eea14-987d-4a27-85dd-3fc02c45be9e]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:28:26 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-712875b6-982c-43a5-ace6-755ac80c734d tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:28:26 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:28:26 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:28:26 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[a59df751-a907-4ebc-aa46-35d4c512c547]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:28:26 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-712875b6-982c-43a5-ace6-755ac80c734d tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:28:26 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qFQXscng {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:28:26 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qFQXscng" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:28:26 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[31e119c2-1e5e-47e7-9b35-ecb2429cc706]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:28:26 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-712875b6-982c-43a5-ace6-755ac80c734d tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qFQXscng'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:28:26 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:28:26 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:28:26 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3d006f4-7ba7-47a2-9b3b-7a1ad746c970]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:28:26 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-712875b6-982c-43a5-ace6-755ac80c734d tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:28:26 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:28:26 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:28:26 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c04c5fe-3456-41b4-b631-3fd7c0740ad8]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c17ed19c-4452-4a79-b36a-07ddcd7d9404 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:28:26 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-712875b6-982c-43a5-ace6-755ac80c734d tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)
Nov 17 01:28:26 user nova-compute[75226]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14 (non-flash)
Nov 17 01:28:26 user nova-compute[75226]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c17ed19c-4452-4a79-b36a-07ddcd7d9404 (non-flash)
Nov 17 01:28:26 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:28:26 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-712875b6-982c-43a5-ace6-755ac80c734d tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)
Nov 17 01:28:26 user nova-compute[75226]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14 (non-flash)
Nov 17 01:28:26 user nova-compute[75226]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c17ed19c-4452-4a79-b36a-07ddcd7d9404 (non-flash)
Nov 17 01:28:26 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:28:26 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba -p 172.16.0.220:3260 --login {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:28:26 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:28:26 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4534a05-7138-4a6c-8ea5-e6f57ac7876e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:28:26 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-712875b6-982c-43a5-ace6-755ac80c734d tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba, portal: 172.16.0.220,3260]
Nov 17 01:28:26 user nova-compute[75226]: Login to [iface: default, target: iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba, portal: 172.16.0.220,3260] successful.
Nov 17 01:28:26 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:28:26 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:28:26 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:28:26 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c918f3c-12fd-4846-a465-21c888a3e3ec]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:28:26 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-712875b6-982c-43a5-ace6-755ac80c734d tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:28:26 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:28:26 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:28:26 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcfb012b-31ce-4c46-8c59-9e238353ed9d]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c17ed19c-4452-4a79-b36a-07ddcd7d9404 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:28:26 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-712875b6-982c-43a5-ace6-755ac80c734d tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)
Nov 17 01:28:26 user nova-compute[75226]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14 (non-flash)
Nov 17 01:28:26 user nova-compute[75226]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c17ed19c-4452-4a79-b36a-07ddcd7d9404 (non-flash)
Nov 17 01:28:26 user nova-compute[75226]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba (non-flash)
Nov 17 01:28:26 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:28:26 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-712875b6-982c-43a5-ace6-755ac80c734d tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)
Nov 17 01:28:26 user nova-compute[75226]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14 (non-flash)
Nov 17 01:28:26 user nova-compute[75226]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c17ed19c-4452-4a79-b36a-07ddcd7d9404 (non-flash)
Nov 17 01:28:26 user nova-compute[75226]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba (non-flash)
Nov 17 01:28:26 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:28:26 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-712875b6-982c-43a5-ace6-755ac80c734d tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.271s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:28:26 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-712875b6-982c-43a5-ace6-755ac80c734d tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Connected to 172.16.0.220:3260 {{(pid=75226) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 17 01:28:26 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-712875b6-982c-43a5-ace6-755ac80c734d tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] HCTL ('33', '-', '-', 0) found on session 31 with lun 0 {{(pid=75226) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 17 01:28:26 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-712875b6-982c-43a5-ace6-755ac80c734d tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75226) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 17 01:28:26 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:28:26 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:28:26 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2091fbe-86fd-4765-927f-731616fe4f0f]: (4, ('- - 0', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:28:26 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-712875b6-982c-43a5-ace6-755ac80c734d tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Searching for a device in session 31 and hctl ['33', '*', '*', 0] yield: None {{(pid=75226) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 01:28:26 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:28:27 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-712875b6-982c-43a5-ace6-755ac80c734d tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Searching for a device in session 31 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75226) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 01:28:27 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-712875b6-982c-43a5-ace6-755ac80c734d tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qFQXscng', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75226) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 17 01:28:27 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-712875b6-982c-43a5-ace6-755ac80c734d tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.300s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:28:27 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-712875b6-982c-43a5-ace6-755ac80c734d tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] <== connect_volume: return (1301ms) {'type': 'block', 'scsi_wwn': '26365326232616566', 'path': '/dev/sdb'} {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:28:27 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-712875b6-982c-43a5-ace6-755ac80c734d tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] [instance: ee2187c9-8620-4fd2-ad8a-a054cd8393f3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26365326232616566', 'path': '/dev/sdb'} {{(pid=75226) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 17 01:28:27 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-712875b6-982c-43a5-ace6-755ac80c734d tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:24:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1878692867',display_name='tempest-ServerActionsTestOtherB-server-1878692867',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1878692867',id=21,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBTPdFaRxKgPkRdKbUEvHAZcoj+dPC43zryXBmo0q5ihjaLD04DW9eJSP+KLH1T/XkmERKqJKOvG49EB5qtvQ6Fib4lL66B3axWTUVDvaaC20Rh3bH2XA1pGQ2EKVxiHfg==',key_name='tempest-keypair-1901957685',keypairs=<?>,launch_index=0,launched_at=2023-11-17T01:24:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c19f767dc7bb4024b3cbf1d8f5f8f2bf',ramdisk_id='',reservation_id='r-p9pzzoi2',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-229085712',owner_user_name='tempest-ServerActionsTestOtherB-229085712-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T01:28:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f0952a7e2dd64bf2adb2e224965377ab',uuid=ee2187c9-8620-4fd2-ad8a-a054cd8393f3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1057ea4c-2ac4-40fa-8b2e-3b5888ea4d61", "address": "fa:16:3e:4a:f5:8f", "network": {"id": "3d8c3322-c78d-4d3a-b8c7-ba12241b4c65", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1996535656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1996535656-network", "vif_mac": "fa:16:3e:4a:f5:8f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c19f767dc7bb4024b3cbf1d8f5f8f2bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1057ea4c-2a", "ovs_interfaceid": "1057ea4c-2ac4-40fa-8b2e-3b5888ea4d61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75226) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 01:28:27 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-712875b6-982c-43a5-ace6-755ac80c734d tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Converting VIF {"id": "1057ea4c-2ac4-40fa-8b2e-3b5888ea4d61", "address": "fa:16:3e:4a:f5:8f", "network": {"id": "3d8c3322-c78d-4d3a-b8c7-ba12241b4c65", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1996535656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1996535656-network", "vif_mac": "fa:16:3e:4a:f5:8f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c19f767dc7bb4024b3cbf1d8f5f8f2bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1057ea4c-2a", "ovs_interfaceid": "1057ea4c-2ac4-40fa-8b2e-3b5888ea4d61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:28:27 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-712875b6-982c-43a5-ace6-755ac80c734d tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:f5:8f,bridge_name='br-int',has_traffic_filtering=True,id=1057ea4c-2ac4-40fa-8b2e-3b5888ea4d61,network=Network(3d8c3322-c78d-4d3a-b8c7-ba12241b4c65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1057ea4c-2a') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:28:27 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-712875b6-982c-43a5-ace6-755ac80c734d tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] [instance: ee2187c9-8620-4fd2-ad8a-a054cd8393f3] End _get_guest_xml xml=<domain type="kvm">
Nov 17 01:28:27 user nova-compute[75226]:   <uuid>ee2187c9-8620-4fd2-ad8a-a054cd8393f3</uuid>
Nov 17 01:28:27 user nova-compute[75226]:   <name>instance-00000015</name>
Nov 17 01:28:27 user nova-compute[75226]:   <memory>2097152</memory>
Nov 17 01:28:27 user nova-compute[75226]:   <vcpu>1</vcpu>
Nov 17 01:28:27 user nova-compute[75226]:   <metadata>
Nov 17 01:28:27 user nova-compute[75226]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 17 01:28:27 user nova-compute[75226]:       <nova:package version="0.0.0"/>
Nov 17 01:28:27 user nova-compute[75226]:       <nova:name>tempest-ServerActionsTestOtherB-server-1878692867</nova:name>
Nov 17 01:28:27 user nova-compute[75226]:       <nova:creationTime>2023-11-17 01:28:26</nova:creationTime>
Nov 17 01:28:27 user nova-compute[75226]:       <nova:flavor name="m1.small">
Nov 17 01:28:27 user nova-compute[75226]:         <nova:memory>2048</nova:memory>
Nov 17 01:28:27 user nova-compute[75226]:         <nova:disk>20</nova:disk>
Nov 17 01:28:27 user nova-compute[75226]:         <nova:swap>0</nova:swap>
Nov 17 01:28:27 user nova-compute[75226]:         <nova:ephemeral>0</nova:ephemeral>
Nov 17 01:28:27 user nova-compute[75226]:         <nova:vcpus>1</nova:vcpus>
Nov 17 01:28:27 user nova-compute[75226]:       </nova:flavor>
Nov 17 01:28:27 user nova-compute[75226]:       <nova:owner>
Nov 17 01:28:27 user nova-compute[75226]:         <nova:user uuid="f0952a7e2dd64bf2adb2e224965377ab">tempest-ServerActionsTestOtherB-229085712-project-member</nova:user>
Nov 17 01:28:27 user nova-compute[75226]:         <nova:project uuid="c19f767dc7bb4024b3cbf1d8f5f8f2bf">tempest-ServerActionsTestOtherB-229085712</nova:project>
Nov 17 01:28:27 user nova-compute[75226]:       </nova:owner>
Nov 17 01:28:27 user nova-compute[75226]:       <nova:root type="image" uuid="0b369aea-6f3f-4690-9f01-229b90ab6310"/>
Nov 17 01:28:27 user nova-compute[75226]:       <nova:ports>
Nov 17 01:28:27 user nova-compute[75226]:         <nova:port uuid="1057ea4c-2ac4-40fa-8b2e-3b5888ea4d61">
Nov 17 01:28:27 user nova-compute[75226]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 17 01:28:27 user nova-compute[75226]:         </nova:port>
Nov 17 01:28:27 user nova-compute[75226]:       </nova:ports>
Nov 17 01:28:27 user nova-compute[75226]:     </nova:instance>
Nov 17 01:28:27 user nova-compute[75226]:   </metadata>
Nov 17 01:28:27 user nova-compute[75226]:   <sysinfo type="smbios">
Nov 17 01:28:27 user nova-compute[75226]:     <system>
Nov 17 01:28:27 user nova-compute[75226]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 17 01:28:27 user nova-compute[75226]:       <entry name="product">OpenStack Nova</entry>
Nov 17 01:28:27 user nova-compute[75226]:       <entry name="version">0.0.0</entry>
Nov 17 01:28:27 user nova-compute[75226]:       <entry name="serial">ee2187c9-8620-4fd2-ad8a-a054cd8393f3</entry>
Nov 17 01:28:27 user nova-compute[75226]:       <entry name="uuid">ee2187c9-8620-4fd2-ad8a-a054cd8393f3</entry>
Nov 17 01:28:27 user nova-compute[75226]:       <entry name="family">Virtual Machine</entry>
Nov 17 01:28:27 user nova-compute[75226]:     </system>
Nov 17 01:28:27 user nova-compute[75226]:   </sysinfo>
Nov 17 01:28:27 user nova-compute[75226]:   <os>
Nov 17 01:28:27 user nova-compute[75226]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 17 01:28:27 user nova-compute[75226]:     <boot dev="hd"/>
Nov 17 01:28:27 user nova-compute[75226]:     <smbios mode="sysinfo"/>
Nov 17 01:28:27 user nova-compute[75226]:   </os>
Nov 17 01:28:27 user nova-compute[75226]:   <features>
Nov 17 01:28:27 user nova-compute[75226]:     <acpi/>
Nov 17 01:28:27 user nova-compute[75226]:     <apic/>
Nov 17 01:28:27 user nova-compute[75226]:     <vmcoreinfo/>
Nov 17 01:28:27 user nova-compute[75226]:   </features>
Nov 17 01:28:27 user nova-compute[75226]:   <clock offset="utc">
Nov 17 01:28:27 user nova-compute[75226]:     <timer name="pit" tickpolicy="delay"/>
Nov 17 01:28:27 user nova-compute[75226]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 17 01:28:27 user nova-compute[75226]:     <timer name="hpet" present="no"/>
Nov 17 01:28:27 user nova-compute[75226]:   </clock>
Nov 17 01:28:27 user nova-compute[75226]:   <cpu mode="custom" match="exact">
Nov 17 01:28:27 user nova-compute[75226]:     <model>Nehalem</model>
Nov 17 01:28:27 user nova-compute[75226]:     <topology sockets="1" cores="1" threads="1"/>
Nov 17 01:28:27 user nova-compute[75226]:   </cpu>
Nov 17 01:28:27 user nova-compute[75226]:   <devices>
Nov 17 01:28:27 user nova-compute[75226]:     <disk type="file" device="disk">
Nov 17 01:28:27 user nova-compute[75226]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 17 01:28:27 user nova-compute[75226]:       <source file="/opt/stack/data/nova/instances/ee2187c9-8620-4fd2-ad8a-a054cd8393f3/disk"/>
Nov 17 01:28:27 user nova-compute[75226]:       <target dev="vda" bus="virtio"/>
Nov 17 01:28:27 user nova-compute[75226]:     </disk>
Nov 17 01:28:27 user nova-compute[75226]:     <disk type="block" device="disk">
Nov 17 01:28:27 user nova-compute[75226]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 01:28:27 user nova-compute[75226]:       <source dev="/dev/sdb"/>
Nov 17 01:28:27 user nova-compute[75226]:       <target dev="vdb" bus="virtio"/>
Nov 17 01:28:27 user nova-compute[75226]:       <serial>1bdffe6a-77b2-4ed9-9d93-5e432bde62ba</serial>
Nov 17 01:28:27 user nova-compute[75226]:     </disk>
Nov 17 01:28:27 user nova-compute[75226]:     <interface type="ethernet">
Nov 17 01:28:27 user nova-compute[75226]:       <mac address="fa:16:3e:4a:f5:8f"/>
Nov 17 01:28:27 user nova-compute[75226]:       <model type="virtio"/>
Nov 17 01:28:27 user nova-compute[75226]:       <mtu size="1442"/>
Nov 17 01:28:27 user nova-compute[75226]:       <target dev="tap1057ea4c-2a"/>
Nov 17 01:28:27 user nova-compute[75226]:     </interface>
Nov 17 01:28:27 user nova-compute[75226]:     <serial type="pty">
Nov 17 01:28:27 user nova-compute[75226]:       <log file="/opt/stack/data/nova/instances/ee2187c9-8620-4fd2-ad8a-a054cd8393f3/console.log" append="off"/>
Nov 17 01:28:27 user nova-compute[75226]:     </serial>
Nov 17 01:28:27 user nova-compute[75226]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 17 01:28:27 user nova-compute[75226]:     <video>
Nov 17 01:28:27 user nova-compute[75226]:       <model type="virtio"/>
Nov 17 01:28:27 user nova-compute[75226]:     </video>
Nov 17 01:28:27 user nova-compute[75226]:     <rng model="virtio">
Nov 17 01:28:27 user nova-compute[75226]:       <backend model="random">/dev/urandom</backend>
Nov 17 01:28:27 user nova-compute[75226]:     </rng>
Nov 17 01:28:27 user nova-compute[75226]:     <controller type="usb" index="0" model="none"/>
Nov 17 01:28:27 user nova-compute[75226]:     <memballoon model="virtio">
Nov 17 01:28:27 user nova-compute[75226]:       <stats period="10"/>
Nov 17 01:28:27 user nova-compute[75226]:     </memballoon>
Nov 17 01:28:27 user nova-compute[75226]:   </devices>
Nov 17 01:28:27 user nova-compute[75226]: </domain>
Nov 17 01:28:27 user nova-compute[75226]:  {{(pid=75226) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 17 01:28:27 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-712875b6-982c-43a5-ace6-755ac80c734d tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:24:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1878692867',display_name='tempest-ServerActionsTestOtherB-server-1878692867',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1878692867',id=21,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBTPdFaRxKgPkRdKbUEvHAZcoj+dPC43zryXBmo0q5ihjaLD04DW9eJSP+KLH1T/XkmERKqJKOvG49EB5qtvQ6Fib4lL66B3axWTUVDvaaC20Rh3bH2XA1pGQ2EKVxiHfg==',key_name='tempest-keypair-1901957685',keypairs=<?>,launch_index=0,launched_at=2023-11-17T01:24:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c19f767dc7bb4024b3cbf1d8f5f8f2bf',ramdisk_id='',reservation_id='r-p9pzzoi2',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-229085712',owner_user_name='tempest-ServerActionsTestOtherB-229085712-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T01:28:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f0952a7e2dd64bf2adb2e224965377ab',uuid=ee2187c9-8620-4fd2-ad8a-a054cd8393f3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1057ea4c-2ac4-40fa-8b2e-3b5888ea4d61", "address": "fa:16:3e:4a:f5:8f", "network": {"id": "3d8c3322-c78d-4d3a-b8c7-ba12241b4c65", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1996535656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1996535656-network", "vif_mac": "fa:16:3e:4a:f5:8f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c19f767dc7bb4024b3cbf1d8f5f8f2bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1057ea4c-2a", "ovs_interfaceid": "1057ea4c-2ac4-40fa-8b2e-3b5888ea4d61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 17 01:28:27 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-712875b6-982c-43a5-ace6-755ac80c734d tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Converting VIF {"id": "1057ea4c-2ac4-40fa-8b2e-3b5888ea4d61", "address": "fa:16:3e:4a:f5:8f", "network": {"id": "3d8c3322-c78d-4d3a-b8c7-ba12241b4c65", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1996535656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1996535656-network", "vif_mac": "fa:16:3e:4a:f5:8f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c19f767dc7bb4024b3cbf1d8f5f8f2bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1057ea4c-2a", "ovs_interfaceid": "1057ea4c-2ac4-40fa-8b2e-3b5888ea4d61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:28:27 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-712875b6-982c-43a5-ace6-755ac80c734d tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:f5:8f,bridge_name='br-int',has_traffic_filtering=True,id=1057ea4c-2ac4-40fa-8b2e-3b5888ea4d61,network=Network(3d8c3322-c78d-4d3a-b8c7-ba12241b4c65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1057ea4c-2a') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:28:27 user nova-compute[75226]: DEBUG os_vif [None req-712875b6-982c-43a5-ace6-755ac80c734d tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:f5:8f,bridge_name='br-int',has_traffic_filtering=True,id=1057ea4c-2ac4-40fa-8b2e-3b5888ea4d61,network=Network(3d8c3322-c78d-4d3a-b8c7-ba12241b4c65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1057ea4c-2a') {{(pid=75226) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 17 01:28:27 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:28:27 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:28:27 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 17 01:28:27 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:28:27 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '647fd443-d41e-56b9-9ef8-81aab2673ffb', '_type': 'linux-noop'}}, row=False) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:28:27 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:28:27 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:28:27 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:28:27 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1057ea4c-2a, may_exist=True, interface_attrs={}) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:28:27 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1057ea4c-2a, col_values=(('qos', UUID('bbe01608-43cf-479e-a251-5c56b55eb5cc')),), if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:28:27 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1057ea4c-2a, col_values=(('external_ids', {'iface-id': '1057ea4c-2ac4-40fa-8b2e-3b5888ea4d61', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4a:f5:8f', 'vm-uuid': 'ee2187c9-8620-4fd2-ad8a-a054cd8393f3'}),), if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:28:27 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:28:27 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:28:27 user nova-compute[75226]: INFO os_vif [None req-712875b6-982c-43a5-ace6-755ac80c734d tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:f5:8f,bridge_name='br-int',has_traffic_filtering=True,id=1057ea4c-2ac4-40fa-8b2e-3b5888ea4d61,network=Network(3d8c3322-c78d-4d3a-b8c7-ba12241b4c65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1057ea4c-2a')
Nov 17 01:28:27 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-712875b6-982c-43a5-ace6-755ac80c734d tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] No BDM found with device name vda, not building metadata. {{(pid=75226) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 01:28:27 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-712875b6-982c-43a5-ace6-755ac80c734d tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75226) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 01:28:27 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-712875b6-982c-43a5-ace6-755ac80c734d tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] No VIF found with MAC fa:16:3e:4a:f5:8f, not building metadata {{(pid=75226) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 01:28:27 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:28:29 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:28:29 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:28:29 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:28:29 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:28:29 user nova-compute[75226]: DEBUG nova.compute.manager [req-3f5c5547-4d6d-4ac9-9e6f-7908ed6be753 req-8bd6959e-cca5-4f8a-9cd8-2b3c2f873f83 service nova] [instance: ee2187c9-8620-4fd2-ad8a-a054cd8393f3] Received event network-vif-plugged-1057ea4c-2ac4-40fa-8b2e-3b5888ea4d61 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:28:29 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-3f5c5547-4d6d-4ac9-9e6f-7908ed6be753 req-8bd6959e-cca5-4f8a-9cd8-2b3c2f873f83 service nova] Acquiring lock "ee2187c9-8620-4fd2-ad8a-a054cd8393f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:28:29 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-3f5c5547-4d6d-4ac9-9e6f-7908ed6be753 req-8bd6959e-cca5-4f8a-9cd8-2b3c2f873f83 service nova] Lock "ee2187c9-8620-4fd2-ad8a-a054cd8393f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:28:29 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-3f5c5547-4d6d-4ac9-9e6f-7908ed6be753 req-8bd6959e-cca5-4f8a-9cd8-2b3c2f873f83 service nova] Lock "ee2187c9-8620-4fd2-ad8a-a054cd8393f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:28:29 user nova-compute[75226]: DEBUG nova.compute.manager [req-3f5c5547-4d6d-4ac9-9e6f-7908ed6be753 req-8bd6959e-cca5-4f8a-9cd8-2b3c2f873f83 service nova] [instance: ee2187c9-8620-4fd2-ad8a-a054cd8393f3] No waiting events found dispatching network-vif-plugged-1057ea4c-2ac4-40fa-8b2e-3b5888ea4d61 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:28:29 user nova-compute[75226]: WARNING nova.compute.manager [req-3f5c5547-4d6d-4ac9-9e6f-7908ed6be753 req-8bd6959e-cca5-4f8a-9cd8-2b3c2f873f83 service nova] [instance: ee2187c9-8620-4fd2-ad8a-a054cd8393f3] Received unexpected event network-vif-plugged-1057ea4c-2ac4-40fa-8b2e-3b5888ea4d61 for instance with vm_state active and task_state resize_finish.
Nov 17 01:28:29 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:28:29 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:28:29 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:28:29 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:28:29 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:28:29 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:28:31 user nova-compute[75226]: DEBUG nova.compute.manager [None req-712875b6-982c-43a5-ace6-755ac80c734d tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] [instance: ee2187c9-8620-4fd2-ad8a-a054cd8393f3] Instance event wait completed in 0 seconds for  {{(pid=75226) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 17 01:28:31 user nova-compute[75226]: INFO nova.virt.libvirt.driver [-] [instance: ee2187c9-8620-4fd2-ad8a-a054cd8393f3] Instance running successfully.
Nov 17 01:28:31 user nova-compute[75226]: DEBUG nova.virt.libvirt.guest [None req-712875b6-982c-43a5-ace6-755ac80c734d tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] [instance: ee2187c9-8620-4fd2-ad8a-a054cd8393f3] Failed to set time: agent not configured {{(pid=75226) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 17 01:28:31 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-712875b6-982c-43a5-ace6-755ac80c734d tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] [instance: ee2187c9-8620-4fd2-ad8a-a054cd8393f3] finish_migration finished successfully. {{(pid=75226) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 17 01:28:31 user nova-compute[75226]: DEBUG nova.compute.manager [req-4180908c-c681-4c96-8596-e14161423eb2 req-4338a9c4-a423-49b0-830a-b78bea873b97 service nova] [instance: ee2187c9-8620-4fd2-ad8a-a054cd8393f3] Received event network-vif-plugged-1057ea4c-2ac4-40fa-8b2e-3b5888ea4d61 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:28:31 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-4180908c-c681-4c96-8596-e14161423eb2 req-4338a9c4-a423-49b0-830a-b78bea873b97 service nova] Acquiring lock "ee2187c9-8620-4fd2-ad8a-a054cd8393f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:28:31 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-4180908c-c681-4c96-8596-e14161423eb2 req-4338a9c4-a423-49b0-830a-b78bea873b97 service nova] Lock "ee2187c9-8620-4fd2-ad8a-a054cd8393f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:28:31 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-4180908c-c681-4c96-8596-e14161423eb2 req-4338a9c4-a423-49b0-830a-b78bea873b97 service nova] Lock "ee2187c9-8620-4fd2-ad8a-a054cd8393f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:28:31 user nova-compute[75226]: DEBUG nova.compute.manager [req-4180908c-c681-4c96-8596-e14161423eb2 req-4338a9c4-a423-49b0-830a-b78bea873b97 service nova] [instance: ee2187c9-8620-4fd2-ad8a-a054cd8393f3] No waiting events found dispatching network-vif-plugged-1057ea4c-2ac4-40fa-8b2e-3b5888ea4d61 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:28:31 user nova-compute[75226]: WARNING nova.compute.manager [req-4180908c-c681-4c96-8596-e14161423eb2 req-4338a9c4-a423-49b0-830a-b78bea873b97 service nova] [instance: ee2187c9-8620-4fd2-ad8a-a054cd8393f3] Received unexpected event network-vif-plugged-1057ea4c-2ac4-40fa-8b2e-3b5888ea4d61 for instance with vm_state active and task_state resize_finish.
Nov 17 01:28:32 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:28:32 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:28:34 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-9266fc0b-ef81-476c-97eb-3b06e87f6eb9 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Acquiring lock "306054a8-4d0f-4913-b3b8-97aeeeec071c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:28:34 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-9266fc0b-ef81-476c-97eb-3b06e87f6eb9 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Lock "306054a8-4d0f-4913-b3b8-97aeeeec071c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:28:34 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-9266fc0b-ef81-476c-97eb-3b06e87f6eb9 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Acquiring lock "306054a8-4d0f-4913-b3b8-97aeeeec071c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:28:34 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-9266fc0b-ef81-476c-97eb-3b06e87f6eb9 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Lock "306054a8-4d0f-4913-b3b8-97aeeeec071c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:28:34 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-9266fc0b-ef81-476c-97eb-3b06e87f6eb9 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Lock "306054a8-4d0f-4913-b3b8-97aeeeec071c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:28:34 user nova-compute[75226]: INFO nova.compute.manager [None req-9266fc0b-ef81-476c-97eb-3b06e87f6eb9 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] [instance: 306054a8-4d0f-4913-b3b8-97aeeeec071c] Terminating instance
Nov 17 01:28:34 user nova-compute[75226]: DEBUG nova.compute.manager [None req-9266fc0b-ef81-476c-97eb-3b06e87f6eb9 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] [instance: 306054a8-4d0f-4913-b3b8-97aeeeec071c] Start destroying the instance on the hypervisor. {{(pid=75226) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 17 01:28:34 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:28:34 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:28:34 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:28:34 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:28:34 user nova-compute[75226]: DEBUG nova.compute.manager [req-d51643ca-efd5-4a0b-9eeb-9ba3cbd79fba req-30e8abe6-1793-49fe-b5c2-655eacf1253c service nova] [instance: 306054a8-4d0f-4913-b3b8-97aeeeec071c] Received event network-vif-unplugged-9c6d2999-f11a-4cab-828c-993cc52b996c {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:28:34 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-d51643ca-efd5-4a0b-9eeb-9ba3cbd79fba req-30e8abe6-1793-49fe-b5c2-655eacf1253c service nova] Acquiring lock "306054a8-4d0f-4913-b3b8-97aeeeec071c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:28:34 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-d51643ca-efd5-4a0b-9eeb-9ba3cbd79fba req-30e8abe6-1793-49fe-b5c2-655eacf1253c service nova] Lock "306054a8-4d0f-4913-b3b8-97aeeeec071c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:28:34 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-d51643ca-efd5-4a0b-9eeb-9ba3cbd79fba req-30e8abe6-1793-49fe-b5c2-655eacf1253c service nova] Lock "306054a8-4d0f-4913-b3b8-97aeeeec071c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:28:34 user nova-compute[75226]: DEBUG nova.compute.manager [req-d51643ca-efd5-4a0b-9eeb-9ba3cbd79fba req-30e8abe6-1793-49fe-b5c2-655eacf1253c service nova] [instance: 306054a8-4d0f-4913-b3b8-97aeeeec071c] No waiting events found dispatching network-vif-unplugged-9c6d2999-f11a-4cab-828c-993cc52b996c {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:28:34 user nova-compute[75226]: DEBUG nova.compute.manager [req-d51643ca-efd5-4a0b-9eeb-9ba3cbd79fba req-30e8abe6-1793-49fe-b5c2-655eacf1253c service nova] [instance: 306054a8-4d0f-4913-b3b8-97aeeeec071c] Received event network-vif-unplugged-9c6d2999-f11a-4cab-828c-993cc52b996c for instance with task_state deleting. {{(pid=75226) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 17 01:28:35 user nova-compute[75226]: INFO nova.virt.libvirt.driver [-] [instance: 306054a8-4d0f-4913-b3b8-97aeeeec071c] Instance destroyed successfully.
Nov 17 01:28:35 user nova-compute[75226]: DEBUG nova.objects.instance [None req-9266fc0b-ef81-476c-97eb-3b06e87f6eb9 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Lazy-loading 'resources' on Instance uuid 306054a8-4d0f-4913-b3b8-97aeeeec071c {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:28:35 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-9266fc0b-ef81-476c-97eb-3b06e87f6eb9 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-17T01:22:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-523828380',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-523828380',id=17,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB8VZbi6odui0QRmSeooLxUmEz2+PJYm2i8ad1QX8czd8x79RdCiZHgEEKU0giPyPELai241fCLcP/Lw9LIxZnLDBi+bjdOFgz9iAt9ifW0YqhW6c0loV0dXybeEkqmBVQ==',key_name='tempest-keypair-1641360166',keypairs=<?>,launch_index=0,launched_at=2023-11-17T01:26:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1fcdc65b510141e9b7c9a01401a97448',ramdisk_id='',reservation_id='r-7ael85gs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1321076871',owner_user_name='tempest-AttachVolumeShelveTestJSON-1321076871-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T01:26:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2adb9c6cd5c443a7993f6f9d09da6346',uuid=306054a8-4d0f-4913-b3b8-97aeeeec071c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9c6d2999-f11a-4cab-828c-993cc52b996c", "address": "fa:16:3e:71:4a:e0", "network": {"id": "72724945-89ae-47c2-ac58-ea393837ada6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-308563626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fcdc65b510141e9b7c9a01401a97448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c6d2999-f1", "ovs_interfaceid": "9c6d2999-f11a-4cab-828c-993cc52b996c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 17 01:28:35 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-9266fc0b-ef81-476c-97eb-3b06e87f6eb9 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Converting VIF {"id": "9c6d2999-f11a-4cab-828c-993cc52b996c", "address": "fa:16:3e:71:4a:e0", "network": {"id": "72724945-89ae-47c2-ac58-ea393837ada6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-308563626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fcdc65b510141e9b7c9a01401a97448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c6d2999-f1", "ovs_interfaceid": "9c6d2999-f11a-4cab-828c-993cc52b996c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:28:35 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-9266fc0b-ef81-476c-97eb-3b06e87f6eb9 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:71:4a:e0,bridge_name='br-int',has_traffic_filtering=True,id=9c6d2999-f11a-4cab-828c-993cc52b996c,network=Network(72724945-89ae-47c2-ac58-ea393837ada6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c6d2999-f1') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:28:35 user nova-compute[75226]: DEBUG os_vif [None req-9266fc0b-ef81-476c-97eb-3b06e87f6eb9 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:71:4a:e0,bridge_name='br-int',has_traffic_filtering=True,id=9c6d2999-f11a-4cab-828c-993cc52b996c,network=Network(72724945-89ae-47c2-ac58-ea393837ada6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c6d2999-f1') {{(pid=75226) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 17 01:28:35 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:28:35 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9c6d2999-f1, bridge=br-int, if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:28:35 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:28:35 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:28:35 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:28:35 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:28:35 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c4c08998-862b-420c-a9c9-e5de97bc91c1) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:28:35 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:28:35 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:28:35 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:28:35 user nova-compute[75226]: INFO os_vif [None req-9266fc0b-ef81-476c-97eb-3b06e87f6eb9 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:71:4a:e0,bridge_name='br-int',has_traffic_filtering=True,id=9c6d2999-f11a-4cab-828c-993cc52b996c,network=Network(72724945-89ae-47c2-ac58-ea393837ada6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c6d2999-f1')
Nov 17 01:28:35 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-9266fc0b-ef81-476c-97eb-3b06e87f6eb9 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] [instance: 306054a8-4d0f-4913-b3b8-97aeeeec071c] Deleting instance files /opt/stack/data/nova/instances/306054a8-4d0f-4913-b3b8-97aeeeec071c_del
Nov 17 01:28:35 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-9266fc0b-ef81-476c-97eb-3b06e87f6eb9 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] [instance: 306054a8-4d0f-4913-b3b8-97aeeeec071c] Deletion of /opt/stack/data/nova/instances/306054a8-4d0f-4913-b3b8-97aeeeec071c_del complete
Nov 17 01:28:35 user nova-compute[75226]: INFO nova.compute.manager [None req-9266fc0b-ef81-476c-97eb-3b06e87f6eb9 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] [instance: 306054a8-4d0f-4913-b3b8-97aeeeec071c] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 17 01:28:35 user nova-compute[75226]: DEBUG oslo.service.loopingcall [None req-9266fc0b-ef81-476c-97eb-3b06e87f6eb9 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75226) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 17 01:28:35 user nova-compute[75226]: DEBUG nova.compute.manager [-] [instance: 306054a8-4d0f-4913-b3b8-97aeeeec071c] Deallocating network for instance {{(pid=75226) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 17 01:28:35 user nova-compute[75226]: DEBUG nova.network.neutron [-] [instance: 306054a8-4d0f-4913-b3b8-97aeeeec071c] deallocate_for_instance() {{(pid=75226) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 17 01:28:36 user nova-compute[75226]: DEBUG nova.network.neutron [-] [instance: 306054a8-4d0f-4913-b3b8-97aeeeec071c] Updating instance_info_cache with network_info: [] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:28:36 user nova-compute[75226]: INFO nova.compute.manager [-] [instance: 306054a8-4d0f-4913-b3b8-97aeeeec071c] Took 1.31 seconds to deallocate network for instance.
Nov 17 01:28:36 user nova-compute[75226]: DEBUG nova.compute.manager [req-52f3cda8-d3b1-41b6-80e6-cc249d50a815 req-b8b40221-d202-42a1-a908-49b6de636697 service nova] [instance: 306054a8-4d0f-4913-b3b8-97aeeeec071c] Received event network-vif-deleted-9c6d2999-f11a-4cab-828c-993cc52b996c {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:28:36 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-9266fc0b-ef81-476c-97eb-3b06e87f6eb9 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:28:36 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-9266fc0b-ef81-476c-97eb-3b06e87f6eb9 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:28:36 user nova-compute[75226]: DEBUG nova.compute.manager [req-30142e2f-34cb-4533-bf46-96dba57fa3b9 req-eb813ade-9590-4afb-b57a-21360f0e3a61 service nova] [instance: 306054a8-4d0f-4913-b3b8-97aeeeec071c] Received event network-vif-plugged-9c6d2999-f11a-4cab-828c-993cc52b996c {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:28:36 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-30142e2f-34cb-4533-bf46-96dba57fa3b9 req-eb813ade-9590-4afb-b57a-21360f0e3a61 service nova] Acquiring lock "306054a8-4d0f-4913-b3b8-97aeeeec071c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:28:36 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-30142e2f-34cb-4533-bf46-96dba57fa3b9 req-eb813ade-9590-4afb-b57a-21360f0e3a61 service nova] Lock "306054a8-4d0f-4913-b3b8-97aeeeec071c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:28:36 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-30142e2f-34cb-4533-bf46-96dba57fa3b9 req-eb813ade-9590-4afb-b57a-21360f0e3a61 service nova] Lock "306054a8-4d0f-4913-b3b8-97aeeeec071c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:28:36 user nova-compute[75226]: DEBUG nova.compute.manager [req-30142e2f-34cb-4533-bf46-96dba57fa3b9 req-eb813ade-9590-4afb-b57a-21360f0e3a61 service nova] [instance: 306054a8-4d0f-4913-b3b8-97aeeeec071c] No waiting events found dispatching network-vif-plugged-9c6d2999-f11a-4cab-828c-993cc52b996c {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:28:36 user nova-compute[75226]: WARNING nova.compute.manager [req-30142e2f-34cb-4533-bf46-96dba57fa3b9 req-eb813ade-9590-4afb-b57a-21360f0e3a61 service nova] [instance: 306054a8-4d0f-4913-b3b8-97aeeeec071c] Received unexpected event network-vif-plugged-9c6d2999-f11a-4cab-828c-993cc52b996c for instance with vm_state deleted and task_state None.
Nov 17 01:28:37 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-9266fc0b-ef81-476c-97eb-3b06e87f6eb9 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:28:37 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-9266fc0b-ef81-476c-97eb-3b06e87f6eb9 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:28:37 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-9266fc0b-ef81-476c-97eb-3b06e87f6eb9 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.448s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:28:37 user nova-compute[75226]: INFO nova.scheduler.client.report [None req-9266fc0b-ef81-476c-97eb-3b06e87f6eb9 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Deleted allocations for instance 306054a8-4d0f-4913-b3b8-97aeeeec071c
Nov 17 01:28:37 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-9266fc0b-ef81-476c-97eb-3b06e87f6eb9 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Lock "306054a8-4d0f-4913-b3b8-97aeeeec071c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.828s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:28:40 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:28:45 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:28:47 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:28:50 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:28:52 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:28:55 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:28:57 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:29:00 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:29:01 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:29:02 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:29:03 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:29:03 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:29:03 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:29:03 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:29:03 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:29:03 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:29:03 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75226) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 17 01:29:04 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa84e575-bdad-45b9-80ce-86b1c2826fb0/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:29:04 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa84e575-bdad-45b9-80ce-86b1c2826fb0/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:29:04 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa84e575-bdad-45b9-80ce-86b1c2826fb0/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:29:04 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa84e575-bdad-45b9-80ce-86b1c2826fb0/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:29:04 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee2187c9-8620-4fd2-ad8a-a054cd8393f3/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:29:04 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee2187c9-8620-4fd2-ad8a-a054cd8393f3/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:29:04 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee2187c9-8620-4fd2-ad8a-a054cd8393f3/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:29:04 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee2187c9-8620-4fd2-ad8a-a054cd8393f3/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:29:04 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75226) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 01:29:04 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6555d72-6094-4ea9-b071-a3d3c8a300a9/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:29:05 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6555d72-6094-4ea9-b071-a3d3c8a300a9/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:29:05 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6555d72-6094-4ea9-b071-a3d3c8a300a9/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:29:05 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6555d72-6094-4ea9-b071-a3d3c8a300a9/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:29:05 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:29:05 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38062487-67ca-4962-974f-81456aebe97b/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:29:05 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38062487-67ca-4962-974f-81456aebe97b/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:29:05 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38062487-67ca-4962-974f-81456aebe97b/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:29:05 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38062487-67ca-4962-974f-81456aebe97b/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:29:05 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75226) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 01:29:05 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75226) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 01:29:05 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c280142-8901-4f83-bde4-baaa097e05b0/disk.rescue --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:29:05 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c280142-8901-4f83-bde4-baaa097e05b0/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:29:05 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c280142-8901-4f83-bde4-baaa097e05b0/disk.rescue --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:29:06 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c280142-8901-4f83-bde4-baaa097e05b0/disk.rescue --force-share --output=json" returned: 0 in 0.168s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:29:06 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c280142-8901-4f83-bde4-baaa097e05b0/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:29:06 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c280142-8901-4f83-bde4-baaa097e05b0/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:29:06 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c280142-8901-4f83-bde4-baaa097e05b0/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:29:06 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c280142-8901-4f83-bde4-baaa097e05b0/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:29:06 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4050d898-f2b8-46c2-86e3-702ceb41a701/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:29:06 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4050d898-f2b8-46c2-86e3-702ceb41a701/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:29:06 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4050d898-f2b8-46c2-86e3-702ceb41a701/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:29:06 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4050d898-f2b8-46c2-86e3-702ceb41a701/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:29:06 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bef5f981-8fcb-4433-87bf-f958f3f57424/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:29:06 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-2b1b6215-9cc8-484a-8584-ead8438ee310 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] Acquiring lock "fb140c60-d5e8-4849-8621-95e913becc45" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:29:06 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-2b1b6215-9cc8-484a-8584-ead8438ee310 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] Lock "fb140c60-d5e8-4849-8621-95e913becc45" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:29:06 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-2b1b6215-9cc8-484a-8584-ead8438ee310 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] Acquiring lock "fb140c60-d5e8-4849-8621-95e913becc45-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:29:06 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-2b1b6215-9cc8-484a-8584-ead8438ee310 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] Lock "fb140c60-d5e8-4849-8621-95e913becc45-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:29:06 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-2b1b6215-9cc8-484a-8584-ead8438ee310 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] Lock "fb140c60-d5e8-4849-8621-95e913becc45-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:29:06 user nova-compute[75226]: INFO nova.compute.manager [None req-2b1b6215-9cc8-484a-8584-ead8438ee310 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] [instance: fb140c60-d5e8-4849-8621-95e913becc45] Terminating instance
Nov 17 01:29:06 user nova-compute[75226]: DEBUG nova.compute.manager [None req-2b1b6215-9cc8-484a-8584-ead8438ee310 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] [instance: fb140c60-d5e8-4849-8621-95e913becc45] Start destroying the instance on the hypervisor. {{(pid=75226) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 17 01:29:06 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bef5f981-8fcb-4433-87bf-f958f3f57424/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:29:06 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bef5f981-8fcb-4433-87bf-f958f3f57424/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:29:07 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:29:07 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:29:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bef5f981-8fcb-4433-87bf-f958f3f57424/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:29:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:29:07 user nova-compute[75226]: DEBUG nova.compute.manager [req-99e03ee3-a080-43e9-9367-ecd431a41cb6 req-13d7febc-4afd-4a54-abee-d3b55baf132f service nova] [instance: fb140c60-d5e8-4849-8621-95e913becc45] Received event network-vif-unplugged-f0504d3e-b4f2-4f78-a50f-7f0736cf74fe {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:29:07 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-99e03ee3-a080-43e9-9367-ecd431a41cb6 req-13d7febc-4afd-4a54-abee-d3b55baf132f service nova] Acquiring lock "fb140c60-d5e8-4849-8621-95e913becc45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:29:07 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-99e03ee3-a080-43e9-9367-ecd431a41cb6 req-13d7febc-4afd-4a54-abee-d3b55baf132f service nova] Lock "fb140c60-d5e8-4849-8621-95e913becc45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:29:07 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-99e03ee3-a080-43e9-9367-ecd431a41cb6 req-13d7febc-4afd-4a54-abee-d3b55baf132f service nova] Lock "fb140c60-d5e8-4849-8621-95e913becc45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:29:07 user nova-compute[75226]: DEBUG nova.compute.manager [req-99e03ee3-a080-43e9-9367-ecd431a41cb6 req-13d7febc-4afd-4a54-abee-d3b55baf132f service nova] [instance: fb140c60-d5e8-4849-8621-95e913becc45] No waiting events found dispatching network-vif-unplugged-f0504d3e-b4f2-4f78-a50f-7f0736cf74fe {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:29:07 user nova-compute[75226]: DEBUG nova.compute.manager [req-99e03ee3-a080-43e9-9367-ecd431a41cb6 req-13d7febc-4afd-4a54-abee-d3b55baf132f service nova] [instance: fb140c60-d5e8-4849-8621-95e913becc45] Received event network-vif-unplugged-f0504d3e-b4f2-4f78-a50f-7f0736cf74fe for instance with task_state deleting. {{(pid=75226) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 17 01:29:07 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:29:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:29:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:29:07 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:29:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:29:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb140c60-d5e8-4849-8621-95e913becc45/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:29:07 user nova-compute[75226]: INFO nova.virt.libvirt.driver [-] [instance: fb140c60-d5e8-4849-8621-95e913becc45] Instance destroyed successfully.
Nov 17 01:29:07 user nova-compute[75226]: DEBUG nova.objects.instance [None req-2b1b6215-9cc8-484a-8584-ead8438ee310 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] Lazy-loading 'resources' on Instance uuid fb140c60-d5e8-4849-8621-95e913becc45 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:29:07 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-2b1b6215-9cc8-484a-8584-ead8438ee310 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:27:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-978991004',display_name='tempest-ServersNegativeTestJSON-server-978991004',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-978991004',id=27,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-17T01:27:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d69aa270fc5b4749a65ea70c7ef30958',ramdisk_id='',reservation_id='r-45jmyr4r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1569237592',owner_user_name='tempest-ServersNegativeTestJSON-1569237592-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T01:27:23Z,user_data=None,user_id='202fa7cd113b42f2b95bc2314255392e',uuid=fb140c60-d5e8-4849-8621-95e913becc45,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f0504d3e-b4f2-4f78-a50f-7f0736cf74fe", "address": "fa:16:3e:ed:bc:92", "network": {"id": "ded167af-70f6-45b1-beb4-2eca06a78205", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2145123005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d69aa270fc5b4749a65ea70c7ef30958", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0504d3e-b4", "ovs_interfaceid": "f0504d3e-b4f2-4f78-a50f-7f0736cf74fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 17 01:29:07 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-2b1b6215-9cc8-484a-8584-ead8438ee310 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] Converting VIF {"id": "f0504d3e-b4f2-4f78-a50f-7f0736cf74fe", "address": "fa:16:3e:ed:bc:92", "network": {"id": "ded167af-70f6-45b1-beb4-2eca06a78205", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2145123005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d69aa270fc5b4749a65ea70c7ef30958", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0504d3e-b4", "ovs_interfaceid": "f0504d3e-b4f2-4f78-a50f-7f0736cf74fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:29:07 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-2b1b6215-9cc8-484a-8584-ead8438ee310 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:bc:92,bridge_name='br-int',has_traffic_filtering=True,id=f0504d3e-b4f2-4f78-a50f-7f0736cf74fe,network=Network(ded167af-70f6-45b1-beb4-2eca06a78205),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0504d3e-b4') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:29:07 user nova-compute[75226]: DEBUG os_vif [None req-2b1b6215-9cc8-484a-8584-ead8438ee310 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:bc:92,bridge_name='br-int',has_traffic_filtering=True,id=f0504d3e-b4f2-4f78-a50f-7f0736cf74fe,network=Network(ded167af-70f6-45b1-beb4-2eca06a78205),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0504d3e-b4') {{(pid=75226) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 17 01:29:07 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:29:07 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf0504d3e-b4, bridge=br-int, if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:29:07 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:29:07 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:29:07 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:29:07 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:29:07 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=94141d45-db52-4a76-97e7-f80dc3ad8d15) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:29:07 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:29:07 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:29:07 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:29:07 user nova-compute[75226]: INFO os_vif [None req-2b1b6215-9cc8-484a-8584-ead8438ee310 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:bc:92,bridge_name='br-int',has_traffic_filtering=True,id=f0504d3e-b4f2-4f78-a50f-7f0736cf74fe,network=Network(ded167af-70f6-45b1-beb4-2eca06a78205),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0504d3e-b4')
Nov 17 01:29:07 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-2b1b6215-9cc8-484a-8584-ead8438ee310 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] [instance: fb140c60-d5e8-4849-8621-95e913becc45] Deleting instance files /opt/stack/data/nova/instances/fb140c60-d5e8-4849-8621-95e913becc45_del
Nov 17 01:29:07 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-2b1b6215-9cc8-484a-8584-ead8438ee310 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] [instance: fb140c60-d5e8-4849-8621-95e913becc45] Deletion of /opt/stack/data/nova/instances/fb140c60-d5e8-4849-8621-95e913becc45_del complete
Nov 17 01:29:07 user nova-compute[75226]: INFO nova.compute.manager [None req-2b1b6215-9cc8-484a-8584-ead8438ee310 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] [instance: fb140c60-d5e8-4849-8621-95e913becc45] Took 0.97 seconds to destroy the instance on the hypervisor.
Nov 17 01:29:07 user nova-compute[75226]: DEBUG oslo.service.loopingcall [None req-2b1b6215-9cc8-484a-8584-ead8438ee310 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75226) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 17 01:29:07 user nova-compute[75226]: DEBUG nova.compute.manager [-] [instance: fb140c60-d5e8-4849-8621-95e913becc45] Deallocating network for instance {{(pid=75226) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 17 01:29:07 user nova-compute[75226]: DEBUG nova.network.neutron [-] [instance: fb140c60-d5e8-4849-8621-95e913becc45] deallocate_for_instance() {{(pid=75226) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 17 01:29:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb140c60-d5e8-4849-8621-95e913becc45/disk --force-share --output=json" returned: 1 in 0.178s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:29:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb140c60-d5e8-4849-8621-95e913becc45/disk --force-share --output=json' failed. Not Retrying. {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 01:29:07 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Periodic task is updating the host stats, it is trying to get disk info for instance-0000001b, but the backing disk storage was removed by a concurrent operation such as resize. Error: No disk at /opt/stack/data/nova/instances/fb140c60-d5e8-4849-8621-95e913becc45/disk: nova.exception.DiskNotFound: No disk at /opt/stack/data/nova/instances/fb140c60-d5e8-4849-8621-95e913becc45/disk
Nov 17 01:29:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ea5a14b-c330-4a2b-926e-60e1b30f5981/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:29:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ea5a14b-c330-4a2b-926e-60e1b30f5981/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:29:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ea5a14b-c330-4a2b-926e-60e1b30f5981/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:29:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ea5a14b-c330-4a2b-926e-60e1b30f5981/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:29:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dcdd769-bbfe-48e8-a876-8b2072b7baeb/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:29:08 user nova-compute[75226]: DEBUG nova.network.neutron [-] [instance: fb140c60-d5e8-4849-8621-95e913becc45] Updating instance_info_cache with network_info: [] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:29:08 user nova-compute[75226]: DEBUG nova.compute.manager [req-c1a8c26c-6efb-47e7-992a-e4e844c1721f req-ac8d71b9-acaa-49df-abd6-38f823be8535 service nova] [instance: fb140c60-d5e8-4849-8621-95e913becc45] Received event network-vif-deleted-f0504d3e-b4f2-4f78-a50f-7f0736cf74fe {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:29:08 user nova-compute[75226]: INFO nova.compute.manager [req-c1a8c26c-6efb-47e7-992a-e4e844c1721f req-ac8d71b9-acaa-49df-abd6-38f823be8535 service nova] [instance: fb140c60-d5e8-4849-8621-95e913becc45] Neutron deleted interface f0504d3e-b4f2-4f78-a50f-7f0736cf74fe; detaching it from the instance and deleting it from the info cache
Nov 17 01:29:08 user nova-compute[75226]: DEBUG nova.network.neutron [req-c1a8c26c-6efb-47e7-992a-e4e844c1721f req-ac8d71b9-acaa-49df-abd6-38f823be8535 service nova] [instance: fb140c60-d5e8-4849-8621-95e913becc45] Updating instance_info_cache with network_info: [] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:29:08 user nova-compute[75226]: INFO nova.compute.manager [-] [instance: fb140c60-d5e8-4849-8621-95e913becc45] Took 0.48 seconds to deallocate network for instance.
Nov 17 01:29:08 user nova-compute[75226]: DEBUG nova.compute.manager [req-c1a8c26c-6efb-47e7-992a-e4e844c1721f req-ac8d71b9-acaa-49df-abd6-38f823be8535 service nova] [instance: fb140c60-d5e8-4849-8621-95e913becc45] Detach interface failed, port_id=f0504d3e-b4f2-4f78-a50f-7f0736cf74fe, reason: Instance fb140c60-d5e8-4849-8621-95e913becc45 could not be found. {{(pid=75226) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 17 01:29:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dcdd769-bbfe-48e8-a876-8b2072b7baeb/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:29:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dcdd769-bbfe-48e8-a876-8b2072b7baeb/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:29:08 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-2b1b6215-9cc8-484a-8584-ead8438ee310 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:29:08 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-2b1b6215-9cc8-484a-8584-ead8438ee310 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:29:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dcdd769-bbfe-48e8-a876-8b2072b7baeb/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:29:08 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75226) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 01:29:09 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:29:09 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:29:09 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Hypervisor/Node resource view: name=user free_ram=7316MB free_disk=24.899375915527344GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75226) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 17 01:29:09 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:29:09 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-2b1b6215-9cc8-484a-8584-ead8438ee310 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:29:09 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-2b1b6215-9cc8-484a-8584-ead8438ee310 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:29:09 user nova-compute[75226]: DEBUG nova.compute.manager [req-e29ed483-dc68-4a01-b67b-43b08c9410b3 req-b72197ae-56cb-4203-b9d2-7f436bd45320 service nova] [instance: fb140c60-d5e8-4849-8621-95e913becc45] Received event network-vif-plugged-f0504d3e-b4f2-4f78-a50f-7f0736cf74fe {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:29:09 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-e29ed483-dc68-4a01-b67b-43b08c9410b3 req-b72197ae-56cb-4203-b9d2-7f436bd45320 service nova] Acquiring lock "fb140c60-d5e8-4849-8621-95e913becc45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:29:09 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-e29ed483-dc68-4a01-b67b-43b08c9410b3 req-b72197ae-56cb-4203-b9d2-7f436bd45320 service nova] Lock "fb140c60-d5e8-4849-8621-95e913becc45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:29:09 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-e29ed483-dc68-4a01-b67b-43b08c9410b3 req-b72197ae-56cb-4203-b9d2-7f436bd45320 service nova] Lock "fb140c60-d5e8-4849-8621-95e913becc45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:29:09 user nova-compute[75226]: DEBUG nova.compute.manager [req-e29ed483-dc68-4a01-b67b-43b08c9410b3 req-b72197ae-56cb-4203-b9d2-7f436bd45320 service nova] [instance: fb140c60-d5e8-4849-8621-95e913becc45] No waiting events found dispatching network-vif-plugged-f0504d3e-b4f2-4f78-a50f-7f0736cf74fe {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:29:09 user nova-compute[75226]: WARNING nova.compute.manager [req-e29ed483-dc68-4a01-b67b-43b08c9410b3 req-b72197ae-56cb-4203-b9d2-7f436bd45320 service nova] [instance: fb140c60-d5e8-4849-8621-95e913becc45] Received unexpected event network-vif-plugged-f0504d3e-b4f2-4f78-a50f-7f0736cf74fe for instance with vm_state deleted and task_state None.
Nov 17 01:29:09 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-2b1b6215-9cc8-484a-8584-ead8438ee310 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.785s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:29:09 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.231s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:29:09 user nova-compute[75226]: INFO nova.scheduler.client.report [None req-2b1b6215-9cc8-484a-8584-ead8438ee310 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] Deleted allocations for instance fb140c60-d5e8-4849-8621-95e913becc45
Nov 17 01:29:09 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-2b1b6215-9cc8-484a-8584-ead8438ee310 tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] Lock "fb140c60-d5e8-4849-8621-95e913becc45" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.502s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:29:09 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Applying migration context for instance ee2187c9-8620-4fd2-ad8a-a054cd8393f3 as it has an incoming, in-progress migration 96afa0fa-c757-4cd5-beaa-0507610ab24f. Migration status is finished {{(pid=75226) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 17 01:29:09 user nova-compute[75226]: INFO nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] [instance: ee2187c9-8620-4fd2-ad8a-a054cd8393f3] Updating resource usage from migration 96afa0fa-c757-4cd5-beaa-0507610ab24f
Nov 17 01:29:09 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance aa84e575-bdad-45b9-80ce-86b1c2826fb0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:29:09 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 6b7e9611-be35-4e51-b886-91a2fac0a653 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:29:09 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:29:09 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 38062487-67ca-4962-974f-81456aebe97b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:29:09 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 4050d898-f2b8-46c2-86e3-702ceb41a701 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:29:09 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 4dcdd769-bbfe-48e8-a876-8b2072b7baeb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:29:09 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 2ea5a14b-c330-4a2b-926e-60e1b30f5981 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:29:09 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance d6555d72-6094-4ea9-b071-a3d3c8a300a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:29:09 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 5c280142-8901-4f83-bde4-baaa097e05b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:29:09 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 346967c5-6945-4cef-9eea-8415cb27c98f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:29:09 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance bef5f981-8fcb-4433-87bf-f958f3f57424 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:29:09 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Migration 96afa0fa-c757-4cd5-beaa-0507610ab24f is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 17 01:29:09 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance ee2187c9-8620-4fd2-ad8a-a054cd8393f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:29:09 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=75226) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 17 01:29:09 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Final resource view: name=user phys_ram=16011MB used_ram=8704MB phys_disk=40GB used_disk=30GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=75226) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 17 01:29:09 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:29:09 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:29:09 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Compute_service record updated for user:user {{(pid=75226) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 17 01:29:09 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.514s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:29:10 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:29:10 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:29:10 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:29:10 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:29:11 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:29:11 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Starting heal instance info cache {{(pid=75226) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 17 01:29:11 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Didn't find any instances for network info cache update. {{(pid=75226) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 17 01:29:12 user nova-compute[75226]: DEBUG nova.objects.instance [None req-f3fd6180-21cb-4f25-b6c4-92b793aa401b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Lazy-loading 'flavor' on Instance uuid f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:29:12 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-f3fd6180-21cb-4f25-b6c4-92b793aa401b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Acquiring lock "refresh_cache-f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:29:12 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-f3fd6180-21cb-4f25-b6c4-92b793aa401b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Acquired lock "refresh_cache-f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:29:12 user nova-compute[75226]: DEBUG nova.network.neutron [None req-f3fd6180-21cb-4f25-b6c4-92b793aa401b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] [instance: f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c] Building network info cache for instance {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 01:29:12 user nova-compute[75226]: DEBUG nova.objects.instance [None req-f3fd6180-21cb-4f25-b6c4-92b793aa401b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Lazy-loading 'info_cache' on Instance uuid f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:29:12 user nova-compute[75226]: DEBUG nova.objects.base [None req-f3fd6180-21cb-4f25-b6c4-92b793aa401b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Object Instance<f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c> lazy-loaded attributes: flavor,info_cache {{(pid=75226) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 17 01:29:12 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:29:12 user nova-compute[75226]: DEBUG nova.network.neutron [None req-f3fd6180-21cb-4f25-b6c4-92b793aa401b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] [instance: f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c] Updating instance_info_cache with network_info: [{"id": "ed40e788-7338-4ecd-8204-008d4601131b", "address": "fa:16:3e:69:68:ce", "network": {"id": "c93f11a7-52c6-4379-a1fb-9a002876c221", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-985502177-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "054575d3dc66452091173b4c604b8c96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped40e788-73", "ovs_interfaceid": "ed40e788-7338-4ecd-8204-008d4601131b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:29:12 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-f3fd6180-21cb-4f25-b6c4-92b793aa401b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Releasing lock "refresh_cache-f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:29:12 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:29:12 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75226) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 17 01:29:12 user nova-compute[75226]: INFO nova.virt.libvirt.driver [-] [instance: f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c] Instance destroyed successfully.
Nov 17 01:29:12 user nova-compute[75226]: DEBUG nova.objects.instance [None req-f3fd6180-21cb-4f25-b6c4-92b793aa401b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Lazy-loading 'resources' on Instance uuid f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:29:12 user nova-compute[75226]: DEBUG nova.objects.base [None req-f3fd6180-21cb-4f25-b6c4-92b793aa401b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Object Instance<f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c> lazy-loaded attributes: flavor,info_cache,resources {{(pid=75226) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 17 01:29:12 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-f3fd6180-21cb-4f25-b6c4-92b793aa401b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:21:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-980884499',display_name='tempest-AttachVolumeTestJSON-server-980884499',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-980884499',id=14,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEeERZjFkWxmLB8VU7feu2kYsY5hOpCoxndDBoQzV87owC8kzSgAjyPTw83uHfeVmkKFRyeTiQ9M6sBUaGKQxsiszNV9RLzq6OmxLI7Pi6/hF+7Z96DGb0RR92U15Os/9A==',key_name='tempest-keypair-1317105249',keypairs=<?>,launch_index=0,launched_at=2023-11-17T01:21:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='054575d3dc66452091173b4c604b8c96',ramdisk_id='',reservation_id='r-cjk2rxuv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-223132631',owner_user_name='tempest-AttachVolumeTestJSON-223132631-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T01:27:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c30381a66814427ba39e21c024136fee',uuid=f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "ed40e788-7338-4ecd-8204-008d4601131b", "address": "fa:16:3e:69:68:ce", "network": {"id": "c93f11a7-52c6-4379-a1fb-9a002876c221", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-985502177-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "054575d3dc66452091173b4c604b8c96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped40e788-73", "ovs_interfaceid": "ed40e788-7338-4ecd-8204-008d4601131b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 17 01:29:12 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-f3fd6180-21cb-4f25-b6c4-92b793aa401b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Converting VIF {"id": "ed40e788-7338-4ecd-8204-008d4601131b", "address": "fa:16:3e:69:68:ce", "network": {"id": "c93f11a7-52c6-4379-a1fb-9a002876c221", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-985502177-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "054575d3dc66452091173b4c604b8c96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped40e788-73", "ovs_interfaceid": "ed40e788-7338-4ecd-8204-008d4601131b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:29:12 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-f3fd6180-21cb-4f25-b6c4-92b793aa401b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:68:ce,bridge_name='br-int',has_traffic_filtering=True,id=ed40e788-7338-4ecd-8204-008d4601131b,network=Network(c93f11a7-52c6-4379-a1fb-9a002876c221),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped40e788-73') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:29:12 user nova-compute[75226]: DEBUG os_vif [None req-f3fd6180-21cb-4f25-b6c4-92b793aa401b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:68:ce,bridge_name='br-int',has_traffic_filtering=True,id=ed40e788-7338-4ecd-8204-008d4601131b,network=Network(c93f11a7-52c6-4379-a1fb-9a002876c221),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped40e788-73') {{(pid=75226) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 17 01:29:12 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:29:12 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=taped40e788-73, bridge=br-int, if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:29:12 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:29:12 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:29:12 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:29:13 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ef75a5d2-c72b-4f9a-91ee-8af4081732d5) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:29:13 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:29:13 user nova-compute[75226]: INFO os_vif [None req-f3fd6180-21cb-4f25-b6c4-92b793aa401b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:68:ce,bridge_name='br-int',has_traffic_filtering=True,id=ed40e788-7338-4ecd-8204-008d4601131b,network=Network(c93f11a7-52c6-4379-a1fb-9a002876c221),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped40e788-73')
Nov 17 01:29:13 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-f3fd6180-21cb-4f25-b6c4-92b793aa401b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] [instance: f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c] Start _get_guest_xml network_info=[{"id": "ed40e788-7338-4ecd-8204-008d4601131b", "address": "fa:16:3e:69:68:ce", "network": {"id": "c93f11a7-52c6-4379-a1fb-9a002876c221", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-985502177-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "054575d3dc66452091173b4c604b8c96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped40e788-73", "ovs_interfaceid": "ed40e788-7338-4ecd-8204-008d4601131b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=0b369aea-6f3f-4690-9f01-229b90ab6310,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '0b369aea-6f3f-4690-9f01-229b90ab6310'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75226) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 17 01:29:13 user nova-compute[75226]: DEBUG nova.objects.instance [None req-f3fd6180-21cb-4f25-b6c4-92b793aa401b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Lazy-loading 'numa_topology' on Instance uuid f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:29:13 user nova-compute[75226]: DEBUG nova.objects.base [None req-f3fd6180-21cb-4f25-b6c4-92b793aa401b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Object Instance<f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=75226) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 17 01:29:13 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-f3fd6180-21cb-4f25-b6c4-92b793aa401b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:29:13 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-f3fd6180-21cb-4f25-b6c4-92b793aa401b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:29:13 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-f3fd6180-21cb-4f25-b6c4-92b793aa401b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75226) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 17 01:29:13 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-f3fd6180-21cb-4f25-b6c4-92b793aa401b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] CPU controller missing on host. {{(pid=75226) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 17 01:29:13 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-f3fd6180-21cb-4f25-b6c4-92b793aa401b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75226) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 17 01:29:13 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-f3fd6180-21cb-4f25-b6c4-92b793aa401b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] CPU controller found on host. {{(pid=75226) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 17 01:29:13 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-f3fd6180-21cb-4f25-b6c4-92b793aa401b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75226) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 17 01:29:13 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-f3fd6180-21cb-4f25-b6c4-92b793aa401b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-17T01:13:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=0b369aea-6f3f-4690-9f01-229b90ab6310,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 17 01:29:13 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-f3fd6180-21cb-4f25-b6c4-92b793aa401b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Flavor limits 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 17 01:29:13 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-f3fd6180-21cb-4f25-b6c4-92b793aa401b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Image limits 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 17 01:29:13 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-f3fd6180-21cb-4f25-b6c4-92b793aa401b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Flavor pref 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 17 01:29:13 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-f3fd6180-21cb-4f25-b6c4-92b793aa401b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Image pref 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 17 01:29:13 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-f3fd6180-21cb-4f25-b6c4-92b793aa401b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 17 01:29:13 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-f3fd6180-21cb-4f25-b6c4-92b793aa401b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 17 01:29:13 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-f3fd6180-21cb-4f25-b6c4-92b793aa401b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75226) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 17 01:29:13 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-f3fd6180-21cb-4f25-b6c4-92b793aa401b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Got 1 possible topologies {{(pid=75226) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 17 01:29:13 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-f3fd6180-21cb-4f25-b6c4-92b793aa401b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 17 01:29:13 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-f3fd6180-21cb-4f25-b6c4-92b793aa401b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 17 01:29:13 user nova-compute[75226]: DEBUG nova.objects.instance [None req-f3fd6180-21cb-4f25-b6c4-92b793aa401b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Lazy-loading 'vcpu_model' on Instance uuid f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:29:13 user nova-compute[75226]: DEBUG nova.objects.base [None req-f3fd6180-21cb-4f25-b6c4-92b793aa401b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Object Instance<f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=75226) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 17 01:29:13 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-f3fd6180-21cb-4f25-b6c4-92b793aa401b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:21:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-980884499',display_name='tempest-AttachVolumeTestJSON-server-980884499',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-980884499',id=14,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEeERZjFkWxmLB8VU7feu2kYsY5hOpCoxndDBoQzV87owC8kzSgAjyPTw83uHfeVmkKFRyeTiQ9M6sBUaGKQxsiszNV9RLzq6OmxLI7Pi6/hF+7Z96DGb0RR92U15Os/9A==',key_name='tempest-keypair-1317105249',keypairs=<?>,launch_index=0,launched_at=2023-11-17T01:21:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='054575d3dc66452091173b4c604b8c96',ramdisk_id='',reservation_id='r-cjk2rxuv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-223132631',owner_user_name='tempest-AttachVolumeTestJSON-223132631-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T01:27:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c30381a66814427ba39e21c024136fee',uuid=f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "ed40e788-7338-4ecd-8204-008d4601131b", "address": "fa:16:3e:69:68:ce", "network": {"id": "c93f11a7-52c6-4379-a1fb-9a002876c221", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-985502177-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "054575d3dc66452091173b4c604b8c96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped40e788-73", "ovs_interfaceid": "ed40e788-7338-4ecd-8204-008d4601131b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75226) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 01:29:13 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-f3fd6180-21cb-4f25-b6c4-92b793aa401b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Converting VIF {"id": "ed40e788-7338-4ecd-8204-008d4601131b", "address": "fa:16:3e:69:68:ce", "network": {"id": "c93f11a7-52c6-4379-a1fb-9a002876c221", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-985502177-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "054575d3dc66452091173b4c604b8c96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped40e788-73", "ovs_interfaceid": "ed40e788-7338-4ecd-8204-008d4601131b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:29:13 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-f3fd6180-21cb-4f25-b6c4-92b793aa401b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:68:ce,bridge_name='br-int',has_traffic_filtering=True,id=ed40e788-7338-4ecd-8204-008d4601131b,network=Network(c93f11a7-52c6-4379-a1fb-9a002876c221),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped40e788-73') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:29:13 user nova-compute[75226]: DEBUG nova.objects.instance [None req-f3fd6180-21cb-4f25-b6c4-92b793aa401b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Lazy-loading 'pci_devices' on Instance uuid f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:29:13 user nova-compute[75226]: DEBUG nova.objects.base [None req-f3fd6180-21cb-4f25-b6c4-92b793aa401b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Object Instance<f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=75226) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 17 01:29:13 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-f3fd6180-21cb-4f25-b6c4-92b793aa401b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] [instance: f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c] End _get_guest_xml xml=<domain type="kvm">
Nov 17 01:29:13 user nova-compute[75226]:   <uuid>f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c</uuid>
Nov 17 01:29:13 user nova-compute[75226]:   <name>instance-0000000e</name>
Nov 17 01:29:13 user nova-compute[75226]:   <memory>524288</memory>
Nov 17 01:29:13 user nova-compute[75226]:   <vcpu>1</vcpu>
Nov 17 01:29:13 user nova-compute[75226]:   <metadata>
Nov 17 01:29:13 user nova-compute[75226]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 17 01:29:13 user nova-compute[75226]:       <nova:package version="0.0.0"/>
Nov 17 01:29:13 user nova-compute[75226]:       <nova:name>tempest-AttachVolumeTestJSON-server-980884499</nova:name>
Nov 17 01:29:13 user nova-compute[75226]:       <nova:creationTime>2023-11-17 01:29:13</nova:creationTime>
Nov 17 01:29:13 user nova-compute[75226]:       <nova:flavor name="m1.tiny">
Nov 17 01:29:13 user nova-compute[75226]:         <nova:memory>512</nova:memory>
Nov 17 01:29:13 user nova-compute[75226]:         <nova:disk>1</nova:disk>
Nov 17 01:29:13 user nova-compute[75226]:         <nova:swap>0</nova:swap>
Nov 17 01:29:13 user nova-compute[75226]:         <nova:ephemeral>0</nova:ephemeral>
Nov 17 01:29:13 user nova-compute[75226]:         <nova:vcpus>1</nova:vcpus>
Nov 17 01:29:13 user nova-compute[75226]:       </nova:flavor>
Nov 17 01:29:13 user nova-compute[75226]:       <nova:owner>
Nov 17 01:29:13 user nova-compute[75226]:         <nova:user uuid="c30381a66814427ba39e21c024136fee">tempest-AttachVolumeTestJSON-223132631-project-member</nova:user>
Nov 17 01:29:13 user nova-compute[75226]:         <nova:project uuid="054575d3dc66452091173b4c604b8c96">tempest-AttachVolumeTestJSON-223132631</nova:project>
Nov 17 01:29:13 user nova-compute[75226]:       </nova:owner>
Nov 17 01:29:13 user nova-compute[75226]:       <nova:root type="image" uuid="0b369aea-6f3f-4690-9f01-229b90ab6310"/>
Nov 17 01:29:13 user nova-compute[75226]:       <nova:ports>
Nov 17 01:29:13 user nova-compute[75226]:         <nova:port uuid="ed40e788-7338-4ecd-8204-008d4601131b">
Nov 17 01:29:13 user nova-compute[75226]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 17 01:29:13 user nova-compute[75226]:         </nova:port>
Nov 17 01:29:13 user nova-compute[75226]:       </nova:ports>
Nov 17 01:29:13 user nova-compute[75226]:     </nova:instance>
Nov 17 01:29:13 user nova-compute[75226]:   </metadata>
Nov 17 01:29:13 user nova-compute[75226]:   <sysinfo type="smbios">
Nov 17 01:29:13 user nova-compute[75226]:     <system>
Nov 17 01:29:13 user nova-compute[75226]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 17 01:29:13 user nova-compute[75226]:       <entry name="product">OpenStack Nova</entry>
Nov 17 01:29:13 user nova-compute[75226]:       <entry name="version">0.0.0</entry>
Nov 17 01:29:13 user nova-compute[75226]:       <entry name="serial">f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c</entry>
Nov 17 01:29:13 user nova-compute[75226]:       <entry name="uuid">f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c</entry>
Nov 17 01:29:13 user nova-compute[75226]:       <entry name="family">Virtual Machine</entry>
Nov 17 01:29:13 user nova-compute[75226]:     </system>
Nov 17 01:29:13 user nova-compute[75226]:   </sysinfo>
Nov 17 01:29:13 user nova-compute[75226]:   <os>
Nov 17 01:29:13 user nova-compute[75226]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 17 01:29:13 user nova-compute[75226]:     <boot dev="hd"/>
Nov 17 01:29:13 user nova-compute[75226]:     <smbios mode="sysinfo"/>
Nov 17 01:29:13 user nova-compute[75226]:   </os>
Nov 17 01:29:13 user nova-compute[75226]:   <features>
Nov 17 01:29:13 user nova-compute[75226]:     <acpi/>
Nov 17 01:29:13 user nova-compute[75226]:     <apic/>
Nov 17 01:29:13 user nova-compute[75226]:     <vmcoreinfo/>
Nov 17 01:29:13 user nova-compute[75226]:   </features>
Nov 17 01:29:13 user nova-compute[75226]:   <clock offset="utc">
Nov 17 01:29:13 user nova-compute[75226]:     <timer name="pit" tickpolicy="delay"/>
Nov 17 01:29:13 user nova-compute[75226]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 17 01:29:13 user nova-compute[75226]:     <timer name="hpet" present="no"/>
Nov 17 01:29:13 user nova-compute[75226]:   </clock>
Nov 17 01:29:13 user nova-compute[75226]:   <cpu mode="custom" match="exact">
Nov 17 01:29:13 user nova-compute[75226]:     <model>Nehalem</model>
Nov 17 01:29:13 user nova-compute[75226]:     <topology sockets="1" cores="1" threads="1"/>
Nov 17 01:29:13 user nova-compute[75226]:   </cpu>
Nov 17 01:29:13 user nova-compute[75226]:   <devices>
Nov 17 01:29:13 user nova-compute[75226]:     <disk type="file" device="disk">
Nov 17 01:29:13 user nova-compute[75226]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 17 01:29:13 user nova-compute[75226]:       <source file="/opt/stack/data/nova/instances/f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c/disk"/>
Nov 17 01:29:13 user nova-compute[75226]:       <target dev="vda" bus="virtio"/>
Nov 17 01:29:13 user nova-compute[75226]:     </disk>
Nov 17 01:29:13 user nova-compute[75226]:     <interface type="ethernet">
Nov 17 01:29:13 user nova-compute[75226]:       <mac address="fa:16:3e:69:68:ce"/>
Nov 17 01:29:13 user nova-compute[75226]:       <model type="virtio"/>
Nov 17 01:29:13 user nova-compute[75226]:       <mtu size="1442"/>
Nov 17 01:29:13 user nova-compute[75226]:       <target dev="taped40e788-73"/>
Nov 17 01:29:13 user nova-compute[75226]:     </interface>
Nov 17 01:29:13 user nova-compute[75226]:     <serial type="pty">
Nov 17 01:29:13 user nova-compute[75226]:       <log file="/opt/stack/data/nova/instances/f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c/console.log" append="off"/>
Nov 17 01:29:13 user nova-compute[75226]:     </serial>
Nov 17 01:29:13 user nova-compute[75226]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 17 01:29:13 user nova-compute[75226]:     <video>
Nov 17 01:29:13 user nova-compute[75226]:       <model type="virtio"/>
Nov 17 01:29:13 user nova-compute[75226]:     </video>
Nov 17 01:29:13 user nova-compute[75226]:     <rng model="virtio">
Nov 17 01:29:13 user nova-compute[75226]:       <backend model="random">/dev/urandom</backend>
Nov 17 01:29:13 user nova-compute[75226]:     </rng>
Nov 17 01:29:13 user nova-compute[75226]:     <controller type="usb" index="0" model="none"/>
Nov 17 01:29:13 user nova-compute[75226]:     <memballoon model="virtio">
Nov 17 01:29:13 user nova-compute[75226]:       <stats period="10"/>
Nov 17 01:29:13 user nova-compute[75226]:     </memballoon>
Nov 17 01:29:13 user nova-compute[75226]:   </devices>
Nov 17 01:29:13 user nova-compute[75226]: </domain>
Nov 17 01:29:13 user nova-compute[75226]:  {{(pid=75226) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 17 01:29:13 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-f3fd6180-21cb-4f25-b6c4-92b793aa401b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:29:13 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-f3fd6180-21cb-4f25-b6c4-92b793aa401b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:29:13 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-f3fd6180-21cb-4f25-b6c4-92b793aa401b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:29:13 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-f3fd6180-21cb-4f25-b6c4-92b793aa401b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:29:13 user nova-compute[75226]: DEBUG nova.objects.instance [None req-f3fd6180-21cb-4f25-b6c4-92b793aa401b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Lazy-loading 'trusted_certs' on Instance uuid f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:29:13 user nova-compute[75226]: DEBUG nova.objects.base [None req-f3fd6180-21cb-4f25-b6c4-92b793aa401b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Object Instance<f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=75226) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 17 01:29:13 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-f3fd6180-21cb-4f25-b6c4-92b793aa401b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:29:13 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-f3fd6180-21cb-4f25-b6c4-92b793aa401b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json" returned: 0 in 0.178s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:29:13 user nova-compute[75226]: DEBUG nova.virt.disk.api [None req-f3fd6180-21cb-4f25-b6c4-92b793aa401b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c/disk. size=1073741824 {{(pid=75226) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 17 01:29:13 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-f3fd6180-21cb-4f25-b6c4-92b793aa401b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:29:13 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-f3fd6180-21cb-4f25-b6c4-92b793aa401b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:29:13 user nova-compute[75226]: DEBUG nova.virt.disk.api [None req-f3fd6180-21cb-4f25-b6c4-92b793aa401b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Cannot resize image /opt/stack/data/nova/instances/f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c/disk to a smaller size. {{(pid=75226) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 17 01:29:13 user nova-compute[75226]: DEBUG nova.objects.instance [None req-f3fd6180-21cb-4f25-b6c4-92b793aa401b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Lazy-loading 'migration_context' on Instance uuid f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:29:13 user nova-compute[75226]: DEBUG nova.objects.base [None req-f3fd6180-21cb-4f25-b6c4-92b793aa401b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Object Instance<f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75226) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 17 01:29:13 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-f3fd6180-21cb-4f25-b6c4-92b793aa401b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:21:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-980884499',display_name='tempest-AttachVolumeTestJSON-server-980884499',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-980884499',id=14,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEeERZjFkWxmLB8VU7feu2kYsY5hOpCoxndDBoQzV87owC8kzSgAjyPTw83uHfeVmkKFRyeTiQ9M6sBUaGKQxsiszNV9RLzq6OmxLI7Pi6/hF+7Z96DGb0RR92U15Os/9A==',key_name='tempest-keypair-1317105249',keypairs=<?>,launch_index=0,launched_at=2023-11-17T01:21:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='054575d3dc66452091173b4c604b8c96',ramdisk_id='',reservation_id='r-cjk2rxuv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-223132631',owner_user_name='tempest-AttachVolumeTestJSON-223132631-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T01:27:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c30381a66814427ba39e21c024136fee',uuid=f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "ed40e788-7338-4ecd-8204-008d4601131b", "address": "fa:16:3e:69:68:ce", "network": {"id": "c93f11a7-52c6-4379-a1fb-9a002876c221", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-985502177-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "054575d3dc66452091173b4c604b8c96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped40e788-73", "ovs_interfaceid": "ed40e788-7338-4ecd-8204-008d4601131b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 17 01:29:13 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-f3fd6180-21cb-4f25-b6c4-92b793aa401b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Converting VIF {"id": "ed40e788-7338-4ecd-8204-008d4601131b", "address": "fa:16:3e:69:68:ce", "network": {"id": "c93f11a7-52c6-4379-a1fb-9a002876c221", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-985502177-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "054575d3dc66452091173b4c604b8c96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped40e788-73", "ovs_interfaceid": "ed40e788-7338-4ecd-8204-008d4601131b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:29:13 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-f3fd6180-21cb-4f25-b6c4-92b793aa401b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:68:ce,bridge_name='br-int',has_traffic_filtering=True,id=ed40e788-7338-4ecd-8204-008d4601131b,network=Network(c93f11a7-52c6-4379-a1fb-9a002876c221),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped40e788-73') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:29:13 user nova-compute[75226]: DEBUG os_vif [None req-f3fd6180-21cb-4f25-b6c4-92b793aa401b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:68:ce,bridge_name='br-int',has_traffic_filtering=True,id=ed40e788-7338-4ecd-8204-008d4601131b,network=Network(c93f11a7-52c6-4379-a1fb-9a002876c221),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped40e788-73') {{(pid=75226) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 17 01:29:13 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:29:13 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:29:13 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 17 01:29:13 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:29:13 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'afe1cc5f-9cdf-5f89-b0f4-4864cb3a3601', '_type': 'linux-noop'}}, row=False) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:29:13 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:29:13 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:29:13 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=taped40e788-73, may_exist=True, interface_attrs={}) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:29:13 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=taped40e788-73, col_values=(('qos', UUID('b259d550-1edd-4f6c-b69f-046f4d48b2e5')),), if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:29:13 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=taped40e788-73, col_values=(('external_ids', {'iface-id': 'ed40e788-7338-4ecd-8204-008d4601131b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:69:68:ce', 'vm-uuid': 'f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c'}),), if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:29:13 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:29:13 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:29:13 user nova-compute[75226]: INFO os_vif [None req-f3fd6180-21cb-4f25-b6c4-92b793aa401b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:68:ce,bridge_name='br-int',has_traffic_filtering=True,id=ed40e788-7338-4ecd-8204-008d4601131b,network=Network(c93f11a7-52c6-4379-a1fb-9a002876c221),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped40e788-73')
Nov 17 01:29:15 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:29:15 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:29:15 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:29:15 user nova-compute[75226]: DEBUG nova.compute.manager [req-fabcfab6-8482-4826-8baf-da1db736b3dc req-1ffc8209-3b7b-4334-9ace-e2373568a378 service nova] [instance: f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c] Received event network-vif-plugged-ed40e788-7338-4ecd-8204-008d4601131b {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:29:15 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-fabcfab6-8482-4826-8baf-da1db736b3dc req-1ffc8209-3b7b-4334-9ace-e2373568a378 service nova] Acquiring lock "f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:29:15 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-fabcfab6-8482-4826-8baf-da1db736b3dc req-1ffc8209-3b7b-4334-9ace-e2373568a378 service nova] Lock "f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:29:15 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-fabcfab6-8482-4826-8baf-da1db736b3dc req-1ffc8209-3b7b-4334-9ace-e2373568a378 service nova] Lock "f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:29:15 user nova-compute[75226]: DEBUG nova.compute.manager [req-fabcfab6-8482-4826-8baf-da1db736b3dc req-1ffc8209-3b7b-4334-9ace-e2373568a378 service nova] [instance: f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c] No waiting events found dispatching network-vif-plugged-ed40e788-7338-4ecd-8204-008d4601131b {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:29:15 user nova-compute[75226]: WARNING nova.compute.manager [req-fabcfab6-8482-4826-8baf-da1db736b3dc req-1ffc8209-3b7b-4334-9ace-e2373568a378 service nova] [instance: f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c] Received unexpected event network-vif-plugged-ed40e788-7338-4ecd-8204-008d4601131b for instance with vm_state stopped and task_state powering-on.
Nov 17 01:29:15 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:29:15 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:29:15 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:29:17 user nova-compute[75226]: DEBUG nova.compute.manager [None req-f3fd6180-21cb-4f25-b6c4-92b793aa401b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] [instance: f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c] Instance event wait completed in 0 seconds for  {{(pid=75226) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 17 01:29:17 user nova-compute[75226]: INFO nova.virt.libvirt.driver [-] [instance: f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c] Instance rebooted successfully.
Nov 17 01:29:17 user nova-compute[75226]: DEBUG nova.compute.manager [None req-f3fd6180-21cb-4f25-b6c4-92b793aa401b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] [instance: f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c] Checking state {{(pid=75226) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 01:29:17 user nova-compute[75226]: DEBUG nova.compute.manager [req-711e0cfe-6cb7-4691-a5c1-eaaf693dec70 req-588a597f-dfaa-4a18-a63e-a0d738cb8e79 service nova] [instance: f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c] Received event network-vif-plugged-ed40e788-7338-4ecd-8204-008d4601131b {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:29:17 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-711e0cfe-6cb7-4691-a5c1-eaaf693dec70 req-588a597f-dfaa-4a18-a63e-a0d738cb8e79 service nova] Acquiring lock "f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:29:17 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-711e0cfe-6cb7-4691-a5c1-eaaf693dec70 req-588a597f-dfaa-4a18-a63e-a0d738cb8e79 service nova] Lock "f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:29:17 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-711e0cfe-6cb7-4691-a5c1-eaaf693dec70 req-588a597f-dfaa-4a18-a63e-a0d738cb8e79 service nova] Lock "f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:29:17 user nova-compute[75226]: DEBUG nova.compute.manager [req-711e0cfe-6cb7-4691-a5c1-eaaf693dec70 req-588a597f-dfaa-4a18-a63e-a0d738cb8e79 service nova] [instance: f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c] No waiting events found dispatching network-vif-plugged-ed40e788-7338-4ecd-8204-008d4601131b {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:29:17 user nova-compute[75226]: WARNING nova.compute.manager [req-711e0cfe-6cb7-4691-a5c1-eaaf693dec70 req-588a597f-dfaa-4a18-a63e-a0d738cb8e79 service nova] [instance: f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c] Received unexpected event network-vif-plugged-ed40e788-7338-4ecd-8204-008d4601131b for instance with vm_state active and task_state None.
Nov 17 01:29:17 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:29:18 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:29:23 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:29:24 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:29:26 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-8050bed9-27cb-44d4-b353-24fa434c4622 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Acquiring lock "3018e3a2-01e0-49d7-a960-51718709845a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:29:26 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-8050bed9-27cb-44d4-b353-24fa434c4622 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Lock "3018e3a2-01e0-49d7-a960-51718709845a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:29:26 user nova-compute[75226]: DEBUG nova.compute.manager [None req-8050bed9-27cb-44d4-b353-24fa434c4622 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 3018e3a2-01e0-49d7-a960-51718709845a] Starting instance... {{(pid=75226) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 17 01:29:26 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-8050bed9-27cb-44d4-b353-24fa434c4622 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:29:26 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-8050bed9-27cb-44d4-b353-24fa434c4622 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:29:26 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-8050bed9-27cb-44d4-b353-24fa434c4622 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75226) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 17 01:29:26 user nova-compute[75226]: INFO nova.compute.claims [None req-8050bed9-27cb-44d4-b353-24fa434c4622 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 3018e3a2-01e0-49d7-a960-51718709845a] Claim successful on node user
Nov 17 01:29:26 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-8050bed9-27cb-44d4-b353-24fa434c4622 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:29:26 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-8050bed9-27cb-44d4-b353-24fa434c4622 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:29:26 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-8050bed9-27cb-44d4-b353-24fa434c4622 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.585s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:29:26 user nova-compute[75226]: DEBUG nova.compute.manager [None req-8050bed9-27cb-44d4-b353-24fa434c4622 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 3018e3a2-01e0-49d7-a960-51718709845a] Start building networks asynchronously for instance. {{(pid=75226) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 17 01:29:26 user nova-compute[75226]: DEBUG nova.compute.manager [None req-8050bed9-27cb-44d4-b353-24fa434c4622 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 3018e3a2-01e0-49d7-a960-51718709845a] Allocating IP information in the background. {{(pid=75226) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 17 01:29:26 user nova-compute[75226]: DEBUG nova.network.neutron [None req-8050bed9-27cb-44d4-b353-24fa434c4622 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 3018e3a2-01e0-49d7-a960-51718709845a] allocate_for_instance() {{(pid=75226) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 17 01:29:26 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-8050bed9-27cb-44d4-b353-24fa434c4622 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 3018e3a2-01e0-49d7-a960-51718709845a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 17 01:29:26 user nova-compute[75226]: DEBUG nova.compute.manager [None req-8050bed9-27cb-44d4-b353-24fa434c4622 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 3018e3a2-01e0-49d7-a960-51718709845a] Start building block device mappings for instance. {{(pid=75226) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 17 01:29:26 user nova-compute[75226]: DEBUG nova.policy [None req-8050bed9-27cb-44d4-b353-24fa434c4622 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1b793ce05bf44b939a9fb5a914a04cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6cb6f679ee4468d82cc7fb5d0f67be9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75226) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 17 01:29:26 user nova-compute[75226]: INFO nova.virt.block_device [None req-8050bed9-27cb-44d4-b353-24fa434c4622 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 3018e3a2-01e0-49d7-a960-51718709845a] Booting with volume-backed-image 0b369aea-6f3f-4690-9f01-229b90ab6310 at /dev/vda
Nov 17 01:29:27 user nova-compute[75226]: DEBUG nova.network.neutron [None req-8050bed9-27cb-44d4-b353-24fa434c4622 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 3018e3a2-01e0-49d7-a960-51718709845a] Successfully created port: f05fa2a1-b61b-4617-b895-8c75645bde94 {{(pid=75226) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 17 01:29:27 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:29:28 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-f55badd1-c75c-40c6-8e4d-234688a72bae tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Acquiring lock "9e8b4b85-fe0c-4592-850e-e94ebab32d02" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:29:28 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-f55badd1-c75c-40c6-8e4d-234688a72bae tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Lock "9e8b4b85-fe0c-4592-850e-e94ebab32d02" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:29:28 user nova-compute[75226]: DEBUG nova.compute.manager [None req-f55badd1-c75c-40c6-8e4d-234688a72bae tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] [instance: 9e8b4b85-fe0c-4592-850e-e94ebab32d02] Starting instance... {{(pid=75226) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 17 01:29:28 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-f55badd1-c75c-40c6-8e4d-234688a72bae tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:29:28 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-f55badd1-c75c-40c6-8e4d-234688a72bae tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:29:28 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-f55badd1-c75c-40c6-8e4d-234688a72bae tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75226) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 17 01:29:28 user nova-compute[75226]: INFO nova.compute.claims [None req-f55badd1-c75c-40c6-8e4d-234688a72bae tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] [instance: 9e8b4b85-fe0c-4592-850e-e94ebab32d02] Claim successful on node user
Nov 17 01:29:28 user nova-compute[75226]: DEBUG nova.network.neutron [None req-8050bed9-27cb-44d4-b353-24fa434c4622 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 3018e3a2-01e0-49d7-a960-51718709845a] Successfully updated port: f05fa2a1-b61b-4617-b895-8c75645bde94 {{(pid=75226) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 17 01:29:28 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-8050bed9-27cb-44d4-b353-24fa434c4622 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Acquiring lock "refresh_cache-3018e3a2-01e0-49d7-a960-51718709845a" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:29:28 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-8050bed9-27cb-44d4-b353-24fa434c4622 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Acquired lock "refresh_cache-3018e3a2-01e0-49d7-a960-51718709845a" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:29:28 user nova-compute[75226]: DEBUG nova.network.neutron [None req-8050bed9-27cb-44d4-b353-24fa434c4622 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 3018e3a2-01e0-49d7-a960-51718709845a] Building network info cache for instance {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 01:29:28 user nova-compute[75226]: DEBUG nova.compute.manager [req-1e896280-939e-4569-a295-1dbaa3664dcb req-2cc5f7fd-f0e3-450d-8ba7-27631c8674c1 service nova] [instance: 3018e3a2-01e0-49d7-a960-51718709845a] Received event network-changed-f05fa2a1-b61b-4617-b895-8c75645bde94 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:29:28 user nova-compute[75226]: DEBUG nova.compute.manager [req-1e896280-939e-4569-a295-1dbaa3664dcb req-2cc5f7fd-f0e3-450d-8ba7-27631c8674c1 service nova] [instance: 3018e3a2-01e0-49d7-a960-51718709845a] Refreshing instance network info cache due to event network-changed-f05fa2a1-b61b-4617-b895-8c75645bde94. {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 01:29:28 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-1e896280-939e-4569-a295-1dbaa3664dcb req-2cc5f7fd-f0e3-450d-8ba7-27631c8674c1 service nova] Acquiring lock "refresh_cache-3018e3a2-01e0-49d7-a960-51718709845a" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:29:28 user nova-compute[75226]: DEBUG nova.network.neutron [None req-8050bed9-27cb-44d4-b353-24fa434c4622 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 3018e3a2-01e0-49d7-a960-51718709845a] Instance cache missing network info. {{(pid=75226) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 17 01:29:28 user nova-compute[75226]: DEBUG nova.compute.manager [req-a807006a-e7e7-4758-b0b2-e05f3f95ca4c req-4a3e979d-003e-4249-811c-ab95605be1ad service nova] [instance: 346967c5-6945-4cef-9eea-8415cb27c98f] Received event network-changed-aa5b3af3-4cac-4a2f-93b8-3b6d378a3486 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:29:28 user nova-compute[75226]: DEBUG nova.compute.manager [req-a807006a-e7e7-4758-b0b2-e05f3f95ca4c req-4a3e979d-003e-4249-811c-ab95605be1ad service nova] [instance: 346967c5-6945-4cef-9eea-8415cb27c98f] Refreshing instance network info cache due to event network-changed-aa5b3af3-4cac-4a2f-93b8-3b6d378a3486. {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 01:29:28 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-a807006a-e7e7-4758-b0b2-e05f3f95ca4c req-4a3e979d-003e-4249-811c-ab95605be1ad service nova] Acquiring lock "refresh_cache-346967c5-6945-4cef-9eea-8415cb27c98f" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:29:28 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-a807006a-e7e7-4758-b0b2-e05f3f95ca4c req-4a3e979d-003e-4249-811c-ab95605be1ad service nova] Acquired lock "refresh_cache-346967c5-6945-4cef-9eea-8415cb27c98f" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:29:28 user nova-compute[75226]: DEBUG nova.network.neutron [req-a807006a-e7e7-4758-b0b2-e05f3f95ca4c req-4a3e979d-003e-4249-811c-ab95605be1ad service nova] [instance: 346967c5-6945-4cef-9eea-8415cb27c98f] Refreshing network info cache for port aa5b3af3-4cac-4a2f-93b8-3b6d378a3486 {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 01:29:28 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-aeff962e-1d18-49b0-a58e-2557ffa9ff5f tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Acquiring lock "346967c5-6945-4cef-9eea-8415cb27c98f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:29:28 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-aeff962e-1d18-49b0-a58e-2557ffa9ff5f tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Lock "346967c5-6945-4cef-9eea-8415cb27c98f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:29:28 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-aeff962e-1d18-49b0-a58e-2557ffa9ff5f tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Acquiring lock "346967c5-6945-4cef-9eea-8415cb27c98f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:29:28 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-aeff962e-1d18-49b0-a58e-2557ffa9ff5f tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Lock "346967c5-6945-4cef-9eea-8415cb27c98f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:29:28 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-aeff962e-1d18-49b0-a58e-2557ffa9ff5f tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Lock "346967c5-6945-4cef-9eea-8415cb27c98f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:29:28 user nova-compute[75226]: INFO nova.compute.manager [None req-aeff962e-1d18-49b0-a58e-2557ffa9ff5f tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] [instance: 346967c5-6945-4cef-9eea-8415cb27c98f] Terminating instance
Nov 17 01:29:28 user nova-compute[75226]: DEBUG nova.compute.manager [None req-aeff962e-1d18-49b0-a58e-2557ffa9ff5f tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] [instance: 346967c5-6945-4cef-9eea-8415cb27c98f] Start destroying the instance on the hypervisor. {{(pid=75226) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 17 01:29:28 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:29:28 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-f55badd1-c75c-40c6-8e4d-234688a72bae tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:29:28 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:29:28 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:29:28 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-f55badd1-c75c-40c6-8e4d-234688a72bae tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:29:28 user nova-compute[75226]: DEBUG nova.network.neutron [None req-8050bed9-27cb-44d4-b353-24fa434c4622 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 3018e3a2-01e0-49d7-a960-51718709845a] Updating instance_info_cache with network_info: [{"id": "f05fa2a1-b61b-4617-b895-8c75645bde94", "address": "fa:16:3e:0b:9b:f6", "network": {"id": "450540a3-ff7e-42fb-a0a6-808acd749943", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1503678778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6cb6f679ee4468d82cc7fb5d0f67be9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf05fa2a1-b6", "ovs_interfaceid": "f05fa2a1-b61b-4617-b895-8c75645bde94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:29:28 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:29:28 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:29:28 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-8050bed9-27cb-44d4-b353-24fa434c4622 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Releasing lock "refresh_cache-3018e3a2-01e0-49d7-a960-51718709845a" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:29:28 user nova-compute[75226]: DEBUG nova.compute.manager [None req-8050bed9-27cb-44d4-b353-24fa434c4622 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 3018e3a2-01e0-49d7-a960-51718709845a] Instance network_info: |[{"id": "f05fa2a1-b61b-4617-b895-8c75645bde94", "address": "fa:16:3e:0b:9b:f6", "network": {"id": "450540a3-ff7e-42fb-a0a6-808acd749943", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1503678778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6cb6f679ee4468d82cc7fb5d0f67be9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf05fa2a1-b6", "ovs_interfaceid": "f05fa2a1-b61b-4617-b895-8c75645bde94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75226) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 17 01:29:28 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-1e896280-939e-4569-a295-1dbaa3664dcb req-2cc5f7fd-f0e3-450d-8ba7-27631c8674c1 service nova] Acquired lock "refresh_cache-3018e3a2-01e0-49d7-a960-51718709845a" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:29:28 user nova-compute[75226]: DEBUG nova.network.neutron [req-1e896280-939e-4569-a295-1dbaa3664dcb req-2cc5f7fd-f0e3-450d-8ba7-27631c8674c1 service nova] [instance: 3018e3a2-01e0-49d7-a960-51718709845a] Refreshing network info cache for port f05fa2a1-b61b-4617-b895-8c75645bde94 {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 01:29:28 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-f55badd1-c75c-40c6-8e4d-234688a72bae tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.709s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:29:28 user nova-compute[75226]: DEBUG nova.compute.manager [None req-f55badd1-c75c-40c6-8e4d-234688a72bae tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] [instance: 9e8b4b85-fe0c-4592-850e-e94ebab32d02] Start building networks asynchronously for instance. {{(pid=75226) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 17 01:29:29 user nova-compute[75226]: DEBUG nova.compute.manager [None req-f55badd1-c75c-40c6-8e4d-234688a72bae tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] [instance: 9e8b4b85-fe0c-4592-850e-e94ebab32d02] Allocating IP information in the background. {{(pid=75226) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 17 01:29:29 user nova-compute[75226]: DEBUG nova.network.neutron [None req-f55badd1-c75c-40c6-8e4d-234688a72bae tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] [instance: 9e8b4b85-fe0c-4592-850e-e94ebab32d02] allocate_for_instance() {{(pid=75226) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 17 01:29:29 user nova-compute[75226]: DEBUG nova.compute.manager [req-8415d202-5eb5-4221-ab49-2894f4c2f81f req-521393ff-b212-4645-862e-6a8202af07c0 service nova] [instance: 346967c5-6945-4cef-9eea-8415cb27c98f] Received event network-vif-unplugged-aa5b3af3-4cac-4a2f-93b8-3b6d378a3486 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:29:29 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-8415d202-5eb5-4221-ab49-2894f4c2f81f req-521393ff-b212-4645-862e-6a8202af07c0 service nova] Acquiring lock "346967c5-6945-4cef-9eea-8415cb27c98f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:29:29 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-8415d202-5eb5-4221-ab49-2894f4c2f81f req-521393ff-b212-4645-862e-6a8202af07c0 service nova] Lock "346967c5-6945-4cef-9eea-8415cb27c98f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:29:29 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-8415d202-5eb5-4221-ab49-2894f4c2f81f req-521393ff-b212-4645-862e-6a8202af07c0 service nova] Lock "346967c5-6945-4cef-9eea-8415cb27c98f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:29:29 user nova-compute[75226]: DEBUG nova.compute.manager [req-8415d202-5eb5-4221-ab49-2894f4c2f81f req-521393ff-b212-4645-862e-6a8202af07c0 service nova] [instance: 346967c5-6945-4cef-9eea-8415cb27c98f] No waiting events found dispatching network-vif-unplugged-aa5b3af3-4cac-4a2f-93b8-3b6d378a3486 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:29:29 user nova-compute[75226]: DEBUG nova.compute.manager [req-8415d202-5eb5-4221-ab49-2894f4c2f81f req-521393ff-b212-4645-862e-6a8202af07c0 service nova] [instance: 346967c5-6945-4cef-9eea-8415cb27c98f] Received event network-vif-unplugged-aa5b3af3-4cac-4a2f-93b8-3b6d378a3486 for instance with task_state deleting. {{(pid=75226) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 17 01:29:29 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-f55badd1-c75c-40c6-8e4d-234688a72bae tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] [instance: 9e8b4b85-fe0c-4592-850e-e94ebab32d02] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 17 01:29:29 user nova-compute[75226]: DEBUG nova.compute.manager [None req-f55badd1-c75c-40c6-8e4d-234688a72bae tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] [instance: 9e8b4b85-fe0c-4592-850e-e94ebab32d02] Start building block device mappings for instance. {{(pid=75226) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 17 01:29:29 user nova-compute[75226]: DEBUG nova.network.neutron [req-a807006a-e7e7-4758-b0b2-e05f3f95ca4c req-4a3e979d-003e-4249-811c-ab95605be1ad service nova] [instance: 346967c5-6945-4cef-9eea-8415cb27c98f] Updated VIF entry in instance network info cache for port aa5b3af3-4cac-4a2f-93b8-3b6d378a3486. {{(pid=75226) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 01:29:29 user nova-compute[75226]: DEBUG nova.network.neutron [req-a807006a-e7e7-4758-b0b2-e05f3f95ca4c req-4a3e979d-003e-4249-811c-ab95605be1ad service nova] [instance: 346967c5-6945-4cef-9eea-8415cb27c98f] Updating instance_info_cache with network_info: [{"id": "aa5b3af3-4cac-4a2f-93b8-3b6d378a3486", "address": "fa:16:3e:be:85:10", "network": {"id": "9335d73b-c260-49f3-8771-0dc21875a113", "bridge": "br-int", "label": "tempest-TestShelveInstance-1952470027-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adaa172aeff64609a273bdc271806238", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa5b3af3-4c", "ovs_interfaceid": "aa5b3af3-4cac-4a2f-93b8-3b6d378a3486", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:29:29 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-a807006a-e7e7-4758-b0b2-e05f3f95ca4c req-4a3e979d-003e-4249-811c-ab95605be1ad service nova] Releasing lock "refresh_cache-346967c5-6945-4cef-9eea-8415cb27c98f" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:29:29 user nova-compute[75226]: DEBUG nova.compute.manager [None req-f55badd1-c75c-40c6-8e4d-234688a72bae tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] [instance: 9e8b4b85-fe0c-4592-850e-e94ebab32d02] Start spawning the instance on the hypervisor. {{(pid=75226) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 17 01:29:29 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-f55badd1-c75c-40c6-8e4d-234688a72bae tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] [instance: 9e8b4b85-fe0c-4592-850e-e94ebab32d02] Creating instance directory {{(pid=75226) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 17 01:29:29 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-f55badd1-c75c-40c6-8e4d-234688a72bae tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] [instance: 9e8b4b85-fe0c-4592-850e-e94ebab32d02] Creating image(s)
Nov 17 01:29:29 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-f55badd1-c75c-40c6-8e4d-234688a72bae tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Acquiring lock "/opt/stack/data/nova/instances/9e8b4b85-fe0c-4592-850e-e94ebab32d02/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:29:29 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-f55badd1-c75c-40c6-8e4d-234688a72bae tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Lock "/opt/stack/data/nova/instances/9e8b4b85-fe0c-4592-850e-e94ebab32d02/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:29:29 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-f55badd1-c75c-40c6-8e4d-234688a72bae tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Lock "/opt/stack/data/nova/instances/9e8b4b85-fe0c-4592-850e-e94ebab32d02/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:29:29 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-f55badd1-c75c-40c6-8e4d-234688a72bae tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:29:29 user nova-compute[75226]: DEBUG nova.policy [None req-f55badd1-c75c-40c6-8e4d-234688a72bae tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2adb9c6cd5c443a7993f6f9d09da6346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fcdc65b510141e9b7c9a01401a97448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75226) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 17 01:29:29 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-f55badd1-c75c-40c6-8e4d-234688a72bae tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json" returned: 0 in 0.180s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:29:29 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-f55badd1-c75c-40c6-8e4d-234688a72bae tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Acquiring lock "a8a62c2546af3a2036b853250c5ac64d4c6b4371" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:29:29 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-f55badd1-c75c-40c6-8e4d-234688a72bae tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Lock "a8a62c2546af3a2036b853250c5ac64d4c6b4371" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:29:29 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-f55badd1-c75c-40c6-8e4d-234688a72bae tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:29:29 user nova-compute[75226]: INFO nova.virt.libvirt.driver [-] [instance: 346967c5-6945-4cef-9eea-8415cb27c98f] Instance destroyed successfully.
Nov 17 01:29:29 user nova-compute[75226]: DEBUG nova.objects.instance [None req-aeff962e-1d18-49b0-a58e-2557ffa9ff5f tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Lazy-loading 'resources' on Instance uuid 346967c5-6945-4cef-9eea-8415cb27c98f {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:29:29 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-aeff962e-1d18-49b0-a58e-2557ffa9ff5f tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-17T01:23:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1793645083',display_name='tempest-TestShelveInstance-server-1793645083',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1793645083',id=20,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIOvS4/tTht9hr1zXYQtzCR2u7iigZ7otRMVBOpropTrS4OyZyMoxHA9vJUOwRc9jjyn0792XF/jB+xhGlZyJPPlZyVyxaJGOABRR09r+ft/TyseT2oW3x5gSl4AxhHiWw==',key_name='tempest-TestShelveInstance-879048345',keypairs=<?>,launch_index=0,launched_at=2023-11-17T01:27:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='adaa172aeff64609a273bdc271806238',ramdisk_id='',reservation_id='r-rgcypk19',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1381460949',owner_user_name='tempest-TestShelveInstance-1381460949-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T01:27:51Z,user_data=None,user_id='ed6cfbd0e0124dd2a4092f0b087f416c',uuid=346967c5-6945-4cef-9eea-8415cb27c98f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "aa5b3af3-4cac-4a2f-93b8-3b6d378a3486", "address": "fa:16:3e:be:85:10", "network": {"id": "9335d73b-c260-49f3-8771-0dc21875a113", "bridge": "br-int", "label": "tempest-TestShelveInstance-1952470027-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adaa172aeff64609a273bdc271806238", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa5b3af3-4c", "ovs_interfaceid": "aa5b3af3-4cac-4a2f-93b8-3b6d378a3486", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 17 01:29:29 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-aeff962e-1d18-49b0-a58e-2557ffa9ff5f tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Converting VIF {"id": "aa5b3af3-4cac-4a2f-93b8-3b6d378a3486", "address": "fa:16:3e:be:85:10", "network": {"id": "9335d73b-c260-49f3-8771-0dc21875a113", "bridge": "br-int", "label": "tempest-TestShelveInstance-1952470027-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adaa172aeff64609a273bdc271806238", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa5b3af3-4c", "ovs_interfaceid": "aa5b3af3-4cac-4a2f-93b8-3b6d378a3486", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:29:29 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-aeff962e-1d18-49b0-a58e-2557ffa9ff5f tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:85:10,bridge_name='br-int',has_traffic_filtering=True,id=aa5b3af3-4cac-4a2f-93b8-3b6d378a3486,network=Network(9335d73b-c260-49f3-8771-0dc21875a113),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa5b3af3-4c') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:29:29 user nova-compute[75226]: DEBUG os_vif [None req-aeff962e-1d18-49b0-a58e-2557ffa9ff5f tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:85:10,bridge_name='br-int',has_traffic_filtering=True,id=aa5b3af3-4cac-4a2f-93b8-3b6d378a3486,network=Network(9335d73b-c260-49f3-8771-0dc21875a113),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa5b3af3-4c') {{(pid=75226) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 17 01:29:29 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:29:29 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaa5b3af3-4c, bridge=br-int, if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:29:29 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:29:29 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:29:29 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:29:29 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=92ef469c-66c1-4ad6-87b7-88b52a5c277c) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:29:29 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:29:29 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:29:29 user nova-compute[75226]: INFO os_vif [None req-aeff962e-1d18-49b0-a58e-2557ffa9ff5f tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:85:10,bridge_name='br-int',has_traffic_filtering=True,id=aa5b3af3-4cac-4a2f-93b8-3b6d378a3486,network=Network(9335d73b-c260-49f3-8771-0dc21875a113),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa5b3af3-4c')
Nov 17 01:29:29 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aeff962e-1d18-49b0-a58e-2557ffa9ff5f tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] [instance: 346967c5-6945-4cef-9eea-8415cb27c98f] calling os-brick to detach iSCSI Volume {{(pid=75226) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 17 01:29:29 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeff962e-1d18-49b0-a58e-2557ffa9ff5f tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc4cc36b490>, {'target_iqn': 'iqn.2010-10.org.openstack:c17ed19c-4452-4a79-b36a-07ddcd7d9404', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LimvaOGH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:29:29 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-aeff962e-1d18-49b0-a58e-2557ffa9ff5f tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:29:29 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-aeff962e-1d18-49b0-a58e-2557ffa9ff5f tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:29:29 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-aeff962e-1d18-49b0-a58e-2557ffa9ff5f tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:29:29 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:29:29 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:29:29 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[06b63f37-6836-4b28-9599-5e78b4de5aa1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c17ed19c-4452-4a79-b36a-07ddcd7d9404\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:29:29 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeff962e-1d18-49b0-a58e-2557ffa9ff5f tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 17 01:29:29 user nova-compute[75226]: No targets found.
Nov 17 01:29:29 user nova-compute[75226]: iSNS:
Nov 17 01:29:29 user nova-compute[75226]: No targets found.
Nov 17 01:29:29 user nova-compute[75226]: STATIC:
Nov 17 01:29:29 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14
Nov 17 01:29:29 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:29:29 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:29:29 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba
Nov 17 01:29:29 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:29:29 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:29:29 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8
Nov 17 01:29:29 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:29:29 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:29:29 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:c17ed19c-4452-4a79-b36a-07ddcd7d9404
Nov 17 01:29:29 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:29:29 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:29:29 user nova-compute[75226]: FIRMWARE:
Nov 17 01:29:29 user nova-compute[75226]: No targets found.
Nov 17 01:29:29 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:29:29 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeff962e-1d18-49b0-a58e-2557ffa9ff5f tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 17 01:29:29 user nova-compute[75226]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 17 01:29:29 user nova-compute[75226]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75226) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 17 01:29:29 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeff962e-1d18-49b0-a58e-2557ffa9ff5f tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c17ed19c-4452-4a79-b36a-07ddcd7d9404', 0)] {{(pid=75226) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 17 01:29:29 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:29:29 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-f55badd1-c75c-40c6-8e4d-234688a72bae tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json" returned: 0 in 0.205s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:29:29 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-f55badd1-c75c-40c6-8e4d-234688a72bae tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371,backing_fmt=raw /opt/stack/data/nova/instances/9e8b4b85-fe0c-4592-850e-e94ebab32d02/disk 1073741824 {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:29:29 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:29:29 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dc3ee31-6333-473d-90df-08d72fec0d58]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c17ed19c-4452-4a79-b36a-07ddcd7d9404\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:29:29 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:29:29 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-f55badd1-c75c-40c6-8e4d-234688a72bae tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371,backing_fmt=raw /opt/stack/data/nova/instances/9e8b4b85-fe0c-4592-850e-e94ebab32d02/disk 1073741824" returned: 0 in 0.060s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:29:29 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-f55badd1-c75c-40c6-8e4d-234688a72bae tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Lock "a8a62c2546af3a2036b853250c5ac64d4c6b4371" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.268s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:29:29 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-f55badd1-c75c-40c6-8e4d-234688a72bae tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:29:29 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:29:29 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[49a8d705-998b-4787-91a5-0f019ec302d6]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c17ed19c-4452-4a79-b36a-07ddcd7d9404 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:29:29 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeff962e-1d18-49b0-a58e-2557ffa9ff5f tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)
Nov 17 01:29:29 user nova-compute[75226]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14 (non-flash)
Nov 17 01:29:29 user nova-compute[75226]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c17ed19c-4452-4a79-b36a-07ddcd7d9404 (non-flash)
Nov 17 01:29:29 user nova-compute[75226]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba (non-flash)
Nov 17 01:29:29 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:29:29 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeff962e-1d18-49b0-a58e-2557ffa9ff5f tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)
Nov 17 01:29:29 user nova-compute[75226]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14 (non-flash)
Nov 17 01:29:29 user nova-compute[75226]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c17ed19c-4452-4a79-b36a-07ddcd7d9404 (non-flash)
Nov 17 01:29:29 user nova-compute[75226]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba (non-flash)
Nov 17 01:29:29 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:29:29 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeff962e-1d18-49b0-a58e-2557ffa9ff5f tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc4cc1faa70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c17ed19c-4452-4a79-b36a-07ddcd7d9404'): ({'sde'}, set())}) {{(pid=75226) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 17 01:29:29 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-aeff962e-1d18-49b0-a58e-2557ffa9ff5f tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Removing single pathed devices sde {{(pid=75226) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 17 01:29:29 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:29:29 user nova-compute[75226]: DEBUG nova.network.neutron [req-1e896280-939e-4569-a295-1dbaa3664dcb req-2cc5f7fd-f0e3-450d-8ba7-27631c8674c1 service nova] [instance: 3018e3a2-01e0-49d7-a960-51718709845a] Updated VIF entry in instance network info cache for port f05fa2a1-b61b-4617-b895-8c75645bde94. {{(pid=75226) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 01:29:29 user nova-compute[75226]: DEBUG nova.network.neutron [req-1e896280-939e-4569-a295-1dbaa3664dcb req-2cc5f7fd-f0e3-450d-8ba7-27631c8674c1 service nova] [instance: 3018e3a2-01e0-49d7-a960-51718709845a] Updating instance_info_cache with network_info: [{"id": "f05fa2a1-b61b-4617-b895-8c75645bde94", "address": "fa:16:3e:0b:9b:f6", "network": {"id": "450540a3-ff7e-42fb-a0a6-808acd749943", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1503678778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6cb6f679ee4468d82cc7fb5d0f67be9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf05fa2a1-b6", "ovs_interfaceid": "f05fa2a1-b61b-4617-b895-8c75645bde94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:29:29 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:29:29 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[143e107b-2bc9-4eff-aa89-faa127ea8277]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:29:29 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:29:29 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:29:29 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[01a6d029-8ab6-4629-942e-8f35603151b6]: (4, ('ok\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:29:29 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-aeff962e-1d18-49b0-a58e-2557ffa9ff5f tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Flushing IO for device /dev/sde {{(pid=75226) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 17 01:29:29 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-1e896280-939e-4569-a295-1dbaa3664dcb req-2cc5f7fd-f0e3-450d-8ba7-27631c8674c1 service nova] Releasing lock "refresh_cache-3018e3a2-01e0-49d7-a960-51718709845a" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:29:29 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:29:29 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:29:29 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[116c4f86-777f-4642-882e-ca74421fcc3f]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:29:29 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-aeff962e-1d18-49b0-a58e-2557ffa9ff5f tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75226) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 17 01:29:29 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:29:29 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.041s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:29:29 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[13ea8bdf-15dd-4019-8eb6-50168559c961]: (4, ('1', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:29:29 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-aeff962e-1d18-49b0-a58e-2557ffa9ff5f tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75226) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 17 01:29:29 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-aeff962e-1d18-49b0-a58e-2557ffa9ff5f tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] SCSI volumes sde have been removed. {{(pid=75226) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 17 01:29:29 user nova-compute[75226]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_ec967b13', '/dev/disk/by-id/scsi-1SCST_BIOec967b13-fab60b3b269b01de', '/dev/disk/by-id/scsi-26661623630623362') {{(pid=85818) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 17 01:29:29 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae5889eb-405d-4c8b-ab2c-a799df0a4b63]: (4, None) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:29:29 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeff962e-1d18-49b0-a58e-2557ffa9ff5f tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c17ed19c-4452-4a79-b36a-07ddcd7d9404')] {{(pid=75226) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 17 01:29:29 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c17ed19c-4452-4a79-b36a-07ddcd7d9404 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:29:29 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-f55badd1-c75c-40c6-8e4d-234688a72bae tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json" returned: 0 in 0.211s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:29:29 user nova-compute[75226]: DEBUG nova.virt.disk.api [None req-f55badd1-c75c-40c6-8e4d-234688a72bae tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9e8b4b85-fe0c-4592-850e-e94ebab32d02/disk. size=1073741824 {{(pid=75226) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 17 01:29:29 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-f55badd1-c75c-40c6-8e4d-234688a72bae tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e8b4b85-fe0c-4592-850e-e94ebab32d02/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:29:29 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c17ed19c-4452-4a79-b36a-07ddcd7d9404 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:29:29 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3924898-b5d2-433d-af63-a288522b9ed3]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:29:29 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeff962e-1d18-49b0-a58e-2557ffa9ff5f tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:29:29 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c17ed19c-4452-4a79-b36a-07ddcd7d9404 -p 172.16.0.220:3260 --logout {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:29:29 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c17ed19c-4452-4a79-b36a-07ddcd7d9404 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:29:29 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c1b6098-57d1-42cf-a268-5532c9dd9269]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:c17ed19c-4452-4a79-b36a-07ddcd7d9404, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:c17ed19c-4452-4a79-b36a-07ddcd7d9404, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:29:29 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeff962e-1d18-49b0-a58e-2557ffa9ff5f tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:c17ed19c-4452-4a79-b36a-07ddcd7d9404, portal: 172.16.0.220,3260]
Nov 17 01:29:29 user nova-compute[75226]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:c17ed19c-4452-4a79-b36a-07ddcd7d9404, portal: 172.16.0.220,3260] successful.
Nov 17 01:29:29 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:29:29 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c17ed19c-4452-4a79-b36a-07ddcd7d9404 -p 172.16.0.220:3260 --op delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:29:30 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c17ed19c-4452-4a79-b36a-07ddcd7d9404 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:29:30 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[1426977d-827b-43a0-a885-87929e7ecfce]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:29:30 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeff962e-1d18-49b0-a58e-2557ffa9ff5f tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:29:30 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-aeff962e-1d18-49b0-a58e-2557ffa9ff5f tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.470s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:29:30 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeff962e-1d18-49b0-a58e-2557ffa9ff5f tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] <== disconnect_volume: return (472ms) None {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:29:30 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aeff962e-1d18-49b0-a58e-2557ffa9ff5f tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] [instance: 346967c5-6945-4cef-9eea-8415cb27c98f] Disconnected iSCSI Volume {{(pid=75226) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 17 01:29:30 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-aeff962e-1d18-49b0-a58e-2557ffa9ff5f tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] [instance: 346967c5-6945-4cef-9eea-8415cb27c98f] Deleting instance files /opt/stack/data/nova/instances/346967c5-6945-4cef-9eea-8415cb27c98f_del
Nov 17 01:29:30 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-aeff962e-1d18-49b0-a58e-2557ffa9ff5f tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] [instance: 346967c5-6945-4cef-9eea-8415cb27c98f] Deletion of /opt/stack/data/nova/instances/346967c5-6945-4cef-9eea-8415cb27c98f_del complete
Nov 17 01:29:30 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-f55badd1-c75c-40c6-8e4d-234688a72bae tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e8b4b85-fe0c-4592-850e-e94ebab32d02/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:29:30 user nova-compute[75226]: DEBUG nova.virt.disk.api [None req-f55badd1-c75c-40c6-8e4d-234688a72bae tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Cannot resize image /opt/stack/data/nova/instances/9e8b4b85-fe0c-4592-850e-e94ebab32d02/disk to a smaller size. {{(pid=75226) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 17 01:29:30 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-f55badd1-c75c-40c6-8e4d-234688a72bae tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] [instance: 9e8b4b85-fe0c-4592-850e-e94ebab32d02] Created local disks {{(pid=75226) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 17 01:29:30 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-f55badd1-c75c-40c6-8e4d-234688a72bae tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] [instance: 9e8b4b85-fe0c-4592-850e-e94ebab32d02] Ensure instance console log exists: /opt/stack/data/nova/instances/9e8b4b85-fe0c-4592-850e-e94ebab32d02/console.log {{(pid=75226) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 17 01:29:30 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-f55badd1-c75c-40c6-8e4d-234688a72bae tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:29:30 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-f55badd1-c75c-40c6-8e4d-234688a72bae tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:29:30 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-f55badd1-c75c-40c6-8e4d-234688a72bae tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:29:30 user nova-compute[75226]: INFO nova.compute.manager [None req-aeff962e-1d18-49b0-a58e-2557ffa9ff5f tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] [instance: 346967c5-6945-4cef-9eea-8415cb27c98f] Took 1.42 seconds to destroy the instance on the hypervisor.
Nov 17 01:29:30 user nova-compute[75226]: DEBUG oslo.service.loopingcall [None req-aeff962e-1d18-49b0-a58e-2557ffa9ff5f tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75226) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 17 01:29:30 user nova-compute[75226]: DEBUG nova.compute.manager [-] [instance: 346967c5-6945-4cef-9eea-8415cb27c98f] Deallocating network for instance {{(pid=75226) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 17 01:29:30 user nova-compute[75226]: DEBUG nova.network.neutron [-] [instance: 346967c5-6945-4cef-9eea-8415cb27c98f] deallocate_for_instance() {{(pid=75226) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 17 01:29:30 user nova-compute[75226]: DEBUG nova.network.neutron [None req-f55badd1-c75c-40c6-8e4d-234688a72bae tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] [instance: 9e8b4b85-fe0c-4592-850e-e94ebab32d02] Successfully created port: 5e4b278c-6c95-4fd1-a215-3fa737694996 {{(pid=75226) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 17 01:29:30 user nova-compute[75226]: DEBUG nova.network.neutron [-] [instance: 346967c5-6945-4cef-9eea-8415cb27c98f] Updating instance_info_cache with network_info: [] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:29:30 user nova-compute[75226]: INFO nova.compute.manager [-] [instance: 346967c5-6945-4cef-9eea-8415cb27c98f] Took 0.67 seconds to deallocate network for instance.
Nov 17 01:29:30 user nova-compute[75226]: DEBUG nova.compute.manager [req-0513556c-193d-4a23-8d6c-1c64ae2572a3 req-a63adea2-92b2-4b6f-8622-136666f2f8b1 service nova] [instance: 346967c5-6945-4cef-9eea-8415cb27c98f] Received event network-vif-deleted-aa5b3af3-4cac-4a2f-93b8-3b6d378a3486 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:29:31 user nova-compute[75226]: DEBUG nova.compute.manager [req-831120a0-5ec3-46f5-b7e0-604447712112 req-90ec068b-775b-4c54-aa53-558e4a42b516 service nova] [instance: 346967c5-6945-4cef-9eea-8415cb27c98f] Received event network-vif-plugged-aa5b3af3-4cac-4a2f-93b8-3b6d378a3486 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:29:31 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-831120a0-5ec3-46f5-b7e0-604447712112 req-90ec068b-775b-4c54-aa53-558e4a42b516 service nova] Acquiring lock "346967c5-6945-4cef-9eea-8415cb27c98f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:29:31 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-831120a0-5ec3-46f5-b7e0-604447712112 req-90ec068b-775b-4c54-aa53-558e4a42b516 service nova] Lock "346967c5-6945-4cef-9eea-8415cb27c98f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:29:31 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-831120a0-5ec3-46f5-b7e0-604447712112 req-90ec068b-775b-4c54-aa53-558e4a42b516 service nova] Lock "346967c5-6945-4cef-9eea-8415cb27c98f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:29:31 user nova-compute[75226]: DEBUG nova.compute.manager [req-831120a0-5ec3-46f5-b7e0-604447712112 req-90ec068b-775b-4c54-aa53-558e4a42b516 service nova] [instance: 346967c5-6945-4cef-9eea-8415cb27c98f] No waiting events found dispatching network-vif-plugged-aa5b3af3-4cac-4a2f-93b8-3b6d378a3486 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:29:31 user nova-compute[75226]: WARNING nova.compute.manager [req-831120a0-5ec3-46f5-b7e0-604447712112 req-90ec068b-775b-4c54-aa53-558e4a42b516 service nova] [instance: 346967c5-6945-4cef-9eea-8415cb27c98f] Received unexpected event network-vif-plugged-aa5b3af3-4cac-4a2f-93b8-3b6d378a3486 for instance with vm_state active and task_state deleting.
Nov 17 01:29:31 user nova-compute[75226]: DEBUG nova.network.neutron [None req-f55badd1-c75c-40c6-8e4d-234688a72bae tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] [instance: 9e8b4b85-fe0c-4592-850e-e94ebab32d02] Successfully updated port: 5e4b278c-6c95-4fd1-a215-3fa737694996 {{(pid=75226) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 17 01:29:31 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-f55badd1-c75c-40c6-8e4d-234688a72bae tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Acquiring lock "refresh_cache-9e8b4b85-fe0c-4592-850e-e94ebab32d02" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:29:31 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-f55badd1-c75c-40c6-8e4d-234688a72bae tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Acquired lock "refresh_cache-9e8b4b85-fe0c-4592-850e-e94ebab32d02" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:29:31 user nova-compute[75226]: DEBUG nova.network.neutron [None req-f55badd1-c75c-40c6-8e4d-234688a72bae tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] [instance: 9e8b4b85-fe0c-4592-850e-e94ebab32d02] Building network info cache for instance {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 01:29:31 user nova-compute[75226]: DEBUG nova.network.neutron [None req-f55badd1-c75c-40c6-8e4d-234688a72bae tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] [instance: 9e8b4b85-fe0c-4592-850e-e94ebab32d02] Instance cache missing network info. {{(pid=75226) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 17 01:29:31 user nova-compute[75226]: INFO nova.compute.manager [None req-aeff962e-1d18-49b0-a58e-2557ffa9ff5f tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] [instance: 346967c5-6945-4cef-9eea-8415cb27c98f] Took 0.73 seconds to detach 1 volumes for instance.
Nov 17 01:29:31 user nova-compute[75226]: DEBUG nova.compute.manager [None req-aeff962e-1d18-49b0-a58e-2557ffa9ff5f tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] [instance: 346967c5-6945-4cef-9eea-8415cb27c98f] Deleting volume: c17ed19c-4452-4a79-b36a-07ddcd7d9404 {{(pid=75226) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 17 01:29:31 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-aeff962e-1d18-49b0-a58e-2557ffa9ff5f tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:29:31 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-aeff962e-1d18-49b0-a58e-2557ffa9ff5f tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:29:31 user nova-compute[75226]: DEBUG nova.network.neutron [None req-f55badd1-c75c-40c6-8e4d-234688a72bae tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] [instance: 9e8b4b85-fe0c-4592-850e-e94ebab32d02] Updating instance_info_cache with network_info: [{"id": "5e4b278c-6c95-4fd1-a215-3fa737694996", "address": "fa:16:3e:b6:d6:ba", "network": {"id": "72724945-89ae-47c2-ac58-ea393837ada6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-308563626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fcdc65b510141e9b7c9a01401a97448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e4b278c-6c", "ovs_interfaceid": "5e4b278c-6c95-4fd1-a215-3fa737694996", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:29:31 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-f55badd1-c75c-40c6-8e4d-234688a72bae tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Releasing lock "refresh_cache-9e8b4b85-fe0c-4592-850e-e94ebab32d02" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:29:31 user nova-compute[75226]: DEBUG nova.compute.manager [None req-f55badd1-c75c-40c6-8e4d-234688a72bae tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] [instance: 9e8b4b85-fe0c-4592-850e-e94ebab32d02] Instance network_info: |[{"id": "5e4b278c-6c95-4fd1-a215-3fa737694996", "address": "fa:16:3e:b6:d6:ba", "network": {"id": "72724945-89ae-47c2-ac58-ea393837ada6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-308563626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fcdc65b510141e9b7c9a01401a97448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e4b278c-6c", "ovs_interfaceid": "5e4b278c-6c95-4fd1-a215-3fa737694996", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75226) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 17 01:29:31 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-f55badd1-c75c-40c6-8e4d-234688a72bae tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] [instance: 9e8b4b85-fe0c-4592-850e-e94ebab32d02] Start _get_guest_xml network_info=[{"id": "5e4b278c-6c95-4fd1-a215-3fa737694996", "address": "fa:16:3e:b6:d6:ba", "network": {"id": "72724945-89ae-47c2-ac58-ea393837ada6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-308563626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fcdc65b510141e9b7c9a01401a97448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e4b278c-6c", "ovs_interfaceid": "5e4b278c-6c95-4fd1-a215-3fa737694996", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T01:13:22Z,direct_url=<?>,disk_format='qcow2',id=0b369aea-6f3f-4690-9f01-229b90ab6310,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4e110cbf9a84362a6864a7732c435a1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T01:13:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '0b369aea-6f3f-4690-9f01-229b90ab6310'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75226) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 17 01:29:31 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-f55badd1-c75c-40c6-8e4d-234688a72bae tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:29:31 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-f55badd1-c75c-40c6-8e4d-234688a72bae tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:29:31 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-f55badd1-c75c-40c6-8e4d-234688a72bae tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75226) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 17 01:29:31 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-f55badd1-c75c-40c6-8e4d-234688a72bae tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] CPU controller missing on host. {{(pid=75226) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 17 01:29:31 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-f55badd1-c75c-40c6-8e4d-234688a72bae tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75226) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 17 01:29:31 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-f55badd1-c75c-40c6-8e4d-234688a72bae tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] CPU controller found on host. {{(pid=75226) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 17 01:29:31 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-f55badd1-c75c-40c6-8e4d-234688a72bae tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75226) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 17 01:29:31 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-f55badd1-c75c-40c6-8e4d-234688a72bae tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-17T01:13:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T01:13:22Z,direct_url=<?>,disk_format='qcow2',id=0b369aea-6f3f-4690-9f01-229b90ab6310,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4e110cbf9a84362a6864a7732c435a1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T01:13:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 17 01:29:31 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-f55badd1-c75c-40c6-8e4d-234688a72bae tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Flavor limits 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 17 01:29:31 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-f55badd1-c75c-40c6-8e4d-234688a72bae tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Image limits 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 17 01:29:31 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-f55badd1-c75c-40c6-8e4d-234688a72bae tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Flavor pref 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 17 01:29:31 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-f55badd1-c75c-40c6-8e4d-234688a72bae tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Image pref 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 17 01:29:31 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-f55badd1-c75c-40c6-8e4d-234688a72bae tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 17 01:29:31 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-f55badd1-c75c-40c6-8e4d-234688a72bae tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 17 01:29:31 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-f55badd1-c75c-40c6-8e4d-234688a72bae tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75226) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 17 01:29:31 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-f55badd1-c75c-40c6-8e4d-234688a72bae tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Got 1 possible topologies {{(pid=75226) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 17 01:29:31 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-f55badd1-c75c-40c6-8e4d-234688a72bae tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 17 01:29:31 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-f55badd1-c75c-40c6-8e4d-234688a72bae tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 17 01:29:31 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-f55badd1-c75c-40c6-8e4d-234688a72bae tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:29:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1781762170',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1781762170',id=30,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBInpuqctZcqeDjLntMDMraUaJnVrPY8pPnhF46vZo3b7GDKJsBT1VrkDCJZFNBJMLuoREZPGY4+/LAEQRLwrF9f1fdd8Jnq+YiZ8Dyk1mvtijZcX6ZVdxHElsfADTqm07w==',key_name='tempest-keypair-1121562331',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1fcdc65b510141e9b7c9a01401a97448',ramdisk_id='',reservation_id='r-b0wngs1h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1321076871',owner_user_name='tempest-AttachVolumeShelveTestJSON-1321076871-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T01:29:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2adb9c6cd5c443a7993f6f9d09da6346',uuid=9e8b4b85-fe0c-4592-850e-e94ebab32d02,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5e4b278c-6c95-4fd1-a215-3fa737694996", "address": "fa:16:3e:b6:d6:ba", "network": {"id": "72724945-89ae-47c2-ac58-ea393837ada6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-308563626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fcdc65b510141e9b7c9a01401a97448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e4b278c-6c", "ovs_interfaceid": "5e4b278c-6c95-4fd1-a215-3fa737694996", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75226) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 01:29:31 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-f55badd1-c75c-40c6-8e4d-234688a72bae tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Converting VIF {"id": "5e4b278c-6c95-4fd1-a215-3fa737694996", "address": "fa:16:3e:b6:d6:ba", "network": {"id": "72724945-89ae-47c2-ac58-ea393837ada6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-308563626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fcdc65b510141e9b7c9a01401a97448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e4b278c-6c", "ovs_interfaceid": "5e4b278c-6c95-4fd1-a215-3fa737694996", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:29:31 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-f55badd1-c75c-40c6-8e4d-234688a72bae tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:d6:ba,bridge_name='br-int',has_traffic_filtering=True,id=5e4b278c-6c95-4fd1-a215-3fa737694996,network=Network(72724945-89ae-47c2-ac58-ea393837ada6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e4b278c-6c') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:29:31 user nova-compute[75226]: DEBUG nova.objects.instance [None req-f55badd1-c75c-40c6-8e4d-234688a72bae tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Lazy-loading 'pci_devices' on Instance uuid 9e8b4b85-fe0c-4592-850e-e94ebab32d02 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:29:31 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-f55badd1-c75c-40c6-8e4d-234688a72bae tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] [instance: 9e8b4b85-fe0c-4592-850e-e94ebab32d02] End _get_guest_xml xml=<domain type="kvm">
Nov 17 01:29:31 user nova-compute[75226]:   <uuid>9e8b4b85-fe0c-4592-850e-e94ebab32d02</uuid>
Nov 17 01:29:31 user nova-compute[75226]:   <name>instance-0000001e</name>
Nov 17 01:29:31 user nova-compute[75226]:   <memory>524288</memory>
Nov 17 01:29:31 user nova-compute[75226]:   <vcpu>1</vcpu>
Nov 17 01:29:31 user nova-compute[75226]:   <metadata>
Nov 17 01:29:31 user nova-compute[75226]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 17 01:29:31 user nova-compute[75226]:       <nova:package version="0.0.0"/>
Nov 17 01:29:31 user nova-compute[75226]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1781762170</nova:name>
Nov 17 01:29:31 user nova-compute[75226]:       <nova:creationTime>2023-11-17 01:29:31</nova:creationTime>
Nov 17 01:29:31 user nova-compute[75226]:       <nova:flavor name="m1.tiny">
Nov 17 01:29:31 user nova-compute[75226]:         <nova:memory>512</nova:memory>
Nov 17 01:29:31 user nova-compute[75226]:         <nova:disk>1</nova:disk>
Nov 17 01:29:31 user nova-compute[75226]:         <nova:swap>0</nova:swap>
Nov 17 01:29:31 user nova-compute[75226]:         <nova:ephemeral>0</nova:ephemeral>
Nov 17 01:29:31 user nova-compute[75226]:         <nova:vcpus>1</nova:vcpus>
Nov 17 01:29:31 user nova-compute[75226]:       </nova:flavor>
Nov 17 01:29:31 user nova-compute[75226]:       <nova:owner>
Nov 17 01:29:31 user nova-compute[75226]:         <nova:user uuid="2adb9c6cd5c443a7993f6f9d09da6346">tempest-AttachVolumeShelveTestJSON-1321076871-project-member</nova:user>
Nov 17 01:29:31 user nova-compute[75226]:         <nova:project uuid="1fcdc65b510141e9b7c9a01401a97448">tempest-AttachVolumeShelveTestJSON-1321076871</nova:project>
Nov 17 01:29:31 user nova-compute[75226]:       </nova:owner>
Nov 17 01:29:31 user nova-compute[75226]:       <nova:root type="image" uuid="0b369aea-6f3f-4690-9f01-229b90ab6310"/>
Nov 17 01:29:31 user nova-compute[75226]:       <nova:ports>
Nov 17 01:29:31 user nova-compute[75226]:         <nova:port uuid="5e4b278c-6c95-4fd1-a215-3fa737694996">
Nov 17 01:29:31 user nova-compute[75226]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 17 01:29:31 user nova-compute[75226]:         </nova:port>
Nov 17 01:29:31 user nova-compute[75226]:       </nova:ports>
Nov 17 01:29:31 user nova-compute[75226]:     </nova:instance>
Nov 17 01:29:31 user nova-compute[75226]:   </metadata>
Nov 17 01:29:31 user nova-compute[75226]:   <sysinfo type="smbios">
Nov 17 01:29:31 user nova-compute[75226]:     <system>
Nov 17 01:29:31 user nova-compute[75226]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 17 01:29:31 user nova-compute[75226]:       <entry name="product">OpenStack Nova</entry>
Nov 17 01:29:31 user nova-compute[75226]:       <entry name="version">0.0.0</entry>
Nov 17 01:29:31 user nova-compute[75226]:       <entry name="serial">9e8b4b85-fe0c-4592-850e-e94ebab32d02</entry>
Nov 17 01:29:31 user nova-compute[75226]:       <entry name="uuid">9e8b4b85-fe0c-4592-850e-e94ebab32d02</entry>
Nov 17 01:29:31 user nova-compute[75226]:       <entry name="family">Virtual Machine</entry>
Nov 17 01:29:31 user nova-compute[75226]:     </system>
Nov 17 01:29:31 user nova-compute[75226]:   </sysinfo>
Nov 17 01:29:31 user nova-compute[75226]:   <os>
Nov 17 01:29:31 user nova-compute[75226]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 17 01:29:31 user nova-compute[75226]:     <boot dev="hd"/>
Nov 17 01:29:31 user nova-compute[75226]:     <smbios mode="sysinfo"/>
Nov 17 01:29:31 user nova-compute[75226]:   </os>
Nov 17 01:29:31 user nova-compute[75226]:   <features>
Nov 17 01:29:31 user nova-compute[75226]:     <acpi/>
Nov 17 01:29:31 user nova-compute[75226]:     <apic/>
Nov 17 01:29:31 user nova-compute[75226]:     <vmcoreinfo/>
Nov 17 01:29:31 user nova-compute[75226]:   </features>
Nov 17 01:29:31 user nova-compute[75226]:   <clock offset="utc">
Nov 17 01:29:31 user nova-compute[75226]:     <timer name="pit" tickpolicy="delay"/>
Nov 17 01:29:31 user nova-compute[75226]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 17 01:29:31 user nova-compute[75226]:     <timer name="hpet" present="no"/>
Nov 17 01:29:31 user nova-compute[75226]:   </clock>
Nov 17 01:29:31 user nova-compute[75226]:   <cpu mode="custom" match="exact">
Nov 17 01:29:31 user nova-compute[75226]:     <model>Nehalem</model>
Nov 17 01:29:31 user nova-compute[75226]:     <topology sockets="1" cores="1" threads="1"/>
Nov 17 01:29:31 user nova-compute[75226]:   </cpu>
Nov 17 01:29:31 user nova-compute[75226]:   <devices>
Nov 17 01:29:31 user nova-compute[75226]:     <disk type="file" device="disk">
Nov 17 01:29:31 user nova-compute[75226]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 17 01:29:31 user nova-compute[75226]:       <source file="/opt/stack/data/nova/instances/9e8b4b85-fe0c-4592-850e-e94ebab32d02/disk"/>
Nov 17 01:29:31 user nova-compute[75226]:       <target dev="vda" bus="virtio"/>
Nov 17 01:29:31 user nova-compute[75226]:     </disk>
Nov 17 01:29:31 user nova-compute[75226]:     <interface type="ethernet">
Nov 17 01:29:31 user nova-compute[75226]:       <mac address="fa:16:3e:b6:d6:ba"/>
Nov 17 01:29:31 user nova-compute[75226]:       <model type="virtio"/>
Nov 17 01:29:31 user nova-compute[75226]:       <mtu size="1442"/>
Nov 17 01:29:31 user nova-compute[75226]:       <target dev="tap5e4b278c-6c"/>
Nov 17 01:29:31 user nova-compute[75226]:     </interface>
Nov 17 01:29:31 user nova-compute[75226]:     <serial type="pty">
Nov 17 01:29:31 user nova-compute[75226]:       <log file="/opt/stack/data/nova/instances/9e8b4b85-fe0c-4592-850e-e94ebab32d02/console.log" append="off"/>
Nov 17 01:29:31 user nova-compute[75226]:     </serial>
Nov 17 01:29:31 user nova-compute[75226]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 17 01:29:31 user nova-compute[75226]:     <video>
Nov 17 01:29:31 user nova-compute[75226]:       <model type="virtio"/>
Nov 17 01:29:31 user nova-compute[75226]:     </video>
Nov 17 01:29:31 user nova-compute[75226]:     <rng model="virtio">
Nov 17 01:29:31 user nova-compute[75226]:       <backend model="random">/dev/urandom</backend>
Nov 17 01:29:31 user nova-compute[75226]:     </rng>
Nov 17 01:29:31 user nova-compute[75226]:     <controller type="usb" index="0" model="none"/>
Nov 17 01:29:31 user nova-compute[75226]:     <memballoon model="virtio">
Nov 17 01:29:31 user nova-compute[75226]:       <stats period="10"/>
Nov 17 01:29:31 user nova-compute[75226]:     </memballoon>
Nov 17 01:29:31 user nova-compute[75226]:   </devices>
Nov 17 01:29:31 user nova-compute[75226]: </domain>
Nov 17 01:29:31 user nova-compute[75226]:  {{(pid=75226) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 17 01:29:31 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-f55badd1-c75c-40c6-8e4d-234688a72bae tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:29:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1781762170',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1781762170',id=30,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBInpuqctZcqeDjLntMDMraUaJnVrPY8pPnhF46vZo3b7GDKJsBT1VrkDCJZFNBJMLuoREZPGY4+/LAEQRLwrF9f1fdd8Jnq+YiZ8Dyk1mvtijZcX6ZVdxHElsfADTqm07w==',key_name='tempest-keypair-1121562331',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1fcdc65b510141e9b7c9a01401a97448',ramdisk_id='',reservation_id='r-b0wngs1h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1321076871',owner_user_name='tempest-AttachVolumeShelveTestJSON-1321076871-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T01:29:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2adb9c6cd5c443a7993f6f9d09da6346',uuid=9e8b4b85-fe0c-4592-850e-e94ebab32d02,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5e4b278c-6c95-4fd1-a215-3fa737694996", "address": "fa:16:3e:b6:d6:ba", "network": {"id": "72724945-89ae-47c2-ac58-ea393837ada6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-308563626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fcdc65b510141e9b7c9a01401a97448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e4b278c-6c", "ovs_interfaceid": "5e4b278c-6c95-4fd1-a215-3fa737694996", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 17 01:29:31 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-f55badd1-c75c-40c6-8e4d-234688a72bae tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Converting VIF {"id": "5e4b278c-6c95-4fd1-a215-3fa737694996", "address": "fa:16:3e:b6:d6:ba", "network": {"id": "72724945-89ae-47c2-ac58-ea393837ada6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-308563626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fcdc65b510141e9b7c9a01401a97448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e4b278c-6c", "ovs_interfaceid": "5e4b278c-6c95-4fd1-a215-3fa737694996", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:29:31 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-f55badd1-c75c-40c6-8e4d-234688a72bae tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:d6:ba,bridge_name='br-int',has_traffic_filtering=True,id=5e4b278c-6c95-4fd1-a215-3fa737694996,network=Network(72724945-89ae-47c2-ac58-ea393837ada6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e4b278c-6c') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:29:31 user nova-compute[75226]: DEBUG os_vif [None req-f55badd1-c75c-40c6-8e4d-234688a72bae tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:d6:ba,bridge_name='br-int',has_traffic_filtering=True,id=5e4b278c-6c95-4fd1-a215-3fa737694996,network=Network(72724945-89ae-47c2-ac58-ea393837ada6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e4b278c-6c') {{(pid=75226) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 17 01:29:31 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:29:31 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:29:31 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 17 01:29:31 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:29:31 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '544f83fc-4eee-5ed8-829e-6e46c329ce98', '_type': 'linux-noop'}}, row=False) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:29:31 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:29:31 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:29:31 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:29:31 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5e4b278c-6c, may_exist=True, interface_attrs={}) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:29:31 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5e4b278c-6c, col_values=(('qos', UUID('99a7e699-ab73-430b-9b05-472cfce90ecc')),), if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:29:31 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5e4b278c-6c, col_values=(('external_ids', {'iface-id': '5e4b278c-6c95-4fd1-a215-3fa737694996', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b6:d6:ba', 'vm-uuid': '9e8b4b85-fe0c-4592-850e-e94ebab32d02'}),), if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:29:31 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:29:31 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:29:31 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:29:31 user nova-compute[75226]: INFO os_vif [None req-f55badd1-c75c-40c6-8e4d-234688a72bae tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:d6:ba,bridge_name='br-int',has_traffic_filtering=True,id=5e4b278c-6c95-4fd1-a215-3fa737694996,network=Network(72724945-89ae-47c2-ac58-ea393837ada6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e4b278c-6c')
Nov 17 01:29:31 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-f55badd1-c75c-40c6-8e4d-234688a72bae tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] No BDM found with device name vda, not building metadata. {{(pid=75226) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 01:29:31 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-f55badd1-c75c-40c6-8e4d-234688a72bae tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] No VIF found with MAC fa:16:3e:b6:d6:ba, not building metadata {{(pid=75226) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 01:29:32 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-aeff962e-1d18-49b0-a58e-2557ffa9ff5f tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:29:32 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-aeff962e-1d18-49b0-a58e-2557ffa9ff5f tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:29:32 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-aeff962e-1d18-49b0-a58e-2557ffa9ff5f tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.478s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:29:32 user nova-compute[75226]: INFO nova.scheduler.client.report [None req-aeff962e-1d18-49b0-a58e-2557ffa9ff5f tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Deleted allocations for instance 346967c5-6945-4cef-9eea-8415cb27c98f
Nov 17 01:29:32 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-aeff962e-1d18-49b0-a58e-2557ffa9ff5f tempest-TestShelveInstance-1381460949 tempest-TestShelveInstance-1381460949-project-member] Lock "346967c5-6945-4cef-9eea-8415cb27c98f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.545s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:29:32 user nova-compute[75226]: DEBUG os_brick.utils [None req-8050bed9-27cb-44d4-b353-24fa434c4622 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:29:32 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:29:32 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:29:32 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[c216b850-63f8-494c-9563-b0fa9be2fb7b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f62857db69\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:29:32 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:29:32 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:29:32 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[b439de11-f401-496c-bf89-455240079375]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:29:32 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:29:32 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:29:32 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac61dd3e-c7d9-423b-b789-117a87d2b95f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:29:32 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1fe23d8-d53f-42c7-9027-02377289c6fa]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:29:32 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-8050bed9-27cb-44d4-b353-24fa434c4622 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Running cmd (subprocess): nvme version {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:29:32 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-8050bed9-27cb-44d4-b353-24fa434c4622 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] 'nvme version' failed. Not Retrying. {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 01:29:32 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8050bed9-27cb-44d4-b353-24fa434c4622 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] nvme not present on system {{(pid=75226) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 17 01:29:32 user nova-compute[75226]: DEBUG nova.compute.manager [req-a8b2c3dd-e2ee-45c6-aeaa-a1971cbe6c38 req-982483df-80d4-43ea-942b-463d41d2fe21 service nova] [instance: 9e8b4b85-fe0c-4592-850e-e94ebab32d02] Received event network-changed-5e4b278c-6c95-4fd1-a215-3fa737694996 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:29:32 user nova-compute[75226]: DEBUG nova.compute.manager [req-a8b2c3dd-e2ee-45c6-aeaa-a1971cbe6c38 req-982483df-80d4-43ea-942b-463d41d2fe21 service nova] [instance: 9e8b4b85-fe0c-4592-850e-e94ebab32d02] Refreshing instance network info cache due to event network-changed-5e4b278c-6c95-4fd1-a215-3fa737694996. {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 01:29:32 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-a8b2c3dd-e2ee-45c6-aeaa-a1971cbe6c38 req-982483df-80d4-43ea-942b-463d41d2fe21 service nova] Acquiring lock "refresh_cache-9e8b4b85-fe0c-4592-850e-e94ebab32d02" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:29:32 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-a8b2c3dd-e2ee-45c6-aeaa-a1971cbe6c38 req-982483df-80d4-43ea-942b-463d41d2fe21 service nova] Acquired lock "refresh_cache-9e8b4b85-fe0c-4592-850e-e94ebab32d02" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:29:32 user nova-compute[75226]: DEBUG nova.network.neutron [req-a8b2c3dd-e2ee-45c6-aeaa-a1971cbe6c38 req-982483df-80d4-43ea-942b-463d41d2fe21 service nova] [instance: 9e8b4b85-fe0c-4592-850e-e94ebab32d02] Refreshing network info cache for port 5e4b278c-6c95-4fd1-a215-3fa737694996 {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 01:29:32 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:29:32 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 01:29:32 user nova-compute[75226]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 17 01:29:32 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[230f4165-a728-41e3-acfb-f4bf320ead30]: (4, '') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:29:32 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-8050bed9-27cb-44d4-b353-24fa434c4622 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75226) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 17 01:29:32 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-8050bed9-27cb-44d4-b353-24fa434c4622 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75226) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 17 01:29:32 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-8050bed9-27cb-44d4-b353-24fa434c4622 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] LIGHTOS: no hostnqn found. {{(pid=75226) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 17 01:29:32 user nova-compute[75226]: DEBUG os_brick.utils [None req-8050bed9-27cb-44d4-b353-24fa434c4622 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f62857db69', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:29:32 user nova-compute[75226]: DEBUG nova.virt.block_device [None req-8050bed9-27cb-44d4-b353-24fa434c4622 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 3018e3a2-01e0-49d7-a960-51718709845a] Updating existing volume attachment record: 62fd720b-c932-42c3-85b7-47716bb27ba3 {{(pid=75226) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 17 01:29:32 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:29:33 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:29:33 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:29:33 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:29:33 user nova-compute[75226]: DEBUG nova.network.neutron [req-a8b2c3dd-e2ee-45c6-aeaa-a1971cbe6c38 req-982483df-80d4-43ea-942b-463d41d2fe21 service nova] [instance: 9e8b4b85-fe0c-4592-850e-e94ebab32d02] Updated VIF entry in instance network info cache for port 5e4b278c-6c95-4fd1-a215-3fa737694996. {{(pid=75226) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 01:29:33 user nova-compute[75226]: DEBUG nova.network.neutron [req-a8b2c3dd-e2ee-45c6-aeaa-a1971cbe6c38 req-982483df-80d4-43ea-942b-463d41d2fe21 service nova] [instance: 9e8b4b85-fe0c-4592-850e-e94ebab32d02] Updating instance_info_cache with network_info: [{"id": "5e4b278c-6c95-4fd1-a215-3fa737694996", "address": "fa:16:3e:b6:d6:ba", "network": {"id": "72724945-89ae-47c2-ac58-ea393837ada6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-308563626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fcdc65b510141e9b7c9a01401a97448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e4b278c-6c", "ovs_interfaceid": "5e4b278c-6c95-4fd1-a215-3fa737694996", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:29:33 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-a8b2c3dd-e2ee-45c6-aeaa-a1971cbe6c38 req-982483df-80d4-43ea-942b-463d41d2fe21 service nova] Releasing lock "refresh_cache-9e8b4b85-fe0c-4592-850e-e94ebab32d02" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:29:33 user nova-compute[75226]: DEBUG nova.compute.manager [req-d2df5779-e81d-4bb5-99a5-29faed7ed96f req-0624c1dc-2019-43cd-841f-1b300c71a244 service nova] [instance: 9e8b4b85-fe0c-4592-850e-e94ebab32d02] Received event network-vif-plugged-5e4b278c-6c95-4fd1-a215-3fa737694996 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:29:33 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-d2df5779-e81d-4bb5-99a5-29faed7ed96f req-0624c1dc-2019-43cd-841f-1b300c71a244 service nova] Acquiring lock "9e8b4b85-fe0c-4592-850e-e94ebab32d02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:29:33 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-d2df5779-e81d-4bb5-99a5-29faed7ed96f req-0624c1dc-2019-43cd-841f-1b300c71a244 service nova] Lock "9e8b4b85-fe0c-4592-850e-e94ebab32d02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:29:33 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-d2df5779-e81d-4bb5-99a5-29faed7ed96f req-0624c1dc-2019-43cd-841f-1b300c71a244 service nova] Lock "9e8b4b85-fe0c-4592-850e-e94ebab32d02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:29:33 user nova-compute[75226]: DEBUG nova.compute.manager [req-d2df5779-e81d-4bb5-99a5-29faed7ed96f req-0624c1dc-2019-43cd-841f-1b300c71a244 service nova] [instance: 9e8b4b85-fe0c-4592-850e-e94ebab32d02] No waiting events found dispatching network-vif-plugged-5e4b278c-6c95-4fd1-a215-3fa737694996 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:29:33 user nova-compute[75226]: WARNING nova.compute.manager [req-d2df5779-e81d-4bb5-99a5-29faed7ed96f req-0624c1dc-2019-43cd-841f-1b300c71a244 service nova] [instance: 9e8b4b85-fe0c-4592-850e-e94ebab32d02] Received unexpected event network-vif-plugged-5e4b278c-6c95-4fd1-a215-3fa737694996 for instance with vm_state building and task_state spawning.
Nov 17 01:29:33 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:29:33 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:29:33 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:29:35 user nova-compute[75226]: DEBUG nova.compute.manager [req-e6495643-7408-4064-b1ba-0e25a591f5f8 req-ff4eea71-7fee-4645-8655-6a4523ca4ed2 service nova] [instance: 9e8b4b85-fe0c-4592-850e-e94ebab32d02] Received event network-vif-plugged-5e4b278c-6c95-4fd1-a215-3fa737694996 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:29:35 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-e6495643-7408-4064-b1ba-0e25a591f5f8 req-ff4eea71-7fee-4645-8655-6a4523ca4ed2 service nova] Acquiring lock "9e8b4b85-fe0c-4592-850e-e94ebab32d02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:29:35 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-e6495643-7408-4064-b1ba-0e25a591f5f8 req-ff4eea71-7fee-4645-8655-6a4523ca4ed2 service nova] Lock "9e8b4b85-fe0c-4592-850e-e94ebab32d02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:29:35 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-e6495643-7408-4064-b1ba-0e25a591f5f8 req-ff4eea71-7fee-4645-8655-6a4523ca4ed2 service nova] Lock "9e8b4b85-fe0c-4592-850e-e94ebab32d02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:29:35 user nova-compute[75226]: DEBUG nova.compute.manager [req-e6495643-7408-4064-b1ba-0e25a591f5f8 req-ff4eea71-7fee-4645-8655-6a4523ca4ed2 service nova] [instance: 9e8b4b85-fe0c-4592-850e-e94ebab32d02] No waiting events found dispatching network-vif-plugged-5e4b278c-6c95-4fd1-a215-3fa737694996 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:29:35 user nova-compute[75226]: WARNING nova.compute.manager [req-e6495643-7408-4064-b1ba-0e25a591f5f8 req-ff4eea71-7fee-4645-8655-6a4523ca4ed2 service nova] [instance: 9e8b4b85-fe0c-4592-850e-e94ebab32d02] Received unexpected event network-vif-plugged-5e4b278c-6c95-4fd1-a215-3fa737694996 for instance with vm_state building and task_state spawning.
Nov 17 01:29:35 user nova-compute[75226]: DEBUG nova.compute.manager [None req-f55badd1-c75c-40c6-8e4d-234688a72bae tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] [instance: 9e8b4b85-fe0c-4592-850e-e94ebab32d02] Instance event wait completed in 0 seconds for  {{(pid=75226) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 17 01:29:35 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-f55badd1-c75c-40c6-8e4d-234688a72bae tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] [instance: 9e8b4b85-fe0c-4592-850e-e94ebab32d02] Guest created on hypervisor {{(pid=75226) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 17 01:29:35 user nova-compute[75226]: INFO nova.virt.libvirt.driver [-] [instance: 9e8b4b85-fe0c-4592-850e-e94ebab32d02] Instance spawned successfully.
Nov 17 01:29:35 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-f55badd1-c75c-40c6-8e4d-234688a72bae tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] [instance: 9e8b4b85-fe0c-4592-850e-e94ebab32d02] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 17 01:29:35 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-f55badd1-c75c-40c6-8e4d-234688a72bae tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] [instance: 9e8b4b85-fe0c-4592-850e-e94ebab32d02] Found default for hw_cdrom_bus of ide {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:29:35 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-f55badd1-c75c-40c6-8e4d-234688a72bae tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] [instance: 9e8b4b85-fe0c-4592-850e-e94ebab32d02] Found default for hw_disk_bus of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:29:35 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-f55badd1-c75c-40c6-8e4d-234688a72bae tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] [instance: 9e8b4b85-fe0c-4592-850e-e94ebab32d02] Found default for hw_input_bus of None {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:29:35 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-f55badd1-c75c-40c6-8e4d-234688a72bae tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] [instance: 9e8b4b85-fe0c-4592-850e-e94ebab32d02] Found default for hw_pointer_model of None {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:29:35 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-f55badd1-c75c-40c6-8e4d-234688a72bae tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] [instance: 9e8b4b85-fe0c-4592-850e-e94ebab32d02] Found default for hw_video_model of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:29:35 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-f55badd1-c75c-40c6-8e4d-234688a72bae tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] [instance: 9e8b4b85-fe0c-4592-850e-e94ebab32d02] Found default for hw_vif_model of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:29:35 user nova-compute[75226]: INFO nova.compute.manager [None req-f55badd1-c75c-40c6-8e4d-234688a72bae tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] [instance: 9e8b4b85-fe0c-4592-850e-e94ebab32d02] Took 6.44 seconds to spawn the instance on the hypervisor.
Nov 17 01:29:35 user nova-compute[75226]: DEBUG nova.compute.manager [None req-f55badd1-c75c-40c6-8e4d-234688a72bae tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] [instance: 9e8b4b85-fe0c-4592-850e-e94ebab32d02] Checking state {{(pid=75226) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 01:29:35 user nova-compute[75226]: INFO nova.compute.manager [None req-f55badd1-c75c-40c6-8e4d-234688a72bae tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] [instance: 9e8b4b85-fe0c-4592-850e-e94ebab32d02] Took 7.54 seconds to build instance.
Nov 17 01:29:35 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-f55badd1-c75c-40c6-8e4d-234688a72bae tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Lock "9e8b4b85-fe0c-4592-850e-e94ebab32d02" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.687s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:29:36 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:29:37 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:29:38 user nova-compute[75226]: DEBUG nova.compute.manager [None req-8050bed9-27cb-44d4-b353-24fa434c4622 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 3018e3a2-01e0-49d7-a960-51718709845a] Start spawning the instance on the hypervisor. {{(pid=75226) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 17 01:29:38 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-8050bed9-27cb-44d4-b353-24fa434c4622 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 3018e3a2-01e0-49d7-a960-51718709845a] Creating instance directory {{(pid=75226) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 17 01:29:38 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-8050bed9-27cb-44d4-b353-24fa434c4622 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 3018e3a2-01e0-49d7-a960-51718709845a] Creating image(s)
Nov 17 01:29:38 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-8050bed9-27cb-44d4-b353-24fa434c4622 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 3018e3a2-01e0-49d7-a960-51718709845a] Did not create local disks {{(pid=75226) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 17 01:29:38 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-8050bed9-27cb-44d4-b353-24fa434c4622 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 3018e3a2-01e0-49d7-a960-51718709845a] Ensure instance console log exists: /opt/stack/data/nova/instances/3018e3a2-01e0-49d7-a960-51718709845a/console.log {{(pid=75226) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 17 01:29:38 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-8050bed9-27cb-44d4-b353-24fa434c4622 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:29:38 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-8050bed9-27cb-44d4-b353-24fa434c4622 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:29:38 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-8050bed9-27cb-44d4-b353-24fa434c4622 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:29:38 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-8050bed9-27cb-44d4-b353-24fa434c4622 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 3018e3a2-01e0-49d7-a960-51718709845a] Start _get_guest_xml network_info=[{"id": "f05fa2a1-b61b-4617-b895-8c75645bde94", "address": "fa:16:3e:0b:9b:f6", "network": {"id": "450540a3-ff7e-42fb-a0a6-808acd749943", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1503678778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6cb6f679ee4468d82cc7fb5d0f67be9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf05fa2a1-b6", "ovs_interfaceid": "f05fa2a1-b61b-4617-b895-8c75645bde94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T01:13:22Z,direct_url=<?>,disk_format='qcow2',id=0b369aea-6f3f-4690-9f01-229b90ab6310,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4e110cbf9a84362a6864a7732c435a1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T01:13:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:05f878e5-0241-4282-8b2c-c4651c429dcb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zIwQLnvm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3018e3a2-01e0-49d7-a960-51718709845a', 'attached_at': '', 'detached_at': '', 'volume_id': '05f878e5-0241-4282-8b2c-c4651c429dcb', 'serial': '05f878e5-0241-4282-8b2c-c4651c429dcb'}, 'attachment_id': '62fd720b-c932-42c3-85b7-47716bb27ba3', 'device_type': 'disk', 'volume_type': None} {{(pid=75226) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 17 01:29:38 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-8050bed9-27cb-44d4-b353-24fa434c4622 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:29:38 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-8050bed9-27cb-44d4-b353-24fa434c4622 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:29:38 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-8050bed9-27cb-44d4-b353-24fa434c4622 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75226) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 17 01:29:38 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-8050bed9-27cb-44d4-b353-24fa434c4622 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] CPU controller missing on host. {{(pid=75226) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 17 01:29:38 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-8050bed9-27cb-44d4-b353-24fa434c4622 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75226) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 17 01:29:38 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-8050bed9-27cb-44d4-b353-24fa434c4622 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] CPU controller found on host. {{(pid=75226) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 17 01:29:38 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-8050bed9-27cb-44d4-b353-24fa434c4622 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75226) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 17 01:29:38 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-8050bed9-27cb-44d4-b353-24fa434c4622 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-17T01:13:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T01:13:22Z,direct_url=<?>,disk_format='qcow2',id=0b369aea-6f3f-4690-9f01-229b90ab6310,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4e110cbf9a84362a6864a7732c435a1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T01:13:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 17 01:29:38 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-8050bed9-27cb-44d4-b353-24fa434c4622 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Flavor limits 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 17 01:29:38 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-8050bed9-27cb-44d4-b353-24fa434c4622 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Image limits 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 17 01:29:38 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-8050bed9-27cb-44d4-b353-24fa434c4622 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Flavor pref 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 17 01:29:38 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-8050bed9-27cb-44d4-b353-24fa434c4622 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Image pref 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 17 01:29:38 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-8050bed9-27cb-44d4-b353-24fa434c4622 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 17 01:29:38 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-8050bed9-27cb-44d4-b353-24fa434c4622 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 17 01:29:38 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-8050bed9-27cb-44d4-b353-24fa434c4622 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75226) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 17 01:29:38 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-8050bed9-27cb-44d4-b353-24fa434c4622 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Got 1 possible topologies {{(pid=75226) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 17 01:29:38 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-8050bed9-27cb-44d4-b353-24fa434c4622 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 17 01:29:38 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-8050bed9-27cb-44d4-b353-24fa434c4622 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 17 01:29:38 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8050bed9-27cb-44d4-b353-24fa434c4622 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 3018e3a2-01e0-49d7-a960-51718709845a] Calling os-brick to attach iSCSI Volume {{(pid=75226) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 17 01:29:38 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-8050bed9-27cb-44d4-b353-24fa434c4622 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc4cc36b490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:05f878e5-0241-4282-8b2c-c4651c429dcb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zIwQLnvm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:29:38 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-8050bed9-27cb-44d4-b353-24fa434c4622 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:29:38 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-8050bed9-27cb-44d4-b353-24fa434c4622 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:29:38 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-8050bed9-27cb-44d4-b353-24fa434c4622 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:29:38 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-8050bed9-27cb-44d4-b353-24fa434c4622 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:29:38 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-8050bed9-27cb-44d4-b353-24fa434c4622 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:05f878e5-0241-4282-8b2c-c4651c429dcb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:29:38 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-8050bed9-27cb-44d4-b353-24fa434c4622 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:05f878e5-0241-4282-8b2c-c4651c429dcb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:29:38 user nova-compute[75226]: INFO os_brick.initiator.connectors.iscsi [None req-8050bed9-27cb-44d4-b353-24fa434c4622 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 17 01:29:38 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05f878e5-0241-4282-8b2c-c4651c429dcb -p 172.16.0.220:3260 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:29:38 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05f878e5-0241-4282-8b2c-c4651c429dcb -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:29:38 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d80e731-89f5-4fd8-abf7-9d1dd7dded8e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:29:38 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-8050bed9-27cb-44d4-b353-24fa434c4622 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 17 01:29:38 user nova-compute[75226]:  {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:29:38 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05f878e5-0241-4282-8b2c-c4651c429dcb -p 172.16.0.220:3260 --interface default --op new {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:29:38 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05f878e5-0241-4282-8b2c-c4651c429dcb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:29:38 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9af775b-963b-445d-bb07-9e7ad158882a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:05f878e5-0241-4282-8b2c-c4651c429dcb] added\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:29:38 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-8050bed9-27cb-44d4-b353-24fa434c4622 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:05f878e5-0241-4282-8b2c-c4651c429dcb] added
Nov 17 01:29:38 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:29:38 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05f878e5-0241-4282-8b2c-c4651c429dcb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:29:39 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05f878e5-0241-4282-8b2c-c4651c429dcb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:29:39 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[9425ce01-4823-4ab5-8dfd-3041625106d5]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:29:39 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-8050bed9-27cb-44d4-b353-24fa434c4622 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:29:39 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05f878e5-0241-4282-8b2c-c4651c429dcb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:29:39 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05f878e5-0241-4282-8b2c-c4651c429dcb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:29:39 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bdc32bf-996f-43bd-8898-d025b62d00d6]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:29:39 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-8050bed9-27cb-44d4-b353-24fa434c4622 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:29:39 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05f878e5-0241-4282-8b2c-c4651c429dcb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zIwQLnvm {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:29:39 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05f878e5-0241-4282-8b2c-c4651c429dcb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zIwQLnvm" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:29:39 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[f182ad1e-78d8-4053-abfc-fd3e3a8f5c7c]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:29:39 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-8050bed9-27cb-44d4-b353-24fa434c4622 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zIwQLnvm'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:29:39 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05f878e5-0241-4282-8b2c-c4651c429dcb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:29:39 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05f878e5-0241-4282-8b2c-c4651c429dcb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:29:39 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f1764b2-aed7-448b-b31e-ff01bbd1b3e9]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:29:39 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-8050bed9-27cb-44d4-b353-24fa434c4622 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:29:39 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:29:39 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:29:39 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff3976f8-fab6-4391-b242-57a69465ee9d]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:29:39 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-8050bed9-27cb-44d4-b353-24fa434c4622 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)
Nov 17 01:29:39 user nova-compute[75226]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14 (non-flash)
Nov 17 01:29:39 user nova-compute[75226]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba (non-flash)
Nov 17 01:29:39 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:29:39 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-8050bed9-27cb-44d4-b353-24fa434c4622 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)
Nov 17 01:29:39 user nova-compute[75226]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14 (non-flash)
Nov 17 01:29:39 user nova-compute[75226]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba (non-flash)
Nov 17 01:29:39 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:29:39 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05f878e5-0241-4282-8b2c-c4651c429dcb -p 172.16.0.220:3260 --login {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:29:39 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05f878e5-0241-4282-8b2c-c4651c429dcb -p 172.16.0.220:3260 --login" returned: 0 in 0.087s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:29:39 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d495d1b-b175-466f-8297-e40b7e9624be]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:05f878e5-0241-4282-8b2c-c4651c429dcb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:05f878e5-0241-4282-8b2c-c4651c429dcb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:29:39 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-8050bed9-27cb-44d4-b353-24fa434c4622 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:05f878e5-0241-4282-8b2c-c4651c429dcb, portal: 172.16.0.220,3260]
Nov 17 01:29:39 user nova-compute[75226]: Login to [iface: default, target: iqn.2010-10.org.openstack:05f878e5-0241-4282-8b2c-c4651c429dcb, portal: 172.16.0.220,3260] successful.
Nov 17 01:29:39 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:29:39 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05f878e5-0241-4282-8b2c-c4651c429dcb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:29:39 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05f878e5-0241-4282-8b2c-c4651c429dcb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:29:39 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[acaba269-e28e-476b-92dc-2d72d4fd9035]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:29:39 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-8050bed9-27cb-44d4-b353-24fa434c4622 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:29:39 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:29:39 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:29:39 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef300aa8-1ff0-4086-9b28-bb816a74a9da]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05f878e5-0241-4282-8b2c-c4651c429dcb (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:29:39 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-8050bed9-27cb-44d4-b353-24fa434c4622 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)
Nov 17 01:29:39 user nova-compute[75226]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14 (non-flash)
Nov 17 01:29:39 user nova-compute[75226]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba (non-flash)
Nov 17 01:29:39 user nova-compute[75226]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05f878e5-0241-4282-8b2c-c4651c429dcb (non-flash)
Nov 17 01:29:39 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:29:39 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-8050bed9-27cb-44d4-b353-24fa434c4622 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)
Nov 17 01:29:39 user nova-compute[75226]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14 (non-flash)
Nov 17 01:29:39 user nova-compute[75226]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba (non-flash)
Nov 17 01:29:39 user nova-compute[75226]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05f878e5-0241-4282-8b2c-c4651c429dcb (non-flash)
Nov 17 01:29:39 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:29:39 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-8050bed9-27cb-44d4-b353-24fa434c4622 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:05f878e5-0241-4282-8b2c-c4651c429dcb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.319s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:29:39 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-8050bed9-27cb-44d4-b353-24fa434c4622 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Connected to 172.16.0.220:3260 {{(pid=75226) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 17 01:29:39 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-8050bed9-27cb-44d4-b353-24fa434c4622 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] HCTL ('36', '-', '-', 0) found on session 32 with lun 0 {{(pid=75226) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 17 01:29:39 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-8050bed9-27cb-44d4-b353-24fa434c4622 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75226) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 17 01:29:39 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:29:39 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:29:39 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[99204d84-016a-4f4b-831c-0bec39e6e0cb]: (4, ('- - 0', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:29:39 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-8050bed9-27cb-44d4-b353-24fa434c4622 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Searching for a device in session 32 and hctl ['36', '*', '*', 0] yield: None {{(pid=75226) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 01:29:40 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-8050bed9-27cb-44d4-b353-24fa434c4622 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Searching for a device in session 32 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75226) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 01:29:40 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-8050bed9-27cb-44d4-b353-24fa434c4622 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:05f878e5-0241-4282-8b2c-c4651c429dcb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zIwQLnvm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75226) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 17 01:29:40 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-8050bed9-27cb-44d4-b353-24fa434c4622 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.349s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:29:40 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-8050bed9-27cb-44d4-b353-24fa434c4622 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] <== connect_volume: return (1350ms) {'type': 'block', 'scsi_wwn': '23536623935346130', 'path': '/dev/sde'} {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:29:40 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8050bed9-27cb-44d4-b353-24fa434c4622 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 3018e3a2-01e0-49d7-a960-51718709845a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23536623935346130', 'path': '/dev/sde'} {{(pid=75226) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 17 01:29:40 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-8050bed9-27cb-44d4-b353-24fa434c4622 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:29:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-324711233',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-324711233',id=29,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e6cb6f679ee4468d82cc7fb5d0f67be9',ramdisk_id='',reservation_id='r-vgzgiogg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-76498640',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T01:29:27Z,user_data=None,user_id='1b793ce05bf44b939a9fb5a914a04cb0',uuid=3018e3a2-01e0-49d7-a960-51718709845a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f05fa2a1-b61b-4617-b895-8c75645bde94", "address": "fa:16:3e:0b:9b:f6", "network": {"id": "450540a3-ff7e-42fb-a0a6-808acd749943", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1503678778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6cb6f679ee4468d82cc7fb5d0f67be9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf05fa2a1-b6", "ovs_interfaceid": "f05fa2a1-b61b-4617-b895-8c75645bde94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75226) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 01:29:40 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-8050bed9-27cb-44d4-b353-24fa434c4622 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Converting VIF {"id": "f05fa2a1-b61b-4617-b895-8c75645bde94", "address": "fa:16:3e:0b:9b:f6", "network": {"id": "450540a3-ff7e-42fb-a0a6-808acd749943", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1503678778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6cb6f679ee4468d82cc7fb5d0f67be9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf05fa2a1-b6", "ovs_interfaceid": "f05fa2a1-b61b-4617-b895-8c75645bde94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:29:40 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-8050bed9-27cb-44d4-b353-24fa434c4622 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:9b:f6,bridge_name='br-int',has_traffic_filtering=True,id=f05fa2a1-b61b-4617-b895-8c75645bde94,network=Network(450540a3-ff7e-42fb-a0a6-808acd749943),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf05fa2a1-b6') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:29:40 user nova-compute[75226]: DEBUG nova.objects.instance [None req-8050bed9-27cb-44d4-b353-24fa434c4622 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Lazy-loading 'pci_devices' on Instance uuid 3018e3a2-01e0-49d7-a960-51718709845a {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:29:40 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-8050bed9-27cb-44d4-b353-24fa434c4622 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 3018e3a2-01e0-49d7-a960-51718709845a] End _get_guest_xml xml=<domain type="kvm">
Nov 17 01:29:40 user nova-compute[75226]:   <uuid>3018e3a2-01e0-49d7-a960-51718709845a</uuid>
Nov 17 01:29:40 user nova-compute[75226]:   <name>instance-0000001d</name>
Nov 17 01:29:40 user nova-compute[75226]:   <memory>524288</memory>
Nov 17 01:29:40 user nova-compute[75226]:   <vcpu>1</vcpu>
Nov 17 01:29:40 user nova-compute[75226]:   <metadata>
Nov 17 01:29:40 user nova-compute[75226]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 17 01:29:40 user nova-compute[75226]:       <nova:package version="0.0.0"/>
Nov 17 01:29:40 user nova-compute[75226]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-324711233</nova:name>
Nov 17 01:29:40 user nova-compute[75226]:       <nova:creationTime>2023-11-17 01:29:38</nova:creationTime>
Nov 17 01:29:40 user nova-compute[75226]:       <nova:flavor name="m1.tiny">
Nov 17 01:29:40 user nova-compute[75226]:         <nova:memory>512</nova:memory>
Nov 17 01:29:40 user nova-compute[75226]:         <nova:disk>1</nova:disk>
Nov 17 01:29:40 user nova-compute[75226]:         <nova:swap>0</nova:swap>
Nov 17 01:29:40 user nova-compute[75226]:         <nova:ephemeral>0</nova:ephemeral>
Nov 17 01:29:40 user nova-compute[75226]:         <nova:vcpus>1</nova:vcpus>
Nov 17 01:29:40 user nova-compute[75226]:       </nova:flavor>
Nov 17 01:29:40 user nova-compute[75226]:       <nova:owner>
Nov 17 01:29:40 user nova-compute[75226]:         <nova:user uuid="1b793ce05bf44b939a9fb5a914a04cb0">tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member</nova:user>
Nov 17 01:29:40 user nova-compute[75226]:         <nova:project uuid="e6cb6f679ee4468d82cc7fb5d0f67be9">tempest-ServerBootFromVolumeStableRescueTest-76498640</nova:project>
Nov 17 01:29:40 user nova-compute[75226]:       </nova:owner>
Nov 17 01:29:40 user nova-compute[75226]:       <nova:root type="image" uuid="0b369aea-6f3f-4690-9f01-229b90ab6310"/>
Nov 17 01:29:40 user nova-compute[75226]:       <nova:ports>
Nov 17 01:29:40 user nova-compute[75226]:         <nova:port uuid="f05fa2a1-b61b-4617-b895-8c75645bde94">
Nov 17 01:29:40 user nova-compute[75226]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 17 01:29:40 user nova-compute[75226]:         </nova:port>
Nov 17 01:29:40 user nova-compute[75226]:       </nova:ports>
Nov 17 01:29:40 user nova-compute[75226]:     </nova:instance>
Nov 17 01:29:40 user nova-compute[75226]:   </metadata>
Nov 17 01:29:40 user nova-compute[75226]:   <sysinfo type="smbios">
Nov 17 01:29:40 user nova-compute[75226]:     <system>
Nov 17 01:29:40 user nova-compute[75226]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 17 01:29:40 user nova-compute[75226]:       <entry name="product">OpenStack Nova</entry>
Nov 17 01:29:40 user nova-compute[75226]:       <entry name="version">0.0.0</entry>
Nov 17 01:29:40 user nova-compute[75226]:       <entry name="serial">3018e3a2-01e0-49d7-a960-51718709845a</entry>
Nov 17 01:29:40 user nova-compute[75226]:       <entry name="uuid">3018e3a2-01e0-49d7-a960-51718709845a</entry>
Nov 17 01:29:40 user nova-compute[75226]:       <entry name="family">Virtual Machine</entry>
Nov 17 01:29:40 user nova-compute[75226]:     </system>
Nov 17 01:29:40 user nova-compute[75226]:   </sysinfo>
Nov 17 01:29:40 user nova-compute[75226]:   <os>
Nov 17 01:29:40 user nova-compute[75226]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 17 01:29:40 user nova-compute[75226]:     <boot dev="hd"/>
Nov 17 01:29:40 user nova-compute[75226]:     <smbios mode="sysinfo"/>
Nov 17 01:29:40 user nova-compute[75226]:   </os>
Nov 17 01:29:40 user nova-compute[75226]:   <features>
Nov 17 01:29:40 user nova-compute[75226]:     <acpi/>
Nov 17 01:29:40 user nova-compute[75226]:     <apic/>
Nov 17 01:29:40 user nova-compute[75226]:     <vmcoreinfo/>
Nov 17 01:29:40 user nova-compute[75226]:   </features>
Nov 17 01:29:40 user nova-compute[75226]:   <clock offset="utc">
Nov 17 01:29:40 user nova-compute[75226]:     <timer name="pit" tickpolicy="delay"/>
Nov 17 01:29:40 user nova-compute[75226]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 17 01:29:40 user nova-compute[75226]:     <timer name="hpet" present="no"/>
Nov 17 01:29:40 user nova-compute[75226]:   </clock>
Nov 17 01:29:40 user nova-compute[75226]:   <cpu mode="custom" match="exact">
Nov 17 01:29:40 user nova-compute[75226]:     <model>Nehalem</model>
Nov 17 01:29:40 user nova-compute[75226]:     <topology sockets="1" cores="1" threads="1"/>
Nov 17 01:29:40 user nova-compute[75226]:   </cpu>
Nov 17 01:29:40 user nova-compute[75226]:   <devices>
Nov 17 01:29:40 user nova-compute[75226]:     <disk type="block" device="disk">
Nov 17 01:29:40 user nova-compute[75226]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 01:29:40 user nova-compute[75226]:       <source dev="/dev/sde"/>
Nov 17 01:29:40 user nova-compute[75226]:       <target dev="vda" bus="virtio"/>
Nov 17 01:29:40 user nova-compute[75226]:       <serial>05f878e5-0241-4282-8b2c-c4651c429dcb</serial>
Nov 17 01:29:40 user nova-compute[75226]:     </disk>
Nov 17 01:29:40 user nova-compute[75226]:     <interface type="ethernet">
Nov 17 01:29:40 user nova-compute[75226]:       <mac address="fa:16:3e:0b:9b:f6"/>
Nov 17 01:29:40 user nova-compute[75226]:       <model type="virtio"/>
Nov 17 01:29:40 user nova-compute[75226]:       <mtu size="1442"/>
Nov 17 01:29:40 user nova-compute[75226]:       <target dev="tapf05fa2a1-b6"/>
Nov 17 01:29:40 user nova-compute[75226]:     </interface>
Nov 17 01:29:40 user nova-compute[75226]:     <serial type="pty">
Nov 17 01:29:40 user nova-compute[75226]:       <log file="/opt/stack/data/nova/instances/3018e3a2-01e0-49d7-a960-51718709845a/console.log" append="off"/>
Nov 17 01:29:40 user nova-compute[75226]:     </serial>
Nov 17 01:29:40 user nova-compute[75226]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 17 01:29:40 user nova-compute[75226]:     <video>
Nov 17 01:29:40 user nova-compute[75226]:       <model type="virtio"/>
Nov 17 01:29:40 user nova-compute[75226]:     </video>
Nov 17 01:29:40 user nova-compute[75226]:     <rng model="virtio">
Nov 17 01:29:40 user nova-compute[75226]:       <backend model="random">/dev/urandom</backend>
Nov 17 01:29:40 user nova-compute[75226]:     </rng>
Nov 17 01:29:40 user nova-compute[75226]:     <controller type="usb" index="0" model="none"/>
Nov 17 01:29:40 user nova-compute[75226]:     <memballoon model="virtio">
Nov 17 01:29:40 user nova-compute[75226]:       <stats period="10"/>
Nov 17 01:29:40 user nova-compute[75226]:     </memballoon>
Nov 17 01:29:40 user nova-compute[75226]:   </devices>
Nov 17 01:29:40 user nova-compute[75226]: </domain>
Nov 17 01:29:40 user nova-compute[75226]:  {{(pid=75226) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 17 01:29:40 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-8050bed9-27cb-44d4-b353-24fa434c4622 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:29:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-324711233',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-324711233',id=29,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e6cb6f679ee4468d82cc7fb5d0f67be9',ramdisk_id='',reservation_id='r-vgzgiogg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-76498640',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T01:29:27Z,user_data=None,user_id='1b793ce05bf44b939a9fb5a914a04cb0',uuid=3018e3a2-01e0-49d7-a960-51718709845a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f05fa2a1-b61b-4617-b895-8c75645bde94", "address": "fa:16:3e:0b:9b:f6", "network": {"id": "450540a3-ff7e-42fb-a0a6-808acd749943", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1503678778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6cb6f679ee4468d82cc7fb5d0f67be9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf05fa2a1-b6", "ovs_interfaceid": "f05fa2a1-b61b-4617-b895-8c75645bde94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 17 01:29:40 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-8050bed9-27cb-44d4-b353-24fa434c4622 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Converting VIF {"id": "f05fa2a1-b61b-4617-b895-8c75645bde94", "address": "fa:16:3e:0b:9b:f6", "network": {"id": "450540a3-ff7e-42fb-a0a6-808acd749943", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1503678778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6cb6f679ee4468d82cc7fb5d0f67be9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf05fa2a1-b6", "ovs_interfaceid": "f05fa2a1-b61b-4617-b895-8c75645bde94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:29:40 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-8050bed9-27cb-44d4-b353-24fa434c4622 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:9b:f6,bridge_name='br-int',has_traffic_filtering=True,id=f05fa2a1-b61b-4617-b895-8c75645bde94,network=Network(450540a3-ff7e-42fb-a0a6-808acd749943),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf05fa2a1-b6') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:29:40 user nova-compute[75226]: DEBUG os_vif [None req-8050bed9-27cb-44d4-b353-24fa434c4622 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:9b:f6,bridge_name='br-int',has_traffic_filtering=True,id=f05fa2a1-b61b-4617-b895-8c75645bde94,network=Network(450540a3-ff7e-42fb-a0a6-808acd749943),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf05fa2a1-b6') {{(pid=75226) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 17 01:29:40 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:29:40 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:29:40 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 17 01:29:40 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:29:40 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8f285739-db89-5459-bb5f-3caf24bb3d77', '_type': 'linux-noop'}}, row=False) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:29:40 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:29:40 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:29:40 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:29:40 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf05fa2a1-b6, may_exist=True, interface_attrs={}) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:29:40 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf05fa2a1-b6, col_values=(('qos', UUID('1b801603-d8e0-4b0e-aee0-4b2bfb35ee3b')),), if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:29:40 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf05fa2a1-b6, col_values=(('external_ids', {'iface-id': 'f05fa2a1-b61b-4617-b895-8c75645bde94', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0b:9b:f6', 'vm-uuid': '3018e3a2-01e0-49d7-a960-51718709845a'}),), if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:29:40 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:29:40 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:29:40 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:29:40 user nova-compute[75226]: INFO os_vif [None req-8050bed9-27cb-44d4-b353-24fa434c4622 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:9b:f6,bridge_name='br-int',has_traffic_filtering=True,id=f05fa2a1-b61b-4617-b895-8c75645bde94,network=Network(450540a3-ff7e-42fb-a0a6-808acd749943),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf05fa2a1-b6')
Nov 17 01:29:40 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-8050bed9-27cb-44d4-b353-24fa434c4622 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] No BDM found with device name vda, not building metadata. {{(pid=75226) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 01:29:40 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-8050bed9-27cb-44d4-b353-24fa434c4622 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] No VIF found with MAC fa:16:3e:0b:9b:f6, not building metadata {{(pid=75226) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 01:29:41 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:29:41 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:29:41 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:29:41 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:29:42 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:29:42 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:29:42 user nova-compute[75226]: DEBUG nova.compute.manager [req-e70934cf-1c26-4cdf-9b6d-da860c28e59e req-5ce35448-6809-4d39-9b4c-e2afb999c7da service nova] [instance: 3018e3a2-01e0-49d7-a960-51718709845a] Received event network-vif-plugged-f05fa2a1-b61b-4617-b895-8c75645bde94 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:29:42 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-e70934cf-1c26-4cdf-9b6d-da860c28e59e req-5ce35448-6809-4d39-9b4c-e2afb999c7da service nova] Acquiring lock "3018e3a2-01e0-49d7-a960-51718709845a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:29:42 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-e70934cf-1c26-4cdf-9b6d-da860c28e59e req-5ce35448-6809-4d39-9b4c-e2afb999c7da service nova] Lock "3018e3a2-01e0-49d7-a960-51718709845a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:29:42 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-e70934cf-1c26-4cdf-9b6d-da860c28e59e req-5ce35448-6809-4d39-9b4c-e2afb999c7da service nova] Lock "3018e3a2-01e0-49d7-a960-51718709845a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:29:42 user nova-compute[75226]: DEBUG nova.compute.manager [req-e70934cf-1c26-4cdf-9b6d-da860c28e59e req-5ce35448-6809-4d39-9b4c-e2afb999c7da service nova] [instance: 3018e3a2-01e0-49d7-a960-51718709845a] No waiting events found dispatching network-vif-plugged-f05fa2a1-b61b-4617-b895-8c75645bde94 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:29:42 user nova-compute[75226]: WARNING nova.compute.manager [req-e70934cf-1c26-4cdf-9b6d-da860c28e59e req-5ce35448-6809-4d39-9b4c-e2afb999c7da service nova] [instance: 3018e3a2-01e0-49d7-a960-51718709845a] Received unexpected event network-vif-plugged-f05fa2a1-b61b-4617-b895-8c75645bde94 for instance with vm_state building and task_state spawning.
Nov 17 01:29:42 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:29:44 user nova-compute[75226]: DEBUG nova.compute.manager [None req-8050bed9-27cb-44d4-b353-24fa434c4622 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 3018e3a2-01e0-49d7-a960-51718709845a] Instance event wait completed in 0 seconds for  {{(pid=75226) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 17 01:29:44 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-8050bed9-27cb-44d4-b353-24fa434c4622 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 3018e3a2-01e0-49d7-a960-51718709845a] Guest created on hypervisor {{(pid=75226) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 17 01:29:44 user nova-compute[75226]: INFO nova.virt.libvirt.driver [-] [instance: 3018e3a2-01e0-49d7-a960-51718709845a] Instance spawned successfully.
Nov 17 01:29:44 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-8050bed9-27cb-44d4-b353-24fa434c4622 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 3018e3a2-01e0-49d7-a960-51718709845a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 17 01:29:44 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-8050bed9-27cb-44d4-b353-24fa434c4622 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 3018e3a2-01e0-49d7-a960-51718709845a] Found default for hw_cdrom_bus of ide {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:29:44 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-8050bed9-27cb-44d4-b353-24fa434c4622 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 3018e3a2-01e0-49d7-a960-51718709845a] Found default for hw_disk_bus of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:29:44 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-8050bed9-27cb-44d4-b353-24fa434c4622 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 3018e3a2-01e0-49d7-a960-51718709845a] Found default for hw_input_bus of None {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:29:44 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-8050bed9-27cb-44d4-b353-24fa434c4622 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 3018e3a2-01e0-49d7-a960-51718709845a] Found default for hw_pointer_model of None {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:29:44 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-8050bed9-27cb-44d4-b353-24fa434c4622 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 3018e3a2-01e0-49d7-a960-51718709845a] Found default for hw_video_model of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:29:44 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-8050bed9-27cb-44d4-b353-24fa434c4622 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 3018e3a2-01e0-49d7-a960-51718709845a] Found default for hw_vif_model of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:29:44 user nova-compute[75226]: INFO nova.compute.manager [None req-8050bed9-27cb-44d4-b353-24fa434c4622 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 3018e3a2-01e0-49d7-a960-51718709845a] Took 5.27 seconds to spawn the instance on the hypervisor.
Nov 17 01:29:44 user nova-compute[75226]: DEBUG nova.compute.manager [None req-8050bed9-27cb-44d4-b353-24fa434c4622 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 3018e3a2-01e0-49d7-a960-51718709845a] Checking state {{(pid=75226) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 01:29:44 user nova-compute[75226]: INFO nova.compute.manager [None req-8050bed9-27cb-44d4-b353-24fa434c4622 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 3018e3a2-01e0-49d7-a960-51718709845a] Took 18.13 seconds to build instance.
Nov 17 01:29:44 user nova-compute[75226]: DEBUG nova.compute.manager [req-f25398b7-e7c3-4f0d-b781-ddc239cc735b req-741566b8-e8f3-416a-a464-0636de5982a7 service nova] [instance: bef5f981-8fcb-4433-87bf-f958f3f57424] Received event network-changed-cab29de8-39b1-4673-ac55-4e29c21d0d34 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:29:44 user nova-compute[75226]: DEBUG nova.compute.manager [req-f25398b7-e7c3-4f0d-b781-ddc239cc735b req-741566b8-e8f3-416a-a464-0636de5982a7 service nova] [instance: bef5f981-8fcb-4433-87bf-f958f3f57424] Refreshing instance network info cache due to event network-changed-cab29de8-39b1-4673-ac55-4e29c21d0d34. {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 01:29:44 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-f25398b7-e7c3-4f0d-b781-ddc239cc735b req-741566b8-e8f3-416a-a464-0636de5982a7 service nova] Acquiring lock "refresh_cache-bef5f981-8fcb-4433-87bf-f958f3f57424" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:29:44 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-f25398b7-e7c3-4f0d-b781-ddc239cc735b req-741566b8-e8f3-416a-a464-0636de5982a7 service nova] Acquired lock "refresh_cache-bef5f981-8fcb-4433-87bf-f958f3f57424" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:29:44 user nova-compute[75226]: DEBUG nova.network.neutron [req-f25398b7-e7c3-4f0d-b781-ddc239cc735b req-741566b8-e8f3-416a-a464-0636de5982a7 service nova] [instance: bef5f981-8fcb-4433-87bf-f958f3f57424] Refreshing network info cache for port cab29de8-39b1-4673-ac55-4e29c21d0d34 {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 01:29:44 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-8050bed9-27cb-44d4-b353-24fa434c4622 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Lock "3018e3a2-01e0-49d7-a960-51718709845a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.234s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:29:44 user nova-compute[75226]: DEBUG nova.network.neutron [req-f25398b7-e7c3-4f0d-b781-ddc239cc735b req-741566b8-e8f3-416a-a464-0636de5982a7 service nova] [instance: bef5f981-8fcb-4433-87bf-f958f3f57424] Updated VIF entry in instance network info cache for port cab29de8-39b1-4673-ac55-4e29c21d0d34. {{(pid=75226) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 01:29:44 user nova-compute[75226]: DEBUG nova.network.neutron [req-f25398b7-e7c3-4f0d-b781-ddc239cc735b req-741566b8-e8f3-416a-a464-0636de5982a7 service nova] [instance: bef5f981-8fcb-4433-87bf-f958f3f57424] Updating instance_info_cache with network_info: [{"id": "cab29de8-39b1-4673-ac55-4e29c21d0d34", "address": "fa:16:3e:13:0e:d0", "network": {"id": "57d0e7ee-0b11-4e00-86f9-bb4a3c25c674", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1357446034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e38777e8baf745e79f31190da97406a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcab29de8-39", "ovs_interfaceid": "cab29de8-39b1-4673-ac55-4e29c21d0d34", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:29:44 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-f25398b7-e7c3-4f0d-b781-ddc239cc735b req-741566b8-e8f3-416a-a464-0636de5982a7 service nova] Releasing lock "refresh_cache-bef5f981-8fcb-4433-87bf-f958f3f57424" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:29:44 user nova-compute[75226]: DEBUG nova.compute.manager [req-f25398b7-e7c3-4f0d-b781-ddc239cc735b req-741566b8-e8f3-416a-a464-0636de5982a7 service nova] [instance: 3018e3a2-01e0-49d7-a960-51718709845a] Received event network-vif-plugged-f05fa2a1-b61b-4617-b895-8c75645bde94 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:29:44 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-f25398b7-e7c3-4f0d-b781-ddc239cc735b req-741566b8-e8f3-416a-a464-0636de5982a7 service nova] Acquiring lock "3018e3a2-01e0-49d7-a960-51718709845a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:29:44 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-f25398b7-e7c3-4f0d-b781-ddc239cc735b req-741566b8-e8f3-416a-a464-0636de5982a7 service nova] Lock "3018e3a2-01e0-49d7-a960-51718709845a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:29:44 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-f25398b7-e7c3-4f0d-b781-ddc239cc735b req-741566b8-e8f3-416a-a464-0636de5982a7 service nova] Lock "3018e3a2-01e0-49d7-a960-51718709845a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:29:44 user nova-compute[75226]: DEBUG nova.compute.manager [req-f25398b7-e7c3-4f0d-b781-ddc239cc735b req-741566b8-e8f3-416a-a464-0636de5982a7 service nova] [instance: 3018e3a2-01e0-49d7-a960-51718709845a] No waiting events found dispatching network-vif-plugged-f05fa2a1-b61b-4617-b895-8c75645bde94 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:29:44 user nova-compute[75226]: WARNING nova.compute.manager [req-f25398b7-e7c3-4f0d-b781-ddc239cc735b req-741566b8-e8f3-416a-a464-0636de5982a7 service nova] [instance: 3018e3a2-01e0-49d7-a960-51718709845a] Received unexpected event network-vif-plugged-f05fa2a1-b61b-4617-b895-8c75645bde94 for instance with vm_state active and task_state None.
Nov 17 01:29:44 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-ebf2ee2f-c055-40d7-9549-14a0ff38b9af tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Acquiring lock "bef5f981-8fcb-4433-87bf-f958f3f57424" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:29:44 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-ebf2ee2f-c055-40d7-9549-14a0ff38b9af tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Lock "bef5f981-8fcb-4433-87bf-f958f3f57424" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:29:44 user nova-compute[75226]: DEBUG nova.objects.instance [None req-ebf2ee2f-c055-40d7-9549-14a0ff38b9af tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Lazy-loading 'flavor' on Instance uuid bef5f981-8fcb-4433-87bf-f958f3f57424 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:29:45 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-ebf2ee2f-c055-40d7-9549-14a0ff38b9af tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Lock "bef5f981-8fcb-4433-87bf-f958f3f57424" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:29:45 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-ebf2ee2f-c055-40d7-9549-14a0ff38b9af tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Acquiring lock "bef5f981-8fcb-4433-87bf-f958f3f57424" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:29:45 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-ebf2ee2f-c055-40d7-9549-14a0ff38b9af tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Lock "bef5f981-8fcb-4433-87bf-f958f3f57424" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:29:45 user nova-compute[75226]: INFO nova.compute.manager [None req-ebf2ee2f-c055-40d7-9549-14a0ff38b9af tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: bef5f981-8fcb-4433-87bf-f958f3f57424] Attaching volume 78090354-58ed-4e95-9927-502d1e661eba to /dev/vdb
Nov 17 01:29:45 user nova-compute[75226]: DEBUG os_brick.utils [None req-ebf2ee2f-c055-40d7-9549-14a0ff38b9af tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:29:45 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:29:45 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:29:45 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[e13136e2-78d9-4d91-8722-cb881b600cf3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f62857db69\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:29:45 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:29:45 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:29:45 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[7563515c-89ef-4b6d-bb6e-816eaeeee352]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:29:45 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:29:45 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:29:45 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eebb4ee-6a97-4690-b08c-33d2e9249263]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:29:45 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[e41268c6-d5f7-40d9-b69f-62cd76e9a0b3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:29:45 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-ebf2ee2f-c055-40d7-9549-14a0ff38b9af tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Running cmd (subprocess): nvme version {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:29:45 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-ebf2ee2f-c055-40d7-9549-14a0ff38b9af tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] 'nvme version' failed. Not Retrying. {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 01:29:45 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:29:45 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ebf2ee2f-c055-40d7-9549-14a0ff38b9af tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] nvme not present on system {{(pid=75226) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 17 01:29:45 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:29:45 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 01:29:45 user nova-compute[75226]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 17 01:29:45 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[468dc7b5-b4d4-4c41-9043-9d27c46660a3]: (4, '') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:29:45 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-ebf2ee2f-c055-40d7-9549-14a0ff38b9af tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75226) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 17 01:29:45 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-ebf2ee2f-c055-40d7-9549-14a0ff38b9af tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75226) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 17 01:29:45 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-ebf2ee2f-c055-40d7-9549-14a0ff38b9af tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] LIGHTOS: no hostnqn found. {{(pid=75226) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 17 01:29:45 user nova-compute[75226]: DEBUG os_brick.utils [None req-ebf2ee2f-c055-40d7-9549-14a0ff38b9af tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f62857db69', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:29:45 user nova-compute[75226]: DEBUG nova.virt.block_device [None req-ebf2ee2f-c055-40d7-9549-14a0ff38b9af tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: bef5f981-8fcb-4433-87bf-f958f3f57424] Updating existing volume attachment record: 90e06eb7-612d-4ef0-ac35-059e3c5e6580 {{(pid=75226) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 17 01:29:47 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:29:50 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:29:50 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ebf2ee2f-c055-40d7-9549-14a0ff38b9af tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: bef5f981-8fcb-4433-87bf-f958f3f57424] Calling os-brick to attach iSCSI Volume {{(pid=75226) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 17 01:29:50 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebf2ee2f-c055-40d7-9549-14a0ff38b9af tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc4cc36b490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:78090354-58ed-4e95-9927-502d1e661eba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cMoLnyef', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:29:50 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-ebf2ee2f-c055-40d7-9549-14a0ff38b9af tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:29:50 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-ebf2ee2f-c055-40d7-9549-14a0ff38b9af tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:29:50 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-ebf2ee2f-c055-40d7-9549-14a0ff38b9af tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:29:50 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-ebf2ee2f-c055-40d7-9549-14a0ff38b9af tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:29:50 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-ebf2ee2f-c055-40d7-9549-14a0ff38b9af tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:78090354-58ed-4e95-9927-502d1e661eba" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:29:50 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-ebf2ee2f-c055-40d7-9549-14a0ff38b9af tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:78090354-58ed-4e95-9927-502d1e661eba" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:29:50 user nova-compute[75226]: INFO os_brick.initiator.connectors.iscsi [None req-ebf2ee2f-c055-40d7-9549-14a0ff38b9af tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 17 01:29:50 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78090354-58ed-4e95-9927-502d1e661eba -p 172.16.0.220:3260 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:29:50 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78090354-58ed-4e95-9927-502d1e661eba -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:29:50 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[29ae1069-f90f-408e-b50c-620133aa87ee]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:29:50 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebf2ee2f-c055-40d7-9549-14a0ff38b9af tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 17 01:29:50 user nova-compute[75226]:  {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:29:50 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78090354-58ed-4e95-9927-502d1e661eba -p 172.16.0.220:3260 --interface default --op new {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:29:51 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78090354-58ed-4e95-9927-502d1e661eba -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:29:51 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[42437130-9c63-4797-9c7c-98b3097fd774]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:78090354-58ed-4e95-9927-502d1e661eba] added\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:29:51 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebf2ee2f-c055-40d7-9549-14a0ff38b9af tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:78090354-58ed-4e95-9927-502d1e661eba] added
Nov 17 01:29:51 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:29:51 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78090354-58ed-4e95-9927-502d1e661eba -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:29:51 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78090354-58ed-4e95-9927-502d1e661eba -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:29:51 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[5be726db-305e-4a06-8423-ed3bca11dd9f]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:29:51 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebf2ee2f-c055-40d7-9549-14a0ff38b9af tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:29:51 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78090354-58ed-4e95-9927-502d1e661eba -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:29:51 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78090354-58ed-4e95-9927-502d1e661eba -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:29:51 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[cabdda2c-1046-427c-a069-70d7cf504fc2]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:29:51 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebf2ee2f-c055-40d7-9549-14a0ff38b9af tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:29:51 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78090354-58ed-4e95-9927-502d1e661eba -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cMoLnyef {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:29:51 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78090354-58ed-4e95-9927-502d1e661eba -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cMoLnyef" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:29:51 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae28f067-a8e6-4356-a827-2a0742e9cfa4]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:29:51 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebf2ee2f-c055-40d7-9549-14a0ff38b9af tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cMoLnyef'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:29:51 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78090354-58ed-4e95-9927-502d1e661eba -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:29:51 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78090354-58ed-4e95-9927-502d1e661eba -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:29:51 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[fad30886-a767-493b-a849-801fee71351f]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:29:51 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebf2ee2f-c055-40d7-9549-14a0ff38b9af tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:29:51 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:29:51 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:29:51 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[91a5db87-a61b-493f-ac2e-bf6c06b18473]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05f878e5-0241-4282-8b2c-c4651c429dcb (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:29:51 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebf2ee2f-c055-40d7-9549-14a0ff38b9af tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)
Nov 17 01:29:51 user nova-compute[75226]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14 (non-flash)
Nov 17 01:29:51 user nova-compute[75226]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba (non-flash)
Nov 17 01:29:51 user nova-compute[75226]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05f878e5-0241-4282-8b2c-c4651c429dcb (non-flash)
Nov 17 01:29:51 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:29:51 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebf2ee2f-c055-40d7-9549-14a0ff38b9af tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)
Nov 17 01:29:51 user nova-compute[75226]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14 (non-flash)
Nov 17 01:29:51 user nova-compute[75226]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba (non-flash)
Nov 17 01:29:51 user nova-compute[75226]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05f878e5-0241-4282-8b2c-c4651c429dcb (non-flash)
Nov 17 01:29:51 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:29:51 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78090354-58ed-4e95-9927-502d1e661eba -p 172.16.0.220:3260 --login {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:29:51 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78090354-58ed-4e95-9927-502d1e661eba -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:29:51 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[46f11b29-be6e-4716-8ea9-93a374db8dfd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:78090354-58ed-4e95-9927-502d1e661eba, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:78090354-58ed-4e95-9927-502d1e661eba, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:29:51 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebf2ee2f-c055-40d7-9549-14a0ff38b9af tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:78090354-58ed-4e95-9927-502d1e661eba, portal: 172.16.0.220,3260]
Nov 17 01:29:51 user nova-compute[75226]: Login to [iface: default, target: iqn.2010-10.org.openstack:78090354-58ed-4e95-9927-502d1e661eba, portal: 172.16.0.220,3260] successful.
Nov 17 01:29:51 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:29:51 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78090354-58ed-4e95-9927-502d1e661eba -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:29:51 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78090354-58ed-4e95-9927-502d1e661eba -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:29:51 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a3856ca-c895-461a-96c7-53bce0480af3]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:29:51 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebf2ee2f-c055-40d7-9549-14a0ff38b9af tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:29:51 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:29:51 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:29:51 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0012194-16b5-41b6-bb18-d3bc8dd2ee32]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05f878e5-0241-4282-8b2c-c4651c429dcb (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78090354-58ed-4e95-9927-502d1e661eba (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:29:51 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebf2ee2f-c055-40d7-9549-14a0ff38b9af tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)
Nov 17 01:29:51 user nova-compute[75226]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14 (non-flash)
Nov 17 01:29:51 user nova-compute[75226]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba (non-flash)
Nov 17 01:29:51 user nova-compute[75226]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05f878e5-0241-4282-8b2c-c4651c429dcb (non-flash)
Nov 17 01:29:51 user nova-compute[75226]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78090354-58ed-4e95-9927-502d1e661eba (non-flash)
Nov 17 01:29:51 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:29:51 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebf2ee2f-c055-40d7-9549-14a0ff38b9af tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)
Nov 17 01:29:51 user nova-compute[75226]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14 (non-flash)
Nov 17 01:29:51 user nova-compute[75226]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba (non-flash)
Nov 17 01:29:51 user nova-compute[75226]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05f878e5-0241-4282-8b2c-c4651c429dcb (non-flash)
Nov 17 01:29:51 user nova-compute[75226]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78090354-58ed-4e95-9927-502d1e661eba (non-flash)
Nov 17 01:29:51 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:29:51 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-ebf2ee2f-c055-40d7-9549-14a0ff38b9af tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:78090354-58ed-4e95-9927-502d1e661eba" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:29:51 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebf2ee2f-c055-40d7-9549-14a0ff38b9af tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Connected to 172.16.0.220:3260 {{(pid=75226) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 17 01:29:51 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-ebf2ee2f-c055-40d7-9549-14a0ff38b9af tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] HCTL ('37', '-', '-', 0) found on session 33 with lun 0 {{(pid=75226) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 17 01:29:51 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-ebf2ee2f-c055-40d7-9549-14a0ff38b9af tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75226) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 17 01:29:51 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:29:51 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:29:51 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[55119646-6ff7-497c-b5a8-e2cdc56c9a29]: (4, ('- - 0', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:29:51 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-ebf2ee2f-c055-40d7-9549-14a0ff38b9af tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Searching for a device in session 33 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75226) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 01:29:51 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebf2ee2f-c055-40d7-9549-14a0ff38b9af tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:78090354-58ed-4e95-9927-502d1e661eba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cMoLnyef', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75226) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 17 01:29:52 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-ebf2ee2f-c055-40d7-9549-14a0ff38b9af tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.311s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:29:52 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebf2ee2f-c055-40d7-9549-14a0ff38b9af tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] <== connect_volume: return (1313ms) {'type': 'block', 'scsi_wwn': '26639313134313838', 'path': '/dev/sdf'} {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:29:52 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ebf2ee2f-c055-40d7-9549-14a0ff38b9af tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: bef5f981-8fcb-4433-87bf-f958f3f57424] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26639313134313838', 'path': '/dev/sdf'} {{(pid=75226) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 17 01:29:52 user nova-compute[75226]: DEBUG nova.objects.instance [None req-ebf2ee2f-c055-40d7-9549-14a0ff38b9af tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Lazy-loading 'flavor' on Instance uuid bef5f981-8fcb-4433-87bf-f958f3f57424 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:29:52 user nova-compute[75226]: DEBUG nova.virt.libvirt.guest [None req-ebf2ee2f-c055-40d7-9549-14a0ff38b9af tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] attach device xml: <disk type="block" device="disk">
Nov 17 01:29:52 user nova-compute[75226]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 01:29:52 user nova-compute[75226]:   <source dev="/dev/sdf"/>
Nov 17 01:29:52 user nova-compute[75226]:   <target dev="vdb" bus="virtio"/>
Nov 17 01:29:52 user nova-compute[75226]:   <serial>78090354-58ed-4e95-9927-502d1e661eba</serial>
Nov 17 01:29:52 user nova-compute[75226]: </disk>
Nov 17 01:29:52 user nova-compute[75226]:  {{(pid=75226) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 17 01:29:52 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-ebf2ee2f-c055-40d7-9549-14a0ff38b9af tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] No BDM found with device name vda, not building metadata. {{(pid=75226) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 01:29:52 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-ebf2ee2f-c055-40d7-9549-14a0ff38b9af tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75226) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 01:29:52 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-ebf2ee2f-c055-40d7-9549-14a0ff38b9af tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] No VIF found with MAC fa:16:3e:13:0e:d0, not building metadata {{(pid=75226) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 01:29:52 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-ebf2ee2f-c055-40d7-9549-14a0ff38b9af tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Lock "bef5f981-8fcb-4433-87bf-f958f3f57424" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.660s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:29:52 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:29:54 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-312853ce-7fdc-45a9-afe7-f0a8ffa148f5 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Acquiring lock "bef5f981-8fcb-4433-87bf-f958f3f57424" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:29:54 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-312853ce-7fdc-45a9-afe7-f0a8ffa148f5 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Lock "bef5f981-8fcb-4433-87bf-f958f3f57424" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:29:54 user nova-compute[75226]: INFO nova.compute.manager [None req-312853ce-7fdc-45a9-afe7-f0a8ffa148f5 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: bef5f981-8fcb-4433-87bf-f958f3f57424] Detaching volume 78090354-58ed-4e95-9927-502d1e661eba
Nov 17 01:29:54 user nova-compute[75226]: INFO nova.virt.block_device [None req-312853ce-7fdc-45a9-afe7-f0a8ffa148f5 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: bef5f981-8fcb-4433-87bf-f958f3f57424] Attempting to driver detach volume 78090354-58ed-4e95-9927-502d1e661eba from mountpoint /dev/vdb
Nov 17 01:29:54 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-312853ce-7fdc-45a9-afe7-f0a8ffa148f5 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Attempting to detach device vdb from instance bef5f981-8fcb-4433-87bf-f958f3f57424 from the persistent domain config. {{(pid=75226) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 17 01:29:54 user nova-compute[75226]: DEBUG nova.virt.libvirt.guest [None req-312853ce-7fdc-45a9-afe7-f0a8ffa148f5 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] detach device xml: <disk type="block" device="disk">
Nov 17 01:29:54 user nova-compute[75226]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 01:29:54 user nova-compute[75226]:   <source dev="/dev/sdf"/>
Nov 17 01:29:54 user nova-compute[75226]:   <target dev="vdb" bus="virtio"/>
Nov 17 01:29:54 user nova-compute[75226]:   <serial>78090354-58ed-4e95-9927-502d1e661eba</serial>
Nov 17 01:29:54 user nova-compute[75226]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 17 01:29:54 user nova-compute[75226]: </disk>
Nov 17 01:29:54 user nova-compute[75226]:  {{(pid=75226) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 17 01:29:54 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-312853ce-7fdc-45a9-afe7-f0a8ffa148f5 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Successfully detached device vdb from instance bef5f981-8fcb-4433-87bf-f958f3f57424 from the persistent domain config.
Nov 17 01:29:54 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-312853ce-7fdc-45a9-afe7-f0a8ffa148f5 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance bef5f981-8fcb-4433-87bf-f958f3f57424 from the live domain config. {{(pid=75226) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 17 01:29:54 user nova-compute[75226]: DEBUG nova.virt.libvirt.guest [None req-312853ce-7fdc-45a9-afe7-f0a8ffa148f5 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] detach device xml: <disk type="block" device="disk">
Nov 17 01:29:54 user nova-compute[75226]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 01:29:54 user nova-compute[75226]:   <source dev="/dev/sdf"/>
Nov 17 01:29:54 user nova-compute[75226]:   <target dev="vdb" bus="virtio"/>
Nov 17 01:29:54 user nova-compute[75226]:   <serial>78090354-58ed-4e95-9927-502d1e661eba</serial>
Nov 17 01:29:54 user nova-compute[75226]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 17 01:29:54 user nova-compute[75226]: </disk>
Nov 17 01:29:54 user nova-compute[75226]:  {{(pid=75226) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 17 01:29:54 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-312853ce-7fdc-45a9-afe7-f0a8ffa148f5 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance bef5f981-8fcb-4433-87bf-f958f3f57424 {{(pid=75226) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 17 01:29:55 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:29:57 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:30:00 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:30:01 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:30:02 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:30:03 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:30:03 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:30:03 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:30:03 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:30:03 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:30:03 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75226) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 17 01:30:04 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa84e575-bdad-45b9-80ce-86b1c2826fb0/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:30:04 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa84e575-bdad-45b9-80ce-86b1c2826fb0/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:30:04 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa84e575-bdad-45b9-80ce-86b1c2826fb0/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:30:04 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa84e575-bdad-45b9-80ce-86b1c2826fb0/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:30:04 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee2187c9-8620-4fd2-ad8a-a054cd8393f3/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:30:04 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee2187c9-8620-4fd2-ad8a-a054cd8393f3/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:30:04 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee2187c9-8620-4fd2-ad8a-a054cd8393f3/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:30:04 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee2187c9-8620-4fd2-ad8a-a054cd8393f3/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:30:04 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75226) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 01:30:04 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6555d72-6094-4ea9-b071-a3d3c8a300a9/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:30:05 user nova-compute[75226]: DEBUG nova.network.neutron [None req-c8e6edb0-73b7-40d7-ad3a-181d8091016a tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] [instance: ee2187c9-8620-4fd2-ad8a-a054cd8393f3] Port 1057ea4c-2ac4-40fa-8b2e-3b5888ea4d61 binding to destination host user is already ACTIVE {{(pid=75226) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 17 01:30:05 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-c8e6edb0-73b7-40d7-ad3a-181d8091016a tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Acquiring lock "refresh_cache-ee2187c9-8620-4fd2-ad8a-a054cd8393f3" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:30:05 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-c8e6edb0-73b7-40d7-ad3a-181d8091016a tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Acquired lock "refresh_cache-ee2187c9-8620-4fd2-ad8a-a054cd8393f3" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:30:05 user nova-compute[75226]: DEBUG nova.network.neutron [None req-c8e6edb0-73b7-40d7-ad3a-181d8091016a tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] [instance: ee2187c9-8620-4fd2-ad8a-a054cd8393f3] Building network info cache for instance {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 01:30:05 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6555d72-6094-4ea9-b071-a3d3c8a300a9/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:30:05 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6555d72-6094-4ea9-b071-a3d3c8a300a9/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:30:05 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6555d72-6094-4ea9-b071-a3d3c8a300a9/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:30:05 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e8b4b85-fe0c-4592-850e-e94ebab32d02/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:30:05 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:30:05 user nova-compute[75226]: DEBUG nova.network.neutron [None req-c8e6edb0-73b7-40d7-ad3a-181d8091016a tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] [instance: ee2187c9-8620-4fd2-ad8a-a054cd8393f3] Updating instance_info_cache with network_info: [{"id": "1057ea4c-2ac4-40fa-8b2e-3b5888ea4d61", "address": "fa:16:3e:4a:f5:8f", "network": {"id": "3d8c3322-c78d-4d3a-b8c7-ba12241b4c65", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1996535656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c19f767dc7bb4024b3cbf1d8f5f8f2bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1057ea4c-2a", "ovs_interfaceid": "1057ea4c-2ac4-40fa-8b2e-3b5888ea4d61", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:30:05 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-c8e6edb0-73b7-40d7-ad3a-181d8091016a tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Releasing lock "refresh_cache-ee2187c9-8620-4fd2-ad8a-a054cd8393f3" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:30:05 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-c8e6edb0-73b7-40d7-ad3a-181d8091016a tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] [instance: ee2187c9-8620-4fd2-ad8a-a054cd8393f3] Creating tmpfile /opt/stack/data/nova/instances/ee2187c9-8620-4fd2-ad8a-a054cd8393f3/tmp8rw453zh to verify with other compute node that the instance is on the same shared storage. {{(pid=75226) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9628}}
Nov 17 01:30:05 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e8b4b85-fe0c-4592-850e-e94ebab32d02/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:30:05 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e8b4b85-fe0c-4592-850e-e94ebab32d02/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:30:05 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:30:05 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:30:05 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:30:05 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:30:05 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e8b4b85-fe0c-4592-850e-e94ebab32d02/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:30:05 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38062487-67ca-4962-974f-81456aebe97b/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:30:05 user nova-compute[75226]: DEBUG nova.compute.manager [req-65d0add9-c043-4ce5-9f1f-9c473219050d req-9a990dd6-9c9d-41cb-8290-0daa7eeca0e2 service nova] [instance: ee2187c9-8620-4fd2-ad8a-a054cd8393f3] Received event network-vif-unplugged-1057ea4c-2ac4-40fa-8b2e-3b5888ea4d61 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:30:05 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-65d0add9-c043-4ce5-9f1f-9c473219050d req-9a990dd6-9c9d-41cb-8290-0daa7eeca0e2 service nova] Acquiring lock "ee2187c9-8620-4fd2-ad8a-a054cd8393f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:30:05 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-65d0add9-c043-4ce5-9f1f-9c473219050d req-9a990dd6-9c9d-41cb-8290-0daa7eeca0e2 service nova] Lock "ee2187c9-8620-4fd2-ad8a-a054cd8393f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:30:05 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-65d0add9-c043-4ce5-9f1f-9c473219050d req-9a990dd6-9c9d-41cb-8290-0daa7eeca0e2 service nova] Lock "ee2187c9-8620-4fd2-ad8a-a054cd8393f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:30:05 user nova-compute[75226]: DEBUG nova.compute.manager [req-65d0add9-c043-4ce5-9f1f-9c473219050d req-9a990dd6-9c9d-41cb-8290-0daa7eeca0e2 service nova] [instance: ee2187c9-8620-4fd2-ad8a-a054cd8393f3] No waiting events found dispatching network-vif-unplugged-1057ea4c-2ac4-40fa-8b2e-3b5888ea4d61 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:30:05 user nova-compute[75226]: WARNING nova.compute.manager [req-65d0add9-c043-4ce5-9f1f-9c473219050d req-9a990dd6-9c9d-41cb-8290-0daa7eeca0e2 service nova] [instance: ee2187c9-8620-4fd2-ad8a-a054cd8393f3] Received unexpected event network-vif-unplugged-1057ea4c-2ac4-40fa-8b2e-3b5888ea4d61 for instance with vm_state resized and task_state resize_reverting.
Nov 17 01:30:05 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38062487-67ca-4962-974f-81456aebe97b/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:30:05 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38062487-67ca-4962-974f-81456aebe97b/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:30:05 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:30:06 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38062487-67ca-4962-974f-81456aebe97b/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:30:06 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75226) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 01:30:06 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c280142-8901-4f83-bde4-baaa097e05b0/disk.rescue --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:30:06 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:30:06 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:30:06 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:30:06 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c280142-8901-4f83-bde4-baaa097e05b0/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:30:06 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c280142-8901-4f83-bde4-baaa097e05b0/disk.rescue --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:30:06 user nova-compute[75226]: INFO nova.virt.libvirt.driver [-] [instance: ee2187c9-8620-4fd2-ad8a-a054cd8393f3] Instance destroyed successfully.
Nov 17 01:30:06 user nova-compute[75226]: DEBUG nova.objects.instance [None req-c8e6edb0-73b7-40d7-ad3a-181d8091016a tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Lazy-loading 'resources' on Instance uuid ee2187c9-8620-4fd2-ad8a-a054cd8393f3 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:30:06 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:30:06 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-c8e6edb0-73b7-40d7-ad3a-181d8091016a tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:24:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1878692867',display_name='tempest-ServerActionsTestOtherB-server-1878692867',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1878692867',id=21,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBTPdFaRxKgPkRdKbUEvHAZcoj+dPC43zryXBmo0q5ihjaLD04DW9eJSP+KLH1T/XkmERKqJKOvG49EB5qtvQ6Fib4lL66B3axWTUVDvaaC20Rh3bH2XA1pGQ2EKVxiHfg==',key_name='tempest-keypair-1901957685',keypairs=<?>,launch_index=0,launched_at=2023-11-17T01:28:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c19f767dc7bb4024b3cbf1d8f5f8f2bf',ramdisk_id='',reservation_id='r-p9pzzoi2',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-229085712',owner_user_name='tempest-ServerActionsTestOtherB-229085712-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T01:28:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f0952a7e2dd64bf2adb2e224965377ab',uuid=ee2187c9-8620-4fd2-ad8a-a054cd8393f3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "1057ea4c-2ac4-40fa-8b2e-3b5888ea4d61", "address": "fa:16:3e:4a:f5:8f", "network": {"id": "3d8c3322-c78d-4d3a-b8c7-ba12241b4c65", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1996535656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c19f767dc7bb4024b3cbf1d8f5f8f2bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1057ea4c-2a", "ovs_interfaceid": "1057ea4c-2ac4-40fa-8b2e-3b5888ea4d61", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 17 01:30:06 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-c8e6edb0-73b7-40d7-ad3a-181d8091016a tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Converting VIF {"id": "1057ea4c-2ac4-40fa-8b2e-3b5888ea4d61", "address": "fa:16:3e:4a:f5:8f", "network": {"id": "3d8c3322-c78d-4d3a-b8c7-ba12241b4c65", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1996535656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c19f767dc7bb4024b3cbf1d8f5f8f2bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1057ea4c-2a", "ovs_interfaceid": "1057ea4c-2ac4-40fa-8b2e-3b5888ea4d61", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:30:06 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-c8e6edb0-73b7-40d7-ad3a-181d8091016a tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4a:f5:8f,bridge_name='br-int',has_traffic_filtering=True,id=1057ea4c-2ac4-40fa-8b2e-3b5888ea4d61,network=Network(3d8c3322-c78d-4d3a-b8c7-ba12241b4c65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1057ea4c-2a') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:30:06 user nova-compute[75226]: DEBUG os_vif [None req-c8e6edb0-73b7-40d7-ad3a-181d8091016a tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4a:f5:8f,bridge_name='br-int',has_traffic_filtering=True,id=1057ea4c-2ac4-40fa-8b2e-3b5888ea4d61,network=Network(3d8c3322-c78d-4d3a-b8c7-ba12241b4c65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1057ea4c-2a') {{(pid=75226) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 17 01:30:06 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:30:06 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1057ea4c-2a, bridge=br-int, if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:30:06 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:30:06 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:30:06 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:30:06 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bbe01608-43cf-479e-a251-5c56b55eb5cc) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:30:06 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:30:06 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:30:06 user nova-compute[75226]: INFO os_vif [None req-c8e6edb0-73b7-40d7-ad3a-181d8091016a tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4a:f5:8f,bridge_name='br-int',has_traffic_filtering=True,id=1057ea4c-2ac4-40fa-8b2e-3b5888ea4d61,network=Network(3d8c3322-c78d-4d3a-b8c7-ba12241b4c65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1057ea4c-2a')
Nov 17 01:30:06 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8e6edb0-73b7-40d7-ad3a-181d8091016a tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] [instance: ee2187c9-8620-4fd2-ad8a-a054cd8393f3] calling os-brick to detach iSCSI Volume {{(pid=75226) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 17 01:30:06 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8e6edb0-73b7-40d7-ad3a-181d8091016a tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc4cc36b490>, {'target_iqn': 'iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qFQXscng', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:30:06 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-c8e6edb0-73b7-40d7-ad3a-181d8091016a tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:30:06 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-c8e6edb0-73b7-40d7-ad3a-181d8091016a tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:30:06 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-c8e6edb0-73b7-40d7-ad3a-181d8091016a tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:30:06 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:30:06 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:30:06 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[97fa7889-8c01-4211-80f3-ab2dd0d96283]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:78090354-58ed-4e95-9927-502d1e661eba\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:05f878e5-0241-4282-8b2c-c4651c429dcb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:30:06 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8e6edb0-73b7-40d7-ad3a-181d8091016a tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 17 01:30:06 user nova-compute[75226]: No targets found.
Nov 17 01:30:06 user nova-compute[75226]: iSNS:
Nov 17 01:30:06 user nova-compute[75226]: No targets found.
Nov 17 01:30:06 user nova-compute[75226]: STATIC:
Nov 17 01:30:06 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:78090354-58ed-4e95-9927-502d1e661eba
Nov 17 01:30:06 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:30:06 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:30:06 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14
Nov 17 01:30:06 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:30:06 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:30:06 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba
Nov 17 01:30:06 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:30:06 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:30:06 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:05f878e5-0241-4282-8b2c-c4651c429dcb
Nov 17 01:30:06 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:30:06 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:30:06 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8
Nov 17 01:30:06 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:30:06 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:30:06 user nova-compute[75226]: FIRMWARE:
Nov 17 01:30:06 user nova-compute[75226]: No targets found.
Nov 17 01:30:06 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:30:06 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8e6edb0-73b7-40d7-ad3a-181d8091016a tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 17 01:30:06 user nova-compute[75226]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 17 01:30:06 user nova-compute[75226]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75226) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 17 01:30:06 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8e6edb0-73b7-40d7-ad3a-181d8091016a tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba', 0)] {{(pid=75226) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 17 01:30:06 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:30:06 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:30:06 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce5144ee-ed4d-416e-9bdb-0c720ce80844]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:05f878e5-0241-4282-8b2c-c4651c429dcb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78090354-58ed-4e95-9927-502d1e661eba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:30:06 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:30:06 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:30:06 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[7958f4a9-e4d9-42d9-8d41-212eba21a4e8]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05f878e5-0241-4282-8b2c-c4651c429dcb (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78090354-58ed-4e95-9927-502d1e661eba (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:30:06 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8e6edb0-73b7-40d7-ad3a-181d8091016a tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)
Nov 17 01:30:06 user nova-compute[75226]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14 (non-flash)
Nov 17 01:30:06 user nova-compute[75226]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba (non-flash)
Nov 17 01:30:06 user nova-compute[75226]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05f878e5-0241-4282-8b2c-c4651c429dcb (non-flash)
Nov 17 01:30:06 user nova-compute[75226]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78090354-58ed-4e95-9927-502d1e661eba (non-flash)
Nov 17 01:30:06 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:30:06 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8e6edb0-73b7-40d7-ad3a-181d8091016a tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)
Nov 17 01:30:06 user nova-compute[75226]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14 (non-flash)
Nov 17 01:30:06 user nova-compute[75226]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba (non-flash)
Nov 17 01:30:06 user nova-compute[75226]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05f878e5-0241-4282-8b2c-c4651c429dcb (non-flash)
Nov 17 01:30:06 user nova-compute[75226]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78090354-58ed-4e95-9927-502d1e661eba (non-flash)
Nov 17 01:30:06 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:30:06 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8e6edb0-73b7-40d7-ad3a-181d8091016a tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc4b43ee170>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba'): ({'sdb'}, set())}) {{(pid=75226) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 17 01:30:06 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-c8e6edb0-73b7-40d7-ad3a-181d8091016a tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Removing single pathed devices sdb {{(pid=75226) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 17 01:30:06 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c280142-8901-4f83-bde4-baaa097e05b0/disk.rescue --force-share --output=json" returned: 0 in 0.212s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:30:06 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c280142-8901-4f83-bde4-baaa097e05b0/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:30:06 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:30:06 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.037s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:30:06 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5426142-e539-4938-b180-cf9c4bc8715f]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:30:06 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:30:06 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:30:06 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9871fac-d2ec-4a83-8124-f1cc911fca1c]: (4, ('ok\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:30:06 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-c8e6edb0-73b7-40d7-ad3a-181d8091016a tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Flushing IO for device /dev/sdb {{(pid=75226) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 17 01:30:06 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:30:06 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:30:06 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[37fa53a5-2572-4224-8a21-4368e96b2215]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:30:06 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-c8e6edb0-73b7-40d7-ad3a-181d8091016a tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75226) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 17 01:30:06 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:30:06 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:30:06 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e971c50-9f94-40c3-975c-44fd5d6c434c]: (4, ('1', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:30:06 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-c8e6edb0-73b7-40d7-ad3a-181d8091016a tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75226) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 17 01:30:06 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-c8e6edb0-73b7-40d7-ad3a-181d8091016a tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] SCSI volumes sdb have been removed. {{(pid=75226) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 17 01:30:06 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8e6edb0-73b7-40d7-ad3a-181d8091016a tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba')] {{(pid=75226) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 17 01:30:06 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:30:06 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:30:06 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bea2fa1-cfc3-4904-87d4-3c2747a9eb4a]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:30:06 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8e6edb0-73b7-40d7-ad3a-181d8091016a tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:30:06 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba -p 172.16.0.220:3260 --logout {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:30:06 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c280142-8901-4f83-bde4-baaa097e05b0/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:30:06 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c280142-8901-4f83-bde4-baaa097e05b0/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:30:06 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:30:06 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[03657eca-b090-4b41-a4c0-ab5deb520da3]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:30:06 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8e6edb0-73b7-40d7-ad3a-181d8091016a tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba, portal: 172.16.0.220,3260]
Nov 17 01:30:06 user nova-compute[75226]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba, portal: 172.16.0.220,3260] successful.
Nov 17 01:30:06 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:30:06 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba -p 172.16.0.220:3260 --op delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:30:06 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:30:06 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[45a418c8-f05c-49a6-b6b4-99d40a04421e]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:30:06 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8e6edb0-73b7-40d7-ad3a-181d8091016a tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:30:06 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-c8e6edb0-73b7-40d7-ad3a-181d8091016a tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.366s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:30:06 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8e6edb0-73b7-40d7-ad3a-181d8091016a tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] <== disconnect_volume: return (368ms) None {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:30:06 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8e6edb0-73b7-40d7-ad3a-181d8091016a tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] [instance: ee2187c9-8620-4fd2-ad8a-a054cd8393f3] Disconnected iSCSI Volume {{(pid=75226) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 17 01:30:06 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c280142-8901-4f83-bde4-baaa097e05b0/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:30:06 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4050d898-f2b8-46c2-86e3-702ceb41a701/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:30:06 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:30:06 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:30:07 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:30:07 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:30:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4050d898-f2b8-46c2-86e3-702ceb41a701/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:30:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4050d898-f2b8-46c2-86e3-702ceb41a701/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:30:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4050d898-f2b8-46c2-86e3-702ceb41a701/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:30:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bef5f981-8fcb-4433-87bf-f958f3f57424/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:30:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bef5f981-8fcb-4433-87bf-f958f3f57424/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:30:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bef5f981-8fcb-4433-87bf-f958f3f57424/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:30:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bef5f981-8fcb-4433-87bf-f958f3f57424/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:30:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:30:07 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-c8e6edb0-73b7-40d7-ad3a-181d8091016a tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:30:07 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-c8e6edb0-73b7-40d7-ad3a-181d8091016a tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.002s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:30:07 user nova-compute[75226]: DEBUG nova.objects.instance [None req-c8e6edb0-73b7-40d7-ad3a-181d8091016a tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Lazy-loading 'migration_context' on Instance uuid ee2187c9-8620-4fd2-ad8a-a054cd8393f3 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:30:07 user nova-compute[75226]: DEBUG nova.objects.base [None req-c8e6edb0-73b7-40d7-ad3a-181d8091016a tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Object Instance<ee2187c9-8620-4fd2-ad8a-a054cd8393f3> lazy-loaded attributes: resources,migration_context {{(pid=75226) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 17 01:30:07 user nova-compute[75226]: DEBUG nova.compute.manager [req-41314626-77fa-4251-830e-a35efe6d402f req-1e7b18df-2635-4d06-9850-bf1a64624f3a service nova] [instance: ee2187c9-8620-4fd2-ad8a-a054cd8393f3] Received event network-vif-plugged-1057ea4c-2ac4-40fa-8b2e-3b5888ea4d61 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:30:07 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-41314626-77fa-4251-830e-a35efe6d402f req-1e7b18df-2635-4d06-9850-bf1a64624f3a service nova] Acquiring lock "ee2187c9-8620-4fd2-ad8a-a054cd8393f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:30:07 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-41314626-77fa-4251-830e-a35efe6d402f req-1e7b18df-2635-4d06-9850-bf1a64624f3a service nova] Lock "ee2187c9-8620-4fd2-ad8a-a054cd8393f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:30:07 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-41314626-77fa-4251-830e-a35efe6d402f req-1e7b18df-2635-4d06-9850-bf1a64624f3a service nova] Lock "ee2187c9-8620-4fd2-ad8a-a054cd8393f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:30:07 user nova-compute[75226]: DEBUG nova.compute.manager [req-41314626-77fa-4251-830e-a35efe6d402f req-1e7b18df-2635-4d06-9850-bf1a64624f3a service nova] [instance: ee2187c9-8620-4fd2-ad8a-a054cd8393f3] No waiting events found dispatching network-vif-plugged-1057ea4c-2ac4-40fa-8b2e-3b5888ea4d61 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:30:07 user nova-compute[75226]: WARNING nova.compute.manager [req-41314626-77fa-4251-830e-a35efe6d402f req-1e7b18df-2635-4d06-9850-bf1a64624f3a service nova] [instance: ee2187c9-8620-4fd2-ad8a-a054cd8393f3] Received unexpected event network-vif-plugged-1057ea4c-2ac4-40fa-8b2e-3b5888ea4d61 for instance with vm_state resized and task_state resize_reverting.
Nov 17 01:30:07 user nova-compute[75226]: DEBUG nova.compute.manager [req-41314626-77fa-4251-830e-a35efe6d402f req-1e7b18df-2635-4d06-9850-bf1a64624f3a service nova] [instance: ee2187c9-8620-4fd2-ad8a-a054cd8393f3] Received event network-vif-plugged-1057ea4c-2ac4-40fa-8b2e-3b5888ea4d61 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:30:07 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-41314626-77fa-4251-830e-a35efe6d402f req-1e7b18df-2635-4d06-9850-bf1a64624f3a service nova] Acquiring lock "ee2187c9-8620-4fd2-ad8a-a054cd8393f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:30:07 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-41314626-77fa-4251-830e-a35efe6d402f req-1e7b18df-2635-4d06-9850-bf1a64624f3a service nova] Lock "ee2187c9-8620-4fd2-ad8a-a054cd8393f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:30:07 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-41314626-77fa-4251-830e-a35efe6d402f req-1e7b18df-2635-4d06-9850-bf1a64624f3a service nova] Lock "ee2187c9-8620-4fd2-ad8a-a054cd8393f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:30:07 user nova-compute[75226]: DEBUG nova.compute.manager [req-41314626-77fa-4251-830e-a35efe6d402f req-1e7b18df-2635-4d06-9850-bf1a64624f3a service nova] [instance: ee2187c9-8620-4fd2-ad8a-a054cd8393f3] No waiting events found dispatching network-vif-plugged-1057ea4c-2ac4-40fa-8b2e-3b5888ea4d61 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:30:07 user nova-compute[75226]: WARNING nova.compute.manager [req-41314626-77fa-4251-830e-a35efe6d402f req-1e7b18df-2635-4d06-9850-bf1a64624f3a service nova] [instance: ee2187c9-8620-4fd2-ad8a-a054cd8393f3] Received unexpected event network-vif-plugged-1057ea4c-2ac4-40fa-8b2e-3b5888ea4d61 for instance with vm_state resized and task_state resize_reverting.
Nov 17 01:30:07 user nova-compute[75226]: DEBUG nova.compute.manager [req-41314626-77fa-4251-830e-a35efe6d402f req-1e7b18df-2635-4d06-9850-bf1a64624f3a service nova] [instance: ee2187c9-8620-4fd2-ad8a-a054cd8393f3] Received event network-vif-plugged-1057ea4c-2ac4-40fa-8b2e-3b5888ea4d61 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:30:07 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-41314626-77fa-4251-830e-a35efe6d402f req-1e7b18df-2635-4d06-9850-bf1a64624f3a service nova] Acquiring lock "ee2187c9-8620-4fd2-ad8a-a054cd8393f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:30:07 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-41314626-77fa-4251-830e-a35efe6d402f req-1e7b18df-2635-4d06-9850-bf1a64624f3a service nova] Lock "ee2187c9-8620-4fd2-ad8a-a054cd8393f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:30:07 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-41314626-77fa-4251-830e-a35efe6d402f req-1e7b18df-2635-4d06-9850-bf1a64624f3a service nova] Lock "ee2187c9-8620-4fd2-ad8a-a054cd8393f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:30:07 user nova-compute[75226]: DEBUG nova.compute.manager [req-41314626-77fa-4251-830e-a35efe6d402f req-1e7b18df-2635-4d06-9850-bf1a64624f3a service nova] [instance: ee2187c9-8620-4fd2-ad8a-a054cd8393f3] No waiting events found dispatching network-vif-plugged-1057ea4c-2ac4-40fa-8b2e-3b5888ea4d61 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:30:07 user nova-compute[75226]: WARNING nova.compute.manager [req-41314626-77fa-4251-830e-a35efe6d402f req-1e7b18df-2635-4d06-9850-bf1a64624f3a service nova] [instance: ee2187c9-8620-4fd2-ad8a-a054cd8393f3] Received unexpected event network-vif-plugged-1057ea4c-2ac4-40fa-8b2e-3b5888ea4d61 for instance with vm_state resized and task_state resize_reverting.
Nov 17 01:30:07 user nova-compute[75226]: DEBUG nova.compute.manager [req-41314626-77fa-4251-830e-a35efe6d402f req-1e7b18df-2635-4d06-9850-bf1a64624f3a service nova] [instance: ee2187c9-8620-4fd2-ad8a-a054cd8393f3] Received event network-vif-unplugged-1057ea4c-2ac4-40fa-8b2e-3b5888ea4d61 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:30:07 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-41314626-77fa-4251-830e-a35efe6d402f req-1e7b18df-2635-4d06-9850-bf1a64624f3a service nova] Acquiring lock "ee2187c9-8620-4fd2-ad8a-a054cd8393f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:30:07 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-41314626-77fa-4251-830e-a35efe6d402f req-1e7b18df-2635-4d06-9850-bf1a64624f3a service nova] Lock "ee2187c9-8620-4fd2-ad8a-a054cd8393f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:30:07 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-41314626-77fa-4251-830e-a35efe6d402f req-1e7b18df-2635-4d06-9850-bf1a64624f3a service nova] Lock "ee2187c9-8620-4fd2-ad8a-a054cd8393f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:30:07 user nova-compute[75226]: DEBUG nova.compute.manager [req-41314626-77fa-4251-830e-a35efe6d402f req-1e7b18df-2635-4d06-9850-bf1a64624f3a service nova] [instance: ee2187c9-8620-4fd2-ad8a-a054cd8393f3] No waiting events found dispatching network-vif-unplugged-1057ea4c-2ac4-40fa-8b2e-3b5888ea4d61 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:30:07 user nova-compute[75226]: WARNING nova.compute.manager [req-41314626-77fa-4251-830e-a35efe6d402f req-1e7b18df-2635-4d06-9850-bf1a64624f3a service nova] [instance: ee2187c9-8620-4fd2-ad8a-a054cd8393f3] Received unexpected event network-vif-unplugged-1057ea4c-2ac4-40fa-8b2e-3b5888ea4d61 for instance with vm_state resized and task_state resize_reverting.
Nov 17 01:30:07 user nova-compute[75226]: DEBUG nova.compute.manager [req-41314626-77fa-4251-830e-a35efe6d402f req-1e7b18df-2635-4d06-9850-bf1a64624f3a service nova] [instance: ee2187c9-8620-4fd2-ad8a-a054cd8393f3] Received event network-vif-plugged-1057ea4c-2ac4-40fa-8b2e-3b5888ea4d61 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:30:07 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-41314626-77fa-4251-830e-a35efe6d402f req-1e7b18df-2635-4d06-9850-bf1a64624f3a service nova] Acquiring lock "ee2187c9-8620-4fd2-ad8a-a054cd8393f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:30:07 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-41314626-77fa-4251-830e-a35efe6d402f req-1e7b18df-2635-4d06-9850-bf1a64624f3a service nova] Lock "ee2187c9-8620-4fd2-ad8a-a054cd8393f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:30:07 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-41314626-77fa-4251-830e-a35efe6d402f req-1e7b18df-2635-4d06-9850-bf1a64624f3a service nova] Lock "ee2187c9-8620-4fd2-ad8a-a054cd8393f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:30:07 user nova-compute[75226]: DEBUG nova.compute.manager [req-41314626-77fa-4251-830e-a35efe6d402f req-1e7b18df-2635-4d06-9850-bf1a64624f3a service nova] [instance: ee2187c9-8620-4fd2-ad8a-a054cd8393f3] No waiting events found dispatching network-vif-plugged-1057ea4c-2ac4-40fa-8b2e-3b5888ea4d61 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:30:07 user nova-compute[75226]: WARNING nova.compute.manager [req-41314626-77fa-4251-830e-a35efe6d402f req-1e7b18df-2635-4d06-9850-bf1a64624f3a service nova] [instance: ee2187c9-8620-4fd2-ad8a-a054cd8393f3] Received unexpected event network-vif-plugged-1057ea4c-2ac4-40fa-8b2e-3b5888ea4d61 for instance with vm_state resized and task_state resize_reverting.
Nov 17 01:30:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:30:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:30:07 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:30:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:30:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ea5a14b-c330-4a2b-926e-60e1b30f5981/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:30:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ea5a14b-c330-4a2b-926e-60e1b30f5981/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:30:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ea5a14b-c330-4a2b-926e-60e1b30f5981/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:30:08 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-c8e6edb0-73b7-40d7-ad3a-181d8091016a tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:30:08 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-c8e6edb0-73b7-40d7-ad3a-181d8091016a tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:30:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ea5a14b-c330-4a2b-926e-60e1b30f5981/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:30:08 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75226) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 01:30:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dcdd769-bbfe-48e8-a876-8b2072b7baeb/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:30:08 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-c8e6edb0-73b7-40d7-ad3a-181d8091016a tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.801s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:30:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dcdd769-bbfe-48e8-a876-8b2072b7baeb/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:30:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dcdd769-bbfe-48e8-a876-8b2072b7baeb/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:30:08 user nova-compute[75226]: INFO nova.compute.manager [None req-c8e6edb0-73b7-40d7-ad3a-181d8091016a tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] [instance: ee2187c9-8620-4fd2-ad8a-a054cd8393f3] Swapping old allocation on dict_keys(['f431122b-abb2-4ecb-9e21-e3ec333d823b']) held by migration 96afa0fa-c757-4cd5-beaa-0507610ab24f for instance
Nov 17 01:30:08 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-c8e6edb0-73b7-40d7-ad3a-181d8091016a tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Overwriting current allocation {'allocations': {'f431122b-abb2-4ecb-9e21-e3ec333d823b': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 36}}, 'project_id': 'c19f767dc7bb4024b3cbf1d8f5f8f2bf', 'user_id': 'f0952a7e2dd64bf2adb2e224965377ab', 'consumer_generation': 1} on consumer ee2187c9-8620-4fd2-ad8a-a054cd8393f3 {{(pid=75226) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Nov 17 01:30:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dcdd769-bbfe-48e8-a876-8b2072b7baeb/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:30:08 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75226) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 01:30:09 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:30:09 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:30:09 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Hypervisor/Node resource view: name=user free_ram=7276MB free_disk=24.89484405517578GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75226) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 17 01:30:09 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:30:09 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:30:09 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-c8e6edb0-73b7-40d7-ad3a-181d8091016a tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Acquiring lock "refresh_cache-ee2187c9-8620-4fd2-ad8a-a054cd8393f3" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:30:09 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-c8e6edb0-73b7-40d7-ad3a-181d8091016a tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Acquired lock "refresh_cache-ee2187c9-8620-4fd2-ad8a-a054cd8393f3" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:30:09 user nova-compute[75226]: DEBUG nova.network.neutron [None req-c8e6edb0-73b7-40d7-ad3a-181d8091016a tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] [instance: ee2187c9-8620-4fd2-ad8a-a054cd8393f3] Building network info cache for instance {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 01:30:09 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance aa84e575-bdad-45b9-80ce-86b1c2826fb0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:30:09 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 6b7e9611-be35-4e51-b886-91a2fac0a653 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:30:09 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:30:09 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 38062487-67ca-4962-974f-81456aebe97b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:30:09 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 4050d898-f2b8-46c2-86e3-702ceb41a701 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:30:09 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 4dcdd769-bbfe-48e8-a876-8b2072b7baeb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:30:09 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 2ea5a14b-c330-4a2b-926e-60e1b30f5981 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:30:09 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance d6555d72-6094-4ea9-b071-a3d3c8a300a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:30:09 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 5c280142-8901-4f83-bde4-baaa097e05b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:30:09 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance bef5f981-8fcb-4433-87bf-f958f3f57424 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:30:09 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance ee2187c9-8620-4fd2-ad8a-a054cd8393f3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:30:09 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 3018e3a2-01e0-49d7-a960-51718709845a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:30:09 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 9e8b4b85-fe0c-4592-850e-e94ebab32d02 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:30:09 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=75226) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 17 01:30:09 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=75226) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 17 01:30:09 user nova-compute[75226]: DEBUG nova.network.neutron [None req-c8e6edb0-73b7-40d7-ad3a-181d8091016a tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] [instance: ee2187c9-8620-4fd2-ad8a-a054cd8393f3] Updating instance_info_cache with network_info: [{"id": "1057ea4c-2ac4-40fa-8b2e-3b5888ea4d61", "address": "fa:16:3e:4a:f5:8f", "network": {"id": "3d8c3322-c78d-4d3a-b8c7-ba12241b4c65", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1996535656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c19f767dc7bb4024b3cbf1d8f5f8f2bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1057ea4c-2a", "ovs_interfaceid": "1057ea4c-2ac4-40fa-8b2e-3b5888ea4d61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:30:09 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-c8e6edb0-73b7-40d7-ad3a-181d8091016a tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Releasing lock "refresh_cache-ee2187c9-8620-4fd2-ad8a-a054cd8393f3" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:30:09 user nova-compute[75226]: DEBUG os_brick.utils [None req-c8e6edb0-73b7-40d7-ad3a-181d8091016a tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:30:09 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:30:09 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:30:09 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[a358e00f-b1a2-44e2-ad9c-31803e51a2ff]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f62857db69\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:30:09 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:30:09 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:30:09 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[f553b8b6-c046-4679-9529-a1c332f2a9db]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:30:09 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:30:09 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:30:09 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:30:09 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d7a8cf6-95f6-43af-a4f5-69946c1fc8fd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:30:09 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6557bb6-e7d0-44b7-a32f-4ed1fff842bc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:30:09 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-c8e6edb0-73b7-40d7-ad3a-181d8091016a tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Running cmd (subprocess): nvme version {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:30:09 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-c8e6edb0-73b7-40d7-ad3a-181d8091016a tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] 'nvme version' failed. Not Retrying. {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 01:30:09 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c8e6edb0-73b7-40d7-ad3a-181d8091016a tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] nvme not present on system {{(pid=75226) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 17 01:30:09 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:30:09 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:30:09 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 01:30:09 user nova-compute[75226]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 17 01:30:09 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[929c539f-ece3-4ff9-a05d-8200233a1b46]: (4, '') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:30:09 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-c8e6edb0-73b7-40d7-ad3a-181d8091016a tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75226) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 17 01:30:09 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-c8e6edb0-73b7-40d7-ad3a-181d8091016a tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75226) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 17 01:30:09 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-c8e6edb0-73b7-40d7-ad3a-181d8091016a tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] LIGHTOS: no hostnqn found. {{(pid=75226) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 17 01:30:09 user nova-compute[75226]: DEBUG os_brick.utils [None req-c8e6edb0-73b7-40d7-ad3a-181d8091016a tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f62857db69', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:30:09 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Compute_service record updated for user:user {{(pid=75226) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 17 01:30:09 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.561s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:30:10 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:30:10 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:30:10 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:30:10 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:30:11 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:30:12 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:30:12 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:30:12 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75226) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 17 01:30:13 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:30:13 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Starting heal instance info cache {{(pid=75226) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 17 01:30:13 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Rebuilding the list of instances to heal {{(pid=75226) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 17 01:30:14 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "refresh_cache-aa84e575-bdad-45b9-80ce-86b1c2826fb0" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:30:14 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquired lock "refresh_cache-aa84e575-bdad-45b9-80ce-86b1c2826fb0" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:30:14 user nova-compute[75226]: DEBUG nova.network.neutron [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] [instance: aa84e575-bdad-45b9-80ce-86b1c2826fb0] Forcefully refreshing network info cache for instance {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 17 01:30:14 user nova-compute[75226]: DEBUG nova.objects.instance [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lazy-loading 'info_cache' on Instance uuid aa84e575-bdad-45b9-80ce-86b1c2826fb0 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:30:14 user nova-compute[75226]: DEBUG nova.network.neutron [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] [instance: aa84e575-bdad-45b9-80ce-86b1c2826fb0] Updating instance_info_cache with network_info: [{"id": "734a9e23-26e5-4282-b842-62e0bb37c782", "address": "fa:16:3e:60:90:47", "network": {"id": "450540a3-ff7e-42fb-a0a6-808acd749943", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1503678778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6cb6f679ee4468d82cc7fb5d0f67be9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap734a9e23-26", "ovs_interfaceid": "734a9e23-26e5-4282-b842-62e0bb37c782", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:30:14 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Releasing lock "refresh_cache-aa84e575-bdad-45b9-80ce-86b1c2826fb0" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:30:14 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] [instance: aa84e575-bdad-45b9-80ce-86b1c2826fb0] Updated the network info_cache for instance {{(pid=75226) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 17 01:30:14 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-312853ce-7fdc-45a9-afe7-f0a8ffa148f5 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance bef5f981-8fcb-4433-87bf-f958f3f57424 is timed out.
Nov 17 01:30:14 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-312853ce-7fdc-45a9-afe7-f0a8ffa148f5 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Successfully detached device vdb from instance bef5f981-8fcb-4433-87bf-f958f3f57424 from the live domain config.
Nov 17 01:30:14 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-312853ce-7fdc-45a9-afe7-f0a8ffa148f5 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: bef5f981-8fcb-4433-87bf-f958f3f57424] calling os-brick to detach iSCSI Volume {{(pid=75226) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 17 01:30:14 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-312853ce-7fdc-45a9-afe7-f0a8ffa148f5 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc4cc36b490>, {'target_iqn': 'iqn.2010-10.org.openstack:78090354-58ed-4e95-9927-502d1e661eba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cMoLnyef', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:30:14 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-312853ce-7fdc-45a9-afe7-f0a8ffa148f5 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:30:14 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-312853ce-7fdc-45a9-afe7-f0a8ffa148f5 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:30:14 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-312853ce-7fdc-45a9-afe7-f0a8ffa148f5 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:30:14 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:30:14 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:30:14 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[43af11b7-6eb7-433d-9203-7a1fd6f44740]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:78090354-58ed-4e95-9927-502d1e661eba\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:05f878e5-0241-4282-8b2c-c4651c429dcb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:30:14 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-312853ce-7fdc-45a9-afe7-f0a8ffa148f5 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 17 01:30:14 user nova-compute[75226]: No targets found.
Nov 17 01:30:14 user nova-compute[75226]: iSNS:
Nov 17 01:30:14 user nova-compute[75226]: No targets found.
Nov 17 01:30:14 user nova-compute[75226]: STATIC:
Nov 17 01:30:14 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:78090354-58ed-4e95-9927-502d1e661eba
Nov 17 01:30:14 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:30:14 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:30:14 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14
Nov 17 01:30:14 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:30:14 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:30:14 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:05f878e5-0241-4282-8b2c-c4651c429dcb
Nov 17 01:30:14 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:30:14 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:30:14 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8
Nov 17 01:30:14 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:30:14 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:30:14 user nova-compute[75226]: FIRMWARE:
Nov 17 01:30:14 user nova-compute[75226]: No targets found.
Nov 17 01:30:14 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:30:14 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-312853ce-7fdc-45a9-afe7-f0a8ffa148f5 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 17 01:30:14 user nova-compute[75226]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 17 01:30:14 user nova-compute[75226]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75226) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 17 01:30:14 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-312853ce-7fdc-45a9-afe7-f0a8ffa148f5 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:78090354-58ed-4e95-9927-502d1e661eba', 0)] {{(pid=75226) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 17 01:30:14 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:30:14 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:30:14 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cbcc424-4d36-4043-b790-444cf78a6123]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:05f878e5-0241-4282-8b2c-c4651c429dcb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78090354-58ed-4e95-9927-502d1e661eba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:30:14 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:30:14 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:30:14 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[d90feed8-c49a-43f8-b70a-419140de384d]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05f878e5-0241-4282-8b2c-c4651c429dcb (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78090354-58ed-4e95-9927-502d1e661eba (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:30:14 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-312853ce-7fdc-45a9-afe7-f0a8ffa148f5 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)
Nov 17 01:30:14 user nova-compute[75226]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14 (non-flash)
Nov 17 01:30:14 user nova-compute[75226]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05f878e5-0241-4282-8b2c-c4651c429dcb (non-flash)
Nov 17 01:30:14 user nova-compute[75226]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78090354-58ed-4e95-9927-502d1e661eba (non-flash)
Nov 17 01:30:14 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:30:14 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-312853ce-7fdc-45a9-afe7-f0a8ffa148f5 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)
Nov 17 01:30:14 user nova-compute[75226]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14 (non-flash)
Nov 17 01:30:14 user nova-compute[75226]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05f878e5-0241-4282-8b2c-c4651c429dcb (non-flash)
Nov 17 01:30:14 user nova-compute[75226]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78090354-58ed-4e95-9927-502d1e661eba (non-flash)
Nov 17 01:30:14 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:30:14 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-312853ce-7fdc-45a9-afe7-f0a8ffa148f5 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc4b45d3be0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:78090354-58ed-4e95-9927-502d1e661eba'): ({'sdf'}, set())}) {{(pid=75226) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 17 01:30:14 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-312853ce-7fdc-45a9-afe7-f0a8ffa148f5 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Removing single pathed devices sdf {{(pid=75226) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 17 01:30:14 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:30:14 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:30:14 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd62e2b8-905d-4bcf-94a8-c8ff362d287e]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:30:14 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:30:14 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:30:14 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[c570d859-10a1-4a4e-896f-062fc4ba6879]: (4, ('ok\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:30:14 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-312853ce-7fdc-45a9-afe7-f0a8ffa148f5 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Flushing IO for device /dev/sdf {{(pid=75226) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 17 01:30:14 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:30:14 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:30:14 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e7bff6d-d238-4b76-8cbc-61e054fb0708]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:30:14 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-312853ce-7fdc-45a9-afe7-f0a8ffa148f5 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75226) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 17 01:30:14 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:30:15 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.045s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:30:15 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[52d592b0-0004-4145-bc95-d5bbc1ac3cef]: (4, ('1', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:30:15 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-312853ce-7fdc-45a9-afe7-f0a8ffa148f5 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75226) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 17 01:30:15 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-312853ce-7fdc-45a9-afe7-f0a8ffa148f5 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] SCSI volumes sdf have been removed. {{(pid=75226) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 17 01:30:15 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-312853ce-7fdc-45a9-afe7-f0a8ffa148f5 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:78090354-58ed-4e95-9927-502d1e661eba')] {{(pid=75226) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 17 01:30:15 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78090354-58ed-4e95-9927-502d1e661eba -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:30:15 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78090354-58ed-4e95-9927-502d1e661eba -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:30:15 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0de2d21-c8cc-4384-84b4-a9b4fc20e527]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:30:15 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-312853ce-7fdc-45a9-afe7-f0a8ffa148f5 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:30:15 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78090354-58ed-4e95-9927-502d1e661eba -p 172.16.0.220:3260 --logout {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:30:15 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-c8e6edb0-73b7-40d7-ad3a-181d8091016a tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] [instance: ee2187c9-8620-4fd2-ad8a-a054cd8393f3] Starting finish_revert_migration {{(pid=75226) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Nov 17 01:30:15 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-c8e6edb0-73b7-40d7-ad3a-181d8091016a tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] [instance: ee2187c9-8620-4fd2-ad8a-a054cd8393f3] Start _get_guest_xml network_info=[{"id": "1057ea4c-2ac4-40fa-8b2e-3b5888ea4d61", "address": "fa:16:3e:4a:f5:8f", "network": {"id": "3d8c3322-c78d-4d3a-b8c7-ba12241b4c65", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1996535656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c19f767dc7bb4024b3cbf1d8f5f8f2bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1057ea4c-2a", "ovs_interfaceid": "1057ea4c-2ac4-40fa-8b2e-3b5888ea4d61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=0b369aea-6f3f-4690-9f01-229b90ab6310,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '0b369aea-6f3f-4690-9f01-229b90ab6310'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'boot_index': None, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qFQXscng', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'ee2187c9-8620-4fd2-ad8a-a054cd8393f3', 'attached_at': '2023-11-17T01:30:15.000000', 'detached_at': '', 'volume_id': '1bdffe6a-77b2-4ed9-9d93-5e432bde62ba', 'serial': '1bdffe6a-77b2-4ed9-9d93-5e432bde62ba'}, 'attachment_id': 'ae1e3815-361b-4d9c-9c21-a4d065e3840c', 'device_type': 'disk', 'volume_type': None} {{(pid=75226) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 17 01:30:15 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-c8e6edb0-73b7-40d7-ad3a-181d8091016a tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:30:15 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-c8e6edb0-73b7-40d7-ad3a-181d8091016a tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:30:15 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-c8e6edb0-73b7-40d7-ad3a-181d8091016a tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75226) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 17 01:30:15 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-c8e6edb0-73b7-40d7-ad3a-181d8091016a tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] CPU controller missing on host. {{(pid=75226) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 17 01:30:15 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-c8e6edb0-73b7-40d7-ad3a-181d8091016a tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75226) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 17 01:30:15 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-c8e6edb0-73b7-40d7-ad3a-181d8091016a tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] CPU controller found on host. {{(pid=75226) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 17 01:30:15 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-c8e6edb0-73b7-40d7-ad3a-181d8091016a tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75226) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 17 01:30:15 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-c8e6edb0-73b7-40d7-ad3a-181d8091016a tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-17T01:13:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=0b369aea-6f3f-4690-9f01-229b90ab6310,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 17 01:30:15 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-c8e6edb0-73b7-40d7-ad3a-181d8091016a tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Flavor limits 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 17 01:30:15 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-c8e6edb0-73b7-40d7-ad3a-181d8091016a tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Image limits 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 17 01:30:15 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-c8e6edb0-73b7-40d7-ad3a-181d8091016a tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Flavor pref 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 17 01:30:15 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-c8e6edb0-73b7-40d7-ad3a-181d8091016a tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Image pref 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 17 01:30:15 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-c8e6edb0-73b7-40d7-ad3a-181d8091016a tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 17 01:30:15 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-c8e6edb0-73b7-40d7-ad3a-181d8091016a tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 17 01:30:15 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-c8e6edb0-73b7-40d7-ad3a-181d8091016a tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75226) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 17 01:30:15 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-c8e6edb0-73b7-40d7-ad3a-181d8091016a tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Got 1 possible topologies {{(pid=75226) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 17 01:30:15 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-c8e6edb0-73b7-40d7-ad3a-181d8091016a tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 17 01:30:15 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-c8e6edb0-73b7-40d7-ad3a-181d8091016a tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 17 01:30:15 user nova-compute[75226]: DEBUG nova.objects.instance [None req-c8e6edb0-73b7-40d7-ad3a-181d8091016a tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Lazy-loading 'vcpu_model' on Instance uuid ee2187c9-8620-4fd2-ad8a-a054cd8393f3 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:30:15 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8e6edb0-73b7-40d7-ad3a-181d8091016a tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] [instance: ee2187c9-8620-4fd2-ad8a-a054cd8393f3] Calling os-brick to attach iSCSI Volume {{(pid=75226) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 17 01:30:15 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8e6edb0-73b7-40d7-ad3a-181d8091016a tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc4cc36b490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qFQXscng', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:30:15 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-c8e6edb0-73b7-40d7-ad3a-181d8091016a tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:30:15 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-c8e6edb0-73b7-40d7-ad3a-181d8091016a tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:30:15 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78090354-58ed-4e95-9927-502d1e661eba -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:30:15 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[c00f7df2-47be-403b-94db-42a1082ca113]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:78090354-58ed-4e95-9927-502d1e661eba, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:78090354-58ed-4e95-9927-502d1e661eba, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:30:15 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-312853ce-7fdc-45a9-afe7-f0a8ffa148f5 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:78090354-58ed-4e95-9927-502d1e661eba, portal: 172.16.0.220,3260]
Nov 17 01:30:15 user nova-compute[75226]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:78090354-58ed-4e95-9927-502d1e661eba, portal: 172.16.0.220,3260] successful.
Nov 17 01:30:15 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:30:15 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78090354-58ed-4e95-9927-502d1e661eba -p 172.16.0.220:3260 --op delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:30:15 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78090354-58ed-4e95-9927-502d1e661eba -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:30:15 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d08a2a8-2608-47c7-ab01-da912a2b7302]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:30:15 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-312853ce-7fdc-45a9-afe7-f0a8ffa148f5 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:30:15 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-312853ce-7fdc-45a9-afe7-f0a8ffa148f5 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.336s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:30:15 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-312853ce-7fdc-45a9-afe7-f0a8ffa148f5 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] <== disconnect_volume: return (337ms) None {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:30:15 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-312853ce-7fdc-45a9-afe7-f0a8ffa148f5 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: bef5f981-8fcb-4433-87bf-f958f3f57424] Disconnected iSCSI Volume {{(pid=75226) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 17 01:30:15 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-c8e6edb0-73b7-40d7-ad3a-181d8091016a tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.037s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:30:15 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-c8e6edb0-73b7-40d7-ad3a-181d8091016a tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:30:15 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-c8e6edb0-73b7-40d7-ad3a-181d8091016a tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:30:15 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-c8e6edb0-73b7-40d7-ad3a-181d8091016a tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:30:15 user nova-compute[75226]: INFO os_brick.initiator.connectors.iscsi [None req-c8e6edb0-73b7-40d7-ad3a-181d8091016a tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 17 01:30:15 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba -p 172.16.0.220:3260 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:30:15 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:30:15 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3c7fa57-7254-40d1-890a-625443da4997]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:30:15 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8e6edb0-73b7-40d7-ad3a-181d8091016a tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 17 01:30:15 user nova-compute[75226]:  {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:30:15 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba -p 172.16.0.220:3260 --interface default --op new {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:30:15 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:30:15 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9f4cc08-781e-4710-af54-1c7bb8c3ab41]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba] added\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:30:15 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8e6edb0-73b7-40d7-ad3a-181d8091016a tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba] added
Nov 17 01:30:15 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:30:15 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:30:15 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:30:15 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[50e61567-14bc-49ca-8931-20feb23d53b5]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:30:15 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8e6edb0-73b7-40d7-ad3a-181d8091016a tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:30:15 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:30:15 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:30:15 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[50a9c98b-902b-4caf-aa63-a25abeee266b]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:30:15 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8e6edb0-73b7-40d7-ad3a-181d8091016a tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:30:15 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qFQXscng {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:30:15 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qFQXscng" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:30:15 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[37fca004-d9ca-4eb8-88e0-38d07f5d49c0]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:30:15 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8e6edb0-73b7-40d7-ad3a-181d8091016a tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qFQXscng'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:30:15 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:30:15 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:30:15 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1e19c5a-5d8e-46fe-b5cc-e7de2d44b5f9]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:30:15 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8e6edb0-73b7-40d7-ad3a-181d8091016a tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:30:15 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:30:15 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:30:15 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[623ca93f-77fb-4843-a2c0-f4039873a7f2]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05f878e5-0241-4282-8b2c-c4651c429dcb (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:30:15 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8e6edb0-73b7-40d7-ad3a-181d8091016a tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)
Nov 17 01:30:15 user nova-compute[75226]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14 (non-flash)
Nov 17 01:30:15 user nova-compute[75226]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05f878e5-0241-4282-8b2c-c4651c429dcb (non-flash)
Nov 17 01:30:15 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:30:15 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8e6edb0-73b7-40d7-ad3a-181d8091016a tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)
Nov 17 01:30:15 user nova-compute[75226]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14 (non-flash)
Nov 17 01:30:15 user nova-compute[75226]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05f878e5-0241-4282-8b2c-c4651c429dcb (non-flash)
Nov 17 01:30:15 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:30:15 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba -p 172.16.0.220:3260 --login {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:30:15 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:30:15 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[66bd51ee-d1a6-4be8-9bb8-06697e991cae]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:30:15 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8e6edb0-73b7-40d7-ad3a-181d8091016a tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba, portal: 172.16.0.220,3260]
Nov 17 01:30:15 user nova-compute[75226]: Login to [iface: default, target: iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba, portal: 172.16.0.220,3260] successful.
Nov 17 01:30:15 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:30:15 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:30:15 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:30:15 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[85093bd7-2961-4442-8cb1-90e143ad3f93]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:30:15 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8e6edb0-73b7-40d7-ad3a-181d8091016a tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:30:15 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:30:15 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:30:15 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d89108b-c812-4304-9272-cc0ffdd5e1da]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05f878e5-0241-4282-8b2c-c4651c429dcb (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:30:15 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8e6edb0-73b7-40d7-ad3a-181d8091016a tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)
Nov 17 01:30:15 user nova-compute[75226]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14 (non-flash)
Nov 17 01:30:15 user nova-compute[75226]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05f878e5-0241-4282-8b2c-c4651c429dcb (non-flash)
Nov 17 01:30:15 user nova-compute[75226]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba (non-flash)
Nov 17 01:30:15 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:30:15 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8e6edb0-73b7-40d7-ad3a-181d8091016a tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)
Nov 17 01:30:15 user nova-compute[75226]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14 (non-flash)
Nov 17 01:30:15 user nova-compute[75226]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05f878e5-0241-4282-8b2c-c4651c429dcb (non-flash)
Nov 17 01:30:15 user nova-compute[75226]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba (non-flash)
Nov 17 01:30:15 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:30:15 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-c8e6edb0-73b7-40d7-ad3a-181d8091016a tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.298s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:30:15 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8e6edb0-73b7-40d7-ad3a-181d8091016a tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Connected to 172.16.0.220:3260 {{(pid=75226) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 17 01:30:15 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-c8e6edb0-73b7-40d7-ad3a-181d8091016a tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] HCTL ('33', '-', '-', 0) found on session 34 with lun 0 {{(pid=75226) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 17 01:30:15 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-c8e6edb0-73b7-40d7-ad3a-181d8091016a tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75226) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 17 01:30:15 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:30:15 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:30:15 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[be37b064-6b7b-4d81-87a2-1601cce2f9fe]: (4, ('- - 0', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:30:15 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-c8e6edb0-73b7-40d7-ad3a-181d8091016a tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Searching for a device in session 34 and hctl ['33', '*', '*', 0] yield: None {{(pid=75226) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 01:30:15 user nova-compute[75226]: DEBUG nova.objects.instance [None req-312853ce-7fdc-45a9-afe7-f0a8ffa148f5 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Lazy-loading 'flavor' on Instance uuid bef5f981-8fcb-4433-87bf-f958f3f57424 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:30:15 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-312853ce-7fdc-45a9-afe7-f0a8ffa148f5 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Lock "bef5f981-8fcb-4433-87bf-f958f3f57424" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.781s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:30:16 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:30:16 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-c8e6edb0-73b7-40d7-ad3a-181d8091016a tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Searching for a device in session 34 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75226) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 01:30:16 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8e6edb0-73b7-40d7-ad3a-181d8091016a tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qFQXscng', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75226) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 17 01:30:16 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-c8e6edb0-73b7-40d7-ad3a-181d8091016a tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.330s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:30:16 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8e6edb0-73b7-40d7-ad3a-181d8091016a tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] <== connect_volume: return (1367ms) {'type': 'block', 'scsi_wwn': '26365326232616566', 'path': '/dev/sdb'} {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:30:16 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8e6edb0-73b7-40d7-ad3a-181d8091016a tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] [instance: ee2187c9-8620-4fd2-ad8a-a054cd8393f3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26365326232616566', 'path': '/dev/sdb'} {{(pid=75226) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 17 01:30:16 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-c8e6edb0-73b7-40d7-ad3a-181d8091016a tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:24:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1878692867',display_name='tempest-ServerActionsTestOtherB-server-1878692867',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1878692867',id=21,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBTPdFaRxKgPkRdKbUEvHAZcoj+dPC43zryXBmo0q5ihjaLD04DW9eJSP+KLH1T/XkmERKqJKOvG49EB5qtvQ6Fib4lL66B3axWTUVDvaaC20Rh3bH2XA1pGQ2EKVxiHfg==',key_name='tempest-keypair-1901957685',keypairs=<?>,launch_index=0,launched_at=2023-11-17T01:28:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c19f767dc7bb4024b3cbf1d8f5f8f2bf',ramdisk_id='',reservation_id='r-p9pzzoi2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-229085712',owner_user_name='tempest-ServerActionsTestOtherB-229085712-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T01:30:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f0952a7e2dd64bf2adb2e224965377ab',uuid=ee2187c9-8620-4fd2-ad8a-a054cd8393f3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "1057ea4c-2ac4-40fa-8b2e-3b5888ea4d61", "address": "fa:16:3e:4a:f5:8f", "network": {"id": "3d8c3322-c78d-4d3a-b8c7-ba12241b4c65", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1996535656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c19f767dc7bb4024b3cbf1d8f5f8f2bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1057ea4c-2a", "ovs_interfaceid": "1057ea4c-2ac4-40fa-8b2e-3b5888ea4d61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75226) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 01:30:16 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-c8e6edb0-73b7-40d7-ad3a-181d8091016a tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Converting VIF {"id": "1057ea4c-2ac4-40fa-8b2e-3b5888ea4d61", "address": "fa:16:3e:4a:f5:8f", "network": {"id": "3d8c3322-c78d-4d3a-b8c7-ba12241b4c65", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1996535656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c19f767dc7bb4024b3cbf1d8f5f8f2bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1057ea4c-2a", "ovs_interfaceid": "1057ea4c-2ac4-40fa-8b2e-3b5888ea4d61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:30:16 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-c8e6edb0-73b7-40d7-ad3a-181d8091016a tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:f5:8f,bridge_name='br-int',has_traffic_filtering=True,id=1057ea4c-2ac4-40fa-8b2e-3b5888ea4d61,network=Network(3d8c3322-c78d-4d3a-b8c7-ba12241b4c65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1057ea4c-2a') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:30:16 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-c8e6edb0-73b7-40d7-ad3a-181d8091016a tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] [instance: ee2187c9-8620-4fd2-ad8a-a054cd8393f3] End _get_guest_xml xml=<domain type="kvm">
Nov 17 01:30:16 user nova-compute[75226]:   <uuid>ee2187c9-8620-4fd2-ad8a-a054cd8393f3</uuid>
Nov 17 01:30:16 user nova-compute[75226]:   <name>instance-00000015</name>
Nov 17 01:30:16 user nova-compute[75226]:   <memory>524288</memory>
Nov 17 01:30:16 user nova-compute[75226]:   <vcpu>1</vcpu>
Nov 17 01:30:16 user nova-compute[75226]:   <metadata>
Nov 17 01:30:16 user nova-compute[75226]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 17 01:30:16 user nova-compute[75226]:       <nova:package version="0.0.0"/>
Nov 17 01:30:16 user nova-compute[75226]:       <nova:name>tempest-ServerActionsTestOtherB-server-1878692867</nova:name>
Nov 17 01:30:16 user nova-compute[75226]:       <nova:creationTime>2023-11-17 01:30:15</nova:creationTime>
Nov 17 01:30:16 user nova-compute[75226]:       <nova:flavor name="m1.tiny">
Nov 17 01:30:16 user nova-compute[75226]:         <nova:memory>512</nova:memory>
Nov 17 01:30:16 user nova-compute[75226]:         <nova:disk>1</nova:disk>
Nov 17 01:30:16 user nova-compute[75226]:         <nova:swap>0</nova:swap>
Nov 17 01:30:16 user nova-compute[75226]:         <nova:ephemeral>0</nova:ephemeral>
Nov 17 01:30:16 user nova-compute[75226]:         <nova:vcpus>1</nova:vcpus>
Nov 17 01:30:16 user nova-compute[75226]:       </nova:flavor>
Nov 17 01:30:16 user nova-compute[75226]:       <nova:owner>
Nov 17 01:30:16 user nova-compute[75226]:         <nova:user uuid="f0952a7e2dd64bf2adb2e224965377ab">tempest-ServerActionsTestOtherB-229085712-project-member</nova:user>
Nov 17 01:30:16 user nova-compute[75226]:         <nova:project uuid="c19f767dc7bb4024b3cbf1d8f5f8f2bf">tempest-ServerActionsTestOtherB-229085712</nova:project>
Nov 17 01:30:16 user nova-compute[75226]:       </nova:owner>
Nov 17 01:30:16 user nova-compute[75226]:       <nova:root type="image" uuid="0b369aea-6f3f-4690-9f01-229b90ab6310"/>
Nov 17 01:30:16 user nova-compute[75226]:       <nova:ports>
Nov 17 01:30:16 user nova-compute[75226]:         <nova:port uuid="1057ea4c-2ac4-40fa-8b2e-3b5888ea4d61">
Nov 17 01:30:16 user nova-compute[75226]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 17 01:30:16 user nova-compute[75226]:         </nova:port>
Nov 17 01:30:16 user nova-compute[75226]:       </nova:ports>
Nov 17 01:30:16 user nova-compute[75226]:     </nova:instance>
Nov 17 01:30:16 user nova-compute[75226]:   </metadata>
Nov 17 01:30:16 user nova-compute[75226]:   <sysinfo type="smbios">
Nov 17 01:30:16 user nova-compute[75226]:     <system>
Nov 17 01:30:16 user nova-compute[75226]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 17 01:30:16 user nova-compute[75226]:       <entry name="product">OpenStack Nova</entry>
Nov 17 01:30:16 user nova-compute[75226]:       <entry name="version">0.0.0</entry>
Nov 17 01:30:16 user nova-compute[75226]:       <entry name="serial">ee2187c9-8620-4fd2-ad8a-a054cd8393f3</entry>
Nov 17 01:30:16 user nova-compute[75226]:       <entry name="uuid">ee2187c9-8620-4fd2-ad8a-a054cd8393f3</entry>
Nov 17 01:30:16 user nova-compute[75226]:       <entry name="family">Virtual Machine</entry>
Nov 17 01:30:16 user nova-compute[75226]:     </system>
Nov 17 01:30:16 user nova-compute[75226]:   </sysinfo>
Nov 17 01:30:16 user nova-compute[75226]:   <os>
Nov 17 01:30:16 user nova-compute[75226]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 17 01:30:16 user nova-compute[75226]:     <boot dev="hd"/>
Nov 17 01:30:16 user nova-compute[75226]:     <smbios mode="sysinfo"/>
Nov 17 01:30:16 user nova-compute[75226]:   </os>
Nov 17 01:30:16 user nova-compute[75226]:   <features>
Nov 17 01:30:16 user nova-compute[75226]:     <acpi/>
Nov 17 01:30:16 user nova-compute[75226]:     <apic/>
Nov 17 01:30:16 user nova-compute[75226]:     <vmcoreinfo/>
Nov 17 01:30:16 user nova-compute[75226]:   </features>
Nov 17 01:30:16 user nova-compute[75226]:   <clock offset="utc">
Nov 17 01:30:16 user nova-compute[75226]:     <timer name="pit" tickpolicy="delay"/>
Nov 17 01:30:16 user nova-compute[75226]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 17 01:30:16 user nova-compute[75226]:     <timer name="hpet" present="no"/>
Nov 17 01:30:16 user nova-compute[75226]:   </clock>
Nov 17 01:30:16 user nova-compute[75226]:   <cpu mode="custom" match="exact">
Nov 17 01:30:16 user nova-compute[75226]:     <model>Nehalem</model>
Nov 17 01:30:16 user nova-compute[75226]:     <topology sockets="1" cores="1" threads="1"/>
Nov 17 01:30:16 user nova-compute[75226]:   </cpu>
Nov 17 01:30:16 user nova-compute[75226]:   <devices>
Nov 17 01:30:16 user nova-compute[75226]:     <disk type="file" device="disk">
Nov 17 01:30:16 user nova-compute[75226]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 17 01:30:16 user nova-compute[75226]:       <source file="/opt/stack/data/nova/instances/ee2187c9-8620-4fd2-ad8a-a054cd8393f3/disk"/>
Nov 17 01:30:16 user nova-compute[75226]:       <target dev="vda" bus="virtio"/>
Nov 17 01:30:16 user nova-compute[75226]:     </disk>
Nov 17 01:30:16 user nova-compute[75226]:     <disk type="block" device="disk">
Nov 17 01:30:16 user nova-compute[75226]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 01:30:16 user nova-compute[75226]:       <source dev="/dev/sdb"/>
Nov 17 01:30:16 user nova-compute[75226]:       <target dev="vdb" bus="virtio"/>
Nov 17 01:30:16 user nova-compute[75226]:       <serial>1bdffe6a-77b2-4ed9-9d93-5e432bde62ba</serial>
Nov 17 01:30:16 user nova-compute[75226]:     </disk>
Nov 17 01:30:16 user nova-compute[75226]:     <interface type="ethernet">
Nov 17 01:30:16 user nova-compute[75226]:       <mac address="fa:16:3e:4a:f5:8f"/>
Nov 17 01:30:16 user nova-compute[75226]:       <model type="virtio"/>
Nov 17 01:30:16 user nova-compute[75226]:       <mtu size="1442"/>
Nov 17 01:30:16 user nova-compute[75226]:       <target dev="tap1057ea4c-2a"/>
Nov 17 01:30:16 user nova-compute[75226]:     </interface>
Nov 17 01:30:16 user nova-compute[75226]:     <serial type="pty">
Nov 17 01:30:16 user nova-compute[75226]:       <log file="/opt/stack/data/nova/instances/ee2187c9-8620-4fd2-ad8a-a054cd8393f3/console.log" append="off"/>
Nov 17 01:30:16 user nova-compute[75226]:     </serial>
Nov 17 01:30:16 user nova-compute[75226]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 17 01:30:16 user nova-compute[75226]:     <video>
Nov 17 01:30:16 user nova-compute[75226]:       <model type="virtio"/>
Nov 17 01:30:16 user nova-compute[75226]:     </video>
Nov 17 01:30:16 user nova-compute[75226]:     <rng model="virtio">
Nov 17 01:30:16 user nova-compute[75226]:       <backend model="random">/dev/urandom</backend>
Nov 17 01:30:16 user nova-compute[75226]:     </rng>
Nov 17 01:30:16 user nova-compute[75226]:     <controller type="usb" index="0" model="none"/>
Nov 17 01:30:16 user nova-compute[75226]:     <memballoon model="virtio">
Nov 17 01:30:16 user nova-compute[75226]:       <stats period="10"/>
Nov 17 01:30:16 user nova-compute[75226]:     </memballoon>
Nov 17 01:30:16 user nova-compute[75226]:   </devices>
Nov 17 01:30:16 user nova-compute[75226]: </domain>
Nov 17 01:30:16 user nova-compute[75226]:  {{(pid=75226) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 17 01:30:16 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-c8e6edb0-73b7-40d7-ad3a-181d8091016a tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:24:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1878692867',display_name='tempest-ServerActionsTestOtherB-server-1878692867',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1878692867',id=21,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBTPdFaRxKgPkRdKbUEvHAZcoj+dPC43zryXBmo0q5ihjaLD04DW9eJSP+KLH1T/XkmERKqJKOvG49EB5qtvQ6Fib4lL66B3axWTUVDvaaC20Rh3bH2XA1pGQ2EKVxiHfg==',key_name='tempest-keypair-1901957685',keypairs=<?>,launch_index=0,launched_at=2023-11-17T01:28:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c19f767dc7bb4024b3cbf1d8f5f8f2bf',ramdisk_id='',reservation_id='r-p9pzzoi2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-229085712',owner_user_name='tempest-ServerActionsTestOtherB-229085712-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T01:30:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f0952a7e2dd64bf2adb2e224965377ab',uuid=ee2187c9-8620-4fd2-ad8a-a054cd8393f3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "1057ea4c-2ac4-40fa-8b2e-3b5888ea4d61", "address": "fa:16:3e:4a:f5:8f", "network": {"id": "3d8c3322-c78d-4d3a-b8c7-ba12241b4c65", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1996535656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c19f767dc7bb4024b3cbf1d8f5f8f2bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1057ea4c-2a", "ovs_interfaceid": "1057ea4c-2ac4-40fa-8b2e-3b5888ea4d61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 17 01:30:16 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-c8e6edb0-73b7-40d7-ad3a-181d8091016a tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Converting VIF {"id": "1057ea4c-2ac4-40fa-8b2e-3b5888ea4d61", "address": "fa:16:3e:4a:f5:8f", "network": {"id": "3d8c3322-c78d-4d3a-b8c7-ba12241b4c65", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1996535656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c19f767dc7bb4024b3cbf1d8f5f8f2bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1057ea4c-2a", "ovs_interfaceid": "1057ea4c-2ac4-40fa-8b2e-3b5888ea4d61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:30:16 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-c8e6edb0-73b7-40d7-ad3a-181d8091016a tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:f5:8f,bridge_name='br-int',has_traffic_filtering=True,id=1057ea4c-2ac4-40fa-8b2e-3b5888ea4d61,network=Network(3d8c3322-c78d-4d3a-b8c7-ba12241b4c65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1057ea4c-2a') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:30:16 user nova-compute[75226]: DEBUG os_vif [None req-c8e6edb0-73b7-40d7-ad3a-181d8091016a tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:f5:8f,bridge_name='br-int',has_traffic_filtering=True,id=1057ea4c-2ac4-40fa-8b2e-3b5888ea4d61,network=Network(3d8c3322-c78d-4d3a-b8c7-ba12241b4c65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1057ea4c-2a') {{(pid=75226) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 17 01:30:16 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:30:16 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:30:16 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 17 01:30:16 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:30:16 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '647fd443-d41e-56b9-9ef8-81aab2673ffb', '_type': 'linux-noop'}}, row=False) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:30:16 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:30:16 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:30:16 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1057ea4c-2a, may_exist=True, interface_attrs={}) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:30:16 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1057ea4c-2a, col_values=(('qos', UUID('12c928fa-2068-4c41-8a89-56d86cdff822')),), if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:30:16 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1057ea4c-2a, col_values=(('external_ids', {'iface-id': '1057ea4c-2ac4-40fa-8b2e-3b5888ea4d61', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4a:f5:8f', 'vm-uuid': 'ee2187c9-8620-4fd2-ad8a-a054cd8393f3'}),), if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:30:16 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:30:16 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:30:16 user nova-compute[75226]: INFO os_vif [None req-c8e6edb0-73b7-40d7-ad3a-181d8091016a tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:f5:8f,bridge_name='br-int',has_traffic_filtering=True,id=1057ea4c-2ac4-40fa-8b2e-3b5888ea4d61,network=Network(3d8c3322-c78d-4d3a-b8c7-ba12241b4c65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1057ea4c-2a')
Nov 17 01:30:17 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:30:17 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:30:17 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:30:17 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:30:18 user nova-compute[75226]: DEBUG nova.compute.manager [req-16d34a00-57c5-4ce6-a4a6-911cb6aac23e req-bb09cfda-006d-40fe-8929-c622c7d14976 service nova] [instance: ee2187c9-8620-4fd2-ad8a-a054cd8393f3] Received event network-vif-plugged-1057ea4c-2ac4-40fa-8b2e-3b5888ea4d61 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:30:18 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-16d34a00-57c5-4ce6-a4a6-911cb6aac23e req-bb09cfda-006d-40fe-8929-c622c7d14976 service nova] Acquiring lock "ee2187c9-8620-4fd2-ad8a-a054cd8393f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:30:18 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-16d34a00-57c5-4ce6-a4a6-911cb6aac23e req-bb09cfda-006d-40fe-8929-c622c7d14976 service nova] Lock "ee2187c9-8620-4fd2-ad8a-a054cd8393f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:30:18 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-16d34a00-57c5-4ce6-a4a6-911cb6aac23e req-bb09cfda-006d-40fe-8929-c622c7d14976 service nova] Lock "ee2187c9-8620-4fd2-ad8a-a054cd8393f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:30:18 user nova-compute[75226]: DEBUG nova.compute.manager [req-16d34a00-57c5-4ce6-a4a6-911cb6aac23e req-bb09cfda-006d-40fe-8929-c622c7d14976 service nova] [instance: ee2187c9-8620-4fd2-ad8a-a054cd8393f3] No waiting events found dispatching network-vif-plugged-1057ea4c-2ac4-40fa-8b2e-3b5888ea4d61 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:30:18 user nova-compute[75226]: WARNING nova.compute.manager [req-16d34a00-57c5-4ce6-a4a6-911cb6aac23e req-bb09cfda-006d-40fe-8929-c622c7d14976 service nova] [instance: ee2187c9-8620-4fd2-ad8a-a054cd8393f3] Received unexpected event network-vif-plugged-1057ea4c-2ac4-40fa-8b2e-3b5888ea4d61 for instance with vm_state resized and task_state resize_reverting.
Nov 17 01:30:18 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:30:18 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:30:19 user nova-compute[75226]: DEBUG nova.compute.manager [None req-c8e6edb0-73b7-40d7-ad3a-181d8091016a tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] [instance: ee2187c9-8620-4fd2-ad8a-a054cd8393f3] Instance event wait completed in 0 seconds for  {{(pid=75226) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 17 01:30:19 user nova-compute[75226]: INFO nova.virt.libvirt.driver [-] [instance: ee2187c9-8620-4fd2-ad8a-a054cd8393f3] Instance running successfully.
Nov 17 01:30:19 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-c8e6edb0-73b7-40d7-ad3a-181d8091016a tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] [instance: ee2187c9-8620-4fd2-ad8a-a054cd8393f3] finish_revert_migration finished successfully. {{(pid=75226) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Nov 17 01:30:20 user nova-compute[75226]: DEBUG nova.compute.manager [req-c144e38f-f5b4-4f2c-b3aa-df10a52ecda1 req-efddfbaa-9df5-4ee8-b8fc-2df11ed26f75 service nova] [instance: ee2187c9-8620-4fd2-ad8a-a054cd8393f3] Received event network-vif-plugged-1057ea4c-2ac4-40fa-8b2e-3b5888ea4d61 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:30:20 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-c144e38f-f5b4-4f2c-b3aa-df10a52ecda1 req-efddfbaa-9df5-4ee8-b8fc-2df11ed26f75 service nova] Acquiring lock "ee2187c9-8620-4fd2-ad8a-a054cd8393f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:30:20 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-c144e38f-f5b4-4f2c-b3aa-df10a52ecda1 req-efddfbaa-9df5-4ee8-b8fc-2df11ed26f75 service nova] Lock "ee2187c9-8620-4fd2-ad8a-a054cd8393f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:30:20 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-c144e38f-f5b4-4f2c-b3aa-df10a52ecda1 req-efddfbaa-9df5-4ee8-b8fc-2df11ed26f75 service nova] Lock "ee2187c9-8620-4fd2-ad8a-a054cd8393f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:30:20 user nova-compute[75226]: DEBUG nova.compute.manager [req-c144e38f-f5b4-4f2c-b3aa-df10a52ecda1 req-efddfbaa-9df5-4ee8-b8fc-2df11ed26f75 service nova] [instance: ee2187c9-8620-4fd2-ad8a-a054cd8393f3] No waiting events found dispatching network-vif-plugged-1057ea4c-2ac4-40fa-8b2e-3b5888ea4d61 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:30:20 user nova-compute[75226]: WARNING nova.compute.manager [req-c144e38f-f5b4-4f2c-b3aa-df10a52ecda1 req-efddfbaa-9df5-4ee8-b8fc-2df11ed26f75 service nova] [instance: ee2187c9-8620-4fd2-ad8a-a054cd8393f3] Received unexpected event network-vif-plugged-1057ea4c-2ac4-40fa-8b2e-3b5888ea4d61 for instance with vm_state resized and task_state resize_reverting.
Nov 17 01:30:20 user nova-compute[75226]: INFO nova.compute.manager [None req-c8e6edb0-73b7-40d7-ad3a-181d8091016a tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] [instance: ee2187c9-8620-4fd2-ad8a-a054cd8393f3] Updating instance to original state: 'active'
Nov 17 01:30:21 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:30:21 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:30:22 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:30:24 user nova-compute[75226]: INFO nova.compute.manager [None req-9f1463d7-6ccc-4807-a895-2248e563a1c7 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] [instance: d6555d72-6094-4ea9-b071-a3d3c8a300a9] Rescuing
Nov 17 01:30:24 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-9f1463d7-6ccc-4807-a895-2248e563a1c7 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Acquiring lock "refresh_cache-d6555d72-6094-4ea9-b071-a3d3c8a300a9" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:30:24 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-9f1463d7-6ccc-4807-a895-2248e563a1c7 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Acquired lock "refresh_cache-d6555d72-6094-4ea9-b071-a3d3c8a300a9" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:30:24 user nova-compute[75226]: DEBUG nova.network.neutron [None req-9f1463d7-6ccc-4807-a895-2248e563a1c7 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] [instance: d6555d72-6094-4ea9-b071-a3d3c8a300a9] Building network info cache for instance {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 01:30:25 user nova-compute[75226]: DEBUG nova.network.neutron [None req-9f1463d7-6ccc-4807-a895-2248e563a1c7 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] [instance: d6555d72-6094-4ea9-b071-a3d3c8a300a9] Updating instance_info_cache with network_info: [{"id": "1315a3d4-9d0a-4a65-8044-45959bf1f754", "address": "fa:16:3e:83:57:31", "network": {"id": "a9710b94-56f8-4cf6-9bb6-344b275e5bf2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-512340839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2052a37a068e4d948c57560c0f4445e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1315a3d4-9d", "ovs_interfaceid": "1315a3d4-9d0a-4a65-8044-45959bf1f754", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:30:25 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-9f1463d7-6ccc-4807-a895-2248e563a1c7 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Releasing lock "refresh_cache-d6555d72-6094-4ea9-b071-a3d3c8a300a9" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:30:25 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:30:25 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:30:25 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:30:25 user nova-compute[75226]: DEBUG nova.compute.manager [req-9e401507-9c88-47b7-8782-c4fb4aace82f req-8a1b5b69-da97-44f6-baf9-bcae765cec0c service nova] [instance: d6555d72-6094-4ea9-b071-a3d3c8a300a9] Received event network-vif-unplugged-1315a3d4-9d0a-4a65-8044-45959bf1f754 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:30:25 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-9e401507-9c88-47b7-8782-c4fb4aace82f req-8a1b5b69-da97-44f6-baf9-bcae765cec0c service nova] Acquiring lock "d6555d72-6094-4ea9-b071-a3d3c8a300a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:30:25 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-9e401507-9c88-47b7-8782-c4fb4aace82f req-8a1b5b69-da97-44f6-baf9-bcae765cec0c service nova] Lock "d6555d72-6094-4ea9-b071-a3d3c8a300a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:30:25 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-9e401507-9c88-47b7-8782-c4fb4aace82f req-8a1b5b69-da97-44f6-baf9-bcae765cec0c service nova] Lock "d6555d72-6094-4ea9-b071-a3d3c8a300a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:30:25 user nova-compute[75226]: DEBUG nova.compute.manager [req-9e401507-9c88-47b7-8782-c4fb4aace82f req-8a1b5b69-da97-44f6-baf9-bcae765cec0c service nova] [instance: d6555d72-6094-4ea9-b071-a3d3c8a300a9] No waiting events found dispatching network-vif-unplugged-1315a3d4-9d0a-4a65-8044-45959bf1f754 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:30:25 user nova-compute[75226]: WARNING nova.compute.manager [req-9e401507-9c88-47b7-8782-c4fb4aace82f req-8a1b5b69-da97-44f6-baf9-bcae765cec0c service nova] [instance: d6555d72-6094-4ea9-b071-a3d3c8a300a9] Received unexpected event network-vif-unplugged-1315a3d4-9d0a-4a65-8044-45959bf1f754 for instance with vm_state active and task_state rescuing.
Nov 17 01:30:25 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:30:25 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:30:25 user nova-compute[75226]: INFO nova.virt.libvirt.driver [-] [instance: d6555d72-6094-4ea9-b071-a3d3c8a300a9] Instance destroyed successfully.
Nov 17 01:30:25 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-9f1463d7-6ccc-4807-a895-2248e563a1c7 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] [instance: d6555d72-6094-4ea9-b071-a3d3c8a300a9] Attempting rescue
Nov 17 01:30:25 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-9f1463d7-6ccc-4807-a895-2248e563a1c7 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75226) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 17 01:30:25 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-9f1463d7-6ccc-4807-a895-2248e563a1c7 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] [instance: d6555d72-6094-4ea9-b071-a3d3c8a300a9] Instance directory exists: not creating {{(pid=75226) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 17 01:30:25 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-9f1463d7-6ccc-4807-a895-2248e563a1c7 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] [instance: d6555d72-6094-4ea9-b071-a3d3c8a300a9] Creating image(s)
Nov 17 01:30:25 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-9f1463d7-6ccc-4807-a895-2248e563a1c7 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Acquiring lock "/opt/stack/data/nova/instances/d6555d72-6094-4ea9-b071-a3d3c8a300a9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:30:25 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-9f1463d7-6ccc-4807-a895-2248e563a1c7 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Lock "/opt/stack/data/nova/instances/d6555d72-6094-4ea9-b071-a3d3c8a300a9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:30:25 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-9f1463d7-6ccc-4807-a895-2248e563a1c7 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Lock "/opt/stack/data/nova/instances/d6555d72-6094-4ea9-b071-a3d3c8a300a9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:30:25 user nova-compute[75226]: DEBUG nova.objects.instance [None req-9f1463d7-6ccc-4807-a895-2248e563a1c7 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Lazy-loading 'trusted_certs' on Instance uuid d6555d72-6094-4ea9-b071-a3d3c8a300a9 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:30:25 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-9f1463d7-6ccc-4807-a895-2248e563a1c7 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Acquiring lock "a8a62c2546af3a2036b853250c5ac64d4c6b4371" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:30:25 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-9f1463d7-6ccc-4807-a895-2248e563a1c7 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Lock "a8a62c2546af3a2036b853250c5ac64d4c6b4371" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:30:25 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-9f1463d7-6ccc-4807-a895-2248e563a1c7 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:30:26 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-9f1463d7-6ccc-4807-a895-2248e563a1c7 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json" returned: 0 in 0.201s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:30:26 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-9f1463d7-6ccc-4807-a895-2248e563a1c7 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371,backing_fmt=raw /opt/stack/data/nova/instances/d6555d72-6094-4ea9-b071-a3d3c8a300a9/disk.rescue {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:30:26 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-9f1463d7-6ccc-4807-a895-2248e563a1c7 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371,backing_fmt=raw /opt/stack/data/nova/instances/d6555d72-6094-4ea9-b071-a3d3c8a300a9/disk.rescue" returned: 0 in 0.065s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:30:26 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-9f1463d7-6ccc-4807-a895-2248e563a1c7 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Lock "a8a62c2546af3a2036b853250c5ac64d4c6b4371" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.274s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:30:26 user nova-compute[75226]: DEBUG nova.objects.instance [None req-9f1463d7-6ccc-4807-a895-2248e563a1c7 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Lazy-loading 'migration_context' on Instance uuid d6555d72-6094-4ea9-b071-a3d3c8a300a9 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:30:26 user nova-compute[75226]: DEBUG nova.objects.base [None req-9f1463d7-6ccc-4807-a895-2248e563a1c7 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Object Instance<d6555d72-6094-4ea9-b071-a3d3c8a300a9> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75226) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 17 01:30:26 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-9f1463d7-6ccc-4807-a895-2248e563a1c7 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] [instance: d6555d72-6094-4ea9-b071-a3d3c8a300a9] Created local disks {{(pid=75226) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 17 01:30:26 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-9f1463d7-6ccc-4807-a895-2248e563a1c7 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] [instance: d6555d72-6094-4ea9-b071-a3d3c8a300a9] Start _get_guest_xml network_info=[{"id": "1315a3d4-9d0a-4a65-8044-45959bf1f754", "address": "fa:16:3e:83:57:31", "network": {"id": "a9710b94-56f8-4cf6-9bb6-344b275e5bf2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-512340839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-512340839-network", "vif_mac": "fa:16:3e:83:57:31"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2052a37a068e4d948c57560c0f4445e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1315a3d4-9d", "ovs_interfaceid": "1315a3d4-9d0a-4a65-8044-45959bf1f754", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T01:13:22Z,direct_url=<?>,disk_format='qcow2',id=0b369aea-6f3f-4690-9f01-229b90ab6310,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4e110cbf9a84362a6864a7732c435a1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T01:13:23Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '0b369aea-6f3f-4690-9f01-229b90ab6310', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75226) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 17 01:30:26 user nova-compute[75226]: DEBUG nova.objects.instance [None req-9f1463d7-6ccc-4807-a895-2248e563a1c7 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Lazy-loading 'resources' on Instance uuid d6555d72-6094-4ea9-b071-a3d3c8a300a9 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:30:26 user nova-compute[75226]: DEBUG nova.objects.base [None req-9f1463d7-6ccc-4807-a895-2248e563a1c7 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Object Instance<d6555d72-6094-4ea9-b071-a3d3c8a300a9> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75226) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 17 01:30:26 user nova-compute[75226]: DEBUG nova.objects.instance [None req-9f1463d7-6ccc-4807-a895-2248e563a1c7 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Lazy-loading 'numa_topology' on Instance uuid d6555d72-6094-4ea9-b071-a3d3c8a300a9 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:30:26 user nova-compute[75226]: DEBUG nova.objects.base [None req-9f1463d7-6ccc-4807-a895-2248e563a1c7 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Object Instance<d6555d72-6094-4ea9-b071-a3d3c8a300a9> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75226) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 17 01:30:26 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-9f1463d7-6ccc-4807-a895-2248e563a1c7 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:30:26 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-9f1463d7-6ccc-4807-a895-2248e563a1c7 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:30:26 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-9f1463d7-6ccc-4807-a895-2248e563a1c7 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75226) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 17 01:30:26 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-9f1463d7-6ccc-4807-a895-2248e563a1c7 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] CPU controller missing on host. {{(pid=75226) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 17 01:30:26 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-9f1463d7-6ccc-4807-a895-2248e563a1c7 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75226) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 17 01:30:26 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-9f1463d7-6ccc-4807-a895-2248e563a1c7 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] CPU controller found on host. {{(pid=75226) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 17 01:30:26 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-9f1463d7-6ccc-4807-a895-2248e563a1c7 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75226) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 17 01:30:26 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-9f1463d7-6ccc-4807-a895-2248e563a1c7 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-17T01:13:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T01:13:22Z,direct_url=<?>,disk_format='qcow2',id=0b369aea-6f3f-4690-9f01-229b90ab6310,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4e110cbf9a84362a6864a7732c435a1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T01:13:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 17 01:30:26 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-9f1463d7-6ccc-4807-a895-2248e563a1c7 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Flavor limits 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 17 01:30:26 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-9f1463d7-6ccc-4807-a895-2248e563a1c7 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Image limits 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 17 01:30:26 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-9f1463d7-6ccc-4807-a895-2248e563a1c7 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Flavor pref 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 17 01:30:26 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-9f1463d7-6ccc-4807-a895-2248e563a1c7 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Image pref 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 17 01:30:26 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-9f1463d7-6ccc-4807-a895-2248e563a1c7 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 17 01:30:26 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-9f1463d7-6ccc-4807-a895-2248e563a1c7 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 17 01:30:26 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-9f1463d7-6ccc-4807-a895-2248e563a1c7 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75226) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 17 01:30:26 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-9f1463d7-6ccc-4807-a895-2248e563a1c7 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Got 1 possible topologies {{(pid=75226) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 17 01:30:26 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-9f1463d7-6ccc-4807-a895-2248e563a1c7 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 17 01:30:26 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-9f1463d7-6ccc-4807-a895-2248e563a1c7 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 17 01:30:26 user nova-compute[75226]: DEBUG nova.objects.instance [None req-9f1463d7-6ccc-4807-a895-2248e563a1c7 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Lazy-loading 'vcpu_model' on Instance uuid d6555d72-6094-4ea9-b071-a3d3c8a300a9 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:30:26 user nova-compute[75226]: DEBUG nova.objects.base [None req-9f1463d7-6ccc-4807-a895-2248e563a1c7 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Object Instance<d6555d72-6094-4ea9-b071-a3d3c8a300a9> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75226) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 17 01:30:26 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-9f1463d7-6ccc-4807-a895-2248e563a1c7 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:25:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1387314277',display_name='tempest-ServerRescueNegativeTestJSON-server-1387314277',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1387314277',id=25,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-17T01:25:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2052a37a068e4d948c57560c0f4445e4',ramdisk_id='',reservation_id='r-2jn9z0wx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-344970408',owner_user_name='tempest-ServerRescueNegativeTestJSON-344970408-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T01:25:50Z,user_data=None,user_id='12f405f1486a4f5187e628c60f223e98',uuid=d6555d72-6094-4ea9-b071-a3d3c8a300a9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1315a3d4-9d0a-4a65-8044-45959bf1f754", "address": "fa:16:3e:83:57:31", "network": {"id": "a9710b94-56f8-4cf6-9bb6-344b275e5bf2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-512340839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-512340839-network", "vif_mac": "fa:16:3e:83:57:31"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2052a37a068e4d948c57560c0f4445e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1315a3d4-9d", "ovs_interfaceid": "1315a3d4-9d0a-4a65-8044-45959bf1f754", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75226) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 01:30:26 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-9f1463d7-6ccc-4807-a895-2248e563a1c7 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Converting VIF {"id": "1315a3d4-9d0a-4a65-8044-45959bf1f754", "address": "fa:16:3e:83:57:31", "network": {"id": "a9710b94-56f8-4cf6-9bb6-344b275e5bf2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-512340839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-512340839-network", "vif_mac": "fa:16:3e:83:57:31"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2052a37a068e4d948c57560c0f4445e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1315a3d4-9d", "ovs_interfaceid": "1315a3d4-9d0a-4a65-8044-45959bf1f754", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:30:26 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-9f1463d7-6ccc-4807-a895-2248e563a1c7 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:83:57:31,bridge_name='br-int',has_traffic_filtering=True,id=1315a3d4-9d0a-4a65-8044-45959bf1f754,network=Network(a9710b94-56f8-4cf6-9bb6-344b275e5bf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1315a3d4-9d') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:30:26 user nova-compute[75226]: DEBUG nova.objects.instance [None req-9f1463d7-6ccc-4807-a895-2248e563a1c7 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Lazy-loading 'pci_devices' on Instance uuid d6555d72-6094-4ea9-b071-a3d3c8a300a9 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:30:26 user nova-compute[75226]: DEBUG nova.objects.base [None req-9f1463d7-6ccc-4807-a895-2248e563a1c7 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Object Instance<d6555d72-6094-4ea9-b071-a3d3c8a300a9> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75226) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 17 01:30:26 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-9f1463d7-6ccc-4807-a895-2248e563a1c7 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] [instance: d6555d72-6094-4ea9-b071-a3d3c8a300a9] End _get_guest_xml xml=<domain type="kvm">
Nov 17 01:30:26 user nova-compute[75226]:   <uuid>d6555d72-6094-4ea9-b071-a3d3c8a300a9</uuid>
Nov 17 01:30:26 user nova-compute[75226]:   <name>instance-00000019</name>
Nov 17 01:30:26 user nova-compute[75226]:   <memory>524288</memory>
Nov 17 01:30:26 user nova-compute[75226]:   <vcpu>1</vcpu>
Nov 17 01:30:26 user nova-compute[75226]:   <metadata>
Nov 17 01:30:26 user nova-compute[75226]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 17 01:30:26 user nova-compute[75226]:       <nova:package version="0.0.0"/>
Nov 17 01:30:26 user nova-compute[75226]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1387314277</nova:name>
Nov 17 01:30:26 user nova-compute[75226]:       <nova:creationTime>2023-11-17 01:30:26</nova:creationTime>
Nov 17 01:30:26 user nova-compute[75226]:       <nova:flavor name="m1.tiny">
Nov 17 01:30:26 user nova-compute[75226]:         <nova:memory>512</nova:memory>
Nov 17 01:30:26 user nova-compute[75226]:         <nova:disk>1</nova:disk>
Nov 17 01:30:26 user nova-compute[75226]:         <nova:swap>0</nova:swap>
Nov 17 01:30:26 user nova-compute[75226]:         <nova:ephemeral>0</nova:ephemeral>
Nov 17 01:30:26 user nova-compute[75226]:         <nova:vcpus>1</nova:vcpus>
Nov 17 01:30:26 user nova-compute[75226]:       </nova:flavor>
Nov 17 01:30:26 user nova-compute[75226]:       <nova:owner>
Nov 17 01:30:26 user nova-compute[75226]:         <nova:user uuid="12f405f1486a4f5187e628c60f223e98">tempest-ServerRescueNegativeTestJSON-344970408-project-member</nova:user>
Nov 17 01:30:26 user nova-compute[75226]:         <nova:project uuid="2052a37a068e4d948c57560c0f4445e4">tempest-ServerRescueNegativeTestJSON-344970408</nova:project>
Nov 17 01:30:26 user nova-compute[75226]:       </nova:owner>
Nov 17 01:30:26 user nova-compute[75226]:       <nova:root type="image" uuid="0b369aea-6f3f-4690-9f01-229b90ab6310"/>
Nov 17 01:30:26 user nova-compute[75226]:       <nova:ports>
Nov 17 01:30:26 user nova-compute[75226]:         <nova:port uuid="1315a3d4-9d0a-4a65-8044-45959bf1f754">
Nov 17 01:30:26 user nova-compute[75226]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 17 01:30:26 user nova-compute[75226]:         </nova:port>
Nov 17 01:30:26 user nova-compute[75226]:       </nova:ports>
Nov 17 01:30:26 user nova-compute[75226]:     </nova:instance>
Nov 17 01:30:26 user nova-compute[75226]:   </metadata>
Nov 17 01:30:26 user nova-compute[75226]:   <sysinfo type="smbios">
Nov 17 01:30:26 user nova-compute[75226]:     <system>
Nov 17 01:30:26 user nova-compute[75226]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 17 01:30:26 user nova-compute[75226]:       <entry name="product">OpenStack Nova</entry>
Nov 17 01:30:26 user nova-compute[75226]:       <entry name="version">0.0.0</entry>
Nov 17 01:30:26 user nova-compute[75226]:       <entry name="serial">d6555d72-6094-4ea9-b071-a3d3c8a300a9</entry>
Nov 17 01:30:26 user nova-compute[75226]:       <entry name="uuid">d6555d72-6094-4ea9-b071-a3d3c8a300a9</entry>
Nov 17 01:30:26 user nova-compute[75226]:       <entry name="family">Virtual Machine</entry>
Nov 17 01:30:26 user nova-compute[75226]:     </system>
Nov 17 01:30:26 user nova-compute[75226]:   </sysinfo>
Nov 17 01:30:26 user nova-compute[75226]:   <os>
Nov 17 01:30:26 user nova-compute[75226]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 17 01:30:26 user nova-compute[75226]:     <smbios mode="sysinfo"/>
Nov 17 01:30:26 user nova-compute[75226]:   </os>
Nov 17 01:30:26 user nova-compute[75226]:   <features>
Nov 17 01:30:26 user nova-compute[75226]:     <acpi/>
Nov 17 01:30:26 user nova-compute[75226]:     <apic/>
Nov 17 01:30:26 user nova-compute[75226]:     <vmcoreinfo/>
Nov 17 01:30:26 user nova-compute[75226]:   </features>
Nov 17 01:30:26 user nova-compute[75226]:   <clock offset="utc">
Nov 17 01:30:26 user nova-compute[75226]:     <timer name="pit" tickpolicy="delay"/>
Nov 17 01:30:26 user nova-compute[75226]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 17 01:30:26 user nova-compute[75226]:     <timer name="hpet" present="no"/>
Nov 17 01:30:26 user nova-compute[75226]:   </clock>
Nov 17 01:30:26 user nova-compute[75226]:   <cpu mode="custom" match="exact">
Nov 17 01:30:26 user nova-compute[75226]:     <model>Nehalem</model>
Nov 17 01:30:26 user nova-compute[75226]:     <topology sockets="1" cores="1" threads="1"/>
Nov 17 01:30:26 user nova-compute[75226]:   </cpu>
Nov 17 01:30:26 user nova-compute[75226]:   <devices>
Nov 17 01:30:26 user nova-compute[75226]:     <disk type="file" device="disk">
Nov 17 01:30:26 user nova-compute[75226]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 17 01:30:26 user nova-compute[75226]:       <source file="/opt/stack/data/nova/instances/d6555d72-6094-4ea9-b071-a3d3c8a300a9/disk.rescue"/>
Nov 17 01:30:26 user nova-compute[75226]:       <target dev="vda" bus="virtio"/>
Nov 17 01:30:26 user nova-compute[75226]:     </disk>
Nov 17 01:30:26 user nova-compute[75226]:     <disk type="file" device="disk">
Nov 17 01:30:26 user nova-compute[75226]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 17 01:30:26 user nova-compute[75226]:       <source file="/opt/stack/data/nova/instances/d6555d72-6094-4ea9-b071-a3d3c8a300a9/disk"/>
Nov 17 01:30:26 user nova-compute[75226]:       <target dev="vdb" bus="virtio"/>
Nov 17 01:30:26 user nova-compute[75226]:     </disk>
Nov 17 01:30:26 user nova-compute[75226]:     <interface type="ethernet">
Nov 17 01:30:26 user nova-compute[75226]:       <mac address="fa:16:3e:83:57:31"/>
Nov 17 01:30:26 user nova-compute[75226]:       <model type="virtio"/>
Nov 17 01:30:26 user nova-compute[75226]:       <mtu size="1442"/>
Nov 17 01:30:26 user nova-compute[75226]:       <target dev="tap1315a3d4-9d"/>
Nov 17 01:30:26 user nova-compute[75226]:     </interface>
Nov 17 01:30:26 user nova-compute[75226]:     <serial type="pty">
Nov 17 01:30:26 user nova-compute[75226]:       <log file="/opt/stack/data/nova/instances/d6555d72-6094-4ea9-b071-a3d3c8a300a9/console.log" append="off"/>
Nov 17 01:30:26 user nova-compute[75226]:     </serial>
Nov 17 01:30:26 user nova-compute[75226]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 17 01:30:26 user nova-compute[75226]:     <video>
Nov 17 01:30:26 user nova-compute[75226]:       <model type="virtio"/>
Nov 17 01:30:26 user nova-compute[75226]:     </video>
Nov 17 01:30:26 user nova-compute[75226]:     <rng model="virtio">
Nov 17 01:30:26 user nova-compute[75226]:       <backend model="random">/dev/urandom</backend>
Nov 17 01:30:26 user nova-compute[75226]:     </rng>
Nov 17 01:30:26 user nova-compute[75226]:     <controller type="usb" index="0" model="none"/>
Nov 17 01:30:26 user nova-compute[75226]:     <memballoon model="virtio">
Nov 17 01:30:26 user nova-compute[75226]:       <stats period="10"/>
Nov 17 01:30:26 user nova-compute[75226]:     </memballoon>
Nov 17 01:30:26 user nova-compute[75226]:   </devices>
Nov 17 01:30:26 user nova-compute[75226]: </domain>
Nov 17 01:30:26 user nova-compute[75226]:  {{(pid=75226) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 17 01:30:26 user nova-compute[75226]: INFO nova.virt.libvirt.driver [-] [instance: d6555d72-6094-4ea9-b071-a3d3c8a300a9] Instance destroyed successfully.
Nov 17 01:30:26 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-dc969c53-d9e6-4376-a6fa-6aeada47277f tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Acquiring lock "4dcdd769-bbfe-48e8-a876-8b2072b7baeb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:30:26 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-dc969c53-d9e6-4376-a6fa-6aeada47277f tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Lock "4dcdd769-bbfe-48e8-a876-8b2072b7baeb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:30:26 user nova-compute[75226]: INFO nova.compute.manager [None req-dc969c53-d9e6-4376-a6fa-6aeada47277f tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: 4dcdd769-bbfe-48e8-a876-8b2072b7baeb] Detaching volume 528da57f-3100-4711-849f-f7a3a30ced14
Nov 17 01:30:26 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-9f1463d7-6ccc-4807-a895-2248e563a1c7 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] No BDM found with device name vda, not building metadata. {{(pid=75226) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 01:30:26 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-9f1463d7-6ccc-4807-a895-2248e563a1c7 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75226) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 01:30:26 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-9f1463d7-6ccc-4807-a895-2248e563a1c7 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] No VIF found with MAC fa:16:3e:83:57:31, not building metadata {{(pid=75226) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 01:30:26 user nova-compute[75226]: INFO nova.virt.block_device [None req-dc969c53-d9e6-4376-a6fa-6aeada47277f tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: 4dcdd769-bbfe-48e8-a876-8b2072b7baeb] Attempting to driver detach volume 528da57f-3100-4711-849f-f7a3a30ced14 from mountpoint /dev/vdb
Nov 17 01:30:26 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-dc969c53-d9e6-4376-a6fa-6aeada47277f tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Attempting to detach device vdb from instance 4dcdd769-bbfe-48e8-a876-8b2072b7baeb from the persistent domain config. {{(pid=75226) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 17 01:30:26 user nova-compute[75226]: DEBUG nova.virt.libvirt.guest [None req-dc969c53-d9e6-4376-a6fa-6aeada47277f tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] detach device xml: <disk type="block" device="disk">
Nov 17 01:30:26 user nova-compute[75226]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 01:30:26 user nova-compute[75226]:   <source dev="/dev/sdd"/>
Nov 17 01:30:26 user nova-compute[75226]:   <target dev="vdb" bus="virtio"/>
Nov 17 01:30:26 user nova-compute[75226]:   <serial>528da57f-3100-4711-849f-f7a3a30ced14</serial>
Nov 17 01:30:26 user nova-compute[75226]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 17 01:30:26 user nova-compute[75226]: </disk>
Nov 17 01:30:26 user nova-compute[75226]:  {{(pid=75226) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 17 01:30:26 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-dc969c53-d9e6-4376-a6fa-6aeada47277f tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Successfully detached device vdb from instance 4dcdd769-bbfe-48e8-a876-8b2072b7baeb from the persistent domain config.
Nov 17 01:30:26 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-dc969c53-d9e6-4376-a6fa-6aeada47277f tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4dcdd769-bbfe-48e8-a876-8b2072b7baeb from the live domain config. {{(pid=75226) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 17 01:30:26 user nova-compute[75226]: DEBUG nova.virt.libvirt.guest [None req-dc969c53-d9e6-4376-a6fa-6aeada47277f tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] detach device xml: <disk type="block" device="disk">
Nov 17 01:30:26 user nova-compute[75226]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 01:30:26 user nova-compute[75226]:   <source dev="/dev/sdd"/>
Nov 17 01:30:26 user nova-compute[75226]:   <target dev="vdb" bus="virtio"/>
Nov 17 01:30:26 user nova-compute[75226]:   <serial>528da57f-3100-4711-849f-f7a3a30ced14</serial>
Nov 17 01:30:26 user nova-compute[75226]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 17 01:30:26 user nova-compute[75226]: </disk>
Nov 17 01:30:26 user nova-compute[75226]:  {{(pid=75226) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 17 01:30:26 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:30:27 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-dc969c53-d9e6-4376-a6fa-6aeada47277f tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4dcdd769-bbfe-48e8-a876-8b2072b7baeb {{(pid=75226) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 17 01:30:27 user nova-compute[75226]: DEBUG nova.compute.manager [req-c1056571-f0cf-4cca-b7fb-b03fc50bade3 req-c65578e8-bcb4-4299-91c4-753ecdf020d0 service nova] [instance: d6555d72-6094-4ea9-b071-a3d3c8a300a9] Received event network-vif-plugged-1315a3d4-9d0a-4a65-8044-45959bf1f754 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:30:27 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-c1056571-f0cf-4cca-b7fb-b03fc50bade3 req-c65578e8-bcb4-4299-91c4-753ecdf020d0 service nova] Acquiring lock "d6555d72-6094-4ea9-b071-a3d3c8a300a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:30:27 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-c1056571-f0cf-4cca-b7fb-b03fc50bade3 req-c65578e8-bcb4-4299-91c4-753ecdf020d0 service nova] Lock "d6555d72-6094-4ea9-b071-a3d3c8a300a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:30:27 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-c1056571-f0cf-4cca-b7fb-b03fc50bade3 req-c65578e8-bcb4-4299-91c4-753ecdf020d0 service nova] Lock "d6555d72-6094-4ea9-b071-a3d3c8a300a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:30:27 user nova-compute[75226]: DEBUG nova.compute.manager [req-c1056571-f0cf-4cca-b7fb-b03fc50bade3 req-c65578e8-bcb4-4299-91c4-753ecdf020d0 service nova] [instance: d6555d72-6094-4ea9-b071-a3d3c8a300a9] No waiting events found dispatching network-vif-plugged-1315a3d4-9d0a-4a65-8044-45959bf1f754 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:30:27 user nova-compute[75226]: WARNING nova.compute.manager [req-c1056571-f0cf-4cca-b7fb-b03fc50bade3 req-c65578e8-bcb4-4299-91c4-753ecdf020d0 service nova] [instance: d6555d72-6094-4ea9-b071-a3d3c8a300a9] Received unexpected event network-vif-plugged-1315a3d4-9d0a-4a65-8044-45959bf1f754 for instance with vm_state active and task_state rescuing.
Nov 17 01:30:27 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:30:27 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:30:27 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:30:27 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:30:28 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:30:28 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:30:29 user nova-compute[75226]: DEBUG nova.compute.manager [req-2e8a19e7-e734-41c2-8be5-94dfb0008f45 req-6bc9162f-cc04-40b1-80d2-d5421138517d service nova] [instance: d6555d72-6094-4ea9-b071-a3d3c8a300a9] Received event network-vif-plugged-1315a3d4-9d0a-4a65-8044-45959bf1f754 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:30:29 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-2e8a19e7-e734-41c2-8be5-94dfb0008f45 req-6bc9162f-cc04-40b1-80d2-d5421138517d service nova] Acquiring lock "d6555d72-6094-4ea9-b071-a3d3c8a300a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:30:29 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-2e8a19e7-e734-41c2-8be5-94dfb0008f45 req-6bc9162f-cc04-40b1-80d2-d5421138517d service nova] Lock "d6555d72-6094-4ea9-b071-a3d3c8a300a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:30:29 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-2e8a19e7-e734-41c2-8be5-94dfb0008f45 req-6bc9162f-cc04-40b1-80d2-d5421138517d service nova] Lock "d6555d72-6094-4ea9-b071-a3d3c8a300a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:30:29 user nova-compute[75226]: DEBUG nova.compute.manager [req-2e8a19e7-e734-41c2-8be5-94dfb0008f45 req-6bc9162f-cc04-40b1-80d2-d5421138517d service nova] [instance: d6555d72-6094-4ea9-b071-a3d3c8a300a9] No waiting events found dispatching network-vif-plugged-1315a3d4-9d0a-4a65-8044-45959bf1f754 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:30:29 user nova-compute[75226]: WARNING nova.compute.manager [req-2e8a19e7-e734-41c2-8be5-94dfb0008f45 req-6bc9162f-cc04-40b1-80d2-d5421138517d service nova] [instance: d6555d72-6094-4ea9-b071-a3d3c8a300a9] Received unexpected event network-vif-plugged-1315a3d4-9d0a-4a65-8044-45959bf1f754 for instance with vm_state active and task_state rescuing.
Nov 17 01:30:29 user nova-compute[75226]: DEBUG nova.compute.manager [req-2e8a19e7-e734-41c2-8be5-94dfb0008f45 req-6bc9162f-cc04-40b1-80d2-d5421138517d service nova] [instance: d6555d72-6094-4ea9-b071-a3d3c8a300a9] Received event network-vif-plugged-1315a3d4-9d0a-4a65-8044-45959bf1f754 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:30:29 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-2e8a19e7-e734-41c2-8be5-94dfb0008f45 req-6bc9162f-cc04-40b1-80d2-d5421138517d service nova] Acquiring lock "d6555d72-6094-4ea9-b071-a3d3c8a300a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:30:29 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-2e8a19e7-e734-41c2-8be5-94dfb0008f45 req-6bc9162f-cc04-40b1-80d2-d5421138517d service nova] Lock "d6555d72-6094-4ea9-b071-a3d3c8a300a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:30:29 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-2e8a19e7-e734-41c2-8be5-94dfb0008f45 req-6bc9162f-cc04-40b1-80d2-d5421138517d service nova] Lock "d6555d72-6094-4ea9-b071-a3d3c8a300a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:30:29 user nova-compute[75226]: DEBUG nova.compute.manager [req-2e8a19e7-e734-41c2-8be5-94dfb0008f45 req-6bc9162f-cc04-40b1-80d2-d5421138517d service nova] [instance: d6555d72-6094-4ea9-b071-a3d3c8a300a9] No waiting events found dispatching network-vif-plugged-1315a3d4-9d0a-4a65-8044-45959bf1f754 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:30:29 user nova-compute[75226]: WARNING nova.compute.manager [req-2e8a19e7-e734-41c2-8be5-94dfb0008f45 req-6bc9162f-cc04-40b1-80d2-d5421138517d service nova] [instance: d6555d72-6094-4ea9-b071-a3d3c8a300a9] Received unexpected event network-vif-plugged-1315a3d4-9d0a-4a65-8044-45959bf1f754 for instance with vm_state active and task_state rescuing.
Nov 17 01:30:30 user nova-compute[75226]: DEBUG nova.compute.manager [None req-9f1463d7-6ccc-4807-a895-2248e563a1c7 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] [instance: d6555d72-6094-4ea9-b071-a3d3c8a300a9] Checking state {{(pid=75226) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 01:30:31 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:30:32 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:30:36 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:30:37 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:30:41 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:30:42 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:30:44 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-fa4c12f2-cba4-4a86-b2d8-eaab07bcb447 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Acquiring lock "bef5f981-8fcb-4433-87bf-f958f3f57424" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:30:44 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-fa4c12f2-cba4-4a86-b2d8-eaab07bcb447 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Lock "bef5f981-8fcb-4433-87bf-f958f3f57424" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:30:44 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-fa4c12f2-cba4-4a86-b2d8-eaab07bcb447 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Acquiring lock "bef5f981-8fcb-4433-87bf-f958f3f57424-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:30:44 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-fa4c12f2-cba4-4a86-b2d8-eaab07bcb447 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Lock "bef5f981-8fcb-4433-87bf-f958f3f57424-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:30:44 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-fa4c12f2-cba4-4a86-b2d8-eaab07bcb447 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Lock "bef5f981-8fcb-4433-87bf-f958f3f57424-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:30:44 user nova-compute[75226]: INFO nova.compute.manager [None req-fa4c12f2-cba4-4a86-b2d8-eaab07bcb447 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: bef5f981-8fcb-4433-87bf-f958f3f57424] Terminating instance
Nov 17 01:30:44 user nova-compute[75226]: DEBUG nova.compute.manager [None req-fa4c12f2-cba4-4a86-b2d8-eaab07bcb447 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: bef5f981-8fcb-4433-87bf-f958f3f57424] Start destroying the instance on the hypervisor. {{(pid=75226) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 17 01:30:44 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:30:44 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:30:44 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:30:44 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:30:44 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:30:44 user nova-compute[75226]: DEBUG nova.compute.manager [req-9ca1ce6f-7c4b-4c10-aa41-3ac8579568ca req-48354782-4ab6-436e-87c0-071f3a2aecf3 service nova] [instance: bef5f981-8fcb-4433-87bf-f958f3f57424] Received event network-vif-unplugged-cab29de8-39b1-4673-ac55-4e29c21d0d34 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:30:44 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-9ca1ce6f-7c4b-4c10-aa41-3ac8579568ca req-48354782-4ab6-436e-87c0-071f3a2aecf3 service nova] Acquiring lock "bef5f981-8fcb-4433-87bf-f958f3f57424-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:30:44 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-9ca1ce6f-7c4b-4c10-aa41-3ac8579568ca req-48354782-4ab6-436e-87c0-071f3a2aecf3 service nova] Lock "bef5f981-8fcb-4433-87bf-f958f3f57424-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:30:44 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-9ca1ce6f-7c4b-4c10-aa41-3ac8579568ca req-48354782-4ab6-436e-87c0-071f3a2aecf3 service nova] Lock "bef5f981-8fcb-4433-87bf-f958f3f57424-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:30:44 user nova-compute[75226]: DEBUG nova.compute.manager [req-9ca1ce6f-7c4b-4c10-aa41-3ac8579568ca req-48354782-4ab6-436e-87c0-071f3a2aecf3 service nova] [instance: bef5f981-8fcb-4433-87bf-f958f3f57424] No waiting events found dispatching network-vif-unplugged-cab29de8-39b1-4673-ac55-4e29c21d0d34 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:30:44 user nova-compute[75226]: DEBUG nova.compute.manager [req-9ca1ce6f-7c4b-4c10-aa41-3ac8579568ca req-48354782-4ab6-436e-87c0-071f3a2aecf3 service nova] [instance: bef5f981-8fcb-4433-87bf-f958f3f57424] Received event network-vif-unplugged-cab29de8-39b1-4673-ac55-4e29c21d0d34 for instance with task_state deleting. {{(pid=75226) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 17 01:30:45 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:30:45 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:30:45 user nova-compute[75226]: INFO nova.virt.libvirt.driver [-] [instance: bef5f981-8fcb-4433-87bf-f958f3f57424] Instance destroyed successfully.
Nov 17 01:30:45 user nova-compute[75226]: DEBUG nova.objects.instance [None req-fa4c12f2-cba4-4a86-b2d8-eaab07bcb447 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Lazy-loading 'resources' on Instance uuid bef5f981-8fcb-4433-87bf-f958f3f57424 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:30:45 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-fa4c12f2-cba4-4a86-b2d8-eaab07bcb447 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:27:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-358531304',display_name='tempest-AttachVolumeNegativeTest-server-358531304',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-358531304',id=28,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOUE61hjaJTHLJruOzhQkIZRNw5oGH4YfX39cdcxF6KVbvCNzR7+PKun3r8tKC2OJAqvoWPt4aK1swEfIkSQh9hXlTW2LQThP/V9tlE6Dc1Pa9+uyVkmNbuh+BQ5AEaJqg==',key_name='tempest-keypair-133727568',keypairs=<?>,launch_index=0,launched_at=2023-11-17T01:27:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e38777e8baf745e79f31190da97406a0',ramdisk_id='',reservation_id='r-57i7cim0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-940905741',owner_user_name='tempest-AttachVolumeNegativeTest-940905741-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T01:27:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='642db538240b4ca1a367cf4ee9714f66',uuid=bef5f981-8fcb-4433-87bf-f958f3f57424,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cab29de8-39b1-4673-ac55-4e29c21d0d34", "address": "fa:16:3e:13:0e:d0", "network": {"id": "57d0e7ee-0b11-4e00-86f9-bb4a3c25c674", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1357446034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e38777e8baf745e79f31190da97406a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcab29de8-39", "ovs_interfaceid": "cab29de8-39b1-4673-ac55-4e29c21d0d34", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 17 01:30:45 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-fa4c12f2-cba4-4a86-b2d8-eaab07bcb447 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Converting VIF {"id": "cab29de8-39b1-4673-ac55-4e29c21d0d34", "address": "fa:16:3e:13:0e:d0", "network": {"id": "57d0e7ee-0b11-4e00-86f9-bb4a3c25c674", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1357446034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e38777e8baf745e79f31190da97406a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcab29de8-39", "ovs_interfaceid": "cab29de8-39b1-4673-ac55-4e29c21d0d34", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:30:45 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-fa4c12f2-cba4-4a86-b2d8-eaab07bcb447 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:13:0e:d0,bridge_name='br-int',has_traffic_filtering=True,id=cab29de8-39b1-4673-ac55-4e29c21d0d34,network=Network(57d0e7ee-0b11-4e00-86f9-bb4a3c25c674),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcab29de8-39') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:30:45 user nova-compute[75226]: DEBUG os_vif [None req-fa4c12f2-cba4-4a86-b2d8-eaab07bcb447 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:13:0e:d0,bridge_name='br-int',has_traffic_filtering=True,id=cab29de8-39b1-4673-ac55-4e29c21d0d34,network=Network(57d0e7ee-0b11-4e00-86f9-bb4a3c25c674),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcab29de8-39') {{(pid=75226) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 17 01:30:45 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:30:45 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcab29de8-39, bridge=br-int, if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:30:45 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:30:45 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:30:45 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:30:45 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b5c0e37d-6c97-4d99-ac46-041b8c73de0b) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:30:45 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:30:45 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:30:45 user nova-compute[75226]: INFO os_vif [None req-fa4c12f2-cba4-4a86-b2d8-eaab07bcb447 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:13:0e:d0,bridge_name='br-int',has_traffic_filtering=True,id=cab29de8-39b1-4673-ac55-4e29c21d0d34,network=Network(57d0e7ee-0b11-4e00-86f9-bb4a3c25c674),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcab29de8-39')
Nov 17 01:30:45 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-fa4c12f2-cba4-4a86-b2d8-eaab07bcb447 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: bef5f981-8fcb-4433-87bf-f958f3f57424] Deleting instance files /opt/stack/data/nova/instances/bef5f981-8fcb-4433-87bf-f958f3f57424_del
Nov 17 01:30:45 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-fa4c12f2-cba4-4a86-b2d8-eaab07bcb447 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: bef5f981-8fcb-4433-87bf-f958f3f57424] Deletion of /opt/stack/data/nova/instances/bef5f981-8fcb-4433-87bf-f958f3f57424_del complete
Nov 17 01:30:45 user nova-compute[75226]: INFO nova.compute.manager [None req-fa4c12f2-cba4-4a86-b2d8-eaab07bcb447 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: bef5f981-8fcb-4433-87bf-f958f3f57424] Took 0.84 seconds to destroy the instance on the hypervisor.
Nov 17 01:30:45 user nova-compute[75226]: DEBUG oslo.service.loopingcall [None req-fa4c12f2-cba4-4a86-b2d8-eaab07bcb447 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75226) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 17 01:30:45 user nova-compute[75226]: DEBUG nova.compute.manager [-] [instance: bef5f981-8fcb-4433-87bf-f958f3f57424] Deallocating network for instance {{(pid=75226) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 17 01:30:45 user nova-compute[75226]: DEBUG nova.network.neutron [-] [instance: bef5f981-8fcb-4433-87bf-f958f3f57424] deallocate_for_instance() {{(pid=75226) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 17 01:30:46 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:30:46 user nova-compute[75226]: DEBUG nova.network.neutron [-] [instance: bef5f981-8fcb-4433-87bf-f958f3f57424] Updating instance_info_cache with network_info: [] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:30:46 user nova-compute[75226]: INFO nova.compute.manager [-] [instance: bef5f981-8fcb-4433-87bf-f958f3f57424] Took 0.68 seconds to deallocate network for instance.
Nov 17 01:30:46 user nova-compute[75226]: DEBUG nova.compute.manager [req-f5e1b631-3888-4d04-b541-27e5a34f3883 req-1bed14a4-3c68-45b9-9bbe-74bda4ee7459 service nova] [instance: bef5f981-8fcb-4433-87bf-f958f3f57424] Received event network-vif-deleted-cab29de8-39b1-4673-ac55-4e29c21d0d34 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:30:46 user nova-compute[75226]: INFO nova.compute.manager [req-f5e1b631-3888-4d04-b541-27e5a34f3883 req-1bed14a4-3c68-45b9-9bbe-74bda4ee7459 service nova] [instance: bef5f981-8fcb-4433-87bf-f958f3f57424] Neutron deleted interface cab29de8-39b1-4673-ac55-4e29c21d0d34; detaching it from the instance and deleting it from the info cache
Nov 17 01:30:46 user nova-compute[75226]: DEBUG nova.network.neutron [req-f5e1b631-3888-4d04-b541-27e5a34f3883 req-1bed14a4-3c68-45b9-9bbe-74bda4ee7459 service nova] [instance: bef5f981-8fcb-4433-87bf-f958f3f57424] Updating instance_info_cache with network_info: [] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:30:46 user nova-compute[75226]: DEBUG nova.compute.manager [req-f5e1b631-3888-4d04-b541-27e5a34f3883 req-1bed14a4-3c68-45b9-9bbe-74bda4ee7459 service nova] [instance: bef5f981-8fcb-4433-87bf-f958f3f57424] Detach interface failed, port_id=cab29de8-39b1-4673-ac55-4e29c21d0d34, reason: Instance bef5f981-8fcb-4433-87bf-f958f3f57424 could not be found. {{(pid=75226) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 17 01:30:46 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-fa4c12f2-cba4-4a86-b2d8-eaab07bcb447 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:30:46 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-fa4c12f2-cba4-4a86-b2d8-eaab07bcb447 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:30:46 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-fa4c12f2-cba4-4a86-b2d8-eaab07bcb447 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:30:46 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-fa4c12f2-cba4-4a86-b2d8-eaab07bcb447 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:30:46 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-fa4c12f2-cba4-4a86-b2d8-eaab07bcb447 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.397s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:30:46 user nova-compute[75226]: INFO nova.scheduler.client.report [None req-fa4c12f2-cba4-4a86-b2d8-eaab07bcb447 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Deleted allocations for instance bef5f981-8fcb-4433-87bf-f958f3f57424
Nov 17 01:30:46 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-fa4c12f2-cba4-4a86-b2d8-eaab07bcb447 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Lock "bef5f981-8fcb-4433-87bf-f958f3f57424" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.097s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:30:46 user nova-compute[75226]: DEBUG nova.compute.manager [req-0783c01b-ba49-4188-87a3-92dfce1210f1 req-6f45a87b-72f5-4891-bd49-92fe225cc327 service nova] [instance: bef5f981-8fcb-4433-87bf-f958f3f57424] Received event network-vif-plugged-cab29de8-39b1-4673-ac55-4e29c21d0d34 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:30:46 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-0783c01b-ba49-4188-87a3-92dfce1210f1 req-6f45a87b-72f5-4891-bd49-92fe225cc327 service nova] Acquiring lock "bef5f981-8fcb-4433-87bf-f958f3f57424-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:30:46 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-0783c01b-ba49-4188-87a3-92dfce1210f1 req-6f45a87b-72f5-4891-bd49-92fe225cc327 service nova] Lock "bef5f981-8fcb-4433-87bf-f958f3f57424-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:30:46 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-0783c01b-ba49-4188-87a3-92dfce1210f1 req-6f45a87b-72f5-4891-bd49-92fe225cc327 service nova] Lock "bef5f981-8fcb-4433-87bf-f958f3f57424-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:30:46 user nova-compute[75226]: DEBUG nova.compute.manager [req-0783c01b-ba49-4188-87a3-92dfce1210f1 req-6f45a87b-72f5-4891-bd49-92fe225cc327 service nova] [instance: bef5f981-8fcb-4433-87bf-f958f3f57424] No waiting events found dispatching network-vif-plugged-cab29de8-39b1-4673-ac55-4e29c21d0d34 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:30:46 user nova-compute[75226]: WARNING nova.compute.manager [req-0783c01b-ba49-4188-87a3-92dfce1210f1 req-6f45a87b-72f5-4891-bd49-92fe225cc327 service nova] [instance: bef5f981-8fcb-4433-87bf-f958f3f57424] Received unexpected event network-vif-plugged-cab29de8-39b1-4673-ac55-4e29c21d0d34 for instance with vm_state deleted and task_state None.
Nov 17 01:30:47 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-dc969c53-d9e6-4376-a6fa-6aeada47277f tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 4dcdd769-bbfe-48e8-a876-8b2072b7baeb is timed out.
Nov 17 01:30:47 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-dc969c53-d9e6-4376-a6fa-6aeada47277f tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Successfully detached device vdb from instance 4dcdd769-bbfe-48e8-a876-8b2072b7baeb from the live domain config.
Nov 17 01:30:47 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc969c53-d9e6-4376-a6fa-6aeada47277f tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: 4dcdd769-bbfe-48e8-a876-8b2072b7baeb] calling os-brick to detach iSCSI Volume {{(pid=75226) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 17 01:30:47 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc969c53-d9e6-4376-a6fa-6aeada47277f tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc4cc36b490>, {'target_iqn': 'iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EwKBfZbN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:30:47 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-dc969c53-d9e6-4376-a6fa-6aeada47277f tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:30:47 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-dc969c53-d9e6-4376-a6fa-6aeada47277f tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:30:47 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-dc969c53-d9e6-4376-a6fa-6aeada47277f tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:30:47 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:30:47 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:30:47 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[697b32bd-facc-4cb1-aa75-808a1cd2f0ac]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:05f878e5-0241-4282-8b2c-c4651c429dcb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:30:47 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc969c53-d9e6-4376-a6fa-6aeada47277f tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 17 01:30:47 user nova-compute[75226]: No targets found.
Nov 17 01:30:47 user nova-compute[75226]: iSNS:
Nov 17 01:30:47 user nova-compute[75226]: No targets found.
Nov 17 01:30:47 user nova-compute[75226]: STATIC:
Nov 17 01:30:47 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14
Nov 17 01:30:47 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:30:47 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:30:47 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba
Nov 17 01:30:47 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:30:47 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:30:47 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:05f878e5-0241-4282-8b2c-c4651c429dcb
Nov 17 01:30:47 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:30:47 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:30:47 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8
Nov 17 01:30:47 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:30:47 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:30:47 user nova-compute[75226]: FIRMWARE:
Nov 17 01:30:47 user nova-compute[75226]: No targets found.
Nov 17 01:30:47 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:30:47 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc969c53-d9e6-4376-a6fa-6aeada47277f tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 17 01:30:47 user nova-compute[75226]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 17 01:30:47 user nova-compute[75226]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75226) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 17 01:30:47 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc969c53-d9e6-4376-a6fa-6aeada47277f tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14', 0)] {{(pid=75226) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 17 01:30:47 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:30:47 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:30:47 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ca84f87-2352-4c06-b668-5a7804936da6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:05f878e5-0241-4282-8b2c-c4651c429dcb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:30:47 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:30:47 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:30:47 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4502a14-a8d1-47cb-962a-ce9d5610aed2]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05f878e5-0241-4282-8b2c-c4651c429dcb (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:30:47 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc969c53-d9e6-4376-a6fa-6aeada47277f tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)
Nov 17 01:30:47 user nova-compute[75226]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14 (non-flash)
Nov 17 01:30:47 user nova-compute[75226]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05f878e5-0241-4282-8b2c-c4651c429dcb (non-flash)
Nov 17 01:30:47 user nova-compute[75226]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba (non-flash)
Nov 17 01:30:47 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:30:47 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc969c53-d9e6-4376-a6fa-6aeada47277f tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)
Nov 17 01:30:47 user nova-compute[75226]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14 (non-flash)
Nov 17 01:30:47 user nova-compute[75226]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05f878e5-0241-4282-8b2c-c4651c429dcb (non-flash)
Nov 17 01:30:47 user nova-compute[75226]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba (non-flash)
Nov 17 01:30:47 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:30:47 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc969c53-d9e6-4376-a6fa-6aeada47277f tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc4b41d8550>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14'): ({'sdd'}, set())}) {{(pid=75226) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 17 01:30:47 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-dc969c53-d9e6-4376-a6fa-6aeada47277f tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Removing single pathed devices sdd {{(pid=75226) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 17 01:30:47 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:30:47 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:30:47 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[32fe4e01-de97-4bf2-a974-e8d56b1e0f48]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:30:47 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:30:47 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:30:47 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[18224ef4-d9b1-4b3b-901c-0b3b2bde0427]: (4, ('ok\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:30:47 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-dc969c53-d9e6-4376-a6fa-6aeada47277f tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Flushing IO for device /dev/sdd {{(pid=75226) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 17 01:30:47 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:30:47 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:30:47 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[cae5cb7c-e68b-43dd-9afc-bf0277b5968a]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:30:47 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-dc969c53-d9e6-4376-a6fa-6aeada47277f tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75226) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 17 01:30:47 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:30:47 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.044s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:30:47 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c111aa2-efce-46f7-aa6a-bd62869470e8]: (4, ('1', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:30:47 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-dc969c53-d9e6-4376-a6fa-6aeada47277f tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75226) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 17 01:30:47 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-dc969c53-d9e6-4376-a6fa-6aeada47277f tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] SCSI volumes sdd have been removed. {{(pid=75226) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 17 01:30:47 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc969c53-d9e6-4376-a6fa-6aeada47277f tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14')] {{(pid=75226) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 17 01:30:47 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:30:47 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:30:47 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[d74d616c-e855-4185-a621-1b33756f237e]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:30:47 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc969c53-d9e6-4376-a6fa-6aeada47277f tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:30:47 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14 -p 172.16.0.220:3260 --logout {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:30:47 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:30:47 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[a16d4e1a-bf6e-4b78-91c3-c250b969c147]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:30:47 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc969c53-d9e6-4376-a6fa-6aeada47277f tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14, portal: 172.16.0.220,3260]
Nov 17 01:30:47 user nova-compute[75226]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14, portal: 172.16.0.220,3260] successful.
Nov 17 01:30:47 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:30:47 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14 -p 172.16.0.220:3260 --op delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:30:47 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:528da57f-3100-4711-849f-f7a3a30ced14 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:30:47 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[89c85ac4-6285-4a60-af90-8c8b17276967]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:30:47 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc969c53-d9e6-4376-a6fa-6aeada47277f tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:30:47 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-dc969c53-d9e6-4376-a6fa-6aeada47277f tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.306s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:30:47 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc969c53-d9e6-4376-a6fa-6aeada47277f tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] <== disconnect_volume: return (307ms) None {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:30:47 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc969c53-d9e6-4376-a6fa-6aeada47277f tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: 4dcdd769-bbfe-48e8-a876-8b2072b7baeb] Disconnected iSCSI Volume {{(pid=75226) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 17 01:30:47 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:30:48 user nova-compute[75226]: DEBUG nova.objects.instance [None req-dc969c53-d9e6-4376-a6fa-6aeada47277f tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Lazy-loading 'flavor' on Instance uuid 4dcdd769-bbfe-48e8-a876-8b2072b7baeb {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:30:48 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-dc969c53-d9e6-4376-a6fa-6aeada47277f tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Lock "4dcdd769-bbfe-48e8-a876-8b2072b7baeb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.064s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:30:50 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:30:52 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:30:55 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:30:57 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:31:00 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:31:02 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:31:03 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-c1030ca7-e641-4b2d-893d-aee2c0dff7fc tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Acquiring lock "f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:31:03 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-c1030ca7-e641-4b2d-893d-aee2c0dff7fc tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Lock "f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:31:03 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-c1030ca7-e641-4b2d-893d-aee2c0dff7fc tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Acquiring lock "f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:31:03 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-c1030ca7-e641-4b2d-893d-aee2c0dff7fc tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Lock "f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:31:03 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-c1030ca7-e641-4b2d-893d-aee2c0dff7fc tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Lock "f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:31:03 user nova-compute[75226]: INFO nova.compute.manager [None req-c1030ca7-e641-4b2d-893d-aee2c0dff7fc tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] [instance: f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c] Terminating instance
Nov 17 01:31:03 user nova-compute[75226]: DEBUG nova.compute.manager [None req-c1030ca7-e641-4b2d-893d-aee2c0dff7fc tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] [instance: f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c] Start destroying the instance on the hypervisor. {{(pid=75226) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 17 01:31:03 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:31:03 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:31:03 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:31:03 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:31:03 user nova-compute[75226]: DEBUG nova.compute.manager [req-d71646c1-9712-4656-92da-18a87deac25e req-3ac4441d-4e9e-4010-be11-b35069c6fee1 service nova] [instance: f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c] Received event network-vif-unplugged-ed40e788-7338-4ecd-8204-008d4601131b {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:31:03 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-d71646c1-9712-4656-92da-18a87deac25e req-3ac4441d-4e9e-4010-be11-b35069c6fee1 service nova] Acquiring lock "f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:31:03 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-d71646c1-9712-4656-92da-18a87deac25e req-3ac4441d-4e9e-4010-be11-b35069c6fee1 service nova] Lock "f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:31:03 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-d71646c1-9712-4656-92da-18a87deac25e req-3ac4441d-4e9e-4010-be11-b35069c6fee1 service nova] Lock "f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:31:03 user nova-compute[75226]: DEBUG nova.compute.manager [req-d71646c1-9712-4656-92da-18a87deac25e req-3ac4441d-4e9e-4010-be11-b35069c6fee1 service nova] [instance: f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c] No waiting events found dispatching network-vif-unplugged-ed40e788-7338-4ecd-8204-008d4601131b {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:31:03 user nova-compute[75226]: DEBUG nova.compute.manager [req-d71646c1-9712-4656-92da-18a87deac25e req-3ac4441d-4e9e-4010-be11-b35069c6fee1 service nova] [instance: f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c] Received event network-vif-unplugged-ed40e788-7338-4ecd-8204-008d4601131b for instance with task_state deleting. {{(pid=75226) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 17 01:31:03 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:31:03 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:31:04 user nova-compute[75226]: INFO nova.virt.libvirt.driver [-] [instance: f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c] Instance destroyed successfully.
Nov 17 01:31:04 user nova-compute[75226]: DEBUG nova.objects.instance [None req-c1030ca7-e641-4b2d-893d-aee2c0dff7fc tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Lazy-loading 'resources' on Instance uuid f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:31:04 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-c1030ca7-e641-4b2d-893d-aee2c0dff7fc tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:21:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-980884499',display_name='tempest-AttachVolumeTestJSON-server-980884499',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-980884499',id=14,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEeERZjFkWxmLB8VU7feu2kYsY5hOpCoxndDBoQzV87owC8kzSgAjyPTw83uHfeVmkKFRyeTiQ9M6sBUaGKQxsiszNV9RLzq6OmxLI7Pi6/hF+7Z96DGb0RR92U15Os/9A==',key_name='tempest-keypair-1317105249',keypairs=<?>,launch_index=0,launched_at=2023-11-17T01:21:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='054575d3dc66452091173b4c604b8c96',ramdisk_id='',reservation_id='r-cjk2rxuv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-223132631',owner_user_name='tempest-AttachVolumeTestJSON-223132631-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T01:29:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c30381a66814427ba39e21c024136fee',uuid=f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ed40e788-7338-4ecd-8204-008d4601131b", "address": "fa:16:3e:69:68:ce", "network": {"id": "c93f11a7-52c6-4379-a1fb-9a002876c221", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-985502177-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "054575d3dc66452091173b4c604b8c96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped40e788-73", "ovs_interfaceid": "ed40e788-7338-4ecd-8204-008d4601131b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 17 01:31:04 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-c1030ca7-e641-4b2d-893d-aee2c0dff7fc tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Converting VIF {"id": "ed40e788-7338-4ecd-8204-008d4601131b", "address": "fa:16:3e:69:68:ce", "network": {"id": "c93f11a7-52c6-4379-a1fb-9a002876c221", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-985502177-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "054575d3dc66452091173b4c604b8c96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped40e788-73", "ovs_interfaceid": "ed40e788-7338-4ecd-8204-008d4601131b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:31:04 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-c1030ca7-e641-4b2d-893d-aee2c0dff7fc tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:68:ce,bridge_name='br-int',has_traffic_filtering=True,id=ed40e788-7338-4ecd-8204-008d4601131b,network=Network(c93f11a7-52c6-4379-a1fb-9a002876c221),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped40e788-73') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:31:04 user nova-compute[75226]: DEBUG os_vif [None req-c1030ca7-e641-4b2d-893d-aee2c0dff7fc tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:68:ce,bridge_name='br-int',has_traffic_filtering=True,id=ed40e788-7338-4ecd-8204-008d4601131b,network=Network(c93f11a7-52c6-4379-a1fb-9a002876c221),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped40e788-73') {{(pid=75226) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 17 01:31:04 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:31:04 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=taped40e788-73, bridge=br-int, if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:31:04 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:31:04 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:31:04 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:31:04 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b259d550-1edd-4f6c-b69f-046f4d48b2e5) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:31:04 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:31:04 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:31:04 user nova-compute[75226]: INFO os_vif [None req-c1030ca7-e641-4b2d-893d-aee2c0dff7fc tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:68:ce,bridge_name='br-int',has_traffic_filtering=True,id=ed40e788-7338-4ecd-8204-008d4601131b,network=Network(c93f11a7-52c6-4379-a1fb-9a002876c221),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped40e788-73')
Nov 17 01:31:04 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-c1030ca7-e641-4b2d-893d-aee2c0dff7fc tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] [instance: f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c] Deleting instance files /opt/stack/data/nova/instances/f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c_del
Nov 17 01:31:04 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-c1030ca7-e641-4b2d-893d-aee2c0dff7fc tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] [instance: f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c] Deletion of /opt/stack/data/nova/instances/f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c_del complete
Nov 17 01:31:04 user nova-compute[75226]: INFO nova.compute.manager [None req-c1030ca7-e641-4b2d-893d-aee2c0dff7fc tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] [instance: f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c] Took 0.68 seconds to destroy the instance on the hypervisor.
Nov 17 01:31:04 user nova-compute[75226]: DEBUG oslo.service.loopingcall [None req-c1030ca7-e641-4b2d-893d-aee2c0dff7fc tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75226) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 17 01:31:04 user nova-compute[75226]: DEBUG nova.compute.manager [-] [instance: f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c] Deallocating network for instance {{(pid=75226) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 17 01:31:04 user nova-compute[75226]: DEBUG nova.network.neutron [-] [instance: f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c] deallocate_for_instance() {{(pid=75226) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 17 01:31:04 user nova-compute[75226]: DEBUG nova.network.neutron [-] [instance: f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c] Updating instance_info_cache with network_info: [] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:31:04 user nova-compute[75226]: INFO nova.compute.manager [-] [instance: f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c] Took 0.79 seconds to deallocate network for instance.
Nov 17 01:31:04 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:31:04 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:31:04 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:31:04 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:31:04 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75226) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 17 01:31:04 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-c1030ca7-e641-4b2d-893d-aee2c0dff7fc tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:31:04 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-c1030ca7-e641-4b2d-893d-aee2c0dff7fc tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:31:05 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa84e575-bdad-45b9-80ce-86b1c2826fb0/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:31:05 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa84e575-bdad-45b9-80ce-86b1c2826fb0/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:31:05 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa84e575-bdad-45b9-80ce-86b1c2826fb0/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:31:05 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-c1030ca7-e641-4b2d-893d-aee2c0dff7fc tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:31:05 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-c1030ca7-e641-4b2d-893d-aee2c0dff7fc tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:31:05 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-c1030ca7-e641-4b2d-893d-aee2c0dff7fc tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.523s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:31:05 user nova-compute[75226]: INFO nova.scheduler.client.report [None req-c1030ca7-e641-4b2d-893d-aee2c0dff7fc tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Deleted allocations for instance f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c
Nov 17 01:31:05 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa84e575-bdad-45b9-80ce-86b1c2826fb0/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:31:05 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee2187c9-8620-4fd2-ad8a-a054cd8393f3/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:31:05 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-c1030ca7-e641-4b2d-893d-aee2c0dff7fc tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Lock "f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.176s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:31:05 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee2187c9-8620-4fd2-ad8a-a054cd8393f3/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:31:05 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee2187c9-8620-4fd2-ad8a-a054cd8393f3/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:31:05 user nova-compute[75226]: DEBUG nova.compute.manager [req-2d23307e-6981-4be4-a60e-8a01d6612afa req-fe6ab160-f50e-4928-b5c8-35bb9aafae98 service nova] [instance: f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c] Received event network-vif-plugged-ed40e788-7338-4ecd-8204-008d4601131b {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:31:05 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-2d23307e-6981-4be4-a60e-8a01d6612afa req-fe6ab160-f50e-4928-b5c8-35bb9aafae98 service nova] Acquiring lock "f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:31:05 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-2d23307e-6981-4be4-a60e-8a01d6612afa req-fe6ab160-f50e-4928-b5c8-35bb9aafae98 service nova] Lock "f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:31:05 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-2d23307e-6981-4be4-a60e-8a01d6612afa req-fe6ab160-f50e-4928-b5c8-35bb9aafae98 service nova] Lock "f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:31:05 user nova-compute[75226]: DEBUG nova.compute.manager [req-2d23307e-6981-4be4-a60e-8a01d6612afa req-fe6ab160-f50e-4928-b5c8-35bb9aafae98 service nova] [instance: f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c] No waiting events found dispatching network-vif-plugged-ed40e788-7338-4ecd-8204-008d4601131b {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:31:05 user nova-compute[75226]: WARNING nova.compute.manager [req-2d23307e-6981-4be4-a60e-8a01d6612afa req-fe6ab160-f50e-4928-b5c8-35bb9aafae98 service nova] [instance: f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c] Received unexpected event network-vif-plugged-ed40e788-7338-4ecd-8204-008d4601131b for instance with vm_state deleted and task_state None.
Nov 17 01:31:05 user nova-compute[75226]: DEBUG nova.compute.manager [req-2d23307e-6981-4be4-a60e-8a01d6612afa req-fe6ab160-f50e-4928-b5c8-35bb9aafae98 service nova] [instance: f45ff6b3-164d-4a85-9c4c-2964a8ddeb1c] Received event network-vif-deleted-ed40e788-7338-4ecd-8204-008d4601131b {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:31:05 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee2187c9-8620-4fd2-ad8a-a054cd8393f3/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:31:05 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75226) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 01:31:05 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6555d72-6094-4ea9-b071-a3d3c8a300a9/disk.rescue --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:31:06 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6555d72-6094-4ea9-b071-a3d3c8a300a9/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:31:06 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6555d72-6094-4ea9-b071-a3d3c8a300a9/disk.rescue --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:31:06 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6555d72-6094-4ea9-b071-a3d3c8a300a9/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:31:06 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6555d72-6094-4ea9-b071-a3d3c8a300a9/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:31:06 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6555d72-6094-4ea9-b071-a3d3c8a300a9/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:31:06 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6555d72-6094-4ea9-b071-a3d3c8a300a9/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:31:06 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6555d72-6094-4ea9-b071-a3d3c8a300a9/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:31:06 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e8b4b85-fe0c-4592-850e-e94ebab32d02/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:31:06 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e8b4b85-fe0c-4592-850e-e94ebab32d02/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:31:06 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e8b4b85-fe0c-4592-850e-e94ebab32d02/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:31:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e8b4b85-fe0c-4592-850e-e94ebab32d02/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:31:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38062487-67ca-4962-974f-81456aebe97b/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:31:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38062487-67ca-4962-974f-81456aebe97b/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:31:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38062487-67ca-4962-974f-81456aebe97b/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:31:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38062487-67ca-4962-974f-81456aebe97b/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:31:07 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75226) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 01:31:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c280142-8901-4f83-bde4-baaa097e05b0/disk.rescue --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:31:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c280142-8901-4f83-bde4-baaa097e05b0/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:31:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c280142-8901-4f83-bde4-baaa097e05b0/disk.rescue --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:31:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c280142-8901-4f83-bde4-baaa097e05b0/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:31:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c280142-8901-4f83-bde4-baaa097e05b0/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:31:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c280142-8901-4f83-bde4-baaa097e05b0/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:31:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c280142-8901-4f83-bde4-baaa097e05b0/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:31:07 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:31:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c280142-8901-4f83-bde4-baaa097e05b0/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:31:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4050d898-f2b8-46c2-86e3-702ceb41a701/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:31:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4050d898-f2b8-46c2-86e3-702ceb41a701/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:31:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4050d898-f2b8-46c2-86e3-702ceb41a701/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:31:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4050d898-f2b8-46c2-86e3-702ceb41a701/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:31:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ea5a14b-c330-4a2b-926e-60e1b30f5981/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:31:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ea5a14b-c330-4a2b-926e-60e1b30f5981/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:31:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ea5a14b-c330-4a2b-926e-60e1b30f5981/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:31:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ea5a14b-c330-4a2b-926e-60e1b30f5981/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:31:08 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75226) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 01:31:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dcdd769-bbfe-48e8-a876-8b2072b7baeb/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:31:09 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dcdd769-bbfe-48e8-a876-8b2072b7baeb/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:31:09 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dcdd769-bbfe-48e8-a876-8b2072b7baeb/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:31:09 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:31:09 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dcdd769-bbfe-48e8-a876-8b2072b7baeb/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:31:09 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:31:09 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:31:09 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Hypervisor/Node resource view: name=user free_ram=7568MB free_disk=24.967273712158203GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75226) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 17 01:31:09 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:31:09 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:31:09 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance aa84e575-bdad-45b9-80ce-86b1c2826fb0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:31:09 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 6b7e9611-be35-4e51-b886-91a2fac0a653 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:31:09 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 38062487-67ca-4962-974f-81456aebe97b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:31:09 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 4050d898-f2b8-46c2-86e3-702ceb41a701 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:31:09 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 4dcdd769-bbfe-48e8-a876-8b2072b7baeb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:31:09 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 2ea5a14b-c330-4a2b-926e-60e1b30f5981 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:31:09 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance d6555d72-6094-4ea9-b071-a3d3c8a300a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:31:09 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 5c280142-8901-4f83-bde4-baaa097e05b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:31:09 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance ee2187c9-8620-4fd2-ad8a-a054cd8393f3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:31:09 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 3018e3a2-01e0-49d7-a960-51718709845a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:31:09 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 9e8b4b85-fe0c-4592-850e-e94ebab32d02 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:31:09 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75226) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 17 01:31:09 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75226) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 17 01:31:09 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:31:09 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:31:10 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Compute_service record updated for user:user {{(pid=75226) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 17 01:31:10 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.440s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:31:12 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:31:12 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:31:12 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:31:12 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:31:13 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:31:14 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:31:14 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:31:14 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Starting heal instance info cache {{(pid=75226) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 17 01:31:15 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "refresh_cache-6b7e9611-be35-4e51-b886-91a2fac0a653" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:31:15 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquired lock "refresh_cache-6b7e9611-be35-4e51-b886-91a2fac0a653" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:31:15 user nova-compute[75226]: DEBUG nova.network.neutron [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] [instance: 6b7e9611-be35-4e51-b886-91a2fac0a653] Forcefully refreshing network info cache for instance {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 17 01:31:15 user nova-compute[75226]: DEBUG nova.network.neutron [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] [instance: 6b7e9611-be35-4e51-b886-91a2fac0a653] Updating instance_info_cache with network_info: [{"id": "657af53c-fc3a-45ab-81e5-b2eeea1c88d7", "address": "fa:16:3e:91:de:17", "network": {"id": "450540a3-ff7e-42fb-a0a6-808acd749943", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1503678778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6cb6f679ee4468d82cc7fb5d0f67be9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap657af53c-fc", "ovs_interfaceid": "657af53c-fc3a-45ab-81e5-b2eeea1c88d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:31:15 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Releasing lock "refresh_cache-6b7e9611-be35-4e51-b886-91a2fac0a653" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:31:15 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] [instance: 6b7e9611-be35-4e51-b886-91a2fac0a653] Updated the network info_cache for instance {{(pid=75226) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 17 01:31:15 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:31:15 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75226) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 17 01:31:16 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-0bb3b4b8-912e-4e36-a30f-98057808eb63 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Acquiring lock "4dcdd769-bbfe-48e8-a876-8b2072b7baeb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:31:16 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-0bb3b4b8-912e-4e36-a30f-98057808eb63 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Lock "4dcdd769-bbfe-48e8-a876-8b2072b7baeb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:31:16 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-0bb3b4b8-912e-4e36-a30f-98057808eb63 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Acquiring lock "4dcdd769-bbfe-48e8-a876-8b2072b7baeb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:31:16 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-0bb3b4b8-912e-4e36-a30f-98057808eb63 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Lock "4dcdd769-bbfe-48e8-a876-8b2072b7baeb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:31:16 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-0bb3b4b8-912e-4e36-a30f-98057808eb63 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Lock "4dcdd769-bbfe-48e8-a876-8b2072b7baeb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:31:16 user nova-compute[75226]: INFO nova.compute.manager [None req-0bb3b4b8-912e-4e36-a30f-98057808eb63 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: 4dcdd769-bbfe-48e8-a876-8b2072b7baeb] Terminating instance
Nov 17 01:31:16 user nova-compute[75226]: DEBUG nova.compute.manager [None req-0bb3b4b8-912e-4e36-a30f-98057808eb63 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: 4dcdd769-bbfe-48e8-a876-8b2072b7baeb] Start destroying the instance on the hypervisor. {{(pid=75226) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 17 01:31:16 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:31:16 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:31:16 user nova-compute[75226]: INFO nova.compute.manager [None req-b0f3bba7-755f-4af1-848b-2f00baee45ad tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 3018e3a2-01e0-49d7-a960-51718709845a] Rescuing
Nov 17 01:31:16 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-b0f3bba7-755f-4af1-848b-2f00baee45ad tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Acquiring lock "refresh_cache-3018e3a2-01e0-49d7-a960-51718709845a" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:31:16 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-b0f3bba7-755f-4af1-848b-2f00baee45ad tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Acquired lock "refresh_cache-3018e3a2-01e0-49d7-a960-51718709845a" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:31:16 user nova-compute[75226]: DEBUG nova.network.neutron [None req-b0f3bba7-755f-4af1-848b-2f00baee45ad tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 3018e3a2-01e0-49d7-a960-51718709845a] Building network info cache for instance {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 01:31:16 user nova-compute[75226]: DEBUG nova.compute.manager [req-2af677e9-4ada-4279-b2be-b866ceb0dab9 req-b72c0182-9840-42c4-b1f1-986a49eefadc service nova] [instance: 4dcdd769-bbfe-48e8-a876-8b2072b7baeb] Received event network-vif-unplugged-89afa235-d910-4430-a95a-c173ba7a7048 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:31:16 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-2af677e9-4ada-4279-b2be-b866ceb0dab9 req-b72c0182-9840-42c4-b1f1-986a49eefadc service nova] Acquiring lock "4dcdd769-bbfe-48e8-a876-8b2072b7baeb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:31:16 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-2af677e9-4ada-4279-b2be-b866ceb0dab9 req-b72c0182-9840-42c4-b1f1-986a49eefadc service nova] Lock "4dcdd769-bbfe-48e8-a876-8b2072b7baeb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:31:16 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-2af677e9-4ada-4279-b2be-b866ceb0dab9 req-b72c0182-9840-42c4-b1f1-986a49eefadc service nova] Lock "4dcdd769-bbfe-48e8-a876-8b2072b7baeb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:31:16 user nova-compute[75226]: DEBUG nova.compute.manager [req-2af677e9-4ada-4279-b2be-b866ceb0dab9 req-b72c0182-9840-42c4-b1f1-986a49eefadc service nova] [instance: 4dcdd769-bbfe-48e8-a876-8b2072b7baeb] No waiting events found dispatching network-vif-unplugged-89afa235-d910-4430-a95a-c173ba7a7048 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:31:16 user nova-compute[75226]: DEBUG nova.compute.manager [req-2af677e9-4ada-4279-b2be-b866ceb0dab9 req-b72c0182-9840-42c4-b1f1-986a49eefadc service nova] [instance: 4dcdd769-bbfe-48e8-a876-8b2072b7baeb] Received event network-vif-unplugged-89afa235-d910-4430-a95a-c173ba7a7048 for instance with task_state deleting. {{(pid=75226) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 17 01:31:16 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:31:16 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:31:17 user nova-compute[75226]: INFO nova.virt.libvirt.driver [-] [instance: 4dcdd769-bbfe-48e8-a876-8b2072b7baeb] Instance destroyed successfully.
Nov 17 01:31:17 user nova-compute[75226]: DEBUG nova.objects.instance [None req-0bb3b4b8-912e-4e36-a30f-98057808eb63 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Lazy-loading 'resources' on Instance uuid 4dcdd769-bbfe-48e8-a876-8b2072b7baeb {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:31:17 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-0bb3b4b8-912e-4e36-a30f-98057808eb63 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-17T01:25:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1264841713',display_name='tempest-ServerActionsTestOtherA-server-77073469',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1264841713',id=23,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGOKbwek9F3YeeXoISPpS9+FDOrqOAqUhG9ukSmG/2nvRhlXurk6SPlW7mGAsx4jOBi7d45LHSKFtCo2RRjgggrHiA9jsTNQAxfCNWgvK2lGzcNS8ikfzoMNKYvTRylwaw==',key_name='tempest-keypair-1621147487',keypairs=<?>,launch_index=0,launched_at=2023-11-17T01:27:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f9042fe4ecc245dd97553f6e942c3e05',ramdisk_id='',reservation_id='r-g0p6okz5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2125452149',owner_user_name='tempest-ServerActionsTestOtherA-2125452149-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T01:27:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a13dd8231937440185c9fc628c3bd5db',uuid=4dcdd769-bbfe-48e8-a876-8b2072b7baeb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "89afa235-d910-4430-a95a-c173ba7a7048", "address": "fa:16:3e:a8:19:37", "network": {"id": "9f39d3e5-b106-4bd9-b8ba-0f326e89c481", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-675861281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9042fe4ecc245dd97553f6e942c3e05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89afa235-d9", "ovs_interfaceid": "89afa235-d910-4430-a95a-c173ba7a7048", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 17 01:31:17 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-0bb3b4b8-912e-4e36-a30f-98057808eb63 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Converting VIF {"id": "89afa235-d910-4430-a95a-c173ba7a7048", "address": "fa:16:3e:a8:19:37", "network": {"id": "9f39d3e5-b106-4bd9-b8ba-0f326e89c481", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-675861281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9042fe4ecc245dd97553f6e942c3e05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89afa235-d9", "ovs_interfaceid": "89afa235-d910-4430-a95a-c173ba7a7048", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:31:17 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-0bb3b4b8-912e-4e36-a30f-98057808eb63 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a8:19:37,bridge_name='br-int',has_traffic_filtering=True,id=89afa235-d910-4430-a95a-c173ba7a7048,network=Network(9f39d3e5-b106-4bd9-b8ba-0f326e89c481),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89afa235-d9') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:31:17 user nova-compute[75226]: DEBUG os_vif [None req-0bb3b4b8-912e-4e36-a30f-98057808eb63 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a8:19:37,bridge_name='br-int',has_traffic_filtering=True,id=89afa235-d910-4430-a95a-c173ba7a7048,network=Network(9f39d3e5-b106-4bd9-b8ba-0f326e89c481),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89afa235-d9') {{(pid=75226) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 17 01:31:17 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:31:17 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap89afa235-d9, bridge=br-int, if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:31:17 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:31:17 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:31:17 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:31:17 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b6680288-00ed-458e-957d-d2f28ca11c41) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:31:17 user nova-compute[75226]: DEBUG nova.network.neutron [None req-b0f3bba7-755f-4af1-848b-2f00baee45ad tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 3018e3a2-01e0-49d7-a960-51718709845a] Updating instance_info_cache with network_info: [{"id": "f05fa2a1-b61b-4617-b895-8c75645bde94", "address": "fa:16:3e:0b:9b:f6", "network": {"id": "450540a3-ff7e-42fb-a0a6-808acd749943", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1503678778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6cb6f679ee4468d82cc7fb5d0f67be9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf05fa2a1-b6", "ovs_interfaceid": "f05fa2a1-b61b-4617-b895-8c75645bde94", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:31:17 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:31:17 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:31:17 user nova-compute[75226]: INFO os_vif [None req-0bb3b4b8-912e-4e36-a30f-98057808eb63 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a8:19:37,bridge_name='br-int',has_traffic_filtering=True,id=89afa235-d910-4430-a95a-c173ba7a7048,network=Network(9f39d3e5-b106-4bd9-b8ba-0f326e89c481),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89afa235-d9')
Nov 17 01:31:17 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-0bb3b4b8-912e-4e36-a30f-98057808eb63 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: 4dcdd769-bbfe-48e8-a876-8b2072b7baeb] Deleting instance files /opt/stack/data/nova/instances/4dcdd769-bbfe-48e8-a876-8b2072b7baeb_del
Nov 17 01:31:17 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-0bb3b4b8-912e-4e36-a30f-98057808eb63 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: 4dcdd769-bbfe-48e8-a876-8b2072b7baeb] Deletion of /opt/stack/data/nova/instances/4dcdd769-bbfe-48e8-a876-8b2072b7baeb_del complete
Nov 17 01:31:17 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-b0f3bba7-755f-4af1-848b-2f00baee45ad tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Releasing lock "refresh_cache-3018e3a2-01e0-49d7-a960-51718709845a" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:31:17 user nova-compute[75226]: INFO nova.compute.manager [None req-0bb3b4b8-912e-4e36-a30f-98057808eb63 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: 4dcdd769-bbfe-48e8-a876-8b2072b7baeb] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 17 01:31:17 user nova-compute[75226]: DEBUG oslo.service.loopingcall [None req-0bb3b4b8-912e-4e36-a30f-98057808eb63 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75226) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 17 01:31:17 user nova-compute[75226]: DEBUG nova.compute.manager [-] [instance: 4dcdd769-bbfe-48e8-a876-8b2072b7baeb] Deallocating network for instance {{(pid=75226) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 17 01:31:17 user nova-compute[75226]: DEBUG nova.network.neutron [-] [instance: 4dcdd769-bbfe-48e8-a876-8b2072b7baeb] deallocate_for_instance() {{(pid=75226) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 17 01:31:17 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:31:17 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:31:17 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:31:17 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:31:18 user nova-compute[75226]: DEBUG nova.compute.manager [req-cca16a54-a7bd-4e04-87af-548bedacc85f req-7dfed619-78cd-40b4-a422-ee21096adde7 service nova] [instance: 3018e3a2-01e0-49d7-a960-51718709845a] Received event network-vif-unplugged-f05fa2a1-b61b-4617-b895-8c75645bde94 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:31:18 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-cca16a54-a7bd-4e04-87af-548bedacc85f req-7dfed619-78cd-40b4-a422-ee21096adde7 service nova] Acquiring lock "3018e3a2-01e0-49d7-a960-51718709845a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:31:18 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-cca16a54-a7bd-4e04-87af-548bedacc85f req-7dfed619-78cd-40b4-a422-ee21096adde7 service nova] Lock "3018e3a2-01e0-49d7-a960-51718709845a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:31:18 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-cca16a54-a7bd-4e04-87af-548bedacc85f req-7dfed619-78cd-40b4-a422-ee21096adde7 service nova] Lock "3018e3a2-01e0-49d7-a960-51718709845a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:31:18 user nova-compute[75226]: DEBUG nova.compute.manager [req-cca16a54-a7bd-4e04-87af-548bedacc85f req-7dfed619-78cd-40b4-a422-ee21096adde7 service nova] [instance: 3018e3a2-01e0-49d7-a960-51718709845a] No waiting events found dispatching network-vif-unplugged-f05fa2a1-b61b-4617-b895-8c75645bde94 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:31:18 user nova-compute[75226]: WARNING nova.compute.manager [req-cca16a54-a7bd-4e04-87af-548bedacc85f req-7dfed619-78cd-40b4-a422-ee21096adde7 service nova] [instance: 3018e3a2-01e0-49d7-a960-51718709845a] Received unexpected event network-vif-unplugged-f05fa2a1-b61b-4617-b895-8c75645bde94 for instance with vm_state active and task_state rescuing.
Nov 17 01:31:18 user nova-compute[75226]: INFO nova.virt.libvirt.driver [-] [instance: 3018e3a2-01e0-49d7-a960-51718709845a] Instance destroyed successfully.
Nov 17 01:31:18 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-b0f3bba7-755f-4af1-848b-2f00baee45ad tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 3018e3a2-01e0-49d7-a960-51718709845a] Attempting a stable device rescue
Nov 17 01:31:18 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-b0f3bba7-755f-4af1-848b-2f00baee45ad tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75226) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 17 01:31:18 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-b0f3bba7-755f-4af1-848b-2f00baee45ad tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 3018e3a2-01e0-49d7-a960-51718709845a] Instance directory exists: not creating {{(pid=75226) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 17 01:31:18 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-b0f3bba7-755f-4af1-848b-2f00baee45ad tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 3018e3a2-01e0-49d7-a960-51718709845a] Creating image(s)
Nov 17 01:31:18 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-b0f3bba7-755f-4af1-848b-2f00baee45ad tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Acquiring lock "/opt/stack/data/nova/instances/3018e3a2-01e0-49d7-a960-51718709845a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:31:18 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-b0f3bba7-755f-4af1-848b-2f00baee45ad tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Lock "/opt/stack/data/nova/instances/3018e3a2-01e0-49d7-a960-51718709845a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:31:18 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-b0f3bba7-755f-4af1-848b-2f00baee45ad tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Lock "/opt/stack/data/nova/instances/3018e3a2-01e0-49d7-a960-51718709845a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:31:18 user nova-compute[75226]: DEBUG nova.objects.instance [None req-b0f3bba7-755f-4af1-848b-2f00baee45ad tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Lazy-loading 'trusted_certs' on Instance uuid 3018e3a2-01e0-49d7-a960-51718709845a {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:31:18 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-b0f3bba7-755f-4af1-848b-2f00baee45ad tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Acquiring lock "3468189901db823a58475181091cbb5d8259d088" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:31:18 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-b0f3bba7-755f-4af1-848b-2f00baee45ad tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Lock "3468189901db823a58475181091cbb5d8259d088" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:31:19 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-b0f3bba7-755f-4af1-848b-2f00baee45ad tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3468189901db823a58475181091cbb5d8259d088.part --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:31:19 user nova-compute[75226]: DEBUG nova.compute.manager [req-8c5664ca-9b50-425c-99ca-20f9935ccd09 req-160925db-4b46-462e-9e1d-139788095a96 service nova] [instance: 4dcdd769-bbfe-48e8-a876-8b2072b7baeb] Received event network-vif-plugged-89afa235-d910-4430-a95a-c173ba7a7048 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:31:19 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-8c5664ca-9b50-425c-99ca-20f9935ccd09 req-160925db-4b46-462e-9e1d-139788095a96 service nova] Acquiring lock "4dcdd769-bbfe-48e8-a876-8b2072b7baeb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:31:19 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-8c5664ca-9b50-425c-99ca-20f9935ccd09 req-160925db-4b46-462e-9e1d-139788095a96 service nova] Lock "4dcdd769-bbfe-48e8-a876-8b2072b7baeb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:31:19 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-8c5664ca-9b50-425c-99ca-20f9935ccd09 req-160925db-4b46-462e-9e1d-139788095a96 service nova] Lock "4dcdd769-bbfe-48e8-a876-8b2072b7baeb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:31:19 user nova-compute[75226]: DEBUG nova.compute.manager [req-8c5664ca-9b50-425c-99ca-20f9935ccd09 req-160925db-4b46-462e-9e1d-139788095a96 service nova] [instance: 4dcdd769-bbfe-48e8-a876-8b2072b7baeb] No waiting events found dispatching network-vif-plugged-89afa235-d910-4430-a95a-c173ba7a7048 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:31:19 user nova-compute[75226]: WARNING nova.compute.manager [req-8c5664ca-9b50-425c-99ca-20f9935ccd09 req-160925db-4b46-462e-9e1d-139788095a96 service nova] [instance: 4dcdd769-bbfe-48e8-a876-8b2072b7baeb] Received unexpected event network-vif-plugged-89afa235-d910-4430-a95a-c173ba7a7048 for instance with vm_state active and task_state deleting.
Nov 17 01:31:19 user nova-compute[75226]: DEBUG nova.network.neutron [-] [instance: 4dcdd769-bbfe-48e8-a876-8b2072b7baeb] Updating instance_info_cache with network_info: [] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:31:19 user nova-compute[75226]: INFO nova.compute.manager [-] [instance: 4dcdd769-bbfe-48e8-a876-8b2072b7baeb] Took 2.23 seconds to deallocate network for instance.
Nov 17 01:31:19 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-0bb3b4b8-912e-4e36-a30f-98057808eb63 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:31:19 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-0bb3b4b8-912e-4e36-a30f-98057808eb63 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:31:19 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-b0f3bba7-755f-4af1-848b-2f00baee45ad tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3468189901db823a58475181091cbb5d8259d088.part --force-share --output=json" returned: 0 in 0.177s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:31:19 user nova-compute[75226]: DEBUG nova.virt.images [None req-b0f3bba7-755f-4af1-848b-2f00baee45ad tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] 5b19cc42-48dd-4dd9-a544-dd442b4f16ba was qcow2, converting to raw {{(pid=75226) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 17 01:31:19 user nova-compute[75226]: DEBUG nova.privsep.utils [None req-b0f3bba7-755f-4af1-848b-2f00baee45ad tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75226) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 17 01:31:19 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-b0f3bba7-755f-4af1-848b-2f00baee45ad tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3468189901db823a58475181091cbb5d8259d088.part /opt/stack/data/nova/instances/_base/3468189901db823a58475181091cbb5d8259d088.converted {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:31:20 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-0bb3b4b8-912e-4e36-a30f-98057808eb63 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:31:20 user nova-compute[75226]: DEBUG nova.compute.manager [req-1d92880a-93cb-41b6-82e0-99319083996a req-3c08dbcb-cb28-43d9-a273-0bd5f671bb95 service nova] [instance: 3018e3a2-01e0-49d7-a960-51718709845a] Received event network-vif-plugged-f05fa2a1-b61b-4617-b895-8c75645bde94 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:31:20 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-1d92880a-93cb-41b6-82e0-99319083996a req-3c08dbcb-cb28-43d9-a273-0bd5f671bb95 service nova] Acquiring lock "3018e3a2-01e0-49d7-a960-51718709845a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:31:20 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-1d92880a-93cb-41b6-82e0-99319083996a req-3c08dbcb-cb28-43d9-a273-0bd5f671bb95 service nova] Lock "3018e3a2-01e0-49d7-a960-51718709845a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:31:20 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-1d92880a-93cb-41b6-82e0-99319083996a req-3c08dbcb-cb28-43d9-a273-0bd5f671bb95 service nova] Lock "3018e3a2-01e0-49d7-a960-51718709845a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:31:20 user nova-compute[75226]: DEBUG nova.compute.manager [req-1d92880a-93cb-41b6-82e0-99319083996a req-3c08dbcb-cb28-43d9-a273-0bd5f671bb95 service nova] [instance: 3018e3a2-01e0-49d7-a960-51718709845a] No waiting events found dispatching network-vif-plugged-f05fa2a1-b61b-4617-b895-8c75645bde94 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:31:20 user nova-compute[75226]: WARNING nova.compute.manager [req-1d92880a-93cb-41b6-82e0-99319083996a req-3c08dbcb-cb28-43d9-a273-0bd5f671bb95 service nova] [instance: 3018e3a2-01e0-49d7-a960-51718709845a] Received unexpected event network-vif-plugged-f05fa2a1-b61b-4617-b895-8c75645bde94 for instance with vm_state active and task_state rescuing.
Nov 17 01:31:20 user nova-compute[75226]: DEBUG nova.compute.manager [req-1d92880a-93cb-41b6-82e0-99319083996a req-3c08dbcb-cb28-43d9-a273-0bd5f671bb95 service nova] [instance: 4dcdd769-bbfe-48e8-a876-8b2072b7baeb] Received event network-vif-deleted-89afa235-d910-4430-a95a-c173ba7a7048 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:31:20 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-0bb3b4b8-912e-4e36-a30f-98057808eb63 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:31:20 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-b0f3bba7-755f-4af1-848b-2f00baee45ad tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3468189901db823a58475181091cbb5d8259d088.part /opt/stack/data/nova/instances/_base/3468189901db823a58475181091cbb5d8259d088.converted" returned: 0 in 0.537s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:31:20 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-b0f3bba7-755f-4af1-848b-2f00baee45ad tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3468189901db823a58475181091cbb5d8259d088.converted --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:31:20 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-0bb3b4b8-912e-4e36-a30f-98057808eb63 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.650s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:31:20 user nova-compute[75226]: INFO nova.scheduler.client.report [None req-0bb3b4b8-912e-4e36-a30f-98057808eb63 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Deleted allocations for instance 4dcdd769-bbfe-48e8-a876-8b2072b7baeb
Nov 17 01:31:20 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-0bb3b4b8-912e-4e36-a30f-98057808eb63 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Lock "4dcdd769-bbfe-48e8-a876-8b2072b7baeb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.941s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:31:20 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-b0f3bba7-755f-4af1-848b-2f00baee45ad tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3468189901db823a58475181091cbb5d8259d088.converted --force-share --output=json" returned: 0 in 0.185s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:31:20 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-b0f3bba7-755f-4af1-848b-2f00baee45ad tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Lock "3468189901db823a58475181091cbb5d8259d088" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.215s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:31:20 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-b0f3bba7-755f-4af1-848b-2f00baee45ad tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Acquiring lock "3468189901db823a58475181091cbb5d8259d088" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:31:20 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-b0f3bba7-755f-4af1-848b-2f00baee45ad tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Lock "3468189901db823a58475181091cbb5d8259d088" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:31:20 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-b0f3bba7-755f-4af1-848b-2f00baee45ad tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3468189901db823a58475181091cbb5d8259d088 --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:31:20 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-b0f3bba7-755f-4af1-848b-2f00baee45ad tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3468189901db823a58475181091cbb5d8259d088 --force-share --output=json" returned: 0 in 0.183s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:31:20 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-b0f3bba7-755f-4af1-848b-2f00baee45ad tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3468189901db823a58475181091cbb5d8259d088,backing_fmt=raw /opt/stack/data/nova/instances/3018e3a2-01e0-49d7-a960-51718709845a/disk.rescue {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:31:20 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-b0f3bba7-755f-4af1-848b-2f00baee45ad tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3468189901db823a58475181091cbb5d8259d088,backing_fmt=raw /opt/stack/data/nova/instances/3018e3a2-01e0-49d7-a960-51718709845a/disk.rescue" returned: 0 in 0.048s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:31:20 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-b0f3bba7-755f-4af1-848b-2f00baee45ad tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Lock "3468189901db823a58475181091cbb5d8259d088" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.238s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:31:20 user nova-compute[75226]: DEBUG nova.objects.instance [None req-b0f3bba7-755f-4af1-848b-2f00baee45ad tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Lazy-loading 'migration_context' on Instance uuid 3018e3a2-01e0-49d7-a960-51718709845a {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:31:20 user nova-compute[75226]: DEBUG nova.objects.base [None req-b0f3bba7-755f-4af1-848b-2f00baee45ad tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Object Instance<3018e3a2-01e0-49d7-a960-51718709845a> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75226) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 17 01:31:20 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-b0f3bba7-755f-4af1-848b-2f00baee45ad tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 3018e3a2-01e0-49d7-a960-51718709845a] Created local disks {{(pid=75226) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 17 01:31:20 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-b0f3bba7-755f-4af1-848b-2f00baee45ad tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 3018e3a2-01e0-49d7-a960-51718709845a] Start _get_guest_xml network_info=[{"id": "f05fa2a1-b61b-4617-b895-8c75645bde94", "address": "fa:16:3e:0b:9b:f6", "network": {"id": "450540a3-ff7e-42fb-a0a6-808acd749943", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1503678778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1503678778-network", "vif_mac": "fa:16:3e:0b:9b:f6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6cb6f679ee4468d82cc7fb5d0f67be9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf05fa2a1-b6", "ovs_interfaceid": "f05fa2a1-b61b-4617-b895-8c75645bde94", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T01:13:22Z,direct_url=<?>,disk_format='qcow2',id=0b369aea-6f3f-4690-9f01-229b90ab6310,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4e110cbf9a84362a6864a7732c435a1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T01:13:23Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '5b19cc42-48dd-4dd9-a544-dd442b4f16ba', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:05f878e5-0241-4282-8b2c-c4651c429dcb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zIwQLnvm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': '3018e3a2-01e0-49d7-a960-51718709845a', 'attached_at': '', 'detached_at': '', 'volume_id': '05f878e5-0241-4282-8b2c-c4651c429dcb', 'serial': '05f878e5-0241-4282-8b2c-c4651c429dcb'}, 'attachment_id': '62fd720b-c932-42c3-85b7-47716bb27ba3', 'device_type': 'disk', 'volume_type': None} {{(pid=75226) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 17 01:31:20 user nova-compute[75226]: DEBUG nova.objects.instance [None req-b0f3bba7-755f-4af1-848b-2f00baee45ad tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Lazy-loading 'resources' on Instance uuid 3018e3a2-01e0-49d7-a960-51718709845a {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:31:20 user nova-compute[75226]: DEBUG nova.objects.base [None req-b0f3bba7-755f-4af1-848b-2f00baee45ad tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Object Instance<3018e3a2-01e0-49d7-a960-51718709845a> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75226) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 17 01:31:20 user nova-compute[75226]: DEBUG nova.objects.instance [None req-b0f3bba7-755f-4af1-848b-2f00baee45ad tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Lazy-loading 'numa_topology' on Instance uuid 3018e3a2-01e0-49d7-a960-51718709845a {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:31:20 user nova-compute[75226]: DEBUG nova.objects.base [None req-b0f3bba7-755f-4af1-848b-2f00baee45ad tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Object Instance<3018e3a2-01e0-49d7-a960-51718709845a> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75226) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 17 01:31:20 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-b0f3bba7-755f-4af1-848b-2f00baee45ad tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:31:20 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-b0f3bba7-755f-4af1-848b-2f00baee45ad tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:31:20 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-b0f3bba7-755f-4af1-848b-2f00baee45ad tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75226) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 17 01:31:20 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-b0f3bba7-755f-4af1-848b-2f00baee45ad tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] CPU controller missing on host. {{(pid=75226) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 17 01:31:20 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-b0f3bba7-755f-4af1-848b-2f00baee45ad tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75226) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 17 01:31:20 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-b0f3bba7-755f-4af1-848b-2f00baee45ad tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] CPU controller found on host. {{(pid=75226) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 17 01:31:20 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-b0f3bba7-755f-4af1-848b-2f00baee45ad tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75226) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 17 01:31:20 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-b0f3bba7-755f-4af1-848b-2f00baee45ad tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-17T01:13:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T01:13:22Z,direct_url=<?>,disk_format='qcow2',id=0b369aea-6f3f-4690-9f01-229b90ab6310,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4e110cbf9a84362a6864a7732c435a1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T01:13:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 17 01:31:20 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-b0f3bba7-755f-4af1-848b-2f00baee45ad tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Flavor limits 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 17 01:31:20 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-b0f3bba7-755f-4af1-848b-2f00baee45ad tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Image limits 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 17 01:31:20 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-b0f3bba7-755f-4af1-848b-2f00baee45ad tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Flavor pref 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 17 01:31:20 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-b0f3bba7-755f-4af1-848b-2f00baee45ad tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Image pref 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 17 01:31:20 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-b0f3bba7-755f-4af1-848b-2f00baee45ad tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 17 01:31:20 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-b0f3bba7-755f-4af1-848b-2f00baee45ad tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 17 01:31:20 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-b0f3bba7-755f-4af1-848b-2f00baee45ad tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75226) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 17 01:31:20 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-b0f3bba7-755f-4af1-848b-2f00baee45ad tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Got 1 possible topologies {{(pid=75226) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 17 01:31:20 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-b0f3bba7-755f-4af1-848b-2f00baee45ad tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 17 01:31:20 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-b0f3bba7-755f-4af1-848b-2f00baee45ad tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 17 01:31:20 user nova-compute[75226]: DEBUG nova.objects.instance [None req-b0f3bba7-755f-4af1-848b-2f00baee45ad tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Lazy-loading 'vcpu_model' on Instance uuid 3018e3a2-01e0-49d7-a960-51718709845a {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:31:20 user nova-compute[75226]: DEBUG nova.objects.base [None req-b0f3bba7-755f-4af1-848b-2f00baee45ad tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Object Instance<3018e3a2-01e0-49d7-a960-51718709845a> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75226) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 17 01:31:20 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0f3bba7-755f-4af1-848b-2f00baee45ad tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 3018e3a2-01e0-49d7-a960-51718709845a] Calling os-brick to attach iSCSI Volume {{(pid=75226) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 17 01:31:20 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0f3bba7-755f-4af1-848b-2f00baee45ad tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc4cc36b490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:05f878e5-0241-4282-8b2c-c4651c429dcb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zIwQLnvm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:31:20 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-b0f3bba7-755f-4af1-848b-2f00baee45ad tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:31:20 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-b0f3bba7-755f-4af1-848b-2f00baee45ad tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:31:20 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-b0f3bba7-755f-4af1-848b-2f00baee45ad tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:31:20 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-b0f3bba7-755f-4af1-848b-2f00baee45ad tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:31:20 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-b0f3bba7-755f-4af1-848b-2f00baee45ad tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:05f878e5-0241-4282-8b2c-c4651c429dcb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:31:20 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-b0f3bba7-755f-4af1-848b-2f00baee45ad tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:05f878e5-0241-4282-8b2c-c4651c429dcb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:31:20 user nova-compute[75226]: INFO os_brick.initiator.connectors.iscsi [None req-b0f3bba7-755f-4af1-848b-2f00baee45ad tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 17 01:31:20 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05f878e5-0241-4282-8b2c-c4651c429dcb -p 172.16.0.220:3260 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:31:20 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05f878e5-0241-4282-8b2c-c4651c429dcb -p 172.16.0.220:3260" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:31:20 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[00116d7a-177d-4a82-9ec0-a1f4a9d35875]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:05f878e5-0241-4282-8b2c-c4651c429dcb\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = zIwQLnvm\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:31:20 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0f3bba7-755f-4af1-848b-2f00baee45ad tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 17 01:31:20 user nova-compute[75226]: node.name = iqn.2010-10.org.openstack:05f878e5-0241-4282-8b2c-c4651c429dcb
Nov 17 01:31:20 user nova-compute[75226]: node.tpgt = -1
Nov 17 01:31:20 user nova-compute[75226]: node.startup = automatic
Nov 17 01:31:20 user nova-compute[75226]: node.leading_login = No
Nov 17 01:31:20 user nova-compute[75226]: iface.iscsi_ifacename = default
Nov 17 01:31:20 user nova-compute[75226]: iface.net_ifacename = <empty>
Nov 17 01:31:20 user nova-compute[75226]: iface.ipaddress = <empty>
Nov 17 01:31:20 user nova-compute[75226]: iface.prefix_len = 0
Nov 17 01:31:20 user nova-compute[75226]: iface.hwaddress = <empty>
Nov 17 01:31:20 user nova-compute[75226]: iface.transport_name = tcp
Nov 17 01:31:20 user nova-compute[75226]: iface.initiatorname = <empty>
Nov 17 01:31:20 user nova-compute[75226]: iface.state = <empty>
Nov 17 01:31:20 user nova-compute[75226]: iface.vlan_id = 0
Nov 17 01:31:20 user nova-compute[75226]: iface.vlan_priority = 0
Nov 17 01:31:20 user nova-compute[75226]: iface.vlan_state = <empty>
Nov 17 01:31:20 user nova-compute[75226]: iface.iface_num = 0
Nov 17 01:31:20 user nova-compute[75226]: iface.mtu = 0
Nov 17 01:31:20 user nova-compute[75226]: iface.port = 0
Nov 17 01:31:20 user nova-compute[75226]: iface.bootproto = <empty>
Nov 17 01:31:20 user nova-compute[75226]: iface.subnet_mask = <empty>
Nov 17 01:31:20 user nova-compute[75226]: iface.gateway = <empty>
Nov 17 01:31:20 user nova-compute[75226]: iface.dhcp_alt_client_id_state = <empty>
Nov 17 01:31:20 user nova-compute[75226]: iface.dhcp_alt_client_id = <empty>
Nov 17 01:31:20 user nova-compute[75226]: iface.dhcp_dns = <empty>
Nov 17 01:31:20 user nova-compute[75226]: iface.dhcp_learn_iqn = <empty>
Nov 17 01:31:20 user nova-compute[75226]: iface.dhcp_req_vendor_id_state = <empty>
Nov 17 01:31:20 user nova-compute[75226]: iface.dhcp_vendor_id_state = <empty>
Nov 17 01:31:20 user nova-compute[75226]: iface.dhcp_vendor_id = <empty>
Nov 17 01:31:20 user nova-compute[75226]: iface.dhcp_slp_da = <empty>
Nov 17 01:31:20 user nova-compute[75226]: iface.fragmentation = <empty>
Nov 17 01:31:20 user nova-compute[75226]: iface.gratuitous_arp = <empty>
Nov 17 01:31:20 user nova-compute[75226]: iface.incoming_forwarding = <empty>
Nov 17 01:31:20 user nova-compute[75226]: iface.tos_state = <empty>
Nov 17 01:31:20 user nova-compute[75226]: iface.tos = 0
Nov 17 01:31:20 user nova-compute[75226]: iface.ttl = 0
Nov 17 01:31:20 user nova-compute[75226]: iface.delayed_ack = <empty>
Nov 17 01:31:20 user nova-compute[75226]: iface.tcp_nagle = <empty>
Nov 17 01:31:20 user nova-compute[75226]: iface.tcp_wsf_state = <empty>
Nov 17 01:31:20 user nova-compute[75226]: iface.tcp_wsf = 0
Nov 17 01:31:20 user nova-compute[75226]: iface.tcp_timer_scale = 0
Nov 17 01:31:20 user nova-compute[75226]: iface.tcp_timestamp = <empty>
Nov 17 01:31:20 user nova-compute[75226]: iface.redirect = <empty>
Nov 17 01:31:20 user nova-compute[75226]: iface.def_task_mgmt_timeout = 0
Nov 17 01:31:20 user nova-compute[75226]: iface.header_digest = <empty>
Nov 17 01:31:20 user nova-compute[75226]: iface.data_digest = <empty>
Nov 17 01:31:20 user nova-compute[75226]: iface.immediate_data = <empty>
Nov 17 01:31:20 user nova-compute[75226]: iface.initial_r2t = <empty>
Nov 17 01:31:20 user nova-compute[75226]: iface.data_seq_inorder = <empty>
Nov 17 01:31:20 user nova-compute[75226]: iface.data_pdu_inorder = <empty>
Nov 17 01:31:20 user nova-compute[75226]: iface.erl = 0
Nov 17 01:31:20 user nova-compute[75226]: iface.max_receive_data_len = 0
Nov 17 01:31:20 user nova-compute[75226]: iface.first_burst_len = 0
Nov 17 01:31:20 user nova-compute[75226]: iface.max_outstanding_r2t = 0
Nov 17 01:31:20 user nova-compute[75226]: iface.max_burst_len = 0
Nov 17 01:31:20 user nova-compute[75226]: iface.chap_auth = <empty>
Nov 17 01:31:20 user nova-compute[75226]: iface.bidi_chap = <empty>
Nov 17 01:31:20 user nova-compute[75226]: iface.strict_login_compliance = <empty>
Nov 17 01:31:20 user nova-compute[75226]: iface.discovery_auth = <empty>
Nov 17 01:31:20 user nova-compute[75226]: iface.discovery_logout = <empty>
Nov 17 01:31:20 user nova-compute[75226]: node.discovery_address = <empty>
Nov 17 01:31:20 user nova-compute[75226]: node.discovery_port = 0
Nov 17 01:31:20 user nova-compute[75226]: node.discovery_type = static
Nov 17 01:31:20 user nova-compute[75226]: node.session.initial_cmdsn = 0
Nov 17 01:31:20 user nova-compute[75226]: node.session.initial_login_retry_max = 8
Nov 17 01:31:20 user nova-compute[75226]: node.session.xmit_thread_priority = -20
Nov 17 01:31:20 user nova-compute[75226]: node.session.cmds_max = 128
Nov 17 01:31:20 user nova-compute[75226]: node.session.queue_depth = 32
Nov 17 01:31:20 user nova-compute[75226]: node.session.nr_sessions = 1
Nov 17 01:31:20 user nova-compute[75226]: node.session.auth.authmethod = CHAP
Nov 17 01:31:20 user nova-compute[75226]: node.session.auth.username = zIwQLnvm
Nov 17 01:31:20 user nova-compute[75226]: node.session.auth.password = ***
Nov 17 01:31:20 user nova-compute[75226]: node.session.auth.username_in = <empty>
Nov 17 01:31:20 user nova-compute[75226]: node.session.auth.password_in = <empty>
Nov 17 01:31:20 user nova-compute[75226]: node.session.auth.chap_algs = MD5
Nov 17 01:31:20 user nova-compute[75226]: node.session.timeo.replacement_timeout = 120
Nov 17 01:31:20 user nova-compute[75226]: node.session.err_timeo.abort_timeout = 15
Nov 17 01:31:20 user nova-compute[75226]: node.session.err_timeo.lu_reset_timeout = 30
Nov 17 01:31:20 user nova-compute[75226]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 17 01:31:20 user nova-compute[75226]: node.session.err_timeo.host_reset_timeout = 60
Nov 17 01:31:20 user nova-compute[75226]: node.session.iscsi.FastAbort = Yes
Nov 17 01:31:20 user nova-compute[75226]: node.session.iscsi.InitialR2T = No
Nov 17 01:31:20 user nova-compute[75226]: node.session.iscsi.ImmediateData = Yes
Nov 17 01:31:20 user nova-compute[75226]: node.session.iscsi.FirstBurstLength = 262144
Nov 17 01:31:20 user nova-compute[75226]: node.session.iscsi.MaxBurstLength = 16776192
Nov 17 01:31:20 user nova-compute[75226]: node.session.iscsi.DefaultTime2Retain = 0
Nov 17 01:31:20 user nova-compute[75226]: node.session.iscsi.DefaultTime2Wait = 2
Nov 17 01:31:20 user nova-compute[75226]: node.session.iscsi.MaxConnections = 1
Nov 17 01:31:20 user nova-compute[75226]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 17 01:31:20 user nova-compute[75226]: node.session.iscsi.ERL = 0
Nov 17 01:31:20 user nova-compute[75226]: node.session.scan = manual
Nov 17 01:31:20 user nova-compute[75226]: node.session.reopen_max = 0
Nov 17 01:31:20 user nova-compute[75226]: node.conn[0].address = 172.16.0.220
Nov 17 01:31:20 user nova-compute[75226]: node.conn[0].port = 3260
Nov 17 01:31:20 user nova-compute[75226]: node.conn[0].startup = manual
Nov 17 01:31:20 user nova-compute[75226]: node.conn[0].tcp.window_size = 524288
Nov 17 01:31:20 user nova-compute[75226]: node.conn[0].tcp.type_of_service = 0
Nov 17 01:31:20 user nova-compute[75226]: node.conn[0].timeo.logout_timeout = 15
Nov 17 01:31:20 user nova-compute[75226]: node.conn[0].timeo.login_timeout = 15
Nov 17 01:31:20 user nova-compute[75226]: node.conn[0].timeo.auth_timeout = 45
Nov 17 01:31:20 user nova-compute[75226]: node.conn[0].timeo.noop_out_interval = 5
Nov 17 01:31:20 user nova-compute[75226]: node.conn[0].timeo.noop_out_timeout = 5
Nov 17 01:31:20 user nova-compute[75226]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 17 01:31:20 user nova-compute[75226]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 17 01:31:20 user nova-compute[75226]: node.conn[0].iscsi.HeaderDigest = None
Nov 17 01:31:20 user nova-compute[75226]: node.conn[0].iscsi.DataDigest = None
Nov 17 01:31:20 user nova-compute[75226]: node.conn[0].iscsi.IFMarker = No
Nov 17 01:31:20 user nova-compute[75226]: node.conn[0].iscsi.OFMarker = No
Nov 17 01:31:20 user nova-compute[75226]: # END RECORD
Nov 17 01:31:20 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:31:20 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05f878e5-0241-4282-8b2c-c4651c429dcb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:31:20 user nova-compute[75226]: DEBUG nova.compute.manager [req-3c94d69d-eb5c-4d9d-b33b-a8106ef8c86d req-5d01ab7c-67a2-4d74-a025-203e93dfde24 service nova] [instance: 9e8b4b85-fe0c-4592-850e-e94ebab32d02] Received event network-changed-5e4b278c-6c95-4fd1-a215-3fa737694996 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:31:20 user nova-compute[75226]: DEBUG nova.compute.manager [req-3c94d69d-eb5c-4d9d-b33b-a8106ef8c86d req-5d01ab7c-67a2-4d74-a025-203e93dfde24 service nova] [instance: 9e8b4b85-fe0c-4592-850e-e94ebab32d02] Refreshing instance network info cache due to event network-changed-5e4b278c-6c95-4fd1-a215-3fa737694996. {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 01:31:20 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-3c94d69d-eb5c-4d9d-b33b-a8106ef8c86d req-5d01ab7c-67a2-4d74-a025-203e93dfde24 service nova] Acquiring lock "refresh_cache-9e8b4b85-fe0c-4592-850e-e94ebab32d02" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:31:20 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-3c94d69d-eb5c-4d9d-b33b-a8106ef8c86d req-5d01ab7c-67a2-4d74-a025-203e93dfde24 service nova] Acquired lock "refresh_cache-9e8b4b85-fe0c-4592-850e-e94ebab32d02" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:31:20 user nova-compute[75226]: DEBUG nova.network.neutron [req-3c94d69d-eb5c-4d9d-b33b-a8106ef8c86d req-5d01ab7c-67a2-4d74-a025-203e93dfde24 service nova] [instance: 9e8b4b85-fe0c-4592-850e-e94ebab32d02] Refreshing network info cache for port 5e4b278c-6c95-4fd1-a215-3fa737694996 {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 01:31:20 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05f878e5-0241-4282-8b2c-c4651c429dcb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:31:20 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2a66fda-fdba-4295-ab0c-4c0c34d351da]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:31:20 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0f3bba7-755f-4af1-848b-2f00baee45ad tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:31:20 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05f878e5-0241-4282-8b2c-c4651c429dcb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:31:20 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05f878e5-0241-4282-8b2c-c4651c429dcb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:31:20 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[774ccc9f-5f8b-4f1f-8e65-be945853fd7b]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:31:20 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0f3bba7-755f-4af1-848b-2f00baee45ad tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:31:20 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05f878e5-0241-4282-8b2c-c4651c429dcb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zIwQLnvm {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:31:21 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05f878e5-0241-4282-8b2c-c4651c429dcb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zIwQLnvm" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:31:21 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8551f23-bd84-4d8b-b020-c8328b1f0dfe]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:31:21 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0f3bba7-755f-4af1-848b-2f00baee45ad tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zIwQLnvm'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:31:21 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05f878e5-0241-4282-8b2c-c4651c429dcb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:31:21 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05f878e5-0241-4282-8b2c-c4651c429dcb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:31:21 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecdbd58d-f788-4689-8afa-a7dc8207b54e]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:31:21 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0f3bba7-755f-4af1-848b-2f00baee45ad tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:31:21 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:31:21 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:31:21 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1fe84ce-b9db-4185-b78e-d277851953b2]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05f878e5-0241-4282-8b2c-c4651c429dcb (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:31:21 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0f3bba7-755f-4af1-848b-2f00baee45ad tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)
Nov 17 01:31:21 user nova-compute[75226]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05f878e5-0241-4282-8b2c-c4651c429dcb (non-flash)
Nov 17 01:31:21 user nova-compute[75226]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba (non-flash)
Nov 17 01:31:21 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:31:21 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0f3bba7-755f-4af1-848b-2f00baee45ad tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)
Nov 17 01:31:21 user nova-compute[75226]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05f878e5-0241-4282-8b2c-c4651c429dcb (non-flash)
Nov 17 01:31:21 user nova-compute[75226]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba (non-flash)
Nov 17 01:31:21 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:31:21 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-b0f3bba7-755f-4af1-848b-2f00baee45ad tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:05f878e5-0241-4282-8b2c-c4651c429dcb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.158s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:31:21 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0f3bba7-755f-4af1-848b-2f00baee45ad tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Connected to 172.16.0.220:3260 {{(pid=75226) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 17 01:31:21 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-b0f3bba7-755f-4af1-848b-2f00baee45ad tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] HCTL ('36', '0', '0', 0) found on session 32 with lun 0 {{(pid=75226) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 17 01:31:21 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-b0f3bba7-755f-4af1-848b-2f00baee45ad tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Scanning host 36 c: 0, t: 0, l: 0) {{(pid=75226) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 17 01:31:21 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:31:21 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:31:21 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdca7616-9f5b-4726-a69f-da28a19e04ed]: (4, ('0 0 0', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:31:21 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-b0f3bba7-755f-4af1-848b-2f00baee45ad tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Searching for a device in session 32 and hctl ('36', '0', '0', 0) yield: sde {{(pid=75226) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 01:31:21 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0f3bba7-755f-4af1-848b-2f00baee45ad tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:05f878e5-0241-4282-8b2c-c4651c429dcb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zIwQLnvm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75226) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 17 01:31:21 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-b0f3bba7-755f-4af1-848b-2f00baee45ad tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.187s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:31:21 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0f3bba7-755f-4af1-848b-2f00baee45ad tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] <== connect_volume: return (188ms) {'type': 'block', 'scsi_wwn': '23536623935346130', 'path': '/dev/sde'} {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:31:21 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0f3bba7-755f-4af1-848b-2f00baee45ad tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 3018e3a2-01e0-49d7-a960-51718709845a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23536623935346130', 'path': '/dev/sde'} {{(pid=75226) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 17 01:31:21 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-b0f3bba7-755f-4af1-848b-2f00baee45ad tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:29:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-324711233',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-324711233',id=29,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-17T01:29:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e6cb6f679ee4468d82cc7fb5d0f67be9',ramdisk_id='',reservation_id='r-vgzgiogg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-76498640',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T01:29:44Z,user_data=None,user_id='1b793ce05bf44b939a9fb5a914a04cb0',uuid=3018e3a2-01e0-49d7-a960-51718709845a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f05fa2a1-b61b-4617-b895-8c75645bde94", "address": "fa:16:3e:0b:9b:f6", "network": {"id": "450540a3-ff7e-42fb-a0a6-808acd749943", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1503678778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1503678778-network", "vif_mac": "fa:16:3e:0b:9b:f6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6cb6f679ee4468d82cc7fb5d0f67be9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf05fa2a1-b6", "ovs_interfaceid": "f05fa2a1-b61b-4617-b895-8c75645bde94", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75226) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 01:31:21 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-b0f3bba7-755f-4af1-848b-2f00baee45ad tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Converting VIF {"id": "f05fa2a1-b61b-4617-b895-8c75645bde94", "address": "fa:16:3e:0b:9b:f6", "network": {"id": "450540a3-ff7e-42fb-a0a6-808acd749943", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1503678778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1503678778-network", "vif_mac": "fa:16:3e:0b:9b:f6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6cb6f679ee4468d82cc7fb5d0f67be9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf05fa2a1-b6", "ovs_interfaceid": "f05fa2a1-b61b-4617-b895-8c75645bde94", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:31:21 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-b0f3bba7-755f-4af1-848b-2f00baee45ad tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0b:9b:f6,bridge_name='br-int',has_traffic_filtering=True,id=f05fa2a1-b61b-4617-b895-8c75645bde94,network=Network(450540a3-ff7e-42fb-a0a6-808acd749943),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf05fa2a1-b6') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:31:21 user nova-compute[75226]: DEBUG nova.objects.instance [None req-b0f3bba7-755f-4af1-848b-2f00baee45ad tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Lazy-loading 'pci_devices' on Instance uuid 3018e3a2-01e0-49d7-a960-51718709845a {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:31:21 user nova-compute[75226]: DEBUG nova.objects.base [None req-b0f3bba7-755f-4af1-848b-2f00baee45ad tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Object Instance<3018e3a2-01e0-49d7-a960-51718709845a> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75226) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 17 01:31:21 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-b0f3bba7-755f-4af1-848b-2f00baee45ad tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 3018e3a2-01e0-49d7-a960-51718709845a] End _get_guest_xml xml=<domain type="kvm">
Nov 17 01:31:21 user nova-compute[75226]:   <uuid>3018e3a2-01e0-49d7-a960-51718709845a</uuid>
Nov 17 01:31:21 user nova-compute[75226]:   <name>instance-0000001d</name>
Nov 17 01:31:21 user nova-compute[75226]:   <memory>524288</memory>
Nov 17 01:31:21 user nova-compute[75226]:   <vcpu>1</vcpu>
Nov 17 01:31:21 user nova-compute[75226]:   <metadata>
Nov 17 01:31:21 user nova-compute[75226]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 17 01:31:21 user nova-compute[75226]:       <nova:package version="0.0.0"/>
Nov 17 01:31:21 user nova-compute[75226]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-324711233</nova:name>
Nov 17 01:31:21 user nova-compute[75226]:       <nova:creationTime>2023-11-17 01:31:20</nova:creationTime>
Nov 17 01:31:21 user nova-compute[75226]:       <nova:flavor name="m1.tiny">
Nov 17 01:31:21 user nova-compute[75226]:         <nova:memory>512</nova:memory>
Nov 17 01:31:21 user nova-compute[75226]:         <nova:disk>1</nova:disk>
Nov 17 01:31:21 user nova-compute[75226]:         <nova:swap>0</nova:swap>
Nov 17 01:31:21 user nova-compute[75226]:         <nova:ephemeral>0</nova:ephemeral>
Nov 17 01:31:21 user nova-compute[75226]:         <nova:vcpus>1</nova:vcpus>
Nov 17 01:31:21 user nova-compute[75226]:       </nova:flavor>
Nov 17 01:31:21 user nova-compute[75226]:       <nova:owner>
Nov 17 01:31:21 user nova-compute[75226]:         <nova:user uuid="1b793ce05bf44b939a9fb5a914a04cb0">tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member</nova:user>
Nov 17 01:31:21 user nova-compute[75226]:         <nova:project uuid="e6cb6f679ee4468d82cc7fb5d0f67be9">tempest-ServerBootFromVolumeStableRescueTest-76498640</nova:project>
Nov 17 01:31:21 user nova-compute[75226]:       </nova:owner>
Nov 17 01:31:21 user nova-compute[75226]:       <nova:root type="image" uuid="0b369aea-6f3f-4690-9f01-229b90ab6310"/>
Nov 17 01:31:21 user nova-compute[75226]:       <nova:ports>
Nov 17 01:31:21 user nova-compute[75226]:         <nova:port uuid="f05fa2a1-b61b-4617-b895-8c75645bde94">
Nov 17 01:31:21 user nova-compute[75226]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 17 01:31:21 user nova-compute[75226]:         </nova:port>
Nov 17 01:31:21 user nova-compute[75226]:       </nova:ports>
Nov 17 01:31:21 user nova-compute[75226]:     </nova:instance>
Nov 17 01:31:21 user nova-compute[75226]:   </metadata>
Nov 17 01:31:21 user nova-compute[75226]:   <sysinfo type="smbios">
Nov 17 01:31:21 user nova-compute[75226]:     <system>
Nov 17 01:31:21 user nova-compute[75226]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 17 01:31:21 user nova-compute[75226]:       <entry name="product">OpenStack Nova</entry>
Nov 17 01:31:21 user nova-compute[75226]:       <entry name="version">0.0.0</entry>
Nov 17 01:31:21 user nova-compute[75226]:       <entry name="serial">3018e3a2-01e0-49d7-a960-51718709845a</entry>
Nov 17 01:31:21 user nova-compute[75226]:       <entry name="uuid">3018e3a2-01e0-49d7-a960-51718709845a</entry>
Nov 17 01:31:21 user nova-compute[75226]:       <entry name="family">Virtual Machine</entry>
Nov 17 01:31:21 user nova-compute[75226]:     </system>
Nov 17 01:31:21 user nova-compute[75226]:   </sysinfo>
Nov 17 01:31:21 user nova-compute[75226]:   <os>
Nov 17 01:31:21 user nova-compute[75226]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 17 01:31:21 user nova-compute[75226]:     <smbios mode="sysinfo"/>
Nov 17 01:31:21 user nova-compute[75226]:   </os>
Nov 17 01:31:21 user nova-compute[75226]:   <features>
Nov 17 01:31:21 user nova-compute[75226]:     <acpi/>
Nov 17 01:31:21 user nova-compute[75226]:     <apic/>
Nov 17 01:31:21 user nova-compute[75226]:     <vmcoreinfo/>
Nov 17 01:31:21 user nova-compute[75226]:   </features>
Nov 17 01:31:21 user nova-compute[75226]:   <clock offset="utc">
Nov 17 01:31:21 user nova-compute[75226]:     <timer name="pit" tickpolicy="delay"/>
Nov 17 01:31:21 user nova-compute[75226]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 17 01:31:21 user nova-compute[75226]:     <timer name="hpet" present="no"/>
Nov 17 01:31:21 user nova-compute[75226]:   </clock>
Nov 17 01:31:21 user nova-compute[75226]:   <cpu mode="custom" match="exact">
Nov 17 01:31:21 user nova-compute[75226]:     <model>Nehalem</model>
Nov 17 01:31:21 user nova-compute[75226]:     <topology sockets="1" cores="1" threads="1"/>
Nov 17 01:31:21 user nova-compute[75226]:   </cpu>
Nov 17 01:31:21 user nova-compute[75226]:   <devices>
Nov 17 01:31:21 user nova-compute[75226]:     <disk type="block" device="disk">
Nov 17 01:31:21 user nova-compute[75226]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 01:31:21 user nova-compute[75226]:       <source dev="/dev/sde"/>
Nov 17 01:31:21 user nova-compute[75226]:       <target dev="vda" bus="virtio"/>
Nov 17 01:31:21 user nova-compute[75226]:       <serial>05f878e5-0241-4282-8b2c-c4651c429dcb</serial>
Nov 17 01:31:21 user nova-compute[75226]:     </disk>
Nov 17 01:31:21 user nova-compute[75226]:     <disk type="file" device="disk">
Nov 17 01:31:21 user nova-compute[75226]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 17 01:31:21 user nova-compute[75226]:       <source file="/opt/stack/data/nova/instances/3018e3a2-01e0-49d7-a960-51718709845a/disk.rescue"/>
Nov 17 01:31:21 user nova-compute[75226]:       <target dev="vdb" bus="virtio"/>
Nov 17 01:31:21 user nova-compute[75226]:       <boot order="1"/>
Nov 17 01:31:21 user nova-compute[75226]:     </disk>
Nov 17 01:31:21 user nova-compute[75226]:     <interface type="ethernet">
Nov 17 01:31:21 user nova-compute[75226]:       <mac address="fa:16:3e:0b:9b:f6"/>
Nov 17 01:31:21 user nova-compute[75226]:       <model type="virtio"/>
Nov 17 01:31:21 user nova-compute[75226]:       <mtu size="1442"/>
Nov 17 01:31:21 user nova-compute[75226]:       <target dev="tapf05fa2a1-b6"/>
Nov 17 01:31:21 user nova-compute[75226]:     </interface>
Nov 17 01:31:21 user nova-compute[75226]:     <serial type="pty">
Nov 17 01:31:21 user nova-compute[75226]:       <log file="/opt/stack/data/nova/instances/3018e3a2-01e0-49d7-a960-51718709845a/console.log" append="off"/>
Nov 17 01:31:21 user nova-compute[75226]:     </serial>
Nov 17 01:31:21 user nova-compute[75226]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 17 01:31:21 user nova-compute[75226]:     <video>
Nov 17 01:31:21 user nova-compute[75226]:       <model type="virtio"/>
Nov 17 01:31:21 user nova-compute[75226]:     </video>
Nov 17 01:31:21 user nova-compute[75226]:     <rng model="virtio">
Nov 17 01:31:21 user nova-compute[75226]:       <backend model="random">/dev/urandom</backend>
Nov 17 01:31:21 user nova-compute[75226]:     </rng>
Nov 17 01:31:21 user nova-compute[75226]:     <controller type="usb" index="0" model="none"/>
Nov 17 01:31:21 user nova-compute[75226]:     <memballoon model="virtio">
Nov 17 01:31:21 user nova-compute[75226]:       <stats period="10"/>
Nov 17 01:31:21 user nova-compute[75226]:     </memballoon>
Nov 17 01:31:21 user nova-compute[75226]:   </devices>
Nov 17 01:31:21 user nova-compute[75226]: </domain>
Nov 17 01:31:21 user nova-compute[75226]:  {{(pid=75226) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 17 01:31:21 user nova-compute[75226]: INFO nova.virt.libvirt.driver [-] [instance: 3018e3a2-01e0-49d7-a960-51718709845a] Instance destroyed successfully.
Nov 17 01:31:21 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-b0f3bba7-755f-4af1-848b-2f00baee45ad tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] No BDM found with device name vda, not building metadata. {{(pid=75226) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 01:31:21 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-b0f3bba7-755f-4af1-848b-2f00baee45ad tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75226) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 01:31:21 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-b0f3bba7-755f-4af1-848b-2f00baee45ad tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] No VIF found with MAC fa:16:3e:0b:9b:f6, not building metadata {{(pid=75226) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 01:31:21 user nova-compute[75226]: DEBUG nova.network.neutron [req-3c94d69d-eb5c-4d9d-b33b-a8106ef8c86d req-5d01ab7c-67a2-4d74-a025-203e93dfde24 service nova] [instance: 9e8b4b85-fe0c-4592-850e-e94ebab32d02] Updated VIF entry in instance network info cache for port 5e4b278c-6c95-4fd1-a215-3fa737694996. {{(pid=75226) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 01:31:21 user nova-compute[75226]: DEBUG nova.network.neutron [req-3c94d69d-eb5c-4d9d-b33b-a8106ef8c86d req-5d01ab7c-67a2-4d74-a025-203e93dfde24 service nova] [instance: 9e8b4b85-fe0c-4592-850e-e94ebab32d02] Updating instance_info_cache with network_info: [{"id": "5e4b278c-6c95-4fd1-a215-3fa737694996", "address": "fa:16:3e:b6:d6:ba", "network": {"id": "72724945-89ae-47c2-ac58-ea393837ada6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-308563626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fcdc65b510141e9b7c9a01401a97448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e4b278c-6c", "ovs_interfaceid": "5e4b278c-6c95-4fd1-a215-3fa737694996", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:31:21 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-3c94d69d-eb5c-4d9d-b33b-a8106ef8c86d req-5d01ab7c-67a2-4d74-a025-203e93dfde24 service nova] Releasing lock "refresh_cache-9e8b4b85-fe0c-4592-850e-e94ebab32d02" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:31:22 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:31:22 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:31:22 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:31:22 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:31:22 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:31:22 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:31:22 user nova-compute[75226]: DEBUG nova.compute.manager [req-00f11aab-d2ca-4dae-a7f1-75d4d5f2f565 req-3e23f4da-2b67-4f0c-80b7-209726ce352a service nova] [instance: 3018e3a2-01e0-49d7-a960-51718709845a] Received event network-vif-plugged-f05fa2a1-b61b-4617-b895-8c75645bde94 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:31:22 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-00f11aab-d2ca-4dae-a7f1-75d4d5f2f565 req-3e23f4da-2b67-4f0c-80b7-209726ce352a service nova] Acquiring lock "3018e3a2-01e0-49d7-a960-51718709845a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:31:22 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-00f11aab-d2ca-4dae-a7f1-75d4d5f2f565 req-3e23f4da-2b67-4f0c-80b7-209726ce352a service nova] Lock "3018e3a2-01e0-49d7-a960-51718709845a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:31:22 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-00f11aab-d2ca-4dae-a7f1-75d4d5f2f565 req-3e23f4da-2b67-4f0c-80b7-209726ce352a service nova] Lock "3018e3a2-01e0-49d7-a960-51718709845a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:31:22 user nova-compute[75226]: DEBUG nova.compute.manager [req-00f11aab-d2ca-4dae-a7f1-75d4d5f2f565 req-3e23f4da-2b67-4f0c-80b7-209726ce352a service nova] [instance: 3018e3a2-01e0-49d7-a960-51718709845a] No waiting events found dispatching network-vif-plugged-f05fa2a1-b61b-4617-b895-8c75645bde94 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:31:22 user nova-compute[75226]: WARNING nova.compute.manager [req-00f11aab-d2ca-4dae-a7f1-75d4d5f2f565 req-3e23f4da-2b67-4f0c-80b7-209726ce352a service nova] [instance: 3018e3a2-01e0-49d7-a960-51718709845a] Received unexpected event network-vif-plugged-f05fa2a1-b61b-4617-b895-8c75645bde94 for instance with vm_state active and task_state rescuing.
Nov 17 01:31:22 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:31:22 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:31:23 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:31:23 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-64cfac85-cb0a-4e47-bebc-90533197ceb2 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Acquiring lock "9e8b4b85-fe0c-4592-850e-e94ebab32d02" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:31:23 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-64cfac85-cb0a-4e47-bebc-90533197ceb2 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Lock "9e8b4b85-fe0c-4592-850e-e94ebab32d02" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:31:23 user nova-compute[75226]: INFO nova.compute.manager [None req-64cfac85-cb0a-4e47-bebc-90533197ceb2 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] [instance: 9e8b4b85-fe0c-4592-850e-e94ebab32d02] Shelving
Nov 17 01:31:23 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:31:23 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:31:23 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:31:23 user nova-compute[75226]: DEBUG nova.compute.manager [req-09ea522b-9843-421f-b4ab-af8b9c50fce8 req-761fe056-1b21-4d3e-9fcf-f700548a909e service nova] [instance: 9e8b4b85-fe0c-4592-850e-e94ebab32d02] Received event network-vif-unplugged-5e4b278c-6c95-4fd1-a215-3fa737694996 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:31:23 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-09ea522b-9843-421f-b4ab-af8b9c50fce8 req-761fe056-1b21-4d3e-9fcf-f700548a909e service nova] Acquiring lock "9e8b4b85-fe0c-4592-850e-e94ebab32d02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:31:23 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-09ea522b-9843-421f-b4ab-af8b9c50fce8 req-761fe056-1b21-4d3e-9fcf-f700548a909e service nova] Lock "9e8b4b85-fe0c-4592-850e-e94ebab32d02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:31:23 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-09ea522b-9843-421f-b4ab-af8b9c50fce8 req-761fe056-1b21-4d3e-9fcf-f700548a909e service nova] Lock "9e8b4b85-fe0c-4592-850e-e94ebab32d02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:31:23 user nova-compute[75226]: DEBUG nova.compute.manager [req-09ea522b-9843-421f-b4ab-af8b9c50fce8 req-761fe056-1b21-4d3e-9fcf-f700548a909e service nova] [instance: 9e8b4b85-fe0c-4592-850e-e94ebab32d02] No waiting events found dispatching network-vif-unplugged-5e4b278c-6c95-4fd1-a215-3fa737694996 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:31:23 user nova-compute[75226]: WARNING nova.compute.manager [req-09ea522b-9843-421f-b4ab-af8b9c50fce8 req-761fe056-1b21-4d3e-9fcf-f700548a909e service nova] [instance: 9e8b4b85-fe0c-4592-850e-e94ebab32d02] Received unexpected event network-vif-unplugged-5e4b278c-6c95-4fd1-a215-3fa737694996 for instance with vm_state active and task_state shelving.
Nov 17 01:31:23 user nova-compute[75226]: INFO nova.virt.libvirt.driver [-] [instance: 9e8b4b85-fe0c-4592-850e-e94ebab32d02] Instance destroyed successfully.
Nov 17 01:31:23 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-64cfac85-cb0a-4e47-bebc-90533197ceb2 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] [instance: 9e8b4b85-fe0c-4592-850e-e94ebab32d02] Beginning cold snapshot process
Nov 17 01:31:23 user nova-compute[75226]: DEBUG nova.privsep.utils [None req-64cfac85-cb0a-4e47-bebc-90533197ceb2 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75226) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 17 01:31:23 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-64cfac85-cb0a-4e47-bebc-90533197ceb2 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/9e8b4b85-fe0c-4592-850e-e94ebab32d02/disk /opt/stack/data/nova/instances/snapshots/tmprux_jzuz/787c181db66a42d2974532f1b7a649e9 {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:31:24 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-64cfac85-cb0a-4e47-bebc-90533197ceb2 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/9e8b4b85-fe0c-4592-850e-e94ebab32d02/disk /opt/stack/data/nova/instances/snapshots/tmprux_jzuz/787c181db66a42d2974532f1b7a649e9" returned: 0 in 0.532s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:31:24 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-64cfac85-cb0a-4e47-bebc-90533197ceb2 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] [instance: 9e8b4b85-fe0c-4592-850e-e94ebab32d02] Snapshot extracted, beginning image upload
Nov 17 01:31:24 user nova-compute[75226]: DEBUG nova.compute.manager [req-20d0082a-d6fd-4d82-a706-2e6550c65180 req-5158f20c-adc0-4c1e-897a-12dbea7a1018 service nova] [instance: 3018e3a2-01e0-49d7-a960-51718709845a] Received event network-vif-plugged-f05fa2a1-b61b-4617-b895-8c75645bde94 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:31:24 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-20d0082a-d6fd-4d82-a706-2e6550c65180 req-5158f20c-adc0-4c1e-897a-12dbea7a1018 service nova] Acquiring lock "3018e3a2-01e0-49d7-a960-51718709845a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:31:24 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-20d0082a-d6fd-4d82-a706-2e6550c65180 req-5158f20c-adc0-4c1e-897a-12dbea7a1018 service nova] Lock "3018e3a2-01e0-49d7-a960-51718709845a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:31:24 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-20d0082a-d6fd-4d82-a706-2e6550c65180 req-5158f20c-adc0-4c1e-897a-12dbea7a1018 service nova] Lock "3018e3a2-01e0-49d7-a960-51718709845a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:31:24 user nova-compute[75226]: DEBUG nova.compute.manager [req-20d0082a-d6fd-4d82-a706-2e6550c65180 req-5158f20c-adc0-4c1e-897a-12dbea7a1018 service nova] [instance: 3018e3a2-01e0-49d7-a960-51718709845a] No waiting events found dispatching network-vif-plugged-f05fa2a1-b61b-4617-b895-8c75645bde94 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:31:24 user nova-compute[75226]: WARNING nova.compute.manager [req-20d0082a-d6fd-4d82-a706-2e6550c65180 req-5158f20c-adc0-4c1e-897a-12dbea7a1018 service nova] [instance: 3018e3a2-01e0-49d7-a960-51718709845a] Received unexpected event network-vif-plugged-f05fa2a1-b61b-4617-b895-8c75645bde94 for instance with vm_state active and task_state rescuing.
Nov 17 01:31:24 user nova-compute[75226]: DEBUG nova.compute.manager [None req-b0f3bba7-755f-4af1-848b-2f00baee45ad tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 3018e3a2-01e0-49d7-a960-51718709845a] Checking state {{(pid=75226) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 01:31:25 user nova-compute[75226]: DEBUG nova.compute.manager [req-195419d0-f4ac-475c-9d5e-a3ff81cc0557 req-a3ccf648-dea2-4112-b792-ee021cce90ae service nova] [instance: 9e8b4b85-fe0c-4592-850e-e94ebab32d02] Received event network-vif-plugged-5e4b278c-6c95-4fd1-a215-3fa737694996 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:31:25 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-195419d0-f4ac-475c-9d5e-a3ff81cc0557 req-a3ccf648-dea2-4112-b792-ee021cce90ae service nova] Acquiring lock "9e8b4b85-fe0c-4592-850e-e94ebab32d02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:31:25 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-195419d0-f4ac-475c-9d5e-a3ff81cc0557 req-a3ccf648-dea2-4112-b792-ee021cce90ae service nova] Lock "9e8b4b85-fe0c-4592-850e-e94ebab32d02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:31:25 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-195419d0-f4ac-475c-9d5e-a3ff81cc0557 req-a3ccf648-dea2-4112-b792-ee021cce90ae service nova] Lock "9e8b4b85-fe0c-4592-850e-e94ebab32d02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:31:25 user nova-compute[75226]: DEBUG nova.compute.manager [req-195419d0-f4ac-475c-9d5e-a3ff81cc0557 req-a3ccf648-dea2-4112-b792-ee021cce90ae service nova] [instance: 9e8b4b85-fe0c-4592-850e-e94ebab32d02] No waiting events found dispatching network-vif-plugged-5e4b278c-6c95-4fd1-a215-3fa737694996 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:31:25 user nova-compute[75226]: WARNING nova.compute.manager [req-195419d0-f4ac-475c-9d5e-a3ff81cc0557 req-a3ccf648-dea2-4112-b792-ee021cce90ae service nova] [instance: 9e8b4b85-fe0c-4592-850e-e94ebab32d02] Received unexpected event network-vif-plugged-5e4b278c-6c95-4fd1-a215-3fa737694996 for instance with vm_state active and task_state shelving_image_uploading.
Nov 17 01:31:26 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-64cfac85-cb0a-4e47-bebc-90533197ceb2 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] [instance: 9e8b4b85-fe0c-4592-850e-e94ebab32d02] Snapshot image upload complete
Nov 17 01:31:26 user nova-compute[75226]: DEBUG nova.compute.manager [None req-64cfac85-cb0a-4e47-bebc-90533197ceb2 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] [instance: 9e8b4b85-fe0c-4592-850e-e94ebab32d02] Checking state {{(pid=75226) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 01:31:26 user nova-compute[75226]: INFO nova.compute.manager [None req-64cfac85-cb0a-4e47-bebc-90533197ceb2 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] [instance: 9e8b4b85-fe0c-4592-850e-e94ebab32d02] Shelve offloading
Nov 17 01:31:26 user nova-compute[75226]: INFO nova.virt.libvirt.driver [-] [instance: 9e8b4b85-fe0c-4592-850e-e94ebab32d02] Instance destroyed successfully.
Nov 17 01:31:26 user nova-compute[75226]: DEBUG nova.compute.manager [None req-64cfac85-cb0a-4e47-bebc-90533197ceb2 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] [instance: 9e8b4b85-fe0c-4592-850e-e94ebab32d02] Checking state {{(pid=75226) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 01:31:26 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-64cfac85-cb0a-4e47-bebc-90533197ceb2 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Acquiring lock "refresh_cache-9e8b4b85-fe0c-4592-850e-e94ebab32d02" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:31:26 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-64cfac85-cb0a-4e47-bebc-90533197ceb2 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Acquired lock "refresh_cache-9e8b4b85-fe0c-4592-850e-e94ebab32d02" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:31:26 user nova-compute[75226]: DEBUG nova.network.neutron [None req-64cfac85-cb0a-4e47-bebc-90533197ceb2 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] [instance: 9e8b4b85-fe0c-4592-850e-e94ebab32d02] Building network info cache for instance {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 01:31:27 user nova-compute[75226]: DEBUG nova.network.neutron [None req-64cfac85-cb0a-4e47-bebc-90533197ceb2 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] [instance: 9e8b4b85-fe0c-4592-850e-e94ebab32d02] Updating instance_info_cache with network_info: [{"id": "5e4b278c-6c95-4fd1-a215-3fa737694996", "address": "fa:16:3e:b6:d6:ba", "network": {"id": "72724945-89ae-47c2-ac58-ea393837ada6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-308563626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fcdc65b510141e9b7c9a01401a97448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e4b278c-6c", "ovs_interfaceid": "5e4b278c-6c95-4fd1-a215-3fa737694996", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:31:27 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:31:27 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-64cfac85-cb0a-4e47-bebc-90533197ceb2 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Releasing lock "refresh_cache-9e8b4b85-fe0c-4592-850e-e94ebab32d02" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:31:27 user nova-compute[75226]: INFO nova.virt.libvirt.driver [-] [instance: 9e8b4b85-fe0c-4592-850e-e94ebab32d02] Instance destroyed successfully.
Nov 17 01:31:27 user nova-compute[75226]: DEBUG nova.objects.instance [None req-64cfac85-cb0a-4e47-bebc-90533197ceb2 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Lazy-loading 'resources' on Instance uuid 9e8b4b85-fe0c-4592-850e-e94ebab32d02 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:31:27 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-64cfac85-cb0a-4e47-bebc-90533197ceb2 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:29:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1781762170',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1781762170',id=30,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBInpuqctZcqeDjLntMDMraUaJnVrPY8pPnhF46vZo3b7GDKJsBT1VrkDCJZFNBJMLuoREZPGY4+/LAEQRLwrF9f1fdd8Jnq+YiZ8Dyk1mvtijZcX6ZVdxHElsfADTqm07w==',key_name='tempest-keypair-1121562331',keypairs=<?>,launch_index=0,launched_at=2023-11-17T01:29:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='1fcdc65b510141e9b7c9a01401a97448',ramdisk_id='',reservation_id='r-b0wngs1h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1321076871',owner_user_name='tempest-AttachVolumeShelveTestJSON-1321076871-project-member',shelved_at='2023-11-17T01:31:26.887987',shelved_host='user',shelved_image_id='63952acd-d41b-45b9-99cd-bd803ca9b101'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T01:31:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2adb9c6cd5c443a7993f6f9d09da6346',uuid=9e8b4b85-fe0c-4592-850e-e94ebab32d02,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "5e4b278c-6c95-4fd1-a215-3fa737694996", "address": "fa:16:3e:b6:d6:ba", "network": {"id": "72724945-89ae-47c2-ac58-ea393837ada6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-308563626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fcdc65b510141e9b7c9a01401a97448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e4b278c-6c", "ovs_interfaceid": "5e4b278c-6c95-4fd1-a215-3fa737694996", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 17 01:31:27 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-64cfac85-cb0a-4e47-bebc-90533197ceb2 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Converting VIF {"id": "5e4b278c-6c95-4fd1-a215-3fa737694996", "address": "fa:16:3e:b6:d6:ba", "network": {"id": "72724945-89ae-47c2-ac58-ea393837ada6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-308563626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fcdc65b510141e9b7c9a01401a97448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e4b278c-6c", "ovs_interfaceid": "5e4b278c-6c95-4fd1-a215-3fa737694996", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:31:27 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-64cfac85-cb0a-4e47-bebc-90533197ceb2 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:d6:ba,bridge_name='br-int',has_traffic_filtering=True,id=5e4b278c-6c95-4fd1-a215-3fa737694996,network=Network(72724945-89ae-47c2-ac58-ea393837ada6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e4b278c-6c') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:31:27 user nova-compute[75226]: DEBUG os_vif [None req-64cfac85-cb0a-4e47-bebc-90533197ceb2 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:d6:ba,bridge_name='br-int',has_traffic_filtering=True,id=5e4b278c-6c95-4fd1-a215-3fa737694996,network=Network(72724945-89ae-47c2-ac58-ea393837ada6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e4b278c-6c') {{(pid=75226) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 17 01:31:27 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:31:27 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5e4b278c-6c, bridge=br-int, if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:31:27 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:31:27 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:31:27 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=99a7e699-ab73-430b-9b05-472cfce90ecc) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:31:27 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:31:27 user nova-compute[75226]: INFO os_vif [None req-64cfac85-cb0a-4e47-bebc-90533197ceb2 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:d6:ba,bridge_name='br-int',has_traffic_filtering=True,id=5e4b278c-6c95-4fd1-a215-3fa737694996,network=Network(72724945-89ae-47c2-ac58-ea393837ada6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e4b278c-6c')
Nov 17 01:31:27 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-64cfac85-cb0a-4e47-bebc-90533197ceb2 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] [instance: 9e8b4b85-fe0c-4592-850e-e94ebab32d02] Deleting instance files /opt/stack/data/nova/instances/9e8b4b85-fe0c-4592-850e-e94ebab32d02_del
Nov 17 01:31:27 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-64cfac85-cb0a-4e47-bebc-90533197ceb2 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] [instance: 9e8b4b85-fe0c-4592-850e-e94ebab32d02] Deletion of /opt/stack/data/nova/instances/9e8b4b85-fe0c-4592-850e-e94ebab32d02_del complete
Nov 17 01:31:27 user nova-compute[75226]: DEBUG nova.compute.manager [req-7dd28c81-afd9-459a-a9ab-861ade5d46ca req-9f22d3f7-4bae-47ee-8ab0-ff7af26a7717 service nova] [instance: 9e8b4b85-fe0c-4592-850e-e94ebab32d02] Received event network-changed-5e4b278c-6c95-4fd1-a215-3fa737694996 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:31:27 user nova-compute[75226]: DEBUG nova.compute.manager [req-7dd28c81-afd9-459a-a9ab-861ade5d46ca req-9f22d3f7-4bae-47ee-8ab0-ff7af26a7717 service nova] [instance: 9e8b4b85-fe0c-4592-850e-e94ebab32d02] Refreshing instance network info cache due to event network-changed-5e4b278c-6c95-4fd1-a215-3fa737694996. {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 01:31:27 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-7dd28c81-afd9-459a-a9ab-861ade5d46ca req-9f22d3f7-4bae-47ee-8ab0-ff7af26a7717 service nova] Acquiring lock "refresh_cache-9e8b4b85-fe0c-4592-850e-e94ebab32d02" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:31:27 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-7dd28c81-afd9-459a-a9ab-861ade5d46ca req-9f22d3f7-4bae-47ee-8ab0-ff7af26a7717 service nova] Acquired lock "refresh_cache-9e8b4b85-fe0c-4592-850e-e94ebab32d02" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:31:27 user nova-compute[75226]: DEBUG nova.network.neutron [req-7dd28c81-afd9-459a-a9ab-861ade5d46ca req-9f22d3f7-4bae-47ee-8ab0-ff7af26a7717 service nova] [instance: 9e8b4b85-fe0c-4592-850e-e94ebab32d02] Refreshing network info cache for port 5e4b278c-6c95-4fd1-a215-3fa737694996 {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 01:31:28 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:31:28 user nova-compute[75226]: INFO nova.scheduler.client.report [None req-64cfac85-cb0a-4e47-bebc-90533197ceb2 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Deleted allocations for instance 9e8b4b85-fe0c-4592-850e-e94ebab32d02
Nov 17 01:31:28 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-64cfac85-cb0a-4e47-bebc-90533197ceb2 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:31:28 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-64cfac85-cb0a-4e47-bebc-90533197ceb2 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:31:28 user nova-compute[75226]: DEBUG nova.objects.instance [None req-64cfac85-cb0a-4e47-bebc-90533197ceb2 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Lazy-loading 'numa_topology' on Instance uuid 9e8b4b85-fe0c-4592-850e-e94ebab32d02 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:31:28 user nova-compute[75226]: DEBUG nova.objects.base [None req-64cfac85-cb0a-4e47-bebc-90533197ceb2 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Object Instance<9e8b4b85-fe0c-4592-850e-e94ebab32d02> lazy-loaded attributes: resources,numa_topology {{(pid=75226) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 17 01:31:28 user nova-compute[75226]: DEBUG nova.network.neutron [req-7dd28c81-afd9-459a-a9ab-861ade5d46ca req-9f22d3f7-4bae-47ee-8ab0-ff7af26a7717 service nova] [instance: 9e8b4b85-fe0c-4592-850e-e94ebab32d02] Updated VIF entry in instance network info cache for port 5e4b278c-6c95-4fd1-a215-3fa737694996. {{(pid=75226) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 01:31:28 user nova-compute[75226]: DEBUG nova.network.neutron [req-7dd28c81-afd9-459a-a9ab-861ade5d46ca req-9f22d3f7-4bae-47ee-8ab0-ff7af26a7717 service nova] [instance: 9e8b4b85-fe0c-4592-850e-e94ebab32d02] Updating instance_info_cache with network_info: [{"id": "5e4b278c-6c95-4fd1-a215-3fa737694996", "address": "fa:16:3e:b6:d6:ba", "network": {"id": "72724945-89ae-47c2-ac58-ea393837ada6", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-308563626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fcdc65b510141e9b7c9a01401a97448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap5e4b278c-6c", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:31:28 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-7dd28c81-afd9-459a-a9ab-861ade5d46ca req-9f22d3f7-4bae-47ee-8ab0-ff7af26a7717 service nova] Releasing lock "refresh_cache-9e8b4b85-fe0c-4592-850e-e94ebab32d02" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:31:28 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-64cfac85-cb0a-4e47-bebc-90533197ceb2 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:31:28 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-64cfac85-cb0a-4e47-bebc-90533197ceb2 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:31:28 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-64cfac85-cb0a-4e47-bebc-90533197ceb2 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.301s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:31:28 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-64cfac85-cb0a-4e47-bebc-90533197ceb2 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Lock "9e8b4b85-fe0c-4592-850e-e94ebab32d02" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 5.376s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:31:32 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:31:35 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:31:37 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:31:38 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:31:38 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-fae44993-7dad-41d7-88de-668af05f197c tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Acquiring lock "dae5490b-e434-4cd1-b8d4-6baab9bb7345" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:31:38 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-fae44993-7dad-41d7-88de-668af05f197c tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Lock "dae5490b-e434-4cd1-b8d4-6baab9bb7345" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:31:38 user nova-compute[75226]: DEBUG nova.compute.manager [None req-fae44993-7dad-41d7-88de-668af05f197c tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: dae5490b-e434-4cd1-b8d4-6baab9bb7345] Starting instance... {{(pid=75226) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 17 01:31:38 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-fae44993-7dad-41d7-88de-668af05f197c tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:31:38 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-fae44993-7dad-41d7-88de-668af05f197c tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:31:38 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-fae44993-7dad-41d7-88de-668af05f197c tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75226) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 17 01:31:38 user nova-compute[75226]: INFO nova.compute.claims [None req-fae44993-7dad-41d7-88de-668af05f197c tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: dae5490b-e434-4cd1-b8d4-6baab9bb7345] Claim successful on node user
Nov 17 01:31:38 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-fae44993-7dad-41d7-88de-668af05f197c tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:31:38 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-fae44993-7dad-41d7-88de-668af05f197c tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:31:38 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-fae44993-7dad-41d7-88de-668af05f197c tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.409s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:31:38 user nova-compute[75226]: DEBUG nova.compute.manager [None req-fae44993-7dad-41d7-88de-668af05f197c tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: dae5490b-e434-4cd1-b8d4-6baab9bb7345] Start building networks asynchronously for instance. {{(pid=75226) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 17 01:31:38 user nova-compute[75226]: DEBUG nova.compute.manager [None req-fae44993-7dad-41d7-88de-668af05f197c tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: dae5490b-e434-4cd1-b8d4-6baab9bb7345] Allocating IP information in the background. {{(pid=75226) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 17 01:31:38 user nova-compute[75226]: DEBUG nova.network.neutron [None req-fae44993-7dad-41d7-88de-668af05f197c tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: dae5490b-e434-4cd1-b8d4-6baab9bb7345] allocate_for_instance() {{(pid=75226) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 17 01:31:38 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-fae44993-7dad-41d7-88de-668af05f197c tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: dae5490b-e434-4cd1-b8d4-6baab9bb7345] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 17 01:31:38 user nova-compute[75226]: DEBUG nova.compute.manager [None req-fae44993-7dad-41d7-88de-668af05f197c tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: dae5490b-e434-4cd1-b8d4-6baab9bb7345] Start building block device mappings for instance. {{(pid=75226) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 17 01:31:38 user nova-compute[75226]: DEBUG nova.policy [None req-fae44993-7dad-41d7-88de-668af05f197c tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '642db538240b4ca1a367cf4ee9714f66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38777e8baf745e79f31190da97406a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75226) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 17 01:31:39 user nova-compute[75226]: DEBUG nova.compute.manager [None req-fae44993-7dad-41d7-88de-668af05f197c tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: dae5490b-e434-4cd1-b8d4-6baab9bb7345] Start spawning the instance on the hypervisor. {{(pid=75226) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 17 01:31:39 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-fae44993-7dad-41d7-88de-668af05f197c tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: dae5490b-e434-4cd1-b8d4-6baab9bb7345] Creating instance directory {{(pid=75226) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 17 01:31:39 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-fae44993-7dad-41d7-88de-668af05f197c tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: dae5490b-e434-4cd1-b8d4-6baab9bb7345] Creating image(s)
Nov 17 01:31:39 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-fae44993-7dad-41d7-88de-668af05f197c tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Acquiring lock "/opt/stack/data/nova/instances/dae5490b-e434-4cd1-b8d4-6baab9bb7345/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:31:39 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-fae44993-7dad-41d7-88de-668af05f197c tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Lock "/opt/stack/data/nova/instances/dae5490b-e434-4cd1-b8d4-6baab9bb7345/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:31:39 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-fae44993-7dad-41d7-88de-668af05f197c tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Lock "/opt/stack/data/nova/instances/dae5490b-e434-4cd1-b8d4-6baab9bb7345/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:31:39 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-fae44993-7dad-41d7-88de-668af05f197c tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:31:39 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-fae44993-7dad-41d7-88de-668af05f197c tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json" returned: 0 in 0.175s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:31:39 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-fae44993-7dad-41d7-88de-668af05f197c tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Acquiring lock "a8a62c2546af3a2036b853250c5ac64d4c6b4371" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:31:39 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-fae44993-7dad-41d7-88de-668af05f197c tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Lock "a8a62c2546af3a2036b853250c5ac64d4c6b4371" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:31:39 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-fae44993-7dad-41d7-88de-668af05f197c tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:31:39 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-fae44993-7dad-41d7-88de-668af05f197c tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json" returned: 0 in 0.179s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:31:39 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-fae44993-7dad-41d7-88de-668af05f197c tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371,backing_fmt=raw /opt/stack/data/nova/instances/dae5490b-e434-4cd1-b8d4-6baab9bb7345/disk 1073741824 {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:31:39 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-fae44993-7dad-41d7-88de-668af05f197c tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371,backing_fmt=raw /opt/stack/data/nova/instances/dae5490b-e434-4cd1-b8d4-6baab9bb7345/disk 1073741824" returned: 0 in 0.053s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:31:39 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-fae44993-7dad-41d7-88de-668af05f197c tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Lock "a8a62c2546af3a2036b853250c5ac64d4c6b4371" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:31:39 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-fae44993-7dad-41d7-88de-668af05f197c tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:31:39 user nova-compute[75226]: DEBUG nova.network.neutron [None req-fae44993-7dad-41d7-88de-668af05f197c tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: dae5490b-e434-4cd1-b8d4-6baab9bb7345] Successfully created port: 09413dab-7bc1-4c16-9486-ce6e790b72e1 {{(pid=75226) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 17 01:31:39 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-fae44993-7dad-41d7-88de-668af05f197c tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json" returned: 0 in 0.180s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:31:39 user nova-compute[75226]: DEBUG nova.virt.disk.api [None req-fae44993-7dad-41d7-88de-668af05f197c tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Checking if we can resize image /opt/stack/data/nova/instances/dae5490b-e434-4cd1-b8d4-6baab9bb7345/disk. size=1073741824 {{(pid=75226) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 17 01:31:39 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-fae44993-7dad-41d7-88de-668af05f197c tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dae5490b-e434-4cd1-b8d4-6baab9bb7345/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:31:39 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-fae44993-7dad-41d7-88de-668af05f197c tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dae5490b-e434-4cd1-b8d4-6baab9bb7345/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:31:39 user nova-compute[75226]: DEBUG nova.virt.disk.api [None req-fae44993-7dad-41d7-88de-668af05f197c tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Cannot resize image /opt/stack/data/nova/instances/dae5490b-e434-4cd1-b8d4-6baab9bb7345/disk to a smaller size. {{(pid=75226) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 17 01:31:39 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-fae44993-7dad-41d7-88de-668af05f197c tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: dae5490b-e434-4cd1-b8d4-6baab9bb7345] Created local disks {{(pid=75226) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 17 01:31:39 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-fae44993-7dad-41d7-88de-668af05f197c tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: dae5490b-e434-4cd1-b8d4-6baab9bb7345] Ensure instance console log exists: /opt/stack/data/nova/instances/dae5490b-e434-4cd1-b8d4-6baab9bb7345/console.log {{(pid=75226) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 17 01:31:39 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-fae44993-7dad-41d7-88de-668af05f197c tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:31:39 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-fae44993-7dad-41d7-88de-668af05f197c tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:31:39 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-fae44993-7dad-41d7-88de-668af05f197c tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:31:40 user nova-compute[75226]: DEBUG nova.network.neutron [None req-fae44993-7dad-41d7-88de-668af05f197c tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: dae5490b-e434-4cd1-b8d4-6baab9bb7345] Successfully updated port: 09413dab-7bc1-4c16-9486-ce6e790b72e1 {{(pid=75226) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 17 01:31:40 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-fae44993-7dad-41d7-88de-668af05f197c tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Acquiring lock "refresh_cache-dae5490b-e434-4cd1-b8d4-6baab9bb7345" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:31:40 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-fae44993-7dad-41d7-88de-668af05f197c tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Acquired lock "refresh_cache-dae5490b-e434-4cd1-b8d4-6baab9bb7345" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:31:40 user nova-compute[75226]: DEBUG nova.network.neutron [None req-fae44993-7dad-41d7-88de-668af05f197c tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: dae5490b-e434-4cd1-b8d4-6baab9bb7345] Building network info cache for instance {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 01:31:40 user nova-compute[75226]: DEBUG nova.compute.manager [req-c00dddd0-ab4b-4203-95aa-0e121b0619e8 req-6bfc51e9-fe2d-4a67-9487-584a9db85df3 service nova] [instance: dae5490b-e434-4cd1-b8d4-6baab9bb7345] Received event network-changed-09413dab-7bc1-4c16-9486-ce6e790b72e1 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:31:40 user nova-compute[75226]: DEBUG nova.compute.manager [req-c00dddd0-ab4b-4203-95aa-0e121b0619e8 req-6bfc51e9-fe2d-4a67-9487-584a9db85df3 service nova] [instance: dae5490b-e434-4cd1-b8d4-6baab9bb7345] Refreshing instance network info cache due to event network-changed-09413dab-7bc1-4c16-9486-ce6e790b72e1. {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 01:31:40 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-c00dddd0-ab4b-4203-95aa-0e121b0619e8 req-6bfc51e9-fe2d-4a67-9487-584a9db85df3 service nova] Acquiring lock "refresh_cache-dae5490b-e434-4cd1-b8d4-6baab9bb7345" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:31:40 user nova-compute[75226]: DEBUG nova.network.neutron [None req-fae44993-7dad-41d7-88de-668af05f197c tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: dae5490b-e434-4cd1-b8d4-6baab9bb7345] Instance cache missing network info. {{(pid=75226) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 17 01:31:40 user nova-compute[75226]: DEBUG nova.network.neutron [None req-fae44993-7dad-41d7-88de-668af05f197c tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: dae5490b-e434-4cd1-b8d4-6baab9bb7345] Updating instance_info_cache with network_info: [{"id": "09413dab-7bc1-4c16-9486-ce6e790b72e1", "address": "fa:16:3e:82:cf:64", "network": {"id": "57d0e7ee-0b11-4e00-86f9-bb4a3c25c674", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1357446034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e38777e8baf745e79f31190da97406a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09413dab-7b", "ovs_interfaceid": "09413dab-7bc1-4c16-9486-ce6e790b72e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:31:40 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-fae44993-7dad-41d7-88de-668af05f197c tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Releasing lock "refresh_cache-dae5490b-e434-4cd1-b8d4-6baab9bb7345" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:31:40 user nova-compute[75226]: DEBUG nova.compute.manager [None req-fae44993-7dad-41d7-88de-668af05f197c tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: dae5490b-e434-4cd1-b8d4-6baab9bb7345] Instance network_info: |[{"id": "09413dab-7bc1-4c16-9486-ce6e790b72e1", "address": "fa:16:3e:82:cf:64", "network": {"id": "57d0e7ee-0b11-4e00-86f9-bb4a3c25c674", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1357446034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e38777e8baf745e79f31190da97406a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09413dab-7b", "ovs_interfaceid": "09413dab-7bc1-4c16-9486-ce6e790b72e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75226) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 17 01:31:40 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-c00dddd0-ab4b-4203-95aa-0e121b0619e8 req-6bfc51e9-fe2d-4a67-9487-584a9db85df3 service nova] Acquired lock "refresh_cache-dae5490b-e434-4cd1-b8d4-6baab9bb7345" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:31:40 user nova-compute[75226]: DEBUG nova.network.neutron [req-c00dddd0-ab4b-4203-95aa-0e121b0619e8 req-6bfc51e9-fe2d-4a67-9487-584a9db85df3 service nova] [instance: dae5490b-e434-4cd1-b8d4-6baab9bb7345] Refreshing network info cache for port 09413dab-7bc1-4c16-9486-ce6e790b72e1 {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 01:31:40 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-fae44993-7dad-41d7-88de-668af05f197c tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: dae5490b-e434-4cd1-b8d4-6baab9bb7345] Start _get_guest_xml network_info=[{"id": "09413dab-7bc1-4c16-9486-ce6e790b72e1", "address": "fa:16:3e:82:cf:64", "network": {"id": "57d0e7ee-0b11-4e00-86f9-bb4a3c25c674", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1357446034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e38777e8baf745e79f31190da97406a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09413dab-7b", "ovs_interfaceid": "09413dab-7bc1-4c16-9486-ce6e790b72e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T01:13:22Z,direct_url=<?>,disk_format='qcow2',id=0b369aea-6f3f-4690-9f01-229b90ab6310,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4e110cbf9a84362a6864a7732c435a1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T01:13:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '0b369aea-6f3f-4690-9f01-229b90ab6310'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75226) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 17 01:31:40 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-fae44993-7dad-41d7-88de-668af05f197c tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:31:40 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-fae44993-7dad-41d7-88de-668af05f197c tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:31:40 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-fae44993-7dad-41d7-88de-668af05f197c tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75226) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 17 01:31:40 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-fae44993-7dad-41d7-88de-668af05f197c tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] CPU controller missing on host. {{(pid=75226) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 17 01:31:40 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-fae44993-7dad-41d7-88de-668af05f197c tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75226) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 17 01:31:40 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-fae44993-7dad-41d7-88de-668af05f197c tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] CPU controller found on host. {{(pid=75226) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 17 01:31:40 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-fae44993-7dad-41d7-88de-668af05f197c tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75226) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 17 01:31:40 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-fae44993-7dad-41d7-88de-668af05f197c tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-17T01:13:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T01:13:22Z,direct_url=<?>,disk_format='qcow2',id=0b369aea-6f3f-4690-9f01-229b90ab6310,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4e110cbf9a84362a6864a7732c435a1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T01:13:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 17 01:31:40 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-fae44993-7dad-41d7-88de-668af05f197c tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Flavor limits 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 17 01:31:40 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-fae44993-7dad-41d7-88de-668af05f197c tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Image limits 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 17 01:31:40 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-fae44993-7dad-41d7-88de-668af05f197c tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Flavor pref 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 17 01:31:40 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-fae44993-7dad-41d7-88de-668af05f197c tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Image pref 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 17 01:31:40 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-fae44993-7dad-41d7-88de-668af05f197c tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 17 01:31:40 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-fae44993-7dad-41d7-88de-668af05f197c tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 17 01:31:40 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-fae44993-7dad-41d7-88de-668af05f197c tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75226) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 17 01:31:40 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-fae44993-7dad-41d7-88de-668af05f197c tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Got 1 possible topologies {{(pid=75226) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 17 01:31:40 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-fae44993-7dad-41d7-88de-668af05f197c tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 17 01:31:40 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-fae44993-7dad-41d7-88de-668af05f197c tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 17 01:31:40 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-fae44993-7dad-41d7-88de-668af05f197c tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:31:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1593446740',display_name='tempest-AttachVolumeNegativeTest-server-1593446740',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1593446740',id=31,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOwz4hZVtgwWrcsPqTttyZBVyl9RUasoXFQhVcgfaPcpYA4qKb3oLahGiiQJ06st0ngGCdUQrVZmkK0ocqe46krfUTKz1BkqdX4i3m0Ik5xNCg8vFBi82owiMQLC/btQGw==',key_name='tempest-keypair-1790996567',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e38777e8baf745e79f31190da97406a0',ramdisk_id='',reservation_id='r-2trz1s7e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-940905741',owner_user_name='tempest-AttachVolumeNegativeTest-940905741-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T01:31:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='642db538240b4ca1a367cf4ee9714f66',uuid=dae5490b-e434-4cd1-b8d4-6baab9bb7345,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "09413dab-7bc1-4c16-9486-ce6e790b72e1", "address": "fa:16:3e:82:cf:64", "network": {"id": "57d0e7ee-0b11-4e00-86f9-bb4a3c25c674", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1357446034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e38777e8baf745e79f31190da97406a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09413dab-7b", "ovs_interfaceid": "09413dab-7bc1-4c16-9486-ce6e790b72e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75226) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 01:31:40 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-fae44993-7dad-41d7-88de-668af05f197c tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Converting VIF {"id": "09413dab-7bc1-4c16-9486-ce6e790b72e1", "address": "fa:16:3e:82:cf:64", "network": {"id": "57d0e7ee-0b11-4e00-86f9-bb4a3c25c674", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1357446034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e38777e8baf745e79f31190da97406a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09413dab-7b", "ovs_interfaceid": "09413dab-7bc1-4c16-9486-ce6e790b72e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:31:40 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-fae44993-7dad-41d7-88de-668af05f197c tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:cf:64,bridge_name='br-int',has_traffic_filtering=True,id=09413dab-7bc1-4c16-9486-ce6e790b72e1,network=Network(57d0e7ee-0b11-4e00-86f9-bb4a3c25c674),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09413dab-7b') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:31:40 user nova-compute[75226]: DEBUG nova.objects.instance [None req-fae44993-7dad-41d7-88de-668af05f197c tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Lazy-loading 'pci_devices' on Instance uuid dae5490b-e434-4cd1-b8d4-6baab9bb7345 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:31:40 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-fae44993-7dad-41d7-88de-668af05f197c tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: dae5490b-e434-4cd1-b8d4-6baab9bb7345] End _get_guest_xml xml=<domain type="kvm">
Nov 17 01:31:40 user nova-compute[75226]:   <uuid>dae5490b-e434-4cd1-b8d4-6baab9bb7345</uuid>
Nov 17 01:31:40 user nova-compute[75226]:   <name>instance-0000001f</name>
Nov 17 01:31:40 user nova-compute[75226]:   <memory>524288</memory>
Nov 17 01:31:40 user nova-compute[75226]:   <vcpu>1</vcpu>
Nov 17 01:31:40 user nova-compute[75226]:   <metadata>
Nov 17 01:31:40 user nova-compute[75226]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 17 01:31:40 user nova-compute[75226]:       <nova:package version="0.0.0"/>
Nov 17 01:31:40 user nova-compute[75226]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1593446740</nova:name>
Nov 17 01:31:40 user nova-compute[75226]:       <nova:creationTime>2023-11-17 01:31:40</nova:creationTime>
Nov 17 01:31:40 user nova-compute[75226]:       <nova:flavor name="m1.tiny">
Nov 17 01:31:40 user nova-compute[75226]:         <nova:memory>512</nova:memory>
Nov 17 01:31:40 user nova-compute[75226]:         <nova:disk>1</nova:disk>
Nov 17 01:31:40 user nova-compute[75226]:         <nova:swap>0</nova:swap>
Nov 17 01:31:40 user nova-compute[75226]:         <nova:ephemeral>0</nova:ephemeral>
Nov 17 01:31:40 user nova-compute[75226]:         <nova:vcpus>1</nova:vcpus>
Nov 17 01:31:40 user nova-compute[75226]:       </nova:flavor>
Nov 17 01:31:40 user nova-compute[75226]:       <nova:owner>
Nov 17 01:31:40 user nova-compute[75226]:         <nova:user uuid="642db538240b4ca1a367cf4ee9714f66">tempest-AttachVolumeNegativeTest-940905741-project-member</nova:user>
Nov 17 01:31:40 user nova-compute[75226]:         <nova:project uuid="e38777e8baf745e79f31190da97406a0">tempest-AttachVolumeNegativeTest-940905741</nova:project>
Nov 17 01:31:40 user nova-compute[75226]:       </nova:owner>
Nov 17 01:31:40 user nova-compute[75226]:       <nova:root type="image" uuid="0b369aea-6f3f-4690-9f01-229b90ab6310"/>
Nov 17 01:31:40 user nova-compute[75226]:       <nova:ports>
Nov 17 01:31:40 user nova-compute[75226]:         <nova:port uuid="09413dab-7bc1-4c16-9486-ce6e790b72e1">
Nov 17 01:31:40 user nova-compute[75226]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 17 01:31:40 user nova-compute[75226]:         </nova:port>
Nov 17 01:31:40 user nova-compute[75226]:       </nova:ports>
Nov 17 01:31:40 user nova-compute[75226]:     </nova:instance>
Nov 17 01:31:40 user nova-compute[75226]:   </metadata>
Nov 17 01:31:40 user nova-compute[75226]:   <sysinfo type="smbios">
Nov 17 01:31:40 user nova-compute[75226]:     <system>
Nov 17 01:31:40 user nova-compute[75226]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 17 01:31:40 user nova-compute[75226]:       <entry name="product">OpenStack Nova</entry>
Nov 17 01:31:40 user nova-compute[75226]:       <entry name="version">0.0.0</entry>
Nov 17 01:31:40 user nova-compute[75226]:       <entry name="serial">dae5490b-e434-4cd1-b8d4-6baab9bb7345</entry>
Nov 17 01:31:40 user nova-compute[75226]:       <entry name="uuid">dae5490b-e434-4cd1-b8d4-6baab9bb7345</entry>
Nov 17 01:31:40 user nova-compute[75226]:       <entry name="family">Virtual Machine</entry>
Nov 17 01:31:40 user nova-compute[75226]:     </system>
Nov 17 01:31:40 user nova-compute[75226]:   </sysinfo>
Nov 17 01:31:40 user nova-compute[75226]:   <os>
Nov 17 01:31:40 user nova-compute[75226]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 17 01:31:40 user nova-compute[75226]:     <boot dev="hd"/>
Nov 17 01:31:40 user nova-compute[75226]:     <smbios mode="sysinfo"/>
Nov 17 01:31:40 user nova-compute[75226]:   </os>
Nov 17 01:31:40 user nova-compute[75226]:   <features>
Nov 17 01:31:40 user nova-compute[75226]:     <acpi/>
Nov 17 01:31:40 user nova-compute[75226]:     <apic/>
Nov 17 01:31:40 user nova-compute[75226]:     <vmcoreinfo/>
Nov 17 01:31:40 user nova-compute[75226]:   </features>
Nov 17 01:31:40 user nova-compute[75226]:   <clock offset="utc">
Nov 17 01:31:40 user nova-compute[75226]:     <timer name="pit" tickpolicy="delay"/>
Nov 17 01:31:40 user nova-compute[75226]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 17 01:31:40 user nova-compute[75226]:     <timer name="hpet" present="no"/>
Nov 17 01:31:40 user nova-compute[75226]:   </clock>
Nov 17 01:31:40 user nova-compute[75226]:   <cpu mode="custom" match="exact">
Nov 17 01:31:40 user nova-compute[75226]:     <model>Nehalem</model>
Nov 17 01:31:40 user nova-compute[75226]:     <topology sockets="1" cores="1" threads="1"/>
Nov 17 01:31:40 user nova-compute[75226]:   </cpu>
Nov 17 01:31:40 user nova-compute[75226]:   <devices>
Nov 17 01:31:40 user nova-compute[75226]:     <disk type="file" device="disk">
Nov 17 01:31:40 user nova-compute[75226]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 17 01:31:40 user nova-compute[75226]:       <source file="/opt/stack/data/nova/instances/dae5490b-e434-4cd1-b8d4-6baab9bb7345/disk"/>
Nov 17 01:31:40 user nova-compute[75226]:       <target dev="vda" bus="virtio"/>
Nov 17 01:31:40 user nova-compute[75226]:     </disk>
Nov 17 01:31:40 user nova-compute[75226]:     <interface type="ethernet">
Nov 17 01:31:40 user nova-compute[75226]:       <mac address="fa:16:3e:82:cf:64"/>
Nov 17 01:31:40 user nova-compute[75226]:       <model type="virtio"/>
Nov 17 01:31:40 user nova-compute[75226]:       <mtu size="1442"/>
Nov 17 01:31:40 user nova-compute[75226]:       <target dev="tap09413dab-7b"/>
Nov 17 01:31:40 user nova-compute[75226]:     </interface>
Nov 17 01:31:40 user nova-compute[75226]:     <serial type="pty">
Nov 17 01:31:40 user nova-compute[75226]:       <log file="/opt/stack/data/nova/instances/dae5490b-e434-4cd1-b8d4-6baab9bb7345/console.log" append="off"/>
Nov 17 01:31:40 user nova-compute[75226]:     </serial>
Nov 17 01:31:40 user nova-compute[75226]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 17 01:31:40 user nova-compute[75226]:     <video>
Nov 17 01:31:40 user nova-compute[75226]:       <model type="virtio"/>
Nov 17 01:31:40 user nova-compute[75226]:     </video>
Nov 17 01:31:40 user nova-compute[75226]:     <rng model="virtio">
Nov 17 01:31:40 user nova-compute[75226]:       <backend model="random">/dev/urandom</backend>
Nov 17 01:31:40 user nova-compute[75226]:     </rng>
Nov 17 01:31:40 user nova-compute[75226]:     <controller type="usb" index="0" model="none"/>
Nov 17 01:31:40 user nova-compute[75226]:     <memballoon model="virtio">
Nov 17 01:31:40 user nova-compute[75226]:       <stats period="10"/>
Nov 17 01:31:40 user nova-compute[75226]:     </memballoon>
Nov 17 01:31:40 user nova-compute[75226]:   </devices>
Nov 17 01:31:40 user nova-compute[75226]: </domain>
Nov 17 01:31:40 user nova-compute[75226]:  {{(pid=75226) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 17 01:31:40 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-fae44993-7dad-41d7-88de-668af05f197c tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:31:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1593446740',display_name='tempest-AttachVolumeNegativeTest-server-1593446740',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1593446740',id=31,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOwz4hZVtgwWrcsPqTttyZBVyl9RUasoXFQhVcgfaPcpYA4qKb3oLahGiiQJ06st0ngGCdUQrVZmkK0ocqe46krfUTKz1BkqdX4i3m0Ik5xNCg8vFBi82owiMQLC/btQGw==',key_name='tempest-keypair-1790996567',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e38777e8baf745e79f31190da97406a0',ramdisk_id='',reservation_id='r-2trz1s7e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-940905741',owner_user_name='tempest-AttachVolumeNegativeTest-940905741-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T01:31:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='642db538240b4ca1a367cf4ee9714f66',uuid=dae5490b-e434-4cd1-b8d4-6baab9bb7345,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "09413dab-7bc1-4c16-9486-ce6e790b72e1", "address": "fa:16:3e:82:cf:64", "network": {"id": "57d0e7ee-0b11-4e00-86f9-bb4a3c25c674", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1357446034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e38777e8baf745e79f31190da97406a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09413dab-7b", "ovs_interfaceid": "09413dab-7bc1-4c16-9486-ce6e790b72e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 17 01:31:40 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-fae44993-7dad-41d7-88de-668af05f197c tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Converting VIF {"id": "09413dab-7bc1-4c16-9486-ce6e790b72e1", "address": "fa:16:3e:82:cf:64", "network": {"id": "57d0e7ee-0b11-4e00-86f9-bb4a3c25c674", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1357446034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e38777e8baf745e79f31190da97406a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09413dab-7b", "ovs_interfaceid": "09413dab-7bc1-4c16-9486-ce6e790b72e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:31:40 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-fae44993-7dad-41d7-88de-668af05f197c tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:cf:64,bridge_name='br-int',has_traffic_filtering=True,id=09413dab-7bc1-4c16-9486-ce6e790b72e1,network=Network(57d0e7ee-0b11-4e00-86f9-bb4a3c25c674),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09413dab-7b') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:31:40 user nova-compute[75226]: DEBUG os_vif [None req-fae44993-7dad-41d7-88de-668af05f197c tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:cf:64,bridge_name='br-int',has_traffic_filtering=True,id=09413dab-7bc1-4c16-9486-ce6e790b72e1,network=Network(57d0e7ee-0b11-4e00-86f9-bb4a3c25c674),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09413dab-7b') {{(pid=75226) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 17 01:31:40 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:31:40 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:31:40 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 17 01:31:40 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:31:40 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0f7d3daa-c204-5ae6-8d9f-edd08d5a5d99', '_type': 'linux-noop'}}, row=False) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:31:40 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:31:40 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:31:40 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:31:40 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap09413dab-7b, may_exist=True, interface_attrs={}) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:31:40 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap09413dab-7b, col_values=(('qos', UUID('5f2550a3-36e4-432f-a0d1-1de02e4c8117')),), if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:31:40 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap09413dab-7b, col_values=(('external_ids', {'iface-id': '09413dab-7bc1-4c16-9486-ce6e790b72e1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:82:cf:64', 'vm-uuid': 'dae5490b-e434-4cd1-b8d4-6baab9bb7345'}),), if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:31:40 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:31:40 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:31:40 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:31:40 user nova-compute[75226]: INFO os_vif [None req-fae44993-7dad-41d7-88de-668af05f197c tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:cf:64,bridge_name='br-int',has_traffic_filtering=True,id=09413dab-7bc1-4c16-9486-ce6e790b72e1,network=Network(57d0e7ee-0b11-4e00-86f9-bb4a3c25c674),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09413dab-7b')
Nov 17 01:31:40 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-fae44993-7dad-41d7-88de-668af05f197c tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] No BDM found with device name vda, not building metadata. {{(pid=75226) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 01:31:40 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-fae44993-7dad-41d7-88de-668af05f197c tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] No VIF found with MAC fa:16:3e:82:cf:64, not building metadata {{(pid=75226) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 01:31:40 user nova-compute[75226]: DEBUG nova.network.neutron [req-c00dddd0-ab4b-4203-95aa-0e121b0619e8 req-6bfc51e9-fe2d-4a67-9487-584a9db85df3 service nova] [instance: dae5490b-e434-4cd1-b8d4-6baab9bb7345] Updated VIF entry in instance network info cache for port 09413dab-7bc1-4c16-9486-ce6e790b72e1. {{(pid=75226) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 01:31:40 user nova-compute[75226]: DEBUG nova.network.neutron [req-c00dddd0-ab4b-4203-95aa-0e121b0619e8 req-6bfc51e9-fe2d-4a67-9487-584a9db85df3 service nova] [instance: dae5490b-e434-4cd1-b8d4-6baab9bb7345] Updating instance_info_cache with network_info: [{"id": "09413dab-7bc1-4c16-9486-ce6e790b72e1", "address": "fa:16:3e:82:cf:64", "network": {"id": "57d0e7ee-0b11-4e00-86f9-bb4a3c25c674", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1357446034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e38777e8baf745e79f31190da97406a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09413dab-7b", "ovs_interfaceid": "09413dab-7bc1-4c16-9486-ce6e790b72e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:31:40 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-c00dddd0-ab4b-4203-95aa-0e121b0619e8 req-6bfc51e9-fe2d-4a67-9487-584a9db85df3 service nova] Releasing lock "refresh_cache-dae5490b-e434-4cd1-b8d4-6baab9bb7345" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:31:41 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:31:41 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:31:41 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:31:42 user nova-compute[75226]: DEBUG nova.compute.manager [req-9cddf44f-53bb-4517-94a6-cb0b4e2d6558 req-4a4f64ad-8123-4edf-86dd-42f02c2c6515 service nova] [instance: dae5490b-e434-4cd1-b8d4-6baab9bb7345] Received event network-vif-plugged-09413dab-7bc1-4c16-9486-ce6e790b72e1 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:31:42 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-9cddf44f-53bb-4517-94a6-cb0b4e2d6558 req-4a4f64ad-8123-4edf-86dd-42f02c2c6515 service nova] Acquiring lock "dae5490b-e434-4cd1-b8d4-6baab9bb7345-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:31:42 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-9cddf44f-53bb-4517-94a6-cb0b4e2d6558 req-4a4f64ad-8123-4edf-86dd-42f02c2c6515 service nova] Lock "dae5490b-e434-4cd1-b8d4-6baab9bb7345-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:31:42 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-9cddf44f-53bb-4517-94a6-cb0b4e2d6558 req-4a4f64ad-8123-4edf-86dd-42f02c2c6515 service nova] Lock "dae5490b-e434-4cd1-b8d4-6baab9bb7345-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:31:42 user nova-compute[75226]: DEBUG nova.compute.manager [req-9cddf44f-53bb-4517-94a6-cb0b4e2d6558 req-4a4f64ad-8123-4edf-86dd-42f02c2c6515 service nova] [instance: dae5490b-e434-4cd1-b8d4-6baab9bb7345] No waiting events found dispatching network-vif-plugged-09413dab-7bc1-4c16-9486-ce6e790b72e1 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:31:42 user nova-compute[75226]: WARNING nova.compute.manager [req-9cddf44f-53bb-4517-94a6-cb0b4e2d6558 req-4a4f64ad-8123-4edf-86dd-42f02c2c6515 service nova] [instance: dae5490b-e434-4cd1-b8d4-6baab9bb7345] Received unexpected event network-vif-plugged-09413dab-7bc1-4c16-9486-ce6e790b72e1 for instance with vm_state building and task_state spawning.
Nov 17 01:31:42 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:31:42 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:31:42 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:31:42 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:31:42 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:31:43 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:31:44 user nova-compute[75226]: DEBUG nova.compute.manager [None req-fae44993-7dad-41d7-88de-668af05f197c tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: dae5490b-e434-4cd1-b8d4-6baab9bb7345] Instance event wait completed in 0 seconds for  {{(pid=75226) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 17 01:31:44 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-fae44993-7dad-41d7-88de-668af05f197c tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: dae5490b-e434-4cd1-b8d4-6baab9bb7345] Guest created on hypervisor {{(pid=75226) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 17 01:31:44 user nova-compute[75226]: INFO nova.virt.libvirt.driver [-] [instance: dae5490b-e434-4cd1-b8d4-6baab9bb7345] Instance spawned successfully.
Nov 17 01:31:44 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-fae44993-7dad-41d7-88de-668af05f197c tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: dae5490b-e434-4cd1-b8d4-6baab9bb7345] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 17 01:31:44 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-fae44993-7dad-41d7-88de-668af05f197c tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: dae5490b-e434-4cd1-b8d4-6baab9bb7345] Found default for hw_cdrom_bus of ide {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:31:44 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-fae44993-7dad-41d7-88de-668af05f197c tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: dae5490b-e434-4cd1-b8d4-6baab9bb7345] Found default for hw_disk_bus of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:31:44 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-fae44993-7dad-41d7-88de-668af05f197c tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: dae5490b-e434-4cd1-b8d4-6baab9bb7345] Found default for hw_input_bus of None {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:31:44 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-fae44993-7dad-41d7-88de-668af05f197c tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: dae5490b-e434-4cd1-b8d4-6baab9bb7345] Found default for hw_pointer_model of None {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:31:44 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-fae44993-7dad-41d7-88de-668af05f197c tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: dae5490b-e434-4cd1-b8d4-6baab9bb7345] Found default for hw_video_model of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:31:44 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-fae44993-7dad-41d7-88de-668af05f197c tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: dae5490b-e434-4cd1-b8d4-6baab9bb7345] Found default for hw_vif_model of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:31:44 user nova-compute[75226]: INFO nova.compute.manager [None req-fae44993-7dad-41d7-88de-668af05f197c tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: dae5490b-e434-4cd1-b8d4-6baab9bb7345] Took 5.15 seconds to spawn the instance on the hypervisor.
Nov 17 01:31:44 user nova-compute[75226]: DEBUG nova.compute.manager [None req-fae44993-7dad-41d7-88de-668af05f197c tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: dae5490b-e434-4cd1-b8d4-6baab9bb7345] Checking state {{(pid=75226) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 01:31:44 user nova-compute[75226]: INFO nova.compute.manager [None req-fae44993-7dad-41d7-88de-668af05f197c tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: dae5490b-e434-4cd1-b8d4-6baab9bb7345] Took 5.89 seconds to build instance.
Nov 17 01:31:44 user nova-compute[75226]: DEBUG nova.compute.manager [req-567b415c-a575-4eb6-8186-fc41777ad093 req-a2373785-1f74-4e59-93c9-2d8b6b8687f9 service nova] [instance: dae5490b-e434-4cd1-b8d4-6baab9bb7345] Received event network-vif-plugged-09413dab-7bc1-4c16-9486-ce6e790b72e1 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:31:44 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-567b415c-a575-4eb6-8186-fc41777ad093 req-a2373785-1f74-4e59-93c9-2d8b6b8687f9 service nova] Acquiring lock "dae5490b-e434-4cd1-b8d4-6baab9bb7345-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:31:44 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-567b415c-a575-4eb6-8186-fc41777ad093 req-a2373785-1f74-4e59-93c9-2d8b6b8687f9 service nova] Lock "dae5490b-e434-4cd1-b8d4-6baab9bb7345-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:31:44 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-567b415c-a575-4eb6-8186-fc41777ad093 req-a2373785-1f74-4e59-93c9-2d8b6b8687f9 service nova] Lock "dae5490b-e434-4cd1-b8d4-6baab9bb7345-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:31:44 user nova-compute[75226]: DEBUG nova.compute.manager [req-567b415c-a575-4eb6-8186-fc41777ad093 req-a2373785-1f74-4e59-93c9-2d8b6b8687f9 service nova] [instance: dae5490b-e434-4cd1-b8d4-6baab9bb7345] No waiting events found dispatching network-vif-plugged-09413dab-7bc1-4c16-9486-ce6e790b72e1 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:31:44 user nova-compute[75226]: WARNING nova.compute.manager [req-567b415c-a575-4eb6-8186-fc41777ad093 req-a2373785-1f74-4e59-93c9-2d8b6b8687f9 service nova] [instance: dae5490b-e434-4cd1-b8d4-6baab9bb7345] Received unexpected event network-vif-plugged-09413dab-7bc1-4c16-9486-ce6e790b72e1 for instance with vm_state active and task_state None.
Nov 17 01:31:44 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-fae44993-7dad-41d7-88de-668af05f197c tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Lock "dae5490b-e434-4cd1-b8d4-6baab9bb7345" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.004s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:31:45 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:31:48 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:31:50 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:31:53 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:31:55 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:31:57 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-b73b6c52-c647-4899-83d6-873a46fe4c5b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Acquiring lock "c11fbffa-07e2-40c4-92b1-8531dbe8b687" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:31:57 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-b73b6c52-c647-4899-83d6-873a46fe4c5b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Lock "c11fbffa-07e2-40c4-92b1-8531dbe8b687" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:31:57 user nova-compute[75226]: DEBUG nova.compute.manager [None req-b73b6c52-c647-4899-83d6-873a46fe4c5b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] [instance: c11fbffa-07e2-40c4-92b1-8531dbe8b687] Starting instance... {{(pid=75226) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 17 01:31:57 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-b73b6c52-c647-4899-83d6-873a46fe4c5b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:31:57 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-b73b6c52-c647-4899-83d6-873a46fe4c5b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:31:57 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-b73b6c52-c647-4899-83d6-873a46fe4c5b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75226) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 17 01:31:57 user nova-compute[75226]: INFO nova.compute.claims [None req-b73b6c52-c647-4899-83d6-873a46fe4c5b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] [instance: c11fbffa-07e2-40c4-92b1-8531dbe8b687] Claim successful on node user
Nov 17 01:31:57 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-b73b6c52-c647-4899-83d6-873a46fe4c5b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:31:57 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-b73b6c52-c647-4899-83d6-873a46fe4c5b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:31:57 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-b73b6c52-c647-4899-83d6-873a46fe4c5b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.412s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:31:57 user nova-compute[75226]: DEBUG nova.compute.manager [None req-b73b6c52-c647-4899-83d6-873a46fe4c5b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] [instance: c11fbffa-07e2-40c4-92b1-8531dbe8b687] Start building networks asynchronously for instance. {{(pid=75226) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 17 01:31:57 user nova-compute[75226]: DEBUG nova.compute.manager [None req-b73b6c52-c647-4899-83d6-873a46fe4c5b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] [instance: c11fbffa-07e2-40c4-92b1-8531dbe8b687] Allocating IP information in the background. {{(pid=75226) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 17 01:31:57 user nova-compute[75226]: DEBUG nova.network.neutron [None req-b73b6c52-c647-4899-83d6-873a46fe4c5b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] [instance: c11fbffa-07e2-40c4-92b1-8531dbe8b687] allocate_for_instance() {{(pid=75226) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 17 01:31:57 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-b73b6c52-c647-4899-83d6-873a46fe4c5b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] [instance: c11fbffa-07e2-40c4-92b1-8531dbe8b687] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 17 01:31:57 user nova-compute[75226]: DEBUG nova.compute.manager [None req-b73b6c52-c647-4899-83d6-873a46fe4c5b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] [instance: c11fbffa-07e2-40c4-92b1-8531dbe8b687] Start building block device mappings for instance. {{(pid=75226) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 17 01:31:58 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:31:58 user nova-compute[75226]: DEBUG nova.compute.manager [None req-b73b6c52-c647-4899-83d6-873a46fe4c5b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] [instance: c11fbffa-07e2-40c4-92b1-8531dbe8b687] Start spawning the instance on the hypervisor. {{(pid=75226) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 17 01:31:58 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-b73b6c52-c647-4899-83d6-873a46fe4c5b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] [instance: c11fbffa-07e2-40c4-92b1-8531dbe8b687] Creating instance directory {{(pid=75226) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 17 01:31:58 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-b73b6c52-c647-4899-83d6-873a46fe4c5b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] [instance: c11fbffa-07e2-40c4-92b1-8531dbe8b687] Creating image(s)
Nov 17 01:31:58 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-b73b6c52-c647-4899-83d6-873a46fe4c5b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Acquiring lock "/opt/stack/data/nova/instances/c11fbffa-07e2-40c4-92b1-8531dbe8b687/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:31:58 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-b73b6c52-c647-4899-83d6-873a46fe4c5b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Lock "/opt/stack/data/nova/instances/c11fbffa-07e2-40c4-92b1-8531dbe8b687/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:31:58 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-b73b6c52-c647-4899-83d6-873a46fe4c5b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Lock "/opt/stack/data/nova/instances/c11fbffa-07e2-40c4-92b1-8531dbe8b687/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:31:58 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-b73b6c52-c647-4899-83d6-873a46fe4c5b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:31:58 user nova-compute[75226]: DEBUG nova.policy [None req-b73b6c52-c647-4899-83d6-873a46fe4c5b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c30381a66814427ba39e21c024136fee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '054575d3dc66452091173b4c604b8c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75226) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 17 01:31:58 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-b73b6c52-c647-4899-83d6-873a46fe4c5b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json" returned: 0 in 0.185s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:31:58 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-b73b6c52-c647-4899-83d6-873a46fe4c5b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Acquiring lock "a8a62c2546af3a2036b853250c5ac64d4c6b4371" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:31:58 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-b73b6c52-c647-4899-83d6-873a46fe4c5b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Lock "a8a62c2546af3a2036b853250c5ac64d4c6b4371" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:31:58 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-b73b6c52-c647-4899-83d6-873a46fe4c5b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:31:58 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-b73b6c52-c647-4899-83d6-873a46fe4c5b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json" returned: 0 in 0.176s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:31:58 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-b73b6c52-c647-4899-83d6-873a46fe4c5b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371,backing_fmt=raw /opt/stack/data/nova/instances/c11fbffa-07e2-40c4-92b1-8531dbe8b687/disk 1073741824 {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:31:58 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-b73b6c52-c647-4899-83d6-873a46fe4c5b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371,backing_fmt=raw /opt/stack/data/nova/instances/c11fbffa-07e2-40c4-92b1-8531dbe8b687/disk 1073741824" returned: 0 in 0.069s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:31:58 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-b73b6c52-c647-4899-83d6-873a46fe4c5b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Lock "a8a62c2546af3a2036b853250c5ac64d4c6b4371" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:31:58 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-b73b6c52-c647-4899-83d6-873a46fe4c5b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:31:58 user nova-compute[75226]: DEBUG nova.network.neutron [None req-b73b6c52-c647-4899-83d6-873a46fe4c5b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] [instance: c11fbffa-07e2-40c4-92b1-8531dbe8b687] Successfully created port: 325d11f4-b841-44c8-8a19-bdccb1d8cfd1 {{(pid=75226) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 17 01:31:58 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-b73b6c52-c647-4899-83d6-873a46fe4c5b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json" returned: 0 in 0.201s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:31:58 user nova-compute[75226]: DEBUG nova.virt.disk.api [None req-b73b6c52-c647-4899-83d6-873a46fe4c5b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c11fbffa-07e2-40c4-92b1-8531dbe8b687/disk. size=1073741824 {{(pid=75226) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 17 01:31:58 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-b73b6c52-c647-4899-83d6-873a46fe4c5b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c11fbffa-07e2-40c4-92b1-8531dbe8b687/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:31:58 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-b73b6c52-c647-4899-83d6-873a46fe4c5b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c11fbffa-07e2-40c4-92b1-8531dbe8b687/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:31:58 user nova-compute[75226]: DEBUG nova.virt.disk.api [None req-b73b6c52-c647-4899-83d6-873a46fe4c5b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Cannot resize image /opt/stack/data/nova/instances/c11fbffa-07e2-40c4-92b1-8531dbe8b687/disk to a smaller size. {{(pid=75226) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 17 01:31:58 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-b73b6c52-c647-4899-83d6-873a46fe4c5b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] [instance: c11fbffa-07e2-40c4-92b1-8531dbe8b687] Created local disks {{(pid=75226) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 17 01:31:58 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-b73b6c52-c647-4899-83d6-873a46fe4c5b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] [instance: c11fbffa-07e2-40c4-92b1-8531dbe8b687] Ensure instance console log exists: /opt/stack/data/nova/instances/c11fbffa-07e2-40c4-92b1-8531dbe8b687/console.log {{(pid=75226) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 17 01:31:58 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-b73b6c52-c647-4899-83d6-873a46fe4c5b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:31:58 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-b73b6c52-c647-4899-83d6-873a46fe4c5b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:31:58 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-b73b6c52-c647-4899-83d6-873a46fe4c5b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:31:59 user nova-compute[75226]: DEBUG nova.network.neutron [None req-b73b6c52-c647-4899-83d6-873a46fe4c5b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] [instance: c11fbffa-07e2-40c4-92b1-8531dbe8b687] Successfully updated port: 325d11f4-b841-44c8-8a19-bdccb1d8cfd1 {{(pid=75226) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 17 01:31:59 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-b73b6c52-c647-4899-83d6-873a46fe4c5b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Acquiring lock "refresh_cache-c11fbffa-07e2-40c4-92b1-8531dbe8b687" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:31:59 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-b73b6c52-c647-4899-83d6-873a46fe4c5b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Acquired lock "refresh_cache-c11fbffa-07e2-40c4-92b1-8531dbe8b687" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:31:59 user nova-compute[75226]: DEBUG nova.network.neutron [None req-b73b6c52-c647-4899-83d6-873a46fe4c5b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] [instance: c11fbffa-07e2-40c4-92b1-8531dbe8b687] Building network info cache for instance {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 01:31:59 user nova-compute[75226]: DEBUG nova.compute.manager [req-01581176-6e89-4361-85e4-db1bb7768533 req-35d6d95a-a67e-4cbe-ad6e-88cd34d8e673 service nova] [instance: c11fbffa-07e2-40c4-92b1-8531dbe8b687] Received event network-changed-325d11f4-b841-44c8-8a19-bdccb1d8cfd1 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:31:59 user nova-compute[75226]: DEBUG nova.compute.manager [req-01581176-6e89-4361-85e4-db1bb7768533 req-35d6d95a-a67e-4cbe-ad6e-88cd34d8e673 service nova] [instance: c11fbffa-07e2-40c4-92b1-8531dbe8b687] Refreshing instance network info cache due to event network-changed-325d11f4-b841-44c8-8a19-bdccb1d8cfd1. {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 01:31:59 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-01581176-6e89-4361-85e4-db1bb7768533 req-35d6d95a-a67e-4cbe-ad6e-88cd34d8e673 service nova] Acquiring lock "refresh_cache-c11fbffa-07e2-40c4-92b1-8531dbe8b687" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:31:59 user nova-compute[75226]: DEBUG nova.network.neutron [None req-b73b6c52-c647-4899-83d6-873a46fe4c5b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] [instance: c11fbffa-07e2-40c4-92b1-8531dbe8b687] Instance cache missing network info. {{(pid=75226) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 17 01:31:59 user nova-compute[75226]: DEBUG nova.network.neutron [None req-b73b6c52-c647-4899-83d6-873a46fe4c5b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] [instance: c11fbffa-07e2-40c4-92b1-8531dbe8b687] Updating instance_info_cache with network_info: [{"id": "325d11f4-b841-44c8-8a19-bdccb1d8cfd1", "address": "fa:16:3e:06:46:c3", "network": {"id": "c93f11a7-52c6-4379-a1fb-9a002876c221", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-985502177-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "054575d3dc66452091173b4c604b8c96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap325d11f4-b8", "ovs_interfaceid": "325d11f4-b841-44c8-8a19-bdccb1d8cfd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:31:59 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-b73b6c52-c647-4899-83d6-873a46fe4c5b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Releasing lock "refresh_cache-c11fbffa-07e2-40c4-92b1-8531dbe8b687" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:31:59 user nova-compute[75226]: DEBUG nova.compute.manager [None req-b73b6c52-c647-4899-83d6-873a46fe4c5b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] [instance: c11fbffa-07e2-40c4-92b1-8531dbe8b687] Instance network_info: |[{"id": "325d11f4-b841-44c8-8a19-bdccb1d8cfd1", "address": "fa:16:3e:06:46:c3", "network": {"id": "c93f11a7-52c6-4379-a1fb-9a002876c221", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-985502177-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "054575d3dc66452091173b4c604b8c96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap325d11f4-b8", "ovs_interfaceid": "325d11f4-b841-44c8-8a19-bdccb1d8cfd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75226) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 17 01:31:59 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-01581176-6e89-4361-85e4-db1bb7768533 req-35d6d95a-a67e-4cbe-ad6e-88cd34d8e673 service nova] Acquired lock "refresh_cache-c11fbffa-07e2-40c4-92b1-8531dbe8b687" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:31:59 user nova-compute[75226]: DEBUG nova.network.neutron [req-01581176-6e89-4361-85e4-db1bb7768533 req-35d6d95a-a67e-4cbe-ad6e-88cd34d8e673 service nova] [instance: c11fbffa-07e2-40c4-92b1-8531dbe8b687] Refreshing network info cache for port 325d11f4-b841-44c8-8a19-bdccb1d8cfd1 {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 01:31:59 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-b73b6c52-c647-4899-83d6-873a46fe4c5b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] [instance: c11fbffa-07e2-40c4-92b1-8531dbe8b687] Start _get_guest_xml network_info=[{"id": "325d11f4-b841-44c8-8a19-bdccb1d8cfd1", "address": "fa:16:3e:06:46:c3", "network": {"id": "c93f11a7-52c6-4379-a1fb-9a002876c221", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-985502177-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "054575d3dc66452091173b4c604b8c96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap325d11f4-b8", "ovs_interfaceid": "325d11f4-b841-44c8-8a19-bdccb1d8cfd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T01:13:22Z,direct_url=<?>,disk_format='qcow2',id=0b369aea-6f3f-4690-9f01-229b90ab6310,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4e110cbf9a84362a6864a7732c435a1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T01:13:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '0b369aea-6f3f-4690-9f01-229b90ab6310'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75226) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 17 01:31:59 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-b73b6c52-c647-4899-83d6-873a46fe4c5b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:31:59 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-b73b6c52-c647-4899-83d6-873a46fe4c5b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:31:59 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-b73b6c52-c647-4899-83d6-873a46fe4c5b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75226) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 17 01:31:59 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-b73b6c52-c647-4899-83d6-873a46fe4c5b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] CPU controller missing on host. {{(pid=75226) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 17 01:31:59 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-b73b6c52-c647-4899-83d6-873a46fe4c5b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75226) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 17 01:31:59 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-b73b6c52-c647-4899-83d6-873a46fe4c5b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] CPU controller found on host. {{(pid=75226) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 17 01:31:59 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-b73b6c52-c647-4899-83d6-873a46fe4c5b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75226) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 17 01:31:59 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-b73b6c52-c647-4899-83d6-873a46fe4c5b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-17T01:13:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T01:13:22Z,direct_url=<?>,disk_format='qcow2',id=0b369aea-6f3f-4690-9f01-229b90ab6310,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4e110cbf9a84362a6864a7732c435a1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T01:13:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 17 01:31:59 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-b73b6c52-c647-4899-83d6-873a46fe4c5b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Flavor limits 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 17 01:31:59 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-b73b6c52-c647-4899-83d6-873a46fe4c5b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Image limits 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 17 01:31:59 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-b73b6c52-c647-4899-83d6-873a46fe4c5b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Flavor pref 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 17 01:31:59 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-b73b6c52-c647-4899-83d6-873a46fe4c5b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Image pref 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 17 01:31:59 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-b73b6c52-c647-4899-83d6-873a46fe4c5b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 17 01:31:59 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-b73b6c52-c647-4899-83d6-873a46fe4c5b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 17 01:31:59 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-b73b6c52-c647-4899-83d6-873a46fe4c5b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75226) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 17 01:31:59 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-b73b6c52-c647-4899-83d6-873a46fe4c5b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Got 1 possible topologies {{(pid=75226) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 17 01:31:59 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-b73b6c52-c647-4899-83d6-873a46fe4c5b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 17 01:31:59 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-b73b6c52-c647-4899-83d6-873a46fe4c5b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 17 01:31:59 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-b73b6c52-c647-4899-83d6-873a46fe4c5b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:31:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-272679960',display_name='tempest-AttachVolumeTestJSON-server-272679960',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-272679960',id=32,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL2DydS5B2Smzu9SpLhv4GJZVB8BFUGnLWtyejkStib/wW9Am/YgjXYWichtaaKD2Ji75s6W7ULIOuvASfS68HQNeuyGVJrb6V/A9K7Mko9DQsSLEUzBtAxegePG83Lf5A==',key_name='tempest-keypair-969699449',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='054575d3dc66452091173b4c604b8c96',ramdisk_id='',reservation_id='r-9r3w0z00',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-223132631',owner_user_name='tempest-AttachVolumeTestJSON-223132631-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T01:31:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c30381a66814427ba39e21c024136fee',uuid=c11fbffa-07e2-40c4-92b1-8531dbe8b687,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "325d11f4-b841-44c8-8a19-bdccb1d8cfd1", "address": "fa:16:3e:06:46:c3", "network": {"id": "c93f11a7-52c6-4379-a1fb-9a002876c221", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-985502177-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "054575d3dc66452091173b4c604b8c96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap325d11f4-b8", "ovs_interfaceid": "325d11f4-b841-44c8-8a19-bdccb1d8cfd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75226) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 01:31:59 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-b73b6c52-c647-4899-83d6-873a46fe4c5b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Converting VIF {"id": "325d11f4-b841-44c8-8a19-bdccb1d8cfd1", "address": "fa:16:3e:06:46:c3", "network": {"id": "c93f11a7-52c6-4379-a1fb-9a002876c221", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-985502177-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "054575d3dc66452091173b4c604b8c96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap325d11f4-b8", "ovs_interfaceid": "325d11f4-b841-44c8-8a19-bdccb1d8cfd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:31:59 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-b73b6c52-c647-4899-83d6-873a46fe4c5b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:46:c3,bridge_name='br-int',has_traffic_filtering=True,id=325d11f4-b841-44c8-8a19-bdccb1d8cfd1,network=Network(c93f11a7-52c6-4379-a1fb-9a002876c221),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap325d11f4-b8') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:31:59 user nova-compute[75226]: DEBUG nova.objects.instance [None req-b73b6c52-c647-4899-83d6-873a46fe4c5b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Lazy-loading 'pci_devices' on Instance uuid c11fbffa-07e2-40c4-92b1-8531dbe8b687 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:31:59 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-b73b6c52-c647-4899-83d6-873a46fe4c5b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] [instance: c11fbffa-07e2-40c4-92b1-8531dbe8b687] End _get_guest_xml xml=<domain type="kvm">
Nov 17 01:31:59 user nova-compute[75226]:   <uuid>c11fbffa-07e2-40c4-92b1-8531dbe8b687</uuid>
Nov 17 01:31:59 user nova-compute[75226]:   <name>instance-00000020</name>
Nov 17 01:31:59 user nova-compute[75226]:   <memory>524288</memory>
Nov 17 01:31:59 user nova-compute[75226]:   <vcpu>1</vcpu>
Nov 17 01:31:59 user nova-compute[75226]:   <metadata>
Nov 17 01:31:59 user nova-compute[75226]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 17 01:31:59 user nova-compute[75226]:       <nova:package version="0.0.0"/>
Nov 17 01:31:59 user nova-compute[75226]:       <nova:name>tempest-AttachVolumeTestJSON-server-272679960</nova:name>
Nov 17 01:31:59 user nova-compute[75226]:       <nova:creationTime>2023-11-17 01:31:59</nova:creationTime>
Nov 17 01:31:59 user nova-compute[75226]:       <nova:flavor name="m1.tiny">
Nov 17 01:31:59 user nova-compute[75226]:         <nova:memory>512</nova:memory>
Nov 17 01:31:59 user nova-compute[75226]:         <nova:disk>1</nova:disk>
Nov 17 01:31:59 user nova-compute[75226]:         <nova:swap>0</nova:swap>
Nov 17 01:31:59 user nova-compute[75226]:         <nova:ephemeral>0</nova:ephemeral>
Nov 17 01:31:59 user nova-compute[75226]:         <nova:vcpus>1</nova:vcpus>
Nov 17 01:31:59 user nova-compute[75226]:       </nova:flavor>
Nov 17 01:31:59 user nova-compute[75226]:       <nova:owner>
Nov 17 01:31:59 user nova-compute[75226]:         <nova:user uuid="c30381a66814427ba39e21c024136fee">tempest-AttachVolumeTestJSON-223132631-project-member</nova:user>
Nov 17 01:31:59 user nova-compute[75226]:         <nova:project uuid="054575d3dc66452091173b4c604b8c96">tempest-AttachVolumeTestJSON-223132631</nova:project>
Nov 17 01:31:59 user nova-compute[75226]:       </nova:owner>
Nov 17 01:31:59 user nova-compute[75226]:       <nova:root type="image" uuid="0b369aea-6f3f-4690-9f01-229b90ab6310"/>
Nov 17 01:31:59 user nova-compute[75226]:       <nova:ports>
Nov 17 01:31:59 user nova-compute[75226]:         <nova:port uuid="325d11f4-b841-44c8-8a19-bdccb1d8cfd1">
Nov 17 01:31:59 user nova-compute[75226]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 17 01:31:59 user nova-compute[75226]:         </nova:port>
Nov 17 01:31:59 user nova-compute[75226]:       </nova:ports>
Nov 17 01:31:59 user nova-compute[75226]:     </nova:instance>
Nov 17 01:31:59 user nova-compute[75226]:   </metadata>
Nov 17 01:31:59 user nova-compute[75226]:   <sysinfo type="smbios">
Nov 17 01:31:59 user nova-compute[75226]:     <system>
Nov 17 01:31:59 user nova-compute[75226]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 17 01:31:59 user nova-compute[75226]:       <entry name="product">OpenStack Nova</entry>
Nov 17 01:31:59 user nova-compute[75226]:       <entry name="version">0.0.0</entry>
Nov 17 01:31:59 user nova-compute[75226]:       <entry name="serial">c11fbffa-07e2-40c4-92b1-8531dbe8b687</entry>
Nov 17 01:31:59 user nova-compute[75226]:       <entry name="uuid">c11fbffa-07e2-40c4-92b1-8531dbe8b687</entry>
Nov 17 01:31:59 user nova-compute[75226]:       <entry name="family">Virtual Machine</entry>
Nov 17 01:31:59 user nova-compute[75226]:     </system>
Nov 17 01:31:59 user nova-compute[75226]:   </sysinfo>
Nov 17 01:31:59 user nova-compute[75226]:   <os>
Nov 17 01:31:59 user nova-compute[75226]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 17 01:31:59 user nova-compute[75226]:     <boot dev="hd"/>
Nov 17 01:31:59 user nova-compute[75226]:     <smbios mode="sysinfo"/>
Nov 17 01:31:59 user nova-compute[75226]:   </os>
Nov 17 01:31:59 user nova-compute[75226]:   <features>
Nov 17 01:31:59 user nova-compute[75226]:     <acpi/>
Nov 17 01:31:59 user nova-compute[75226]:     <apic/>
Nov 17 01:31:59 user nova-compute[75226]:     <vmcoreinfo/>
Nov 17 01:31:59 user nova-compute[75226]:   </features>
Nov 17 01:31:59 user nova-compute[75226]:   <clock offset="utc">
Nov 17 01:31:59 user nova-compute[75226]:     <timer name="pit" tickpolicy="delay"/>
Nov 17 01:31:59 user nova-compute[75226]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 17 01:31:59 user nova-compute[75226]:     <timer name="hpet" present="no"/>
Nov 17 01:31:59 user nova-compute[75226]:   </clock>
Nov 17 01:31:59 user nova-compute[75226]:   <cpu mode="custom" match="exact">
Nov 17 01:31:59 user nova-compute[75226]:     <model>Nehalem</model>
Nov 17 01:31:59 user nova-compute[75226]:     <topology sockets="1" cores="1" threads="1"/>
Nov 17 01:31:59 user nova-compute[75226]:   </cpu>
Nov 17 01:31:59 user nova-compute[75226]:   <devices>
Nov 17 01:31:59 user nova-compute[75226]:     <disk type="file" device="disk">
Nov 17 01:31:59 user nova-compute[75226]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 17 01:31:59 user nova-compute[75226]:       <source file="/opt/stack/data/nova/instances/c11fbffa-07e2-40c4-92b1-8531dbe8b687/disk"/>
Nov 17 01:31:59 user nova-compute[75226]:       <target dev="vda" bus="virtio"/>
Nov 17 01:31:59 user nova-compute[75226]:     </disk>
Nov 17 01:31:59 user nova-compute[75226]:     <interface type="ethernet">
Nov 17 01:31:59 user nova-compute[75226]:       <mac address="fa:16:3e:06:46:c3"/>
Nov 17 01:31:59 user nova-compute[75226]:       <model type="virtio"/>
Nov 17 01:31:59 user nova-compute[75226]:       <mtu size="1442"/>
Nov 17 01:31:59 user nova-compute[75226]:       <target dev="tap325d11f4-b8"/>
Nov 17 01:31:59 user nova-compute[75226]:     </interface>
Nov 17 01:31:59 user nova-compute[75226]:     <serial type="pty">
Nov 17 01:31:59 user nova-compute[75226]:       <log file="/opt/stack/data/nova/instances/c11fbffa-07e2-40c4-92b1-8531dbe8b687/console.log" append="off"/>
Nov 17 01:31:59 user nova-compute[75226]:     </serial>
Nov 17 01:31:59 user nova-compute[75226]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 17 01:31:59 user nova-compute[75226]:     <video>
Nov 17 01:31:59 user nova-compute[75226]:       <model type="virtio"/>
Nov 17 01:31:59 user nova-compute[75226]:     </video>
Nov 17 01:31:59 user nova-compute[75226]:     <rng model="virtio">
Nov 17 01:31:59 user nova-compute[75226]:       <backend model="random">/dev/urandom</backend>
Nov 17 01:31:59 user nova-compute[75226]:     </rng>
Nov 17 01:31:59 user nova-compute[75226]:     <controller type="usb" index="0" model="none"/>
Nov 17 01:31:59 user nova-compute[75226]:     <memballoon model="virtio">
Nov 17 01:31:59 user nova-compute[75226]:       <stats period="10"/>
Nov 17 01:31:59 user nova-compute[75226]:     </memballoon>
Nov 17 01:31:59 user nova-compute[75226]:   </devices>
Nov 17 01:31:59 user nova-compute[75226]: </domain>
Nov 17 01:31:59 user nova-compute[75226]:  {{(pid=75226) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 17 01:31:59 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-b73b6c52-c647-4899-83d6-873a46fe4c5b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:31:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-272679960',display_name='tempest-AttachVolumeTestJSON-server-272679960',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-272679960',id=32,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL2DydS5B2Smzu9SpLhv4GJZVB8BFUGnLWtyejkStib/wW9Am/YgjXYWichtaaKD2Ji75s6W7ULIOuvASfS68HQNeuyGVJrb6V/A9K7Mko9DQsSLEUzBtAxegePG83Lf5A==',key_name='tempest-keypair-969699449',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='054575d3dc66452091173b4c604b8c96',ramdisk_id='',reservation_id='r-9r3w0z00',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-223132631',owner_user_name='tempest-AttachVolumeTestJSON-223132631-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T01:31:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c30381a66814427ba39e21c024136fee',uuid=c11fbffa-07e2-40c4-92b1-8531dbe8b687,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "325d11f4-b841-44c8-8a19-bdccb1d8cfd1", "address": "fa:16:3e:06:46:c3", "network": {"id": "c93f11a7-52c6-4379-a1fb-9a002876c221", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-985502177-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "054575d3dc66452091173b4c604b8c96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap325d11f4-b8", "ovs_interfaceid": "325d11f4-b841-44c8-8a19-bdccb1d8cfd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 17 01:31:59 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-b73b6c52-c647-4899-83d6-873a46fe4c5b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Converting VIF {"id": "325d11f4-b841-44c8-8a19-bdccb1d8cfd1", "address": "fa:16:3e:06:46:c3", "network": {"id": "c93f11a7-52c6-4379-a1fb-9a002876c221", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-985502177-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "054575d3dc66452091173b4c604b8c96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap325d11f4-b8", "ovs_interfaceid": "325d11f4-b841-44c8-8a19-bdccb1d8cfd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:31:59 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-b73b6c52-c647-4899-83d6-873a46fe4c5b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:46:c3,bridge_name='br-int',has_traffic_filtering=True,id=325d11f4-b841-44c8-8a19-bdccb1d8cfd1,network=Network(c93f11a7-52c6-4379-a1fb-9a002876c221),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap325d11f4-b8') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:31:59 user nova-compute[75226]: DEBUG os_vif [None req-b73b6c52-c647-4899-83d6-873a46fe4c5b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:46:c3,bridge_name='br-int',has_traffic_filtering=True,id=325d11f4-b841-44c8-8a19-bdccb1d8cfd1,network=Network(c93f11a7-52c6-4379-a1fb-9a002876c221),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap325d11f4-b8') {{(pid=75226) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 17 01:31:59 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:31:59 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:31:59 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 17 01:31:59 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:31:59 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4cc8bb85-5298-5d75-9d6d-d1e6dc84781f', '_type': 'linux-noop'}}, row=False) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:31:59 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:31:59 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:31:59 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:31:59 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap325d11f4-b8, may_exist=True, interface_attrs={}) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:31:59 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap325d11f4-b8, col_values=(('qos', UUID('78d36c24-6151-4510-9c4e-c73ef482e979')),), if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:31:59 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap325d11f4-b8, col_values=(('external_ids', {'iface-id': '325d11f4-b841-44c8-8a19-bdccb1d8cfd1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:06:46:c3', 'vm-uuid': 'c11fbffa-07e2-40c4-92b1-8531dbe8b687'}),), if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:31:59 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:31:59 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:31:59 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:31:59 user nova-compute[75226]: INFO os_vif [None req-b73b6c52-c647-4899-83d6-873a46fe4c5b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:46:c3,bridge_name='br-int',has_traffic_filtering=True,id=325d11f4-b841-44c8-8a19-bdccb1d8cfd1,network=Network(c93f11a7-52c6-4379-a1fb-9a002876c221),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap325d11f4-b8')
Nov 17 01:31:59 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-b73b6c52-c647-4899-83d6-873a46fe4c5b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] No BDM found with device name vda, not building metadata. {{(pid=75226) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 01:31:59 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-b73b6c52-c647-4899-83d6-873a46fe4c5b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] No VIF found with MAC fa:16:3e:06:46:c3, not building metadata {{(pid=75226) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 01:32:00 user nova-compute[75226]: DEBUG nova.network.neutron [req-01581176-6e89-4361-85e4-db1bb7768533 req-35d6d95a-a67e-4cbe-ad6e-88cd34d8e673 service nova] [instance: c11fbffa-07e2-40c4-92b1-8531dbe8b687] Updated VIF entry in instance network info cache for port 325d11f4-b841-44c8-8a19-bdccb1d8cfd1. {{(pid=75226) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 01:32:00 user nova-compute[75226]: DEBUG nova.network.neutron [req-01581176-6e89-4361-85e4-db1bb7768533 req-35d6d95a-a67e-4cbe-ad6e-88cd34d8e673 service nova] [instance: c11fbffa-07e2-40c4-92b1-8531dbe8b687] Updating instance_info_cache with network_info: [{"id": "325d11f4-b841-44c8-8a19-bdccb1d8cfd1", "address": "fa:16:3e:06:46:c3", "network": {"id": "c93f11a7-52c6-4379-a1fb-9a002876c221", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-985502177-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "054575d3dc66452091173b4c604b8c96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap325d11f4-b8", "ovs_interfaceid": "325d11f4-b841-44c8-8a19-bdccb1d8cfd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:32:00 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-01581176-6e89-4361-85e4-db1bb7768533 req-35d6d95a-a67e-4cbe-ad6e-88cd34d8e673 service nova] Releasing lock "refresh_cache-c11fbffa-07e2-40c4-92b1-8531dbe8b687" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:32:01 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:32:01 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:32:01 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:32:01 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:32:01 user nova-compute[75226]: DEBUG nova.compute.manager [req-7f11d4d3-6340-48ed-bfea-e619c5dd9073 req-a8c53c1b-ac77-4341-a9fa-8878cb8b4116 service nova] [instance: c11fbffa-07e2-40c4-92b1-8531dbe8b687] Received event network-vif-plugged-325d11f4-b841-44c8-8a19-bdccb1d8cfd1 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:32:01 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-7f11d4d3-6340-48ed-bfea-e619c5dd9073 req-a8c53c1b-ac77-4341-a9fa-8878cb8b4116 service nova] Acquiring lock "c11fbffa-07e2-40c4-92b1-8531dbe8b687-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:32:01 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-7f11d4d3-6340-48ed-bfea-e619c5dd9073 req-a8c53c1b-ac77-4341-a9fa-8878cb8b4116 service nova] Lock "c11fbffa-07e2-40c4-92b1-8531dbe8b687-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:32:01 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-7f11d4d3-6340-48ed-bfea-e619c5dd9073 req-a8c53c1b-ac77-4341-a9fa-8878cb8b4116 service nova] Lock "c11fbffa-07e2-40c4-92b1-8531dbe8b687-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:32:01 user nova-compute[75226]: DEBUG nova.compute.manager [req-7f11d4d3-6340-48ed-bfea-e619c5dd9073 req-a8c53c1b-ac77-4341-a9fa-8878cb8b4116 service nova] [instance: c11fbffa-07e2-40c4-92b1-8531dbe8b687] No waiting events found dispatching network-vif-plugged-325d11f4-b841-44c8-8a19-bdccb1d8cfd1 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:32:01 user nova-compute[75226]: WARNING nova.compute.manager [req-7f11d4d3-6340-48ed-bfea-e619c5dd9073 req-a8c53c1b-ac77-4341-a9fa-8878cb8b4116 service nova] [instance: c11fbffa-07e2-40c4-92b1-8531dbe8b687] Received unexpected event network-vif-plugged-325d11f4-b841-44c8-8a19-bdccb1d8cfd1 for instance with vm_state building and task_state spawning.
Nov 17 01:32:01 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:32:01 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:32:01 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:32:01 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:32:03 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:32:03 user nova-compute[75226]: DEBUG nova.compute.manager [None req-b73b6c52-c647-4899-83d6-873a46fe4c5b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] [instance: c11fbffa-07e2-40c4-92b1-8531dbe8b687] Instance event wait completed in 0 seconds for  {{(pid=75226) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 17 01:32:03 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-b73b6c52-c647-4899-83d6-873a46fe4c5b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] [instance: c11fbffa-07e2-40c4-92b1-8531dbe8b687] Guest created on hypervisor {{(pid=75226) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 17 01:32:03 user nova-compute[75226]: INFO nova.virt.libvirt.driver [-] [instance: c11fbffa-07e2-40c4-92b1-8531dbe8b687] Instance spawned successfully.
Nov 17 01:32:03 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-b73b6c52-c647-4899-83d6-873a46fe4c5b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] [instance: c11fbffa-07e2-40c4-92b1-8531dbe8b687] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 17 01:32:03 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-b73b6c52-c647-4899-83d6-873a46fe4c5b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] [instance: c11fbffa-07e2-40c4-92b1-8531dbe8b687] Found default for hw_cdrom_bus of ide {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:32:03 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-b73b6c52-c647-4899-83d6-873a46fe4c5b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] [instance: c11fbffa-07e2-40c4-92b1-8531dbe8b687] Found default for hw_disk_bus of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:32:03 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-b73b6c52-c647-4899-83d6-873a46fe4c5b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] [instance: c11fbffa-07e2-40c4-92b1-8531dbe8b687] Found default for hw_input_bus of None {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:32:03 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-b73b6c52-c647-4899-83d6-873a46fe4c5b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] [instance: c11fbffa-07e2-40c4-92b1-8531dbe8b687] Found default for hw_pointer_model of None {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:32:03 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-b73b6c52-c647-4899-83d6-873a46fe4c5b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] [instance: c11fbffa-07e2-40c4-92b1-8531dbe8b687] Found default for hw_video_model of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:32:03 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-b73b6c52-c647-4899-83d6-873a46fe4c5b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] [instance: c11fbffa-07e2-40c4-92b1-8531dbe8b687] Found default for hw_vif_model of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:32:03 user nova-compute[75226]: INFO nova.compute.manager [None req-b73b6c52-c647-4899-83d6-873a46fe4c5b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] [instance: c11fbffa-07e2-40c4-92b1-8531dbe8b687] Took 5.35 seconds to spawn the instance on the hypervisor.
Nov 17 01:32:03 user nova-compute[75226]: DEBUG nova.compute.manager [None req-b73b6c52-c647-4899-83d6-873a46fe4c5b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] [instance: c11fbffa-07e2-40c4-92b1-8531dbe8b687] Checking state {{(pid=75226) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 01:32:03 user nova-compute[75226]: DEBUG nova.compute.manager [req-0b1a7755-863f-4000-8e5b-1cf213658986 req-a5c9488d-ebac-47d9-ba1c-fdeb83428767 service nova] [instance: c11fbffa-07e2-40c4-92b1-8531dbe8b687] Received event network-vif-plugged-325d11f4-b841-44c8-8a19-bdccb1d8cfd1 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:32:03 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-0b1a7755-863f-4000-8e5b-1cf213658986 req-a5c9488d-ebac-47d9-ba1c-fdeb83428767 service nova] Acquiring lock "c11fbffa-07e2-40c4-92b1-8531dbe8b687-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:32:03 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-0b1a7755-863f-4000-8e5b-1cf213658986 req-a5c9488d-ebac-47d9-ba1c-fdeb83428767 service nova] Lock "c11fbffa-07e2-40c4-92b1-8531dbe8b687-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:32:03 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-0b1a7755-863f-4000-8e5b-1cf213658986 req-a5c9488d-ebac-47d9-ba1c-fdeb83428767 service nova] Lock "c11fbffa-07e2-40c4-92b1-8531dbe8b687-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:32:03 user nova-compute[75226]: DEBUG nova.compute.manager [req-0b1a7755-863f-4000-8e5b-1cf213658986 req-a5c9488d-ebac-47d9-ba1c-fdeb83428767 service nova] [instance: c11fbffa-07e2-40c4-92b1-8531dbe8b687] No waiting events found dispatching network-vif-plugged-325d11f4-b841-44c8-8a19-bdccb1d8cfd1 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:32:03 user nova-compute[75226]: WARNING nova.compute.manager [req-0b1a7755-863f-4000-8e5b-1cf213658986 req-a5c9488d-ebac-47d9-ba1c-fdeb83428767 service nova] [instance: c11fbffa-07e2-40c4-92b1-8531dbe8b687] Received unexpected event network-vif-plugged-325d11f4-b841-44c8-8a19-bdccb1d8cfd1 for instance with vm_state active and task_state None.
Nov 17 01:32:03 user nova-compute[75226]: INFO nova.compute.manager [None req-b73b6c52-c647-4899-83d6-873a46fe4c5b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] [instance: c11fbffa-07e2-40c4-92b1-8531dbe8b687] Took 6.11 seconds to build instance.
Nov 17 01:32:03 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-b73b6c52-c647-4899-83d6-873a46fe4c5b tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Lock "c11fbffa-07e2-40c4-92b1-8531dbe8b687" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.214s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:32:04 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:32:04 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:32:05 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:32:05 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:32:05 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:32:05 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:32:05 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:32:05 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75226) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 17 01:32:06 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa84e575-bdad-45b9-80ce-86b1c2826fb0/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:32:06 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa84e575-bdad-45b9-80ce-86b1c2826fb0/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:32:06 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa84e575-bdad-45b9-80ce-86b1c2826fb0/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:32:06 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa84e575-bdad-45b9-80ce-86b1c2826fb0/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:32:06 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee2187c9-8620-4fd2-ad8a-a054cd8393f3/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:32:06 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee2187c9-8620-4fd2-ad8a-a054cd8393f3/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:32:06 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee2187c9-8620-4fd2-ad8a-a054cd8393f3/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:32:06 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee2187c9-8620-4fd2-ad8a-a054cd8393f3/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:32:06 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75226) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 01:32:06 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6555d72-6094-4ea9-b071-a3d3c8a300a9/disk.rescue --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:32:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6555d72-6094-4ea9-b071-a3d3c8a300a9/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:32:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6555d72-6094-4ea9-b071-a3d3c8a300a9/disk.rescue --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:32:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6555d72-6094-4ea9-b071-a3d3c8a300a9/disk.rescue --force-share --output=json" returned: 0 in 0.211s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:32:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6555d72-6094-4ea9-b071-a3d3c8a300a9/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:32:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6555d72-6094-4ea9-b071-a3d3c8a300a9/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:32:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6555d72-6094-4ea9-b071-a3d3c8a300a9/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:32:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6555d72-6094-4ea9-b071-a3d3c8a300a9/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:32:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dae5490b-e434-4cd1-b8d4-6baab9bb7345/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:32:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dae5490b-e434-4cd1-b8d4-6baab9bb7345/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:32:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dae5490b-e434-4cd1-b8d4-6baab9bb7345/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:32:08 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:32:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dae5490b-e434-4cd1-b8d4-6baab9bb7345/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:32:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38062487-67ca-4962-974f-81456aebe97b/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:32:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38062487-67ca-4962-974f-81456aebe97b/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:32:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38062487-67ca-4962-974f-81456aebe97b/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:32:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38062487-67ca-4962-974f-81456aebe97b/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:32:08 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75226) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 01:32:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c280142-8901-4f83-bde4-baaa097e05b0/disk.rescue --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:32:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c280142-8901-4f83-bde4-baaa097e05b0/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:32:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c280142-8901-4f83-bde4-baaa097e05b0/disk.rescue --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:32:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c280142-8901-4f83-bde4-baaa097e05b0/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:32:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c280142-8901-4f83-bde4-baaa097e05b0/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:32:09 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c280142-8901-4f83-bde4-baaa097e05b0/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:32:09 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c280142-8901-4f83-bde4-baaa097e05b0/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:32:09 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c280142-8901-4f83-bde4-baaa097e05b0/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:32:09 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4050d898-f2b8-46c2-86e3-702ceb41a701/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:32:09 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4050d898-f2b8-46c2-86e3-702ceb41a701/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:32:09 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4050d898-f2b8-46c2-86e3-702ceb41a701/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:32:09 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4050d898-f2b8-46c2-86e3-702ceb41a701/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:32:09 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ea5a14b-c330-4a2b-926e-60e1b30f5981/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:32:09 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ea5a14b-c330-4a2b-926e-60e1b30f5981/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:32:09 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ea5a14b-c330-4a2b-926e-60e1b30f5981/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:32:09 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:32:09 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ea5a14b-c330-4a2b-926e-60e1b30f5981/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:32:09 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75226) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 01:32:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3018e3a2-01e0-49d7-a960-51718709845a/disk.rescue --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:32:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3018e3a2-01e0-49d7-a960-51718709845a/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:32:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3018e3a2-01e0-49d7-a960-51718709845a/disk.rescue --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:32:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3018e3a2-01e0-49d7-a960-51718709845a/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:32:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c11fbffa-07e2-40c4-92b1-8531dbe8b687/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:32:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c11fbffa-07e2-40c4-92b1-8531dbe8b687/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:32:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c11fbffa-07e2-40c4-92b1-8531dbe8b687/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:32:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c11fbffa-07e2-40c4-92b1-8531dbe8b687/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:32:11 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:32:11 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:32:11 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Hypervisor/Node resource view: name=user free_ram=7659MB free_disk=24.846477508544922GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75226) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 17 01:32:11 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:32:11 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:32:11 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance aa84e575-bdad-45b9-80ce-86b1c2826fb0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:32:11 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 6b7e9611-be35-4e51-b886-91a2fac0a653 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:32:11 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 38062487-67ca-4962-974f-81456aebe97b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:32:11 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 4050d898-f2b8-46c2-86e3-702ceb41a701 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:32:11 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 2ea5a14b-c330-4a2b-926e-60e1b30f5981 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:32:11 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance d6555d72-6094-4ea9-b071-a3d3c8a300a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:32:11 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 5c280142-8901-4f83-bde4-baaa097e05b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:32:11 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance ee2187c9-8620-4fd2-ad8a-a054cd8393f3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:32:11 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 3018e3a2-01e0-49d7-a960-51718709845a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:32:11 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance dae5490b-e434-4cd1-b8d4-6baab9bb7345 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:32:11 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance c11fbffa-07e2-40c4-92b1-8531dbe8b687 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:32:11 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75226) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 17 01:32:11 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75226) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 17 01:32:11 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:32:11 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:32:11 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Compute_service record updated for user:user {{(pid=75226) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 17 01:32:11 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.504s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:32:12 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:32:12 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:32:12 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:32:12 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:32:13 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:32:14 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:32:14 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:32:14 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75226) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 17 01:32:15 user nova-compute[75226]: INFO nova.compute.manager [None req-e7379d52-af8a-4422-9e3f-7e88a19421e0 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] [instance: d6555d72-6094-4ea9-b071-a3d3c8a300a9] Unrescuing
Nov 17 01:32:15 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e7379d52-af8a-4422-9e3f-7e88a19421e0 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Acquiring lock "refresh_cache-d6555d72-6094-4ea9-b071-a3d3c8a300a9" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:32:15 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e7379d52-af8a-4422-9e3f-7e88a19421e0 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Acquired lock "refresh_cache-d6555d72-6094-4ea9-b071-a3d3c8a300a9" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:32:15 user nova-compute[75226]: DEBUG nova.network.neutron [None req-e7379d52-af8a-4422-9e3f-7e88a19421e0 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] [instance: d6555d72-6094-4ea9-b071-a3d3c8a300a9] Building network info cache for instance {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 01:32:16 user nova-compute[75226]: DEBUG nova.network.neutron [None req-e7379d52-af8a-4422-9e3f-7e88a19421e0 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] [instance: d6555d72-6094-4ea9-b071-a3d3c8a300a9] Updating instance_info_cache with network_info: [{"id": "1315a3d4-9d0a-4a65-8044-45959bf1f754", "address": "fa:16:3e:83:57:31", "network": {"id": "a9710b94-56f8-4cf6-9bb6-344b275e5bf2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-512340839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2052a37a068e4d948c57560c0f4445e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1315a3d4-9d", "ovs_interfaceid": "1315a3d4-9d0a-4a65-8044-45959bf1f754", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:32:16 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e7379d52-af8a-4422-9e3f-7e88a19421e0 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Releasing lock "refresh_cache-d6555d72-6094-4ea9-b071-a3d3c8a300a9" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:32:16 user nova-compute[75226]: DEBUG nova.objects.instance [None req-e7379d52-af8a-4422-9e3f-7e88a19421e0 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Lazy-loading 'flavor' on Instance uuid d6555d72-6094-4ea9-b071-a3d3c8a300a9 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:32:16 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:32:16 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:32:16 user nova-compute[75226]: DEBUG nova.compute.manager [req-8289230b-5260-41a8-977d-fd0db647a1de req-59ccae47-569c-4d6a-9509-0cc8e5294310 service nova] [instance: d6555d72-6094-4ea9-b071-a3d3c8a300a9] Received event network-vif-unplugged-1315a3d4-9d0a-4a65-8044-45959bf1f754 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:32:16 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-8289230b-5260-41a8-977d-fd0db647a1de req-59ccae47-569c-4d6a-9509-0cc8e5294310 service nova] Acquiring lock "d6555d72-6094-4ea9-b071-a3d3c8a300a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:32:16 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-8289230b-5260-41a8-977d-fd0db647a1de req-59ccae47-569c-4d6a-9509-0cc8e5294310 service nova] Lock "d6555d72-6094-4ea9-b071-a3d3c8a300a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:32:16 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-8289230b-5260-41a8-977d-fd0db647a1de req-59ccae47-569c-4d6a-9509-0cc8e5294310 service nova] Lock "d6555d72-6094-4ea9-b071-a3d3c8a300a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:32:16 user nova-compute[75226]: DEBUG nova.compute.manager [req-8289230b-5260-41a8-977d-fd0db647a1de req-59ccae47-569c-4d6a-9509-0cc8e5294310 service nova] [instance: d6555d72-6094-4ea9-b071-a3d3c8a300a9] No waiting events found dispatching network-vif-unplugged-1315a3d4-9d0a-4a65-8044-45959bf1f754 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:32:16 user nova-compute[75226]: WARNING nova.compute.manager [req-8289230b-5260-41a8-977d-fd0db647a1de req-59ccae47-569c-4d6a-9509-0cc8e5294310 service nova] [instance: d6555d72-6094-4ea9-b071-a3d3c8a300a9] Received unexpected event network-vif-unplugged-1315a3d4-9d0a-4a65-8044-45959bf1f754 for instance with vm_state rescued and task_state unrescuing.
Nov 17 01:32:16 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:32:16 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:32:16 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:32:16 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Starting heal instance info cache {{(pid=75226) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 17 01:32:17 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "refresh_cache-38062487-67ca-4962-974f-81456aebe97b" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:32:17 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquired lock "refresh_cache-38062487-67ca-4962-974f-81456aebe97b" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:32:17 user nova-compute[75226]: DEBUG nova.network.neutron [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] [instance: 38062487-67ca-4962-974f-81456aebe97b] Forcefully refreshing network info cache for instance {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 17 01:32:17 user nova-compute[75226]: INFO nova.virt.libvirt.driver [-] [instance: d6555d72-6094-4ea9-b071-a3d3c8a300a9] Instance destroyed successfully.
Nov 17 01:32:17 user nova-compute[75226]: DEBUG nova.network.neutron [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] [instance: 38062487-67ca-4962-974f-81456aebe97b] Updating instance_info_cache with network_info: [{"id": "b4bb80f3-212b-41bf-94a3-442865a852c7", "address": "fa:16:3e:ef:fd:97", "network": {"id": "9f39d3e5-b106-4bd9-b8ba-0f326e89c481", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-675861281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9042fe4ecc245dd97553f6e942c3e05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4bb80f3-21", "ovs_interfaceid": "b4bb80f3-212b-41bf-94a3-442865a852c7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:32:17 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Releasing lock "refresh_cache-38062487-67ca-4962-974f-81456aebe97b" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:32:17 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] [instance: 38062487-67ca-4962-974f-81456aebe97b] Updated the network info_cache for instance {{(pid=75226) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 17 01:32:18 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:32:18 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:32:18 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:32:18 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:32:18 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:32:18 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:32:18 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:32:18 user nova-compute[75226]: DEBUG nova.compute.manager [req-57291047-e112-4fe6-a648-06f4ec4682b7 req-7b6315e3-1afd-41e3-b736-a128da2b39f0 service nova] [instance: d6555d72-6094-4ea9-b071-a3d3c8a300a9] Received event network-vif-plugged-1315a3d4-9d0a-4a65-8044-45959bf1f754 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:32:18 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-57291047-e112-4fe6-a648-06f4ec4682b7 req-7b6315e3-1afd-41e3-b736-a128da2b39f0 service nova] Acquiring lock "d6555d72-6094-4ea9-b071-a3d3c8a300a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:32:18 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-57291047-e112-4fe6-a648-06f4ec4682b7 req-7b6315e3-1afd-41e3-b736-a128da2b39f0 service nova] Lock "d6555d72-6094-4ea9-b071-a3d3c8a300a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:32:18 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-57291047-e112-4fe6-a648-06f4ec4682b7 req-7b6315e3-1afd-41e3-b736-a128da2b39f0 service nova] Lock "d6555d72-6094-4ea9-b071-a3d3c8a300a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:32:18 user nova-compute[75226]: DEBUG nova.compute.manager [req-57291047-e112-4fe6-a648-06f4ec4682b7 req-7b6315e3-1afd-41e3-b736-a128da2b39f0 service nova] [instance: d6555d72-6094-4ea9-b071-a3d3c8a300a9] No waiting events found dispatching network-vif-plugged-1315a3d4-9d0a-4a65-8044-45959bf1f754 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:32:18 user nova-compute[75226]: WARNING nova.compute.manager [req-57291047-e112-4fe6-a648-06f4ec4682b7 req-7b6315e3-1afd-41e3-b736-a128da2b39f0 service nova] [instance: d6555d72-6094-4ea9-b071-a3d3c8a300a9] Received unexpected event network-vif-plugged-1315a3d4-9d0a-4a65-8044-45959bf1f754 for instance with vm_state rescued and task_state unrescuing.
Nov 17 01:32:19 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:32:20 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e7379d52-af8a-4422-9e3f-7e88a19421e0 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] [instance: d6555d72-6094-4ea9-b071-a3d3c8a300a9] Checking state {{(pid=75226) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 01:32:20 user nova-compute[75226]: DEBUG nova.compute.manager [req-bca001f2-b8c6-435b-9993-99a59af20c8c req-6dcb4b2b-1bb2-4dae-8386-00517e1c4fe4 service nova] [instance: d6555d72-6094-4ea9-b071-a3d3c8a300a9] Received event network-vif-plugged-1315a3d4-9d0a-4a65-8044-45959bf1f754 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:32:20 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-bca001f2-b8c6-435b-9993-99a59af20c8c req-6dcb4b2b-1bb2-4dae-8386-00517e1c4fe4 service nova] Acquiring lock "d6555d72-6094-4ea9-b071-a3d3c8a300a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:32:20 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-bca001f2-b8c6-435b-9993-99a59af20c8c req-6dcb4b2b-1bb2-4dae-8386-00517e1c4fe4 service nova] Lock "d6555d72-6094-4ea9-b071-a3d3c8a300a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:32:20 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-bca001f2-b8c6-435b-9993-99a59af20c8c req-6dcb4b2b-1bb2-4dae-8386-00517e1c4fe4 service nova] Lock "d6555d72-6094-4ea9-b071-a3d3c8a300a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:32:20 user nova-compute[75226]: DEBUG nova.compute.manager [req-bca001f2-b8c6-435b-9993-99a59af20c8c req-6dcb4b2b-1bb2-4dae-8386-00517e1c4fe4 service nova] [instance: d6555d72-6094-4ea9-b071-a3d3c8a300a9] No waiting events found dispatching network-vif-plugged-1315a3d4-9d0a-4a65-8044-45959bf1f754 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:32:20 user nova-compute[75226]: WARNING nova.compute.manager [req-bca001f2-b8c6-435b-9993-99a59af20c8c req-6dcb4b2b-1bb2-4dae-8386-00517e1c4fe4 service nova] [instance: d6555d72-6094-4ea9-b071-a3d3c8a300a9] Received unexpected event network-vif-plugged-1315a3d4-9d0a-4a65-8044-45959bf1f754 for instance with vm_state active and task_state None.
Nov 17 01:32:20 user nova-compute[75226]: DEBUG nova.compute.manager [req-bca001f2-b8c6-435b-9993-99a59af20c8c req-6dcb4b2b-1bb2-4dae-8386-00517e1c4fe4 service nova] [instance: d6555d72-6094-4ea9-b071-a3d3c8a300a9] Received event network-vif-plugged-1315a3d4-9d0a-4a65-8044-45959bf1f754 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:32:20 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-bca001f2-b8c6-435b-9993-99a59af20c8c req-6dcb4b2b-1bb2-4dae-8386-00517e1c4fe4 service nova] Acquiring lock "d6555d72-6094-4ea9-b071-a3d3c8a300a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:32:20 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-bca001f2-b8c6-435b-9993-99a59af20c8c req-6dcb4b2b-1bb2-4dae-8386-00517e1c4fe4 service nova] Lock "d6555d72-6094-4ea9-b071-a3d3c8a300a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:32:20 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-bca001f2-b8c6-435b-9993-99a59af20c8c req-6dcb4b2b-1bb2-4dae-8386-00517e1c4fe4 service nova] Lock "d6555d72-6094-4ea9-b071-a3d3c8a300a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:32:20 user nova-compute[75226]: DEBUG nova.compute.manager [req-bca001f2-b8c6-435b-9993-99a59af20c8c req-6dcb4b2b-1bb2-4dae-8386-00517e1c4fe4 service nova] [instance: d6555d72-6094-4ea9-b071-a3d3c8a300a9] No waiting events found dispatching network-vif-plugged-1315a3d4-9d0a-4a65-8044-45959bf1f754 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:32:20 user nova-compute[75226]: WARNING nova.compute.manager [req-bca001f2-b8c6-435b-9993-99a59af20c8c req-6dcb4b2b-1bb2-4dae-8386-00517e1c4fe4 service nova] [instance: d6555d72-6094-4ea9-b071-a3d3c8a300a9] Received unexpected event network-vif-plugged-1315a3d4-9d0a-4a65-8044-45959bf1f754 for instance with vm_state active and task_state None.
Nov 17 01:32:23 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:32:24 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:32:28 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:32:29 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:32:33 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:32:34 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:32:38 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:32:39 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:32:43 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:32:44 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:32:48 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:32:49 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:32:53 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:32:54 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:32:56 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-78f13820-9cc6-4dcf-9665-e163c351fec1 tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Acquiring lock "ee2187c9-8620-4fd2-ad8a-a054cd8393f3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:32:56 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-78f13820-9cc6-4dcf-9665-e163c351fec1 tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Lock "ee2187c9-8620-4fd2-ad8a-a054cd8393f3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:32:56 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-78f13820-9cc6-4dcf-9665-e163c351fec1 tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Acquiring lock "ee2187c9-8620-4fd2-ad8a-a054cd8393f3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:32:56 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-78f13820-9cc6-4dcf-9665-e163c351fec1 tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Lock "ee2187c9-8620-4fd2-ad8a-a054cd8393f3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:32:56 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-78f13820-9cc6-4dcf-9665-e163c351fec1 tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Lock "ee2187c9-8620-4fd2-ad8a-a054cd8393f3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:32:56 user nova-compute[75226]: INFO nova.compute.manager [None req-78f13820-9cc6-4dcf-9665-e163c351fec1 tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] [instance: ee2187c9-8620-4fd2-ad8a-a054cd8393f3] Terminating instance
Nov 17 01:32:56 user nova-compute[75226]: DEBUG nova.compute.manager [None req-78f13820-9cc6-4dcf-9665-e163c351fec1 tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] [instance: ee2187c9-8620-4fd2-ad8a-a054cd8393f3] Start destroying the instance on the hypervisor. {{(pid=75226) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 17 01:32:56 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:32:56 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:32:56 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:32:56 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:32:56 user nova-compute[75226]: DEBUG nova.compute.manager [req-a88d7186-f3fb-4c6d-b429-5f0ab2cd01e4 req-235c92fd-7b95-4a78-9682-32fbaa3ccf9f service nova] [instance: ee2187c9-8620-4fd2-ad8a-a054cd8393f3] Received event network-vif-unplugged-1057ea4c-2ac4-40fa-8b2e-3b5888ea4d61 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:32:56 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-a88d7186-f3fb-4c6d-b429-5f0ab2cd01e4 req-235c92fd-7b95-4a78-9682-32fbaa3ccf9f service nova] Acquiring lock "ee2187c9-8620-4fd2-ad8a-a054cd8393f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:32:56 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-a88d7186-f3fb-4c6d-b429-5f0ab2cd01e4 req-235c92fd-7b95-4a78-9682-32fbaa3ccf9f service nova] Lock "ee2187c9-8620-4fd2-ad8a-a054cd8393f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:32:56 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-a88d7186-f3fb-4c6d-b429-5f0ab2cd01e4 req-235c92fd-7b95-4a78-9682-32fbaa3ccf9f service nova] Lock "ee2187c9-8620-4fd2-ad8a-a054cd8393f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:32:56 user nova-compute[75226]: DEBUG nova.compute.manager [req-a88d7186-f3fb-4c6d-b429-5f0ab2cd01e4 req-235c92fd-7b95-4a78-9682-32fbaa3ccf9f service nova] [instance: ee2187c9-8620-4fd2-ad8a-a054cd8393f3] No waiting events found dispatching network-vif-unplugged-1057ea4c-2ac4-40fa-8b2e-3b5888ea4d61 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:32:56 user nova-compute[75226]: DEBUG nova.compute.manager [req-a88d7186-f3fb-4c6d-b429-5f0ab2cd01e4 req-235c92fd-7b95-4a78-9682-32fbaa3ccf9f service nova] [instance: ee2187c9-8620-4fd2-ad8a-a054cd8393f3] Received event network-vif-unplugged-1057ea4c-2ac4-40fa-8b2e-3b5888ea4d61 for instance with task_state deleting. {{(pid=75226) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 17 01:32:56 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:32:57 user nova-compute[75226]: INFO nova.virt.libvirt.driver [-] [instance: ee2187c9-8620-4fd2-ad8a-a054cd8393f3] Instance destroyed successfully.
Nov 17 01:32:57 user nova-compute[75226]: DEBUG nova.objects.instance [None req-78f13820-9cc6-4dcf-9665-e163c351fec1 tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Lazy-loading 'resources' on Instance uuid ee2187c9-8620-4fd2-ad8a-a054cd8393f3 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:32:57 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-78f13820-9cc6-4dcf-9665-e163c351fec1 tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:24:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1878692867',display_name='tempest-ServerActionsTestOtherB-server-1878692867',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1878692867',id=21,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBTPdFaRxKgPkRdKbUEvHAZcoj+dPC43zryXBmo0q5ihjaLD04DW9eJSP+KLH1T/XkmERKqJKOvG49EB5qtvQ6Fib4lL66B3axWTUVDvaaC20Rh3bH2XA1pGQ2EKVxiHfg==',key_name='tempest-keypair-1901957685',keypairs=<?>,launch_index=0,launched_at=2023-11-17T01:30:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c19f767dc7bb4024b3cbf1d8f5f8f2bf',ramdisk_id='',reservation_id='r-p9pzzoi2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-229085712',owner_user_name='tempest-ServerActionsTestOtherB-229085712-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T01:30:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f0952a7e2dd64bf2adb2e224965377ab',uuid=ee2187c9-8620-4fd2-ad8a-a054cd8393f3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1057ea4c-2ac4-40fa-8b2e-3b5888ea4d61", "address": "fa:16:3e:4a:f5:8f", "network": {"id": "3d8c3322-c78d-4d3a-b8c7-ba12241b4c65", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1996535656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c19f767dc7bb4024b3cbf1d8f5f8f2bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1057ea4c-2a", "ovs_interfaceid": "1057ea4c-2ac4-40fa-8b2e-3b5888ea4d61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 17 01:32:57 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-78f13820-9cc6-4dcf-9665-e163c351fec1 tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Converting VIF {"id": "1057ea4c-2ac4-40fa-8b2e-3b5888ea4d61", "address": "fa:16:3e:4a:f5:8f", "network": {"id": "3d8c3322-c78d-4d3a-b8c7-ba12241b4c65", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1996535656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c19f767dc7bb4024b3cbf1d8f5f8f2bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1057ea4c-2a", "ovs_interfaceid": "1057ea4c-2ac4-40fa-8b2e-3b5888ea4d61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:32:57 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-78f13820-9cc6-4dcf-9665-e163c351fec1 tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:f5:8f,bridge_name='br-int',has_traffic_filtering=True,id=1057ea4c-2ac4-40fa-8b2e-3b5888ea4d61,network=Network(3d8c3322-c78d-4d3a-b8c7-ba12241b4c65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1057ea4c-2a') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:32:57 user nova-compute[75226]: DEBUG os_vif [None req-78f13820-9cc6-4dcf-9665-e163c351fec1 tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:f5:8f,bridge_name='br-int',has_traffic_filtering=True,id=1057ea4c-2ac4-40fa-8b2e-3b5888ea4d61,network=Network(3d8c3322-c78d-4d3a-b8c7-ba12241b4c65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1057ea4c-2a') {{(pid=75226) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 17 01:32:57 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:32:57 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1057ea4c-2a, bridge=br-int, if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:32:57 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:32:57 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:32:57 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:32:57 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=12c928fa-2068-4c41-8a89-56d86cdff822) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:32:57 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:32:57 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:32:57 user nova-compute[75226]: INFO os_vif [None req-78f13820-9cc6-4dcf-9665-e163c351fec1 tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:f5:8f,bridge_name='br-int',has_traffic_filtering=True,id=1057ea4c-2ac4-40fa-8b2e-3b5888ea4d61,network=Network(3d8c3322-c78d-4d3a-b8c7-ba12241b4c65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1057ea4c-2a')
Nov 17 01:32:57 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-78f13820-9cc6-4dcf-9665-e163c351fec1 tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] [instance: ee2187c9-8620-4fd2-ad8a-a054cd8393f3] calling os-brick to detach iSCSI Volume {{(pid=75226) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 17 01:32:57 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f13820-9cc6-4dcf-9665-e163c351fec1 tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc4cc36b490>, {'target_iqn': 'iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qFQXscng', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:32:57 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-78f13820-9cc6-4dcf-9665-e163c351fec1 tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:32:57 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-78f13820-9cc6-4dcf-9665-e163c351fec1 tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:32:57 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-78f13820-9cc6-4dcf-9665-e163c351fec1 tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:32:57 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:32:57 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:32:57 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef3f7ee5-f04a-4b46-ba83-4fa6313df64b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:05f878e5-0241-4282-8b2c-c4651c429dcb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:32:57 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f13820-9cc6-4dcf-9665-e163c351fec1 tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 17 01:32:57 user nova-compute[75226]: No targets found.
Nov 17 01:32:57 user nova-compute[75226]: iSNS:
Nov 17 01:32:57 user nova-compute[75226]: No targets found.
Nov 17 01:32:57 user nova-compute[75226]: STATIC:
Nov 17 01:32:57 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba
Nov 17 01:32:57 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:32:57 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:32:57 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:05f878e5-0241-4282-8b2c-c4651c429dcb
Nov 17 01:32:57 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:32:57 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:32:57 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8
Nov 17 01:32:57 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:32:57 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:32:57 user nova-compute[75226]: FIRMWARE:
Nov 17 01:32:57 user nova-compute[75226]: No targets found.
Nov 17 01:32:57 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:32:57 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f13820-9cc6-4dcf-9665-e163c351fec1 tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 17 01:32:57 user nova-compute[75226]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 17 01:32:57 user nova-compute[75226]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75226) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 17 01:32:57 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f13820-9cc6-4dcf-9665-e163c351fec1 tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba', 0)] {{(pid=75226) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 17 01:32:57 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:32:57 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:32:57 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d0fafe2-cde1-44bd-963c-6d221bebd4f5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:05f878e5-0241-4282-8b2c-c4651c429dcb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:32:57 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:32:57 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:32:57 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4e43d6f-844e-4691-93dd-2b7ff5c52d8a]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05f878e5-0241-4282-8b2c-c4651c429dcb (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:32:57 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f13820-9cc6-4dcf-9665-e163c351fec1 tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)
Nov 17 01:32:57 user nova-compute[75226]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05f878e5-0241-4282-8b2c-c4651c429dcb (non-flash)
Nov 17 01:32:57 user nova-compute[75226]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba (non-flash)
Nov 17 01:32:57 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:32:57 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f13820-9cc6-4dcf-9665-e163c351fec1 tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)
Nov 17 01:32:57 user nova-compute[75226]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05f878e5-0241-4282-8b2c-c4651c429dcb (non-flash)
Nov 17 01:32:57 user nova-compute[75226]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba (non-flash)
Nov 17 01:32:57 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:32:57 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f13820-9cc6-4dcf-9665-e163c351fec1 tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc4b41ff5b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba'): ({'sdb'}, set())}) {{(pid=75226) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 17 01:32:57 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-78f13820-9cc6-4dcf-9665-e163c351fec1 tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Removing single pathed devices sdb {{(pid=75226) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 17 01:32:57 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:32:57 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:32:57 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c1080e6-5045-4ce8-936f-43537e872cfb]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:32:57 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:32:57 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:32:57 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdda0f6c-fca3-42ea-ac42-070874ba2c94]: (4, ('ok\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:32:57 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-78f13820-9cc6-4dcf-9665-e163c351fec1 tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Flushing IO for device /dev/sdb {{(pid=75226) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 17 01:32:57 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:32:57 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:32:57 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9faea25-e3a0-4196-8757-b461aff8ee29]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:32:57 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-78f13820-9cc6-4dcf-9665-e163c351fec1 tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75226) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 17 01:32:57 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:32:57 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:32:57 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[48db741b-e284-4c37-bb69-1dae866e47ea]: (4, ('1', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:32:57 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-78f13820-9cc6-4dcf-9665-e163c351fec1 tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75226) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 17 01:32:57 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-78f13820-9cc6-4dcf-9665-e163c351fec1 tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] SCSI volumes sdb have been removed. {{(pid=75226) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 17 01:32:57 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f13820-9cc6-4dcf-9665-e163c351fec1 tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba')] {{(pid=75226) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 17 01:32:57 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:32:57 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:32:57 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d821125-1cb2-45da-b7e7-b70057d96c31]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:32:57 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f13820-9cc6-4dcf-9665-e163c351fec1 tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:32:57 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba -p 172.16.0.220:3260 --logout {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:32:57 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba -p 172.16.0.220:3260 --logout" returned: 0 in 0.042s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:32:57 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[658ef246-fbd5-4432-b18f-c80b5f519f71]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:32:57 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f13820-9cc6-4dcf-9665-e163c351fec1 tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba, portal: 172.16.0.220,3260]
Nov 17 01:32:57 user nova-compute[75226]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba, portal: 172.16.0.220,3260] successful.
Nov 17 01:32:57 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:32:57 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba -p 172.16.0.220:3260 --op delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:32:57 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bdffe6a-77b2-4ed9-9d93-5e432bde62ba -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:32:57 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[e21edddf-6b1e-40be-bdfa-4accf841db04]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:32:57 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f13820-9cc6-4dcf-9665-e163c351fec1 tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:32:57 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-78f13820-9cc6-4dcf-9665-e163c351fec1 tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.288s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:32:57 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f13820-9cc6-4dcf-9665-e163c351fec1 tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] <== disconnect_volume: return (290ms) None {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:32:57 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-78f13820-9cc6-4dcf-9665-e163c351fec1 tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] [instance: ee2187c9-8620-4fd2-ad8a-a054cd8393f3] Disconnected iSCSI Volume {{(pid=75226) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 17 01:32:57 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-78f13820-9cc6-4dcf-9665-e163c351fec1 tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] [instance: ee2187c9-8620-4fd2-ad8a-a054cd8393f3] Deleting instance files /opt/stack/data/nova/instances/ee2187c9-8620-4fd2-ad8a-a054cd8393f3_del
Nov 17 01:32:57 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-78f13820-9cc6-4dcf-9665-e163c351fec1 tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] [instance: ee2187c9-8620-4fd2-ad8a-a054cd8393f3] Deletion of /opt/stack/data/nova/instances/ee2187c9-8620-4fd2-ad8a-a054cd8393f3_del complete
Nov 17 01:32:57 user nova-compute[75226]: INFO nova.compute.manager [None req-78f13820-9cc6-4dcf-9665-e163c351fec1 tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] [instance: ee2187c9-8620-4fd2-ad8a-a054cd8393f3] Took 1.18 seconds to destroy the instance on the hypervisor.
Nov 17 01:32:57 user nova-compute[75226]: DEBUG oslo.service.loopingcall [None req-78f13820-9cc6-4dcf-9665-e163c351fec1 tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75226) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 17 01:32:57 user nova-compute[75226]: DEBUG nova.compute.manager [-] [instance: ee2187c9-8620-4fd2-ad8a-a054cd8393f3] Deallocating network for instance {{(pid=75226) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 17 01:32:57 user nova-compute[75226]: DEBUG nova.network.neutron [-] [instance: ee2187c9-8620-4fd2-ad8a-a054cd8393f3] deallocate_for_instance() {{(pid=75226) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 17 01:32:58 user nova-compute[75226]: DEBUG nova.network.neutron [-] [instance: ee2187c9-8620-4fd2-ad8a-a054cd8393f3] Updating instance_info_cache with network_info: [] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:32:58 user nova-compute[75226]: INFO nova.compute.manager [-] [instance: ee2187c9-8620-4fd2-ad8a-a054cd8393f3] Took 0.79 seconds to deallocate network for instance.
Nov 17 01:32:58 user nova-compute[75226]: DEBUG nova.compute.manager [req-6bb052d8-e8a3-473a-b7e1-ef9c9b99e656 req-b7dffd17-e699-43b7-9ba9-a96eea24b372 service nova] [instance: ee2187c9-8620-4fd2-ad8a-a054cd8393f3] Received event network-vif-deleted-1057ea4c-2ac4-40fa-8b2e-3b5888ea4d61 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:32:58 user nova-compute[75226]: DEBUG nova.compute.manager [req-7fbd2870-f3a2-402a-a631-08a3d74f341d req-629191f5-f4ec-41c0-bc75-f0491834e9dc service nova] [instance: ee2187c9-8620-4fd2-ad8a-a054cd8393f3] Received event network-vif-plugged-1057ea4c-2ac4-40fa-8b2e-3b5888ea4d61 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:32:58 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-7fbd2870-f3a2-402a-a631-08a3d74f341d req-629191f5-f4ec-41c0-bc75-f0491834e9dc service nova] Acquiring lock "ee2187c9-8620-4fd2-ad8a-a054cd8393f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:32:58 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-7fbd2870-f3a2-402a-a631-08a3d74f341d req-629191f5-f4ec-41c0-bc75-f0491834e9dc service nova] Lock "ee2187c9-8620-4fd2-ad8a-a054cd8393f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:32:58 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-7fbd2870-f3a2-402a-a631-08a3d74f341d req-629191f5-f4ec-41c0-bc75-f0491834e9dc service nova] Lock "ee2187c9-8620-4fd2-ad8a-a054cd8393f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:32:58 user nova-compute[75226]: DEBUG nova.compute.manager [req-7fbd2870-f3a2-402a-a631-08a3d74f341d req-629191f5-f4ec-41c0-bc75-f0491834e9dc service nova] [instance: ee2187c9-8620-4fd2-ad8a-a054cd8393f3] No waiting events found dispatching network-vif-plugged-1057ea4c-2ac4-40fa-8b2e-3b5888ea4d61 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:32:58 user nova-compute[75226]: WARNING nova.compute.manager [req-7fbd2870-f3a2-402a-a631-08a3d74f341d req-629191f5-f4ec-41c0-bc75-f0491834e9dc service nova] [instance: ee2187c9-8620-4fd2-ad8a-a054cd8393f3] Received unexpected event network-vif-plugged-1057ea4c-2ac4-40fa-8b2e-3b5888ea4d61 for instance with vm_state active and task_state deleting.
Nov 17 01:32:59 user nova-compute[75226]: INFO nova.compute.manager [None req-78f13820-9cc6-4dcf-9665-e163c351fec1 tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] [instance: ee2187c9-8620-4fd2-ad8a-a054cd8393f3] Took 0.73 seconds to detach 1 volumes for instance.
Nov 17 01:32:59 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-78f13820-9cc6-4dcf-9665-e163c351fec1 tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:32:59 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-78f13820-9cc6-4dcf-9665-e163c351fec1 tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:32:59 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-78f13820-9cc6-4dcf-9665-e163c351fec1 tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:32:59 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-78f13820-9cc6-4dcf-9665-e163c351fec1 tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:32:59 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-78f13820-9cc6-4dcf-9665-e163c351fec1 tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.308s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:32:59 user nova-compute[75226]: INFO nova.scheduler.client.report [None req-78f13820-9cc6-4dcf-9665-e163c351fec1 tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Deleted allocations for instance ee2187c9-8620-4fd2-ad8a-a054cd8393f3
Nov 17 01:32:59 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-78f13820-9cc6-4dcf-9665-e163c351fec1 tempest-ServerActionsTestOtherB-229085712 tempest-ServerActionsTestOtherB-229085712-project-member] Lock "ee2187c9-8620-4fd2-ad8a-a054cd8393f3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.194s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:33:02 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:33:06 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:33:06 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:33:06 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:33:06 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:33:06 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:33:06 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:33:06 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:33:06 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:33:06 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75226) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 17 01:33:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa84e575-bdad-45b9-80ce-86b1c2826fb0/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:33:07 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:33:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa84e575-bdad-45b9-80ce-86b1c2826fb0/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:33:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa84e575-bdad-45b9-80ce-86b1c2826fb0/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:33:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa84e575-bdad-45b9-80ce-86b1c2826fb0/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:33:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6555d72-6094-4ea9-b071-a3d3c8a300a9/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:33:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6555d72-6094-4ea9-b071-a3d3c8a300a9/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:33:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6555d72-6094-4ea9-b071-a3d3c8a300a9/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:33:07 user nova-compute[75226]: INFO nova.compute.manager [None req-375f897a-3ec0-42a7-9623-41874c337831 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 3018e3a2-01e0-49d7-a960-51718709845a] Unrescuing
Nov 17 01:33:07 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-375f897a-3ec0-42a7-9623-41874c337831 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Acquiring lock "refresh_cache-3018e3a2-01e0-49d7-a960-51718709845a" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:33:07 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-375f897a-3ec0-42a7-9623-41874c337831 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Acquired lock "refresh_cache-3018e3a2-01e0-49d7-a960-51718709845a" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:33:07 user nova-compute[75226]: DEBUG nova.network.neutron [None req-375f897a-3ec0-42a7-9623-41874c337831 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 3018e3a2-01e0-49d7-a960-51718709845a] Building network info cache for instance {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 01:33:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6555d72-6094-4ea9-b071-a3d3c8a300a9/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:33:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dae5490b-e434-4cd1-b8d4-6baab9bb7345/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:33:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dae5490b-e434-4cd1-b8d4-6baab9bb7345/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:33:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dae5490b-e434-4cd1-b8d4-6baab9bb7345/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:33:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dae5490b-e434-4cd1-b8d4-6baab9bb7345/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:33:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38062487-67ca-4962-974f-81456aebe97b/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:33:08 user nova-compute[75226]: DEBUG nova.network.neutron [None req-375f897a-3ec0-42a7-9623-41874c337831 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 3018e3a2-01e0-49d7-a960-51718709845a] Updating instance_info_cache with network_info: [{"id": "f05fa2a1-b61b-4617-b895-8c75645bde94", "address": "fa:16:3e:0b:9b:f6", "network": {"id": "450540a3-ff7e-42fb-a0a6-808acd749943", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1503678778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6cb6f679ee4468d82cc7fb5d0f67be9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf05fa2a1-b6", "ovs_interfaceid": "f05fa2a1-b61b-4617-b895-8c75645bde94", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:33:08 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-375f897a-3ec0-42a7-9623-41874c337831 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Releasing lock "refresh_cache-3018e3a2-01e0-49d7-a960-51718709845a" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:33:08 user nova-compute[75226]: DEBUG nova.objects.instance [None req-375f897a-3ec0-42a7-9623-41874c337831 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Lazy-loading 'flavor' on Instance uuid 3018e3a2-01e0-49d7-a960-51718709845a {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:33:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38062487-67ca-4962-974f-81456aebe97b/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:33:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38062487-67ca-4962-974f-81456aebe97b/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:33:08 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:33:08 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:33:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38062487-67ca-4962-974f-81456aebe97b/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:33:08 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75226) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 01:33:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c280142-8901-4f83-bde4-baaa097e05b0/disk.rescue --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:33:08 user nova-compute[75226]: DEBUG nova.compute.manager [req-06957d4b-e374-4419-8c43-1fcb6b9edbdf req-0f468e1a-6019-415f-a797-d1d3108aaab6 service nova] [instance: 3018e3a2-01e0-49d7-a960-51718709845a] Received event network-vif-unplugged-f05fa2a1-b61b-4617-b895-8c75645bde94 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:33:08 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-06957d4b-e374-4419-8c43-1fcb6b9edbdf req-0f468e1a-6019-415f-a797-d1d3108aaab6 service nova] Acquiring lock "3018e3a2-01e0-49d7-a960-51718709845a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:33:08 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-06957d4b-e374-4419-8c43-1fcb6b9edbdf req-0f468e1a-6019-415f-a797-d1d3108aaab6 service nova] Lock "3018e3a2-01e0-49d7-a960-51718709845a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:33:08 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-06957d4b-e374-4419-8c43-1fcb6b9edbdf req-0f468e1a-6019-415f-a797-d1d3108aaab6 service nova] Lock "3018e3a2-01e0-49d7-a960-51718709845a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:33:08 user nova-compute[75226]: DEBUG nova.compute.manager [req-06957d4b-e374-4419-8c43-1fcb6b9edbdf req-0f468e1a-6019-415f-a797-d1d3108aaab6 service nova] [instance: 3018e3a2-01e0-49d7-a960-51718709845a] No waiting events found dispatching network-vif-unplugged-f05fa2a1-b61b-4617-b895-8c75645bde94 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:33:08 user nova-compute[75226]: WARNING nova.compute.manager [req-06957d4b-e374-4419-8c43-1fcb6b9edbdf req-0f468e1a-6019-415f-a797-d1d3108aaab6 service nova] [instance: 3018e3a2-01e0-49d7-a960-51718709845a] Received unexpected event network-vif-unplugged-f05fa2a1-b61b-4617-b895-8c75645bde94 for instance with vm_state rescued and task_state unrescuing.
Nov 17 01:33:08 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:33:08 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:33:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c280142-8901-4f83-bde4-baaa097e05b0/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:33:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c280142-8901-4f83-bde4-baaa097e05b0/disk.rescue --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:33:09 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c280142-8901-4f83-bde4-baaa097e05b0/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:33:09 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c280142-8901-4f83-bde4-baaa097e05b0/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:33:09 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:33:09 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:33:09 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:33:09 user nova-compute[75226]: INFO nova.virt.libvirt.driver [-] [instance: 3018e3a2-01e0-49d7-a960-51718709845a] Instance destroyed successfully.
Nov 17 01:33:09 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c280142-8901-4f83-bde4-baaa097e05b0/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:33:09 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c280142-8901-4f83-bde4-baaa097e05b0/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:33:09 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:33:09 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c280142-8901-4f83-bde4-baaa097e05b0/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:33:09 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4050d898-f2b8-46c2-86e3-702ceb41a701/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:33:09 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:33:09 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:33:09 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4050d898-f2b8-46c2-86e3-702ceb41a701/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:33:09 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4050d898-f2b8-46c2-86e3-702ceb41a701/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:33:09 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:33:09 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:33:09 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4050d898-f2b8-46c2-86e3-702ceb41a701/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:33:09 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ea5a14b-c330-4a2b-926e-60e1b30f5981/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:33:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ea5a14b-c330-4a2b-926e-60e1b30f5981/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:33:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ea5a14b-c330-4a2b-926e-60e1b30f5981/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:33:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ea5a14b-c330-4a2b-926e-60e1b30f5981/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:33:10 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:33:10 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:33:10 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:33:10 user nova-compute[75226]: DEBUG nova.compute.manager [req-3a3cac69-9872-4537-a58d-38e62849187b req-bfbde2a9-150c-41f0-b340-0914cf3111ca service nova] [instance: 3018e3a2-01e0-49d7-a960-51718709845a] Received event network-vif-plugged-f05fa2a1-b61b-4617-b895-8c75645bde94 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:33:10 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-3a3cac69-9872-4537-a58d-38e62849187b req-bfbde2a9-150c-41f0-b340-0914cf3111ca service nova] Acquiring lock "3018e3a2-01e0-49d7-a960-51718709845a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:33:10 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-3a3cac69-9872-4537-a58d-38e62849187b req-bfbde2a9-150c-41f0-b340-0914cf3111ca service nova] Lock "3018e3a2-01e0-49d7-a960-51718709845a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:33:10 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-3a3cac69-9872-4537-a58d-38e62849187b req-bfbde2a9-150c-41f0-b340-0914cf3111ca service nova] Lock "3018e3a2-01e0-49d7-a960-51718709845a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:33:10 user nova-compute[75226]: DEBUG nova.compute.manager [req-3a3cac69-9872-4537-a58d-38e62849187b req-bfbde2a9-150c-41f0-b340-0914cf3111ca service nova] [instance: 3018e3a2-01e0-49d7-a960-51718709845a] No waiting events found dispatching network-vif-plugged-f05fa2a1-b61b-4617-b895-8c75645bde94 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:33:10 user nova-compute[75226]: WARNING nova.compute.manager [req-3a3cac69-9872-4537-a58d-38e62849187b req-bfbde2a9-150c-41f0-b340-0914cf3111ca service nova] [instance: 3018e3a2-01e0-49d7-a960-51718709845a] Received unexpected event network-vif-plugged-f05fa2a1-b61b-4617-b895-8c75645bde94 for instance with vm_state rescued and task_state unrescuing.
Nov 17 01:33:10 user nova-compute[75226]: DEBUG nova.compute.manager [req-3a3cac69-9872-4537-a58d-38e62849187b req-bfbde2a9-150c-41f0-b340-0914cf3111ca service nova] [instance: 3018e3a2-01e0-49d7-a960-51718709845a] Received event network-vif-plugged-f05fa2a1-b61b-4617-b895-8c75645bde94 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:33:10 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-3a3cac69-9872-4537-a58d-38e62849187b req-bfbde2a9-150c-41f0-b340-0914cf3111ca service nova] Acquiring lock "3018e3a2-01e0-49d7-a960-51718709845a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:33:10 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-3a3cac69-9872-4537-a58d-38e62849187b req-bfbde2a9-150c-41f0-b340-0914cf3111ca service nova] Lock "3018e3a2-01e0-49d7-a960-51718709845a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:33:10 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-3a3cac69-9872-4537-a58d-38e62849187b req-bfbde2a9-150c-41f0-b340-0914cf3111ca service nova] Lock "3018e3a2-01e0-49d7-a960-51718709845a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:33:10 user nova-compute[75226]: DEBUG nova.compute.manager [req-3a3cac69-9872-4537-a58d-38e62849187b req-bfbde2a9-150c-41f0-b340-0914cf3111ca service nova] [instance: 3018e3a2-01e0-49d7-a960-51718709845a] No waiting events found dispatching network-vif-plugged-f05fa2a1-b61b-4617-b895-8c75645bde94 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:33:10 user nova-compute[75226]: WARNING nova.compute.manager [req-3a3cac69-9872-4537-a58d-38e62849187b req-bfbde2a9-150c-41f0-b340-0914cf3111ca service nova] [instance: 3018e3a2-01e0-49d7-a960-51718709845a] Received unexpected event network-vif-plugged-f05fa2a1-b61b-4617-b895-8c75645bde94 for instance with vm_state rescued and task_state unrescuing.
Nov 17 01:33:10 user nova-compute[75226]: DEBUG nova.compute.manager [req-3a3cac69-9872-4537-a58d-38e62849187b req-bfbde2a9-150c-41f0-b340-0914cf3111ca service nova] [instance: 3018e3a2-01e0-49d7-a960-51718709845a] Received event network-vif-plugged-f05fa2a1-b61b-4617-b895-8c75645bde94 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:33:10 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-3a3cac69-9872-4537-a58d-38e62849187b req-bfbde2a9-150c-41f0-b340-0914cf3111ca service nova] Acquiring lock "3018e3a2-01e0-49d7-a960-51718709845a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:33:10 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-3a3cac69-9872-4537-a58d-38e62849187b req-bfbde2a9-150c-41f0-b340-0914cf3111ca service nova] Lock "3018e3a2-01e0-49d7-a960-51718709845a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:33:10 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-3a3cac69-9872-4537-a58d-38e62849187b req-bfbde2a9-150c-41f0-b340-0914cf3111ca service nova] Lock "3018e3a2-01e0-49d7-a960-51718709845a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:33:10 user nova-compute[75226]: DEBUG nova.compute.manager [req-3a3cac69-9872-4537-a58d-38e62849187b req-bfbde2a9-150c-41f0-b340-0914cf3111ca service nova] [instance: 3018e3a2-01e0-49d7-a960-51718709845a] No waiting events found dispatching network-vif-plugged-f05fa2a1-b61b-4617-b895-8c75645bde94 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:33:10 user nova-compute[75226]: WARNING nova.compute.manager [req-3a3cac69-9872-4537-a58d-38e62849187b req-bfbde2a9-150c-41f0-b340-0914cf3111ca service nova] [instance: 3018e3a2-01e0-49d7-a960-51718709845a] Received unexpected event network-vif-plugged-f05fa2a1-b61b-4617-b895-8c75645bde94 for instance with vm_state rescued and task_state unrescuing.
Nov 17 01:33:10 user nova-compute[75226]: DEBUG nova.compute.manager [req-3a3cac69-9872-4537-a58d-38e62849187b req-bfbde2a9-150c-41f0-b340-0914cf3111ca service nova] [instance: 3018e3a2-01e0-49d7-a960-51718709845a] Received event network-vif-unplugged-f05fa2a1-b61b-4617-b895-8c75645bde94 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:33:10 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-3a3cac69-9872-4537-a58d-38e62849187b req-bfbde2a9-150c-41f0-b340-0914cf3111ca service nova] Acquiring lock "3018e3a2-01e0-49d7-a960-51718709845a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:33:10 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-3a3cac69-9872-4537-a58d-38e62849187b req-bfbde2a9-150c-41f0-b340-0914cf3111ca service nova] Lock "3018e3a2-01e0-49d7-a960-51718709845a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:33:10 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-3a3cac69-9872-4537-a58d-38e62849187b req-bfbde2a9-150c-41f0-b340-0914cf3111ca service nova] Lock "3018e3a2-01e0-49d7-a960-51718709845a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:33:10 user nova-compute[75226]: DEBUG nova.compute.manager [req-3a3cac69-9872-4537-a58d-38e62849187b req-bfbde2a9-150c-41f0-b340-0914cf3111ca service nova] [instance: 3018e3a2-01e0-49d7-a960-51718709845a] No waiting events found dispatching network-vif-unplugged-f05fa2a1-b61b-4617-b895-8c75645bde94 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:33:10 user nova-compute[75226]: WARNING nova.compute.manager [req-3a3cac69-9872-4537-a58d-38e62849187b req-bfbde2a9-150c-41f0-b340-0914cf3111ca service nova] [instance: 3018e3a2-01e0-49d7-a960-51718709845a] Received unexpected event network-vif-unplugged-f05fa2a1-b61b-4617-b895-8c75645bde94 for instance with vm_state rescued and task_state unrescuing.
Nov 17 01:33:10 user nova-compute[75226]: DEBUG nova.compute.manager [req-3a3cac69-9872-4537-a58d-38e62849187b req-bfbde2a9-150c-41f0-b340-0914cf3111ca service nova] [instance: 3018e3a2-01e0-49d7-a960-51718709845a] Received event network-vif-plugged-f05fa2a1-b61b-4617-b895-8c75645bde94 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:33:10 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-3a3cac69-9872-4537-a58d-38e62849187b req-bfbde2a9-150c-41f0-b340-0914cf3111ca service nova] Acquiring lock "3018e3a2-01e0-49d7-a960-51718709845a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:33:10 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-3a3cac69-9872-4537-a58d-38e62849187b req-bfbde2a9-150c-41f0-b340-0914cf3111ca service nova] Lock "3018e3a2-01e0-49d7-a960-51718709845a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:33:10 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-3a3cac69-9872-4537-a58d-38e62849187b req-bfbde2a9-150c-41f0-b340-0914cf3111ca service nova] Lock "3018e3a2-01e0-49d7-a960-51718709845a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:33:10 user nova-compute[75226]: DEBUG nova.compute.manager [req-3a3cac69-9872-4537-a58d-38e62849187b req-bfbde2a9-150c-41f0-b340-0914cf3111ca service nova] [instance: 3018e3a2-01e0-49d7-a960-51718709845a] No waiting events found dispatching network-vif-plugged-f05fa2a1-b61b-4617-b895-8c75645bde94 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:33:10 user nova-compute[75226]: WARNING nova.compute.manager [req-3a3cac69-9872-4537-a58d-38e62849187b req-bfbde2a9-150c-41f0-b340-0914cf3111ca service nova] [instance: 3018e3a2-01e0-49d7-a960-51718709845a] Received unexpected event network-vif-plugged-f05fa2a1-b61b-4617-b895-8c75645bde94 for instance with vm_state rescued and task_state unrescuing.
Nov 17 01:33:10 user nova-compute[75226]: DEBUG nova.compute.manager [req-3a3cac69-9872-4537-a58d-38e62849187b req-bfbde2a9-150c-41f0-b340-0914cf3111ca service nova] [instance: 3018e3a2-01e0-49d7-a960-51718709845a] Received event network-vif-plugged-f05fa2a1-b61b-4617-b895-8c75645bde94 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:33:10 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-3a3cac69-9872-4537-a58d-38e62849187b req-bfbde2a9-150c-41f0-b340-0914cf3111ca service nova] Acquiring lock "3018e3a2-01e0-49d7-a960-51718709845a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:33:10 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-3a3cac69-9872-4537-a58d-38e62849187b req-bfbde2a9-150c-41f0-b340-0914cf3111ca service nova] Lock "3018e3a2-01e0-49d7-a960-51718709845a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:33:10 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-3a3cac69-9872-4537-a58d-38e62849187b req-bfbde2a9-150c-41f0-b340-0914cf3111ca service nova] Lock "3018e3a2-01e0-49d7-a960-51718709845a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:33:10 user nova-compute[75226]: DEBUG nova.compute.manager [req-3a3cac69-9872-4537-a58d-38e62849187b req-bfbde2a9-150c-41f0-b340-0914cf3111ca service nova] [instance: 3018e3a2-01e0-49d7-a960-51718709845a] No waiting events found dispatching network-vif-plugged-f05fa2a1-b61b-4617-b895-8c75645bde94 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:33:10 user nova-compute[75226]: WARNING nova.compute.manager [req-3a3cac69-9872-4537-a58d-38e62849187b req-bfbde2a9-150c-41f0-b340-0914cf3111ca service nova] [instance: 3018e3a2-01e0-49d7-a960-51718709845a] Received unexpected event network-vif-plugged-f05fa2a1-b61b-4617-b895-8c75645bde94 for instance with vm_state rescued and task_state unrescuing.
Nov 17 01:33:10 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:33:10 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75226) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 01:33:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c11fbffa-07e2-40c4-92b1-8531dbe8b687/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:33:11 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c11fbffa-07e2-40c4-92b1-8531dbe8b687/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:33:11 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c11fbffa-07e2-40c4-92b1-8531dbe8b687/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:33:11 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c11fbffa-07e2-40c4-92b1-8531dbe8b687/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:33:13 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:33:13 user nova-compute[75226]: DEBUG nova.compute.manager [None req-375f897a-3ec0-42a7-9623-41874c337831 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 3018e3a2-01e0-49d7-a960-51718709845a] Checking state {{(pid=75226) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 01:33:13 user nova-compute[75226]: DEBUG nova.compute.manager [req-94714f8f-fd3d-4323-971b-becb9c89b781 req-69631475-6980-45ab-af53-47dee1cd0ba0 service nova] [instance: 3018e3a2-01e0-49d7-a960-51718709845a] Received event network-vif-plugged-f05fa2a1-b61b-4617-b895-8c75645bde94 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:33:13 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-94714f8f-fd3d-4323-971b-becb9c89b781 req-69631475-6980-45ab-af53-47dee1cd0ba0 service nova] Acquiring lock "3018e3a2-01e0-49d7-a960-51718709845a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:33:13 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-94714f8f-fd3d-4323-971b-becb9c89b781 req-69631475-6980-45ab-af53-47dee1cd0ba0 service nova] Lock "3018e3a2-01e0-49d7-a960-51718709845a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:33:13 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-94714f8f-fd3d-4323-971b-becb9c89b781 req-69631475-6980-45ab-af53-47dee1cd0ba0 service nova] Lock "3018e3a2-01e0-49d7-a960-51718709845a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:33:13 user nova-compute[75226]: DEBUG nova.compute.manager [req-94714f8f-fd3d-4323-971b-becb9c89b781 req-69631475-6980-45ab-af53-47dee1cd0ba0 service nova] [instance: 3018e3a2-01e0-49d7-a960-51718709845a] No waiting events found dispatching network-vif-plugged-f05fa2a1-b61b-4617-b895-8c75645bde94 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:33:13 user nova-compute[75226]: WARNING nova.compute.manager [req-94714f8f-fd3d-4323-971b-becb9c89b781 req-69631475-6980-45ab-af53-47dee1cd0ba0 service nova] [instance: 3018e3a2-01e0-49d7-a960-51718709845a] Received unexpected event network-vif-plugged-f05fa2a1-b61b-4617-b895-8c75645bde94 for instance with vm_state rescued and task_state unrescuing.
Nov 17 01:33:13 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:33:13 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:33:13 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:33:13 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Hypervisor/Node resource view: name=user free_ram=7746MB free_disk=24.844440460205078GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75226) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 17 01:33:13 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:33:13 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:33:13 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance aa84e575-bdad-45b9-80ce-86b1c2826fb0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:33:13 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 6b7e9611-be35-4e51-b886-91a2fac0a653 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:33:13 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 38062487-67ca-4962-974f-81456aebe97b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:33:13 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 4050d898-f2b8-46c2-86e3-702ceb41a701 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:33:13 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 2ea5a14b-c330-4a2b-926e-60e1b30f5981 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:33:13 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance d6555d72-6094-4ea9-b071-a3d3c8a300a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:33:13 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 5c280142-8901-4f83-bde4-baaa097e05b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:33:13 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 3018e3a2-01e0-49d7-a960-51718709845a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:33:13 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance dae5490b-e434-4cd1-b8d4-6baab9bb7345 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:33:13 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance c11fbffa-07e2-40c4-92b1-8531dbe8b687 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:33:13 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75226) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 17 01:33:13 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75226) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 17 01:33:13 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Refreshing inventories for resource provider f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 17 01:33:13 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Updating ProviderTree inventory for provider f431122b-abb2-4ecb-9e21-e3ec333d823b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 17 01:33:13 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Updating inventory in ProviderTree for provider f431122b-abb2-4ecb-9e21-e3ec333d823b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 17 01:33:13 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Refreshing aggregate associations for resource provider f431122b-abb2-4ecb-9e21-e3ec333d823b, aggregates: None {{(pid=75226) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 17 01:33:13 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Refreshing trait associations for resource provider f431122b-abb2-4ecb-9e21-e3ec333d823b, traits: COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE42,HW_CPU_X86_SSE,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSSE3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_SATA {{(pid=75226) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 17 01:33:13 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-14378e52-95ef-4f45-a431-26d83ba9ac71 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Acquiring lock "a298d980-feed-4530-9499-f2833b404dcd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:33:13 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-14378e52-95ef-4f45-a431-26d83ba9ac71 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Lock "a298d980-feed-4530-9499-f2833b404dcd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:33:13 user nova-compute[75226]: DEBUG nova.compute.manager [None req-14378e52-95ef-4f45-a431-26d83ba9ac71 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: a298d980-feed-4530-9499-f2833b404dcd] Starting instance... {{(pid=75226) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 17 01:33:13 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-14378e52-95ef-4f45-a431-26d83ba9ac71 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:33:13 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:33:13 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:33:13 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Compute_service record updated for user:user {{(pid=75226) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 17 01:33:13 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.730s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:33:13 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-14378e52-95ef-4f45-a431-26d83ba9ac71 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.217s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:33:13 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:33:13 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-14378e52-95ef-4f45-a431-26d83ba9ac71 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75226) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 17 01:33:13 user nova-compute[75226]: INFO nova.compute.claims [None req-14378e52-95ef-4f45-a431-26d83ba9ac71 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: a298d980-feed-4530-9499-f2833b404dcd] Claim successful on node user
Nov 17 01:33:13 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:33:13 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:33:13 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:33:13 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Cleaning up deleted instances {{(pid=75226) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 17 01:33:14 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] There are 0 instances to clean {{(pid=75226) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 17 01:33:14 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-14378e52-95ef-4f45-a431-26d83ba9ac71 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:33:14 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-14378e52-95ef-4f45-a431-26d83ba9ac71 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:33:14 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-14378e52-95ef-4f45-a431-26d83ba9ac71 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.442s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:33:14 user nova-compute[75226]: DEBUG nova.compute.manager [None req-14378e52-95ef-4f45-a431-26d83ba9ac71 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: a298d980-feed-4530-9499-f2833b404dcd] Start building networks asynchronously for instance. {{(pid=75226) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 17 01:33:14 user nova-compute[75226]: DEBUG nova.compute.manager [None req-14378e52-95ef-4f45-a431-26d83ba9ac71 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: a298d980-feed-4530-9499-f2833b404dcd] Allocating IP information in the background. {{(pid=75226) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 17 01:33:14 user nova-compute[75226]: DEBUG nova.network.neutron [None req-14378e52-95ef-4f45-a431-26d83ba9ac71 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: a298d980-feed-4530-9499-f2833b404dcd] allocate_for_instance() {{(pid=75226) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 17 01:33:14 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-14378e52-95ef-4f45-a431-26d83ba9ac71 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: a298d980-feed-4530-9499-f2833b404dcd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 17 01:33:14 user nova-compute[75226]: DEBUG nova.compute.manager [None req-14378e52-95ef-4f45-a431-26d83ba9ac71 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: a298d980-feed-4530-9499-f2833b404dcd] Start building block device mappings for instance. {{(pid=75226) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 17 01:33:14 user nova-compute[75226]: DEBUG nova.policy [None req-14378e52-95ef-4f45-a431-26d83ba9ac71 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a13dd8231937440185c9fc628c3bd5db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9042fe4ecc245dd97553f6e942c3e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75226) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 17 01:33:14 user nova-compute[75226]: INFO nova.virt.block_device [None req-14378e52-95ef-4f45-a431-26d83ba9ac71 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: a298d980-feed-4530-9499-f2833b404dcd] Booting with volume c9b3d0d6-bd04-414b-99e5-da9402f5f419 at /dev/vda
Nov 17 01:33:14 user nova-compute[75226]: DEBUG os_brick.utils [None req-14378e52-95ef-4f45-a431-26d83ba9ac71 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:33:14 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:33:14 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:33:14 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[28f21c4a-ef04-492b-96d7-0d0da89e86cf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f62857db69\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:33:14 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:33:14 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:33:14 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[88ee9631-decf-4300-b7a9-5e849ccc3b8f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:33:14 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:33:14 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:33:14 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1b58eab-9b88-44c9-99ae-1a86c7bf7b36]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:33:14 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[35fb5c6e-05f4-4f12-8bf3-1a985cb2ed40]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:33:14 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-14378e52-95ef-4f45-a431-26d83ba9ac71 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Running cmd (subprocess): nvme version {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:33:14 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-14378e52-95ef-4f45-a431-26d83ba9ac71 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] 'nvme version' failed. Not Retrying. {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 01:33:14 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.nvmeof [None req-14378e52-95ef-4f45-a431-26d83ba9ac71 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] nvme not present on system {{(pid=75226) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 17 01:33:14 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:33:14 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 01:33:14 user nova-compute[75226]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 17 01:33:14 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[69f15e9c-352b-4ed7-a538-6b1300a5da5d]: (4, '') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:33:14 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-14378e52-95ef-4f45-a431-26d83ba9ac71 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75226) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 17 01:33:14 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-14378e52-95ef-4f45-a431-26d83ba9ac71 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75226) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 17 01:33:14 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-14378e52-95ef-4f45-a431-26d83ba9ac71 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] LIGHTOS: no hostnqn found. {{(pid=75226) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 17 01:33:14 user nova-compute[75226]: DEBUG os_brick.utils [None req-14378e52-95ef-4f45-a431-26d83ba9ac71 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f62857db69', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:33:14 user nova-compute[75226]: DEBUG nova.virt.block_device [None req-14378e52-95ef-4f45-a431-26d83ba9ac71 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: a298d980-feed-4530-9499-f2833b404dcd] Updating existing volume attachment record: 84a19302-a7ed-4ff8-99a2-1223264961b1 {{(pid=75226) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 17 01:33:15 user nova-compute[75226]: DEBUG nova.network.neutron [None req-14378e52-95ef-4f45-a431-26d83ba9ac71 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: a298d980-feed-4530-9499-f2833b404dcd] Successfully created port: 301235a9-5ec1-41f4-8e43-9dc7b20e872d {{(pid=75226) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 17 01:33:15 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-6385d986-b5ae-4b0d-a702-6021abeded49 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Acquiring lock "9e8b4b85-fe0c-4592-850e-e94ebab32d02" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:33:15 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-6385d986-b5ae-4b0d-a702-6021abeded49 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Lock "9e8b4b85-fe0c-4592-850e-e94ebab32d02" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:33:15 user nova-compute[75226]: INFO nova.compute.manager [None req-6385d986-b5ae-4b0d-a702-6021abeded49 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] [instance: 9e8b4b85-fe0c-4592-850e-e94ebab32d02] Unshelving
Nov 17 01:33:16 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-6385d986-b5ae-4b0d-a702-6021abeded49 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:33:16 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-6385d986-b5ae-4b0d-a702-6021abeded49 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:33:16 user nova-compute[75226]: DEBUG nova.objects.instance [None req-6385d986-b5ae-4b0d-a702-6021abeded49 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Lazy-loading 'pci_requests' on Instance uuid 9e8b4b85-fe0c-4592-850e-e94ebab32d02 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:33:16 user nova-compute[75226]: DEBUG nova.objects.instance [None req-6385d986-b5ae-4b0d-a702-6021abeded49 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Lazy-loading 'numa_topology' on Instance uuid 9e8b4b85-fe0c-4592-850e-e94ebab32d02 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:33:16 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-6385d986-b5ae-4b0d-a702-6021abeded49 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75226) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 17 01:33:16 user nova-compute[75226]: INFO nova.compute.claims [None req-6385d986-b5ae-4b0d-a702-6021abeded49 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] [instance: 9e8b4b85-fe0c-4592-850e-e94ebab32d02] Claim successful on node user
Nov 17 01:33:16 user nova-compute[75226]: DEBUG nova.network.neutron [None req-14378e52-95ef-4f45-a431-26d83ba9ac71 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: a298d980-feed-4530-9499-f2833b404dcd] Successfully updated port: 301235a9-5ec1-41f4-8e43-9dc7b20e872d {{(pid=75226) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 17 01:33:16 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-14378e52-95ef-4f45-a431-26d83ba9ac71 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Acquiring lock "refresh_cache-a298d980-feed-4530-9499-f2833b404dcd" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:33:16 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-14378e52-95ef-4f45-a431-26d83ba9ac71 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Acquired lock "refresh_cache-a298d980-feed-4530-9499-f2833b404dcd" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:33:16 user nova-compute[75226]: DEBUG nova.network.neutron [None req-14378e52-95ef-4f45-a431-26d83ba9ac71 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: a298d980-feed-4530-9499-f2833b404dcd] Building network info cache for instance {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 01:33:16 user nova-compute[75226]: DEBUG nova.compute.manager [req-5fa93ed5-0001-4710-b5fe-e46ea310b16e req-7e063741-003e-4b6e-a04f-c4fe6e391c56 service nova] [instance: a298d980-feed-4530-9499-f2833b404dcd] Received event network-changed-301235a9-5ec1-41f4-8e43-9dc7b20e872d {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:33:16 user nova-compute[75226]: DEBUG nova.compute.manager [req-5fa93ed5-0001-4710-b5fe-e46ea310b16e req-7e063741-003e-4b6e-a04f-c4fe6e391c56 service nova] [instance: a298d980-feed-4530-9499-f2833b404dcd] Refreshing instance network info cache due to event network-changed-301235a9-5ec1-41f4-8e43-9dc7b20e872d. {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 01:33:16 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-5fa93ed5-0001-4710-b5fe-e46ea310b16e req-7e063741-003e-4b6e-a04f-c4fe6e391c56 service nova] Acquiring lock "refresh_cache-a298d980-feed-4530-9499-f2833b404dcd" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:33:16 user nova-compute[75226]: DEBUG nova.network.neutron [None req-14378e52-95ef-4f45-a431-26d83ba9ac71 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: a298d980-feed-4530-9499-f2833b404dcd] Instance cache missing network info. {{(pid=75226) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 17 01:33:16 user nova-compute[75226]: DEBUG nova.network.neutron [None req-14378e52-95ef-4f45-a431-26d83ba9ac71 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: a298d980-feed-4530-9499-f2833b404dcd] Updating instance_info_cache with network_info: [{"id": "301235a9-5ec1-41f4-8e43-9dc7b20e872d", "address": "fa:16:3e:9a:7d:e3", "network": {"id": "9f39d3e5-b106-4bd9-b8ba-0f326e89c481", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-675861281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9042fe4ecc245dd97553f6e942c3e05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap301235a9-5e", "ovs_interfaceid": "301235a9-5ec1-41f4-8e43-9dc7b20e872d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:33:16 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-6385d986-b5ae-4b0d-a702-6021abeded49 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:33:16 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-6385d986-b5ae-4b0d-a702-6021abeded49 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:33:16 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-14378e52-95ef-4f45-a431-26d83ba9ac71 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Releasing lock "refresh_cache-a298d980-feed-4530-9499-f2833b404dcd" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:33:16 user nova-compute[75226]: DEBUG nova.compute.manager [None req-14378e52-95ef-4f45-a431-26d83ba9ac71 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: a298d980-feed-4530-9499-f2833b404dcd] Instance network_info: |[{"id": "301235a9-5ec1-41f4-8e43-9dc7b20e872d", "address": "fa:16:3e:9a:7d:e3", "network": {"id": "9f39d3e5-b106-4bd9-b8ba-0f326e89c481", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-675861281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9042fe4ecc245dd97553f6e942c3e05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap301235a9-5e", "ovs_interfaceid": "301235a9-5ec1-41f4-8e43-9dc7b20e872d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75226) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 17 01:33:16 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-5fa93ed5-0001-4710-b5fe-e46ea310b16e req-7e063741-003e-4b6e-a04f-c4fe6e391c56 service nova] Acquired lock "refresh_cache-a298d980-feed-4530-9499-f2833b404dcd" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:33:16 user nova-compute[75226]: DEBUG nova.network.neutron [req-5fa93ed5-0001-4710-b5fe-e46ea310b16e req-7e063741-003e-4b6e-a04f-c4fe6e391c56 service nova] [instance: a298d980-feed-4530-9499-f2833b404dcd] Refreshing network info cache for port 301235a9-5ec1-41f4-8e43-9dc7b20e872d {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 01:33:16 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-6385d986-b5ae-4b0d-a702-6021abeded49 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.525s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:33:16 user nova-compute[75226]: INFO nova.network.neutron [None req-6385d986-b5ae-4b0d-a702-6021abeded49 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] [instance: 9e8b4b85-fe0c-4592-850e-e94ebab32d02] Updating port 5e4b278c-6c95-4fd1-a215-3fa737694996 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 17 01:33:16 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:33:16 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:33:16 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75226) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 17 01:33:16 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:33:16 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75226) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 17 01:33:17 user nova-compute[75226]: DEBUG nova.network.neutron [req-5fa93ed5-0001-4710-b5fe-e46ea310b16e req-7e063741-003e-4b6e-a04f-c4fe6e391c56 service nova] [instance: a298d980-feed-4530-9499-f2833b404dcd] Updated VIF entry in instance network info cache for port 301235a9-5ec1-41f4-8e43-9dc7b20e872d. {{(pid=75226) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 01:33:17 user nova-compute[75226]: DEBUG nova.network.neutron [req-5fa93ed5-0001-4710-b5fe-e46ea310b16e req-7e063741-003e-4b6e-a04f-c4fe6e391c56 service nova] [instance: a298d980-feed-4530-9499-f2833b404dcd] Updating instance_info_cache with network_info: [{"id": "301235a9-5ec1-41f4-8e43-9dc7b20e872d", "address": "fa:16:3e:9a:7d:e3", "network": {"id": "9f39d3e5-b106-4bd9-b8ba-0f326e89c481", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-675861281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9042fe4ecc245dd97553f6e942c3e05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap301235a9-5e", "ovs_interfaceid": "301235a9-5ec1-41f4-8e43-9dc7b20e872d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:33:17 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-5fa93ed5-0001-4710-b5fe-e46ea310b16e req-7e063741-003e-4b6e-a04f-c4fe6e391c56 service nova] Releasing lock "refresh_cache-a298d980-feed-4530-9499-f2833b404dcd" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:33:17 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-6385d986-b5ae-4b0d-a702-6021abeded49 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Acquiring lock "refresh_cache-9e8b4b85-fe0c-4592-850e-e94ebab32d02" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:33:17 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-6385d986-b5ae-4b0d-a702-6021abeded49 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Acquired lock "refresh_cache-9e8b4b85-fe0c-4592-850e-e94ebab32d02" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:33:17 user nova-compute[75226]: DEBUG nova.network.neutron [None req-6385d986-b5ae-4b0d-a702-6021abeded49 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] [instance: 9e8b4b85-fe0c-4592-850e-e94ebab32d02] Building network info cache for instance {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 01:33:17 user nova-compute[75226]: DEBUG nova.network.neutron [None req-6385d986-b5ae-4b0d-a702-6021abeded49 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] [instance: 9e8b4b85-fe0c-4592-850e-e94ebab32d02] Updating instance_info_cache with network_info: [{"id": "5e4b278c-6c95-4fd1-a215-3fa737694996", "address": "fa:16:3e:b6:d6:ba", "network": {"id": "72724945-89ae-47c2-ac58-ea393837ada6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-308563626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fcdc65b510141e9b7c9a01401a97448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e4b278c-6c", "ovs_interfaceid": "5e4b278c-6c95-4fd1-a215-3fa737694996", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:33:17 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-6385d986-b5ae-4b0d-a702-6021abeded49 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Releasing lock "refresh_cache-9e8b4b85-fe0c-4592-850e-e94ebab32d02" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:33:17 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-6385d986-b5ae-4b0d-a702-6021abeded49 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] [instance: 9e8b4b85-fe0c-4592-850e-e94ebab32d02] Creating instance directory {{(pid=75226) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 17 01:33:17 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-6385d986-b5ae-4b0d-a702-6021abeded49 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] [instance: 9e8b4b85-fe0c-4592-850e-e94ebab32d02] Creating image(s)
Nov 17 01:33:17 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-6385d986-b5ae-4b0d-a702-6021abeded49 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Acquiring lock "/opt/stack/data/nova/instances/9e8b4b85-fe0c-4592-850e-e94ebab32d02/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:33:17 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-6385d986-b5ae-4b0d-a702-6021abeded49 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Lock "/opt/stack/data/nova/instances/9e8b4b85-fe0c-4592-850e-e94ebab32d02/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:33:17 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-6385d986-b5ae-4b0d-a702-6021abeded49 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Lock "/opt/stack/data/nova/instances/9e8b4b85-fe0c-4592-850e-e94ebab32d02/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:33:17 user nova-compute[75226]: DEBUG nova.objects.instance [None req-6385d986-b5ae-4b0d-a702-6021abeded49 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Lazy-loading 'trusted_certs' on Instance uuid 9e8b4b85-fe0c-4592-850e-e94ebab32d02 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:33:17 user nova-compute[75226]: DEBUG nova.objects.base [None req-6385d986-b5ae-4b0d-a702-6021abeded49 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Object Instance<9e8b4b85-fe0c-4592-850e-e94ebab32d02> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75226) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 17 01:33:17 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-6385d986-b5ae-4b0d-a702-6021abeded49 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Acquiring lock "86ea0cbaaeb2d30ade0aaf877499f237da655392" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:33:17 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-6385d986-b5ae-4b0d-a702-6021abeded49 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Lock "86ea0cbaaeb2d30ade0aaf877499f237da655392" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.005s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:33:17 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:33:17 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Starting heal instance info cache {{(pid=75226) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 17 01:33:18 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:33:19 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-6385d986-b5ae-4b0d-a702-6021abeded49 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/86ea0cbaaeb2d30ade0aaf877499f237da655392.part --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:33:19 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "refresh_cache-4050d898-f2b8-46c2-86e3-702ceb41a701" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:33:19 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquired lock "refresh_cache-4050d898-f2b8-46c2-86e3-702ceb41a701" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:33:19 user nova-compute[75226]: DEBUG nova.network.neutron [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] [instance: 4050d898-f2b8-46c2-86e3-702ceb41a701] Forcefully refreshing network info cache for instance {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 17 01:33:19 user nova-compute[75226]: DEBUG nova.compute.manager [req-55f636f5-6fc1-4b4b-bfad-3b5556e795c6 req-d6429307-1a0d-40ab-844d-499244eca97c service nova] [instance: 9e8b4b85-fe0c-4592-850e-e94ebab32d02] Received event network-changed-5e4b278c-6c95-4fd1-a215-3fa737694996 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:33:19 user nova-compute[75226]: DEBUG nova.compute.manager [req-55f636f5-6fc1-4b4b-bfad-3b5556e795c6 req-d6429307-1a0d-40ab-844d-499244eca97c service nova] [instance: 9e8b4b85-fe0c-4592-850e-e94ebab32d02] Refreshing instance network info cache due to event network-changed-5e4b278c-6c95-4fd1-a215-3fa737694996. {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 01:33:19 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-55f636f5-6fc1-4b4b-bfad-3b5556e795c6 req-d6429307-1a0d-40ab-844d-499244eca97c service nova] Acquiring lock "refresh_cache-9e8b4b85-fe0c-4592-850e-e94ebab32d02" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:33:19 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-55f636f5-6fc1-4b4b-bfad-3b5556e795c6 req-d6429307-1a0d-40ab-844d-499244eca97c service nova] Acquired lock "refresh_cache-9e8b4b85-fe0c-4592-850e-e94ebab32d02" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:33:19 user nova-compute[75226]: DEBUG nova.network.neutron [req-55f636f5-6fc1-4b4b-bfad-3b5556e795c6 req-d6429307-1a0d-40ab-844d-499244eca97c service nova] [instance: 9e8b4b85-fe0c-4592-850e-e94ebab32d02] Refreshing network info cache for port 5e4b278c-6c95-4fd1-a215-3fa737694996 {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 01:33:19 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-6385d986-b5ae-4b0d-a702-6021abeded49 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/86ea0cbaaeb2d30ade0aaf877499f237da655392.part --force-share --output=json" returned: 0 in 0.191s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:33:19 user nova-compute[75226]: DEBUG nova.virt.images [None req-6385d986-b5ae-4b0d-a702-6021abeded49 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] 63952acd-d41b-45b9-99cd-bd803ca9b101 was qcow2, converting to raw {{(pid=75226) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 17 01:33:19 user nova-compute[75226]: DEBUG nova.privsep.utils [None req-6385d986-b5ae-4b0d-a702-6021abeded49 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75226) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 17 01:33:19 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-6385d986-b5ae-4b0d-a702-6021abeded49 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/86ea0cbaaeb2d30ade0aaf877499f237da655392.part /opt/stack/data/nova/instances/_base/86ea0cbaaeb2d30ade0aaf877499f237da655392.converted {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:33:19 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-6385d986-b5ae-4b0d-a702-6021abeded49 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/86ea0cbaaeb2d30ade0aaf877499f237da655392.part /opt/stack/data/nova/instances/_base/86ea0cbaaeb2d30ade0aaf877499f237da655392.converted" returned: 0 in 0.197s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:33:19 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-6385d986-b5ae-4b0d-a702-6021abeded49 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/86ea0cbaaeb2d30ade0aaf877499f237da655392.converted --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:33:19 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-6385d986-b5ae-4b0d-a702-6021abeded49 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/86ea0cbaaeb2d30ade0aaf877499f237da655392.converted --force-share --output=json" returned: 0 in 0.203s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:33:19 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-6385d986-b5ae-4b0d-a702-6021abeded49 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Lock "86ea0cbaaeb2d30ade0aaf877499f237da655392" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.697s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:33:19 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-6385d986-b5ae-4b0d-a702-6021abeded49 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/86ea0cbaaeb2d30ade0aaf877499f237da655392 --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:33:19 user nova-compute[75226]: DEBUG nova.network.neutron [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] [instance: 4050d898-f2b8-46c2-86e3-702ceb41a701] Updating instance_info_cache with network_info: [{"id": "3b88e9ba-814a-4122-9e85-a70bd6d85ad0", "address": "fa:16:3e:41:78:68", "network": {"id": "ded167af-70f6-45b1-beb4-2eca06a78205", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2145123005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d69aa270fc5b4749a65ea70c7ef30958", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b88e9ba-81", "ovs_interfaceid": "3b88e9ba-814a-4122-9e85-a70bd6d85ad0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:33:19 user nova-compute[75226]: DEBUG nova.network.neutron [req-55f636f5-6fc1-4b4b-bfad-3b5556e795c6 req-d6429307-1a0d-40ab-844d-499244eca97c service nova] [instance: 9e8b4b85-fe0c-4592-850e-e94ebab32d02] Updated VIF entry in instance network info cache for port 5e4b278c-6c95-4fd1-a215-3fa737694996. {{(pid=75226) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 01:33:19 user nova-compute[75226]: DEBUG nova.network.neutron [req-55f636f5-6fc1-4b4b-bfad-3b5556e795c6 req-d6429307-1a0d-40ab-844d-499244eca97c service nova] [instance: 9e8b4b85-fe0c-4592-850e-e94ebab32d02] Updating instance_info_cache with network_info: [{"id": "5e4b278c-6c95-4fd1-a215-3fa737694996", "address": "fa:16:3e:b6:d6:ba", "network": {"id": "72724945-89ae-47c2-ac58-ea393837ada6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-308563626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fcdc65b510141e9b7c9a01401a97448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e4b278c-6c", "ovs_interfaceid": "5e4b278c-6c95-4fd1-a215-3fa737694996", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:33:19 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-6385d986-b5ae-4b0d-a702-6021abeded49 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/86ea0cbaaeb2d30ade0aaf877499f237da655392 --force-share --output=json" returned: 0 in 0.245s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:33:19 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-6385d986-b5ae-4b0d-a702-6021abeded49 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Acquiring lock "86ea0cbaaeb2d30ade0aaf877499f237da655392" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:33:19 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-6385d986-b5ae-4b0d-a702-6021abeded49 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Lock "86ea0cbaaeb2d30ade0aaf877499f237da655392" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:33:19 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-6385d986-b5ae-4b0d-a702-6021abeded49 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/86ea0cbaaeb2d30ade0aaf877499f237da655392 --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:33:19 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Releasing lock "refresh_cache-4050d898-f2b8-46c2-86e3-702ceb41a701" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:33:19 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] [instance: 4050d898-f2b8-46c2-86e3-702ceb41a701] Updated the network info_cache for instance {{(pid=75226) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 17 01:33:19 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-55f636f5-6fc1-4b4b-bfad-3b5556e795c6 req-d6429307-1a0d-40ab-844d-499244eca97c service nova] Releasing lock "refresh_cache-9e8b4b85-fe0c-4592-850e-e94ebab32d02" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:33:20 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-6385d986-b5ae-4b0d-a702-6021abeded49 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/86ea0cbaaeb2d30ade0aaf877499f237da655392 --force-share --output=json" returned: 0 in 0.178s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:33:20 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-6385d986-b5ae-4b0d-a702-6021abeded49 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/86ea0cbaaeb2d30ade0aaf877499f237da655392,backing_fmt=raw /opt/stack/data/nova/instances/9e8b4b85-fe0c-4592-850e-e94ebab32d02/disk 1073741824 {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:33:20 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-6385d986-b5ae-4b0d-a702-6021abeded49 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/86ea0cbaaeb2d30ade0aaf877499f237da655392,backing_fmt=raw /opt/stack/data/nova/instances/9e8b4b85-fe0c-4592-850e-e94ebab32d02/disk 1073741824" returned: 0 in 0.051s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:33:20 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-6385d986-b5ae-4b0d-a702-6021abeded49 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Lock "86ea0cbaaeb2d30ade0aaf877499f237da655392" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:33:20 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-6385d986-b5ae-4b0d-a702-6021abeded49 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/86ea0cbaaeb2d30ade0aaf877499f237da655392 --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:33:20 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-6385d986-b5ae-4b0d-a702-6021abeded49 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/86ea0cbaaeb2d30ade0aaf877499f237da655392 --force-share --output=json" returned: 0 in 0.170s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:33:20 user nova-compute[75226]: DEBUG nova.objects.instance [None req-6385d986-b5ae-4b0d-a702-6021abeded49 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Lazy-loading 'migration_context' on Instance uuid 9e8b4b85-fe0c-4592-850e-e94ebab32d02 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:33:20 user nova-compute[75226]: DEBUG nova.objects.base [None req-6385d986-b5ae-4b0d-a702-6021abeded49 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Object Instance<9e8b4b85-fe0c-4592-850e-e94ebab32d02> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75226) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 17 01:33:20 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-6385d986-b5ae-4b0d-a702-6021abeded49 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] [instance: 9e8b4b85-fe0c-4592-850e-e94ebab32d02] Rebasing disk image.
Nov 17 01:33:20 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-6385d986-b5ae-4b0d-a702-6021abeded49 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:33:20 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-6385d986-b5ae-4b0d-a702-6021abeded49 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json" returned: 0 in 0.179s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:33:20 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-6385d986-b5ae-4b0d-a702-6021abeded49 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 -F raw /opt/stack/data/nova/instances/9e8b4b85-fe0c-4592-850e-e94ebab32d02/disk {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:33:22 user nova-compute[75226]: DEBUG nova.compute.manager [None req-14378e52-95ef-4f45-a431-26d83ba9ac71 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: a298d980-feed-4530-9499-f2833b404dcd] Start spawning the instance on the hypervisor. {{(pid=75226) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 17 01:33:22 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-14378e52-95ef-4f45-a431-26d83ba9ac71 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: a298d980-feed-4530-9499-f2833b404dcd] Creating instance directory {{(pid=75226) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 17 01:33:22 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-14378e52-95ef-4f45-a431-26d83ba9ac71 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: a298d980-feed-4530-9499-f2833b404dcd] Creating image(s)
Nov 17 01:33:22 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-14378e52-95ef-4f45-a431-26d83ba9ac71 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: a298d980-feed-4530-9499-f2833b404dcd] Did not create local disks {{(pid=75226) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 17 01:33:22 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-14378e52-95ef-4f45-a431-26d83ba9ac71 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: a298d980-feed-4530-9499-f2833b404dcd] Ensure instance console log exists: /opt/stack/data/nova/instances/a298d980-feed-4530-9499-f2833b404dcd/console.log {{(pid=75226) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 17 01:33:22 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-14378e52-95ef-4f45-a431-26d83ba9ac71 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:33:22 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-14378e52-95ef-4f45-a431-26d83ba9ac71 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:33:22 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-14378e52-95ef-4f45-a431-26d83ba9ac71 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:33:22 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-14378e52-95ef-4f45-a431-26d83ba9ac71 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: a298d980-feed-4530-9499-f2833b404dcd] Start _get_guest_xml network_info=[{"id": "301235a9-5ec1-41f4-8e43-9dc7b20e872d", "address": "fa:16:3e:9a:7d:e3", "network": {"id": "9f39d3e5-b106-4bd9-b8ba-0f326e89c481", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-675861281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9042fe4ecc245dd97553f6e942c3e05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap301235a9-5e", "ovs_interfaceid": "301235a9-5ec1-41f4-8e43-9dc7b20e872d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VUyvFGLr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a298d980-feed-4530-9499-f2833b404dcd', 'attached_at': '', 'detached_at': '', 'volume_id': 'c9b3d0d6-bd04-414b-99e5-da9402f5f419', 'serial': 'c9b3d0d6-bd04-414b-99e5-da9402f5f419'}, 'attachment_id': '84a19302-a7ed-4ff8-99a2-1223264961b1', 'device_type': 'disk', 'volume_type': None} {{(pid=75226) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 17 01:33:22 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-14378e52-95ef-4f45-a431-26d83ba9ac71 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:33:22 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-14378e52-95ef-4f45-a431-26d83ba9ac71 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:33:22 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-14378e52-95ef-4f45-a431-26d83ba9ac71 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75226) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 17 01:33:22 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-14378e52-95ef-4f45-a431-26d83ba9ac71 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] CPU controller missing on host. {{(pid=75226) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 17 01:33:22 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-14378e52-95ef-4f45-a431-26d83ba9ac71 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75226) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 17 01:33:22 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-14378e52-95ef-4f45-a431-26d83ba9ac71 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] CPU controller found on host. {{(pid=75226) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 17 01:33:22 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-14378e52-95ef-4f45-a431-26d83ba9ac71 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75226) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 17 01:33:22 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-14378e52-95ef-4f45-a431-26d83ba9ac71 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-17T01:13:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 17 01:33:22 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-14378e52-95ef-4f45-a431-26d83ba9ac71 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Flavor limits 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 17 01:33:22 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-14378e52-95ef-4f45-a431-26d83ba9ac71 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Image limits 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 17 01:33:22 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-14378e52-95ef-4f45-a431-26d83ba9ac71 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Flavor pref 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 17 01:33:22 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-14378e52-95ef-4f45-a431-26d83ba9ac71 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Image pref 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 17 01:33:22 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-14378e52-95ef-4f45-a431-26d83ba9ac71 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 17 01:33:22 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-14378e52-95ef-4f45-a431-26d83ba9ac71 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 17 01:33:22 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-14378e52-95ef-4f45-a431-26d83ba9ac71 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75226) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 17 01:33:22 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-14378e52-95ef-4f45-a431-26d83ba9ac71 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Got 1 possible topologies {{(pid=75226) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 17 01:33:22 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-14378e52-95ef-4f45-a431-26d83ba9ac71 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 17 01:33:22 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-14378e52-95ef-4f45-a431-26d83ba9ac71 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 17 01:33:22 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-14378e52-95ef-4f45-a431-26d83ba9ac71 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: a298d980-feed-4530-9499-f2833b404dcd] Calling os-brick to attach iSCSI Volume {{(pid=75226) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 17 01:33:22 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-14378e52-95ef-4f45-a431-26d83ba9ac71 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc4cc36b490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VUyvFGLr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:33:22 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-14378e52-95ef-4f45-a431-26d83ba9ac71 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:33:22 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-14378e52-95ef-4f45-a431-26d83ba9ac71 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:33:22 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-14378e52-95ef-4f45-a431-26d83ba9ac71 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:33:22 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-14378e52-95ef-4f45-a431-26d83ba9ac71 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:33:22 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-14378e52-95ef-4f45-a431-26d83ba9ac71 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:33:22 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-14378e52-95ef-4f45-a431-26d83ba9ac71 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:33:22 user nova-compute[75226]: INFO os_brick.initiator.connectors.iscsi [None req-14378e52-95ef-4f45-a431-26d83ba9ac71 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 17 01:33:22 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419 -p 172.16.0.220:3260 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:33:22 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:33:22 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[be0ca560-a04c-407d-a9a0-41c08a9aaa2f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:33:22 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-14378e52-95ef-4f45-a431-26d83ba9ac71 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 17 01:33:22 user nova-compute[75226]:  {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:33:22 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419 -p 172.16.0.220:3260 --interface default --op new {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:33:22 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:33:22 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cc8e2dd-e218-464b-b17c-cf724fb18303]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419] added\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:33:22 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-14378e52-95ef-4f45-a431-26d83ba9ac71 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419] added
Nov 17 01:33:22 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:33:22 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:33:22 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:33:22 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[958a6463-6981-4e57-bf77-c9cdbb6e49cc]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:33:22 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-14378e52-95ef-4f45-a431-26d83ba9ac71 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:33:22 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:33:22 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:33:22 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[d100deeb-008b-4ed5-a890-4807a5859112]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:33:22 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-14378e52-95ef-4f45-a431-26d83ba9ac71 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:33:22 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VUyvFGLr {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:33:22 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VUyvFGLr" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:33:22 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab3f3535-2b09-4c2e-afd4-06d0b3433eaf]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:33:22 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-14378e52-95ef-4f45-a431-26d83ba9ac71 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VUyvFGLr'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:33:22 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:33:22 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:33:22 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a610bf2-6c9d-4588-8f85-c83cb8d1dc35]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:33:22 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-14378e52-95ef-4f45-a431-26d83ba9ac71 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:33:22 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:33:22 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-6385d986-b5ae-4b0d-a702-6021abeded49 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 -F raw /opt/stack/data/nova/instances/9e8b4b85-fe0c-4592-850e-e94ebab32d02/disk" returned: 0 in 2.286s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:33:22 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-6385d986-b5ae-4b0d-a702-6021abeded49 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] [instance: 9e8b4b85-fe0c-4592-850e-e94ebab32d02] Created local disks {{(pid=75226) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 17 01:33:22 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-6385d986-b5ae-4b0d-a702-6021abeded49 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] [instance: 9e8b4b85-fe0c-4592-850e-e94ebab32d02] Ensure instance console log exists: /opt/stack/data/nova/instances/9e8b4b85-fe0c-4592-850e-e94ebab32d02/console.log {{(pid=75226) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 17 01:33:22 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-6385d986-b5ae-4b0d-a702-6021abeded49 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:33:22 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-6385d986-b5ae-4b0d-a702-6021abeded49 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:33:22 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-6385d986-b5ae-4b0d-a702-6021abeded49 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:33:22 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-6385d986-b5ae-4b0d-a702-6021abeded49 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] [instance: 9e8b4b85-fe0c-4592-850e-e94ebab32d02] Start _get_guest_xml network_info=[{"id": "5e4b278c-6c95-4fd1-a215-3fa737694996", "address": "fa:16:3e:b6:d6:ba", "network": {"id": "72724945-89ae-47c2-ac58-ea393837ada6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-308563626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fcdc65b510141e9b7c9a01401a97448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e4b278c-6c", "ovs_interfaceid": "5e4b278c-6c95-4fd1-a215-3fa737694996", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='15ffcd3f6410c8f5f9ca635eefdbdb07',container_format='bare',created_at=2023-11-17T01:31:23Z,direct_url=<?>,disk_format='qcow2',id=63952acd-d41b-45b9-99cd-bd803ca9b101,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1781762170-shelved',owner='1fcdc65b510141e9b7c9a01401a97448',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-17T01:31:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '0b369aea-6f3f-4690-9f01-229b90ab6310'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75226) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 17 01:33:22 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-6385d986-b5ae-4b0d-a702-6021abeded49 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:33:22 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-6385d986-b5ae-4b0d-a702-6021abeded49 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:33:22 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:33:22 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2839fed-5bb6-4533-bf07-46c08d9309c2]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05f878e5-0241-4282-8b2c-c4651c429dcb (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:33:22 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-14378e52-95ef-4f45-a431-26d83ba9ac71 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)
Nov 17 01:33:22 user nova-compute[75226]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05f878e5-0241-4282-8b2c-c4651c429dcb (non-flash)
Nov 17 01:33:22 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:33:22 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-14378e52-95ef-4f45-a431-26d83ba9ac71 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)
Nov 17 01:33:22 user nova-compute[75226]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05f878e5-0241-4282-8b2c-c4651c429dcb (non-flash)
Nov 17 01:33:22 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:33:22 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-6385d986-b5ae-4b0d-a702-6021abeded49 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75226) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 17 01:33:22 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-6385d986-b5ae-4b0d-a702-6021abeded49 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] CPU controller missing on host. {{(pid=75226) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 17 01:33:22 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419 -p 172.16.0.220:3260 --login {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:33:22 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-6385d986-b5ae-4b0d-a702-6021abeded49 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75226) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 17 01:33:22 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-6385d986-b5ae-4b0d-a702-6021abeded49 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] CPU controller found on host. {{(pid=75226) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 17 01:33:22 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-6385d986-b5ae-4b0d-a702-6021abeded49 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75226) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 17 01:33:22 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-6385d986-b5ae-4b0d-a702-6021abeded49 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-17T01:13:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='15ffcd3f6410c8f5f9ca635eefdbdb07',container_format='bare',created_at=2023-11-17T01:31:23Z,direct_url=<?>,disk_format='qcow2',id=63952acd-d41b-45b9-99cd-bd803ca9b101,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1781762170-shelved',owner='1fcdc65b510141e9b7c9a01401a97448',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-17T01:31:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 17 01:33:22 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-6385d986-b5ae-4b0d-a702-6021abeded49 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Flavor limits 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 17 01:33:22 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-6385d986-b5ae-4b0d-a702-6021abeded49 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Image limits 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 17 01:33:22 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-6385d986-b5ae-4b0d-a702-6021abeded49 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Flavor pref 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 17 01:33:22 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-6385d986-b5ae-4b0d-a702-6021abeded49 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Image pref 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 17 01:33:22 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-6385d986-b5ae-4b0d-a702-6021abeded49 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 17 01:33:22 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-6385d986-b5ae-4b0d-a702-6021abeded49 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 17 01:33:22 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-6385d986-b5ae-4b0d-a702-6021abeded49 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75226) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 17 01:33:22 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-6385d986-b5ae-4b0d-a702-6021abeded49 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Got 1 possible topologies {{(pid=75226) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 17 01:33:22 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-6385d986-b5ae-4b0d-a702-6021abeded49 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 17 01:33:22 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-6385d986-b5ae-4b0d-a702-6021abeded49 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 17 01:33:22 user nova-compute[75226]: DEBUG nova.objects.instance [None req-6385d986-b5ae-4b0d-a702-6021abeded49 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Lazy-loading 'vcpu_model' on Instance uuid 9e8b4b85-fe0c-4592-850e-e94ebab32d02 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:33:22 user nova-compute[75226]: DEBUG nova.objects.base [None req-6385d986-b5ae-4b0d-a702-6021abeded49 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Object Instance<9e8b4b85-fe0c-4592-850e-e94ebab32d02> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75226) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 17 01:33:22 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-6385d986-b5ae-4b0d-a702-6021abeded49 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-17T01:29:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1781762170',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1781762170',id=30,image_ref='63952acd-d41b-45b9-99cd-bd803ca9b101',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1121562331',keypairs=<?>,launch_index=0,launched_at=2023-11-17T01:29:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='1fcdc65b510141e9b7c9a01401a97448',ramdisk_id='',reservation_id='r-b0wngs1h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1321076871',owner_user_name='tempest-AttachVolumeShelveTestJSON-1321076871-project-member',shelved_at='2023-11-17T01:31:26.887987',shelved_host='user',shelved_image_id='63952acd-d41b-45b9-99cd-bd803ca9b101'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T01:33:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2adb9c6cd5c443a7993f6f9d09da6346',uuid=9e8b4b85-fe0c-4592-850e-e94ebab32d02,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "5e4b278c-6c95-4fd1-a215-3fa737694996", "address": "fa:16:3e:b6:d6:ba", "network": {"id": "72724945-89ae-47c2-ac58-ea393837ada6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-308563626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fcdc65b510141e9b7c9a01401a97448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e4b278c-6c", "ovs_interfaceid": "5e4b278c-6c95-4fd1-a215-3fa737694996", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75226) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 01:33:22 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-6385d986-b5ae-4b0d-a702-6021abeded49 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Converting VIF {"id": "5e4b278c-6c95-4fd1-a215-3fa737694996", "address": "fa:16:3e:b6:d6:ba", "network": {"id": "72724945-89ae-47c2-ac58-ea393837ada6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-308563626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fcdc65b510141e9b7c9a01401a97448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e4b278c-6c", "ovs_interfaceid": "5e4b278c-6c95-4fd1-a215-3fa737694996", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:33:22 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-6385d986-b5ae-4b0d-a702-6021abeded49 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:d6:ba,bridge_name='br-int',has_traffic_filtering=True,id=5e4b278c-6c95-4fd1-a215-3fa737694996,network=Network(72724945-89ae-47c2-ac58-ea393837ada6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e4b278c-6c') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:33:22 user nova-compute[75226]: DEBUG nova.objects.instance [None req-6385d986-b5ae-4b0d-a702-6021abeded49 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Lazy-loading 'pci_devices' on Instance uuid 9e8b4b85-fe0c-4592-850e-e94ebab32d02 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:33:22 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:33:22 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[4289b2a1-bf9c-4132-851a-8f3dd808427a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:33:22 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-14378e52-95ef-4f45-a431-26d83ba9ac71 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419, portal: 172.16.0.220,3260]
Nov 17 01:33:22 user nova-compute[75226]: Login to [iface: default, target: iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419, portal: 172.16.0.220,3260] successful.
Nov 17 01:33:22 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:33:22 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:33:22 user nova-compute[75226]: DEBUG nova.objects.base [None req-6385d986-b5ae-4b0d-a702-6021abeded49 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Object Instance<9e8b4b85-fe0c-4592-850e-e94ebab32d02> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75226) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 17 01:33:22 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-6385d986-b5ae-4b0d-a702-6021abeded49 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] [instance: 9e8b4b85-fe0c-4592-850e-e94ebab32d02] End _get_guest_xml xml=<domain type="kvm">
Nov 17 01:33:22 user nova-compute[75226]:   <uuid>9e8b4b85-fe0c-4592-850e-e94ebab32d02</uuid>
Nov 17 01:33:22 user nova-compute[75226]:   <name>instance-0000001e</name>
Nov 17 01:33:22 user nova-compute[75226]:   <memory>524288</memory>
Nov 17 01:33:22 user nova-compute[75226]:   <vcpu>1</vcpu>
Nov 17 01:33:22 user nova-compute[75226]:   <metadata>
Nov 17 01:33:22 user nova-compute[75226]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 17 01:33:22 user nova-compute[75226]:       <nova:package version="0.0.0"/>
Nov 17 01:33:22 user nova-compute[75226]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1781762170</nova:name>
Nov 17 01:33:22 user nova-compute[75226]:       <nova:creationTime>2023-11-17 01:33:22</nova:creationTime>
Nov 17 01:33:22 user nova-compute[75226]:       <nova:flavor name="m1.tiny">
Nov 17 01:33:22 user nova-compute[75226]:         <nova:memory>512</nova:memory>
Nov 17 01:33:22 user nova-compute[75226]:         <nova:disk>1</nova:disk>
Nov 17 01:33:22 user nova-compute[75226]:         <nova:swap>0</nova:swap>
Nov 17 01:33:22 user nova-compute[75226]:         <nova:ephemeral>0</nova:ephemeral>
Nov 17 01:33:22 user nova-compute[75226]:         <nova:vcpus>1</nova:vcpus>
Nov 17 01:33:22 user nova-compute[75226]:       </nova:flavor>
Nov 17 01:33:22 user nova-compute[75226]:       <nova:owner>
Nov 17 01:33:22 user nova-compute[75226]:         <nova:user uuid="2adb9c6cd5c443a7993f6f9d09da6346">tempest-AttachVolumeShelveTestJSON-1321076871-project-member</nova:user>
Nov 17 01:33:22 user nova-compute[75226]:         <nova:project uuid="1fcdc65b510141e9b7c9a01401a97448">tempest-AttachVolumeShelveTestJSON-1321076871</nova:project>
Nov 17 01:33:22 user nova-compute[75226]:       </nova:owner>
Nov 17 01:33:22 user nova-compute[75226]:       <nova:root type="image" uuid="63952acd-d41b-45b9-99cd-bd803ca9b101"/>
Nov 17 01:33:22 user nova-compute[75226]:       <nova:ports>
Nov 17 01:33:22 user nova-compute[75226]:         <nova:port uuid="5e4b278c-6c95-4fd1-a215-3fa737694996">
Nov 17 01:33:22 user nova-compute[75226]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 17 01:33:22 user nova-compute[75226]:         </nova:port>
Nov 17 01:33:22 user nova-compute[75226]:       </nova:ports>
Nov 17 01:33:22 user nova-compute[75226]:     </nova:instance>
Nov 17 01:33:22 user nova-compute[75226]:   </metadata>
Nov 17 01:33:22 user nova-compute[75226]:   <sysinfo type="smbios">
Nov 17 01:33:22 user nova-compute[75226]:     <system>
Nov 17 01:33:22 user nova-compute[75226]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 17 01:33:22 user nova-compute[75226]:       <entry name="product">OpenStack Nova</entry>
Nov 17 01:33:22 user nova-compute[75226]:       <entry name="version">0.0.0</entry>
Nov 17 01:33:22 user nova-compute[75226]:       <entry name="serial">9e8b4b85-fe0c-4592-850e-e94ebab32d02</entry>
Nov 17 01:33:22 user nova-compute[75226]:       <entry name="uuid">9e8b4b85-fe0c-4592-850e-e94ebab32d02</entry>
Nov 17 01:33:22 user nova-compute[75226]:       <entry name="family">Virtual Machine</entry>
Nov 17 01:33:22 user nova-compute[75226]:     </system>
Nov 17 01:33:22 user nova-compute[75226]:   </sysinfo>
Nov 17 01:33:22 user nova-compute[75226]:   <os>
Nov 17 01:33:22 user nova-compute[75226]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 17 01:33:22 user nova-compute[75226]:     <boot dev="hd"/>
Nov 17 01:33:22 user nova-compute[75226]:     <smbios mode="sysinfo"/>
Nov 17 01:33:22 user nova-compute[75226]:   </os>
Nov 17 01:33:22 user nova-compute[75226]:   <features>
Nov 17 01:33:22 user nova-compute[75226]:     <acpi/>
Nov 17 01:33:22 user nova-compute[75226]:     <apic/>
Nov 17 01:33:22 user nova-compute[75226]:     <vmcoreinfo/>
Nov 17 01:33:22 user nova-compute[75226]:   </features>
Nov 17 01:33:22 user nova-compute[75226]:   <clock offset="utc">
Nov 17 01:33:22 user nova-compute[75226]:     <timer name="pit" tickpolicy="delay"/>
Nov 17 01:33:22 user nova-compute[75226]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 17 01:33:22 user nova-compute[75226]:     <timer name="hpet" present="no"/>
Nov 17 01:33:22 user nova-compute[75226]:   </clock>
Nov 17 01:33:22 user nova-compute[75226]:   <cpu mode="custom" match="exact">
Nov 17 01:33:22 user nova-compute[75226]:     <model>Nehalem</model>
Nov 17 01:33:22 user nova-compute[75226]:     <topology sockets="1" cores="1" threads="1"/>
Nov 17 01:33:22 user nova-compute[75226]:   </cpu>
Nov 17 01:33:22 user nova-compute[75226]:   <devices>
Nov 17 01:33:22 user nova-compute[75226]:     <disk type="file" device="disk">
Nov 17 01:33:22 user nova-compute[75226]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 17 01:33:22 user nova-compute[75226]:       <source file="/opt/stack/data/nova/instances/9e8b4b85-fe0c-4592-850e-e94ebab32d02/disk"/>
Nov 17 01:33:22 user nova-compute[75226]:       <target dev="vda" bus="virtio"/>
Nov 17 01:33:22 user nova-compute[75226]:     </disk>
Nov 17 01:33:22 user nova-compute[75226]:     <interface type="ethernet">
Nov 17 01:33:22 user nova-compute[75226]:       <mac address="fa:16:3e:b6:d6:ba"/>
Nov 17 01:33:22 user nova-compute[75226]:       <model type="virtio"/>
Nov 17 01:33:22 user nova-compute[75226]:       <mtu size="1442"/>
Nov 17 01:33:22 user nova-compute[75226]:       <target dev="tap5e4b278c-6c"/>
Nov 17 01:33:22 user nova-compute[75226]:     </interface>
Nov 17 01:33:22 user nova-compute[75226]:     <serial type="pty">
Nov 17 01:33:22 user nova-compute[75226]:       <log file="/opt/stack/data/nova/instances/9e8b4b85-fe0c-4592-850e-e94ebab32d02/console.log" append="off"/>
Nov 17 01:33:22 user nova-compute[75226]:     </serial>
Nov 17 01:33:22 user nova-compute[75226]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 17 01:33:22 user nova-compute[75226]:     <video>
Nov 17 01:33:22 user nova-compute[75226]:       <model type="virtio"/>
Nov 17 01:33:22 user nova-compute[75226]:     </video>
Nov 17 01:33:22 user nova-compute[75226]:     <rng model="virtio">
Nov 17 01:33:22 user nova-compute[75226]:       <backend model="random">/dev/urandom</backend>
Nov 17 01:33:22 user nova-compute[75226]:     </rng>
Nov 17 01:33:22 user nova-compute[75226]:     <controller type="usb" index="0" model="none"/>
Nov 17 01:33:22 user nova-compute[75226]:     <memballoon model="virtio">
Nov 17 01:33:22 user nova-compute[75226]:       <stats period="10"/>
Nov 17 01:33:22 user nova-compute[75226]:     </memballoon>
Nov 17 01:33:22 user nova-compute[75226]:   </devices>
Nov 17 01:33:22 user nova-compute[75226]: </domain>
Nov 17 01:33:22 user nova-compute[75226]:  {{(pid=75226) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 17 01:33:22 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-6385d986-b5ae-4b0d-a702-6021abeded49 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-17T01:29:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1781762170',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1781762170',id=30,image_ref='63952acd-d41b-45b9-99cd-bd803ca9b101',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1121562331',keypairs=<?>,launch_index=0,launched_at=2023-11-17T01:29:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='1fcdc65b510141e9b7c9a01401a97448',ramdisk_id='',reservation_id='r-b0wngs1h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1321076871',owner_user_name='tempest-AttachVolumeShelveTestJSON-1321076871-project-member',shelved_at='2023-11-17T01:31:26.887987',shelved_host='user',shelved_image_id='63952acd-d41b-45b9-99cd-bd803ca9b101'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T01:33:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2adb9c6cd5c443a7993f6f9d09da6346',uuid=9e8b4b85-fe0c-4592-850e-e94ebab32d02,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "5e4b278c-6c95-4fd1-a215-3fa737694996", "address": "fa:16:3e:b6:d6:ba", "network": {"id": "72724945-89ae-47c2-ac58-ea393837ada6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-308563626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fcdc65b510141e9b7c9a01401a97448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e4b278c-6c", "ovs_interfaceid": "5e4b278c-6c95-4fd1-a215-3fa737694996", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 17 01:33:22 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-6385d986-b5ae-4b0d-a702-6021abeded49 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Converting VIF {"id": "5e4b278c-6c95-4fd1-a215-3fa737694996", "address": "fa:16:3e:b6:d6:ba", "network": {"id": "72724945-89ae-47c2-ac58-ea393837ada6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-308563626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fcdc65b510141e9b7c9a01401a97448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e4b278c-6c", "ovs_interfaceid": "5e4b278c-6c95-4fd1-a215-3fa737694996", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:33:22 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-6385d986-b5ae-4b0d-a702-6021abeded49 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:d6:ba,bridge_name='br-int',has_traffic_filtering=True,id=5e4b278c-6c95-4fd1-a215-3fa737694996,network=Network(72724945-89ae-47c2-ac58-ea393837ada6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e4b278c-6c') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:33:22 user nova-compute[75226]: DEBUG os_vif [None req-6385d986-b5ae-4b0d-a702-6021abeded49 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:d6:ba,bridge_name='br-int',has_traffic_filtering=True,id=5e4b278c-6c95-4fd1-a215-3fa737694996,network=Network(72724945-89ae-47c2-ac58-ea393837ada6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e4b278c-6c') {{(pid=75226) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 17 01:33:22 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:33:22 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:33:22 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 17 01:33:22 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:33:22 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '544f83fc-4eee-5ed8-829e-6e46c329ce98', '_type': 'linux-noop'}}, row=False) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:33:22 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:33:22 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:33:22 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:33:22 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[be428825-6329-4544-ad47-5b17c2df922b]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:33:22 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:33:22 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5e4b278c-6c, may_exist=True, interface_attrs={}) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:33:22 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5e4b278c-6c, col_values=(('qos', UUID('28358dd7-5733-4665-85f4-c7dcb17d5f9e')),), if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:33:22 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5e4b278c-6c, col_values=(('external_ids', {'iface-id': '5e4b278c-6c95-4fd1-a215-3fa737694996', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b6:d6:ba', 'vm-uuid': '9e8b4b85-fe0c-4592-850e-e94ebab32d02'}),), if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:33:22 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-14378e52-95ef-4f45-a431-26d83ba9ac71 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:33:22 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:33:22 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:33:22 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:33:22 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:33:22 user nova-compute[75226]: INFO os_vif [None req-6385d986-b5ae-4b0d-a702-6021abeded49 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:d6:ba,bridge_name='br-int',has_traffic_filtering=True,id=5e4b278c-6c95-4fd1-a215-3fa737694996,network=Network(72724945-89ae-47c2-ac58-ea393837ada6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e4b278c-6c')
Nov 17 01:33:22 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:33:22 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[a725f17d-56b7-48aa-9ba8-4823a5066fdb]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05f878e5-0241-4282-8b2c-c4651c429dcb (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:33:22 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-14378e52-95ef-4f45-a431-26d83ba9ac71 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)
Nov 17 01:33:22 user nova-compute[75226]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05f878e5-0241-4282-8b2c-c4651c429dcb (non-flash)
Nov 17 01:33:22 user nova-compute[75226]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419 (non-flash)
Nov 17 01:33:22 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:33:22 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-14378e52-95ef-4f45-a431-26d83ba9ac71 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)
Nov 17 01:33:22 user nova-compute[75226]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05f878e5-0241-4282-8b2c-c4651c429dcb (non-flash)
Nov 17 01:33:22 user nova-compute[75226]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419 (non-flash)
Nov 17 01:33:22 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:33:22 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-14378e52-95ef-4f45-a431-26d83ba9ac71 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.281s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:33:22 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-14378e52-95ef-4f45-a431-26d83ba9ac71 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Connected to 172.16.0.220:3260 {{(pid=75226) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 17 01:33:22 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-14378e52-95ef-4f45-a431-26d83ba9ac71 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] HCTL ('33', '-', '-', 0) found on session 35 with lun 0 {{(pid=75226) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 17 01:33:22 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-14378e52-95ef-4f45-a431-26d83ba9ac71 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75226) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 17 01:33:22 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:33:22 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:33:22 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9f9a6a1-be3a-4f23-92c2-3045ff988e61]: (4, ('- - 0', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:33:22 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-14378e52-95ef-4f45-a431-26d83ba9ac71 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Searching for a device in session 35 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75226) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 01:33:22 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-14378e52-95ef-4f45-a431-26d83ba9ac71 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VUyvFGLr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75226) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 17 01:33:22 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-6385d986-b5ae-4b0d-a702-6021abeded49 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] No BDM found with device name vda, not building metadata. {{(pid=75226) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 01:33:22 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-6385d986-b5ae-4b0d-a702-6021abeded49 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] No VIF found with MAC fa:16:3e:b6:d6:ba, not building metadata {{(pid=75226) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 01:33:23 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-14378e52-95ef-4f45-a431-26d83ba9ac71 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.314s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:33:23 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-14378e52-95ef-4f45-a431-26d83ba9ac71 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] <== connect_volume: return (1317ms) {'type': 'block', 'scsi_wwn': '23430633864323532', 'path': '/dev/sdb'} {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:33:23 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-14378e52-95ef-4f45-a431-26d83ba9ac71 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: a298d980-feed-4530-9499-f2833b404dcd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23430633864323532', 'path': '/dev/sdb'} {{(pid=75226) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 17 01:33:24 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-14378e52-95ef-4f45-a431-26d83ba9ac71 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:33:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-652050362',display_name='tempest-ServerActionsTestOtherA-server-652050362',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-652050362',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFcMGt3BPMgKZBdescHicrTnz7kyNBHfMwmrFONg75JAKc8VfRVh1PCQT3W5iiYYT6fcflPeuhtfYyaPi/d36jL88Vz6dOEwhdGgUoOilw3GKb90qUp0hFoOK7faoQkiRg==',key_name='tempest-keypair-1413404210',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f9042fe4ecc245dd97553f6e942c3e05',ramdisk_id='',reservation_id='r-e60zxux4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2125452149',owner_user_name='tempest-ServerActionsTestOtherA-2125452149-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T01:33:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a13dd8231937440185c9fc628c3bd5db',uuid=a298d980-feed-4530-9499-f2833b404dcd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "301235a9-5ec1-41f4-8e43-9dc7b20e872d", "address": "fa:16:3e:9a:7d:e3", "network": {"id": "9f39d3e5-b106-4bd9-b8ba-0f326e89c481", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-675861281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9042fe4ecc245dd97553f6e942c3e05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap301235a9-5e", "ovs_interfaceid": "301235a9-5ec1-41f4-8e43-9dc7b20e872d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75226) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 01:33:24 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-14378e52-95ef-4f45-a431-26d83ba9ac71 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Converting VIF {"id": "301235a9-5ec1-41f4-8e43-9dc7b20e872d", "address": "fa:16:3e:9a:7d:e3", "network": {"id": "9f39d3e5-b106-4bd9-b8ba-0f326e89c481", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-675861281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9042fe4ecc245dd97553f6e942c3e05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap301235a9-5e", "ovs_interfaceid": "301235a9-5ec1-41f4-8e43-9dc7b20e872d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:33:24 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-14378e52-95ef-4f45-a431-26d83ba9ac71 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:7d:e3,bridge_name='br-int',has_traffic_filtering=True,id=301235a9-5ec1-41f4-8e43-9dc7b20e872d,network=Network(9f39d3e5-b106-4bd9-b8ba-0f326e89c481),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap301235a9-5e') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:33:24 user nova-compute[75226]: DEBUG nova.objects.instance [None req-14378e52-95ef-4f45-a431-26d83ba9ac71 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Lazy-loading 'pci_devices' on Instance uuid a298d980-feed-4530-9499-f2833b404dcd {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:33:24 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-14378e52-95ef-4f45-a431-26d83ba9ac71 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: a298d980-feed-4530-9499-f2833b404dcd] End _get_guest_xml xml=<domain type="kvm">
Nov 17 01:33:24 user nova-compute[75226]:   <uuid>a298d980-feed-4530-9499-f2833b404dcd</uuid>
Nov 17 01:33:24 user nova-compute[75226]:   <name>instance-00000021</name>
Nov 17 01:33:24 user nova-compute[75226]:   <memory>524288</memory>
Nov 17 01:33:24 user nova-compute[75226]:   <vcpu>1</vcpu>
Nov 17 01:33:24 user nova-compute[75226]:   <metadata>
Nov 17 01:33:24 user nova-compute[75226]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 17 01:33:24 user nova-compute[75226]:       <nova:package version="0.0.0"/>
Nov 17 01:33:24 user nova-compute[75226]:       <nova:name>tempest-ServerActionsTestOtherA-server-652050362</nova:name>
Nov 17 01:33:24 user nova-compute[75226]:       <nova:creationTime>2023-11-17 01:33:22</nova:creationTime>
Nov 17 01:33:24 user nova-compute[75226]:       <nova:flavor name="m1.tiny">
Nov 17 01:33:24 user nova-compute[75226]:         <nova:memory>512</nova:memory>
Nov 17 01:33:24 user nova-compute[75226]:         <nova:disk>1</nova:disk>
Nov 17 01:33:24 user nova-compute[75226]:         <nova:swap>0</nova:swap>
Nov 17 01:33:24 user nova-compute[75226]:         <nova:ephemeral>0</nova:ephemeral>
Nov 17 01:33:24 user nova-compute[75226]:         <nova:vcpus>1</nova:vcpus>
Nov 17 01:33:24 user nova-compute[75226]:       </nova:flavor>
Nov 17 01:33:24 user nova-compute[75226]:       <nova:owner>
Nov 17 01:33:24 user nova-compute[75226]:         <nova:user uuid="a13dd8231937440185c9fc628c3bd5db">tempest-ServerActionsTestOtherA-2125452149-project-member</nova:user>
Nov 17 01:33:24 user nova-compute[75226]:         <nova:project uuid="f9042fe4ecc245dd97553f6e942c3e05">tempest-ServerActionsTestOtherA-2125452149</nova:project>
Nov 17 01:33:24 user nova-compute[75226]:       </nova:owner>
Nov 17 01:33:24 user nova-compute[75226]:       <nova:ports>
Nov 17 01:33:24 user nova-compute[75226]:         <nova:port uuid="301235a9-5ec1-41f4-8e43-9dc7b20e872d">
Nov 17 01:33:24 user nova-compute[75226]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 17 01:33:24 user nova-compute[75226]:         </nova:port>
Nov 17 01:33:24 user nova-compute[75226]:       </nova:ports>
Nov 17 01:33:24 user nova-compute[75226]:     </nova:instance>
Nov 17 01:33:24 user nova-compute[75226]:   </metadata>
Nov 17 01:33:24 user nova-compute[75226]:   <sysinfo type="smbios">
Nov 17 01:33:24 user nova-compute[75226]:     <system>
Nov 17 01:33:24 user nova-compute[75226]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 17 01:33:24 user nova-compute[75226]:       <entry name="product">OpenStack Nova</entry>
Nov 17 01:33:24 user nova-compute[75226]:       <entry name="version">0.0.0</entry>
Nov 17 01:33:24 user nova-compute[75226]:       <entry name="serial">a298d980-feed-4530-9499-f2833b404dcd</entry>
Nov 17 01:33:24 user nova-compute[75226]:       <entry name="uuid">a298d980-feed-4530-9499-f2833b404dcd</entry>
Nov 17 01:33:24 user nova-compute[75226]:       <entry name="family">Virtual Machine</entry>
Nov 17 01:33:24 user nova-compute[75226]:     </system>
Nov 17 01:33:24 user nova-compute[75226]:   </sysinfo>
Nov 17 01:33:24 user nova-compute[75226]:   <os>
Nov 17 01:33:24 user nova-compute[75226]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 17 01:33:24 user nova-compute[75226]:     <boot dev="hd"/>
Nov 17 01:33:24 user nova-compute[75226]:     <smbios mode="sysinfo"/>
Nov 17 01:33:24 user nova-compute[75226]:   </os>
Nov 17 01:33:24 user nova-compute[75226]:   <features>
Nov 17 01:33:24 user nova-compute[75226]:     <acpi/>
Nov 17 01:33:24 user nova-compute[75226]:     <apic/>
Nov 17 01:33:24 user nova-compute[75226]:     <vmcoreinfo/>
Nov 17 01:33:24 user nova-compute[75226]:   </features>
Nov 17 01:33:24 user nova-compute[75226]:   <clock offset="utc">
Nov 17 01:33:24 user nova-compute[75226]:     <timer name="pit" tickpolicy="delay"/>
Nov 17 01:33:24 user nova-compute[75226]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 17 01:33:24 user nova-compute[75226]:     <timer name="hpet" present="no"/>
Nov 17 01:33:24 user nova-compute[75226]:   </clock>
Nov 17 01:33:24 user nova-compute[75226]:   <cpu mode="custom" match="exact">
Nov 17 01:33:24 user nova-compute[75226]:     <model>Nehalem</model>
Nov 17 01:33:24 user nova-compute[75226]:     <topology sockets="1" cores="1" threads="1"/>
Nov 17 01:33:24 user nova-compute[75226]:   </cpu>
Nov 17 01:33:24 user nova-compute[75226]:   <devices>
Nov 17 01:33:24 user nova-compute[75226]:     <disk type="block" device="disk">
Nov 17 01:33:24 user nova-compute[75226]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 01:33:24 user nova-compute[75226]:       <source dev="/dev/sdb"/>
Nov 17 01:33:24 user nova-compute[75226]:       <target dev="vda" bus="virtio"/>
Nov 17 01:33:24 user nova-compute[75226]:       <serial>c9b3d0d6-bd04-414b-99e5-da9402f5f419</serial>
Nov 17 01:33:24 user nova-compute[75226]:     </disk>
Nov 17 01:33:24 user nova-compute[75226]:     <interface type="ethernet">
Nov 17 01:33:24 user nova-compute[75226]:       <mac address="fa:16:3e:9a:7d:e3"/>
Nov 17 01:33:24 user nova-compute[75226]:       <model type="virtio"/>
Nov 17 01:33:24 user nova-compute[75226]:       <mtu size="1442"/>
Nov 17 01:33:24 user nova-compute[75226]:       <target dev="tap301235a9-5e"/>
Nov 17 01:33:24 user nova-compute[75226]:     </interface>
Nov 17 01:33:24 user nova-compute[75226]:     <serial type="pty">
Nov 17 01:33:24 user nova-compute[75226]:       <log file="/opt/stack/data/nova/instances/a298d980-feed-4530-9499-f2833b404dcd/console.log" append="off"/>
Nov 17 01:33:24 user nova-compute[75226]:     </serial>
Nov 17 01:33:24 user nova-compute[75226]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 17 01:33:24 user nova-compute[75226]:     <video>
Nov 17 01:33:24 user nova-compute[75226]:       <model type="virtio"/>
Nov 17 01:33:24 user nova-compute[75226]:     </video>
Nov 17 01:33:24 user nova-compute[75226]:     <rng model="virtio">
Nov 17 01:33:24 user nova-compute[75226]:       <backend model="random">/dev/urandom</backend>
Nov 17 01:33:24 user nova-compute[75226]:     </rng>
Nov 17 01:33:24 user nova-compute[75226]:     <controller type="usb" index="0" model="none"/>
Nov 17 01:33:24 user nova-compute[75226]:     <memballoon model="virtio">
Nov 17 01:33:24 user nova-compute[75226]:       <stats period="10"/>
Nov 17 01:33:24 user nova-compute[75226]:     </memballoon>
Nov 17 01:33:24 user nova-compute[75226]:   </devices>
Nov 17 01:33:24 user nova-compute[75226]: </domain>
Nov 17 01:33:24 user nova-compute[75226]:  {{(pid=75226) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 17 01:33:24 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-14378e52-95ef-4f45-a431-26d83ba9ac71 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:33:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-652050362',display_name='tempest-ServerActionsTestOtherA-server-652050362',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-652050362',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFcMGt3BPMgKZBdescHicrTnz7kyNBHfMwmrFONg75JAKc8VfRVh1PCQT3W5iiYYT6fcflPeuhtfYyaPi/d36jL88Vz6dOEwhdGgUoOilw3GKb90qUp0hFoOK7faoQkiRg==',key_name='tempest-keypair-1413404210',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f9042fe4ecc245dd97553f6e942c3e05',ramdisk_id='',reservation_id='r-e60zxux4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2125452149',owner_user_name='tempest-ServerActionsTestOtherA-2125452149-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T01:33:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a13dd8231937440185c9fc628c3bd5db',uuid=a298d980-feed-4530-9499-f2833b404dcd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "301235a9-5ec1-41f4-8e43-9dc7b20e872d", "address": "fa:16:3e:9a:7d:e3", "network": {"id": "9f39d3e5-b106-4bd9-b8ba-0f326e89c481", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-675861281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9042fe4ecc245dd97553f6e942c3e05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap301235a9-5e", "ovs_interfaceid": "301235a9-5ec1-41f4-8e43-9dc7b20e872d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 17 01:33:24 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-14378e52-95ef-4f45-a431-26d83ba9ac71 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Converting VIF {"id": "301235a9-5ec1-41f4-8e43-9dc7b20e872d", "address": "fa:16:3e:9a:7d:e3", "network": {"id": "9f39d3e5-b106-4bd9-b8ba-0f326e89c481", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-675861281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9042fe4ecc245dd97553f6e942c3e05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap301235a9-5e", "ovs_interfaceid": "301235a9-5ec1-41f4-8e43-9dc7b20e872d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:33:24 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-14378e52-95ef-4f45-a431-26d83ba9ac71 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:7d:e3,bridge_name='br-int',has_traffic_filtering=True,id=301235a9-5ec1-41f4-8e43-9dc7b20e872d,network=Network(9f39d3e5-b106-4bd9-b8ba-0f326e89c481),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap301235a9-5e') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:33:24 user nova-compute[75226]: DEBUG os_vif [None req-14378e52-95ef-4f45-a431-26d83ba9ac71 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:7d:e3,bridge_name='br-int',has_traffic_filtering=True,id=301235a9-5ec1-41f4-8e43-9dc7b20e872d,network=Network(9f39d3e5-b106-4bd9-b8ba-0f326e89c481),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap301235a9-5e') {{(pid=75226) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 17 01:33:24 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:33:24 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:33:24 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 17 01:33:24 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:33:24 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '187ace96-20c3-57ec-a7d5-8a0bae3c8163', '_type': 'linux-noop'}}, row=False) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:33:24 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:33:24 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:33:24 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:33:24 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:33:24 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap301235a9-5e, may_exist=True, interface_attrs={}) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:33:24 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap301235a9-5e, col_values=(('qos', UUID('c13e8cd0-354b-41e1-9ad7-0cb352fa2645')),), if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:33:24 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap301235a9-5e, col_values=(('external_ids', {'iface-id': '301235a9-5ec1-41f4-8e43-9dc7b20e872d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9a:7d:e3', 'vm-uuid': 'a298d980-feed-4530-9499-f2833b404dcd'}),), if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:33:24 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:33:24 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:33:24 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:33:24 user nova-compute[75226]: INFO os_vif [None req-14378e52-95ef-4f45-a431-26d83ba9ac71 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:7d:e3,bridge_name='br-int',has_traffic_filtering=True,id=301235a9-5ec1-41f4-8e43-9dc7b20e872d,network=Network(9f39d3e5-b106-4bd9-b8ba-0f326e89c481),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap301235a9-5e')
Nov 17 01:33:24 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-14378e52-95ef-4f45-a431-26d83ba9ac71 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] No BDM found with device name vda, not building metadata. {{(pid=75226) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 01:33:24 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-14378e52-95ef-4f45-a431-26d83ba9ac71 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] No VIF found with MAC fa:16:3e:9a:7d:e3, not building metadata {{(pid=75226) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 01:33:24 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:33:24 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:33:24 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:33:24 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:33:24 user nova-compute[75226]: DEBUG nova.compute.manager [req-56ac2eab-c9ec-4949-a80b-a3c514021c2c req-3283973c-dd75-49fd-8ba7-051ad1260ac8 service nova] [instance: 9e8b4b85-fe0c-4592-850e-e94ebab32d02] Received event network-vif-plugged-5e4b278c-6c95-4fd1-a215-3fa737694996 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:33:24 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-56ac2eab-c9ec-4949-a80b-a3c514021c2c req-3283973c-dd75-49fd-8ba7-051ad1260ac8 service nova] Acquiring lock "9e8b4b85-fe0c-4592-850e-e94ebab32d02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:33:24 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-56ac2eab-c9ec-4949-a80b-a3c514021c2c req-3283973c-dd75-49fd-8ba7-051ad1260ac8 service nova] Lock "9e8b4b85-fe0c-4592-850e-e94ebab32d02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:33:24 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-56ac2eab-c9ec-4949-a80b-a3c514021c2c req-3283973c-dd75-49fd-8ba7-051ad1260ac8 service nova] Lock "9e8b4b85-fe0c-4592-850e-e94ebab32d02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:33:24 user nova-compute[75226]: DEBUG nova.compute.manager [req-56ac2eab-c9ec-4949-a80b-a3c514021c2c req-3283973c-dd75-49fd-8ba7-051ad1260ac8 service nova] [instance: 9e8b4b85-fe0c-4592-850e-e94ebab32d02] No waiting events found dispatching network-vif-plugged-5e4b278c-6c95-4fd1-a215-3fa737694996 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:33:24 user nova-compute[75226]: WARNING nova.compute.manager [req-56ac2eab-c9ec-4949-a80b-a3c514021c2c req-3283973c-dd75-49fd-8ba7-051ad1260ac8 service nova] [instance: 9e8b4b85-fe0c-4592-850e-e94ebab32d02] Received unexpected event network-vif-plugged-5e4b278c-6c95-4fd1-a215-3fa737694996 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 17 01:33:25 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:33:25 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:33:25 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:33:25 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:33:25 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:33:25 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:33:25 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:33:25 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:33:26 user nova-compute[75226]: DEBUG nova.compute.manager [req-9cbf8832-c31a-47b8-979e-f6bde442e95b req-6f0963c4-d185-4a9e-992e-ad4bd018cddc service nova] [instance: a298d980-feed-4530-9499-f2833b404dcd] Received event network-vif-plugged-301235a9-5ec1-41f4-8e43-9dc7b20e872d {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:33:26 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-9cbf8832-c31a-47b8-979e-f6bde442e95b req-6f0963c4-d185-4a9e-992e-ad4bd018cddc service nova] Acquiring lock "a298d980-feed-4530-9499-f2833b404dcd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:33:26 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-9cbf8832-c31a-47b8-979e-f6bde442e95b req-6f0963c4-d185-4a9e-992e-ad4bd018cddc service nova] Lock "a298d980-feed-4530-9499-f2833b404dcd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:33:26 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-9cbf8832-c31a-47b8-979e-f6bde442e95b req-6f0963c4-d185-4a9e-992e-ad4bd018cddc service nova] Lock "a298d980-feed-4530-9499-f2833b404dcd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:33:26 user nova-compute[75226]: DEBUG nova.compute.manager [req-9cbf8832-c31a-47b8-979e-f6bde442e95b req-6f0963c4-d185-4a9e-992e-ad4bd018cddc service nova] [instance: a298d980-feed-4530-9499-f2833b404dcd] No waiting events found dispatching network-vif-plugged-301235a9-5ec1-41f4-8e43-9dc7b20e872d {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:33:26 user nova-compute[75226]: WARNING nova.compute.manager [req-9cbf8832-c31a-47b8-979e-f6bde442e95b req-6f0963c4-d185-4a9e-992e-ad4bd018cddc service nova] [instance: a298d980-feed-4530-9499-f2833b404dcd] Received unexpected event network-vif-plugged-301235a9-5ec1-41f4-8e43-9dc7b20e872d for instance with vm_state building and task_state spawning.
Nov 17 01:33:26 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:33:26 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:33:26 user nova-compute[75226]: DEBUG nova.compute.manager [req-0dd75c4a-d175-4370-b6fc-653a360e1918 req-bd8f809b-9597-4346-843b-2c096bc39843 service nova] [instance: 9e8b4b85-fe0c-4592-850e-e94ebab32d02] Received event network-vif-plugged-5e4b278c-6c95-4fd1-a215-3fa737694996 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:33:26 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-0dd75c4a-d175-4370-b6fc-653a360e1918 req-bd8f809b-9597-4346-843b-2c096bc39843 service nova] Acquiring lock "9e8b4b85-fe0c-4592-850e-e94ebab32d02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:33:26 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-0dd75c4a-d175-4370-b6fc-653a360e1918 req-bd8f809b-9597-4346-843b-2c096bc39843 service nova] Lock "9e8b4b85-fe0c-4592-850e-e94ebab32d02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:33:26 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-0dd75c4a-d175-4370-b6fc-653a360e1918 req-bd8f809b-9597-4346-843b-2c096bc39843 service nova] Lock "9e8b4b85-fe0c-4592-850e-e94ebab32d02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:33:26 user nova-compute[75226]: DEBUG nova.compute.manager [req-0dd75c4a-d175-4370-b6fc-653a360e1918 req-bd8f809b-9597-4346-843b-2c096bc39843 service nova] [instance: 9e8b4b85-fe0c-4592-850e-e94ebab32d02] No waiting events found dispatching network-vif-plugged-5e4b278c-6c95-4fd1-a215-3fa737694996 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:33:26 user nova-compute[75226]: WARNING nova.compute.manager [req-0dd75c4a-d175-4370-b6fc-653a360e1918 req-bd8f809b-9597-4346-843b-2c096bc39843 service nova] [instance: 9e8b4b85-fe0c-4592-850e-e94ebab32d02] Received unexpected event network-vif-plugged-5e4b278c-6c95-4fd1-a215-3fa737694996 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 17 01:33:27 user nova-compute[75226]: DEBUG nova.compute.manager [None req-6385d986-b5ae-4b0d-a702-6021abeded49 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] [instance: 9e8b4b85-fe0c-4592-850e-e94ebab32d02] Instance event wait completed in 0 seconds for  {{(pid=75226) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 17 01:33:27 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-6385d986-b5ae-4b0d-a702-6021abeded49 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] [instance: 9e8b4b85-fe0c-4592-850e-e94ebab32d02] Guest created on hypervisor {{(pid=75226) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 17 01:33:27 user nova-compute[75226]: INFO nova.virt.libvirt.driver [-] [instance: 9e8b4b85-fe0c-4592-850e-e94ebab32d02] Instance spawned successfully.
Nov 17 01:33:27 user nova-compute[75226]: DEBUG nova.compute.manager [None req-6385d986-b5ae-4b0d-a702-6021abeded49 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] [instance: 9e8b4b85-fe0c-4592-850e-e94ebab32d02] Checking state {{(pid=75226) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 01:33:27 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-6385d986-b5ae-4b0d-a702-6021abeded49 tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Lock "9e8b4b85-fe0c-4592-850e-e94ebab32d02" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 12.034s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:33:28 user nova-compute[75226]: DEBUG nova.compute.manager [None req-14378e52-95ef-4f45-a431-26d83ba9ac71 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: a298d980-feed-4530-9499-f2833b404dcd] Instance event wait completed in 0 seconds for  {{(pid=75226) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 17 01:33:28 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-14378e52-95ef-4f45-a431-26d83ba9ac71 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: a298d980-feed-4530-9499-f2833b404dcd] Guest created on hypervisor {{(pid=75226) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 17 01:33:28 user nova-compute[75226]: INFO nova.virt.libvirt.driver [-] [instance: a298d980-feed-4530-9499-f2833b404dcd] Instance spawned successfully.
Nov 17 01:33:28 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-14378e52-95ef-4f45-a431-26d83ba9ac71 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: a298d980-feed-4530-9499-f2833b404dcd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 17 01:33:28 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-14378e52-95ef-4f45-a431-26d83ba9ac71 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: a298d980-feed-4530-9499-f2833b404dcd] Found default for hw_cdrom_bus of ide {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:33:28 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-14378e52-95ef-4f45-a431-26d83ba9ac71 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: a298d980-feed-4530-9499-f2833b404dcd] Found default for hw_disk_bus of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:33:28 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-14378e52-95ef-4f45-a431-26d83ba9ac71 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: a298d980-feed-4530-9499-f2833b404dcd] Found default for hw_input_bus of None {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:33:28 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-14378e52-95ef-4f45-a431-26d83ba9ac71 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: a298d980-feed-4530-9499-f2833b404dcd] Found default for hw_pointer_model of None {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:33:28 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-14378e52-95ef-4f45-a431-26d83ba9ac71 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: a298d980-feed-4530-9499-f2833b404dcd] Found default for hw_video_model of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:33:28 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-14378e52-95ef-4f45-a431-26d83ba9ac71 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: a298d980-feed-4530-9499-f2833b404dcd] Found default for hw_vif_model of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:33:28 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:33:28 user nova-compute[75226]: INFO nova.compute.manager [None req-14378e52-95ef-4f45-a431-26d83ba9ac71 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: a298d980-feed-4530-9499-f2833b404dcd] Took 5.54 seconds to spawn the instance on the hypervisor.
Nov 17 01:33:28 user nova-compute[75226]: DEBUG nova.compute.manager [None req-14378e52-95ef-4f45-a431-26d83ba9ac71 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: a298d980-feed-4530-9499-f2833b404dcd] Checking state {{(pid=75226) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 01:33:28 user nova-compute[75226]: DEBUG nova.compute.manager [req-c0c674ef-d692-48e2-be08-849fb2740fc8 req-0076ba48-ec08-4a99-a092-77f9f4f4047e service nova] [instance: a298d980-feed-4530-9499-f2833b404dcd] Received event network-vif-plugged-301235a9-5ec1-41f4-8e43-9dc7b20e872d {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:33:28 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-c0c674ef-d692-48e2-be08-849fb2740fc8 req-0076ba48-ec08-4a99-a092-77f9f4f4047e service nova] Acquiring lock "a298d980-feed-4530-9499-f2833b404dcd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:33:28 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-c0c674ef-d692-48e2-be08-849fb2740fc8 req-0076ba48-ec08-4a99-a092-77f9f4f4047e service nova] Lock "a298d980-feed-4530-9499-f2833b404dcd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:33:28 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-c0c674ef-d692-48e2-be08-849fb2740fc8 req-0076ba48-ec08-4a99-a092-77f9f4f4047e service nova] Lock "a298d980-feed-4530-9499-f2833b404dcd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:33:28 user nova-compute[75226]: DEBUG nova.compute.manager [req-c0c674ef-d692-48e2-be08-849fb2740fc8 req-0076ba48-ec08-4a99-a092-77f9f4f4047e service nova] [instance: a298d980-feed-4530-9499-f2833b404dcd] No waiting events found dispatching network-vif-plugged-301235a9-5ec1-41f4-8e43-9dc7b20e872d {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:33:28 user nova-compute[75226]: WARNING nova.compute.manager [req-c0c674ef-d692-48e2-be08-849fb2740fc8 req-0076ba48-ec08-4a99-a092-77f9f4f4047e service nova] [instance: a298d980-feed-4530-9499-f2833b404dcd] Received unexpected event network-vif-plugged-301235a9-5ec1-41f4-8e43-9dc7b20e872d for instance with vm_state building and task_state spawning.
Nov 17 01:33:28 user nova-compute[75226]: INFO nova.compute.manager [None req-14378e52-95ef-4f45-a431-26d83ba9ac71 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: a298d980-feed-4530-9499-f2833b404dcd] Took 14.66 seconds to build instance.
Nov 17 01:33:28 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-14378e52-95ef-4f45-a431-26d83ba9ac71 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Lock "a298d980-feed-4530-9499-f2833b404dcd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.773s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:33:29 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:33:30 user nova-compute[75226]: DEBUG nova.compute.manager [req-4993e2e9-3b89-4af3-a991-d072e09017b1 req-f1c383b4-ef53-4b6a-9d47-65345c543da5 service nova] [instance: dae5490b-e434-4cd1-b8d4-6baab9bb7345] Received event network-changed-09413dab-7bc1-4c16-9486-ce6e790b72e1 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:33:30 user nova-compute[75226]: DEBUG nova.compute.manager [req-4993e2e9-3b89-4af3-a991-d072e09017b1 req-f1c383b4-ef53-4b6a-9d47-65345c543da5 service nova] [instance: dae5490b-e434-4cd1-b8d4-6baab9bb7345] Refreshing instance network info cache due to event network-changed-09413dab-7bc1-4c16-9486-ce6e790b72e1. {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 01:33:30 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-4993e2e9-3b89-4af3-a991-d072e09017b1 req-f1c383b4-ef53-4b6a-9d47-65345c543da5 service nova] Acquiring lock "refresh_cache-dae5490b-e434-4cd1-b8d4-6baab9bb7345" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:33:30 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-4993e2e9-3b89-4af3-a991-d072e09017b1 req-f1c383b4-ef53-4b6a-9d47-65345c543da5 service nova] Acquired lock "refresh_cache-dae5490b-e434-4cd1-b8d4-6baab9bb7345" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:33:30 user nova-compute[75226]: DEBUG nova.network.neutron [req-4993e2e9-3b89-4af3-a991-d072e09017b1 req-f1c383b4-ef53-4b6a-9d47-65345c543da5 service nova] [instance: dae5490b-e434-4cd1-b8d4-6baab9bb7345] Refreshing network info cache for port 09413dab-7bc1-4c16-9486-ce6e790b72e1 {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 01:33:30 user nova-compute[75226]: DEBUG nova.network.neutron [req-4993e2e9-3b89-4af3-a991-d072e09017b1 req-f1c383b4-ef53-4b6a-9d47-65345c543da5 service nova] [instance: dae5490b-e434-4cd1-b8d4-6baab9bb7345] Updated VIF entry in instance network info cache for port 09413dab-7bc1-4c16-9486-ce6e790b72e1. {{(pid=75226) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 01:33:30 user nova-compute[75226]: DEBUG nova.network.neutron [req-4993e2e9-3b89-4af3-a991-d072e09017b1 req-f1c383b4-ef53-4b6a-9d47-65345c543da5 service nova] [instance: dae5490b-e434-4cd1-b8d4-6baab9bb7345] Updating instance_info_cache with network_info: [{"id": "09413dab-7bc1-4c16-9486-ce6e790b72e1", "address": "fa:16:3e:82:cf:64", "network": {"id": "57d0e7ee-0b11-4e00-86f9-bb4a3c25c674", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1357446034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e38777e8baf745e79f31190da97406a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09413dab-7b", "ovs_interfaceid": "09413dab-7bc1-4c16-9486-ce6e790b72e1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:33:30 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-4993e2e9-3b89-4af3-a991-d072e09017b1 req-f1c383b4-ef53-4b6a-9d47-65345c543da5 service nova] Releasing lock "refresh_cache-dae5490b-e434-4cd1-b8d4-6baab9bb7345" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:33:32 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-cb2217a9-a9f3-47aa-8c83-8429404bacfe tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Acquiring lock "dae5490b-e434-4cd1-b8d4-6baab9bb7345" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:33:32 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-cb2217a9-a9f3-47aa-8c83-8429404bacfe tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Lock "dae5490b-e434-4cd1-b8d4-6baab9bb7345" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:33:32 user nova-compute[75226]: DEBUG nova.objects.instance [None req-cb2217a9-a9f3-47aa-8c83-8429404bacfe tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Lazy-loading 'flavor' on Instance uuid dae5490b-e434-4cd1-b8d4-6baab9bb7345 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:33:32 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-cb2217a9-a9f3-47aa-8c83-8429404bacfe tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Lock "dae5490b-e434-4cd1-b8d4-6baab9bb7345" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:33:32 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-cb2217a9-a9f3-47aa-8c83-8429404bacfe tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Acquiring lock "dae5490b-e434-4cd1-b8d4-6baab9bb7345" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:33:32 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-cb2217a9-a9f3-47aa-8c83-8429404bacfe tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Lock "dae5490b-e434-4cd1-b8d4-6baab9bb7345" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:33:32 user nova-compute[75226]: INFO nova.compute.manager [None req-cb2217a9-a9f3-47aa-8c83-8429404bacfe tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: dae5490b-e434-4cd1-b8d4-6baab9bb7345] Attaching volume 579abcf6-d3e0-485f-91d4-c939c836ab1b to /dev/vdb
Nov 17 01:33:32 user nova-compute[75226]: DEBUG os_brick.utils [None req-cb2217a9-a9f3-47aa-8c83-8429404bacfe tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:33:32 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:33:32 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:33:32 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[6483ec1c-9a5f-4aec-854e-ecac397fa3c9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f62857db69\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:33:32 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:33:32 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:33:32 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[b28070a3-be91-42bc-893e-5d4a57881496]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:33:32 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:33:32 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.062s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:33:32 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[15f67f2c-a83f-43c8-83e8-78a7d0e3dba4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:33:32 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3cc5257-a656-41a8-94d8-ee76b5118ea1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:33:32 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-cb2217a9-a9f3-47aa-8c83-8429404bacfe tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Running cmd (subprocess): nvme version {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:33:32 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-cb2217a9-a9f3-47aa-8c83-8429404bacfe tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] 'nvme version' failed. Not Retrying. {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 01:33:32 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cb2217a9-a9f3-47aa-8c83-8429404bacfe tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] nvme not present on system {{(pid=75226) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 17 01:33:32 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:33:32 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 01:33:32 user nova-compute[75226]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 17 01:33:32 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3a24f3d-8570-4581-9a33-59261ee8321a]: (4, '') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:33:32 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-cb2217a9-a9f3-47aa-8c83-8429404bacfe tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75226) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 17 01:33:32 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-cb2217a9-a9f3-47aa-8c83-8429404bacfe tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75226) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 17 01:33:32 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-cb2217a9-a9f3-47aa-8c83-8429404bacfe tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] LIGHTOS: no hostnqn found. {{(pid=75226) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 17 01:33:32 user nova-compute[75226]: DEBUG os_brick.utils [None req-cb2217a9-a9f3-47aa-8c83-8429404bacfe tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] <== get_connector_properties: return (179ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f62857db69', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:33:32 user nova-compute[75226]: DEBUG nova.virt.block_device [None req-cb2217a9-a9f3-47aa-8c83-8429404bacfe tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: dae5490b-e434-4cd1-b8d4-6baab9bb7345] Updating existing volume attachment record: 2abdf7bb-89fe-41d4-af9c-0501d7b6ca73 {{(pid=75226) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 17 01:33:33 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:33:34 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:33:38 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:33:38 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb2217a9-a9f3-47aa-8c83-8429404bacfe tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: dae5490b-e434-4cd1-b8d4-6baab9bb7345] Calling os-brick to attach iSCSI Volume {{(pid=75226) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 17 01:33:38 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb2217a9-a9f3-47aa-8c83-8429404bacfe tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc4cc36b490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:579abcf6-d3e0-485f-91d4-c939c836ab1b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PTUpmGof', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:33:38 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-cb2217a9-a9f3-47aa-8c83-8429404bacfe tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:33:38 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-cb2217a9-a9f3-47aa-8c83-8429404bacfe tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:33:38 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-cb2217a9-a9f3-47aa-8c83-8429404bacfe tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:33:38 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-cb2217a9-a9f3-47aa-8c83-8429404bacfe tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:33:38 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-cb2217a9-a9f3-47aa-8c83-8429404bacfe tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:579abcf6-d3e0-485f-91d4-c939c836ab1b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:33:38 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-cb2217a9-a9f3-47aa-8c83-8429404bacfe tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:579abcf6-d3e0-485f-91d4-c939c836ab1b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:33:38 user nova-compute[75226]: INFO os_brick.initiator.connectors.iscsi [None req-cb2217a9-a9f3-47aa-8c83-8429404bacfe tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 17 01:33:38 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:579abcf6-d3e0-485f-91d4-c939c836ab1b -p 172.16.0.220:3260 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:33:38 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:579abcf6-d3e0-485f-91d4-c939c836ab1b -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:33:38 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee85bcd0-9ccc-4631-8a83-fd84e694d190]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:33:38 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb2217a9-a9f3-47aa-8c83-8429404bacfe tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 17 01:33:38 user nova-compute[75226]:  {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:33:38 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:579abcf6-d3e0-485f-91d4-c939c836ab1b -p 172.16.0.220:3260 --interface default --op new {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:33:38 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:579abcf6-d3e0-485f-91d4-c939c836ab1b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:33:38 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[167b957f-c31f-4609-b6ae-7192ffd2dd99]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:579abcf6-d3e0-485f-91d4-c939c836ab1b] added\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:33:38 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb2217a9-a9f3-47aa-8c83-8429404bacfe tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:579abcf6-d3e0-485f-91d4-c939c836ab1b] added
Nov 17 01:33:38 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:33:38 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:579abcf6-d3e0-485f-91d4-c939c836ab1b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:33:38 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:579abcf6-d3e0-485f-91d4-c939c836ab1b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:33:38 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bc64539-0121-4a78-b3e7-6b2e12f380d2]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:33:38 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb2217a9-a9f3-47aa-8c83-8429404bacfe tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:33:38 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:579abcf6-d3e0-485f-91d4-c939c836ab1b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:33:38 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:579abcf6-d3e0-485f-91d4-c939c836ab1b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:33:38 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4f59fa8-f563-4080-b787-2227745ceb22]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:33:38 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb2217a9-a9f3-47aa-8c83-8429404bacfe tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:33:38 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:579abcf6-d3e0-485f-91d4-c939c836ab1b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PTUpmGof {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:33:38 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:579abcf6-d3e0-485f-91d4-c939c836ab1b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PTUpmGof" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:33:38 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[642d8bc5-79ee-4574-b7e2-b22d3a3936b8]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:33:38 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb2217a9-a9f3-47aa-8c83-8429404bacfe tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PTUpmGof'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:33:38 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:579abcf6-d3e0-485f-91d4-c939c836ab1b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:33:38 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:579abcf6-d3e0-485f-91d4-c939c836ab1b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:33:38 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[5148edc1-baab-4c80-8b48-46dfb60cb3ce]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:33:38 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb2217a9-a9f3-47aa-8c83-8429404bacfe tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:33:38 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:33:38 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:33:38 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fe8089f-8393-4960-a5cb-e2f91e3967fb]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05f878e5-0241-4282-8b2c-c4651c429dcb (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:33:38 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb2217a9-a9f3-47aa-8c83-8429404bacfe tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)
Nov 17 01:33:38 user nova-compute[75226]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05f878e5-0241-4282-8b2c-c4651c429dcb (non-flash)
Nov 17 01:33:38 user nova-compute[75226]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419 (non-flash)
Nov 17 01:33:38 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:33:38 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb2217a9-a9f3-47aa-8c83-8429404bacfe tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)
Nov 17 01:33:38 user nova-compute[75226]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05f878e5-0241-4282-8b2c-c4651c429dcb (non-flash)
Nov 17 01:33:38 user nova-compute[75226]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419 (non-flash)
Nov 17 01:33:38 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:33:38 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:579abcf6-d3e0-485f-91d4-c939c836ab1b -p 172.16.0.220:3260 --login {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:33:38 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:579abcf6-d3e0-485f-91d4-c939c836ab1b -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:33:38 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e771bdf-1b43-42c6-a9ed-5553381eb454]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:579abcf6-d3e0-485f-91d4-c939c836ab1b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:579abcf6-d3e0-485f-91d4-c939c836ab1b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:33:38 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb2217a9-a9f3-47aa-8c83-8429404bacfe tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:579abcf6-d3e0-485f-91d4-c939c836ab1b, portal: 172.16.0.220,3260]
Nov 17 01:33:38 user nova-compute[75226]: Login to [iface: default, target: iqn.2010-10.org.openstack:579abcf6-d3e0-485f-91d4-c939c836ab1b, portal: 172.16.0.220,3260] successful.
Nov 17 01:33:38 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:33:38 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:579abcf6-d3e0-485f-91d4-c939c836ab1b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:33:38 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:579abcf6-d3e0-485f-91d4-c939c836ab1b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:33:38 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[39123f6c-8d47-45f8-af0c-b4c396094de4]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:33:38 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb2217a9-a9f3-47aa-8c83-8429404bacfe tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:33:38 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:33:38 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:33:38 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b805f0a-4c0b-48e1-931a-924e130d49bb]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05f878e5-0241-4282-8b2c-c4651c429dcb (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:579abcf6-d3e0-485f-91d4-c939c836ab1b (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:33:38 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb2217a9-a9f3-47aa-8c83-8429404bacfe tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)
Nov 17 01:33:38 user nova-compute[75226]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05f878e5-0241-4282-8b2c-c4651c429dcb (non-flash)
Nov 17 01:33:38 user nova-compute[75226]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419 (non-flash)
Nov 17 01:33:38 user nova-compute[75226]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:579abcf6-d3e0-485f-91d4-c939c836ab1b (non-flash)
Nov 17 01:33:38 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:33:38 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb2217a9-a9f3-47aa-8c83-8429404bacfe tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)
Nov 17 01:33:38 user nova-compute[75226]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05f878e5-0241-4282-8b2c-c4651c429dcb (non-flash)
Nov 17 01:33:38 user nova-compute[75226]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419 (non-flash)
Nov 17 01:33:38 user nova-compute[75226]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:579abcf6-d3e0-485f-91d4-c939c836ab1b (non-flash)
Nov 17 01:33:38 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:33:38 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-cb2217a9-a9f3-47aa-8c83-8429404bacfe tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:579abcf6-d3e0-485f-91d4-c939c836ab1b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.304s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:33:38 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb2217a9-a9f3-47aa-8c83-8429404bacfe tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Connected to 172.16.0.220:3260 {{(pid=75226) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 17 01:33:38 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-cb2217a9-a9f3-47aa-8c83-8429404bacfe tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] HCTL ('35', '-', '-', 0) found on session 36 with lun 0 {{(pid=75226) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 17 01:33:38 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-cb2217a9-a9f3-47aa-8c83-8429404bacfe tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75226) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 17 01:33:38 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:33:38 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:33:38 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cfa2d46-87f4-4af0-991a-4f1606121193]: (4, ('- - 0', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:33:38 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-cb2217a9-a9f3-47aa-8c83-8429404bacfe tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Searching for a device in session 36 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75226) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 01:33:38 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb2217a9-a9f3-47aa-8c83-8429404bacfe tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:579abcf6-d3e0-485f-91d4-c939c836ab1b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PTUpmGof', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75226) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 17 01:33:39 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:33:39 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-cb2217a9-a9f3-47aa-8c83-8429404bacfe tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.347s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:33:39 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb2217a9-a9f3-47aa-8c83-8429404bacfe tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] <== connect_volume: return (1350ms) {'type': 'block', 'scsi_wwn': '23238363565343039', 'path': '/dev/sdd'} {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:33:39 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb2217a9-a9f3-47aa-8c83-8429404bacfe tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: dae5490b-e434-4cd1-b8d4-6baab9bb7345] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23238363565343039', 'path': '/dev/sdd'} {{(pid=75226) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 17 01:33:39 user nova-compute[75226]: DEBUG nova.objects.instance [None req-cb2217a9-a9f3-47aa-8c83-8429404bacfe tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Lazy-loading 'flavor' on Instance uuid dae5490b-e434-4cd1-b8d4-6baab9bb7345 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:33:39 user nova-compute[75226]: DEBUG nova.virt.libvirt.guest [None req-cb2217a9-a9f3-47aa-8c83-8429404bacfe tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] attach device xml: <disk type="block" device="disk">
Nov 17 01:33:39 user nova-compute[75226]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 01:33:39 user nova-compute[75226]:   <source dev="/dev/sdd"/>
Nov 17 01:33:39 user nova-compute[75226]:   <target dev="vdb" bus="virtio"/>
Nov 17 01:33:39 user nova-compute[75226]:   <serial>579abcf6-d3e0-485f-91d4-c939c836ab1b</serial>
Nov 17 01:33:39 user nova-compute[75226]: </disk>
Nov 17 01:33:39 user nova-compute[75226]:  {{(pid=75226) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 17 01:33:40 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-cb2217a9-a9f3-47aa-8c83-8429404bacfe tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] No BDM found with device name vda, not building metadata. {{(pid=75226) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 01:33:40 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-cb2217a9-a9f3-47aa-8c83-8429404bacfe tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75226) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 01:33:40 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-cb2217a9-a9f3-47aa-8c83-8429404bacfe tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] No VIF found with MAC fa:16:3e:82:cf:64, not building metadata {{(pid=75226) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 01:33:40 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-cb2217a9-a9f3-47aa-8c83-8429404bacfe tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Lock "dae5490b-e434-4cd1-b8d4-6baab9bb7345" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.143s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:33:41 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-d024e35d-8ced-4980-843d-c48eeb5b8a76 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Acquiring lock "dae5490b-e434-4cd1-b8d4-6baab9bb7345" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:33:41 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-d024e35d-8ced-4980-843d-c48eeb5b8a76 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Lock "dae5490b-e434-4cd1-b8d4-6baab9bb7345" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:33:41 user nova-compute[75226]: INFO nova.compute.manager [None req-d024e35d-8ced-4980-843d-c48eeb5b8a76 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: dae5490b-e434-4cd1-b8d4-6baab9bb7345] Detaching volume 579abcf6-d3e0-485f-91d4-c939c836ab1b
Nov 17 01:33:41 user nova-compute[75226]: INFO nova.virt.block_device [None req-d024e35d-8ced-4980-843d-c48eeb5b8a76 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: dae5490b-e434-4cd1-b8d4-6baab9bb7345] Attempting to driver detach volume 579abcf6-d3e0-485f-91d4-c939c836ab1b from mountpoint /dev/vdb
Nov 17 01:33:41 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-d024e35d-8ced-4980-843d-c48eeb5b8a76 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Attempting to detach device vdb from instance dae5490b-e434-4cd1-b8d4-6baab9bb7345 from the persistent domain config. {{(pid=75226) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 17 01:33:41 user nova-compute[75226]: DEBUG nova.virt.libvirt.guest [None req-d024e35d-8ced-4980-843d-c48eeb5b8a76 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] detach device xml: <disk type="block" device="disk">
Nov 17 01:33:41 user nova-compute[75226]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 01:33:41 user nova-compute[75226]:   <source dev="/dev/sdd"/>
Nov 17 01:33:41 user nova-compute[75226]:   <target dev="vdb" bus="virtio"/>
Nov 17 01:33:41 user nova-compute[75226]:   <serial>579abcf6-d3e0-485f-91d4-c939c836ab1b</serial>
Nov 17 01:33:41 user nova-compute[75226]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 17 01:33:41 user nova-compute[75226]: </disk>
Nov 17 01:33:41 user nova-compute[75226]:  {{(pid=75226) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 17 01:33:41 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-d024e35d-8ced-4980-843d-c48eeb5b8a76 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Successfully detached device vdb from instance dae5490b-e434-4cd1-b8d4-6baab9bb7345 from the persistent domain config.
Nov 17 01:33:41 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-d024e35d-8ced-4980-843d-c48eeb5b8a76 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance dae5490b-e434-4cd1-b8d4-6baab9bb7345 from the live domain config. {{(pid=75226) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 17 01:33:41 user nova-compute[75226]: DEBUG nova.virt.libvirt.guest [None req-d024e35d-8ced-4980-843d-c48eeb5b8a76 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] detach device xml: <disk type="block" device="disk">
Nov 17 01:33:41 user nova-compute[75226]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 01:33:41 user nova-compute[75226]:   <source dev="/dev/sdd"/>
Nov 17 01:33:41 user nova-compute[75226]:   <target dev="vdb" bus="virtio"/>
Nov 17 01:33:41 user nova-compute[75226]:   <serial>579abcf6-d3e0-485f-91d4-c939c836ab1b</serial>
Nov 17 01:33:41 user nova-compute[75226]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 17 01:33:41 user nova-compute[75226]: </disk>
Nov 17 01:33:41 user nova-compute[75226]:  {{(pid=75226) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 17 01:33:42 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-d024e35d-8ced-4980-843d-c48eeb5b8a76 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance dae5490b-e434-4cd1-b8d4-6baab9bb7345 {{(pid=75226) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 17 01:33:43 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:33:44 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:33:48 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:33:48 user nova-compute[75226]: DEBUG nova.compute.manager [req-cb8a9d81-c3dc-4abb-b907-b5e93096177f req-df4532f9-8a96-42cf-8c2e-af7f85c9c45d service nova] [instance: c11fbffa-07e2-40c4-92b1-8531dbe8b687] Received event network-changed-325d11f4-b841-44c8-8a19-bdccb1d8cfd1 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:33:48 user nova-compute[75226]: DEBUG nova.compute.manager [req-cb8a9d81-c3dc-4abb-b907-b5e93096177f req-df4532f9-8a96-42cf-8c2e-af7f85c9c45d service nova] [instance: c11fbffa-07e2-40c4-92b1-8531dbe8b687] Refreshing instance network info cache due to event network-changed-325d11f4-b841-44c8-8a19-bdccb1d8cfd1. {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 01:33:48 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-cb8a9d81-c3dc-4abb-b907-b5e93096177f req-df4532f9-8a96-42cf-8c2e-af7f85c9c45d service nova] Acquiring lock "refresh_cache-c11fbffa-07e2-40c4-92b1-8531dbe8b687" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:33:48 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-cb8a9d81-c3dc-4abb-b907-b5e93096177f req-df4532f9-8a96-42cf-8c2e-af7f85c9c45d service nova] Acquired lock "refresh_cache-c11fbffa-07e2-40c4-92b1-8531dbe8b687" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:33:48 user nova-compute[75226]: DEBUG nova.network.neutron [req-cb8a9d81-c3dc-4abb-b907-b5e93096177f req-df4532f9-8a96-42cf-8c2e-af7f85c9c45d service nova] [instance: c11fbffa-07e2-40c4-92b1-8531dbe8b687] Refreshing network info cache for port 325d11f4-b841-44c8-8a19-bdccb1d8cfd1 {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 01:33:48 user nova-compute[75226]: DEBUG nova.network.neutron [req-cb8a9d81-c3dc-4abb-b907-b5e93096177f req-df4532f9-8a96-42cf-8c2e-af7f85c9c45d service nova] [instance: c11fbffa-07e2-40c4-92b1-8531dbe8b687] Updated VIF entry in instance network info cache for port 325d11f4-b841-44c8-8a19-bdccb1d8cfd1. {{(pid=75226) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 01:33:48 user nova-compute[75226]: DEBUG nova.network.neutron [req-cb8a9d81-c3dc-4abb-b907-b5e93096177f req-df4532f9-8a96-42cf-8c2e-af7f85c9c45d service nova] [instance: c11fbffa-07e2-40c4-92b1-8531dbe8b687] Updating instance_info_cache with network_info: [{"id": "325d11f4-b841-44c8-8a19-bdccb1d8cfd1", "address": "fa:16:3e:06:46:c3", "network": {"id": "c93f11a7-52c6-4379-a1fb-9a002876c221", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-985502177-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "054575d3dc66452091173b4c604b8c96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap325d11f4-b8", "ovs_interfaceid": "325d11f4-b841-44c8-8a19-bdccb1d8cfd1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:33:48 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-cb8a9d81-c3dc-4abb-b907-b5e93096177f req-df4532f9-8a96-42cf-8c2e-af7f85c9c45d service nova] Releasing lock "refresh_cache-c11fbffa-07e2-40c4-92b1-8531dbe8b687" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:33:49 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:33:51 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-c7c67898-633e-4476-842c-1671ae593fb5 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Acquiring lock "c11fbffa-07e2-40c4-92b1-8531dbe8b687" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:33:51 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-c7c67898-633e-4476-842c-1671ae593fb5 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Lock "c11fbffa-07e2-40c4-92b1-8531dbe8b687" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:33:51 user nova-compute[75226]: DEBUG nova.objects.instance [None req-c7c67898-633e-4476-842c-1671ae593fb5 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Lazy-loading 'flavor' on Instance uuid c11fbffa-07e2-40c4-92b1-8531dbe8b687 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:33:51 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-c7c67898-633e-4476-842c-1671ae593fb5 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Lock "c11fbffa-07e2-40c4-92b1-8531dbe8b687" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:33:51 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-c7c67898-633e-4476-842c-1671ae593fb5 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Acquiring lock "c11fbffa-07e2-40c4-92b1-8531dbe8b687" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:33:51 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-c7c67898-633e-4476-842c-1671ae593fb5 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Lock "c11fbffa-07e2-40c4-92b1-8531dbe8b687" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:33:51 user nova-compute[75226]: INFO nova.compute.manager [None req-c7c67898-633e-4476-842c-1671ae593fb5 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] [instance: c11fbffa-07e2-40c4-92b1-8531dbe8b687] Attaching volume ce3aa851-e7f0-4ea9-b3ed-404dbb123330 to /dev/vdb
Nov 17 01:33:51 user nova-compute[75226]: DEBUG os_brick.utils [None req-c7c67898-633e-4476-842c-1671ae593fb5 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:33:51 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:33:51 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:33:51 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[2454c533-2161-4172-9a86-6648ca2caa08]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f62857db69\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:33:51 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:33:51 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:33:51 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[53d04bf2-97b3-4f7b-90cc-f47337944e19]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:33:51 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:33:51 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:33:51 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d2b6811-3253-4321-8bf0-b6f3302776e7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:33:51 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8e97d76-25ff-4a0d-b708-80cbd9775664]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:33:51 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-c7c67898-633e-4476-842c-1671ae593fb5 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Running cmd (subprocess): nvme version {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:33:51 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-c7c67898-633e-4476-842c-1671ae593fb5 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] 'nvme version' failed. Not Retrying. {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 01:33:51 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c7c67898-633e-4476-842c-1671ae593fb5 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] nvme not present on system {{(pid=75226) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 17 01:33:51 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:33:51 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 01:33:51 user nova-compute[75226]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 17 01:33:51 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[c01d0c31-fdb9-4450-90ea-e88bcee53721]: (4, '') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:33:51 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-c7c67898-633e-4476-842c-1671ae593fb5 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75226) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 17 01:33:51 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-c7c67898-633e-4476-842c-1671ae593fb5 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75226) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 17 01:33:51 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-c7c67898-633e-4476-842c-1671ae593fb5 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] LIGHTOS: no hostnqn found. {{(pid=75226) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 17 01:33:51 user nova-compute[75226]: DEBUG os_brick.utils [None req-c7c67898-633e-4476-842c-1671ae593fb5 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f62857db69', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:33:51 user nova-compute[75226]: DEBUG nova.virt.block_device [None req-c7c67898-633e-4476-842c-1671ae593fb5 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] [instance: c11fbffa-07e2-40c4-92b1-8531dbe8b687] Updating existing volume attachment record: e92e4ce2-4b16-4342-96fb-9eb0d980a3ea {{(pid=75226) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 17 01:33:53 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:33:53 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:33:54 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:33:57 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7c67898-633e-4476-842c-1671ae593fb5 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] [instance: c11fbffa-07e2-40c4-92b1-8531dbe8b687] Calling os-brick to attach iSCSI Volume {{(pid=75226) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 17 01:33:57 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7c67898-633e-4476-842c-1671ae593fb5 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc4cc36b490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ce3aa851-e7f0-4ea9-b3ed-404dbb123330', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HmrPIwQa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:33:57 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-c7c67898-633e-4476-842c-1671ae593fb5 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:33:57 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-c7c67898-633e-4476-842c-1671ae593fb5 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:33:57 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-c7c67898-633e-4476-842c-1671ae593fb5 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:33:57 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-c7c67898-633e-4476-842c-1671ae593fb5 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:33:57 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-c7c67898-633e-4476-842c-1671ae593fb5 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ce3aa851-e7f0-4ea9-b3ed-404dbb123330" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:33:57 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-c7c67898-633e-4476-842c-1671ae593fb5 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ce3aa851-e7f0-4ea9-b3ed-404dbb123330" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:33:57 user nova-compute[75226]: INFO os_brick.initiator.connectors.iscsi [None req-c7c67898-633e-4476-842c-1671ae593fb5 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 17 01:33:57 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce3aa851-e7f0-4ea9-b3ed-404dbb123330 -p 172.16.0.220:3260 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:33:57 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce3aa851-e7f0-4ea9-b3ed-404dbb123330 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:33:57 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[705e6d53-0b1c-41a8-91c6-94c656ab20e0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:33:57 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7c67898-633e-4476-842c-1671ae593fb5 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 17 01:33:57 user nova-compute[75226]:  {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:33:57 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce3aa851-e7f0-4ea9-b3ed-404dbb123330 -p 172.16.0.220:3260 --interface default --op new {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:33:57 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce3aa851-e7f0-4ea9-b3ed-404dbb123330 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:33:57 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f2d0a2d-99ad-4127-8044-34a2a93332fe]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ce3aa851-e7f0-4ea9-b3ed-404dbb123330] added\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:33:57 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7c67898-633e-4476-842c-1671ae593fb5 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ce3aa851-e7f0-4ea9-b3ed-404dbb123330] added
Nov 17 01:33:57 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:33:57 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce3aa851-e7f0-4ea9-b3ed-404dbb123330 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:33:57 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce3aa851-e7f0-4ea9-b3ed-404dbb123330 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:33:57 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[123ef124-4c20-4351-bbc7-34df9a938846]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:33:57 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7c67898-633e-4476-842c-1671ae593fb5 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:33:57 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce3aa851-e7f0-4ea9-b3ed-404dbb123330 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:33:57 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce3aa851-e7f0-4ea9-b3ed-404dbb123330 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:33:57 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[47714ba0-dc41-4e06-923b-03dec039b21c]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:33:57 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7c67898-633e-4476-842c-1671ae593fb5 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:33:57 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce3aa851-e7f0-4ea9-b3ed-404dbb123330 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HmrPIwQa {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:33:57 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce3aa851-e7f0-4ea9-b3ed-404dbb123330 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HmrPIwQa" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:33:57 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[64256ccc-bc97-4de7-b4fe-e6017b827fac]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:33:57 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7c67898-633e-4476-842c-1671ae593fb5 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HmrPIwQa'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:33:57 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce3aa851-e7f0-4ea9-b3ed-404dbb123330 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:33:57 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce3aa851-e7f0-4ea9-b3ed-404dbb123330 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:33:57 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eabc541-2fb7-41b9-a196-65803cd9084e]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:33:57 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7c67898-633e-4476-842c-1671ae593fb5 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:33:57 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:33:57 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:33:57 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe775219-958c-4b98-ae23-afffe61b6635]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05f878e5-0241-4282-8b2c-c4651c429dcb (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:579abcf6-d3e0-485f-91d4-c939c836ab1b (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:33:57 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7c67898-633e-4476-842c-1671ae593fb5 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)
Nov 17 01:33:57 user nova-compute[75226]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05f878e5-0241-4282-8b2c-c4651c429dcb (non-flash)
Nov 17 01:33:57 user nova-compute[75226]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419 (non-flash)
Nov 17 01:33:57 user nova-compute[75226]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:579abcf6-d3e0-485f-91d4-c939c836ab1b (non-flash)
Nov 17 01:33:57 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:33:57 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7c67898-633e-4476-842c-1671ae593fb5 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)
Nov 17 01:33:57 user nova-compute[75226]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05f878e5-0241-4282-8b2c-c4651c429dcb (non-flash)
Nov 17 01:33:57 user nova-compute[75226]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419 (non-flash)
Nov 17 01:33:57 user nova-compute[75226]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:579abcf6-d3e0-485f-91d4-c939c836ab1b (non-flash)
Nov 17 01:33:57 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:33:57 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce3aa851-e7f0-4ea9-b3ed-404dbb123330 -p 172.16.0.220:3260 --login {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:33:57 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:33:57 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce3aa851-e7f0-4ea9-b3ed-404dbb123330 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:33:57 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[46b5c974-5066-4b12-ae3f-13cbc2941f04]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ce3aa851-e7f0-4ea9-b3ed-404dbb123330, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ce3aa851-e7f0-4ea9-b3ed-404dbb123330, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:33:57 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7c67898-633e-4476-842c-1671ae593fb5 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ce3aa851-e7f0-4ea9-b3ed-404dbb123330, portal: 172.16.0.220,3260]
Nov 17 01:33:57 user nova-compute[75226]: Login to [iface: default, target: iqn.2010-10.org.openstack:ce3aa851-e7f0-4ea9-b3ed-404dbb123330, portal: 172.16.0.220,3260] successful.
Nov 17 01:33:57 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:33:57 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce3aa851-e7f0-4ea9-b3ed-404dbb123330 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:33:57 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Triggering sync for uuid aa84e575-bdad-45b9-80ce-86b1c2826fb0 {{(pid=75226) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 17 01:33:57 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Triggering sync for uuid 6b7e9611-be35-4e51-b886-91a2fac0a653 {{(pid=75226) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 17 01:33:57 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Triggering sync for uuid 38062487-67ca-4962-974f-81456aebe97b {{(pid=75226) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 17 01:33:57 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Triggering sync for uuid 4050d898-f2b8-46c2-86e3-702ceb41a701 {{(pid=75226) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 17 01:33:57 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Triggering sync for uuid 2ea5a14b-c330-4a2b-926e-60e1b30f5981 {{(pid=75226) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 17 01:33:57 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Triggering sync for uuid d6555d72-6094-4ea9-b071-a3d3c8a300a9 {{(pid=75226) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 17 01:33:57 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Triggering sync for uuid 5c280142-8901-4f83-bde4-baaa097e05b0 {{(pid=75226) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 17 01:33:57 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Triggering sync for uuid 3018e3a2-01e0-49d7-a960-51718709845a {{(pid=75226) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 17 01:33:57 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Triggering sync for uuid 9e8b4b85-fe0c-4592-850e-e94ebab32d02 {{(pid=75226) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 17 01:33:57 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Triggering sync for uuid dae5490b-e434-4cd1-b8d4-6baab9bb7345 {{(pid=75226) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 17 01:33:57 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Triggering sync for uuid c11fbffa-07e2-40c4-92b1-8531dbe8b687 {{(pid=75226) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 17 01:33:57 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Triggering sync for uuid a298d980-feed-4530-9499-f2833b404dcd {{(pid=75226) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 17 01:33:57 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "aa84e575-bdad-45b9-80ce-86b1c2826fb0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:33:57 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "aa84e575-bdad-45b9-80ce-86b1c2826fb0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:33:57 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "6b7e9611-be35-4e51-b886-91a2fac0a653" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:33:57 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "6b7e9611-be35-4e51-b886-91a2fac0a653" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:33:57 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "38062487-67ca-4962-974f-81456aebe97b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:33:57 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "38062487-67ca-4962-974f-81456aebe97b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:33:57 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "4050d898-f2b8-46c2-86e3-702ceb41a701" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:33:57 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "4050d898-f2b8-46c2-86e3-702ceb41a701" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:33:57 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "2ea5a14b-c330-4a2b-926e-60e1b30f5981" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:33:57 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "2ea5a14b-c330-4a2b-926e-60e1b30f5981" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:33:57 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "d6555d72-6094-4ea9-b071-a3d3c8a300a9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:33:57 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "d6555d72-6094-4ea9-b071-a3d3c8a300a9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:33:57 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "5c280142-8901-4f83-bde4-baaa097e05b0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:33:57 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "5c280142-8901-4f83-bde4-baaa097e05b0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:33:57 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "3018e3a2-01e0-49d7-a960-51718709845a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:33:57 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "3018e3a2-01e0-49d7-a960-51718709845a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:33:57 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "9e8b4b85-fe0c-4592-850e-e94ebab32d02" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:33:57 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "9e8b4b85-fe0c-4592-850e-e94ebab32d02" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:33:57 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "dae5490b-e434-4cd1-b8d4-6baab9bb7345" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:33:57 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "c11fbffa-07e2-40c4-92b1-8531dbe8b687" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:33:57 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "a298d980-feed-4530-9499-f2833b404dcd" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:33:57 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "a298d980-feed-4530-9499-f2833b404dcd" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:33:57 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce3aa851-e7f0-4ea9-b3ed-404dbb123330 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:33:57 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d5d6f4e-225a-488e-93c0-03d132ec62a2]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:33:57 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7c67898-633e-4476-842c-1671ae593fb5 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:33:57 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:33:57 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "6b7e9611-be35-4e51-b886-91a2fac0a653" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.043s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:33:57 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "aa84e575-bdad-45b9-80ce-86b1c2826fb0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.045s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:33:57 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:33:57 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f2e20d8-ed0c-40c3-86fc-d03da6caf735]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05f878e5-0241-4282-8b2c-c4651c429dcb (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:579abcf6-d3e0-485f-91d4-c939c836ab1b (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce3aa851-e7f0-4ea9-b3ed-404dbb123330 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:33:57 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7c67898-633e-4476-842c-1671ae593fb5 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)
Nov 17 01:33:57 user nova-compute[75226]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05f878e5-0241-4282-8b2c-c4651c429dcb (non-flash)
Nov 17 01:33:57 user nova-compute[75226]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419 (non-flash)
Nov 17 01:33:57 user nova-compute[75226]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:579abcf6-d3e0-485f-91d4-c939c836ab1b (non-flash)
Nov 17 01:33:57 user nova-compute[75226]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce3aa851-e7f0-4ea9-b3ed-404dbb123330 (non-flash)
Nov 17 01:33:57 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:33:57 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7c67898-633e-4476-842c-1671ae593fb5 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)
Nov 17 01:33:57 user nova-compute[75226]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05f878e5-0241-4282-8b2c-c4651c429dcb (non-flash)
Nov 17 01:33:57 user nova-compute[75226]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419 (non-flash)
Nov 17 01:33:57 user nova-compute[75226]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:579abcf6-d3e0-485f-91d4-c939c836ab1b (non-flash)
Nov 17 01:33:57 user nova-compute[75226]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce3aa851-e7f0-4ea9-b3ed-404dbb123330 (non-flash)
Nov 17 01:33:57 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:33:57 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-c7c67898-633e-4476-842c-1671ae593fb5 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ce3aa851-e7f0-4ea9-b3ed-404dbb123330" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.295s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:33:57 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7c67898-633e-4476-842c-1671ae593fb5 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Connected to 172.16.0.220:3260 {{(pid=75226) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 17 01:33:57 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-c7c67898-633e-4476-842c-1671ae593fb5 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] HCTL ('37', '-', '-', 0) found on session 37 with lun 0 {{(pid=75226) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 17 01:33:57 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-c7c67898-633e-4476-842c-1671ae593fb5 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75226) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 17 01:33:57 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "38062487-67ca-4962-974f-81456aebe97b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.058s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:33:57 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "4050d898-f2b8-46c2-86e3-702ceb41a701" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.058s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:33:57 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "2ea5a14b-c330-4a2b-926e-60e1b30f5981" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.058s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:33:57 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:33:57 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "d6555d72-6094-4ea9-b071-a3d3c8a300a9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.063s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:33:57 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "5c280142-8901-4f83-bde4-baaa097e05b0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.071s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:33:57 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:33:57 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[664f1eb3-1367-436d-8f59-ec10091e39e6]: (4, ('- - 0', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:33:57 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-c7c67898-633e-4476-842c-1671ae593fb5 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Searching for a device in session 37 and hctl ['37', '*', '*', 0] yield: None {{(pid=75226) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 01:33:57 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "3018e3a2-01e0-49d7-a960-51718709845a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.082s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:33:57 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "9e8b4b85-fe0c-4592-850e-e94ebab32d02" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.082s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:33:57 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "a298d980-feed-4530-9499-f2833b404dcd" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.084s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:33:58 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:33:58 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:33:58 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-c7c67898-633e-4476-842c-1671ae593fb5 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Searching for a device in session 37 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75226) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 01:33:58 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7c67898-633e-4476-842c-1671ae593fb5 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:ce3aa851-e7f0-4ea9-b3ed-404dbb123330', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HmrPIwQa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75226) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 17 01:33:58 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-c7c67898-633e-4476-842c-1671ae593fb5 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.331s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:33:58 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7c67898-633e-4476-842c-1671ae593fb5 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] <== connect_volume: return (1333ms) {'type': 'block', 'scsi_wwn': '23139376663636435', 'path': '/dev/sdf'} {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:33:58 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7c67898-633e-4476-842c-1671ae593fb5 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] [instance: c11fbffa-07e2-40c4-92b1-8531dbe8b687] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23139376663636435', 'path': '/dev/sdf'} {{(pid=75226) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 17 01:33:58 user nova-compute[75226]: DEBUG nova.objects.instance [None req-c7c67898-633e-4476-842c-1671ae593fb5 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Lazy-loading 'flavor' on Instance uuid c11fbffa-07e2-40c4-92b1-8531dbe8b687 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:33:58 user nova-compute[75226]: DEBUG nova.virt.libvirt.guest [None req-c7c67898-633e-4476-842c-1671ae593fb5 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] attach device xml: <disk type="block" device="disk">
Nov 17 01:33:58 user nova-compute[75226]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 01:33:58 user nova-compute[75226]:   <source dev="/dev/sdf"/>
Nov 17 01:33:58 user nova-compute[75226]:   <target dev="vdb" bus="virtio"/>
Nov 17 01:33:58 user nova-compute[75226]:   <serial>ce3aa851-e7f0-4ea9-b3ed-404dbb123330</serial>
Nov 17 01:33:58 user nova-compute[75226]: </disk>
Nov 17 01:33:58 user nova-compute[75226]:  {{(pid=75226) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 17 01:33:58 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-c7c67898-633e-4476-842c-1671ae593fb5 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] No BDM found with device name vda, not building metadata. {{(pid=75226) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 01:33:58 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-c7c67898-633e-4476-842c-1671ae593fb5 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75226) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 01:33:58 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-c7c67898-633e-4476-842c-1671ae593fb5 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] No VIF found with MAC fa:16:3e:06:46:c3, not building metadata {{(pid=75226) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 01:33:59 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-c7c67898-633e-4476-842c-1671ae593fb5 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Lock "c11fbffa-07e2-40c4-92b1-8531dbe8b687" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.805s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:33:59 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "c11fbffa-07e2-40c4-92b1-8531dbe8b687" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 1.636s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:33:59 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:33:59 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "c11fbffa-07e2-40c4-92b1-8531dbe8b687" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.026s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:34:02 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-d024e35d-8ced-4980-843d-c48eeb5b8a76 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance dae5490b-e434-4cd1-b8d4-6baab9bb7345 is timed out.
Nov 17 01:34:02 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-d024e35d-8ced-4980-843d-c48eeb5b8a76 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Successfully detached device vdb from instance dae5490b-e434-4cd1-b8d4-6baab9bb7345 from the live domain config.
Nov 17 01:34:02 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d024e35d-8ced-4980-843d-c48eeb5b8a76 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: dae5490b-e434-4cd1-b8d4-6baab9bb7345] calling os-brick to detach iSCSI Volume {{(pid=75226) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 17 01:34:02 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-d024e35d-8ced-4980-843d-c48eeb5b8a76 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc4cc36b490>, {'target_iqn': 'iqn.2010-10.org.openstack:579abcf6-d3e0-485f-91d4-c939c836ab1b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PTUpmGof', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:34:02 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-d024e35d-8ced-4980-843d-c48eeb5b8a76 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:34:02 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-d024e35d-8ced-4980-843d-c48eeb5b8a76 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:34:02 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-d024e35d-8ced-4980-843d-c48eeb5b8a76 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:34:02 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:34:02 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:34:02 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[64421b78-f2c7-4dab-99e1-413d4a3140d8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:05f878e5-0241-4282-8b2c-c4651c429dcb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:579abcf6-d3e0-485f-91d4-c939c836ab1b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ce3aa851-e7f0-4ea9-b3ed-404dbb123330\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:34:02 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-d024e35d-8ced-4980-843d-c48eeb5b8a76 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 17 01:34:02 user nova-compute[75226]: No targets found.
Nov 17 01:34:02 user nova-compute[75226]: iSNS:
Nov 17 01:34:02 user nova-compute[75226]: No targets found.
Nov 17 01:34:02 user nova-compute[75226]: STATIC:
Nov 17 01:34:02 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:05f878e5-0241-4282-8b2c-c4651c429dcb
Nov 17 01:34:02 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:34:02 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:34:02 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8
Nov 17 01:34:02 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:34:02 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:34:02 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:579abcf6-d3e0-485f-91d4-c939c836ab1b
Nov 17 01:34:02 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:34:02 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:34:02 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:ce3aa851-e7f0-4ea9-b3ed-404dbb123330
Nov 17 01:34:02 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:34:02 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:34:02 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419
Nov 17 01:34:02 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:34:02 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:34:02 user nova-compute[75226]: FIRMWARE:
Nov 17 01:34:02 user nova-compute[75226]: No targets found.
Nov 17 01:34:02 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:34:02 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-d024e35d-8ced-4980-843d-c48eeb5b8a76 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 17 01:34:02 user nova-compute[75226]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 17 01:34:02 user nova-compute[75226]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75226) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 17 01:34:02 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-d024e35d-8ced-4980-843d-c48eeb5b8a76 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:579abcf6-d3e0-485f-91d4-c939c836ab1b', 0)] {{(pid=75226) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 17 01:34:02 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:34:02 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:34:02 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[22dce9c6-bc52-4c9c-9c96-e8f999ede2d1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:05f878e5-0241-4282-8b2c-c4651c429dcb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:579abcf6-d3e0-485f-91d4-c939c836ab1b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ce3aa851-e7f0-4ea9-b3ed-404dbb123330\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:34:02 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:34:02 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:34:02 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[c52e969e-1f0f-4038-86fc-4ccdac02e1ff]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05f878e5-0241-4282-8b2c-c4651c429dcb (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:579abcf6-d3e0-485f-91d4-c939c836ab1b (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce3aa851-e7f0-4ea9-b3ed-404dbb123330 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:34:02 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-d024e35d-8ced-4980-843d-c48eeb5b8a76 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)
Nov 17 01:34:02 user nova-compute[75226]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05f878e5-0241-4282-8b2c-c4651c429dcb (non-flash)
Nov 17 01:34:02 user nova-compute[75226]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419 (non-flash)
Nov 17 01:34:02 user nova-compute[75226]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:579abcf6-d3e0-485f-91d4-c939c836ab1b (non-flash)
Nov 17 01:34:02 user nova-compute[75226]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce3aa851-e7f0-4ea9-b3ed-404dbb123330 (non-flash)
Nov 17 01:34:02 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:34:02 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-d024e35d-8ced-4980-843d-c48eeb5b8a76 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)
Nov 17 01:34:02 user nova-compute[75226]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05f878e5-0241-4282-8b2c-c4651c429dcb (non-flash)
Nov 17 01:34:02 user nova-compute[75226]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419 (non-flash)
Nov 17 01:34:02 user nova-compute[75226]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:579abcf6-d3e0-485f-91d4-c939c836ab1b (non-flash)
Nov 17 01:34:02 user nova-compute[75226]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce3aa851-e7f0-4ea9-b3ed-404dbb123330 (non-flash)
Nov 17 01:34:02 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:34:02 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-d024e35d-8ced-4980-843d-c48eeb5b8a76 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc4b428f5b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:579abcf6-d3e0-485f-91d4-c939c836ab1b'): ({'sdd'}, set())}) {{(pid=75226) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 17 01:34:02 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-d024e35d-8ced-4980-843d-c48eeb5b8a76 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Removing single pathed devices sdd {{(pid=75226) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 17 01:34:02 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:34:02 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:34:02 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[4525c13c-c3b5-4a85-b00f-9fed599a8428]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:34:02 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:34:02 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:34:02 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f558a2f-0af6-49d4-b0e4-51a8ff9910a3]: (4, ('ok\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:34:02 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-d024e35d-8ced-4980-843d-c48eeb5b8a76 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Flushing IO for device /dev/sdd {{(pid=75226) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 17 01:34:02 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:34:02 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:34:02 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b6fa0c6-4bbd-4f5e-aecf-03698e89310e]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:34:02 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-d024e35d-8ced-4980-843d-c48eeb5b8a76 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75226) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 17 01:34:02 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:34:02 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.044s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:34:02 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[beba3d8e-9022-4592-930a-86ecba2dfbe1]: (4, ('1', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:34:02 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-d024e35d-8ced-4980-843d-c48eeb5b8a76 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75226) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 17 01:34:02 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-d024e35d-8ced-4980-843d-c48eeb5b8a76 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] SCSI volumes sdd have been removed. {{(pid=75226) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 17 01:34:02 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-d024e35d-8ced-4980-843d-c48eeb5b8a76 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:579abcf6-d3e0-485f-91d4-c939c836ab1b')] {{(pid=75226) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 17 01:34:02 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:579abcf6-d3e0-485f-91d4-c939c836ab1b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:34:02 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:579abcf6-d3e0-485f-91d4-c939c836ab1b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:34:02 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[1709489d-edd1-4873-9f30-5d007b8f9bca]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:34:02 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-d024e35d-8ced-4980-843d-c48eeb5b8a76 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:34:02 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:579abcf6-d3e0-485f-91d4-c939c836ab1b -p 172.16.0.220:3260 --logout {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:34:02 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:579abcf6-d3e0-485f-91d4-c939c836ab1b -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:34:02 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[cff53f4b-f71e-4ddf-9ff6-b20253ebbe0f]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:579abcf6-d3e0-485f-91d4-c939c836ab1b, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:579abcf6-d3e0-485f-91d4-c939c836ab1b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:34:02 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-d024e35d-8ced-4980-843d-c48eeb5b8a76 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:579abcf6-d3e0-485f-91d4-c939c836ab1b, portal: 172.16.0.220,3260]
Nov 17 01:34:02 user nova-compute[75226]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:579abcf6-d3e0-485f-91d4-c939c836ab1b, portal: 172.16.0.220,3260] successful.
Nov 17 01:34:02 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:34:02 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:579abcf6-d3e0-485f-91d4-c939c836ab1b -p 172.16.0.220:3260 --op delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:34:02 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:579abcf6-d3e0-485f-91d4-c939c836ab1b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:34:02 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[da86c9c1-93b5-4fad-b88e-25f59c440968]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:34:02 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-d024e35d-8ced-4980-843d-c48eeb5b8a76 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:34:02 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-d024e35d-8ced-4980-843d-c48eeb5b8a76 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.337s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:34:02 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-d024e35d-8ced-4980-843d-c48eeb5b8a76 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] <== disconnect_volume: return (337ms) None {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:34:02 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d024e35d-8ced-4980-843d-c48eeb5b8a76 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: dae5490b-e434-4cd1-b8d4-6baab9bb7345] Disconnected iSCSI Volume {{(pid=75226) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 17 01:34:02 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-d68a1985-f46b-42ea-935d-cef5fa75472f tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Acquiring lock "c11fbffa-07e2-40c4-92b1-8531dbe8b687" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:34:02 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-d68a1985-f46b-42ea-935d-cef5fa75472f tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Lock "c11fbffa-07e2-40c4-92b1-8531dbe8b687" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:34:02 user nova-compute[75226]: DEBUG nova.objects.instance [None req-d68a1985-f46b-42ea-935d-cef5fa75472f tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Lazy-loading 'flavor' on Instance uuid c11fbffa-07e2-40c4-92b1-8531dbe8b687 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:34:02 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-d68a1985-f46b-42ea-935d-cef5fa75472f tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Lock "c11fbffa-07e2-40c4-92b1-8531dbe8b687" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:34:02 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-d68a1985-f46b-42ea-935d-cef5fa75472f tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Acquiring lock "c11fbffa-07e2-40c4-92b1-8531dbe8b687" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:34:02 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-d68a1985-f46b-42ea-935d-cef5fa75472f tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Lock "c11fbffa-07e2-40c4-92b1-8531dbe8b687" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:34:02 user nova-compute[75226]: INFO nova.compute.manager [None req-d68a1985-f46b-42ea-935d-cef5fa75472f tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] [instance: c11fbffa-07e2-40c4-92b1-8531dbe8b687] Attaching volume 50b18fb0-86d4-4384-b5be-ad4ac5a6fe82 to /dev/vdc
Nov 17 01:34:02 user nova-compute[75226]: DEBUG os_brick.utils [None req-d68a1985-f46b-42ea-935d-cef5fa75472f tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:34:02 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:34:02 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:34:02 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae68f6ec-95fd-469d-88b0-27c289db0365]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f62857db69\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:34:02 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:34:02 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:34:02 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff300d14-14cd-43f6-9daa-bbb7881485a2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:34:02 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:34:02 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:34:02 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[daf96c7c-ca27-4f0d-9039-19ee1695fa0e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:34:02 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ed1a3bb-f845-43c1-97c2-2ffe721629ab]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:34:02 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-d68a1985-f46b-42ea-935d-cef5fa75472f tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Running cmd (subprocess): nvme version {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:34:02 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-d68a1985-f46b-42ea-935d-cef5fa75472f tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] 'nvme version' failed. Not Retrying. {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 01:34:02 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d68a1985-f46b-42ea-935d-cef5fa75472f tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] nvme not present on system {{(pid=75226) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 17 01:34:02 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:34:02 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 01:34:02 user nova-compute[75226]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 17 01:34:02 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[58dea82b-18ca-4e16-a020-f3b9b00c1aff]: (4, '') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:34:02 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-d68a1985-f46b-42ea-935d-cef5fa75472f tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75226) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 17 01:34:02 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-d68a1985-f46b-42ea-935d-cef5fa75472f tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75226) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 17 01:34:02 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-d68a1985-f46b-42ea-935d-cef5fa75472f tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] LIGHTOS: no hostnqn found. {{(pid=75226) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 17 01:34:02 user nova-compute[75226]: DEBUG os_brick.utils [None req-d68a1985-f46b-42ea-935d-cef5fa75472f tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f62857db69', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:34:02 user nova-compute[75226]: DEBUG nova.virt.block_device [None req-d68a1985-f46b-42ea-935d-cef5fa75472f tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] [instance: c11fbffa-07e2-40c4-92b1-8531dbe8b687] Updating existing volume attachment record: ba089cb4-ea91-404a-9644-58b0c001f1fc {{(pid=75226) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 17 01:34:03 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:34:03 user nova-compute[75226]: DEBUG nova.objects.instance [None req-d024e35d-8ced-4980-843d-c48eeb5b8a76 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Lazy-loading 'flavor' on Instance uuid dae5490b-e434-4cd1-b8d4-6baab9bb7345 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:34:03 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-d024e35d-8ced-4980-843d-c48eeb5b8a76 tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Lock "dae5490b-e434-4cd1-b8d4-6baab9bb7345" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.729s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:34:03 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "dae5490b-e434-4cd1-b8d4-6baab9bb7345" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 5.742s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:34:03 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "dae5490b-e434-4cd1-b8d4-6baab9bb7345" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.029s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:34:04 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:34:06 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-dd9ed3c2-8035-4211-b1d1-c5b9bf575570 tempest-VolumesNegativeTest-618394537 tempest-VolumesNegativeTest-618394537-project-member] Acquiring lock "18a445fd-6ca2-470f-85c4-301cde767284" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:34:06 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-dd9ed3c2-8035-4211-b1d1-c5b9bf575570 tempest-VolumesNegativeTest-618394537 tempest-VolumesNegativeTest-618394537-project-member] Lock "18a445fd-6ca2-470f-85c4-301cde767284" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:34:06 user nova-compute[75226]: DEBUG nova.compute.manager [None req-dd9ed3c2-8035-4211-b1d1-c5b9bf575570 tempest-VolumesNegativeTest-618394537 tempest-VolumesNegativeTest-618394537-project-member] [instance: 18a445fd-6ca2-470f-85c4-301cde767284] Starting instance... {{(pid=75226) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 17 01:34:06 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-dd9ed3c2-8035-4211-b1d1-c5b9bf575570 tempest-VolumesNegativeTest-618394537 tempest-VolumesNegativeTest-618394537-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:34:06 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-dd9ed3c2-8035-4211-b1d1-c5b9bf575570 tempest-VolumesNegativeTest-618394537 tempest-VolumesNegativeTest-618394537-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:34:06 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-dd9ed3c2-8035-4211-b1d1-c5b9bf575570 tempest-VolumesNegativeTest-618394537 tempest-VolumesNegativeTest-618394537-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75226) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 17 01:34:06 user nova-compute[75226]: INFO nova.compute.claims [None req-dd9ed3c2-8035-4211-b1d1-c5b9bf575570 tempest-VolumesNegativeTest-618394537 tempest-VolumesNegativeTest-618394537-project-member] [instance: 18a445fd-6ca2-470f-85c4-301cde767284] Claim successful on node user
Nov 17 01:34:06 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:34:06 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:34:06 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:34:06 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:34:06 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:34:07 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-dd9ed3c2-8035-4211-b1d1-c5b9bf575570 tempest-VolumesNegativeTest-618394537 tempest-VolumesNegativeTest-618394537-project-member] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:34:07 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-dd9ed3c2-8035-4211-b1d1-c5b9bf575570 tempest-VolumesNegativeTest-618394537 tempest-VolumesNegativeTest-618394537-project-member] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:34:07 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-dd9ed3c2-8035-4211-b1d1-c5b9bf575570 tempest-VolumesNegativeTest-618394537 tempest-VolumesNegativeTest-618394537-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.556s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:34:07 user nova-compute[75226]: DEBUG nova.compute.manager [None req-dd9ed3c2-8035-4211-b1d1-c5b9bf575570 tempest-VolumesNegativeTest-618394537 tempest-VolumesNegativeTest-618394537-project-member] [instance: 18a445fd-6ca2-470f-85c4-301cde767284] Start building networks asynchronously for instance. {{(pid=75226) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 17 01:34:07 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.263s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:34:07 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:34:07 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75226) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 17 01:34:07 user nova-compute[75226]: DEBUG nova.compute.manager [None req-dd9ed3c2-8035-4211-b1d1-c5b9bf575570 tempest-VolumesNegativeTest-618394537 tempest-VolumesNegativeTest-618394537-project-member] [instance: 18a445fd-6ca2-470f-85c4-301cde767284] Allocating IP information in the background. {{(pid=75226) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 17 01:34:07 user nova-compute[75226]: DEBUG nova.network.neutron [None req-dd9ed3c2-8035-4211-b1d1-c5b9bf575570 tempest-VolumesNegativeTest-618394537 tempest-VolumesNegativeTest-618394537-project-member] [instance: 18a445fd-6ca2-470f-85c4-301cde767284] allocate_for_instance() {{(pid=75226) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 17 01:34:07 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-dd9ed3c2-8035-4211-b1d1-c5b9bf575570 tempest-VolumesNegativeTest-618394537 tempest-VolumesNegativeTest-618394537-project-member] [instance: 18a445fd-6ca2-470f-85c4-301cde767284] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 17 01:34:07 user nova-compute[75226]: DEBUG nova.compute.manager [None req-dd9ed3c2-8035-4211-b1d1-c5b9bf575570 tempest-VolumesNegativeTest-618394537 tempest-VolumesNegativeTest-618394537-project-member] [instance: 18a445fd-6ca2-470f-85c4-301cde767284] Start building block device mappings for instance. {{(pid=75226) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 17 01:34:07 user nova-compute[75226]: DEBUG nova.policy [None req-dd9ed3c2-8035-4211-b1d1-c5b9bf575570 tempest-VolumesNegativeTest-618394537 tempest-VolumesNegativeTest-618394537-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3121ba344d8d4d418e79deda1a1b30af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6578c3a9a49416f90039f0a0dcefbfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75226) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 17 01:34:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa84e575-bdad-45b9-80ce-86b1c2826fb0/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:34:07 user nova-compute[75226]: DEBUG nova.compute.manager [None req-dd9ed3c2-8035-4211-b1d1-c5b9bf575570 tempest-VolumesNegativeTest-618394537 tempest-VolumesNegativeTest-618394537-project-member] [instance: 18a445fd-6ca2-470f-85c4-301cde767284] Start spawning the instance on the hypervisor. {{(pid=75226) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 17 01:34:07 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-dd9ed3c2-8035-4211-b1d1-c5b9bf575570 tempest-VolumesNegativeTest-618394537 tempest-VolumesNegativeTest-618394537-project-member] [instance: 18a445fd-6ca2-470f-85c4-301cde767284] Creating instance directory {{(pid=75226) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 17 01:34:07 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-dd9ed3c2-8035-4211-b1d1-c5b9bf575570 tempest-VolumesNegativeTest-618394537 tempest-VolumesNegativeTest-618394537-project-member] [instance: 18a445fd-6ca2-470f-85c4-301cde767284] Creating image(s)
Nov 17 01:34:07 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-dd9ed3c2-8035-4211-b1d1-c5b9bf575570 tempest-VolumesNegativeTest-618394537 tempest-VolumesNegativeTest-618394537-project-member] Acquiring lock "/opt/stack/data/nova/instances/18a445fd-6ca2-470f-85c4-301cde767284/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:34:07 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-dd9ed3c2-8035-4211-b1d1-c5b9bf575570 tempest-VolumesNegativeTest-618394537 tempest-VolumesNegativeTest-618394537-project-member] Lock "/opt/stack/data/nova/instances/18a445fd-6ca2-470f-85c4-301cde767284/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:34:07 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-dd9ed3c2-8035-4211-b1d1-c5b9bf575570 tempest-VolumesNegativeTest-618394537 tempest-VolumesNegativeTest-618394537-project-member] Lock "/opt/stack/data/nova/instances/18a445fd-6ca2-470f-85c4-301cde767284/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:34:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-dd9ed3c2-8035-4211-b1d1-c5b9bf575570 tempest-VolumesNegativeTest-618394537 tempest-VolumesNegativeTest-618394537-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:34:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa84e575-bdad-45b9-80ce-86b1c2826fb0/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:34:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa84e575-bdad-45b9-80ce-86b1c2826fb0/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:34:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-dd9ed3c2-8035-4211-b1d1-c5b9bf575570 tempest-VolumesNegativeTest-618394537 tempest-VolumesNegativeTest-618394537-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json" returned: 0 in 0.175s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:34:07 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-dd9ed3c2-8035-4211-b1d1-c5b9bf575570 tempest-VolumesNegativeTest-618394537 tempest-VolumesNegativeTest-618394537-project-member] Acquiring lock "a8a62c2546af3a2036b853250c5ac64d4c6b4371" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:34:07 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-dd9ed3c2-8035-4211-b1d1-c5b9bf575570 tempest-VolumesNegativeTest-618394537 tempest-VolumesNegativeTest-618394537-project-member] Lock "a8a62c2546af3a2036b853250c5ac64d4c6b4371" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:34:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-dd9ed3c2-8035-4211-b1d1-c5b9bf575570 tempest-VolumesNegativeTest-618394537 tempest-VolumesNegativeTest-618394537-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:34:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa84e575-bdad-45b9-80ce-86b1c2826fb0/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:34:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e8b4b85-fe0c-4592-850e-e94ebab32d02/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:34:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-dd9ed3c2-8035-4211-b1d1-c5b9bf575570 tempest-VolumesNegativeTest-618394537 tempest-VolumesNegativeTest-618394537-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json" returned: 0 in 0.190s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:34:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-dd9ed3c2-8035-4211-b1d1-c5b9bf575570 tempest-VolumesNegativeTest-618394537 tempest-VolumesNegativeTest-618394537-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371,backing_fmt=raw /opt/stack/data/nova/instances/18a445fd-6ca2-470f-85c4-301cde767284/disk 1073741824 {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:34:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-dd9ed3c2-8035-4211-b1d1-c5b9bf575570 tempest-VolumesNegativeTest-618394537 tempest-VolumesNegativeTest-618394537-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371,backing_fmt=raw /opt/stack/data/nova/instances/18a445fd-6ca2-470f-85c4-301cde767284/disk 1073741824" returned: 0 in 0.050s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:34:07 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-dd9ed3c2-8035-4211-b1d1-c5b9bf575570 tempest-VolumesNegativeTest-618394537 tempest-VolumesNegativeTest-618394537-project-member] Lock "a8a62c2546af3a2036b853250c5ac64d4c6b4371" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:34:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-dd9ed3c2-8035-4211-b1d1-c5b9bf575570 tempest-VolumesNegativeTest-618394537 tempest-VolumesNegativeTest-618394537-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:34:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e8b4b85-fe0c-4592-850e-e94ebab32d02/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:34:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e8b4b85-fe0c-4592-850e-e94ebab32d02/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:34:08 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:34:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-dd9ed3c2-8035-4211-b1d1-c5b9bf575570 tempest-VolumesNegativeTest-618394537 tempest-VolumesNegativeTest-618394537-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json" returned: 0 in 0.176s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:34:08 user nova-compute[75226]: DEBUG nova.virt.disk.api [None req-dd9ed3c2-8035-4211-b1d1-c5b9bf575570 tempest-VolumesNegativeTest-618394537 tempest-VolumesNegativeTest-618394537-project-member] Checking if we can resize image /opt/stack/data/nova/instances/18a445fd-6ca2-470f-85c4-301cde767284/disk. size=1073741824 {{(pid=75226) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 17 01:34:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-dd9ed3c2-8035-4211-b1d1-c5b9bf575570 tempest-VolumesNegativeTest-618394537 tempest-VolumesNegativeTest-618394537-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18a445fd-6ca2-470f-85c4-301cde767284/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:34:08 user nova-compute[75226]: DEBUG nova.network.neutron [None req-dd9ed3c2-8035-4211-b1d1-c5b9bf575570 tempest-VolumesNegativeTest-618394537 tempest-VolumesNegativeTest-618394537-project-member] [instance: 18a445fd-6ca2-470f-85c4-301cde767284] Successfully created port: abcd9fa6-496b-4a78-87d8-e5e8e2a5a31c {{(pid=75226) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 17 01:34:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e8b4b85-fe0c-4592-850e-e94ebab32d02/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:34:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6555d72-6094-4ea9-b071-a3d3c8a300a9/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:34:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-dd9ed3c2-8035-4211-b1d1-c5b9bf575570 tempest-VolumesNegativeTest-618394537 tempest-VolumesNegativeTest-618394537-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18a445fd-6ca2-470f-85c4-301cde767284/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:34:08 user nova-compute[75226]: DEBUG nova.virt.disk.api [None req-dd9ed3c2-8035-4211-b1d1-c5b9bf575570 tempest-VolumesNegativeTest-618394537 tempest-VolumesNegativeTest-618394537-project-member] Cannot resize image /opt/stack/data/nova/instances/18a445fd-6ca2-470f-85c4-301cde767284/disk to a smaller size. {{(pid=75226) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 17 01:34:08 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-dd9ed3c2-8035-4211-b1d1-c5b9bf575570 tempest-VolumesNegativeTest-618394537 tempest-VolumesNegativeTest-618394537-project-member] [instance: 18a445fd-6ca2-470f-85c4-301cde767284] Created local disks {{(pid=75226) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 17 01:34:08 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-dd9ed3c2-8035-4211-b1d1-c5b9bf575570 tempest-VolumesNegativeTest-618394537 tempest-VolumesNegativeTest-618394537-project-member] [instance: 18a445fd-6ca2-470f-85c4-301cde767284] Ensure instance console log exists: /opt/stack/data/nova/instances/18a445fd-6ca2-470f-85c4-301cde767284/console.log {{(pid=75226) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 17 01:34:08 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-dd9ed3c2-8035-4211-b1d1-c5b9bf575570 tempest-VolumesNegativeTest-618394537 tempest-VolumesNegativeTest-618394537-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:34:08 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-dd9ed3c2-8035-4211-b1d1-c5b9bf575570 tempest-VolumesNegativeTest-618394537 tempest-VolumesNegativeTest-618394537-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:34:08 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-dd9ed3c2-8035-4211-b1d1-c5b9bf575570 tempest-VolumesNegativeTest-618394537 tempest-VolumesNegativeTest-618394537-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:34:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6555d72-6094-4ea9-b071-a3d3c8a300a9/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:34:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6555d72-6094-4ea9-b071-a3d3c8a300a9/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:34:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6555d72-6094-4ea9-b071-a3d3c8a300a9/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:34:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dae5490b-e434-4cd1-b8d4-6baab9bb7345/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:34:08 user nova-compute[75226]: DEBUG nova.network.neutron [None req-dd9ed3c2-8035-4211-b1d1-c5b9bf575570 tempest-VolumesNegativeTest-618394537 tempest-VolumesNegativeTest-618394537-project-member] [instance: 18a445fd-6ca2-470f-85c4-301cde767284] Successfully updated port: abcd9fa6-496b-4a78-87d8-e5e8e2a5a31c {{(pid=75226) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 17 01:34:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dae5490b-e434-4cd1-b8d4-6baab9bb7345/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:34:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dae5490b-e434-4cd1-b8d4-6baab9bb7345/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:34:08 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-dd9ed3c2-8035-4211-b1d1-c5b9bf575570 tempest-VolumesNegativeTest-618394537 tempest-VolumesNegativeTest-618394537-project-member] Acquiring lock "refresh_cache-18a445fd-6ca2-470f-85c4-301cde767284" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:34:08 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-dd9ed3c2-8035-4211-b1d1-c5b9bf575570 tempest-VolumesNegativeTest-618394537 tempest-VolumesNegativeTest-618394537-project-member] Acquired lock "refresh_cache-18a445fd-6ca2-470f-85c4-301cde767284" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:34:08 user nova-compute[75226]: DEBUG nova.network.neutron [None req-dd9ed3c2-8035-4211-b1d1-c5b9bf575570 tempest-VolumesNegativeTest-618394537 tempest-VolumesNegativeTest-618394537-project-member] [instance: 18a445fd-6ca2-470f-85c4-301cde767284] Building network info cache for instance {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 01:34:08 user nova-compute[75226]: DEBUG nova.compute.manager [req-78e3cf69-06a4-4cdb-ad16-451820b0ad3d req-da5a7007-0eff-4f5f-8d09-6a46743eb056 service nova] [instance: 18a445fd-6ca2-470f-85c4-301cde767284] Received event network-changed-abcd9fa6-496b-4a78-87d8-e5e8e2a5a31c {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:34:08 user nova-compute[75226]: DEBUG nova.compute.manager [req-78e3cf69-06a4-4cdb-ad16-451820b0ad3d req-da5a7007-0eff-4f5f-8d09-6a46743eb056 service nova] [instance: 18a445fd-6ca2-470f-85c4-301cde767284] Refreshing instance network info cache due to event network-changed-abcd9fa6-496b-4a78-87d8-e5e8e2a5a31c. {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 01:34:08 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-78e3cf69-06a4-4cdb-ad16-451820b0ad3d req-da5a7007-0eff-4f5f-8d09-6a46743eb056 service nova] Acquiring lock "refresh_cache-18a445fd-6ca2-470f-85c4-301cde767284" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:34:08 user nova-compute[75226]: DEBUG nova.network.neutron [None req-dd9ed3c2-8035-4211-b1d1-c5b9bf575570 tempest-VolumesNegativeTest-618394537 tempest-VolumesNegativeTest-618394537-project-member] [instance: 18a445fd-6ca2-470f-85c4-301cde767284] Instance cache missing network info. {{(pid=75226) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 17 01:34:09 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dae5490b-e434-4cd1-b8d4-6baab9bb7345/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:34:09 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38062487-67ca-4962-974f-81456aebe97b/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:34:09 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:34:09 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38062487-67ca-4962-974f-81456aebe97b/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:34:09 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38062487-67ca-4962-974f-81456aebe97b/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:34:09 user nova-compute[75226]: DEBUG nova.network.neutron [None req-dd9ed3c2-8035-4211-b1d1-c5b9bf575570 tempest-VolumesNegativeTest-618394537 tempest-VolumesNegativeTest-618394537-project-member] [instance: 18a445fd-6ca2-470f-85c4-301cde767284] Updating instance_info_cache with network_info: [{"id": "abcd9fa6-496b-4a78-87d8-e5e8e2a5a31c", "address": "fa:16:3e:60:05:c6", "network": {"id": "918c1267-3f3d-4c5b-8c79-b443112890c6", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.180", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e4e110cbf9a84362a6864a7732c435a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabcd9fa6-49", "ovs_interfaceid": "abcd9fa6-496b-4a78-87d8-e5e8e2a5a31c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:34:09 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-dd9ed3c2-8035-4211-b1d1-c5b9bf575570 tempest-VolumesNegativeTest-618394537 tempest-VolumesNegativeTest-618394537-project-member] Releasing lock "refresh_cache-18a445fd-6ca2-470f-85c4-301cde767284" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:34:09 user nova-compute[75226]: DEBUG nova.compute.manager [None req-dd9ed3c2-8035-4211-b1d1-c5b9bf575570 tempest-VolumesNegativeTest-618394537 tempest-VolumesNegativeTest-618394537-project-member] [instance: 18a445fd-6ca2-470f-85c4-301cde767284] Instance network_info: |[{"id": "abcd9fa6-496b-4a78-87d8-e5e8e2a5a31c", "address": "fa:16:3e:60:05:c6", "network": {"id": "918c1267-3f3d-4c5b-8c79-b443112890c6", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.180", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e4e110cbf9a84362a6864a7732c435a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabcd9fa6-49", "ovs_interfaceid": "abcd9fa6-496b-4a78-87d8-e5e8e2a5a31c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75226) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 17 01:34:09 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-78e3cf69-06a4-4cdb-ad16-451820b0ad3d req-da5a7007-0eff-4f5f-8d09-6a46743eb056 service nova] Acquired lock "refresh_cache-18a445fd-6ca2-470f-85c4-301cde767284" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:34:09 user nova-compute[75226]: DEBUG nova.network.neutron [req-78e3cf69-06a4-4cdb-ad16-451820b0ad3d req-da5a7007-0eff-4f5f-8d09-6a46743eb056 service nova] [instance: 18a445fd-6ca2-470f-85c4-301cde767284] Refreshing network info cache for port abcd9fa6-496b-4a78-87d8-e5e8e2a5a31c {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 01:34:09 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-dd9ed3c2-8035-4211-b1d1-c5b9bf575570 tempest-VolumesNegativeTest-618394537 tempest-VolumesNegativeTest-618394537-project-member] [instance: 18a445fd-6ca2-470f-85c4-301cde767284] Start _get_guest_xml network_info=[{"id": "abcd9fa6-496b-4a78-87d8-e5e8e2a5a31c", "address": "fa:16:3e:60:05:c6", "network": {"id": "918c1267-3f3d-4c5b-8c79-b443112890c6", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.180", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e4e110cbf9a84362a6864a7732c435a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabcd9fa6-49", "ovs_interfaceid": "abcd9fa6-496b-4a78-87d8-e5e8e2a5a31c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T01:13:22Z,direct_url=<?>,disk_format='qcow2',id=0b369aea-6f3f-4690-9f01-229b90ab6310,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4e110cbf9a84362a6864a7732c435a1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T01:13:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '0b369aea-6f3f-4690-9f01-229b90ab6310'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75226) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 17 01:34:09 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-dd9ed3c2-8035-4211-b1d1-c5b9bf575570 tempest-VolumesNegativeTest-618394537 tempest-VolumesNegativeTest-618394537-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:34:09 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-dd9ed3c2-8035-4211-b1d1-c5b9bf575570 tempest-VolumesNegativeTest-618394537 tempest-VolumesNegativeTest-618394537-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:34:09 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-dd9ed3c2-8035-4211-b1d1-c5b9bf575570 tempest-VolumesNegativeTest-618394537 tempest-VolumesNegativeTest-618394537-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75226) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 17 01:34:09 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-dd9ed3c2-8035-4211-b1d1-c5b9bf575570 tempest-VolumesNegativeTest-618394537 tempest-VolumesNegativeTest-618394537-project-member] CPU controller missing on host. {{(pid=75226) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 17 01:34:09 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-dd9ed3c2-8035-4211-b1d1-c5b9bf575570 tempest-VolumesNegativeTest-618394537 tempest-VolumesNegativeTest-618394537-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75226) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 17 01:34:09 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-dd9ed3c2-8035-4211-b1d1-c5b9bf575570 tempest-VolumesNegativeTest-618394537 tempest-VolumesNegativeTest-618394537-project-member] CPU controller found on host. {{(pid=75226) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 17 01:34:09 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-dd9ed3c2-8035-4211-b1d1-c5b9bf575570 tempest-VolumesNegativeTest-618394537 tempest-VolumesNegativeTest-618394537-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75226) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 17 01:34:09 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-dd9ed3c2-8035-4211-b1d1-c5b9bf575570 tempest-VolumesNegativeTest-618394537 tempest-VolumesNegativeTest-618394537-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-17T01:13:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T01:13:22Z,direct_url=<?>,disk_format='qcow2',id=0b369aea-6f3f-4690-9f01-229b90ab6310,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4e110cbf9a84362a6864a7732c435a1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T01:13:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 17 01:34:09 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-dd9ed3c2-8035-4211-b1d1-c5b9bf575570 tempest-VolumesNegativeTest-618394537 tempest-VolumesNegativeTest-618394537-project-member] Flavor limits 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 17 01:34:09 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-dd9ed3c2-8035-4211-b1d1-c5b9bf575570 tempest-VolumesNegativeTest-618394537 tempest-VolumesNegativeTest-618394537-project-member] Image limits 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 17 01:34:09 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-dd9ed3c2-8035-4211-b1d1-c5b9bf575570 tempest-VolumesNegativeTest-618394537 tempest-VolumesNegativeTest-618394537-project-member] Flavor pref 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 17 01:34:09 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-dd9ed3c2-8035-4211-b1d1-c5b9bf575570 tempest-VolumesNegativeTest-618394537 tempest-VolumesNegativeTest-618394537-project-member] Image pref 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 17 01:34:09 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-dd9ed3c2-8035-4211-b1d1-c5b9bf575570 tempest-VolumesNegativeTest-618394537 tempest-VolumesNegativeTest-618394537-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 17 01:34:09 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-dd9ed3c2-8035-4211-b1d1-c5b9bf575570 tempest-VolumesNegativeTest-618394537 tempest-VolumesNegativeTest-618394537-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 17 01:34:09 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-dd9ed3c2-8035-4211-b1d1-c5b9bf575570 tempest-VolumesNegativeTest-618394537 tempest-VolumesNegativeTest-618394537-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75226) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 17 01:34:09 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-dd9ed3c2-8035-4211-b1d1-c5b9bf575570 tempest-VolumesNegativeTest-618394537 tempest-VolumesNegativeTest-618394537-project-member] Got 1 possible topologies {{(pid=75226) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 17 01:34:09 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-dd9ed3c2-8035-4211-b1d1-c5b9bf575570 tempest-VolumesNegativeTest-618394537 tempest-VolumesNegativeTest-618394537-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 17 01:34:09 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-dd9ed3c2-8035-4211-b1d1-c5b9bf575570 tempest-VolumesNegativeTest-618394537 tempest-VolumesNegativeTest-618394537-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 17 01:34:09 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-dd9ed3c2-8035-4211-b1d1-c5b9bf575570 tempest-VolumesNegativeTest-618394537 tempest-VolumesNegativeTest-618394537-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:34:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1922127987',display_name='tempest-VolumesNegativeTest-instance-1922127987',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1922127987',id=34,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b6578c3a9a49416f90039f0a0dcefbfe',ramdisk_id='',reservation_id='r-q3r4id6d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-618394537',owner_user_name='tempest-VolumesNegativeTest-618394537-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T01:34:07Z,user_data=None,user_id='3121ba344d8d4d418e79deda1a1b30af',uuid=18a445fd-6ca2-470f-85c4-301cde767284,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "abcd9fa6-496b-4a78-87d8-e5e8e2a5a31c", "address": "fa:16:3e:60:05:c6", "network": {"id": "918c1267-3f3d-4c5b-8c79-b443112890c6", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.180", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e4e110cbf9a84362a6864a7732c435a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabcd9fa6-49", "ovs_interfaceid": "abcd9fa6-496b-4a78-87d8-e5e8e2a5a31c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75226) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 01:34:09 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-dd9ed3c2-8035-4211-b1d1-c5b9bf575570 tempest-VolumesNegativeTest-618394537 tempest-VolumesNegativeTest-618394537-project-member] Converting VIF {"id": "abcd9fa6-496b-4a78-87d8-e5e8e2a5a31c", "address": "fa:16:3e:60:05:c6", "network": {"id": "918c1267-3f3d-4c5b-8c79-b443112890c6", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.180", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e4e110cbf9a84362a6864a7732c435a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabcd9fa6-49", "ovs_interfaceid": "abcd9fa6-496b-4a78-87d8-e5e8e2a5a31c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:34:09 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-dd9ed3c2-8035-4211-b1d1-c5b9bf575570 tempest-VolumesNegativeTest-618394537 tempest-VolumesNegativeTest-618394537-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:05:c6,bridge_name='br-int',has_traffic_filtering=True,id=abcd9fa6-496b-4a78-87d8-e5e8e2a5a31c,network=Network(918c1267-3f3d-4c5b-8c79-b443112890c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabcd9fa6-49') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:34:09 user nova-compute[75226]: DEBUG nova.objects.instance [None req-dd9ed3c2-8035-4211-b1d1-c5b9bf575570 tempest-VolumesNegativeTest-618394537 tempest-VolumesNegativeTest-618394537-project-member] Lazy-loading 'pci_devices' on Instance uuid 18a445fd-6ca2-470f-85c4-301cde767284 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:34:09 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-dd9ed3c2-8035-4211-b1d1-c5b9bf575570 tempest-VolumesNegativeTest-618394537 tempest-VolumesNegativeTest-618394537-project-member] [instance: 18a445fd-6ca2-470f-85c4-301cde767284] End _get_guest_xml xml=<domain type="kvm">
Nov 17 01:34:09 user nova-compute[75226]:   <uuid>18a445fd-6ca2-470f-85c4-301cde767284</uuid>
Nov 17 01:34:09 user nova-compute[75226]:   <name>instance-00000022</name>
Nov 17 01:34:09 user nova-compute[75226]:   <memory>524288</memory>
Nov 17 01:34:09 user nova-compute[75226]:   <vcpu>1</vcpu>
Nov 17 01:34:09 user nova-compute[75226]:   <metadata>
Nov 17 01:34:09 user nova-compute[75226]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 17 01:34:09 user nova-compute[75226]:       <nova:package version="0.0.0"/>
Nov 17 01:34:09 user nova-compute[75226]:       <nova:name>tempest-VolumesNegativeTest-instance-1922127987</nova:name>
Nov 17 01:34:09 user nova-compute[75226]:       <nova:creationTime>2023-11-17 01:34:09</nova:creationTime>
Nov 17 01:34:09 user nova-compute[75226]:       <nova:flavor name="m1.tiny">
Nov 17 01:34:09 user nova-compute[75226]:         <nova:memory>512</nova:memory>
Nov 17 01:34:09 user nova-compute[75226]:         <nova:disk>1</nova:disk>
Nov 17 01:34:09 user nova-compute[75226]:         <nova:swap>0</nova:swap>
Nov 17 01:34:09 user nova-compute[75226]:         <nova:ephemeral>0</nova:ephemeral>
Nov 17 01:34:09 user nova-compute[75226]:         <nova:vcpus>1</nova:vcpus>
Nov 17 01:34:09 user nova-compute[75226]:       </nova:flavor>
Nov 17 01:34:09 user nova-compute[75226]:       <nova:owner>
Nov 17 01:34:09 user nova-compute[75226]:         <nova:user uuid="3121ba344d8d4d418e79deda1a1b30af">tempest-VolumesNegativeTest-618394537-project-member</nova:user>
Nov 17 01:34:09 user nova-compute[75226]:         <nova:project uuid="b6578c3a9a49416f90039f0a0dcefbfe">tempest-VolumesNegativeTest-618394537</nova:project>
Nov 17 01:34:09 user nova-compute[75226]:       </nova:owner>
Nov 17 01:34:09 user nova-compute[75226]:       <nova:root type="image" uuid="0b369aea-6f3f-4690-9f01-229b90ab6310"/>
Nov 17 01:34:09 user nova-compute[75226]:       <nova:ports>
Nov 17 01:34:09 user nova-compute[75226]:         <nova:port uuid="abcd9fa6-496b-4a78-87d8-e5e8e2a5a31c">
Nov 17 01:34:09 user nova-compute[75226]:           <nova:ip type="fixed" address="192.168.233.180" ipVersion="4"/>
Nov 17 01:34:09 user nova-compute[75226]:         </nova:port>
Nov 17 01:34:09 user nova-compute[75226]:       </nova:ports>
Nov 17 01:34:09 user nova-compute[75226]:     </nova:instance>
Nov 17 01:34:09 user nova-compute[75226]:   </metadata>
Nov 17 01:34:09 user nova-compute[75226]:   <sysinfo type="smbios">
Nov 17 01:34:09 user nova-compute[75226]:     <system>
Nov 17 01:34:09 user nova-compute[75226]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 17 01:34:09 user nova-compute[75226]:       <entry name="product">OpenStack Nova</entry>
Nov 17 01:34:09 user nova-compute[75226]:       <entry name="version">0.0.0</entry>
Nov 17 01:34:09 user nova-compute[75226]:       <entry name="serial">18a445fd-6ca2-470f-85c4-301cde767284</entry>
Nov 17 01:34:09 user nova-compute[75226]:       <entry name="uuid">18a445fd-6ca2-470f-85c4-301cde767284</entry>
Nov 17 01:34:09 user nova-compute[75226]:       <entry name="family">Virtual Machine</entry>
Nov 17 01:34:09 user nova-compute[75226]:     </system>
Nov 17 01:34:09 user nova-compute[75226]:   </sysinfo>
Nov 17 01:34:09 user nova-compute[75226]:   <os>
Nov 17 01:34:09 user nova-compute[75226]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 17 01:34:09 user nova-compute[75226]:     <boot dev="hd"/>
Nov 17 01:34:09 user nova-compute[75226]:     <smbios mode="sysinfo"/>
Nov 17 01:34:09 user nova-compute[75226]:   </os>
Nov 17 01:34:09 user nova-compute[75226]:   <features>
Nov 17 01:34:09 user nova-compute[75226]:     <acpi/>
Nov 17 01:34:09 user nova-compute[75226]:     <apic/>
Nov 17 01:34:09 user nova-compute[75226]:     <vmcoreinfo/>
Nov 17 01:34:09 user nova-compute[75226]:   </features>
Nov 17 01:34:09 user nova-compute[75226]:   <clock offset="utc">
Nov 17 01:34:09 user nova-compute[75226]:     <timer name="pit" tickpolicy="delay"/>
Nov 17 01:34:09 user nova-compute[75226]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 17 01:34:09 user nova-compute[75226]:     <timer name="hpet" present="no"/>
Nov 17 01:34:09 user nova-compute[75226]:   </clock>
Nov 17 01:34:09 user nova-compute[75226]:   <cpu mode="custom" match="exact">
Nov 17 01:34:09 user nova-compute[75226]:     <model>Nehalem</model>
Nov 17 01:34:09 user nova-compute[75226]:     <topology sockets="1" cores="1" threads="1"/>
Nov 17 01:34:09 user nova-compute[75226]:   </cpu>
Nov 17 01:34:09 user nova-compute[75226]:   <devices>
Nov 17 01:34:09 user nova-compute[75226]:     <disk type="file" device="disk">
Nov 17 01:34:09 user nova-compute[75226]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 17 01:34:09 user nova-compute[75226]:       <source file="/opt/stack/data/nova/instances/18a445fd-6ca2-470f-85c4-301cde767284/disk"/>
Nov 17 01:34:09 user nova-compute[75226]:       <target dev="vda" bus="virtio"/>
Nov 17 01:34:09 user nova-compute[75226]:     </disk>
Nov 17 01:34:09 user nova-compute[75226]:     <interface type="ethernet">
Nov 17 01:34:09 user nova-compute[75226]:       <mac address="fa:16:3e:60:05:c6"/>
Nov 17 01:34:09 user nova-compute[75226]:       <model type="virtio"/>
Nov 17 01:34:09 user nova-compute[75226]:       <mtu size="1442"/>
Nov 17 01:34:09 user nova-compute[75226]:       <target dev="tapabcd9fa6-49"/>
Nov 17 01:34:09 user nova-compute[75226]:     </interface>
Nov 17 01:34:09 user nova-compute[75226]:     <serial type="pty">
Nov 17 01:34:09 user nova-compute[75226]:       <log file="/opt/stack/data/nova/instances/18a445fd-6ca2-470f-85c4-301cde767284/console.log" append="off"/>
Nov 17 01:34:09 user nova-compute[75226]:     </serial>
Nov 17 01:34:09 user nova-compute[75226]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 17 01:34:09 user nova-compute[75226]:     <video>
Nov 17 01:34:09 user nova-compute[75226]:       <model type="virtio"/>
Nov 17 01:34:09 user nova-compute[75226]:     </video>
Nov 17 01:34:09 user nova-compute[75226]:     <rng model="virtio">
Nov 17 01:34:09 user nova-compute[75226]:       <backend model="random">/dev/urandom</backend>
Nov 17 01:34:09 user nova-compute[75226]:     </rng>
Nov 17 01:34:09 user nova-compute[75226]:     <controller type="usb" index="0" model="none"/>
Nov 17 01:34:09 user nova-compute[75226]:     <memballoon model="virtio">
Nov 17 01:34:09 user nova-compute[75226]:       <stats period="10"/>
Nov 17 01:34:09 user nova-compute[75226]:     </memballoon>
Nov 17 01:34:09 user nova-compute[75226]:   </devices>
Nov 17 01:34:09 user nova-compute[75226]: </domain>
Nov 17 01:34:09 user nova-compute[75226]:  {{(pid=75226) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 17 01:34:09 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-dd9ed3c2-8035-4211-b1d1-c5b9bf575570 tempest-VolumesNegativeTest-618394537 tempest-VolumesNegativeTest-618394537-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:34:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1922127987',display_name='tempest-VolumesNegativeTest-instance-1922127987',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1922127987',id=34,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b6578c3a9a49416f90039f0a0dcefbfe',ramdisk_id='',reservation_id='r-q3r4id6d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-618394537',owner_user_name='tempest-VolumesNegativeTest-618394537-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T01:34:07Z,user_data=None,user_id='3121ba344d8d4d418e79deda1a1b30af',uuid=18a445fd-6ca2-470f-85c4-301cde767284,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "abcd9fa6-496b-4a78-87d8-e5e8e2a5a31c", "address": "fa:16:3e:60:05:c6", "network": {"id": "918c1267-3f3d-4c5b-8c79-b443112890c6", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.180", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e4e110cbf9a84362a6864a7732c435a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabcd9fa6-49", "ovs_interfaceid": "abcd9fa6-496b-4a78-87d8-e5e8e2a5a31c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 17 01:34:09 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-dd9ed3c2-8035-4211-b1d1-c5b9bf575570 tempest-VolumesNegativeTest-618394537 tempest-VolumesNegativeTest-618394537-project-member] Converting VIF {"id": "abcd9fa6-496b-4a78-87d8-e5e8e2a5a31c", "address": "fa:16:3e:60:05:c6", "network": {"id": "918c1267-3f3d-4c5b-8c79-b443112890c6", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.180", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e4e110cbf9a84362a6864a7732c435a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabcd9fa6-49", "ovs_interfaceid": "abcd9fa6-496b-4a78-87d8-e5e8e2a5a31c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:34:09 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-dd9ed3c2-8035-4211-b1d1-c5b9bf575570 tempest-VolumesNegativeTest-618394537 tempest-VolumesNegativeTest-618394537-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:05:c6,bridge_name='br-int',has_traffic_filtering=True,id=abcd9fa6-496b-4a78-87d8-e5e8e2a5a31c,network=Network(918c1267-3f3d-4c5b-8c79-b443112890c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabcd9fa6-49') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:34:09 user nova-compute[75226]: DEBUG os_vif [None req-dd9ed3c2-8035-4211-b1d1-c5b9bf575570 tempest-VolumesNegativeTest-618394537 tempest-VolumesNegativeTest-618394537-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:05:c6,bridge_name='br-int',has_traffic_filtering=True,id=abcd9fa6-496b-4a78-87d8-e5e8e2a5a31c,network=Network(918c1267-3f3d-4c5b-8c79-b443112890c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabcd9fa6-49') {{(pid=75226) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 17 01:34:09 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:34:09 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:34:09 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 17 01:34:09 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:34:09 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f337a8f6-7fed-5f19-9bf8-0d2ad905282e', '_type': 'linux-noop'}}, row=False) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:34:09 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:34:09 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38062487-67ca-4962-974f-81456aebe97b/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:34:09 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:34:09 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:34:09 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapabcd9fa6-49, may_exist=True, interface_attrs={}) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:34:09 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapabcd9fa6-49, col_values=(('qos', UUID('2d43d4e1-b977-4afc-bfbc-4104d87622bb')),), if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:34:09 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapabcd9fa6-49, col_values=(('external_ids', {'iface-id': 'abcd9fa6-496b-4a78-87d8-e5e8e2a5a31c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:60:05:c6', 'vm-uuid': '18a445fd-6ca2-470f-85c4-301cde767284'}),), if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:34:09 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:34:09 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75226) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 01:34:09 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:34:09 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c280142-8901-4f83-bde4-baaa097e05b0/disk.rescue --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:34:09 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:34:09 user nova-compute[75226]: INFO os_vif [None req-dd9ed3c2-8035-4211-b1d1-c5b9bf575570 tempest-VolumesNegativeTest-618394537 tempest-VolumesNegativeTest-618394537-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:05:c6,bridge_name='br-int',has_traffic_filtering=True,id=abcd9fa6-496b-4a78-87d8-e5e8e2a5a31c,network=Network(918c1267-3f3d-4c5b-8c79-b443112890c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabcd9fa6-49')
Nov 17 01:34:09 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-dd9ed3c2-8035-4211-b1d1-c5b9bf575570 tempest-VolumesNegativeTest-618394537 tempest-VolumesNegativeTest-618394537-project-member] No BDM found with device name vda, not building metadata. {{(pid=75226) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 01:34:09 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-dd9ed3c2-8035-4211-b1d1-c5b9bf575570 tempest-VolumesNegativeTest-618394537 tempest-VolumesNegativeTest-618394537-project-member] No VIF found with MAC fa:16:3e:60:05:c6, not building metadata {{(pid=75226) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 01:34:09 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c280142-8901-4f83-bde4-baaa097e05b0/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:34:09 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c280142-8901-4f83-bde4-baaa097e05b0/disk.rescue --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:34:09 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c280142-8901-4f83-bde4-baaa097e05b0/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:34:09 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c280142-8901-4f83-bde4-baaa097e05b0/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:34:09 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c280142-8901-4f83-bde4-baaa097e05b0/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:34:09 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c280142-8901-4f83-bde4-baaa097e05b0/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:34:10 user nova-compute[75226]: DEBUG nova.network.neutron [req-78e3cf69-06a4-4cdb-ad16-451820b0ad3d req-da5a7007-0eff-4f5f-8d09-6a46743eb056 service nova] [instance: 18a445fd-6ca2-470f-85c4-301cde767284] Updated VIF entry in instance network info cache for port abcd9fa6-496b-4a78-87d8-e5e8e2a5a31c. {{(pid=75226) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 01:34:10 user nova-compute[75226]: DEBUG nova.network.neutron [req-78e3cf69-06a4-4cdb-ad16-451820b0ad3d req-da5a7007-0eff-4f5f-8d09-6a46743eb056 service nova] [instance: 18a445fd-6ca2-470f-85c4-301cde767284] Updating instance_info_cache with network_info: [{"id": "abcd9fa6-496b-4a78-87d8-e5e8e2a5a31c", "address": "fa:16:3e:60:05:c6", "network": {"id": "918c1267-3f3d-4c5b-8c79-b443112890c6", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.180", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e4e110cbf9a84362a6864a7732c435a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabcd9fa6-49", "ovs_interfaceid": "abcd9fa6-496b-4a78-87d8-e5e8e2a5a31c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:34:10 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-78e3cf69-06a4-4cdb-ad16-451820b0ad3d req-da5a7007-0eff-4f5f-8d09-6a46743eb056 service nova] Releasing lock "refresh_cache-18a445fd-6ca2-470f-85c4-301cde767284" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:34:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c280142-8901-4f83-bde4-baaa097e05b0/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:34:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4050d898-f2b8-46c2-86e3-702ceb41a701/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:34:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4050d898-f2b8-46c2-86e3-702ceb41a701/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:34:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4050d898-f2b8-46c2-86e3-702ceb41a701/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:34:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4050d898-f2b8-46c2-86e3-702ceb41a701/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:34:10 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75226) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 01:34:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ea5a14b-c330-4a2b-926e-60e1b30f5981/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:34:10 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d68a1985-f46b-42ea-935d-cef5fa75472f tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] [instance: c11fbffa-07e2-40c4-92b1-8531dbe8b687] Calling os-brick to attach iSCSI Volume {{(pid=75226) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 17 01:34:10 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-d68a1985-f46b-42ea-935d-cef5fa75472f tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc4cc36b490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:50b18fb0-86d4-4384-b5be-ad4ac5a6fe82', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xCdzLUgh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:34:10 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-d68a1985-f46b-42ea-935d-cef5fa75472f tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:34:10 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-d68a1985-f46b-42ea-935d-cef5fa75472f tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:34:10 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-d68a1985-f46b-42ea-935d-cef5fa75472f tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:34:10 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-d68a1985-f46b-42ea-935d-cef5fa75472f tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:34:10 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-d68a1985-f46b-42ea-935d-cef5fa75472f tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:50b18fb0-86d4-4384-b5be-ad4ac5a6fe82" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:34:10 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-d68a1985-f46b-42ea-935d-cef5fa75472f tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:50b18fb0-86d4-4384-b5be-ad4ac5a6fe82" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:34:10 user nova-compute[75226]: INFO os_brick.initiator.connectors.iscsi [None req-d68a1985-f46b-42ea-935d-cef5fa75472f tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 17 01:34:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50b18fb0-86d4-4384-b5be-ad4ac5a6fe82 -p 172.16.0.220:3260 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:34:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50b18fb0-86d4-4384-b5be-ad4ac5a6fe82 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:34:10 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[628a1106-276b-429d-8ec1-1a0ebc445690]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:34:10 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-d68a1985-f46b-42ea-935d-cef5fa75472f tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 17 01:34:10 user nova-compute[75226]:  {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:34:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50b18fb0-86d4-4384-b5be-ad4ac5a6fe82 -p 172.16.0.220:3260 --interface default --op new {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:34:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50b18fb0-86d4-4384-b5be-ad4ac5a6fe82 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:34:10 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[361c49ee-525f-48f5-bbc2-95487e813375]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:50b18fb0-86d4-4384-b5be-ad4ac5a6fe82] added\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:34:10 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-d68a1985-f46b-42ea-935d-cef5fa75472f tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:50b18fb0-86d4-4384-b5be-ad4ac5a6fe82] added
Nov 17 01:34:10 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:34:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50b18fb0-86d4-4384-b5be-ad4ac5a6fe82 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:34:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ea5a14b-c330-4a2b-926e-60e1b30f5981/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:34:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ea5a14b-c330-4a2b-926e-60e1b30f5981/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:34:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50b18fb0-86d4-4384-b5be-ad4ac5a6fe82 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:34:10 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7e4eb9b-1e79-4fee-a244-4cd6f65553b2]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:34:10 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-d68a1985-f46b-42ea-935d-cef5fa75472f tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:34:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50b18fb0-86d4-4384-b5be-ad4ac5a6fe82 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:34:10 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:34:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50b18fb0-86d4-4384-b5be-ad4ac5a6fe82 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.036s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:34:10 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c4264c7-f2cf-41b1-a089-f14d57b0d1ca]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:34:10 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-d68a1985-f46b-42ea-935d-cef5fa75472f tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:34:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50b18fb0-86d4-4384-b5be-ad4ac5a6fe82 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xCdzLUgh {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:34:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50b18fb0-86d4-4384-b5be-ad4ac5a6fe82 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xCdzLUgh" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:34:10 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[3084df1e-b385-496a-8652-3bc693bff36b]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:34:10 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-d68a1985-f46b-42ea-935d-cef5fa75472f tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xCdzLUgh'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:34:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50b18fb0-86d4-4384-b5be-ad4ac5a6fe82 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:34:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50b18fb0-86d4-4384-b5be-ad4ac5a6fe82 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:34:10 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[12eb00bd-dee3-4ae2-81bb-8a3444f67e15]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:34:10 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-d68a1985-f46b-42ea-935d-cef5fa75472f tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:34:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:34:10 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:34:10 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:34:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:34:10 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[127d76d4-b0bb-4f89-9a0b-53477eadb8ba]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05f878e5-0241-4282-8b2c-c4651c429dcb (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce3aa851-e7f0-4ea9-b3ed-404dbb123330 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:34:10 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-d68a1985-f46b-42ea-935d-cef5fa75472f tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)
Nov 17 01:34:10 user nova-compute[75226]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05f878e5-0241-4282-8b2c-c4651c429dcb (non-flash)
Nov 17 01:34:10 user nova-compute[75226]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419 (non-flash)
Nov 17 01:34:10 user nova-compute[75226]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce3aa851-e7f0-4ea9-b3ed-404dbb123330 (non-flash)
Nov 17 01:34:10 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:34:10 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-d68a1985-f46b-42ea-935d-cef5fa75472f tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)
Nov 17 01:34:10 user nova-compute[75226]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05f878e5-0241-4282-8b2c-c4651c429dcb (non-flash)
Nov 17 01:34:10 user nova-compute[75226]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419 (non-flash)
Nov 17 01:34:10 user nova-compute[75226]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce3aa851-e7f0-4ea9-b3ed-404dbb123330 (non-flash)
Nov 17 01:34:10 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:34:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50b18fb0-86d4-4384-b5be-ad4ac5a6fe82 -p 172.16.0.220:3260 --login {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:34:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ea5a14b-c330-4a2b-926e-60e1b30f5981/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:34:11 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75226) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 01:34:11 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c11fbffa-07e2-40c4-92b1-8531dbe8b687/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:34:11 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50b18fb0-86d4-4384-b5be-ad4ac5a6fe82 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:34:11 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[6315e48a-505a-4a46-b853-5bd903cdebca]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:50b18fb0-86d4-4384-b5be-ad4ac5a6fe82, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:50b18fb0-86d4-4384-b5be-ad4ac5a6fe82, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:34:11 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-d68a1985-f46b-42ea-935d-cef5fa75472f tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:50b18fb0-86d4-4384-b5be-ad4ac5a6fe82, portal: 172.16.0.220,3260]
Nov 17 01:34:11 user nova-compute[75226]: Login to [iface: default, target: iqn.2010-10.org.openstack:50b18fb0-86d4-4384-b5be-ad4ac5a6fe82, portal: 172.16.0.220,3260] successful.
Nov 17 01:34:11 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:34:11 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50b18fb0-86d4-4384-b5be-ad4ac5a6fe82 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:34:11 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50b18fb0-86d4-4384-b5be-ad4ac5a6fe82 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:34:11 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dc79c6b-fe83-4b25-bce9-5a2b05fbef70]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:34:11 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-d68a1985-f46b-42ea-935d-cef5fa75472f tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:34:11 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:34:11 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:34:11 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[08c0e943-ac3d-4656-adbf-aa2557cbb6b3]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05f878e5-0241-4282-8b2c-c4651c429dcb (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce3aa851-e7f0-4ea9-b3ed-404dbb123330 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50b18fb0-86d4-4384-b5be-ad4ac5a6fe82 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:34:11 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-d68a1985-f46b-42ea-935d-cef5fa75472f tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)
Nov 17 01:34:11 user nova-compute[75226]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05f878e5-0241-4282-8b2c-c4651c429dcb (non-flash)
Nov 17 01:34:11 user nova-compute[75226]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419 (non-flash)
Nov 17 01:34:11 user nova-compute[75226]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce3aa851-e7f0-4ea9-b3ed-404dbb123330 (non-flash)
Nov 17 01:34:11 user nova-compute[75226]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50b18fb0-86d4-4384-b5be-ad4ac5a6fe82 (non-flash)
Nov 17 01:34:11 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:34:11 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-d68a1985-f46b-42ea-935d-cef5fa75472f tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)
Nov 17 01:34:11 user nova-compute[75226]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05f878e5-0241-4282-8b2c-c4651c429dcb (non-flash)
Nov 17 01:34:11 user nova-compute[75226]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419 (non-flash)
Nov 17 01:34:11 user nova-compute[75226]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce3aa851-e7f0-4ea9-b3ed-404dbb123330 (non-flash)
Nov 17 01:34:11 user nova-compute[75226]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50b18fb0-86d4-4384-b5be-ad4ac5a6fe82 (non-flash)
Nov 17 01:34:11 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:34:11 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-d68a1985-f46b-42ea-935d-cef5fa75472f tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:50b18fb0-86d4-4384-b5be-ad4ac5a6fe82" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.413s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:34:11 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-d68a1985-f46b-42ea-935d-cef5fa75472f tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Connected to 172.16.0.220:3260 {{(pid=75226) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 17 01:34:11 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-d68a1985-f46b-42ea-935d-cef5fa75472f tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] HCTL ('35', '-', '-', 0) found on session 38 with lun 0 {{(pid=75226) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 17 01:34:11 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-d68a1985-f46b-42ea-935d-cef5fa75472f tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75226) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 17 01:34:11 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:34:11 user nova-compute[75226]: DEBUG nova.compute.manager [req-9deb02c2-2881-4792-877e-298f4152a907 req-188fd97f-06d2-411b-9fd2-0c72fe3deec7 service nova] [instance: 18a445fd-6ca2-470f-85c4-301cde767284] Received event network-vif-plugged-abcd9fa6-496b-4a78-87d8-e5e8e2a5a31c {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:34:11 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-9deb02c2-2881-4792-877e-298f4152a907 req-188fd97f-06d2-411b-9fd2-0c72fe3deec7 service nova] Acquiring lock "18a445fd-6ca2-470f-85c4-301cde767284-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:34:11 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-9deb02c2-2881-4792-877e-298f4152a907 req-188fd97f-06d2-411b-9fd2-0c72fe3deec7 service nova] Lock "18a445fd-6ca2-470f-85c4-301cde767284-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:34:11 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-9deb02c2-2881-4792-877e-298f4152a907 req-188fd97f-06d2-411b-9fd2-0c72fe3deec7 service nova] Lock "18a445fd-6ca2-470f-85c4-301cde767284-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:34:11 user nova-compute[75226]: DEBUG nova.compute.manager [req-9deb02c2-2881-4792-877e-298f4152a907 req-188fd97f-06d2-411b-9fd2-0c72fe3deec7 service nova] [instance: 18a445fd-6ca2-470f-85c4-301cde767284] No waiting events found dispatching network-vif-plugged-abcd9fa6-496b-4a78-87d8-e5e8e2a5a31c {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:34:11 user nova-compute[75226]: WARNING nova.compute.manager [req-9deb02c2-2881-4792-877e-298f4152a907 req-188fd97f-06d2-411b-9fd2-0c72fe3deec7 service nova] [instance: 18a445fd-6ca2-470f-85c4-301cde767284] Received unexpected event network-vif-plugged-abcd9fa6-496b-4a78-87d8-e5e8e2a5a31c for instance with vm_state building and task_state spawning.
Nov 17 01:34:11 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.027s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:34:11 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[12ce60f0-3885-492e-90b1-4e031014717c]: (4, ('- - 0', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:34:11 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-d68a1985-f46b-42ea-935d-cef5fa75472f tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Searching for a device in session 38 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75226) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 01:34:11 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-d68a1985-f46b-42ea-935d-cef5fa75472f tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:50b18fb0-86d4-4384-b5be-ad4ac5a6fe82', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xCdzLUgh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75226) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 17 01:34:11 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c11fbffa-07e2-40c4-92b1-8531dbe8b687/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:34:11 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c11fbffa-07e2-40c4-92b1-8531dbe8b687/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:34:11 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-8da4b76d-9029-40bf-ad30-574ec7d9996d tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Acquiring lock "8d983732-91aa-4f20-9d7d-3de66029cba5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:34:11 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-8da4b76d-9029-40bf-ad30-574ec7d9996d tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Lock "8d983732-91aa-4f20-9d7d-3de66029cba5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:34:11 user nova-compute[75226]: DEBUG nova.compute.manager [None req-8da4b76d-9029-40bf-ad30-574ec7d9996d tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] [instance: 8d983732-91aa-4f20-9d7d-3de66029cba5] Starting instance... {{(pid=75226) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 17 01:34:11 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c11fbffa-07e2-40c4-92b1-8531dbe8b687/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:34:11 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75226) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 01:34:13 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:34:13 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-d68a1985-f46b-42ea-935d-cef5fa75472f tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.798s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:34:13 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-d68a1985-f46b-42ea-935d-cef5fa75472f tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] <== connect_volume: return (2800ms) {'type': 'block', 'scsi_wwn': '23432383166633836', 'path': '/dev/sdd'} {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:34:13 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d68a1985-f46b-42ea-935d-cef5fa75472f tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] [instance: c11fbffa-07e2-40c4-92b1-8531dbe8b687] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23432383166633836', 'path': '/dev/sdd'} {{(pid=75226) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 17 01:34:13 user nova-compute[75226]: DEBUG nova.compute.manager [req-fb39160f-a730-41de-bebb-d2b9e82222f8 req-7c22bc76-7cc5-428b-bd22-d9eff273cf75 service nova] [instance: 18a445fd-6ca2-470f-85c4-301cde767284] Received event network-vif-plugged-abcd9fa6-496b-4a78-87d8-e5e8e2a5a31c {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:34:13 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-fb39160f-a730-41de-bebb-d2b9e82222f8 req-7c22bc76-7cc5-428b-bd22-d9eff273cf75 service nova] Acquiring lock "18a445fd-6ca2-470f-85c4-301cde767284-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:34:13 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-fb39160f-a730-41de-bebb-d2b9e82222f8 req-7c22bc76-7cc5-428b-bd22-d9eff273cf75 service nova] Lock "18a445fd-6ca2-470f-85c4-301cde767284-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:34:13 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-fb39160f-a730-41de-bebb-d2b9e82222f8 req-7c22bc76-7cc5-428b-bd22-d9eff273cf75 service nova] Lock "18a445fd-6ca2-470f-85c4-301cde767284-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:34:13 user nova-compute[75226]: DEBUG nova.compute.manager [req-fb39160f-a730-41de-bebb-d2b9e82222f8 req-7c22bc76-7cc5-428b-bd22-d9eff273cf75 service nova] [instance: 18a445fd-6ca2-470f-85c4-301cde767284] No waiting events found dispatching network-vif-plugged-abcd9fa6-496b-4a78-87d8-e5e8e2a5a31c {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:34:13 user nova-compute[75226]: WARNING nova.compute.manager [req-fb39160f-a730-41de-bebb-d2b9e82222f8 req-7c22bc76-7cc5-428b-bd22-d9eff273cf75 service nova] [instance: 18a445fd-6ca2-470f-85c4-301cde767284] Received unexpected event network-vif-plugged-abcd9fa6-496b-4a78-87d8-e5e8e2a5a31c for instance with vm_state building and task_state spawning.
Nov 17 01:34:13 user nova-compute[75226]: DEBUG nova.compute.manager [None req-dd9ed3c2-8035-4211-b1d1-c5b9bf575570 tempest-VolumesNegativeTest-618394537 tempest-VolumesNegativeTest-618394537-project-member] [instance: 18a445fd-6ca2-470f-85c4-301cde767284] Instance event wait completed in 0 seconds for  {{(pid=75226) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 17 01:34:13 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-dd9ed3c2-8035-4211-b1d1-c5b9bf575570 tempest-VolumesNegativeTest-618394537 tempest-VolumesNegativeTest-618394537-project-member] [instance: 18a445fd-6ca2-470f-85c4-301cde767284] Guest created on hypervisor {{(pid=75226) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 17 01:34:13 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:34:13 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:34:13 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Hypervisor/Node resource view: name=user free_ram=7469MB free_disk=24.807334899902344GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75226) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 17 01:34:13 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:34:13 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:34:13 user nova-compute[75226]: INFO nova.virt.libvirt.driver [-] [instance: 18a445fd-6ca2-470f-85c4-301cde767284] Instance spawned successfully.
Nov 17 01:34:13 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-dd9ed3c2-8035-4211-b1d1-c5b9bf575570 tempest-VolumesNegativeTest-618394537 tempest-VolumesNegativeTest-618394537-project-member] [instance: 18a445fd-6ca2-470f-85c4-301cde767284] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 17 01:34:13 user nova-compute[75226]: DEBUG nova.objects.instance [None req-d68a1985-f46b-42ea-935d-cef5fa75472f tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Lazy-loading 'flavor' on Instance uuid c11fbffa-07e2-40c4-92b1-8531dbe8b687 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:34:13 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-8da4b76d-9029-40bf-ad30-574ec7d9996d tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:34:13 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-dd9ed3c2-8035-4211-b1d1-c5b9bf575570 tempest-VolumesNegativeTest-618394537 tempest-VolumesNegativeTest-618394537-project-member] [instance: 18a445fd-6ca2-470f-85c4-301cde767284] Found default for hw_cdrom_bus of ide {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:34:13 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-dd9ed3c2-8035-4211-b1d1-c5b9bf575570 tempest-VolumesNegativeTest-618394537 tempest-VolumesNegativeTest-618394537-project-member] [instance: 18a445fd-6ca2-470f-85c4-301cde767284] Found default for hw_disk_bus of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:34:13 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-dd9ed3c2-8035-4211-b1d1-c5b9bf575570 tempest-VolumesNegativeTest-618394537 tempest-VolumesNegativeTest-618394537-project-member] [instance: 18a445fd-6ca2-470f-85c4-301cde767284] Found default for hw_input_bus of None {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:34:13 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-dd9ed3c2-8035-4211-b1d1-c5b9bf575570 tempest-VolumesNegativeTest-618394537 tempest-VolumesNegativeTest-618394537-project-member] [instance: 18a445fd-6ca2-470f-85c4-301cde767284] Found default for hw_pointer_model of None {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:34:13 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-dd9ed3c2-8035-4211-b1d1-c5b9bf575570 tempest-VolumesNegativeTest-618394537 tempest-VolumesNegativeTest-618394537-project-member] [instance: 18a445fd-6ca2-470f-85c4-301cde767284] Found default for hw_video_model of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:34:13 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-dd9ed3c2-8035-4211-b1d1-c5b9bf575570 tempest-VolumesNegativeTest-618394537 tempest-VolumesNegativeTest-618394537-project-member] [instance: 18a445fd-6ca2-470f-85c4-301cde767284] Found default for hw_vif_model of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:34:13 user nova-compute[75226]: DEBUG nova.virt.libvirt.guest [None req-d68a1985-f46b-42ea-935d-cef5fa75472f tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] attach device xml: <disk type="block" device="disk">
Nov 17 01:34:13 user nova-compute[75226]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 01:34:13 user nova-compute[75226]:   <source dev="/dev/sdd"/>
Nov 17 01:34:13 user nova-compute[75226]:   <target dev="vdc" bus="virtio"/>
Nov 17 01:34:13 user nova-compute[75226]:   <serial>50b18fb0-86d4-4384-b5be-ad4ac5a6fe82</serial>
Nov 17 01:34:13 user nova-compute[75226]: </disk>
Nov 17 01:34:13 user nova-compute[75226]:  {{(pid=75226) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 17 01:34:13 user nova-compute[75226]: INFO nova.compute.manager [None req-dd9ed3c2-8035-4211-b1d1-c5b9bf575570 tempest-VolumesNegativeTest-618394537 tempest-VolumesNegativeTest-618394537-project-member] [instance: 18a445fd-6ca2-470f-85c4-301cde767284] Took 6.25 seconds to spawn the instance on the hypervisor.
Nov 17 01:34:13 user nova-compute[75226]: DEBUG nova.compute.manager [None req-dd9ed3c2-8035-4211-b1d1-c5b9bf575570 tempest-VolumesNegativeTest-618394537 tempest-VolumesNegativeTest-618394537-project-member] [instance: 18a445fd-6ca2-470f-85c4-301cde767284] Checking state {{(pid=75226) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 01:34:13 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance aa84e575-bdad-45b9-80ce-86b1c2826fb0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:34:13 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 6b7e9611-be35-4e51-b886-91a2fac0a653 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:34:13 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 38062487-67ca-4962-974f-81456aebe97b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:34:13 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 4050d898-f2b8-46c2-86e3-702ceb41a701 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:34:13 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 2ea5a14b-c330-4a2b-926e-60e1b30f5981 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:34:13 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance d6555d72-6094-4ea9-b071-a3d3c8a300a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:34:13 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 5c280142-8901-4f83-bde4-baaa097e05b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:34:13 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 3018e3a2-01e0-49d7-a960-51718709845a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:34:13 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance dae5490b-e434-4cd1-b8d4-6baab9bb7345 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:34:13 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance c11fbffa-07e2-40c4-92b1-8531dbe8b687 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:34:13 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance a298d980-feed-4530-9499-f2833b404dcd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:34:13 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 9e8b4b85-fe0c-4592-850e-e94ebab32d02 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:34:13 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 18a445fd-6ca2-470f-85c4-301cde767284 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:34:13 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 8d983732-91aa-4f20-9d7d-3de66029cba5 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 17 01:34:13 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=75226) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 17 01:34:13 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=75226) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 17 01:34:13 user nova-compute[75226]: INFO nova.compute.manager [None req-dd9ed3c2-8035-4211-b1d1-c5b9bf575570 tempest-VolumesNegativeTest-618394537 tempest-VolumesNegativeTest-618394537-project-member] [instance: 18a445fd-6ca2-470f-85c4-301cde767284] Took 7.18 seconds to build instance.
Nov 17 01:34:13 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-dd9ed3c2-8035-4211-b1d1-c5b9bf575570 tempest-VolumesNegativeTest-618394537 tempest-VolumesNegativeTest-618394537-project-member] Lock "18a445fd-6ca2-470f-85c4-301cde767284" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.276s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:34:13 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-d34659d7-f59d-4f5c-a661-2a665aca8ddf tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] Acquiring lock "4050d898-f2b8-46c2-86e3-702ceb41a701" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:34:13 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-d34659d7-f59d-4f5c-a661-2a665aca8ddf tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] Lock "4050d898-f2b8-46c2-86e3-702ceb41a701" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:34:13 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-d34659d7-f59d-4f5c-a661-2a665aca8ddf tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] Acquiring lock "4050d898-f2b8-46c2-86e3-702ceb41a701-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:34:13 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-d34659d7-f59d-4f5c-a661-2a665aca8ddf tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] Lock "4050d898-f2b8-46c2-86e3-702ceb41a701-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:34:13 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-d34659d7-f59d-4f5c-a661-2a665aca8ddf tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] Lock "4050d898-f2b8-46c2-86e3-702ceb41a701-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:34:13 user nova-compute[75226]: INFO nova.compute.manager [None req-d34659d7-f59d-4f5c-a661-2a665aca8ddf tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] [instance: 4050d898-f2b8-46c2-86e3-702ceb41a701] Terminating instance
Nov 17 01:34:13 user nova-compute[75226]: DEBUG nova.compute.manager [None req-d34659d7-f59d-4f5c-a661-2a665aca8ddf tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] [instance: 4050d898-f2b8-46c2-86e3-702ceb41a701] Start destroying the instance on the hypervisor. {{(pid=75226) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 17 01:34:13 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:34:14 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:34:14 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:34:14 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:34:14 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-d68a1985-f46b-42ea-935d-cef5fa75472f tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] No BDM found with device name vda, not building metadata. {{(pid=75226) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 01:34:14 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-d68a1985-f46b-42ea-935d-cef5fa75472f tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75226) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 01:34:14 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-d68a1985-f46b-42ea-935d-cef5fa75472f tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75226) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 01:34:14 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-d68a1985-f46b-42ea-935d-cef5fa75472f tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] No VIF found with MAC fa:16:3e:06:46:c3, not building metadata {{(pid=75226) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 01:34:14 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-d68a1985-f46b-42ea-935d-cef5fa75472f tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Lock "c11fbffa-07e2-40c4-92b1-8531dbe8b687" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.517s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:34:14 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:34:14 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:34:14 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Compute_service record updated for user:user {{(pid=75226) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 17 01:34:14 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.846s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:34:14 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-8da4b76d-9029-40bf-ad30-574ec7d9996d tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.825s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:34:14 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-8da4b76d-9029-40bf-ad30-574ec7d9996d tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75226) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 17 01:34:14 user nova-compute[75226]: INFO nova.compute.claims [None req-8da4b76d-9029-40bf-ad30-574ec7d9996d tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] [instance: 8d983732-91aa-4f20-9d7d-3de66029cba5] Claim successful on node user
Nov 17 01:34:14 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:34:14 user nova-compute[75226]: INFO nova.virt.libvirt.driver [-] [instance: 4050d898-f2b8-46c2-86e3-702ceb41a701] Instance destroyed successfully.
Nov 17 01:34:14 user nova-compute[75226]: DEBUG nova.objects.instance [None req-d34659d7-f59d-4f5c-a661-2a665aca8ddf tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] Lazy-loading 'resources' on Instance uuid 4050d898-f2b8-46c2-86e3-702ceb41a701 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:34:14 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-d34659d7-f59d-4f5c-a661-2a665aca8ddf tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:25:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-2022474190',display_name='tempest-ServersNegativeTestJSON-server-2022474190',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-2022474190',id=22,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-17T01:25:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d69aa270fc5b4749a65ea70c7ef30958',ramdisk_id='',reservation_id='r-ers3xohq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1569237592',owner_user_name='tempest-ServersNegativeTestJSON-1569237592-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T01:25:32Z,user_data=None,user_id='202fa7cd113b42f2b95bc2314255392e',uuid=4050d898-f2b8-46c2-86e3-702ceb41a701,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3b88e9ba-814a-4122-9e85-a70bd6d85ad0", "address": "fa:16:3e:41:78:68", "network": {"id": "ded167af-70f6-45b1-beb4-2eca06a78205", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2145123005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d69aa270fc5b4749a65ea70c7ef30958", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b88e9ba-81", "ovs_interfaceid": "3b88e9ba-814a-4122-9e85-a70bd6d85ad0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 17 01:34:14 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-d34659d7-f59d-4f5c-a661-2a665aca8ddf tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] Converting VIF {"id": "3b88e9ba-814a-4122-9e85-a70bd6d85ad0", "address": "fa:16:3e:41:78:68", "network": {"id": "ded167af-70f6-45b1-beb4-2eca06a78205", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2145123005-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d69aa270fc5b4749a65ea70c7ef30958", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b88e9ba-81", "ovs_interfaceid": "3b88e9ba-814a-4122-9e85-a70bd6d85ad0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:34:14 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-d34659d7-f59d-4f5c-a661-2a665aca8ddf tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:41:78:68,bridge_name='br-int',has_traffic_filtering=True,id=3b88e9ba-814a-4122-9e85-a70bd6d85ad0,network=Network(ded167af-70f6-45b1-beb4-2eca06a78205),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b88e9ba-81') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:34:14 user nova-compute[75226]: DEBUG os_vif [None req-d34659d7-f59d-4f5c-a661-2a665aca8ddf tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:41:78:68,bridge_name='br-int',has_traffic_filtering=True,id=3b88e9ba-814a-4122-9e85-a70bd6d85ad0,network=Network(ded167af-70f6-45b1-beb4-2eca06a78205),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b88e9ba-81') {{(pid=75226) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 17 01:34:14 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:34:14 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3b88e9ba-81, bridge=br-int, if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:34:14 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:34:14 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:34:14 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:34:14 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cad72b51-9b7f-416e-ad61-7688b5bb2762) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:34:14 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:34:14 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:34:14 user nova-compute[75226]: INFO os_vif [None req-d34659d7-f59d-4f5c-a661-2a665aca8ddf tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:41:78:68,bridge_name='br-int',has_traffic_filtering=True,id=3b88e9ba-814a-4122-9e85-a70bd6d85ad0,network=Network(ded167af-70f6-45b1-beb4-2eca06a78205),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b88e9ba-81')
Nov 17 01:34:14 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-d34659d7-f59d-4f5c-a661-2a665aca8ddf tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] [instance: 4050d898-f2b8-46c2-86e3-702ceb41a701] Deleting instance files /opt/stack/data/nova/instances/4050d898-f2b8-46c2-86e3-702ceb41a701_del
Nov 17 01:34:14 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-d34659d7-f59d-4f5c-a661-2a665aca8ddf tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] [instance: 4050d898-f2b8-46c2-86e3-702ceb41a701] Deletion of /opt/stack/data/nova/instances/4050d898-f2b8-46c2-86e3-702ceb41a701_del complete
Nov 17 01:34:14 user nova-compute[75226]: INFO nova.compute.manager [None req-d34659d7-f59d-4f5c-a661-2a665aca8ddf tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] [instance: 4050d898-f2b8-46c2-86e3-702ceb41a701] Took 0.79 seconds to destroy the instance on the hypervisor.
Nov 17 01:34:14 user nova-compute[75226]: DEBUG oslo.service.loopingcall [None req-d34659d7-f59d-4f5c-a661-2a665aca8ddf tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75226) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 17 01:34:14 user nova-compute[75226]: DEBUG nova.compute.manager [-] [instance: 4050d898-f2b8-46c2-86e3-702ceb41a701] Deallocating network for instance {{(pid=75226) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 17 01:34:14 user nova-compute[75226]: DEBUG nova.network.neutron [-] [instance: 4050d898-f2b8-46c2-86e3-702ceb41a701] deallocate_for_instance() {{(pid=75226) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 17 01:34:15 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-8da4b76d-9029-40bf-ad30-574ec7d9996d tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:34:15 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-8da4b76d-9029-40bf-ad30-574ec7d9996d tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:34:15 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-c73af072-c06e-4ce8-b1ab-386064abc884 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Acquiring lock "c11fbffa-07e2-40c4-92b1-8531dbe8b687" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:34:15 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-c73af072-c06e-4ce8-b1ab-386064abc884 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Lock "c11fbffa-07e2-40c4-92b1-8531dbe8b687" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:34:15 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-8da4b76d-9029-40bf-ad30-574ec7d9996d tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.774s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:34:15 user nova-compute[75226]: DEBUG nova.compute.manager [None req-8da4b76d-9029-40bf-ad30-574ec7d9996d tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] [instance: 8d983732-91aa-4f20-9d7d-3de66029cba5] Start building networks asynchronously for instance. {{(pid=75226) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 17 01:34:15 user nova-compute[75226]: INFO nova.compute.manager [None req-c73af072-c06e-4ce8-b1ab-386064abc884 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] [instance: c11fbffa-07e2-40c4-92b1-8531dbe8b687] Detaching volume ce3aa851-e7f0-4ea9-b3ed-404dbb123330
Nov 17 01:34:15 user nova-compute[75226]: DEBUG nova.network.neutron [-] [instance: 4050d898-f2b8-46c2-86e3-702ceb41a701] Updating instance_info_cache with network_info: [] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:34:15 user nova-compute[75226]: DEBUG nova.compute.manager [None req-8da4b76d-9029-40bf-ad30-574ec7d9996d tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] [instance: 8d983732-91aa-4f20-9d7d-3de66029cba5] Allocating IP information in the background. {{(pid=75226) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 17 01:34:15 user nova-compute[75226]: DEBUG nova.network.neutron [None req-8da4b76d-9029-40bf-ad30-574ec7d9996d tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] [instance: 8d983732-91aa-4f20-9d7d-3de66029cba5] allocate_for_instance() {{(pid=75226) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 17 01:34:15 user nova-compute[75226]: INFO nova.virt.block_device [None req-c73af072-c06e-4ce8-b1ab-386064abc884 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] [instance: c11fbffa-07e2-40c4-92b1-8531dbe8b687] Attempting to driver detach volume ce3aa851-e7f0-4ea9-b3ed-404dbb123330 from mountpoint /dev/vdb
Nov 17 01:34:15 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-c73af072-c06e-4ce8-b1ab-386064abc884 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Attempting to detach device vdb from instance c11fbffa-07e2-40c4-92b1-8531dbe8b687 from the persistent domain config. {{(pid=75226) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 17 01:34:15 user nova-compute[75226]: DEBUG nova.virt.libvirt.guest [None req-c73af072-c06e-4ce8-b1ab-386064abc884 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] detach device xml: <disk type="block" device="disk">
Nov 17 01:34:15 user nova-compute[75226]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 01:34:15 user nova-compute[75226]:   <source dev="/dev/sdf"/>
Nov 17 01:34:15 user nova-compute[75226]:   <target dev="vdb" bus="virtio"/>
Nov 17 01:34:15 user nova-compute[75226]:   <serial>ce3aa851-e7f0-4ea9-b3ed-404dbb123330</serial>
Nov 17 01:34:15 user nova-compute[75226]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 17 01:34:15 user nova-compute[75226]: </disk>
Nov 17 01:34:15 user nova-compute[75226]:  {{(pid=75226) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 17 01:34:15 user nova-compute[75226]: INFO nova.compute.manager [-] [instance: 4050d898-f2b8-46c2-86e3-702ceb41a701] Took 0.60 seconds to deallocate network for instance.
Nov 17 01:34:15 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-8da4b76d-9029-40bf-ad30-574ec7d9996d tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] [instance: 8d983732-91aa-4f20-9d7d-3de66029cba5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 17 01:34:15 user nova-compute[75226]: DEBUG nova.compute.manager [req-93222b77-fd89-4af7-91af-dfebe3a6f9f4 req-a8aa27d6-84b8-44d6-ab0d-925639096ebc service nova] [instance: 4050d898-f2b8-46c2-86e3-702ceb41a701] Received event network-vif-unplugged-3b88e9ba-814a-4122-9e85-a70bd6d85ad0 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:34:15 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-93222b77-fd89-4af7-91af-dfebe3a6f9f4 req-a8aa27d6-84b8-44d6-ab0d-925639096ebc service nova] Acquiring lock "4050d898-f2b8-46c2-86e3-702ceb41a701-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:34:15 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-93222b77-fd89-4af7-91af-dfebe3a6f9f4 req-a8aa27d6-84b8-44d6-ab0d-925639096ebc service nova] Lock "4050d898-f2b8-46c2-86e3-702ceb41a701-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:34:15 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-93222b77-fd89-4af7-91af-dfebe3a6f9f4 req-a8aa27d6-84b8-44d6-ab0d-925639096ebc service nova] Lock "4050d898-f2b8-46c2-86e3-702ceb41a701-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:34:15 user nova-compute[75226]: DEBUG nova.compute.manager [req-93222b77-fd89-4af7-91af-dfebe3a6f9f4 req-a8aa27d6-84b8-44d6-ab0d-925639096ebc service nova] [instance: 4050d898-f2b8-46c2-86e3-702ceb41a701] No waiting events found dispatching network-vif-unplugged-3b88e9ba-814a-4122-9e85-a70bd6d85ad0 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:34:15 user nova-compute[75226]: DEBUG nova.compute.manager [req-93222b77-fd89-4af7-91af-dfebe3a6f9f4 req-a8aa27d6-84b8-44d6-ab0d-925639096ebc service nova] [instance: 4050d898-f2b8-46c2-86e3-702ceb41a701] Received event network-vif-unplugged-3b88e9ba-814a-4122-9e85-a70bd6d85ad0 for instance with task_state deleting. {{(pid=75226) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 17 01:34:15 user nova-compute[75226]: DEBUG nova.compute.manager [req-93222b77-fd89-4af7-91af-dfebe3a6f9f4 req-a8aa27d6-84b8-44d6-ab0d-925639096ebc service nova] [instance: 4050d898-f2b8-46c2-86e3-702ceb41a701] Received event network-vif-plugged-3b88e9ba-814a-4122-9e85-a70bd6d85ad0 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:34:15 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-93222b77-fd89-4af7-91af-dfebe3a6f9f4 req-a8aa27d6-84b8-44d6-ab0d-925639096ebc service nova] Acquiring lock "4050d898-f2b8-46c2-86e3-702ceb41a701-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:34:15 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-93222b77-fd89-4af7-91af-dfebe3a6f9f4 req-a8aa27d6-84b8-44d6-ab0d-925639096ebc service nova] Lock "4050d898-f2b8-46c2-86e3-702ceb41a701-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:34:15 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-93222b77-fd89-4af7-91af-dfebe3a6f9f4 req-a8aa27d6-84b8-44d6-ab0d-925639096ebc service nova] Lock "4050d898-f2b8-46c2-86e3-702ceb41a701-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:34:15 user nova-compute[75226]: DEBUG nova.compute.manager [req-93222b77-fd89-4af7-91af-dfebe3a6f9f4 req-a8aa27d6-84b8-44d6-ab0d-925639096ebc service nova] [instance: 4050d898-f2b8-46c2-86e3-702ceb41a701] No waiting events found dispatching network-vif-plugged-3b88e9ba-814a-4122-9e85-a70bd6d85ad0 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:34:15 user nova-compute[75226]: WARNING nova.compute.manager [req-93222b77-fd89-4af7-91af-dfebe3a6f9f4 req-a8aa27d6-84b8-44d6-ab0d-925639096ebc service nova] [instance: 4050d898-f2b8-46c2-86e3-702ceb41a701] Received unexpected event network-vif-plugged-3b88e9ba-814a-4122-9e85-a70bd6d85ad0 for instance with vm_state active and task_state deleting.
Nov 17 01:34:15 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-c73af072-c06e-4ce8-b1ab-386064abc884 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Successfully detached device vdb from instance c11fbffa-07e2-40c4-92b1-8531dbe8b687 from the persistent domain config.
Nov 17 01:34:15 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-c73af072-c06e-4ce8-b1ab-386064abc884 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c11fbffa-07e2-40c4-92b1-8531dbe8b687 from the live domain config. {{(pid=75226) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 17 01:34:15 user nova-compute[75226]: DEBUG nova.virt.libvirt.guest [None req-c73af072-c06e-4ce8-b1ab-386064abc884 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] detach device xml: <disk type="block" device="disk">
Nov 17 01:34:15 user nova-compute[75226]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 01:34:15 user nova-compute[75226]:   <source dev="/dev/sdf"/>
Nov 17 01:34:15 user nova-compute[75226]:   <target dev="vdb" bus="virtio"/>
Nov 17 01:34:15 user nova-compute[75226]:   <serial>ce3aa851-e7f0-4ea9-b3ed-404dbb123330</serial>
Nov 17 01:34:15 user nova-compute[75226]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 17 01:34:15 user nova-compute[75226]: </disk>
Nov 17 01:34:15 user nova-compute[75226]:  {{(pid=75226) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 17 01:34:15 user nova-compute[75226]: DEBUG nova.compute.manager [None req-8da4b76d-9029-40bf-ad30-574ec7d9996d tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] [instance: 8d983732-91aa-4f20-9d7d-3de66029cba5] Start building block device mappings for instance. {{(pid=75226) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 17 01:34:15 user nova-compute[75226]: DEBUG nova.policy [None req-8da4b76d-9029-40bf-ad30-574ec7d9996d tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '12f405f1486a4f5187e628c60f223e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2052a37a068e4d948c57560c0f4445e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75226) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 17 01:34:15 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-d34659d7-f59d-4f5c-a661-2a665aca8ddf tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:34:15 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-d34659d7-f59d-4f5c-a661-2a665aca8ddf tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:34:15 user nova-compute[75226]: DEBUG nova.compute.manager [None req-8da4b76d-9029-40bf-ad30-574ec7d9996d tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] [instance: 8d983732-91aa-4f20-9d7d-3de66029cba5] Start spawning the instance on the hypervisor. {{(pid=75226) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 17 01:34:15 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-8da4b76d-9029-40bf-ad30-574ec7d9996d tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] [instance: 8d983732-91aa-4f20-9d7d-3de66029cba5] Creating instance directory {{(pid=75226) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 17 01:34:15 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-8da4b76d-9029-40bf-ad30-574ec7d9996d tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] [instance: 8d983732-91aa-4f20-9d7d-3de66029cba5] Creating image(s)
Nov 17 01:34:15 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-8da4b76d-9029-40bf-ad30-574ec7d9996d tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Acquiring lock "/opt/stack/data/nova/instances/8d983732-91aa-4f20-9d7d-3de66029cba5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:34:15 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-8da4b76d-9029-40bf-ad30-574ec7d9996d tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Lock "/opt/stack/data/nova/instances/8d983732-91aa-4f20-9d7d-3de66029cba5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:34:15 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-8da4b76d-9029-40bf-ad30-574ec7d9996d tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Lock "/opt/stack/data/nova/instances/8d983732-91aa-4f20-9d7d-3de66029cba5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:34:15 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-8da4b76d-9029-40bf-ad30-574ec7d9996d tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:34:15 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-8da4b76d-9029-40bf-ad30-574ec7d9996d tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json" returned: 0 in 0.186s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:34:15 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-8da4b76d-9029-40bf-ad30-574ec7d9996d tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Acquiring lock "a8a62c2546af3a2036b853250c5ac64d4c6b4371" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:34:15 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-8da4b76d-9029-40bf-ad30-574ec7d9996d tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Lock "a8a62c2546af3a2036b853250c5ac64d4c6b4371" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:34:15 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-8da4b76d-9029-40bf-ad30-574ec7d9996d tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:34:15 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-c73af072-c06e-4ce8-b1ab-386064abc884 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c11fbffa-07e2-40c4-92b1-8531dbe8b687 {{(pid=75226) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 17 01:34:15 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-8da4b76d-9029-40bf-ad30-574ec7d9996d tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json" returned: 0 in 0.184s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:34:15 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-8da4b76d-9029-40bf-ad30-574ec7d9996d tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371,backing_fmt=raw /opt/stack/data/nova/instances/8d983732-91aa-4f20-9d7d-3de66029cba5/disk 1073741824 {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:34:15 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-8da4b76d-9029-40bf-ad30-574ec7d9996d tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371,backing_fmt=raw /opt/stack/data/nova/instances/8d983732-91aa-4f20-9d7d-3de66029cba5/disk 1073741824" returned: 0 in 0.065s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:34:15 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-8da4b76d-9029-40bf-ad30-574ec7d9996d tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Lock "a8a62c2546af3a2036b853250c5ac64d4c6b4371" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.254s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:34:15 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-8da4b76d-9029-40bf-ad30-574ec7d9996d tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:34:15 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-d34659d7-f59d-4f5c-a661-2a665aca8ddf tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:34:15 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-d34659d7-f59d-4f5c-a661-2a665aca8ddf tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:34:16 user nova-compute[75226]: DEBUG nova.network.neutron [None req-8da4b76d-9029-40bf-ad30-574ec7d9996d tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] [instance: 8d983732-91aa-4f20-9d7d-3de66029cba5] Successfully created port: 2ef7c6ef-e077-49c7-aaca-1d8ba7e7335c {{(pid=75226) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 17 01:34:16 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-d34659d7-f59d-4f5c-a661-2a665aca8ddf tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.663s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:34:16 user nova-compute[75226]: INFO nova.scheduler.client.report [None req-d34659d7-f59d-4f5c-a661-2a665aca8ddf tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] Deleted allocations for instance 4050d898-f2b8-46c2-86e3-702ceb41a701
Nov 17 01:34:16 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-8da4b76d-9029-40bf-ad30-574ec7d9996d tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json" returned: 0 in 0.203s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:34:16 user nova-compute[75226]: DEBUG nova.virt.disk.api [None req-8da4b76d-9029-40bf-ad30-574ec7d9996d tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8d983732-91aa-4f20-9d7d-3de66029cba5/disk. size=1073741824 {{(pid=75226) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 17 01:34:16 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-8da4b76d-9029-40bf-ad30-574ec7d9996d tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d983732-91aa-4f20-9d7d-3de66029cba5/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:34:16 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-d34659d7-f59d-4f5c-a661-2a665aca8ddf tempest-ServersNegativeTestJSON-1569237592 tempest-ServersNegativeTestJSON-1569237592-project-member] Lock "4050d898-f2b8-46c2-86e3-702ceb41a701" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.280s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:34:16 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-8da4b76d-9029-40bf-ad30-574ec7d9996d tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d983732-91aa-4f20-9d7d-3de66029cba5/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:34:16 user nova-compute[75226]: DEBUG nova.virt.disk.api [None req-8da4b76d-9029-40bf-ad30-574ec7d9996d tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Cannot resize image /opt/stack/data/nova/instances/8d983732-91aa-4f20-9d7d-3de66029cba5/disk to a smaller size. {{(pid=75226) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 17 01:34:16 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-8da4b76d-9029-40bf-ad30-574ec7d9996d tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] [instance: 8d983732-91aa-4f20-9d7d-3de66029cba5] Created local disks {{(pid=75226) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 17 01:34:16 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-8da4b76d-9029-40bf-ad30-574ec7d9996d tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] [instance: 8d983732-91aa-4f20-9d7d-3de66029cba5] Ensure instance console log exists: /opt/stack/data/nova/instances/8d983732-91aa-4f20-9d7d-3de66029cba5/console.log {{(pid=75226) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 17 01:34:16 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-8da4b76d-9029-40bf-ad30-574ec7d9996d tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:34:16 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-8da4b76d-9029-40bf-ad30-574ec7d9996d tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:34:16 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-8da4b76d-9029-40bf-ad30-574ec7d9996d tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:34:16 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:34:16 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:34:16 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:34:16 user nova-compute[75226]: DEBUG nova.network.neutron [None req-8da4b76d-9029-40bf-ad30-574ec7d9996d tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] [instance: 8d983732-91aa-4f20-9d7d-3de66029cba5] Successfully updated port: 2ef7c6ef-e077-49c7-aaca-1d8ba7e7335c {{(pid=75226) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 17 01:34:16 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-8da4b76d-9029-40bf-ad30-574ec7d9996d tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Acquiring lock "refresh_cache-8d983732-91aa-4f20-9d7d-3de66029cba5" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:34:16 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-8da4b76d-9029-40bf-ad30-574ec7d9996d tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Acquired lock "refresh_cache-8d983732-91aa-4f20-9d7d-3de66029cba5" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:34:16 user nova-compute[75226]: DEBUG nova.network.neutron [None req-8da4b76d-9029-40bf-ad30-574ec7d9996d tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] [instance: 8d983732-91aa-4f20-9d7d-3de66029cba5] Building network info cache for instance {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 01:34:16 user nova-compute[75226]: DEBUG nova.network.neutron [None req-8da4b76d-9029-40bf-ad30-574ec7d9996d tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] [instance: 8d983732-91aa-4f20-9d7d-3de66029cba5] Instance cache missing network info. {{(pid=75226) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 17 01:34:16 user nova-compute[75226]: DEBUG nova.network.neutron [None req-8da4b76d-9029-40bf-ad30-574ec7d9996d tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] [instance: 8d983732-91aa-4f20-9d7d-3de66029cba5] Updating instance_info_cache with network_info: [{"id": "2ef7c6ef-e077-49c7-aaca-1d8ba7e7335c", "address": "fa:16:3e:90:7b:a1", "network": {"id": "a9710b94-56f8-4cf6-9bb6-344b275e5bf2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-512340839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2052a37a068e4d948c57560c0f4445e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ef7c6ef-e0", "ovs_interfaceid": "2ef7c6ef-e077-49c7-aaca-1d8ba7e7335c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:34:16 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-8da4b76d-9029-40bf-ad30-574ec7d9996d tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Releasing lock "refresh_cache-8d983732-91aa-4f20-9d7d-3de66029cba5" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:34:16 user nova-compute[75226]: DEBUG nova.compute.manager [None req-8da4b76d-9029-40bf-ad30-574ec7d9996d tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] [instance: 8d983732-91aa-4f20-9d7d-3de66029cba5] Instance network_info: |[{"id": "2ef7c6ef-e077-49c7-aaca-1d8ba7e7335c", "address": "fa:16:3e:90:7b:a1", "network": {"id": "a9710b94-56f8-4cf6-9bb6-344b275e5bf2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-512340839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2052a37a068e4d948c57560c0f4445e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ef7c6ef-e0", "ovs_interfaceid": "2ef7c6ef-e077-49c7-aaca-1d8ba7e7335c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75226) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 17 01:34:16 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-8da4b76d-9029-40bf-ad30-574ec7d9996d tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] [instance: 8d983732-91aa-4f20-9d7d-3de66029cba5] Start _get_guest_xml network_info=[{"id": "2ef7c6ef-e077-49c7-aaca-1d8ba7e7335c", "address": "fa:16:3e:90:7b:a1", "network": {"id": "a9710b94-56f8-4cf6-9bb6-344b275e5bf2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-512340839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2052a37a068e4d948c57560c0f4445e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ef7c6ef-e0", "ovs_interfaceid": "2ef7c6ef-e077-49c7-aaca-1d8ba7e7335c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T01:13:22Z,direct_url=<?>,disk_format='qcow2',id=0b369aea-6f3f-4690-9f01-229b90ab6310,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4e110cbf9a84362a6864a7732c435a1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T01:13:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '0b369aea-6f3f-4690-9f01-229b90ab6310'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75226) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 17 01:34:17 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-8da4b76d-9029-40bf-ad30-574ec7d9996d tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:34:17 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-8da4b76d-9029-40bf-ad30-574ec7d9996d tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:34:17 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-8da4b76d-9029-40bf-ad30-574ec7d9996d tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75226) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 17 01:34:17 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-8da4b76d-9029-40bf-ad30-574ec7d9996d tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] CPU controller missing on host. {{(pid=75226) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 17 01:34:17 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-8da4b76d-9029-40bf-ad30-574ec7d9996d tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75226) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 17 01:34:17 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-8da4b76d-9029-40bf-ad30-574ec7d9996d tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] CPU controller found on host. {{(pid=75226) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 17 01:34:17 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-8da4b76d-9029-40bf-ad30-574ec7d9996d tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75226) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 17 01:34:17 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-8da4b76d-9029-40bf-ad30-574ec7d9996d tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-17T01:13:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T01:13:22Z,direct_url=<?>,disk_format='qcow2',id=0b369aea-6f3f-4690-9f01-229b90ab6310,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4e110cbf9a84362a6864a7732c435a1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T01:13:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 17 01:34:17 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-8da4b76d-9029-40bf-ad30-574ec7d9996d tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Flavor limits 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 17 01:34:17 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-8da4b76d-9029-40bf-ad30-574ec7d9996d tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Image limits 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 17 01:34:17 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-8da4b76d-9029-40bf-ad30-574ec7d9996d tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Flavor pref 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 17 01:34:17 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-8da4b76d-9029-40bf-ad30-574ec7d9996d tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Image pref 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 17 01:34:17 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-8da4b76d-9029-40bf-ad30-574ec7d9996d tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 17 01:34:17 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-8da4b76d-9029-40bf-ad30-574ec7d9996d tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 17 01:34:17 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-8da4b76d-9029-40bf-ad30-574ec7d9996d tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75226) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 17 01:34:17 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-8da4b76d-9029-40bf-ad30-574ec7d9996d tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Got 1 possible topologies {{(pid=75226) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 17 01:34:17 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-8da4b76d-9029-40bf-ad30-574ec7d9996d tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 17 01:34:17 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-8da4b76d-9029-40bf-ad30-574ec7d9996d tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 17 01:34:17 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-8da4b76d-9029-40bf-ad30-574ec7d9996d tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:34:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-483037740',display_name='tempest-ServerRescueNegativeTestJSON-server-483037740',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-483037740',id=35,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOVRakfmKG4XwLomtS+/jC13ImozUfCSHgByLANg2qVBj+muP2PNHXh8ZrfOah4b/BlgXMz/oIJTeq+c9dBzYhbjAocJ7t33Td2l/vK8u2gWzu5nr29e4L+F2Hdr873C7g==',key_name='tempest-keypair-769708112',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2052a37a068e4d948c57560c0f4445e4',ramdisk_id='',reservation_id='r-fwlr0hcq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-344970408',owner_user_name='tempest-ServerRescueNegativeTestJSON-344970408-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T01:34:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='12f405f1486a4f5187e628c60f223e98',uuid=8d983732-91aa-4f20-9d7d-3de66029cba5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2ef7c6ef-e077-49c7-aaca-1d8ba7e7335c", "address": "fa:16:3e:90:7b:a1", "network": {"id": "a9710b94-56f8-4cf6-9bb6-344b275e5bf2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-512340839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2052a37a068e4d948c57560c0f4445e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ef7c6ef-e0", "ovs_interfaceid": "2ef7c6ef-e077-49c7-aaca-1d8ba7e7335c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75226) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 01:34:17 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-8da4b76d-9029-40bf-ad30-574ec7d9996d tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Converting VIF {"id": "2ef7c6ef-e077-49c7-aaca-1d8ba7e7335c", "address": "fa:16:3e:90:7b:a1", "network": {"id": "a9710b94-56f8-4cf6-9bb6-344b275e5bf2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-512340839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2052a37a068e4d948c57560c0f4445e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ef7c6ef-e0", "ovs_interfaceid": "2ef7c6ef-e077-49c7-aaca-1d8ba7e7335c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:34:17 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-8da4b76d-9029-40bf-ad30-574ec7d9996d tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:7b:a1,bridge_name='br-int',has_traffic_filtering=True,id=2ef7c6ef-e077-49c7-aaca-1d8ba7e7335c,network=Network(a9710b94-56f8-4cf6-9bb6-344b275e5bf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ef7c6ef-e0') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:34:17 user nova-compute[75226]: DEBUG nova.objects.instance [None req-8da4b76d-9029-40bf-ad30-574ec7d9996d tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Lazy-loading 'pci_devices' on Instance uuid 8d983732-91aa-4f20-9d7d-3de66029cba5 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:34:17 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-8da4b76d-9029-40bf-ad30-574ec7d9996d tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] [instance: 8d983732-91aa-4f20-9d7d-3de66029cba5] End _get_guest_xml xml=<domain type="kvm">
Nov 17 01:34:17 user nova-compute[75226]:   <uuid>8d983732-91aa-4f20-9d7d-3de66029cba5</uuid>
Nov 17 01:34:17 user nova-compute[75226]:   <name>instance-00000023</name>
Nov 17 01:34:17 user nova-compute[75226]:   <memory>524288</memory>
Nov 17 01:34:17 user nova-compute[75226]:   <vcpu>1</vcpu>
Nov 17 01:34:17 user nova-compute[75226]:   <metadata>
Nov 17 01:34:17 user nova-compute[75226]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 17 01:34:17 user nova-compute[75226]:       <nova:package version="0.0.0"/>
Nov 17 01:34:17 user nova-compute[75226]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-483037740</nova:name>
Nov 17 01:34:17 user nova-compute[75226]:       <nova:creationTime>2023-11-17 01:34:17</nova:creationTime>
Nov 17 01:34:17 user nova-compute[75226]:       <nova:flavor name="m1.tiny">
Nov 17 01:34:17 user nova-compute[75226]:         <nova:memory>512</nova:memory>
Nov 17 01:34:17 user nova-compute[75226]:         <nova:disk>1</nova:disk>
Nov 17 01:34:17 user nova-compute[75226]:         <nova:swap>0</nova:swap>
Nov 17 01:34:17 user nova-compute[75226]:         <nova:ephemeral>0</nova:ephemeral>
Nov 17 01:34:17 user nova-compute[75226]:         <nova:vcpus>1</nova:vcpus>
Nov 17 01:34:17 user nova-compute[75226]:       </nova:flavor>
Nov 17 01:34:17 user nova-compute[75226]:       <nova:owner>
Nov 17 01:34:17 user nova-compute[75226]:         <nova:user uuid="12f405f1486a4f5187e628c60f223e98">tempest-ServerRescueNegativeTestJSON-344970408-project-member</nova:user>
Nov 17 01:34:17 user nova-compute[75226]:         <nova:project uuid="2052a37a068e4d948c57560c0f4445e4">tempest-ServerRescueNegativeTestJSON-344970408</nova:project>
Nov 17 01:34:17 user nova-compute[75226]:       </nova:owner>
Nov 17 01:34:17 user nova-compute[75226]:       <nova:root type="image" uuid="0b369aea-6f3f-4690-9f01-229b90ab6310"/>
Nov 17 01:34:17 user nova-compute[75226]:       <nova:ports>
Nov 17 01:34:17 user nova-compute[75226]:         <nova:port uuid="2ef7c6ef-e077-49c7-aaca-1d8ba7e7335c">
Nov 17 01:34:17 user nova-compute[75226]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 17 01:34:17 user nova-compute[75226]:         </nova:port>
Nov 17 01:34:17 user nova-compute[75226]:       </nova:ports>
Nov 17 01:34:17 user nova-compute[75226]:     </nova:instance>
Nov 17 01:34:17 user nova-compute[75226]:   </metadata>
Nov 17 01:34:17 user nova-compute[75226]:   <sysinfo type="smbios">
Nov 17 01:34:17 user nova-compute[75226]:     <system>
Nov 17 01:34:17 user nova-compute[75226]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 17 01:34:17 user nova-compute[75226]:       <entry name="product">OpenStack Nova</entry>
Nov 17 01:34:17 user nova-compute[75226]:       <entry name="version">0.0.0</entry>
Nov 17 01:34:17 user nova-compute[75226]:       <entry name="serial">8d983732-91aa-4f20-9d7d-3de66029cba5</entry>
Nov 17 01:34:17 user nova-compute[75226]:       <entry name="uuid">8d983732-91aa-4f20-9d7d-3de66029cba5</entry>
Nov 17 01:34:17 user nova-compute[75226]:       <entry name="family">Virtual Machine</entry>
Nov 17 01:34:17 user nova-compute[75226]:     </system>
Nov 17 01:34:17 user nova-compute[75226]:   </sysinfo>
Nov 17 01:34:17 user nova-compute[75226]:   <os>
Nov 17 01:34:17 user nova-compute[75226]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 17 01:34:17 user nova-compute[75226]:     <boot dev="hd"/>
Nov 17 01:34:17 user nova-compute[75226]:     <smbios mode="sysinfo"/>
Nov 17 01:34:17 user nova-compute[75226]:   </os>
Nov 17 01:34:17 user nova-compute[75226]:   <features>
Nov 17 01:34:17 user nova-compute[75226]:     <acpi/>
Nov 17 01:34:17 user nova-compute[75226]:     <apic/>
Nov 17 01:34:17 user nova-compute[75226]:     <vmcoreinfo/>
Nov 17 01:34:17 user nova-compute[75226]:   </features>
Nov 17 01:34:17 user nova-compute[75226]:   <clock offset="utc">
Nov 17 01:34:17 user nova-compute[75226]:     <timer name="pit" tickpolicy="delay"/>
Nov 17 01:34:17 user nova-compute[75226]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 17 01:34:17 user nova-compute[75226]:     <timer name="hpet" present="no"/>
Nov 17 01:34:17 user nova-compute[75226]:   </clock>
Nov 17 01:34:17 user nova-compute[75226]:   <cpu mode="custom" match="exact">
Nov 17 01:34:17 user nova-compute[75226]:     <model>Nehalem</model>
Nov 17 01:34:17 user nova-compute[75226]:     <topology sockets="1" cores="1" threads="1"/>
Nov 17 01:34:17 user nova-compute[75226]:   </cpu>
Nov 17 01:34:17 user nova-compute[75226]:   <devices>
Nov 17 01:34:17 user nova-compute[75226]:     <disk type="file" device="disk">
Nov 17 01:34:17 user nova-compute[75226]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 17 01:34:17 user nova-compute[75226]:       <source file="/opt/stack/data/nova/instances/8d983732-91aa-4f20-9d7d-3de66029cba5/disk"/>
Nov 17 01:34:17 user nova-compute[75226]:       <target dev="vda" bus="virtio"/>
Nov 17 01:34:17 user nova-compute[75226]:     </disk>
Nov 17 01:34:17 user nova-compute[75226]:     <interface type="ethernet">
Nov 17 01:34:17 user nova-compute[75226]:       <mac address="fa:16:3e:90:7b:a1"/>
Nov 17 01:34:17 user nova-compute[75226]:       <model type="virtio"/>
Nov 17 01:34:17 user nova-compute[75226]:       <mtu size="1442"/>
Nov 17 01:34:17 user nova-compute[75226]:       <target dev="tap2ef7c6ef-e0"/>
Nov 17 01:34:17 user nova-compute[75226]:     </interface>
Nov 17 01:34:17 user nova-compute[75226]:     <serial type="pty">
Nov 17 01:34:17 user nova-compute[75226]:       <log file="/opt/stack/data/nova/instances/8d983732-91aa-4f20-9d7d-3de66029cba5/console.log" append="off"/>
Nov 17 01:34:17 user nova-compute[75226]:     </serial>
Nov 17 01:34:17 user nova-compute[75226]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 17 01:34:17 user nova-compute[75226]:     <video>
Nov 17 01:34:17 user nova-compute[75226]:       <model type="virtio"/>
Nov 17 01:34:17 user nova-compute[75226]:     </video>
Nov 17 01:34:17 user nova-compute[75226]:     <rng model="virtio">
Nov 17 01:34:17 user nova-compute[75226]:       <backend model="random">/dev/urandom</backend>
Nov 17 01:34:17 user nova-compute[75226]:     </rng>
Nov 17 01:34:17 user nova-compute[75226]:     <controller type="usb" index="0" model="none"/>
Nov 17 01:34:17 user nova-compute[75226]:     <memballoon model="virtio">
Nov 17 01:34:17 user nova-compute[75226]:       <stats period="10"/>
Nov 17 01:34:17 user nova-compute[75226]:     </memballoon>
Nov 17 01:34:17 user nova-compute[75226]:   </devices>
Nov 17 01:34:17 user nova-compute[75226]: </domain>
Nov 17 01:34:17 user nova-compute[75226]:  {{(pid=75226) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 17 01:34:17 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-8da4b76d-9029-40bf-ad30-574ec7d9996d tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:34:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-483037740',display_name='tempest-ServerRescueNegativeTestJSON-server-483037740',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-483037740',id=35,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOVRakfmKG4XwLomtS+/jC13ImozUfCSHgByLANg2qVBj+muP2PNHXh8ZrfOah4b/BlgXMz/oIJTeq+c9dBzYhbjAocJ7t33Td2l/vK8u2gWzu5nr29e4L+F2Hdr873C7g==',key_name='tempest-keypair-769708112',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2052a37a068e4d948c57560c0f4445e4',ramdisk_id='',reservation_id='r-fwlr0hcq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-344970408',owner_user_name='tempest-ServerRescueNegativeTestJSON-344970408-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T01:34:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='12f405f1486a4f5187e628c60f223e98',uuid=8d983732-91aa-4f20-9d7d-3de66029cba5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2ef7c6ef-e077-49c7-aaca-1d8ba7e7335c", "address": "fa:16:3e:90:7b:a1", "network": {"id": "a9710b94-56f8-4cf6-9bb6-344b275e5bf2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-512340839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2052a37a068e4d948c57560c0f4445e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ef7c6ef-e0", "ovs_interfaceid": "2ef7c6ef-e077-49c7-aaca-1d8ba7e7335c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 17 01:34:17 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-8da4b76d-9029-40bf-ad30-574ec7d9996d tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Converting VIF {"id": "2ef7c6ef-e077-49c7-aaca-1d8ba7e7335c", "address": "fa:16:3e:90:7b:a1", "network": {"id": "a9710b94-56f8-4cf6-9bb6-344b275e5bf2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-512340839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2052a37a068e4d948c57560c0f4445e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ef7c6ef-e0", "ovs_interfaceid": "2ef7c6ef-e077-49c7-aaca-1d8ba7e7335c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:34:17 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-8da4b76d-9029-40bf-ad30-574ec7d9996d tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:7b:a1,bridge_name='br-int',has_traffic_filtering=True,id=2ef7c6ef-e077-49c7-aaca-1d8ba7e7335c,network=Network(a9710b94-56f8-4cf6-9bb6-344b275e5bf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ef7c6ef-e0') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:34:17 user nova-compute[75226]: DEBUG os_vif [None req-8da4b76d-9029-40bf-ad30-574ec7d9996d tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:7b:a1,bridge_name='br-int',has_traffic_filtering=True,id=2ef7c6ef-e077-49c7-aaca-1d8ba7e7335c,network=Network(a9710b94-56f8-4cf6-9bb6-344b275e5bf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ef7c6ef-e0') {{(pid=75226) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 17 01:34:17 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:34:17 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:34:17 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 17 01:34:17 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:34:17 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6bf2f6d0-118a-5315-9f8e-9acc3ba3e8d2', '_type': 'linux-noop'}}, row=False) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:34:17 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:34:17 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:34:17 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:34:17 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2ef7c6ef-e0, may_exist=True, interface_attrs={}) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:34:17 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2ef7c6ef-e0, col_values=(('qos', UUID('980445f5-b773-4798-a4a1-c4bddb58a941')),), if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:34:17 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2ef7c6ef-e0, col_values=(('external_ids', {'iface-id': '2ef7c6ef-e077-49c7-aaca-1d8ba7e7335c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:90:7b:a1', 'vm-uuid': '8d983732-91aa-4f20-9d7d-3de66029cba5'}),), if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:34:17 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:34:17 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:34:17 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:34:17 user nova-compute[75226]: INFO os_vif [None req-8da4b76d-9029-40bf-ad30-574ec7d9996d tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:7b:a1,bridge_name='br-int',has_traffic_filtering=True,id=2ef7c6ef-e077-49c7-aaca-1d8ba7e7335c,network=Network(a9710b94-56f8-4cf6-9bb6-344b275e5bf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ef7c6ef-e0')
Nov 17 01:34:17 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-8da4b76d-9029-40bf-ad30-574ec7d9996d tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] No BDM found with device name vda, not building metadata. {{(pid=75226) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 01:34:17 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-8da4b76d-9029-40bf-ad30-574ec7d9996d tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] No VIF found with MAC fa:16:3e:90:7b:a1, not building metadata {{(pid=75226) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 01:34:17 user nova-compute[75226]: DEBUG nova.compute.manager [req-9b5053dc-8e61-4b4c-a78b-03f47b060bef req-ed5be9d7-496a-4034-81b3-ae63de2b0ac3 service nova] [instance: 4050d898-f2b8-46c2-86e3-702ceb41a701] Received event network-vif-deleted-3b88e9ba-814a-4122-9e85-a70bd6d85ad0 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:34:17 user nova-compute[75226]: DEBUG nova.compute.manager [req-9b5053dc-8e61-4b4c-a78b-03f47b060bef req-ed5be9d7-496a-4034-81b3-ae63de2b0ac3 service nova] [instance: 8d983732-91aa-4f20-9d7d-3de66029cba5] Received event network-changed-2ef7c6ef-e077-49c7-aaca-1d8ba7e7335c {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:34:17 user nova-compute[75226]: DEBUG nova.compute.manager [req-9b5053dc-8e61-4b4c-a78b-03f47b060bef req-ed5be9d7-496a-4034-81b3-ae63de2b0ac3 service nova] [instance: 8d983732-91aa-4f20-9d7d-3de66029cba5] Refreshing instance network info cache due to event network-changed-2ef7c6ef-e077-49c7-aaca-1d8ba7e7335c. {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 01:34:17 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-9b5053dc-8e61-4b4c-a78b-03f47b060bef req-ed5be9d7-496a-4034-81b3-ae63de2b0ac3 service nova] Acquiring lock "refresh_cache-8d983732-91aa-4f20-9d7d-3de66029cba5" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:34:17 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-9b5053dc-8e61-4b4c-a78b-03f47b060bef req-ed5be9d7-496a-4034-81b3-ae63de2b0ac3 service nova] Acquired lock "refresh_cache-8d983732-91aa-4f20-9d7d-3de66029cba5" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:34:17 user nova-compute[75226]: DEBUG nova.network.neutron [req-9b5053dc-8e61-4b4c-a78b-03f47b060bef req-ed5be9d7-496a-4034-81b3-ae63de2b0ac3 service nova] [instance: 8d983732-91aa-4f20-9d7d-3de66029cba5] Refreshing network info cache for port 2ef7c6ef-e077-49c7-aaca-1d8ba7e7335c {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 01:34:17 user nova-compute[75226]: DEBUG nova.network.neutron [req-9b5053dc-8e61-4b4c-a78b-03f47b060bef req-ed5be9d7-496a-4034-81b3-ae63de2b0ac3 service nova] [instance: 8d983732-91aa-4f20-9d7d-3de66029cba5] Updated VIF entry in instance network info cache for port 2ef7c6ef-e077-49c7-aaca-1d8ba7e7335c. {{(pid=75226) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 01:34:17 user nova-compute[75226]: DEBUG nova.network.neutron [req-9b5053dc-8e61-4b4c-a78b-03f47b060bef req-ed5be9d7-496a-4034-81b3-ae63de2b0ac3 service nova] [instance: 8d983732-91aa-4f20-9d7d-3de66029cba5] Updating instance_info_cache with network_info: [{"id": "2ef7c6ef-e077-49c7-aaca-1d8ba7e7335c", "address": "fa:16:3e:90:7b:a1", "network": {"id": "a9710b94-56f8-4cf6-9bb6-344b275e5bf2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-512340839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2052a37a068e4d948c57560c0f4445e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ef7c6ef-e0", "ovs_interfaceid": "2ef7c6ef-e077-49c7-aaca-1d8ba7e7335c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:34:17 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-9b5053dc-8e61-4b4c-a78b-03f47b060bef req-ed5be9d7-496a-4034-81b3-ae63de2b0ac3 service nova] Releasing lock "refresh_cache-8d983732-91aa-4f20-9d7d-3de66029cba5" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:34:17 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:34:17 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Starting heal instance info cache {{(pid=75226) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 17 01:34:18 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "refresh_cache-2ea5a14b-c330-4a2b-926e-60e1b30f5981" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:34:18 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquired lock "refresh_cache-2ea5a14b-c330-4a2b-926e-60e1b30f5981" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:34:18 user nova-compute[75226]: DEBUG nova.network.neutron [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] [instance: 2ea5a14b-c330-4a2b-926e-60e1b30f5981] Forcefully refreshing network info cache for instance {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 17 01:34:18 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:34:18 user nova-compute[75226]: DEBUG nova.network.neutron [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] [instance: 2ea5a14b-c330-4a2b-926e-60e1b30f5981] Updating instance_info_cache with network_info: [{"id": "86250373-f92f-4176-b242-382fa11f4e39", "address": "fa:16:3e:54:1e:3c", "network": {"id": "450540a3-ff7e-42fb-a0a6-808acd749943", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1503678778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6cb6f679ee4468d82cc7fb5d0f67be9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86250373-f9", "ovs_interfaceid": "86250373-f92f-4176-b242-382fa11f4e39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:34:18 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Releasing lock "refresh_cache-2ea5a14b-c330-4a2b-926e-60e1b30f5981" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:34:18 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] [instance: 2ea5a14b-c330-4a2b-926e-60e1b30f5981] Updated the network info_cache for instance {{(pid=75226) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 17 01:34:18 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:34:18 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75226) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 17 01:34:18 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:34:18 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:34:18 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:34:18 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:34:18 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:34:18 user nova-compute[75226]: DEBUG nova.compute.manager [req-6bf62548-39f0-468f-847d-002b6b0a104e req-da9bb43c-9341-41cd-8651-6ccb544c77ad service nova] [instance: 8d983732-91aa-4f20-9d7d-3de66029cba5] Received event network-vif-plugged-2ef7c6ef-e077-49c7-aaca-1d8ba7e7335c {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:34:18 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-6bf62548-39f0-468f-847d-002b6b0a104e req-da9bb43c-9341-41cd-8651-6ccb544c77ad service nova] Acquiring lock "8d983732-91aa-4f20-9d7d-3de66029cba5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:34:18 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-6bf62548-39f0-468f-847d-002b6b0a104e req-da9bb43c-9341-41cd-8651-6ccb544c77ad service nova] Lock "8d983732-91aa-4f20-9d7d-3de66029cba5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:34:18 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-6bf62548-39f0-468f-847d-002b6b0a104e req-da9bb43c-9341-41cd-8651-6ccb544c77ad service nova] Lock "8d983732-91aa-4f20-9d7d-3de66029cba5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:34:18 user nova-compute[75226]: DEBUG nova.compute.manager [req-6bf62548-39f0-468f-847d-002b6b0a104e req-da9bb43c-9341-41cd-8651-6ccb544c77ad service nova] [instance: 8d983732-91aa-4f20-9d7d-3de66029cba5] No waiting events found dispatching network-vif-plugged-2ef7c6ef-e077-49c7-aaca-1d8ba7e7335c {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:34:18 user nova-compute[75226]: WARNING nova.compute.manager [req-6bf62548-39f0-468f-847d-002b6b0a104e req-da9bb43c-9341-41cd-8651-6ccb544c77ad service nova] [instance: 8d983732-91aa-4f20-9d7d-3de66029cba5] Received unexpected event network-vif-plugged-2ef7c6ef-e077-49c7-aaca-1d8ba7e7335c for instance with vm_state building and task_state spawning.
Nov 17 01:34:20 user nova-compute[75226]: DEBUG nova.compute.manager [None req-8da4b76d-9029-40bf-ad30-574ec7d9996d tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] [instance: 8d983732-91aa-4f20-9d7d-3de66029cba5] Instance event wait completed in 0 seconds for  {{(pid=75226) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 17 01:34:20 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-8da4b76d-9029-40bf-ad30-574ec7d9996d tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] [instance: 8d983732-91aa-4f20-9d7d-3de66029cba5] Guest created on hypervisor {{(pid=75226) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 17 01:34:20 user nova-compute[75226]: INFO nova.virt.libvirt.driver [-] [instance: 8d983732-91aa-4f20-9d7d-3de66029cba5] Instance spawned successfully.
Nov 17 01:34:20 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-8da4b76d-9029-40bf-ad30-574ec7d9996d tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] [instance: 8d983732-91aa-4f20-9d7d-3de66029cba5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 17 01:34:20 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-8da4b76d-9029-40bf-ad30-574ec7d9996d tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] [instance: 8d983732-91aa-4f20-9d7d-3de66029cba5] Found default for hw_cdrom_bus of ide {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:34:20 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-8da4b76d-9029-40bf-ad30-574ec7d9996d tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] [instance: 8d983732-91aa-4f20-9d7d-3de66029cba5] Found default for hw_disk_bus of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:34:20 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-8da4b76d-9029-40bf-ad30-574ec7d9996d tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] [instance: 8d983732-91aa-4f20-9d7d-3de66029cba5] Found default for hw_input_bus of None {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:34:20 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-8da4b76d-9029-40bf-ad30-574ec7d9996d tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] [instance: 8d983732-91aa-4f20-9d7d-3de66029cba5] Found default for hw_pointer_model of None {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:34:20 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-8da4b76d-9029-40bf-ad30-574ec7d9996d tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] [instance: 8d983732-91aa-4f20-9d7d-3de66029cba5] Found default for hw_video_model of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:34:20 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-8da4b76d-9029-40bf-ad30-574ec7d9996d tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] [instance: 8d983732-91aa-4f20-9d7d-3de66029cba5] Found default for hw_vif_model of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:34:20 user nova-compute[75226]: INFO nova.compute.manager [None req-8da4b76d-9029-40bf-ad30-574ec7d9996d tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] [instance: 8d983732-91aa-4f20-9d7d-3de66029cba5] Took 5.52 seconds to spawn the instance on the hypervisor.
Nov 17 01:34:20 user nova-compute[75226]: DEBUG nova.compute.manager [None req-8da4b76d-9029-40bf-ad30-574ec7d9996d tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] [instance: 8d983732-91aa-4f20-9d7d-3de66029cba5] Checking state {{(pid=75226) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 01:34:21 user nova-compute[75226]: INFO nova.compute.manager [None req-8da4b76d-9029-40bf-ad30-574ec7d9996d tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] [instance: 8d983732-91aa-4f20-9d7d-3de66029cba5] Took 7.50 seconds to build instance.
Nov 17 01:34:21 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-8da4b76d-9029-40bf-ad30-574ec7d9996d tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Lock "8d983732-91aa-4f20-9d7d-3de66029cba5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.591s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:34:21 user nova-compute[75226]: DEBUG nova.compute.manager [req-03a48a4d-bf65-4863-872f-08ee40c7bdb3 req-14ebaeda-4557-4036-9009-69bd7b6f84c8 service nova] [instance: 8d983732-91aa-4f20-9d7d-3de66029cba5] Received event network-vif-plugged-2ef7c6ef-e077-49c7-aaca-1d8ba7e7335c {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:34:21 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-03a48a4d-bf65-4863-872f-08ee40c7bdb3 req-14ebaeda-4557-4036-9009-69bd7b6f84c8 service nova] Acquiring lock "8d983732-91aa-4f20-9d7d-3de66029cba5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:34:21 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-03a48a4d-bf65-4863-872f-08ee40c7bdb3 req-14ebaeda-4557-4036-9009-69bd7b6f84c8 service nova] Lock "8d983732-91aa-4f20-9d7d-3de66029cba5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:34:21 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-03a48a4d-bf65-4863-872f-08ee40c7bdb3 req-14ebaeda-4557-4036-9009-69bd7b6f84c8 service nova] Lock "8d983732-91aa-4f20-9d7d-3de66029cba5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:34:21 user nova-compute[75226]: DEBUG nova.compute.manager [req-03a48a4d-bf65-4863-872f-08ee40c7bdb3 req-14ebaeda-4557-4036-9009-69bd7b6f84c8 service nova] [instance: 8d983732-91aa-4f20-9d7d-3de66029cba5] No waiting events found dispatching network-vif-plugged-2ef7c6ef-e077-49c7-aaca-1d8ba7e7335c {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:34:21 user nova-compute[75226]: WARNING nova.compute.manager [req-03a48a4d-bf65-4863-872f-08ee40c7bdb3 req-14ebaeda-4557-4036-9009-69bd7b6f84c8 service nova] [instance: 8d983732-91aa-4f20-9d7d-3de66029cba5] Received unexpected event network-vif-plugged-2ef7c6ef-e077-49c7-aaca-1d8ba7e7335c for instance with vm_state active and task_state None.
Nov 17 01:34:22 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:34:23 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:34:27 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:34:31 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-9518cb17-5cd4-4053-a933-d1b43d207e4a tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Acquiring lock "dae5490b-e434-4cd1-b8d4-6baab9bb7345" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:34:31 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-9518cb17-5cd4-4053-a933-d1b43d207e4a tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Lock "dae5490b-e434-4cd1-b8d4-6baab9bb7345" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:34:31 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-9518cb17-5cd4-4053-a933-d1b43d207e4a tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Acquiring lock "dae5490b-e434-4cd1-b8d4-6baab9bb7345-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:34:31 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-9518cb17-5cd4-4053-a933-d1b43d207e4a tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Lock "dae5490b-e434-4cd1-b8d4-6baab9bb7345-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:34:31 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-9518cb17-5cd4-4053-a933-d1b43d207e4a tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Lock "dae5490b-e434-4cd1-b8d4-6baab9bb7345-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:34:31 user nova-compute[75226]: INFO nova.compute.manager [None req-9518cb17-5cd4-4053-a933-d1b43d207e4a tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: dae5490b-e434-4cd1-b8d4-6baab9bb7345] Terminating instance
Nov 17 01:34:31 user nova-compute[75226]: DEBUG nova.compute.manager [None req-9518cb17-5cd4-4053-a933-d1b43d207e4a tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: dae5490b-e434-4cd1-b8d4-6baab9bb7345] Start destroying the instance on the hypervisor. {{(pid=75226) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 17 01:34:31 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:34:31 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:34:31 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:34:31 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:34:32 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:34:32 user nova-compute[75226]: DEBUG nova.compute.manager [req-7378ef81-eea0-4328-b921-1365a0790313 req-c5386a2f-324a-4c36-922f-263bcc0c7f01 service nova] [instance: dae5490b-e434-4cd1-b8d4-6baab9bb7345] Received event network-vif-unplugged-09413dab-7bc1-4c16-9486-ce6e790b72e1 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:34:32 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-7378ef81-eea0-4328-b921-1365a0790313 req-c5386a2f-324a-4c36-922f-263bcc0c7f01 service nova] Acquiring lock "dae5490b-e434-4cd1-b8d4-6baab9bb7345-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:34:32 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-7378ef81-eea0-4328-b921-1365a0790313 req-c5386a2f-324a-4c36-922f-263bcc0c7f01 service nova] Lock "dae5490b-e434-4cd1-b8d4-6baab9bb7345-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:34:32 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-7378ef81-eea0-4328-b921-1365a0790313 req-c5386a2f-324a-4c36-922f-263bcc0c7f01 service nova] Lock "dae5490b-e434-4cd1-b8d4-6baab9bb7345-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:34:32 user nova-compute[75226]: DEBUG nova.compute.manager [req-7378ef81-eea0-4328-b921-1365a0790313 req-c5386a2f-324a-4c36-922f-263bcc0c7f01 service nova] [instance: dae5490b-e434-4cd1-b8d4-6baab9bb7345] No waiting events found dispatching network-vif-unplugged-09413dab-7bc1-4c16-9486-ce6e790b72e1 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:34:32 user nova-compute[75226]: DEBUG nova.compute.manager [req-7378ef81-eea0-4328-b921-1365a0790313 req-c5386a2f-324a-4c36-922f-263bcc0c7f01 service nova] [instance: dae5490b-e434-4cd1-b8d4-6baab9bb7345] Received event network-vif-unplugged-09413dab-7bc1-4c16-9486-ce6e790b72e1 for instance with task_state deleting. {{(pid=75226) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 17 01:34:32 user nova-compute[75226]: INFO nova.virt.libvirt.driver [-] [instance: dae5490b-e434-4cd1-b8d4-6baab9bb7345] Instance destroyed successfully.
Nov 17 01:34:32 user nova-compute[75226]: DEBUG nova.objects.instance [None req-9518cb17-5cd4-4053-a933-d1b43d207e4a tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Lazy-loading 'resources' on Instance uuid dae5490b-e434-4cd1-b8d4-6baab9bb7345 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:34:32 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-9518cb17-5cd4-4053-a933-d1b43d207e4a tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:31:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1593446740',display_name='tempest-AttachVolumeNegativeTest-server-1593446740',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1593446740',id=31,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOwz4hZVtgwWrcsPqTttyZBVyl9RUasoXFQhVcgfaPcpYA4qKb3oLahGiiQJ06st0ngGCdUQrVZmkK0ocqe46krfUTKz1BkqdX4i3m0Ik5xNCg8vFBi82owiMQLC/btQGw==',key_name='tempest-keypair-1790996567',keypairs=<?>,launch_index=0,launched_at=2023-11-17T01:31:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e38777e8baf745e79f31190da97406a0',ramdisk_id='',reservation_id='r-2trz1s7e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-940905741',owner_user_name='tempest-AttachVolumeNegativeTest-940905741-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T01:31:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='642db538240b4ca1a367cf4ee9714f66',uuid=dae5490b-e434-4cd1-b8d4-6baab9bb7345,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "09413dab-7bc1-4c16-9486-ce6e790b72e1", "address": "fa:16:3e:82:cf:64", "network": {"id": "57d0e7ee-0b11-4e00-86f9-bb4a3c25c674", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1357446034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e38777e8baf745e79f31190da97406a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09413dab-7b", "ovs_interfaceid": "09413dab-7bc1-4c16-9486-ce6e790b72e1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 17 01:34:32 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-9518cb17-5cd4-4053-a933-d1b43d207e4a tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Converting VIF {"id": "09413dab-7bc1-4c16-9486-ce6e790b72e1", "address": "fa:16:3e:82:cf:64", "network": {"id": "57d0e7ee-0b11-4e00-86f9-bb4a3c25c674", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1357446034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e38777e8baf745e79f31190da97406a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09413dab-7b", "ovs_interfaceid": "09413dab-7bc1-4c16-9486-ce6e790b72e1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:34:32 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-9518cb17-5cd4-4053-a933-d1b43d207e4a tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:82:cf:64,bridge_name='br-int',has_traffic_filtering=True,id=09413dab-7bc1-4c16-9486-ce6e790b72e1,network=Network(57d0e7ee-0b11-4e00-86f9-bb4a3c25c674),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09413dab-7b') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:34:32 user nova-compute[75226]: DEBUG os_vif [None req-9518cb17-5cd4-4053-a933-d1b43d207e4a tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:82:cf:64,bridge_name='br-int',has_traffic_filtering=True,id=09413dab-7bc1-4c16-9486-ce6e790b72e1,network=Network(57d0e7ee-0b11-4e00-86f9-bb4a3c25c674),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09413dab-7b') {{(pid=75226) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 17 01:34:32 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:34:32 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap09413dab-7b, bridge=br-int, if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:34:32 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:34:32 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:34:32 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:34:32 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5f2550a3-36e4-432f-a0d1-1de02e4c8117) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:34:32 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:34:32 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:34:32 user nova-compute[75226]: INFO os_vif [None req-9518cb17-5cd4-4053-a933-d1b43d207e4a tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:82:cf:64,bridge_name='br-int',has_traffic_filtering=True,id=09413dab-7bc1-4c16-9486-ce6e790b72e1,network=Network(57d0e7ee-0b11-4e00-86f9-bb4a3c25c674),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09413dab-7b')
Nov 17 01:34:32 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-9518cb17-5cd4-4053-a933-d1b43d207e4a tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: dae5490b-e434-4cd1-b8d4-6baab9bb7345] Deleting instance files /opt/stack/data/nova/instances/dae5490b-e434-4cd1-b8d4-6baab9bb7345_del
Nov 17 01:34:32 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-9518cb17-5cd4-4053-a933-d1b43d207e4a tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: dae5490b-e434-4cd1-b8d4-6baab9bb7345] Deletion of /opt/stack/data/nova/instances/dae5490b-e434-4cd1-b8d4-6baab9bb7345_del complete
Nov 17 01:34:32 user nova-compute[75226]: INFO nova.compute.manager [None req-9518cb17-5cd4-4053-a933-d1b43d207e4a tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] [instance: dae5490b-e434-4cd1-b8d4-6baab9bb7345] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 17 01:34:32 user nova-compute[75226]: DEBUG oslo.service.loopingcall [None req-9518cb17-5cd4-4053-a933-d1b43d207e4a tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75226) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 17 01:34:32 user nova-compute[75226]: DEBUG nova.compute.manager [-] [instance: dae5490b-e434-4cd1-b8d4-6baab9bb7345] Deallocating network for instance {{(pid=75226) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 17 01:34:32 user nova-compute[75226]: DEBUG nova.network.neutron [-] [instance: dae5490b-e434-4cd1-b8d4-6baab9bb7345] deallocate_for_instance() {{(pid=75226) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 17 01:34:33 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:34:33 user nova-compute[75226]: DEBUG nova.network.neutron [-] [instance: dae5490b-e434-4cd1-b8d4-6baab9bb7345] Updating instance_info_cache with network_info: [] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:34:33 user nova-compute[75226]: INFO nova.compute.manager [-] [instance: dae5490b-e434-4cd1-b8d4-6baab9bb7345] Took 0.63 seconds to deallocate network for instance.
Nov 17 01:34:33 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-9518cb17-5cd4-4053-a933-d1b43d207e4a tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:34:33 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-9518cb17-5cd4-4053-a933-d1b43d207e4a tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:34:33 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-9518cb17-5cd4-4053-a933-d1b43d207e4a tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:34:33 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-9518cb17-5cd4-4053-a933-d1b43d207e4a tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:34:33 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-9518cb17-5cd4-4053-a933-d1b43d207e4a tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.377s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:34:33 user nova-compute[75226]: INFO nova.scheduler.client.report [None req-9518cb17-5cd4-4053-a933-d1b43d207e4a tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Deleted allocations for instance dae5490b-e434-4cd1-b8d4-6baab9bb7345
Nov 17 01:34:33 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-9518cb17-5cd4-4053-a933-d1b43d207e4a tempest-AttachVolumeNegativeTest-940905741 tempest-AttachVolumeNegativeTest-940905741-project-member] Lock "dae5490b-e434-4cd1-b8d4-6baab9bb7345" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.047s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:34:34 user nova-compute[75226]: DEBUG nova.compute.manager [req-8f8e52c2-d365-4518-bef3-62f3d599eed0 req-78093ff9-963c-4eec-a4d1-2e63811c45f8 service nova] [instance: dae5490b-e434-4cd1-b8d4-6baab9bb7345] Received event network-vif-plugged-09413dab-7bc1-4c16-9486-ce6e790b72e1 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:34:34 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-8f8e52c2-d365-4518-bef3-62f3d599eed0 req-78093ff9-963c-4eec-a4d1-2e63811c45f8 service nova] Acquiring lock "dae5490b-e434-4cd1-b8d4-6baab9bb7345-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:34:34 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-8f8e52c2-d365-4518-bef3-62f3d599eed0 req-78093ff9-963c-4eec-a4d1-2e63811c45f8 service nova] Lock "dae5490b-e434-4cd1-b8d4-6baab9bb7345-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:34:34 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-8f8e52c2-d365-4518-bef3-62f3d599eed0 req-78093ff9-963c-4eec-a4d1-2e63811c45f8 service nova] Lock "dae5490b-e434-4cd1-b8d4-6baab9bb7345-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:34:34 user nova-compute[75226]: DEBUG nova.compute.manager [req-8f8e52c2-d365-4518-bef3-62f3d599eed0 req-78093ff9-963c-4eec-a4d1-2e63811c45f8 service nova] [instance: dae5490b-e434-4cd1-b8d4-6baab9bb7345] No waiting events found dispatching network-vif-plugged-09413dab-7bc1-4c16-9486-ce6e790b72e1 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:34:34 user nova-compute[75226]: WARNING nova.compute.manager [req-8f8e52c2-d365-4518-bef3-62f3d599eed0 req-78093ff9-963c-4eec-a4d1-2e63811c45f8 service nova] [instance: dae5490b-e434-4cd1-b8d4-6baab9bb7345] Received unexpected event network-vif-plugged-09413dab-7bc1-4c16-9486-ce6e790b72e1 for instance with vm_state deleted and task_state None.
Nov 17 01:34:34 user nova-compute[75226]: DEBUG nova.compute.manager [req-8f8e52c2-d365-4518-bef3-62f3d599eed0 req-78093ff9-963c-4eec-a4d1-2e63811c45f8 service nova] [instance: dae5490b-e434-4cd1-b8d4-6baab9bb7345] Received event network-vif-deleted-09413dab-7bc1-4c16-9486-ce6e790b72e1 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:34:35 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-c73af072-c06e-4ce8-b1ab-386064abc884 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance c11fbffa-07e2-40c4-92b1-8531dbe8b687 is timed out.
Nov 17 01:34:35 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-c73af072-c06e-4ce8-b1ab-386064abc884 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Successfully detached device vdb from instance c11fbffa-07e2-40c4-92b1-8531dbe8b687 from the live domain config.
Nov 17 01:34:35 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c73af072-c06e-4ce8-b1ab-386064abc884 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] [instance: c11fbffa-07e2-40c4-92b1-8531dbe8b687] calling os-brick to detach iSCSI Volume {{(pid=75226) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 17 01:34:35 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-c73af072-c06e-4ce8-b1ab-386064abc884 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc4cc36b490>, {'target_iqn': 'iqn.2010-10.org.openstack:ce3aa851-e7f0-4ea9-b3ed-404dbb123330', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HmrPIwQa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:34:35 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-c73af072-c06e-4ce8-b1ab-386064abc884 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:34:35 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-c73af072-c06e-4ce8-b1ab-386064abc884 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:34:35 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-c73af072-c06e-4ce8-b1ab-386064abc884 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:34:35 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:34:35 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:34:35 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b44a29b-a58b-4e2c-a161-6682edddc41e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:05f878e5-0241-4282-8b2c-c4651c429dcb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:50b18fb0-86d4-4384-b5be-ad4ac5a6fe82\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ce3aa851-e7f0-4ea9-b3ed-404dbb123330\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:34:35 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-c73af072-c06e-4ce8-b1ab-386064abc884 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 17 01:34:35 user nova-compute[75226]: No targets found.
Nov 17 01:34:35 user nova-compute[75226]: iSNS:
Nov 17 01:34:35 user nova-compute[75226]: No targets found.
Nov 17 01:34:35 user nova-compute[75226]: STATIC:
Nov 17 01:34:35 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:05f878e5-0241-4282-8b2c-c4651c429dcb
Nov 17 01:34:35 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:34:35 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:34:35 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8
Nov 17 01:34:35 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:34:35 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:34:35 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:50b18fb0-86d4-4384-b5be-ad4ac5a6fe82
Nov 17 01:34:35 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:34:35 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:34:35 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:ce3aa851-e7f0-4ea9-b3ed-404dbb123330
Nov 17 01:34:35 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:34:35 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:34:35 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419
Nov 17 01:34:35 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:34:35 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:34:35 user nova-compute[75226]: FIRMWARE:
Nov 17 01:34:35 user nova-compute[75226]: No targets found.
Nov 17 01:34:35 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:34:35 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-c73af072-c06e-4ce8-b1ab-386064abc884 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 17 01:34:35 user nova-compute[75226]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 17 01:34:35 user nova-compute[75226]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75226) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 17 01:34:35 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-c73af072-c06e-4ce8-b1ab-386064abc884 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ce3aa851-e7f0-4ea9-b3ed-404dbb123330', 0)] {{(pid=75226) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 17 01:34:35 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:34:35 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:34:35 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[404a83cc-ce84-4f17-a411-52b552940735]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:05f878e5-0241-4282-8b2c-c4651c429dcb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50b18fb0-86d4-4384-b5be-ad4ac5a6fe82\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ce3aa851-e7f0-4ea9-b3ed-404dbb123330\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:34:35 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:34:35 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:34:35 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[9267999a-4875-49d0-b3b8-95ffd9300253]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05f878e5-0241-4282-8b2c-c4651c429dcb (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce3aa851-e7f0-4ea9-b3ed-404dbb123330 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50b18fb0-86d4-4384-b5be-ad4ac5a6fe82 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:34:35 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-c73af072-c06e-4ce8-b1ab-386064abc884 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)
Nov 17 01:34:35 user nova-compute[75226]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05f878e5-0241-4282-8b2c-c4651c429dcb (non-flash)
Nov 17 01:34:35 user nova-compute[75226]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419 (non-flash)
Nov 17 01:34:35 user nova-compute[75226]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce3aa851-e7f0-4ea9-b3ed-404dbb123330 (non-flash)
Nov 17 01:34:35 user nova-compute[75226]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50b18fb0-86d4-4384-b5be-ad4ac5a6fe82 (non-flash)
Nov 17 01:34:35 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:34:35 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-c73af072-c06e-4ce8-b1ab-386064abc884 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)
Nov 17 01:34:35 user nova-compute[75226]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05f878e5-0241-4282-8b2c-c4651c429dcb (non-flash)
Nov 17 01:34:35 user nova-compute[75226]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419 (non-flash)
Nov 17 01:34:35 user nova-compute[75226]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce3aa851-e7f0-4ea9-b3ed-404dbb123330 (non-flash)
Nov 17 01:34:35 user nova-compute[75226]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50b18fb0-86d4-4384-b5be-ad4ac5a6fe82 (non-flash)
Nov 17 01:34:35 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:34:35 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-c73af072-c06e-4ce8-b1ab-386064abc884 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc4b42d7520>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ce3aa851-e7f0-4ea9-b3ed-404dbb123330'): ({'sdf'}, set())}) {{(pid=75226) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 17 01:34:35 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-c73af072-c06e-4ce8-b1ab-386064abc884 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Removing single pathed devices sdf {{(pid=75226) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 17 01:34:35 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:34:35 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:34:35 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f4174d4-a411-4107-a862-7309a4b1e60f]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:34:35 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:34:35 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.024s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:34:35 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[fddbdc89-8292-47c1-8105-20205d4cae56]: (4, ('ok\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:34:35 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-c73af072-c06e-4ce8-b1ab-386064abc884 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Flushing IO for device /dev/sdf {{(pid=75226) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 17 01:34:35 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:34:35 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:34:35 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[5913679a-a579-41f4-8e5a-8654d3381553]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:34:35 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-c73af072-c06e-4ce8-b1ab-386064abc884 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75226) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 17 01:34:35 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:34:36 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.053s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:34:36 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cde707e-1f3f-4ae2-a428-dfa26564caba]: (4, ('1', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:34:36 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-c73af072-c06e-4ce8-b1ab-386064abc884 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75226) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 17 01:34:36 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-c73af072-c06e-4ce8-b1ab-386064abc884 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] SCSI volumes sdf have been removed. {{(pid=75226) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 17 01:34:36 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-c73af072-c06e-4ce8-b1ab-386064abc884 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ce3aa851-e7f0-4ea9-b3ed-404dbb123330')] {{(pid=75226) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 17 01:34:36 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce3aa851-e7f0-4ea9-b3ed-404dbb123330 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:34:36 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce3aa851-e7f0-4ea9-b3ed-404dbb123330 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:34:36 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[63281ce2-2553-4a73-94be-b1bf69c62613]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:34:36 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-c73af072-c06e-4ce8-b1ab-386064abc884 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:34:36 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce3aa851-e7f0-4ea9-b3ed-404dbb123330 -p 172.16.0.220:3260 --logout {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:34:36 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce3aa851-e7f0-4ea9-b3ed-404dbb123330 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:34:36 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[52210656-5485-4396-8eda-d6d59ae72054]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:ce3aa851-e7f0-4ea9-b3ed-404dbb123330, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:ce3aa851-e7f0-4ea9-b3ed-404dbb123330, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:34:36 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-c73af072-c06e-4ce8-b1ab-386064abc884 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:ce3aa851-e7f0-4ea9-b3ed-404dbb123330, portal: 172.16.0.220,3260]
Nov 17 01:34:36 user nova-compute[75226]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:ce3aa851-e7f0-4ea9-b3ed-404dbb123330, portal: 172.16.0.220,3260] successful.
Nov 17 01:34:36 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:34:36 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce3aa851-e7f0-4ea9-b3ed-404dbb123330 -p 172.16.0.220:3260 --op delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:34:36 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce3aa851-e7f0-4ea9-b3ed-404dbb123330 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:34:36 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[22a2280e-d048-4fba-8497-448d9ca08ffe]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:34:36 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-c73af072-c06e-4ce8-b1ab-386064abc884 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:34:36 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-c73af072-c06e-4ce8-b1ab-386064abc884 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.346s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:34:36 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-c73af072-c06e-4ce8-b1ab-386064abc884 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] <== disconnect_volume: return (348ms) None {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:34:36 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c73af072-c06e-4ce8-b1ab-386064abc884 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] [instance: c11fbffa-07e2-40c4-92b1-8531dbe8b687] Disconnected iSCSI Volume {{(pid=75226) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 17 01:34:36 user nova-compute[75226]: DEBUG nova.objects.instance [None req-c73af072-c06e-4ce8-b1ab-386064abc884 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Lazy-loading 'flavor' on Instance uuid c11fbffa-07e2-40c4-92b1-8531dbe8b687 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:34:36 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-c73af072-c06e-4ce8-b1ab-386064abc884 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Lock "c11fbffa-07e2-40c4-92b1-8531dbe8b687" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.708s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:34:37 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:34:37 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-b48bad02-f734-449d-8f2e-bb26eb014fe0 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Acquiring lock "c11fbffa-07e2-40c4-92b1-8531dbe8b687" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:34:37 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-b48bad02-f734-449d-8f2e-bb26eb014fe0 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Lock "c11fbffa-07e2-40c4-92b1-8531dbe8b687" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:34:37 user nova-compute[75226]: INFO nova.compute.manager [None req-b48bad02-f734-449d-8f2e-bb26eb014fe0 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] [instance: c11fbffa-07e2-40c4-92b1-8531dbe8b687] Detaching volume 50b18fb0-86d4-4384-b5be-ad4ac5a6fe82
Nov 17 01:34:37 user nova-compute[75226]: INFO nova.virt.block_device [None req-b48bad02-f734-449d-8f2e-bb26eb014fe0 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] [instance: c11fbffa-07e2-40c4-92b1-8531dbe8b687] Attempting to driver detach volume 50b18fb0-86d4-4384-b5be-ad4ac5a6fe82 from mountpoint /dev/vdc
Nov 17 01:34:37 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-b48bad02-f734-449d-8f2e-bb26eb014fe0 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Attempting to detach device vdc from instance c11fbffa-07e2-40c4-92b1-8531dbe8b687 from the persistent domain config. {{(pid=75226) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 17 01:34:37 user nova-compute[75226]: DEBUG nova.virt.libvirt.guest [None req-b48bad02-f734-449d-8f2e-bb26eb014fe0 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] detach device xml: <disk type="block" device="disk">
Nov 17 01:34:37 user nova-compute[75226]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 01:34:37 user nova-compute[75226]:   <source dev="/dev/sdd"/>
Nov 17 01:34:37 user nova-compute[75226]:   <target dev="vdc" bus="virtio"/>
Nov 17 01:34:37 user nova-compute[75226]:   <serial>50b18fb0-86d4-4384-b5be-ad4ac5a6fe82</serial>
Nov 17 01:34:37 user nova-compute[75226]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 17 01:34:37 user nova-compute[75226]: </disk>
Nov 17 01:34:37 user nova-compute[75226]:  {{(pid=75226) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 17 01:34:37 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-b48bad02-f734-449d-8f2e-bb26eb014fe0 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Successfully detached device vdc from instance c11fbffa-07e2-40c4-92b1-8531dbe8b687 from the persistent domain config.
Nov 17 01:34:37 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-b48bad02-f734-449d-8f2e-bb26eb014fe0 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance c11fbffa-07e2-40c4-92b1-8531dbe8b687 from the live domain config. {{(pid=75226) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 17 01:34:37 user nova-compute[75226]: DEBUG nova.virt.libvirt.guest [None req-b48bad02-f734-449d-8f2e-bb26eb014fe0 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] detach device xml: <disk type="block" device="disk">
Nov 17 01:34:37 user nova-compute[75226]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 01:34:37 user nova-compute[75226]:   <source dev="/dev/sdd"/>
Nov 17 01:34:37 user nova-compute[75226]:   <target dev="vdc" bus="virtio"/>
Nov 17 01:34:37 user nova-compute[75226]:   <serial>50b18fb0-86d4-4384-b5be-ad4ac5a6fe82</serial>
Nov 17 01:34:37 user nova-compute[75226]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 17 01:34:37 user nova-compute[75226]: </disk>
Nov 17 01:34:37 user nova-compute[75226]:  {{(pid=75226) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 17 01:34:38 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:34:38 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-b48bad02-f734-449d-8f2e-bb26eb014fe0 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance c11fbffa-07e2-40c4-92b1-8531dbe8b687 {{(pid=75226) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 17 01:34:42 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:34:43 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:34:47 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:34:48 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:34:52 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:34:53 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:34:57 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:34:58 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-b48bad02-f734-449d-8f2e-bb26eb014fe0 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance c11fbffa-07e2-40c4-92b1-8531dbe8b687 is timed out.
Nov 17 01:34:58 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-b48bad02-f734-449d-8f2e-bb26eb014fe0 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Successfully detached device vdc from instance c11fbffa-07e2-40c4-92b1-8531dbe8b687 from the live domain config.
Nov 17 01:34:58 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b48bad02-f734-449d-8f2e-bb26eb014fe0 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] [instance: c11fbffa-07e2-40c4-92b1-8531dbe8b687] calling os-brick to detach iSCSI Volume {{(pid=75226) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 17 01:34:58 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-b48bad02-f734-449d-8f2e-bb26eb014fe0 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc4cc36b490>, {'target_iqn': 'iqn.2010-10.org.openstack:50b18fb0-86d4-4384-b5be-ad4ac5a6fe82', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xCdzLUgh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:34:58 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-b48bad02-f734-449d-8f2e-bb26eb014fe0 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:34:58 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-b48bad02-f734-449d-8f2e-bb26eb014fe0 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:34:58 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-b48bad02-f734-449d-8f2e-bb26eb014fe0 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:34:58 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:34:58 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:34:58 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[9108e33a-6ec5-429d-9a85-a82f93c40409]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:05f878e5-0241-4282-8b2c-c4651c429dcb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:50b18fb0-86d4-4384-b5be-ad4ac5a6fe82\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:34:58 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-b48bad02-f734-449d-8f2e-bb26eb014fe0 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 17 01:34:58 user nova-compute[75226]: No targets found.
Nov 17 01:34:58 user nova-compute[75226]: iSNS:
Nov 17 01:34:58 user nova-compute[75226]: No targets found.
Nov 17 01:34:58 user nova-compute[75226]: STATIC:
Nov 17 01:34:58 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:05f878e5-0241-4282-8b2c-c4651c429dcb
Nov 17 01:34:58 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:34:58 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:34:58 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8
Nov 17 01:34:58 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:34:58 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:34:58 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:50b18fb0-86d4-4384-b5be-ad4ac5a6fe82
Nov 17 01:34:58 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:34:58 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:34:58 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419
Nov 17 01:34:58 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:34:58 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:34:58 user nova-compute[75226]: FIRMWARE:
Nov 17 01:34:58 user nova-compute[75226]: No targets found.
Nov 17 01:34:58 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:34:58 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-b48bad02-f734-449d-8f2e-bb26eb014fe0 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 17 01:34:58 user nova-compute[75226]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 17 01:34:58 user nova-compute[75226]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75226) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 17 01:34:58 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-b48bad02-f734-449d-8f2e-bb26eb014fe0 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:50b18fb0-86d4-4384-b5be-ad4ac5a6fe82', 0)] {{(pid=75226) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 17 01:34:58 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:34:58 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:34:58 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f47277a-591a-4a8d-b3d1-86f87b7cfbe7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:05f878e5-0241-4282-8b2c-c4651c429dcb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50b18fb0-86d4-4384-b5be-ad4ac5a6fe82\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:34:58 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:34:58 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:34:58 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[088c7e49-824d-4593-b939-a508c5574989]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05f878e5-0241-4282-8b2c-c4651c429dcb (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50b18fb0-86d4-4384-b5be-ad4ac5a6fe82 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:34:58 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-b48bad02-f734-449d-8f2e-bb26eb014fe0 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)
Nov 17 01:34:58 user nova-compute[75226]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05f878e5-0241-4282-8b2c-c4651c429dcb (non-flash)
Nov 17 01:34:58 user nova-compute[75226]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419 (non-flash)
Nov 17 01:34:58 user nova-compute[75226]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50b18fb0-86d4-4384-b5be-ad4ac5a6fe82 (non-flash)
Nov 17 01:34:58 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:34:58 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-b48bad02-f734-449d-8f2e-bb26eb014fe0 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)
Nov 17 01:34:58 user nova-compute[75226]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05f878e5-0241-4282-8b2c-c4651c429dcb (non-flash)
Nov 17 01:34:58 user nova-compute[75226]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419 (non-flash)
Nov 17 01:34:58 user nova-compute[75226]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50b18fb0-86d4-4384-b5be-ad4ac5a6fe82 (non-flash)
Nov 17 01:34:58 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:34:58 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-b48bad02-f734-449d-8f2e-bb26eb014fe0 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc4b428d090>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:50b18fb0-86d4-4384-b5be-ad4ac5a6fe82'): ({'sdd'}, set())}) {{(pid=75226) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 17 01:34:58 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-b48bad02-f734-449d-8f2e-bb26eb014fe0 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Removing single pathed devices sdd {{(pid=75226) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 17 01:34:58 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:34:58 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:34:58 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[634dfb7a-f7df-48f8-a0a6-4c1cbfa3856d]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:34:58 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:34:58 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:34:58 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[3038da30-3b84-40c2-b92a-728ff5cdbd8e]: (4, ('ok\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:34:58 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-b48bad02-f734-449d-8f2e-bb26eb014fe0 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Flushing IO for device /dev/sdd {{(pid=75226) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 17 01:34:58 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:34:58 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:34:58 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[48051dbd-c019-4cb1-956a-a1388319bf4a]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:34:58 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-b48bad02-f734-449d-8f2e-bb26eb014fe0 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75226) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 17 01:34:58 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:34:58 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.043s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:34:58 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac1f301d-b9f1-4350-beae-171f093f4308]: (4, ('1', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:34:58 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-b48bad02-f734-449d-8f2e-bb26eb014fe0 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75226) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 17 01:34:58 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-b48bad02-f734-449d-8f2e-bb26eb014fe0 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] SCSI volumes sdd have been removed. {{(pid=75226) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 17 01:34:58 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-b48bad02-f734-449d-8f2e-bb26eb014fe0 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:50b18fb0-86d4-4384-b5be-ad4ac5a6fe82')] {{(pid=75226) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 17 01:34:58 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50b18fb0-86d4-4384-b5be-ad4ac5a6fe82 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:34:58 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50b18fb0-86d4-4384-b5be-ad4ac5a6fe82 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:34:58 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd578f07-566a-426c-83a5-0900273b99cf]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:34:58 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-b48bad02-f734-449d-8f2e-bb26eb014fe0 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:34:58 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50b18fb0-86d4-4384-b5be-ad4ac5a6fe82 -p 172.16.0.220:3260 --logout {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:34:58 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50b18fb0-86d4-4384-b5be-ad4ac5a6fe82 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:34:58 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[e951d7cf-9ab4-4518-930b-be63dcbb42e6]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:50b18fb0-86d4-4384-b5be-ad4ac5a6fe82, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:50b18fb0-86d4-4384-b5be-ad4ac5a6fe82, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:34:58 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-b48bad02-f734-449d-8f2e-bb26eb014fe0 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:50b18fb0-86d4-4384-b5be-ad4ac5a6fe82, portal: 172.16.0.220,3260]
Nov 17 01:34:58 user nova-compute[75226]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:50b18fb0-86d4-4384-b5be-ad4ac5a6fe82, portal: 172.16.0.220,3260] successful.
Nov 17 01:34:58 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:34:58 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50b18fb0-86d4-4384-b5be-ad4ac5a6fe82 -p 172.16.0.220:3260 --op delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:34:58 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50b18fb0-86d4-4384-b5be-ad4ac5a6fe82 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:34:58 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce451854-ee61-4187-8570-7c3489ded8cf]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:34:58 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-b48bad02-f734-449d-8f2e-bb26eb014fe0 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:34:58 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-b48bad02-f734-449d-8f2e-bb26eb014fe0 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.319s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:34:58 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-b48bad02-f734-449d-8f2e-bb26eb014fe0 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] <== disconnect_volume: return (321ms) None {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:34:58 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b48bad02-f734-449d-8f2e-bb26eb014fe0 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] [instance: c11fbffa-07e2-40c4-92b1-8531dbe8b687] Disconnected iSCSI Volume {{(pid=75226) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 17 01:34:58 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-64d874c4-047b-4317-9a3d-da49d69b421a tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Acquiring lock "3018e3a2-01e0-49d7-a960-51718709845a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:34:58 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-64d874c4-047b-4317-9a3d-da49d69b421a tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Lock "3018e3a2-01e0-49d7-a960-51718709845a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:34:58 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-64d874c4-047b-4317-9a3d-da49d69b421a tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Acquiring lock "3018e3a2-01e0-49d7-a960-51718709845a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:34:58 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-64d874c4-047b-4317-9a3d-da49d69b421a tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Lock "3018e3a2-01e0-49d7-a960-51718709845a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:34:58 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-64d874c4-047b-4317-9a3d-da49d69b421a tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Lock "3018e3a2-01e0-49d7-a960-51718709845a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:34:58 user nova-compute[75226]: INFO nova.compute.manager [None req-64d874c4-047b-4317-9a3d-da49d69b421a tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 3018e3a2-01e0-49d7-a960-51718709845a] Terminating instance
Nov 17 01:34:58 user nova-compute[75226]: DEBUG nova.compute.manager [None req-64d874c4-047b-4317-9a3d-da49d69b421a tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 3018e3a2-01e0-49d7-a960-51718709845a] Start destroying the instance on the hypervisor. {{(pid=75226) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 17 01:34:58 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:34:59 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:34:59 user nova-compute[75226]: DEBUG nova.compute.manager [req-d15db83d-d902-47ed-8321-93c507ca1fbc req-c05dfe75-f3da-4770-bab8-f3376b074a7b service nova] [instance: 3018e3a2-01e0-49d7-a960-51718709845a] Received event network-vif-unplugged-f05fa2a1-b61b-4617-b895-8c75645bde94 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:34:59 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-d15db83d-d902-47ed-8321-93c507ca1fbc req-c05dfe75-f3da-4770-bab8-f3376b074a7b service nova] Acquiring lock "3018e3a2-01e0-49d7-a960-51718709845a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:34:59 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-d15db83d-d902-47ed-8321-93c507ca1fbc req-c05dfe75-f3da-4770-bab8-f3376b074a7b service nova] Lock "3018e3a2-01e0-49d7-a960-51718709845a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:34:59 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-d15db83d-d902-47ed-8321-93c507ca1fbc req-c05dfe75-f3da-4770-bab8-f3376b074a7b service nova] Lock "3018e3a2-01e0-49d7-a960-51718709845a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:34:59 user nova-compute[75226]: DEBUG nova.compute.manager [req-d15db83d-d902-47ed-8321-93c507ca1fbc req-c05dfe75-f3da-4770-bab8-f3376b074a7b service nova] [instance: 3018e3a2-01e0-49d7-a960-51718709845a] No waiting events found dispatching network-vif-unplugged-f05fa2a1-b61b-4617-b895-8c75645bde94 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:34:59 user nova-compute[75226]: DEBUG nova.compute.manager [req-d15db83d-d902-47ed-8321-93c507ca1fbc req-c05dfe75-f3da-4770-bab8-f3376b074a7b service nova] [instance: 3018e3a2-01e0-49d7-a960-51718709845a] Received event network-vif-unplugged-f05fa2a1-b61b-4617-b895-8c75645bde94 for instance with task_state deleting. {{(pid=75226) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 17 01:34:59 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:34:59 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:34:59 user nova-compute[75226]: DEBUG nova.objects.instance [None req-b48bad02-f734-449d-8f2e-bb26eb014fe0 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Lazy-loading 'flavor' on Instance uuid c11fbffa-07e2-40c4-92b1-8531dbe8b687 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:34:59 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-b48bad02-f734-449d-8f2e-bb26eb014fe0 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Lock "c11fbffa-07e2-40c4-92b1-8531dbe8b687" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.739s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:34:59 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:34:59 user nova-compute[75226]: INFO nova.virt.libvirt.driver [-] [instance: 3018e3a2-01e0-49d7-a960-51718709845a] Instance destroyed successfully.
Nov 17 01:34:59 user nova-compute[75226]: DEBUG nova.objects.instance [None req-64d874c4-047b-4317-9a3d-da49d69b421a tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Lazy-loading 'resources' on Instance uuid 3018e3a2-01e0-49d7-a960-51718709845a {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:34:59 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-64d874c4-047b-4317-9a3d-da49d69b421a tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:29:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-324711233',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-324711233',id=29,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-17T01:31:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e6cb6f679ee4468d82cc7fb5d0f67be9',ramdisk_id='',reservation_id='r-vgzgiogg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-76498640',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T01:33:13Z,user_data=None,user_id='1b793ce05bf44b939a9fb5a914a04cb0',uuid=3018e3a2-01e0-49d7-a960-51718709845a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f05fa2a1-b61b-4617-b895-8c75645bde94", "address": "fa:16:3e:0b:9b:f6", "network": {"id": "450540a3-ff7e-42fb-a0a6-808acd749943", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1503678778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6cb6f679ee4468d82cc7fb5d0f67be9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf05fa2a1-b6", "ovs_interfaceid": "f05fa2a1-b61b-4617-b895-8c75645bde94", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 17 01:34:59 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-64d874c4-047b-4317-9a3d-da49d69b421a tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Converting VIF {"id": "f05fa2a1-b61b-4617-b895-8c75645bde94", "address": "fa:16:3e:0b:9b:f6", "network": {"id": "450540a3-ff7e-42fb-a0a6-808acd749943", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1503678778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6cb6f679ee4468d82cc7fb5d0f67be9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf05fa2a1-b6", "ovs_interfaceid": "f05fa2a1-b61b-4617-b895-8c75645bde94", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:34:59 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-64d874c4-047b-4317-9a3d-da49d69b421a tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0b:9b:f6,bridge_name='br-int',has_traffic_filtering=True,id=f05fa2a1-b61b-4617-b895-8c75645bde94,network=Network(450540a3-ff7e-42fb-a0a6-808acd749943),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf05fa2a1-b6') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:34:59 user nova-compute[75226]: DEBUG os_vif [None req-64d874c4-047b-4317-9a3d-da49d69b421a tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0b:9b:f6,bridge_name='br-int',has_traffic_filtering=True,id=f05fa2a1-b61b-4617-b895-8c75645bde94,network=Network(450540a3-ff7e-42fb-a0a6-808acd749943),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf05fa2a1-b6') {{(pid=75226) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 17 01:34:59 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:34:59 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf05fa2a1-b6, bridge=br-int, if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:34:59 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:34:59 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:34:59 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:34:59 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1b801603-d8e0-4b0e-aee0-4b2bfb35ee3b) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:34:59 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:34:59 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:34:59 user nova-compute[75226]: INFO os_vif [None req-64d874c4-047b-4317-9a3d-da49d69b421a tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0b:9b:f6,bridge_name='br-int',has_traffic_filtering=True,id=f05fa2a1-b61b-4617-b895-8c75645bde94,network=Network(450540a3-ff7e-42fb-a0a6-808acd749943),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf05fa2a1-b6')
Nov 17 01:34:59 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-64d874c4-047b-4317-9a3d-da49d69b421a tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 3018e3a2-01e0-49d7-a960-51718709845a] calling os-brick to detach iSCSI Volume {{(pid=75226) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 17 01:34:59 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-64d874c4-047b-4317-9a3d-da49d69b421a tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc4cc36b490>, {'target_iqn': 'iqn.2010-10.org.openstack:05f878e5-0241-4282-8b2c-c4651c429dcb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zIwQLnvm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:34:59 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-64d874c4-047b-4317-9a3d-da49d69b421a tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:34:59 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-64d874c4-047b-4317-9a3d-da49d69b421a tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:34:59 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-64d874c4-047b-4317-9a3d-da49d69b421a tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:34:59 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:34:59 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:34:59 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[00aa5ea1-ae50-41fd-a5ce-f329eb5e1c22]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:05f878e5-0241-4282-8b2c-c4651c429dcb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:34:59 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-64d874c4-047b-4317-9a3d-da49d69b421a tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 17 01:34:59 user nova-compute[75226]: No targets found.
Nov 17 01:34:59 user nova-compute[75226]: iSNS:
Nov 17 01:34:59 user nova-compute[75226]: No targets found.
Nov 17 01:34:59 user nova-compute[75226]: STATIC:
Nov 17 01:34:59 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:05f878e5-0241-4282-8b2c-c4651c429dcb
Nov 17 01:34:59 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:34:59 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:34:59 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8
Nov 17 01:34:59 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:34:59 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:34:59 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419
Nov 17 01:34:59 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:34:59 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:34:59 user nova-compute[75226]: FIRMWARE:
Nov 17 01:34:59 user nova-compute[75226]: No targets found.
Nov 17 01:34:59 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:34:59 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-64d874c4-047b-4317-9a3d-da49d69b421a tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 17 01:34:59 user nova-compute[75226]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 17 01:34:59 user nova-compute[75226]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75226) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 17 01:34:59 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-64d874c4-047b-4317-9a3d-da49d69b421a tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:05f878e5-0241-4282-8b2c-c4651c429dcb', 0)] {{(pid=75226) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 17 01:34:59 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:34:59 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:34:59 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d338d11-093f-4b82-90a4-8b8a46ddf41f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:05f878e5-0241-4282-8b2c-c4651c429dcb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:34:59 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:34:59 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:34:59 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea2bdcc3-bb7d-4d8d-9ecf-be9309d6b230]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05f878e5-0241-4282-8b2c-c4651c429dcb (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:34:59 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-64d874c4-047b-4317-9a3d-da49d69b421a tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)
Nov 17 01:34:59 user nova-compute[75226]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05f878e5-0241-4282-8b2c-c4651c429dcb (non-flash)
Nov 17 01:34:59 user nova-compute[75226]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419 (non-flash)
Nov 17 01:34:59 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:34:59 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-64d874c4-047b-4317-9a3d-da49d69b421a tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)
Nov 17 01:34:59 user nova-compute[75226]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05f878e5-0241-4282-8b2c-c4651c429dcb (non-flash)
Nov 17 01:34:59 user nova-compute[75226]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419 (non-flash)
Nov 17 01:34:59 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:34:59 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-64d874c4-047b-4317-9a3d-da49d69b421a tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc4d41f5240>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:05f878e5-0241-4282-8b2c-c4651c429dcb'): ({'sde'}, set())}) {{(pid=75226) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 17 01:34:59 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-64d874c4-047b-4317-9a3d-da49d69b421a tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Removing single pathed devices sde {{(pid=75226) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 17 01:34:59 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:34:59 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:34:59 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c131a05-8a20-41b0-9a3a-661880dde267]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:34:59 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:34:59 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:34:59 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[a20b750e-d4da-427f-ae19-c0c555f8c8ba]: (4, ('ok\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:34:59 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-64d874c4-047b-4317-9a3d-da49d69b421a tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Flushing IO for device /dev/sde {{(pid=75226) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 17 01:34:59 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:34:59 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:34:59 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4812043-a545-408a-bb8c-39a9720b3754]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:34:59 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-64d874c4-047b-4317-9a3d-da49d69b421a tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75226) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 17 01:34:59 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:34:59 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.046s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:34:59 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[53b34e96-9f63-47b3-804d-d80dce3c58e4]: (4, ('1', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:34:59 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-64d874c4-047b-4317-9a3d-da49d69b421a tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75226) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 17 01:34:59 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-64d874c4-047b-4317-9a3d-da49d69b421a tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] SCSI volumes sde have been removed. {{(pid=75226) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 17 01:34:59 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-64d874c4-047b-4317-9a3d-da49d69b421a tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:05f878e5-0241-4282-8b2c-c4651c429dcb')] {{(pid=75226) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 17 01:34:59 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05f878e5-0241-4282-8b2c-c4651c429dcb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:34:59 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05f878e5-0241-4282-8b2c-c4651c429dcb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:34:59 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6ad132b-238f-4e08-b2be-ee5b2afa05bb]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:34:59 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-64d874c4-047b-4317-9a3d-da49d69b421a tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:34:59 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05f878e5-0241-4282-8b2c-c4651c429dcb -p 172.16.0.220:3260 --logout {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:34:59 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05f878e5-0241-4282-8b2c-c4651c429dcb -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:34:59 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[44a8bf74-b6be-4961-9f2b-5978dde517af]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:05f878e5-0241-4282-8b2c-c4651c429dcb, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:05f878e5-0241-4282-8b2c-c4651c429dcb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:34:59 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-64d874c4-047b-4317-9a3d-da49d69b421a tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:05f878e5-0241-4282-8b2c-c4651c429dcb, portal: 172.16.0.220,3260]
Nov 17 01:34:59 user nova-compute[75226]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:05f878e5-0241-4282-8b2c-c4651c429dcb, portal: 172.16.0.220,3260] successful.
Nov 17 01:34:59 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:34:59 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05f878e5-0241-4282-8b2c-c4651c429dcb -p 172.16.0.220:3260 --op delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:35:00 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05f878e5-0241-4282-8b2c-c4651c429dcb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:35:00 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[82ea1724-16cc-4fb8-bc1f-e67f6b096cce]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:35:00 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-64d874c4-047b-4317-9a3d-da49d69b421a tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:35:00 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-64d874c4-047b-4317-9a3d-da49d69b421a tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.306s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:35:00 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-64d874c4-047b-4317-9a3d-da49d69b421a tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] <== disconnect_volume: return (307ms) None {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:35:00 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-64d874c4-047b-4317-9a3d-da49d69b421a tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 3018e3a2-01e0-49d7-a960-51718709845a] Disconnected iSCSI Volume {{(pid=75226) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 17 01:35:00 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-64d874c4-047b-4317-9a3d-da49d69b421a tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 3018e3a2-01e0-49d7-a960-51718709845a] Deleting instance files /opt/stack/data/nova/instances/3018e3a2-01e0-49d7-a960-51718709845a_del
Nov 17 01:35:00 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-64d874c4-047b-4317-9a3d-da49d69b421a tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 3018e3a2-01e0-49d7-a960-51718709845a] Deletion of /opt/stack/data/nova/instances/3018e3a2-01e0-49d7-a960-51718709845a_del complete
Nov 17 01:35:00 user nova-compute[75226]: INFO nova.compute.manager [None req-64d874c4-047b-4317-9a3d-da49d69b421a tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 3018e3a2-01e0-49d7-a960-51718709845a] Took 1.17 seconds to destroy the instance on the hypervisor.
Nov 17 01:35:00 user nova-compute[75226]: DEBUG oslo.service.loopingcall [None req-64d874c4-047b-4317-9a3d-da49d69b421a tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75226) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 17 01:35:00 user nova-compute[75226]: DEBUG nova.compute.manager [-] [instance: 3018e3a2-01e0-49d7-a960-51718709845a] Deallocating network for instance {{(pid=75226) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 17 01:35:00 user nova-compute[75226]: DEBUG nova.network.neutron [-] [instance: 3018e3a2-01e0-49d7-a960-51718709845a] deallocate_for_instance() {{(pid=75226) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 17 01:35:00 user nova-compute[75226]: DEBUG nova.network.neutron [-] [instance: 3018e3a2-01e0-49d7-a960-51718709845a] Updating instance_info_cache with network_info: [] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:35:00 user nova-compute[75226]: INFO nova.compute.manager [-] [instance: 3018e3a2-01e0-49d7-a960-51718709845a] Took 0.46 seconds to deallocate network for instance.
Nov 17 01:35:00 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-28d51e59-162e-4b20-99a6-9a53e2df9ee7 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Acquiring lock "c11fbffa-07e2-40c4-92b1-8531dbe8b687" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:35:00 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-28d51e59-162e-4b20-99a6-9a53e2df9ee7 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Lock "c11fbffa-07e2-40c4-92b1-8531dbe8b687" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:35:00 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-28d51e59-162e-4b20-99a6-9a53e2df9ee7 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Acquiring lock "c11fbffa-07e2-40c4-92b1-8531dbe8b687-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:35:00 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-28d51e59-162e-4b20-99a6-9a53e2df9ee7 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Lock "c11fbffa-07e2-40c4-92b1-8531dbe8b687-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:35:00 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-28d51e59-162e-4b20-99a6-9a53e2df9ee7 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Lock "c11fbffa-07e2-40c4-92b1-8531dbe8b687-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:35:00 user nova-compute[75226]: INFO nova.compute.manager [None req-28d51e59-162e-4b20-99a6-9a53e2df9ee7 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] [instance: c11fbffa-07e2-40c4-92b1-8531dbe8b687] Terminating instance
Nov 17 01:35:00 user nova-compute[75226]: DEBUG nova.compute.manager [None req-28d51e59-162e-4b20-99a6-9a53e2df9ee7 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] [instance: c11fbffa-07e2-40c4-92b1-8531dbe8b687] Start destroying the instance on the hypervisor. {{(pid=75226) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 17 01:35:00 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:35:00 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:35:00 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:35:00 user nova-compute[75226]: DEBUG nova.compute.manager [req-f57cdaa3-7e47-4ea1-8649-35522e705db9 req-c3b6acf7-cdea-466f-9224-568db40fa9b5 service nova] [instance: c11fbffa-07e2-40c4-92b1-8531dbe8b687] Received event network-vif-unplugged-325d11f4-b841-44c8-8a19-bdccb1d8cfd1 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:35:00 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-f57cdaa3-7e47-4ea1-8649-35522e705db9 req-c3b6acf7-cdea-466f-9224-568db40fa9b5 service nova] Acquiring lock "c11fbffa-07e2-40c4-92b1-8531dbe8b687-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:35:00 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-f57cdaa3-7e47-4ea1-8649-35522e705db9 req-c3b6acf7-cdea-466f-9224-568db40fa9b5 service nova] Lock "c11fbffa-07e2-40c4-92b1-8531dbe8b687-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:35:00 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-f57cdaa3-7e47-4ea1-8649-35522e705db9 req-c3b6acf7-cdea-466f-9224-568db40fa9b5 service nova] Lock "c11fbffa-07e2-40c4-92b1-8531dbe8b687-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:35:00 user nova-compute[75226]: DEBUG nova.compute.manager [req-f57cdaa3-7e47-4ea1-8649-35522e705db9 req-c3b6acf7-cdea-466f-9224-568db40fa9b5 service nova] [instance: c11fbffa-07e2-40c4-92b1-8531dbe8b687] No waiting events found dispatching network-vif-unplugged-325d11f4-b841-44c8-8a19-bdccb1d8cfd1 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:35:00 user nova-compute[75226]: DEBUG nova.compute.manager [req-f57cdaa3-7e47-4ea1-8649-35522e705db9 req-c3b6acf7-cdea-466f-9224-568db40fa9b5 service nova] [instance: c11fbffa-07e2-40c4-92b1-8531dbe8b687] Received event network-vif-unplugged-325d11f4-b841-44c8-8a19-bdccb1d8cfd1 for instance with task_state deleting. {{(pid=75226) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 17 01:35:01 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:35:01 user nova-compute[75226]: DEBUG nova.compute.manager [req-7077fca0-9187-478f-8ea5-71f2fb124531 req-0e6eb075-3c24-4124-9985-39d5fa2abb63 service nova] [instance: 3018e3a2-01e0-49d7-a960-51718709845a] Received event network-vif-plugged-f05fa2a1-b61b-4617-b895-8c75645bde94 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:35:01 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-7077fca0-9187-478f-8ea5-71f2fb124531 req-0e6eb075-3c24-4124-9985-39d5fa2abb63 service nova] Acquiring lock "3018e3a2-01e0-49d7-a960-51718709845a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:35:01 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-7077fca0-9187-478f-8ea5-71f2fb124531 req-0e6eb075-3c24-4124-9985-39d5fa2abb63 service nova] Lock "3018e3a2-01e0-49d7-a960-51718709845a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:35:01 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-7077fca0-9187-478f-8ea5-71f2fb124531 req-0e6eb075-3c24-4124-9985-39d5fa2abb63 service nova] Lock "3018e3a2-01e0-49d7-a960-51718709845a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:35:01 user nova-compute[75226]: DEBUG nova.compute.manager [req-7077fca0-9187-478f-8ea5-71f2fb124531 req-0e6eb075-3c24-4124-9985-39d5fa2abb63 service nova] [instance: 3018e3a2-01e0-49d7-a960-51718709845a] No waiting events found dispatching network-vif-plugged-f05fa2a1-b61b-4617-b895-8c75645bde94 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:35:01 user nova-compute[75226]: WARNING nova.compute.manager [req-7077fca0-9187-478f-8ea5-71f2fb124531 req-0e6eb075-3c24-4124-9985-39d5fa2abb63 service nova] [instance: 3018e3a2-01e0-49d7-a960-51718709845a] Received unexpected event network-vif-plugged-f05fa2a1-b61b-4617-b895-8c75645bde94 for instance with vm_state active and task_state deleting.
Nov 17 01:35:01 user nova-compute[75226]: DEBUG nova.compute.manager [req-7077fca0-9187-478f-8ea5-71f2fb124531 req-0e6eb075-3c24-4124-9985-39d5fa2abb63 service nova] [instance: 3018e3a2-01e0-49d7-a960-51718709845a] Received event network-vif-deleted-f05fa2a1-b61b-4617-b895-8c75645bde94 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:35:01 user nova-compute[75226]: INFO nova.compute.manager [None req-64d874c4-047b-4317-9a3d-da49d69b421a tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 3018e3a2-01e0-49d7-a960-51718709845a] Took 0.73 seconds to detach 1 volumes for instance.
Nov 17 01:35:01 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-64d874c4-047b-4317-9a3d-da49d69b421a tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:35:01 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-64d874c4-047b-4317-9a3d-da49d69b421a tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:35:01 user nova-compute[75226]: INFO nova.virt.libvirt.driver [-] [instance: c11fbffa-07e2-40c4-92b1-8531dbe8b687] Instance destroyed successfully.
Nov 17 01:35:01 user nova-compute[75226]: DEBUG nova.objects.instance [None req-28d51e59-162e-4b20-99a6-9a53e2df9ee7 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Lazy-loading 'resources' on Instance uuid c11fbffa-07e2-40c4-92b1-8531dbe8b687 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:35:01 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-28d51e59-162e-4b20-99a6-9a53e2df9ee7 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:31:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-272679960',display_name='tempest-AttachVolumeTestJSON-server-272679960',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-272679960',id=32,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL2DydS5B2Smzu9SpLhv4GJZVB8BFUGnLWtyejkStib/wW9Am/YgjXYWichtaaKD2Ji75s6W7ULIOuvASfS68HQNeuyGVJrb6V/A9K7Mko9DQsSLEUzBtAxegePG83Lf5A==',key_name='tempest-keypair-969699449',keypairs=<?>,launch_index=0,launched_at=2023-11-17T01:32:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='054575d3dc66452091173b4c604b8c96',ramdisk_id='',reservation_id='r-9r3w0z00',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-223132631',owner_user_name='tempest-AttachVolumeTestJSON-223132631-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T01:32:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c30381a66814427ba39e21c024136fee',uuid=c11fbffa-07e2-40c4-92b1-8531dbe8b687,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "325d11f4-b841-44c8-8a19-bdccb1d8cfd1", "address": "fa:16:3e:06:46:c3", "network": {"id": "c93f11a7-52c6-4379-a1fb-9a002876c221", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-985502177-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "054575d3dc66452091173b4c604b8c96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap325d11f4-b8", "ovs_interfaceid": "325d11f4-b841-44c8-8a19-bdccb1d8cfd1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 17 01:35:01 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-28d51e59-162e-4b20-99a6-9a53e2df9ee7 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Converting VIF {"id": "325d11f4-b841-44c8-8a19-bdccb1d8cfd1", "address": "fa:16:3e:06:46:c3", "network": {"id": "c93f11a7-52c6-4379-a1fb-9a002876c221", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-985502177-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "054575d3dc66452091173b4c604b8c96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap325d11f4-b8", "ovs_interfaceid": "325d11f4-b841-44c8-8a19-bdccb1d8cfd1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:35:01 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-28d51e59-162e-4b20-99a6-9a53e2df9ee7 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:06:46:c3,bridge_name='br-int',has_traffic_filtering=True,id=325d11f4-b841-44c8-8a19-bdccb1d8cfd1,network=Network(c93f11a7-52c6-4379-a1fb-9a002876c221),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap325d11f4-b8') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:35:01 user nova-compute[75226]: DEBUG os_vif [None req-28d51e59-162e-4b20-99a6-9a53e2df9ee7 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:06:46:c3,bridge_name='br-int',has_traffic_filtering=True,id=325d11f4-b841-44c8-8a19-bdccb1d8cfd1,network=Network(c93f11a7-52c6-4379-a1fb-9a002876c221),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap325d11f4-b8') {{(pid=75226) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 17 01:35:01 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:35:01 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap325d11f4-b8, bridge=br-int, if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:35:01 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:35:01 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:35:01 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:35:01 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=78d36c24-6151-4510-9c4e-c73ef482e979) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:35:01 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:35:01 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:35:01 user nova-compute[75226]: INFO os_vif [None req-28d51e59-162e-4b20-99a6-9a53e2df9ee7 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:06:46:c3,bridge_name='br-int',has_traffic_filtering=True,id=325d11f4-b841-44c8-8a19-bdccb1d8cfd1,network=Network(c93f11a7-52c6-4379-a1fb-9a002876c221),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap325d11f4-b8')
Nov 17 01:35:01 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-28d51e59-162e-4b20-99a6-9a53e2df9ee7 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] [instance: c11fbffa-07e2-40c4-92b1-8531dbe8b687] Deleting instance files /opt/stack/data/nova/instances/c11fbffa-07e2-40c4-92b1-8531dbe8b687_del
Nov 17 01:35:01 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-28d51e59-162e-4b20-99a6-9a53e2df9ee7 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] [instance: c11fbffa-07e2-40c4-92b1-8531dbe8b687] Deletion of /opt/stack/data/nova/instances/c11fbffa-07e2-40c4-92b1-8531dbe8b687_del complete
Nov 17 01:35:01 user nova-compute[75226]: INFO nova.compute.manager [None req-28d51e59-162e-4b20-99a6-9a53e2df9ee7 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] [instance: c11fbffa-07e2-40c4-92b1-8531dbe8b687] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 17 01:35:01 user nova-compute[75226]: DEBUG oslo.service.loopingcall [None req-28d51e59-162e-4b20-99a6-9a53e2df9ee7 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75226) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 17 01:35:01 user nova-compute[75226]: DEBUG nova.compute.manager [-] [instance: c11fbffa-07e2-40c4-92b1-8531dbe8b687] Deallocating network for instance {{(pid=75226) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 17 01:35:01 user nova-compute[75226]: DEBUG nova.network.neutron [-] [instance: c11fbffa-07e2-40c4-92b1-8531dbe8b687] deallocate_for_instance() {{(pid=75226) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 17 01:35:01 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-64d874c4-047b-4317-9a3d-da49d69b421a tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:35:01 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-64d874c4-047b-4317-9a3d-da49d69b421a tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:35:01 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-64d874c4-047b-4317-9a3d-da49d69b421a tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.406s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:35:01 user nova-compute[75226]: INFO nova.scheduler.client.report [None req-64d874c4-047b-4317-9a3d-da49d69b421a tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Deleted allocations for instance 3018e3a2-01e0-49d7-a960-51718709845a
Nov 17 01:35:01 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-64d874c4-047b-4317-9a3d-da49d69b421a tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Lock "3018e3a2-01e0-49d7-a960-51718709845a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.965s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:35:02 user nova-compute[75226]: DEBUG nova.network.neutron [-] [instance: c11fbffa-07e2-40c4-92b1-8531dbe8b687] Updating instance_info_cache with network_info: [] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:35:02 user nova-compute[75226]: INFO nova.compute.manager [-] [instance: c11fbffa-07e2-40c4-92b1-8531dbe8b687] Took 0.76 seconds to deallocate network for instance.
Nov 17 01:35:02 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-28d51e59-162e-4b20-99a6-9a53e2df9ee7 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:35:02 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-28d51e59-162e-4b20-99a6-9a53e2df9ee7 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:35:02 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-28d51e59-162e-4b20-99a6-9a53e2df9ee7 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:35:02 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-28d51e59-162e-4b20-99a6-9a53e2df9ee7 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:35:02 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-28d51e59-162e-4b20-99a6-9a53e2df9ee7 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.306s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:35:02 user nova-compute[75226]: INFO nova.scheduler.client.report [None req-28d51e59-162e-4b20-99a6-9a53e2df9ee7 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Deleted allocations for instance c11fbffa-07e2-40c4-92b1-8531dbe8b687
Nov 17 01:35:02 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-28d51e59-162e-4b20-99a6-9a53e2df9ee7 tempest-AttachVolumeTestJSON-223132631 tempest-AttachVolumeTestJSON-223132631-project-member] Lock "c11fbffa-07e2-40c4-92b1-8531dbe8b687" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.130s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:35:02 user nova-compute[75226]: DEBUG nova.compute.manager [req-c3b316bd-a12c-42c5-abd6-79e755fb7ce8 req-2fed28a1-1e25-4cec-9b8c-7887a07aca94 service nova] [instance: c11fbffa-07e2-40c4-92b1-8531dbe8b687] Received event network-vif-plugged-325d11f4-b841-44c8-8a19-bdccb1d8cfd1 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:35:02 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-c3b316bd-a12c-42c5-abd6-79e755fb7ce8 req-2fed28a1-1e25-4cec-9b8c-7887a07aca94 service nova] Acquiring lock "c11fbffa-07e2-40c4-92b1-8531dbe8b687-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:35:02 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-c3b316bd-a12c-42c5-abd6-79e755fb7ce8 req-2fed28a1-1e25-4cec-9b8c-7887a07aca94 service nova] Lock "c11fbffa-07e2-40c4-92b1-8531dbe8b687-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:35:02 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-c3b316bd-a12c-42c5-abd6-79e755fb7ce8 req-2fed28a1-1e25-4cec-9b8c-7887a07aca94 service nova] Lock "c11fbffa-07e2-40c4-92b1-8531dbe8b687-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:35:02 user nova-compute[75226]: DEBUG nova.compute.manager [req-c3b316bd-a12c-42c5-abd6-79e755fb7ce8 req-2fed28a1-1e25-4cec-9b8c-7887a07aca94 service nova] [instance: c11fbffa-07e2-40c4-92b1-8531dbe8b687] No waiting events found dispatching network-vif-plugged-325d11f4-b841-44c8-8a19-bdccb1d8cfd1 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:35:02 user nova-compute[75226]: WARNING nova.compute.manager [req-c3b316bd-a12c-42c5-abd6-79e755fb7ce8 req-2fed28a1-1e25-4cec-9b8c-7887a07aca94 service nova] [instance: c11fbffa-07e2-40c4-92b1-8531dbe8b687] Received unexpected event network-vif-plugged-325d11f4-b841-44c8-8a19-bdccb1d8cfd1 for instance with vm_state deleted and task_state None.
Nov 17 01:35:03 user nova-compute[75226]: DEBUG nova.compute.manager [req-dcfd7138-f0bb-45d6-b93e-238ef97cefd1 req-d8cbb0d7-92a6-44e7-b7f1-1a993f5ab1f6 service nova] [instance: c11fbffa-07e2-40c4-92b1-8531dbe8b687] Received event network-vif-deleted-325d11f4-b841-44c8-8a19-bdccb1d8cfd1 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:35:05 user nova-compute[75226]: DEBUG nova.compute.manager [req-6576c51f-4dd1-415c-a558-fb099068f442 req-013dda61-f4ed-4db3-9bdf-e84569c02218 service nova] [instance: 38062487-67ca-4962-974f-81456aebe97b] Received event network-changed-b4bb80f3-212b-41bf-94a3-442865a852c7 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:35:05 user nova-compute[75226]: DEBUG nova.compute.manager [req-6576c51f-4dd1-415c-a558-fb099068f442 req-013dda61-f4ed-4db3-9bdf-e84569c02218 service nova] [instance: 38062487-67ca-4962-974f-81456aebe97b] Refreshing instance network info cache due to event network-changed-b4bb80f3-212b-41bf-94a3-442865a852c7. {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 01:35:05 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-6576c51f-4dd1-415c-a558-fb099068f442 req-013dda61-f4ed-4db3-9bdf-e84569c02218 service nova] Acquiring lock "refresh_cache-38062487-67ca-4962-974f-81456aebe97b" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:35:05 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-6576c51f-4dd1-415c-a558-fb099068f442 req-013dda61-f4ed-4db3-9bdf-e84569c02218 service nova] Acquired lock "refresh_cache-38062487-67ca-4962-974f-81456aebe97b" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:35:05 user nova-compute[75226]: DEBUG nova.network.neutron [req-6576c51f-4dd1-415c-a558-fb099068f442 req-013dda61-f4ed-4db3-9bdf-e84569c02218 service nova] [instance: 38062487-67ca-4962-974f-81456aebe97b] Refreshing network info cache for port b4bb80f3-212b-41bf-94a3-442865a852c7 {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 01:35:05 user nova-compute[75226]: DEBUG nova.network.neutron [req-6576c51f-4dd1-415c-a558-fb099068f442 req-013dda61-f4ed-4db3-9bdf-e84569c02218 service nova] [instance: 38062487-67ca-4962-974f-81456aebe97b] Updated VIF entry in instance network info cache for port b4bb80f3-212b-41bf-94a3-442865a852c7. {{(pid=75226) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 01:35:05 user nova-compute[75226]: DEBUG nova.network.neutron [req-6576c51f-4dd1-415c-a558-fb099068f442 req-013dda61-f4ed-4db3-9bdf-e84569c02218 service nova] [instance: 38062487-67ca-4962-974f-81456aebe97b] Updating instance_info_cache with network_info: [{"id": "b4bb80f3-212b-41bf-94a3-442865a852c7", "address": "fa:16:3e:ef:fd:97", "network": {"id": "9f39d3e5-b106-4bd9-b8ba-0f326e89c481", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-675861281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9042fe4ecc245dd97553f6e942c3e05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4bb80f3-21", "ovs_interfaceid": "b4bb80f3-212b-41bf-94a3-442865a852c7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:35:05 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-6576c51f-4dd1-415c-a558-fb099068f442 req-013dda61-f4ed-4db3-9bdf-e84569c02218 service nova] Releasing lock "refresh_cache-38062487-67ca-4962-974f-81456aebe97b" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:35:05 user nova-compute[75226]: DEBUG nova.compute.manager [req-6576c51f-4dd1-415c-a558-fb099068f442 req-013dda61-f4ed-4db3-9bdf-e84569c02218 service nova] [instance: a298d980-feed-4530-9499-f2833b404dcd] Received event network-changed-301235a9-5ec1-41f4-8e43-9dc7b20e872d {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:35:05 user nova-compute[75226]: DEBUG nova.compute.manager [req-6576c51f-4dd1-415c-a558-fb099068f442 req-013dda61-f4ed-4db3-9bdf-e84569c02218 service nova] [instance: a298d980-feed-4530-9499-f2833b404dcd] Refreshing instance network info cache due to event network-changed-301235a9-5ec1-41f4-8e43-9dc7b20e872d. {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 01:35:05 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-6576c51f-4dd1-415c-a558-fb099068f442 req-013dda61-f4ed-4db3-9bdf-e84569c02218 service nova] Acquiring lock "refresh_cache-a298d980-feed-4530-9499-f2833b404dcd" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:35:05 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-6576c51f-4dd1-415c-a558-fb099068f442 req-013dda61-f4ed-4db3-9bdf-e84569c02218 service nova] Acquired lock "refresh_cache-a298d980-feed-4530-9499-f2833b404dcd" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:35:05 user nova-compute[75226]: DEBUG nova.network.neutron [req-6576c51f-4dd1-415c-a558-fb099068f442 req-013dda61-f4ed-4db3-9bdf-e84569c02218 service nova] [instance: a298d980-feed-4530-9499-f2833b404dcd] Refreshing network info cache for port 301235a9-5ec1-41f4-8e43-9dc7b20e872d {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 01:35:05 user nova-compute[75226]: DEBUG nova.compute.manager [None req-b218022e-04f7-4626-9bf3-1e69ccf25619 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: a298d980-feed-4530-9499-f2833b404dcd] Stashing vm_state: active {{(pid=75226) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 17 01:35:05 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-b218022e-04f7-4626-9bf3-1e69ccf25619 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:35:05 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-b218022e-04f7-4626-9bf3-1e69ccf25619 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:35:05 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-b218022e-04f7-4626-9bf3-1e69ccf25619 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75226) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 17 01:35:05 user nova-compute[75226]: INFO nova.compute.claims [None req-b218022e-04f7-4626-9bf3-1e69ccf25619 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: a298d980-feed-4530-9499-f2833b404dcd] Claim successful on node user
Nov 17 01:35:06 user nova-compute[75226]: INFO nova.compute.resource_tracker [None req-b218022e-04f7-4626-9bf3-1e69ccf25619 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: a298d980-feed-4530-9499-f2833b404dcd] Updating resource usage from migration b0f48d1c-5955-4eec-b50d-8c2e90f1e86b
Nov 17 01:35:06 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-662d079c-0739-45be-8770-1bf0a87dbfdb tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Acquiring lock "9e8b4b85-fe0c-4592-850e-e94ebab32d02" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:35:06 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-662d079c-0739-45be-8770-1bf0a87dbfdb tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Lock "9e8b4b85-fe0c-4592-850e-e94ebab32d02" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:35:06 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-662d079c-0739-45be-8770-1bf0a87dbfdb tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Acquiring lock "9e8b4b85-fe0c-4592-850e-e94ebab32d02-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:35:06 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-662d079c-0739-45be-8770-1bf0a87dbfdb tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Lock "9e8b4b85-fe0c-4592-850e-e94ebab32d02-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:35:06 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-662d079c-0739-45be-8770-1bf0a87dbfdb tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Lock "9e8b4b85-fe0c-4592-850e-e94ebab32d02-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:35:06 user nova-compute[75226]: INFO nova.compute.manager [None req-662d079c-0739-45be-8770-1bf0a87dbfdb tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] [instance: 9e8b4b85-fe0c-4592-850e-e94ebab32d02] Terminating instance
Nov 17 01:35:06 user nova-compute[75226]: DEBUG nova.compute.manager [None req-662d079c-0739-45be-8770-1bf0a87dbfdb tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] [instance: 9e8b4b85-fe0c-4592-850e-e94ebab32d02] Start destroying the instance on the hypervisor. {{(pid=75226) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 17 01:35:06 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:35:06 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:35:06 user nova-compute[75226]: DEBUG nova.network.neutron [req-6576c51f-4dd1-415c-a558-fb099068f442 req-013dda61-f4ed-4db3-9bdf-e84569c02218 service nova] [instance: a298d980-feed-4530-9499-f2833b404dcd] Updated VIF entry in instance network info cache for port 301235a9-5ec1-41f4-8e43-9dc7b20e872d. {{(pid=75226) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 01:35:06 user nova-compute[75226]: DEBUG nova.network.neutron [req-6576c51f-4dd1-415c-a558-fb099068f442 req-013dda61-f4ed-4db3-9bdf-e84569c02218 service nova] [instance: a298d980-feed-4530-9499-f2833b404dcd] Updating instance_info_cache with network_info: [{"id": "301235a9-5ec1-41f4-8e43-9dc7b20e872d", "address": "fa:16:3e:9a:7d:e3", "network": {"id": "9f39d3e5-b106-4bd9-b8ba-0f326e89c481", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-675861281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9042fe4ecc245dd97553f6e942c3e05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap301235a9-5e", "ovs_interfaceid": "301235a9-5ec1-41f4-8e43-9dc7b20e872d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:35:06 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:35:06 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-6576c51f-4dd1-415c-a558-fb099068f442 req-013dda61-f4ed-4db3-9bdf-e84569c02218 service nova] Releasing lock "refresh_cache-a298d980-feed-4530-9499-f2833b404dcd" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:35:06 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:35:06 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-b218022e-04f7-4626-9bf3-1e69ccf25619 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:35:06 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-b218022e-04f7-4626-9bf3-1e69ccf25619 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:35:06 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-b218022e-04f7-4626-9bf3-1e69ccf25619 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.466s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:35:06 user nova-compute[75226]: INFO nova.compute.manager [None req-b218022e-04f7-4626-9bf3-1e69ccf25619 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: a298d980-feed-4530-9499-f2833b404dcd] Migrating
Nov 17 01:35:06 user nova-compute[75226]: DEBUG nova.compute.manager [req-54dd0d9a-03b0-4832-a75d-44be03abb734 req-915fcb69-9895-4fc2-9963-cc1cdfa8c2dc service nova] [instance: 9e8b4b85-fe0c-4592-850e-e94ebab32d02] Received event network-vif-unplugged-5e4b278c-6c95-4fd1-a215-3fa737694996 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:35:06 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-54dd0d9a-03b0-4832-a75d-44be03abb734 req-915fcb69-9895-4fc2-9963-cc1cdfa8c2dc service nova] Acquiring lock "9e8b4b85-fe0c-4592-850e-e94ebab32d02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:35:06 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-54dd0d9a-03b0-4832-a75d-44be03abb734 req-915fcb69-9895-4fc2-9963-cc1cdfa8c2dc service nova] Lock "9e8b4b85-fe0c-4592-850e-e94ebab32d02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:35:06 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-54dd0d9a-03b0-4832-a75d-44be03abb734 req-915fcb69-9895-4fc2-9963-cc1cdfa8c2dc service nova] Lock "9e8b4b85-fe0c-4592-850e-e94ebab32d02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:35:06 user nova-compute[75226]: DEBUG nova.compute.manager [req-54dd0d9a-03b0-4832-a75d-44be03abb734 req-915fcb69-9895-4fc2-9963-cc1cdfa8c2dc service nova] [instance: 9e8b4b85-fe0c-4592-850e-e94ebab32d02] No waiting events found dispatching network-vif-unplugged-5e4b278c-6c95-4fd1-a215-3fa737694996 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:35:06 user nova-compute[75226]: DEBUG nova.compute.manager [req-54dd0d9a-03b0-4832-a75d-44be03abb734 req-915fcb69-9895-4fc2-9963-cc1cdfa8c2dc service nova] [instance: 9e8b4b85-fe0c-4592-850e-e94ebab32d02] Received event network-vif-unplugged-5e4b278c-6c95-4fd1-a215-3fa737694996 for instance with task_state deleting. {{(pid=75226) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 17 01:35:06 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-b218022e-04f7-4626-9bf3-1e69ccf25619 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Acquiring lock "refresh_cache-a298d980-feed-4530-9499-f2833b404dcd" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:35:06 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-b218022e-04f7-4626-9bf3-1e69ccf25619 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Acquired lock "refresh_cache-a298d980-feed-4530-9499-f2833b404dcd" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:35:06 user nova-compute[75226]: DEBUG nova.network.neutron [None req-b218022e-04f7-4626-9bf3-1e69ccf25619 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: a298d980-feed-4530-9499-f2833b404dcd] Building network info cache for instance {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 01:35:06 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:35:06 user nova-compute[75226]: INFO nova.virt.libvirt.driver [-] [instance: 9e8b4b85-fe0c-4592-850e-e94ebab32d02] Instance destroyed successfully.
Nov 17 01:35:06 user nova-compute[75226]: DEBUG nova.objects.instance [None req-662d079c-0739-45be-8770-1bf0a87dbfdb tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Lazy-loading 'resources' on Instance uuid 9e8b4b85-fe0c-4592-850e-e94ebab32d02 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:35:06 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-662d079c-0739-45be-8770-1bf0a87dbfdb tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-17T01:29:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1781762170',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1781762170',id=30,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBInpuqctZcqeDjLntMDMraUaJnVrPY8pPnhF46vZo3b7GDKJsBT1VrkDCJZFNBJMLuoREZPGY4+/LAEQRLwrF9f1fdd8Jnq+YiZ8Dyk1mvtijZcX6ZVdxHElsfADTqm07w==',key_name='tempest-keypair-1121562331',keypairs=<?>,launch_index=0,launched_at=2023-11-17T01:33:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1fcdc65b510141e9b7c9a01401a97448',ramdisk_id='',reservation_id='r-b0wngs1h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1321076871',owner_user_name='tempest-AttachVolumeShelveTestJSON-1321076871-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T01:33:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2adb9c6cd5c443a7993f6f9d09da6346',uuid=9e8b4b85-fe0c-4592-850e-e94ebab32d02,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5e4b278c-6c95-4fd1-a215-3fa737694996", "address": "fa:16:3e:b6:d6:ba", "network": {"id": "72724945-89ae-47c2-ac58-ea393837ada6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-308563626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fcdc65b510141e9b7c9a01401a97448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e4b278c-6c", "ovs_interfaceid": "5e4b278c-6c95-4fd1-a215-3fa737694996", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 17 01:35:06 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-662d079c-0739-45be-8770-1bf0a87dbfdb tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Converting VIF {"id": "5e4b278c-6c95-4fd1-a215-3fa737694996", "address": "fa:16:3e:b6:d6:ba", "network": {"id": "72724945-89ae-47c2-ac58-ea393837ada6", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-308563626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fcdc65b510141e9b7c9a01401a97448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e4b278c-6c", "ovs_interfaceid": "5e4b278c-6c95-4fd1-a215-3fa737694996", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:35:06 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-662d079c-0739-45be-8770-1bf0a87dbfdb tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:d6:ba,bridge_name='br-int',has_traffic_filtering=True,id=5e4b278c-6c95-4fd1-a215-3fa737694996,network=Network(72724945-89ae-47c2-ac58-ea393837ada6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e4b278c-6c') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:35:06 user nova-compute[75226]: DEBUG os_vif [None req-662d079c-0739-45be-8770-1bf0a87dbfdb tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:d6:ba,bridge_name='br-int',has_traffic_filtering=True,id=5e4b278c-6c95-4fd1-a215-3fa737694996,network=Network(72724945-89ae-47c2-ac58-ea393837ada6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e4b278c-6c') {{(pid=75226) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 17 01:35:06 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:35:06 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5e4b278c-6c, bridge=br-int, if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:35:06 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:35:06 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:35:06 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:35:06 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=28358dd7-5733-4665-85f4-c7dcb17d5f9e) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:35:06 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:35:06 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:35:06 user nova-compute[75226]: INFO os_vif [None req-662d079c-0739-45be-8770-1bf0a87dbfdb tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:d6:ba,bridge_name='br-int',has_traffic_filtering=True,id=5e4b278c-6c95-4fd1-a215-3fa737694996,network=Network(72724945-89ae-47c2-ac58-ea393837ada6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e4b278c-6c')
Nov 17 01:35:06 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-662d079c-0739-45be-8770-1bf0a87dbfdb tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] [instance: 9e8b4b85-fe0c-4592-850e-e94ebab32d02] Deleting instance files /opt/stack/data/nova/instances/9e8b4b85-fe0c-4592-850e-e94ebab32d02_del
Nov 17 01:35:06 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-662d079c-0739-45be-8770-1bf0a87dbfdb tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] [instance: 9e8b4b85-fe0c-4592-850e-e94ebab32d02] Deletion of /opt/stack/data/nova/instances/9e8b4b85-fe0c-4592-850e-e94ebab32d02_del complete
Nov 17 01:35:06 user nova-compute[75226]: INFO nova.compute.manager [None req-662d079c-0739-45be-8770-1bf0a87dbfdb tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] [instance: 9e8b4b85-fe0c-4592-850e-e94ebab32d02] Took 0.76 seconds to destroy the instance on the hypervisor.
Nov 17 01:35:06 user nova-compute[75226]: DEBUG oslo.service.loopingcall [None req-662d079c-0739-45be-8770-1bf0a87dbfdb tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75226) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 17 01:35:06 user nova-compute[75226]: DEBUG nova.compute.manager [-] [instance: 9e8b4b85-fe0c-4592-850e-e94ebab32d02] Deallocating network for instance {{(pid=75226) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 17 01:35:06 user nova-compute[75226]: DEBUG nova.network.neutron [-] [instance: 9e8b4b85-fe0c-4592-850e-e94ebab32d02] deallocate_for_instance() {{(pid=75226) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 17 01:35:06 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:35:06 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:35:06 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:35:06 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:35:06 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:35:06 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:35:06 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:35:06 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75226) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 17 01:35:06 user nova-compute[75226]: DEBUG nova.network.neutron [None req-b218022e-04f7-4626-9bf3-1e69ccf25619 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: a298d980-feed-4530-9499-f2833b404dcd] Updating instance_info_cache with network_info: [{"id": "301235a9-5ec1-41f4-8e43-9dc7b20e872d", "address": "fa:16:3e:9a:7d:e3", "network": {"id": "9f39d3e5-b106-4bd9-b8ba-0f326e89c481", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-675861281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9042fe4ecc245dd97553f6e942c3e05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap301235a9-5e", "ovs_interfaceid": "301235a9-5ec1-41f4-8e43-9dc7b20e872d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:35:07 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-b218022e-04f7-4626-9bf3-1e69ccf25619 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Releasing lock "refresh_cache-a298d980-feed-4530-9499-f2833b404dcd" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:35:07 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-b218022e-04f7-4626-9bf3-1e69ccf25619 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: a298d980-feed-4530-9499-f2833b404dcd] Starting migrate_disk_and_power_off {{(pid=75226) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 17 01:35:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa84e575-bdad-45b9-80ce-86b1c2826fb0/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:35:07 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:35:07 user nova-compute[75226]: DEBUG nova.network.neutron [-] [instance: 9e8b4b85-fe0c-4592-850e-e94ebab32d02] Updating instance_info_cache with network_info: [] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:35:07 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:35:07 user nova-compute[75226]: INFO nova.compute.manager [-] [instance: 9e8b4b85-fe0c-4592-850e-e94ebab32d02] Took 0.75 seconds to deallocate network for instance.
Nov 17 01:35:07 user nova-compute[75226]: DEBUG nova.compute.manager [req-1e4100a1-7a04-4fcb-867f-bb8aa5ad9f9e req-1d1fec72-0f65-41b8-86e6-6ae525433b28 service nova] [instance: 9e8b4b85-fe0c-4592-850e-e94ebab32d02] Received event network-vif-deleted-5e4b278c-6c95-4fd1-a215-3fa737694996 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:35:07 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-662d079c-0739-45be-8770-1bf0a87dbfdb tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:35:07 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-662d079c-0739-45be-8770-1bf0a87dbfdb tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:35:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa84e575-bdad-45b9-80ce-86b1c2826fb0/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:35:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa84e575-bdad-45b9-80ce-86b1c2826fb0/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:35:07 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:35:07 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:35:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa84e575-bdad-45b9-80ce-86b1c2826fb0/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:35:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6555d72-6094-4ea9-b071-a3d3c8a300a9/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:35:08 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-662d079c-0739-45be-8770-1bf0a87dbfdb tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:35:08 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-662d079c-0739-45be-8770-1bf0a87dbfdb tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:35:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6555d72-6094-4ea9-b071-a3d3c8a300a9/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:35:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6555d72-6094-4ea9-b071-a3d3c8a300a9/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:35:08 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-662d079c-0739-45be-8770-1bf0a87dbfdb tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.482s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:35:08 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:35:08 user nova-compute[75226]: INFO nova.scheduler.client.report [None req-662d079c-0739-45be-8770-1bf0a87dbfdb tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Deleted allocations for instance 9e8b4b85-fe0c-4592-850e-e94ebab32d02
Nov 17 01:35:08 user nova-compute[75226]: INFO nova.virt.libvirt.driver [-] [instance: a298d980-feed-4530-9499-f2833b404dcd] Instance destroyed successfully.
Nov 17 01:35:08 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-b218022e-04f7-4626-9bf3-1e69ccf25619 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:33:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-652050362',display_name='tempest-ServerActionsTestOtherA-server-652050362',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-652050362',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFcMGt3BPMgKZBdescHicrTnz7kyNBHfMwmrFONg75JAKc8VfRVh1PCQT3W5iiYYT6fcflPeuhtfYyaPi/d36jL88Vz6dOEwhdGgUoOilw3GKb90qUp0hFoOK7faoQkiRg==',key_name='tempest-keypair-1413404210',keypairs=<?>,launch_index=0,launched_at=2023-11-17T01:33:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f9042fe4ecc245dd97553f6e942c3e05',ramdisk_id='',reservation_id='r-e60zxux4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-2125452149',owner_user_name='tempest-ServerActionsTestOtherA-2125452149-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T01:35:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a13dd8231937440185c9fc628c3bd5db',uuid=a298d980-feed-4530-9499-f2833b404dcd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "301235a9-5ec1-41f4-8e43-9dc7b20e872d", "address": "fa:16:3e:9a:7d:e3", "network": {"id": "9f39d3e5-b106-4bd9-b8ba-0f326e89c481", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-675861281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-675861281-network", "vif_mac": "fa:16:3e:9a:7d:e3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9042fe4ecc245dd97553f6e942c3e05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap301235a9-5e", "ovs_interfaceid": "301235a9-5ec1-41f4-8e43-9dc7b20e872d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 17 01:35:08 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-b218022e-04f7-4626-9bf3-1e69ccf25619 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Converting VIF {"id": "301235a9-5ec1-41f4-8e43-9dc7b20e872d", "address": "fa:16:3e:9a:7d:e3", "network": {"id": "9f39d3e5-b106-4bd9-b8ba-0f326e89c481", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-675861281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-675861281-network", "vif_mac": "fa:16:3e:9a:7d:e3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9042fe4ecc245dd97553f6e942c3e05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap301235a9-5e", "ovs_interfaceid": "301235a9-5ec1-41f4-8e43-9dc7b20e872d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:35:08 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-b218022e-04f7-4626-9bf3-1e69ccf25619 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9a:7d:e3,bridge_name='br-int',has_traffic_filtering=True,id=301235a9-5ec1-41f4-8e43-9dc7b20e872d,network=Network(9f39d3e5-b106-4bd9-b8ba-0f326e89c481),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap301235a9-5e') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:35:08 user nova-compute[75226]: DEBUG os_vif [None req-b218022e-04f7-4626-9bf3-1e69ccf25619 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9a:7d:e3,bridge_name='br-int',has_traffic_filtering=True,id=301235a9-5ec1-41f4-8e43-9dc7b20e872d,network=Network(9f39d3e5-b106-4bd9-b8ba-0f326e89c481),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap301235a9-5e') {{(pid=75226) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 17 01:35:08 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:35:08 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap301235a9-5e, bridge=br-int, if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:35:08 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:35:08 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:35:08 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:35:08 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c13e8cd0-354b-41e1-9ad7-0cb352fa2645) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:35:08 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:35:08 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:35:08 user nova-compute[75226]: INFO os_vif [None req-b218022e-04f7-4626-9bf3-1e69ccf25619 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9a:7d:e3,bridge_name='br-int',has_traffic_filtering=True,id=301235a9-5ec1-41f4-8e43-9dc7b20e872d,network=Network(9f39d3e5-b106-4bd9-b8ba-0f326e89c481),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap301235a9-5e')
Nov 17 01:35:08 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b218022e-04f7-4626-9bf3-1e69ccf25619 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: a298d980-feed-4530-9499-f2833b404dcd] calling os-brick to detach iSCSI Volume {{(pid=75226) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 17 01:35:08 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-b218022e-04f7-4626-9bf3-1e69ccf25619 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc4cc36b490>, {'target_iqn': 'iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VUyvFGLr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:35:08 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-b218022e-04f7-4626-9bf3-1e69ccf25619 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:35:08 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-b218022e-04f7-4626-9bf3-1e69ccf25619 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:35:08 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-b218022e-04f7-4626-9bf3-1e69ccf25619 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:35:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:35:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6555d72-6094-4ea9-b071-a3d3c8a300a9/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:35:08 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-662d079c-0739-45be-8770-1bf0a87dbfdb tempest-AttachVolumeShelveTestJSON-1321076871 tempest-AttachVolumeShelveTestJSON-1321076871-project-member] Lock "9e8b4b85-fe0c-4592-850e-e94ebab32d02" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.225s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:35:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:35:08 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6cb5924-6162-40e4-bcb9-6467e7a1ef95]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:35:08 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-b218022e-04f7-4626-9bf3-1e69ccf25619 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 17 01:35:08 user nova-compute[75226]: No targets found.
Nov 17 01:35:08 user nova-compute[75226]: iSNS:
Nov 17 01:35:08 user nova-compute[75226]: No targets found.
Nov 17 01:35:08 user nova-compute[75226]: STATIC:
Nov 17 01:35:08 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8
Nov 17 01:35:08 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:35:08 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:35:08 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419
Nov 17 01:35:08 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:35:08 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:35:08 user nova-compute[75226]: FIRMWARE:
Nov 17 01:35:08 user nova-compute[75226]: No targets found.
Nov 17 01:35:08 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:35:08 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-b218022e-04f7-4626-9bf3-1e69ccf25619 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 17 01:35:08 user nova-compute[75226]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 17 01:35:08 user nova-compute[75226]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75226) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 17 01:35:08 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-b218022e-04f7-4626-9bf3-1e69ccf25619 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419', 0)] {{(pid=75226) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 17 01:35:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:35:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38062487-67ca-4962-974f-81456aebe97b/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:35:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:35:08 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcf7d41b-1d5d-4a29-b6cf-2c4b65bc7e50]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:35:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:35:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:35:08 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a76c0b4-dd69-469d-916d-7cd3bf94437b]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:35:08 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-b218022e-04f7-4626-9bf3-1e69ccf25619 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)
Nov 17 01:35:08 user nova-compute[75226]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419 (non-flash)
Nov 17 01:35:08 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:35:08 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-b218022e-04f7-4626-9bf3-1e69ccf25619 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)
Nov 17 01:35:08 user nova-compute[75226]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419 (non-flash)
Nov 17 01:35:08 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:35:08 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-b218022e-04f7-4626-9bf3-1e69ccf25619 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc4cc1bf400>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419'): ({'sdb'}, set())}) {{(pid=75226) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 17 01:35:08 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-b218022e-04f7-4626-9bf3-1e69ccf25619 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Removing single pathed devices sdb {{(pid=75226) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 17 01:35:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:35:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:35:08 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3fec853-13a7-4d3b-81be-f32214737c7d]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:35:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:35:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:35:08 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[0474634f-295f-48c8-8001-caa8878b90ae]: (4, ('ok\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:35:08 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-b218022e-04f7-4626-9bf3-1e69ccf25619 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Flushing IO for device /dev/sdb {{(pid=75226) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 17 01:35:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:35:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:35:08 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[b05c9c5f-4a99-445e-88fb-fc4288124842]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:35:08 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-b218022e-04f7-4626-9bf3-1e69ccf25619 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75226) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 17 01:35:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:35:08 user nova-compute[75226]: DEBUG nova.compute.manager [req-095bf714-94f5-45fc-a657-63a0a5a9a074 req-a28d9562-4143-4b58-962c-ef8338ea7a12 service nova] [instance: 9e8b4b85-fe0c-4592-850e-e94ebab32d02] Received event network-vif-plugged-5e4b278c-6c95-4fd1-a215-3fa737694996 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:35:08 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-095bf714-94f5-45fc-a657-63a0a5a9a074 req-a28d9562-4143-4b58-962c-ef8338ea7a12 service nova] Acquiring lock "9e8b4b85-fe0c-4592-850e-e94ebab32d02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:35:08 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-095bf714-94f5-45fc-a657-63a0a5a9a074 req-a28d9562-4143-4b58-962c-ef8338ea7a12 service nova] Lock "9e8b4b85-fe0c-4592-850e-e94ebab32d02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:35:08 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-095bf714-94f5-45fc-a657-63a0a5a9a074 req-a28d9562-4143-4b58-962c-ef8338ea7a12 service nova] Lock "9e8b4b85-fe0c-4592-850e-e94ebab32d02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:35:08 user nova-compute[75226]: DEBUG nova.compute.manager [req-095bf714-94f5-45fc-a657-63a0a5a9a074 req-a28d9562-4143-4b58-962c-ef8338ea7a12 service nova] [instance: 9e8b4b85-fe0c-4592-850e-e94ebab32d02] No waiting events found dispatching network-vif-plugged-5e4b278c-6c95-4fd1-a215-3fa737694996 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:35:08 user nova-compute[75226]: WARNING nova.compute.manager [req-095bf714-94f5-45fc-a657-63a0a5a9a074 req-a28d9562-4143-4b58-962c-ef8338ea7a12 service nova] [instance: 9e8b4b85-fe0c-4592-850e-e94ebab32d02] Received unexpected event network-vif-plugged-5e4b278c-6c95-4fd1-a215-3fa737694996 for instance with vm_state deleted and task_state None.
Nov 17 01:35:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38062487-67ca-4962-974f-81456aebe97b/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:35:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38062487-67ca-4962-974f-81456aebe97b/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:35:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:35:08 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[34133cfd-0710-4a26-8d0e-ec825b77b9eb]: (4, ('1', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:35:08 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-b218022e-04f7-4626-9bf3-1e69ccf25619 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75226) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 17 01:35:08 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-b218022e-04f7-4626-9bf3-1e69ccf25619 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] SCSI volumes sdb have been removed. {{(pid=75226) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 17 01:35:08 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-b218022e-04f7-4626-9bf3-1e69ccf25619 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419')] {{(pid=75226) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 17 01:35:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:35:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:35:08 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[0550b37c-ea64-4c6d-8d73-7286b241740b]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:35:08 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-b218022e-04f7-4626-9bf3-1e69ccf25619 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:35:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419 -p 172.16.0.220:3260 --logout {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:35:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:35:08 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6eb18c6-c935-4e2a-8322-3fa82f061e0b]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:35:08 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-b218022e-04f7-4626-9bf3-1e69ccf25619 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419, portal: 172.16.0.220,3260]
Nov 17 01:35:08 user nova-compute[75226]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419, portal: 172.16.0.220,3260] successful.
Nov 17 01:35:08 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:35:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419 -p 172.16.0.220:3260 --op delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:35:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:35:08 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[95f7dbd7-159c-4f56-8f71-c38158d421db]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:35:08 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-b218022e-04f7-4626-9bf3-1e69ccf25619 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:35:08 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-b218022e-04f7-4626-9bf3-1e69ccf25619 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.374s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:35:08 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-b218022e-04f7-4626-9bf3-1e69ccf25619 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] <== disconnect_volume: return (377ms) None {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:35:08 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b218022e-04f7-4626-9bf3-1e69ccf25619 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: a298d980-feed-4530-9499-f2833b404dcd] Disconnected iSCSI Volume {{(pid=75226) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 17 01:35:08 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-b218022e-04f7-4626-9bf3-1e69ccf25619 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75226) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 01:35:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38062487-67ca-4962-974f-81456aebe97b/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:35:08 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75226) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 01:35:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c280142-8901-4f83-bde4-baaa097e05b0/disk.rescue --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:35:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c280142-8901-4f83-bde4-baaa097e05b0/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:35:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c280142-8901-4f83-bde4-baaa097e05b0/disk.rescue --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:35:09 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c280142-8901-4f83-bde4-baaa097e05b0/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:35:09 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c280142-8901-4f83-bde4-baaa097e05b0/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:35:09 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c280142-8901-4f83-bde4-baaa097e05b0/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:35:09 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c280142-8901-4f83-bde4-baaa097e05b0/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:35:09 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c280142-8901-4f83-bde4-baaa097e05b0/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:35:09 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18a445fd-6ca2-470f-85c4-301cde767284/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:35:09 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18a445fd-6ca2-470f-85c4-301cde767284/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:35:09 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18a445fd-6ca2-470f-85c4-301cde767284/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:35:09 user nova-compute[75226]: DEBUG nova.compute.manager [req-0184d612-8eb2-44bc-b6a7-4f5c8a46d9d8 req-ad4d9641-2562-4bf0-81a8-f16d39e10d6f service nova] [instance: a298d980-feed-4530-9499-f2833b404dcd] Received event network-vif-unplugged-301235a9-5ec1-41f4-8e43-9dc7b20e872d {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:35:09 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-0184d612-8eb2-44bc-b6a7-4f5c8a46d9d8 req-ad4d9641-2562-4bf0-81a8-f16d39e10d6f service nova] Acquiring lock "a298d980-feed-4530-9499-f2833b404dcd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:35:09 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-0184d612-8eb2-44bc-b6a7-4f5c8a46d9d8 req-ad4d9641-2562-4bf0-81a8-f16d39e10d6f service nova] Lock "a298d980-feed-4530-9499-f2833b404dcd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:35:09 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-0184d612-8eb2-44bc-b6a7-4f5c8a46d9d8 req-ad4d9641-2562-4bf0-81a8-f16d39e10d6f service nova] Lock "a298d980-feed-4530-9499-f2833b404dcd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:35:09 user nova-compute[75226]: DEBUG nova.compute.manager [req-0184d612-8eb2-44bc-b6a7-4f5c8a46d9d8 req-ad4d9641-2562-4bf0-81a8-f16d39e10d6f service nova] [instance: a298d980-feed-4530-9499-f2833b404dcd] No waiting events found dispatching network-vif-unplugged-301235a9-5ec1-41f4-8e43-9dc7b20e872d {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:35:09 user nova-compute[75226]: WARNING nova.compute.manager [req-0184d612-8eb2-44bc-b6a7-4f5c8a46d9d8 req-ad4d9641-2562-4bf0-81a8-f16d39e10d6f service nova] [instance: a298d980-feed-4530-9499-f2833b404dcd] Received unexpected event network-vif-unplugged-301235a9-5ec1-41f4-8e43-9dc7b20e872d for instance with vm_state active and task_state resize_migrating.
Nov 17 01:35:09 user nova-compute[75226]: DEBUG nova.compute.manager [req-0184d612-8eb2-44bc-b6a7-4f5c8a46d9d8 req-ad4d9641-2562-4bf0-81a8-f16d39e10d6f service nova] [instance: a298d980-feed-4530-9499-f2833b404dcd] Received event network-vif-plugged-301235a9-5ec1-41f4-8e43-9dc7b20e872d {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:35:09 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-0184d612-8eb2-44bc-b6a7-4f5c8a46d9d8 req-ad4d9641-2562-4bf0-81a8-f16d39e10d6f service nova] Acquiring lock "a298d980-feed-4530-9499-f2833b404dcd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:35:09 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-0184d612-8eb2-44bc-b6a7-4f5c8a46d9d8 req-ad4d9641-2562-4bf0-81a8-f16d39e10d6f service nova] Lock "a298d980-feed-4530-9499-f2833b404dcd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:35:09 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-0184d612-8eb2-44bc-b6a7-4f5c8a46d9d8 req-ad4d9641-2562-4bf0-81a8-f16d39e10d6f service nova] Lock "a298d980-feed-4530-9499-f2833b404dcd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:35:09 user nova-compute[75226]: DEBUG nova.compute.manager [req-0184d612-8eb2-44bc-b6a7-4f5c8a46d9d8 req-ad4d9641-2562-4bf0-81a8-f16d39e10d6f service nova] [instance: a298d980-feed-4530-9499-f2833b404dcd] No waiting events found dispatching network-vif-plugged-301235a9-5ec1-41f4-8e43-9dc7b20e872d {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:35:09 user nova-compute[75226]: WARNING nova.compute.manager [req-0184d612-8eb2-44bc-b6a7-4f5c8a46d9d8 req-ad4d9641-2562-4bf0-81a8-f16d39e10d6f service nova] [instance: a298d980-feed-4530-9499-f2833b404dcd] Received unexpected event network-vif-plugged-301235a9-5ec1-41f4-8e43-9dc7b20e872d for instance with vm_state active and task_state resize_migrating.
Nov 17 01:35:09 user nova-compute[75226]: DEBUG nova.network.neutron [None req-b218022e-04f7-4626-9bf3-1e69ccf25619 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: a298d980-feed-4530-9499-f2833b404dcd] Port 301235a9-5ec1-41f4-8e43-9dc7b20e872d binding to destination host user is already ACTIVE {{(pid=75226) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 17 01:35:09 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-b218022e-04f7-4626-9bf3-1e69ccf25619 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Acquiring lock "a298d980-feed-4530-9499-f2833b404dcd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:35:09 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-b218022e-04f7-4626-9bf3-1e69ccf25619 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Lock "a298d980-feed-4530-9499-f2833b404dcd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:35:09 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-b218022e-04f7-4626-9bf3-1e69ccf25619 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Lock "a298d980-feed-4530-9499-f2833b404dcd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:35:09 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18a445fd-6ca2-470f-85c4-301cde767284/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:35:09 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75226) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 01:35:09 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d983732-91aa-4f20-9d7d-3de66029cba5/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:35:09 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-b218022e-04f7-4626-9bf3-1e69ccf25619 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Acquiring lock "refresh_cache-a298d980-feed-4530-9499-f2833b404dcd" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:35:09 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-b218022e-04f7-4626-9bf3-1e69ccf25619 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Acquired lock "refresh_cache-a298d980-feed-4530-9499-f2833b404dcd" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:35:09 user nova-compute[75226]: DEBUG nova.network.neutron [None req-b218022e-04f7-4626-9bf3-1e69ccf25619 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: a298d980-feed-4530-9499-f2833b404dcd] Building network info cache for instance {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 01:35:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d983732-91aa-4f20-9d7d-3de66029cba5/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:35:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d983732-91aa-4f20-9d7d-3de66029cba5/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:35:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d983732-91aa-4f20-9d7d-3de66029cba5/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:35:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ea5a14b-c330-4a2b-926e-60e1b30f5981/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:35:10 user nova-compute[75226]: DEBUG nova.network.neutron [None req-b218022e-04f7-4626-9bf3-1e69ccf25619 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: a298d980-feed-4530-9499-f2833b404dcd] Updating instance_info_cache with network_info: [{"id": "301235a9-5ec1-41f4-8e43-9dc7b20e872d", "address": "fa:16:3e:9a:7d:e3", "network": {"id": "9f39d3e5-b106-4bd9-b8ba-0f326e89c481", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-675861281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9042fe4ecc245dd97553f6e942c3e05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap301235a9-5e", "ovs_interfaceid": "301235a9-5ec1-41f4-8e43-9dc7b20e872d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:35:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ea5a14b-c330-4a2b-926e-60e1b30f5981/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:35:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ea5a14b-c330-4a2b-926e-60e1b30f5981/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:35:10 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-b218022e-04f7-4626-9bf3-1e69ccf25619 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Releasing lock "refresh_cache-a298d980-feed-4530-9499-f2833b404dcd" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:35:10 user nova-compute[75226]: DEBUG os_brick.utils [None req-b218022e-04f7-4626-9bf3-1e69ccf25619 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:35:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:35:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:35:10 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca6a6a7d-fd90-4d20-8a52-51e9c35f4af7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f62857db69\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:35:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:35:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ea5a14b-c330-4a2b-926e-60e1b30f5981/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:35:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:35:10 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[afaec5d7-3e3e-431e-82d5-d0ee7174969d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:35:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:35:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:35:10 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[e218b16d-8af4-498a-ba74-fbb3ed1a6a41]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:35:10 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8286438-2c0f-48fe-b64c-6caeb9bacfa6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:35:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-b218022e-04f7-4626-9bf3-1e69ccf25619 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Running cmd (subprocess): nvme version {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:35:11 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-b218022e-04f7-4626-9bf3-1e69ccf25619 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] 'nvme version' failed. Not Retrying. {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 01:35:11 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b218022e-04f7-4626-9bf3-1e69ccf25619 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] nvme not present on system {{(pid=75226) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 17 01:35:11 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:35:11 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:35:11 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:35:11 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Hypervisor/Node resource view: name=user free_ram=7828MB free_disk=24.85888671875GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75226) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 17 01:35:11 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:35:11 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:35:11 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 01:35:11 user nova-compute[75226]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 17 01:35:11 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[214f38c3-e0cc-4104-b629-893c6d9dde76]: (4, '') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:35:11 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-b218022e-04f7-4626-9bf3-1e69ccf25619 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75226) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 17 01:35:11 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-b218022e-04f7-4626-9bf3-1e69ccf25619 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75226) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 17 01:35:11 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-b218022e-04f7-4626-9bf3-1e69ccf25619 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] LIGHTOS: no hostnqn found. {{(pid=75226) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 17 01:35:11 user nova-compute[75226]: DEBUG os_brick.utils [None req-b218022e-04f7-4626-9bf3-1e69ccf25619 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] <== get_connector_properties: return (479ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f62857db69', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:35:11 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Applying migration context for instance a298d980-feed-4530-9499-f2833b404dcd as it has an incoming, in-progress migration b0f48d1c-5955-4eec-b50d-8c2e90f1e86b. Migration status is post-migrating {{(pid=75226) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 17 01:35:11 user nova-compute[75226]: INFO nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] [instance: a298d980-feed-4530-9499-f2833b404dcd] Updating resource usage from migration b0f48d1c-5955-4eec-b50d-8c2e90f1e86b
Nov 17 01:35:11 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance aa84e575-bdad-45b9-80ce-86b1c2826fb0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:35:11 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 6b7e9611-be35-4e51-b886-91a2fac0a653 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:35:11 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 38062487-67ca-4962-974f-81456aebe97b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:35:11 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 2ea5a14b-c330-4a2b-926e-60e1b30f5981 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:35:11 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance d6555d72-6094-4ea9-b071-a3d3c8a300a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:35:11 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 5c280142-8901-4f83-bde4-baaa097e05b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:35:11 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 18a445fd-6ca2-470f-85c4-301cde767284 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:35:11 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 8d983732-91aa-4f20-9d7d-3de66029cba5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:35:11 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Migration b0f48d1c-5955-4eec-b50d-8c2e90f1e86b is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 17 01:35:11 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance a298d980-feed-4530-9499-f2833b404dcd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:35:11 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75226) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 17 01:35:11 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75226) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 17 01:35:11 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:35:11 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:35:11 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Compute_service record updated for user:user {{(pid=75226) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 17 01:35:11 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.460s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:35:12 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:35:12 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:35:13 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:35:14 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:35:15 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:35:16 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-b218022e-04f7-4626-9bf3-1e69ccf25619 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: a298d980-feed-4530-9499-f2833b404dcd] Starting finish_migration {{(pid=75226) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 17 01:35:16 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-b218022e-04f7-4626-9bf3-1e69ccf25619 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: a298d980-feed-4530-9499-f2833b404dcd] Instance directory exists: not creating {{(pid=75226) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 17 01:35:16 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-b218022e-04f7-4626-9bf3-1e69ccf25619 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: a298d980-feed-4530-9499-f2833b404dcd] Creating image(s)
Nov 17 01:35:16 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-b218022e-04f7-4626-9bf3-1e69ccf25619 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: a298d980-feed-4530-9499-f2833b404dcd] Did not create local disks {{(pid=75226) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 17 01:35:16 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-b218022e-04f7-4626-9bf3-1e69ccf25619 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: a298d980-feed-4530-9499-f2833b404dcd] Ensure instance console log exists: /opt/stack/data/nova/instances/a298d980-feed-4530-9499-f2833b404dcd/console.log {{(pid=75226) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 17 01:35:16 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-b218022e-04f7-4626-9bf3-1e69ccf25619 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:35:16 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-b218022e-04f7-4626-9bf3-1e69ccf25619 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:35:16 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-b218022e-04f7-4626-9bf3-1e69ccf25619 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:35:16 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-b218022e-04f7-4626-9bf3-1e69ccf25619 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: a298d980-feed-4530-9499-f2833b404dcd] Start _get_guest_xml network_info=[{"id": "301235a9-5ec1-41f4-8e43-9dc7b20e872d", "address": "fa:16:3e:9a:7d:e3", "network": {"id": "9f39d3e5-b106-4bd9-b8ba-0f326e89c481", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-675861281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-675861281-network", "vif_mac": "fa:16:3e:9a:7d:e3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9042fe4ecc245dd97553f6e942c3e05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap301235a9-5e", "ovs_interfaceid": "301235a9-5ec1-41f4-8e43-9dc7b20e872d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VUyvFGLr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'a298d980-feed-4530-9499-f2833b404dcd', 'attached_at': '2023-11-17T01:35:17.000000', 'detached_at': '', 'volume_id': 'c9b3d0d6-bd04-414b-99e5-da9402f5f419', 'serial': 'c9b3d0d6-bd04-414b-99e5-da9402f5f419'}, 'attachment_id': '49143146-54bc-4355-9c9f-7efb2029c76e', 'device_type': 'disk', 'volume_type': None} {{(pid=75226) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 17 01:35:16 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-b218022e-04f7-4626-9bf3-1e69ccf25619 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:35:16 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-b218022e-04f7-4626-9bf3-1e69ccf25619 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:35:16 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-b218022e-04f7-4626-9bf3-1e69ccf25619 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75226) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 17 01:35:16 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-b218022e-04f7-4626-9bf3-1e69ccf25619 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] CPU controller missing on host. {{(pid=75226) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 17 01:35:16 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-b218022e-04f7-4626-9bf3-1e69ccf25619 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75226) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 17 01:35:16 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-b218022e-04f7-4626-9bf3-1e69ccf25619 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] CPU controller found on host. {{(pid=75226) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 17 01:35:16 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-b218022e-04f7-4626-9bf3-1e69ccf25619 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75226) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 17 01:35:16 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-b218022e-04f7-4626-9bf3-1e69ccf25619 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-17T01:13:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 17 01:35:16 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-b218022e-04f7-4626-9bf3-1e69ccf25619 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Flavor limits 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 17 01:35:16 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-b218022e-04f7-4626-9bf3-1e69ccf25619 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Image limits 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 17 01:35:16 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-b218022e-04f7-4626-9bf3-1e69ccf25619 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Flavor pref 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 17 01:35:16 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-b218022e-04f7-4626-9bf3-1e69ccf25619 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Image pref 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 17 01:35:16 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-b218022e-04f7-4626-9bf3-1e69ccf25619 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 17 01:35:16 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-b218022e-04f7-4626-9bf3-1e69ccf25619 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 17 01:35:16 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-b218022e-04f7-4626-9bf3-1e69ccf25619 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75226) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 17 01:35:16 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-b218022e-04f7-4626-9bf3-1e69ccf25619 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Got 1 possible topologies {{(pid=75226) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 17 01:35:16 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-b218022e-04f7-4626-9bf3-1e69ccf25619 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 17 01:35:16 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-b218022e-04f7-4626-9bf3-1e69ccf25619 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 17 01:35:16 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b218022e-04f7-4626-9bf3-1e69ccf25619 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: a298d980-feed-4530-9499-f2833b404dcd] Calling os-brick to attach iSCSI Volume {{(pid=75226) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 17 01:35:16 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-b218022e-04f7-4626-9bf3-1e69ccf25619 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc4cc36b490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VUyvFGLr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:35:16 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-b218022e-04f7-4626-9bf3-1e69ccf25619 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:35:16 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-b218022e-04f7-4626-9bf3-1e69ccf25619 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:35:16 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-b218022e-04f7-4626-9bf3-1e69ccf25619 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:35:16 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-b218022e-04f7-4626-9bf3-1e69ccf25619 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:35:16 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-b218022e-04f7-4626-9bf3-1e69ccf25619 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:35:16 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-b218022e-04f7-4626-9bf3-1e69ccf25619 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:35:16 user nova-compute[75226]: INFO os_brick.initiator.connectors.iscsi [None req-b218022e-04f7-4626-9bf3-1e69ccf25619 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 17 01:35:16 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419 -p 172.16.0.220:3260 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:35:16 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:35:16 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e994262-ec7d-4c43-91d0-26aabc7db3c9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:35:16 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-b218022e-04f7-4626-9bf3-1e69ccf25619 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 17 01:35:16 user nova-compute[75226]:  {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:35:16 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419 -p 172.16.0.220:3260 --interface default --op new {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:35:16 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:35:16 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[13d661a3-1858-41c2-95f6-5ea04400933f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419] added\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:35:16 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-b218022e-04f7-4626-9bf3-1e69ccf25619 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419] added
Nov 17 01:35:16 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:35:16 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:35:16 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:35:16 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc343fa7-3a85-457c-8ebd-6df02a264ed9]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:35:16 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-b218022e-04f7-4626-9bf3-1e69ccf25619 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:35:16 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:35:16 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:35:16 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4335fb0-c01d-4ba3-a0f6-373f732edab9]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:35:16 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-b218022e-04f7-4626-9bf3-1e69ccf25619 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:35:16 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VUyvFGLr {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:35:16 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VUyvFGLr" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:35:16 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cffb4da-f80a-4469-b00d-7605b2a57353]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:35:16 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-b218022e-04f7-4626-9bf3-1e69ccf25619 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VUyvFGLr'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:35:16 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:35:16 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:35:16 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[b781a18a-c420-424f-8391-b9fe83da8729]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:35:16 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-b218022e-04f7-4626-9bf3-1e69ccf25619 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:35:16 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:35:16 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:35:16 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[15f354a8-f7ce-4eb6-98fe-b7843ac4f3d7]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:35:16 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-b218022e-04f7-4626-9bf3-1e69ccf25619 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)
Nov 17 01:35:16 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:35:16 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-b218022e-04f7-4626-9bf3-1e69ccf25619 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)
Nov 17 01:35:16 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:35:16 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419 -p 172.16.0.220:3260 --login {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:35:17 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:35:17 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[667c5f21-7d6e-46a3-a8e9-d5d4a014c274]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:35:17 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-b218022e-04f7-4626-9bf3-1e69ccf25619 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419, portal: 172.16.0.220,3260]
Nov 17 01:35:17 user nova-compute[75226]: Login to [iface: default, target: iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419, portal: 172.16.0.220,3260] successful.
Nov 17 01:35:17 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:35:17 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:35:17 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:35:17 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[aae44be9-6a9c-4a03-8f4b-4f2b8f44525e]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:35:17 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-b218022e-04f7-4626-9bf3-1e69ccf25619 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:35:17 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:35:17 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:35:17 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[c242c7c4-8094-46d6-bac4-178920420b74]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:35:17 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-b218022e-04f7-4626-9bf3-1e69ccf25619 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)
Nov 17 01:35:17 user nova-compute[75226]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419 (non-flash)
Nov 17 01:35:17 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:35:17 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-b218022e-04f7-4626-9bf3-1e69ccf25619 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)
Nov 17 01:35:17 user nova-compute[75226]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419 (non-flash)
Nov 17 01:35:17 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:35:17 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-b218022e-04f7-4626-9bf3-1e69ccf25619 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.258s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:35:17 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-b218022e-04f7-4626-9bf3-1e69ccf25619 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Connected to 172.16.0.220:3260 {{(pid=75226) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 17 01:35:17 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-b218022e-04f7-4626-9bf3-1e69ccf25619 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] HCTL ('33', '-', '-', 0) found on session 39 with lun 0 {{(pid=75226) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 17 01:35:17 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-b218022e-04f7-4626-9bf3-1e69ccf25619 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75226) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 17 01:35:17 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:35:17 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:35:17 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bd67df5-1299-429f-b0bf-daf6033a6bb4]: (4, ('- - 0', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:35:17 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-b218022e-04f7-4626-9bf3-1e69ccf25619 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Searching for a device in session 39 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75226) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 01:35:17 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-b218022e-04f7-4626-9bf3-1e69ccf25619 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VUyvFGLr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75226) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 17 01:35:18 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-b218022e-04f7-4626-9bf3-1e69ccf25619 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.288s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:35:18 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-b218022e-04f7-4626-9bf3-1e69ccf25619 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] <== connect_volume: return (1290ms) {'type': 'block', 'scsi_wwn': '23430633864323532', 'path': '/dev/sdb'} {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:35:18 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b218022e-04f7-4626-9bf3-1e69ccf25619 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: a298d980-feed-4530-9499-f2833b404dcd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23430633864323532', 'path': '/dev/sdb'} {{(pid=75226) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 17 01:35:18 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-b218022e-04f7-4626-9bf3-1e69ccf25619 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:33:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-652050362',display_name='tempest-ServerActionsTestOtherA-server-652050362',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-652050362',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFcMGt3BPMgKZBdescHicrTnz7kyNBHfMwmrFONg75JAKc8VfRVh1PCQT3W5iiYYT6fcflPeuhtfYyaPi/d36jL88Vz6dOEwhdGgUoOilw3GKb90qUp0hFoOK7faoQkiRg==',key_name='tempest-keypair-1413404210',keypairs=<?>,launch_index=0,launched_at=2023-11-17T01:33:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f9042fe4ecc245dd97553f6e942c3e05',ramdisk_id='',reservation_id='r-e60zxux4',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-2125452149',owner_user_name='tempest-ServerActionsTestOtherA-2125452149-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T01:35:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a13dd8231937440185c9fc628c3bd5db',uuid=a298d980-feed-4530-9499-f2833b404dcd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "301235a9-5ec1-41f4-8e43-9dc7b20e872d", "address": "fa:16:3e:9a:7d:e3", "network": {"id": "9f39d3e5-b106-4bd9-b8ba-0f326e89c481", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-675861281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-675861281-network", "vif_mac": "fa:16:3e:9a:7d:e3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9042fe4ecc245dd97553f6e942c3e05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap301235a9-5e", "ovs_interfaceid": "301235a9-5ec1-41f4-8e43-9dc7b20e872d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75226) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 01:35:18 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-b218022e-04f7-4626-9bf3-1e69ccf25619 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Converting VIF {"id": "301235a9-5ec1-41f4-8e43-9dc7b20e872d", "address": "fa:16:3e:9a:7d:e3", "network": {"id": "9f39d3e5-b106-4bd9-b8ba-0f326e89c481", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-675861281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-675861281-network", "vif_mac": "fa:16:3e:9a:7d:e3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9042fe4ecc245dd97553f6e942c3e05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap301235a9-5e", "ovs_interfaceid": "301235a9-5ec1-41f4-8e43-9dc7b20e872d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:35:18 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-b218022e-04f7-4626-9bf3-1e69ccf25619 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:7d:e3,bridge_name='br-int',has_traffic_filtering=True,id=301235a9-5ec1-41f4-8e43-9dc7b20e872d,network=Network(9f39d3e5-b106-4bd9-b8ba-0f326e89c481),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap301235a9-5e') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:35:18 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-b218022e-04f7-4626-9bf3-1e69ccf25619 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: a298d980-feed-4530-9499-f2833b404dcd] End _get_guest_xml xml=<domain type="kvm">
Nov 17 01:35:18 user nova-compute[75226]:   <uuid>a298d980-feed-4530-9499-f2833b404dcd</uuid>
Nov 17 01:35:18 user nova-compute[75226]:   <name>instance-00000021</name>
Nov 17 01:35:18 user nova-compute[75226]:   <memory>2097152</memory>
Nov 17 01:35:18 user nova-compute[75226]:   <vcpu>1</vcpu>
Nov 17 01:35:18 user nova-compute[75226]:   <metadata>
Nov 17 01:35:18 user nova-compute[75226]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 17 01:35:18 user nova-compute[75226]:       <nova:package version="0.0.0"/>
Nov 17 01:35:18 user nova-compute[75226]:       <nova:name>tempest-ServerActionsTestOtherA-server-652050362</nova:name>
Nov 17 01:35:18 user nova-compute[75226]:       <nova:creationTime>2023-11-17 01:35:16</nova:creationTime>
Nov 17 01:35:18 user nova-compute[75226]:       <nova:flavor name="m1.small">
Nov 17 01:35:18 user nova-compute[75226]:         <nova:memory>2048</nova:memory>
Nov 17 01:35:18 user nova-compute[75226]:         <nova:disk>20</nova:disk>
Nov 17 01:35:18 user nova-compute[75226]:         <nova:swap>0</nova:swap>
Nov 17 01:35:18 user nova-compute[75226]:         <nova:ephemeral>0</nova:ephemeral>
Nov 17 01:35:18 user nova-compute[75226]:         <nova:vcpus>1</nova:vcpus>
Nov 17 01:35:18 user nova-compute[75226]:       </nova:flavor>
Nov 17 01:35:18 user nova-compute[75226]:       <nova:owner>
Nov 17 01:35:18 user nova-compute[75226]:         <nova:user uuid="a13dd8231937440185c9fc628c3bd5db">tempest-ServerActionsTestOtherA-2125452149-project-member</nova:user>
Nov 17 01:35:18 user nova-compute[75226]:         <nova:project uuid="f9042fe4ecc245dd97553f6e942c3e05">tempest-ServerActionsTestOtherA-2125452149</nova:project>
Nov 17 01:35:18 user nova-compute[75226]:       </nova:owner>
Nov 17 01:35:18 user nova-compute[75226]:       <nova:ports>
Nov 17 01:35:18 user nova-compute[75226]:         <nova:port uuid="301235a9-5ec1-41f4-8e43-9dc7b20e872d">
Nov 17 01:35:18 user nova-compute[75226]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 17 01:35:18 user nova-compute[75226]:         </nova:port>
Nov 17 01:35:18 user nova-compute[75226]:       </nova:ports>
Nov 17 01:35:18 user nova-compute[75226]:     </nova:instance>
Nov 17 01:35:18 user nova-compute[75226]:   </metadata>
Nov 17 01:35:18 user nova-compute[75226]:   <sysinfo type="smbios">
Nov 17 01:35:18 user nova-compute[75226]:     <system>
Nov 17 01:35:18 user nova-compute[75226]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 17 01:35:18 user nova-compute[75226]:       <entry name="product">OpenStack Nova</entry>
Nov 17 01:35:18 user nova-compute[75226]:       <entry name="version">0.0.0</entry>
Nov 17 01:35:18 user nova-compute[75226]:       <entry name="serial">a298d980-feed-4530-9499-f2833b404dcd</entry>
Nov 17 01:35:18 user nova-compute[75226]:       <entry name="uuid">a298d980-feed-4530-9499-f2833b404dcd</entry>
Nov 17 01:35:18 user nova-compute[75226]:       <entry name="family">Virtual Machine</entry>
Nov 17 01:35:18 user nova-compute[75226]:     </system>
Nov 17 01:35:18 user nova-compute[75226]:   </sysinfo>
Nov 17 01:35:18 user nova-compute[75226]:   <os>
Nov 17 01:35:18 user nova-compute[75226]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 17 01:35:18 user nova-compute[75226]:     <boot dev="hd"/>
Nov 17 01:35:18 user nova-compute[75226]:     <smbios mode="sysinfo"/>
Nov 17 01:35:18 user nova-compute[75226]:   </os>
Nov 17 01:35:18 user nova-compute[75226]:   <features>
Nov 17 01:35:18 user nova-compute[75226]:     <acpi/>
Nov 17 01:35:18 user nova-compute[75226]:     <apic/>
Nov 17 01:35:18 user nova-compute[75226]:     <vmcoreinfo/>
Nov 17 01:35:18 user nova-compute[75226]:   </features>
Nov 17 01:35:18 user nova-compute[75226]:   <clock offset="utc">
Nov 17 01:35:18 user nova-compute[75226]:     <timer name="pit" tickpolicy="delay"/>
Nov 17 01:35:18 user nova-compute[75226]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 17 01:35:18 user nova-compute[75226]:     <timer name="hpet" present="no"/>
Nov 17 01:35:18 user nova-compute[75226]:   </clock>
Nov 17 01:35:18 user nova-compute[75226]:   <cpu mode="custom" match="exact">
Nov 17 01:35:18 user nova-compute[75226]:     <model>Nehalem</model>
Nov 17 01:35:18 user nova-compute[75226]:     <topology sockets="1" cores="1" threads="1"/>
Nov 17 01:35:18 user nova-compute[75226]:   </cpu>
Nov 17 01:35:18 user nova-compute[75226]:   <devices>
Nov 17 01:35:18 user nova-compute[75226]:     <disk type="block" device="disk">
Nov 17 01:35:18 user nova-compute[75226]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 01:35:18 user nova-compute[75226]:       <source dev="/dev/sdb"/>
Nov 17 01:35:18 user nova-compute[75226]:       <target dev="vda" bus="virtio"/>
Nov 17 01:35:18 user nova-compute[75226]:       <serial>c9b3d0d6-bd04-414b-99e5-da9402f5f419</serial>
Nov 17 01:35:18 user nova-compute[75226]:     </disk>
Nov 17 01:35:18 user nova-compute[75226]:     <interface type="ethernet">
Nov 17 01:35:18 user nova-compute[75226]:       <mac address="fa:16:3e:9a:7d:e3"/>
Nov 17 01:35:18 user nova-compute[75226]:       <model type="virtio"/>
Nov 17 01:35:18 user nova-compute[75226]:       <mtu size="1442"/>
Nov 17 01:35:18 user nova-compute[75226]:       <target dev="tap301235a9-5e"/>
Nov 17 01:35:18 user nova-compute[75226]:     </interface>
Nov 17 01:35:18 user nova-compute[75226]:     <serial type="pty">
Nov 17 01:35:18 user nova-compute[75226]:       <log file="/opt/stack/data/nova/instances/a298d980-feed-4530-9499-f2833b404dcd/console.log" append="off"/>
Nov 17 01:35:18 user nova-compute[75226]:     </serial>
Nov 17 01:35:18 user nova-compute[75226]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 17 01:35:18 user nova-compute[75226]:     <video>
Nov 17 01:35:18 user nova-compute[75226]:       <model type="virtio"/>
Nov 17 01:35:18 user nova-compute[75226]:     </video>
Nov 17 01:35:18 user nova-compute[75226]:     <rng model="virtio">
Nov 17 01:35:18 user nova-compute[75226]:       <backend model="random">/dev/urandom</backend>
Nov 17 01:35:18 user nova-compute[75226]:     </rng>
Nov 17 01:35:18 user nova-compute[75226]:     <controller type="usb" index="0" model="none"/>
Nov 17 01:35:18 user nova-compute[75226]:     <memballoon model="virtio">
Nov 17 01:35:18 user nova-compute[75226]:       <stats period="10"/>
Nov 17 01:35:18 user nova-compute[75226]:     </memballoon>
Nov 17 01:35:18 user nova-compute[75226]:   </devices>
Nov 17 01:35:18 user nova-compute[75226]: </domain>
Nov 17 01:35:18 user nova-compute[75226]:  {{(pid=75226) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 17 01:35:18 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-b218022e-04f7-4626-9bf3-1e69ccf25619 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:33:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-652050362',display_name='tempest-ServerActionsTestOtherA-server-652050362',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-652050362',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFcMGt3BPMgKZBdescHicrTnz7kyNBHfMwmrFONg75JAKc8VfRVh1PCQT3W5iiYYT6fcflPeuhtfYyaPi/d36jL88Vz6dOEwhdGgUoOilw3GKb90qUp0hFoOK7faoQkiRg==',key_name='tempest-keypair-1413404210',keypairs=<?>,launch_index=0,launched_at=2023-11-17T01:33:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f9042fe4ecc245dd97553f6e942c3e05',ramdisk_id='',reservation_id='r-e60zxux4',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-2125452149',owner_user_name='tempest-ServerActionsTestOtherA-2125452149-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T01:35:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a13dd8231937440185c9fc628c3bd5db',uuid=a298d980-feed-4530-9499-f2833b404dcd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "301235a9-5ec1-41f4-8e43-9dc7b20e872d", "address": "fa:16:3e:9a:7d:e3", "network": {"id": "9f39d3e5-b106-4bd9-b8ba-0f326e89c481", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-675861281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-675861281-network", "vif_mac": "fa:16:3e:9a:7d:e3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9042fe4ecc245dd97553f6e942c3e05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap301235a9-5e", "ovs_interfaceid": "301235a9-5ec1-41f4-8e43-9dc7b20e872d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 17 01:35:18 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-b218022e-04f7-4626-9bf3-1e69ccf25619 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Converting VIF {"id": "301235a9-5ec1-41f4-8e43-9dc7b20e872d", "address": "fa:16:3e:9a:7d:e3", "network": {"id": "9f39d3e5-b106-4bd9-b8ba-0f326e89c481", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-675861281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-675861281-network", "vif_mac": "fa:16:3e:9a:7d:e3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9042fe4ecc245dd97553f6e942c3e05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap301235a9-5e", "ovs_interfaceid": "301235a9-5ec1-41f4-8e43-9dc7b20e872d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:35:18 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-b218022e-04f7-4626-9bf3-1e69ccf25619 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:7d:e3,bridge_name='br-int',has_traffic_filtering=True,id=301235a9-5ec1-41f4-8e43-9dc7b20e872d,network=Network(9f39d3e5-b106-4bd9-b8ba-0f326e89c481),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap301235a9-5e') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:35:18 user nova-compute[75226]: DEBUG os_vif [None req-b218022e-04f7-4626-9bf3-1e69ccf25619 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:7d:e3,bridge_name='br-int',has_traffic_filtering=True,id=301235a9-5ec1-41f4-8e43-9dc7b20e872d,network=Network(9f39d3e5-b106-4bd9-b8ba-0f326e89c481),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap301235a9-5e') {{(pid=75226) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 17 01:35:18 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:35:18 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:35:18 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 17 01:35:18 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:35:18 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '187ace96-20c3-57ec-a7d5-8a0bae3c8163', '_type': 'linux-noop'}}, row=False) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:35:18 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:35:18 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:35:18 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:35:18 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap301235a9-5e, may_exist=True, interface_attrs={}) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:35:18 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap301235a9-5e, col_values=(('qos', UUID('fa6beefd-ed9c-48db-9225-5cf8b21888d3')),), if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:35:18 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap301235a9-5e, col_values=(('external_ids', {'iface-id': '301235a9-5ec1-41f4-8e43-9dc7b20e872d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9a:7d:e3', 'vm-uuid': 'a298d980-feed-4530-9499-f2833b404dcd'}),), if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:35:18 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:35:18 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:35:18 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:35:18 user nova-compute[75226]: INFO os_vif [None req-b218022e-04f7-4626-9bf3-1e69ccf25619 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:7d:e3,bridge_name='br-int',has_traffic_filtering=True,id=301235a9-5ec1-41f4-8e43-9dc7b20e872d,network=Network(9f39d3e5-b106-4bd9-b8ba-0f326e89c481),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap301235a9-5e')
Nov 17 01:35:18 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-b218022e-04f7-4626-9bf3-1e69ccf25619 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] No BDM found with device name vda, not building metadata. {{(pid=75226) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 01:35:18 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-b218022e-04f7-4626-9bf3-1e69ccf25619 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] No VIF found with MAC fa:16:3e:9a:7d:e3, not building metadata {{(pid=75226) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 01:35:19 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:35:19 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:35:19 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:35:19 user nova-compute[75226]: DEBUG nova.compute.manager [req-6dad82c6-e594-48b3-bd3d-0ba770213e4e req-494c5649-e32a-4999-9f01-ae28caa04e7a service nova] [instance: a298d980-feed-4530-9499-f2833b404dcd] Received event network-vif-plugged-301235a9-5ec1-41f4-8e43-9dc7b20e872d {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:35:19 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-6dad82c6-e594-48b3-bd3d-0ba770213e4e req-494c5649-e32a-4999-9f01-ae28caa04e7a service nova] Acquiring lock "a298d980-feed-4530-9499-f2833b404dcd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:35:19 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-6dad82c6-e594-48b3-bd3d-0ba770213e4e req-494c5649-e32a-4999-9f01-ae28caa04e7a service nova] Lock "a298d980-feed-4530-9499-f2833b404dcd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:35:19 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-6dad82c6-e594-48b3-bd3d-0ba770213e4e req-494c5649-e32a-4999-9f01-ae28caa04e7a service nova] Lock "a298d980-feed-4530-9499-f2833b404dcd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:35:19 user nova-compute[75226]: DEBUG nova.compute.manager [req-6dad82c6-e594-48b3-bd3d-0ba770213e4e req-494c5649-e32a-4999-9f01-ae28caa04e7a service nova] [instance: a298d980-feed-4530-9499-f2833b404dcd] No waiting events found dispatching network-vif-plugged-301235a9-5ec1-41f4-8e43-9dc7b20e872d {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:35:19 user nova-compute[75226]: WARNING nova.compute.manager [req-6dad82c6-e594-48b3-bd3d-0ba770213e4e req-494c5649-e32a-4999-9f01-ae28caa04e7a service nova] [instance: a298d980-feed-4530-9499-f2833b404dcd] Received unexpected event network-vif-plugged-301235a9-5ec1-41f4-8e43-9dc7b20e872d for instance with vm_state active and task_state resize_finish.
Nov 17 01:35:19 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:35:19 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:35:19 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:35:19 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:35:19 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Starting heal instance info cache {{(pid=75226) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 17 01:35:20 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "refresh_cache-d6555d72-6094-4ea9-b071-a3d3c8a300a9" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:35:20 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquired lock "refresh_cache-d6555d72-6094-4ea9-b071-a3d3c8a300a9" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:35:20 user nova-compute[75226]: DEBUG nova.network.neutron [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] [instance: d6555d72-6094-4ea9-b071-a3d3c8a300a9] Forcefully refreshing network info cache for instance {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 17 01:35:20 user nova-compute[75226]: DEBUG nova.network.neutron [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] [instance: d6555d72-6094-4ea9-b071-a3d3c8a300a9] Updating instance_info_cache with network_info: [{"id": "1315a3d4-9d0a-4a65-8044-45959bf1f754", "address": "fa:16:3e:83:57:31", "network": {"id": "a9710b94-56f8-4cf6-9bb6-344b275e5bf2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-512340839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2052a37a068e4d948c57560c0f4445e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1315a3d4-9d", "ovs_interfaceid": "1315a3d4-9d0a-4a65-8044-45959bf1f754", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:35:20 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Releasing lock "refresh_cache-d6555d72-6094-4ea9-b071-a3d3c8a300a9" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:35:20 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] [instance: d6555d72-6094-4ea9-b071-a3d3c8a300a9] Updated the network info_cache for instance {{(pid=75226) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 17 01:35:20 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:35:20 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75226) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 17 01:35:21 user nova-compute[75226]: DEBUG nova.compute.manager [None req-b218022e-04f7-4626-9bf3-1e69ccf25619 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: a298d980-feed-4530-9499-f2833b404dcd] Instance event wait completed in 0 seconds for  {{(pid=75226) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 17 01:35:21 user nova-compute[75226]: INFO nova.virt.libvirt.driver [-] [instance: a298d980-feed-4530-9499-f2833b404dcd] Instance running successfully.
Nov 17 01:35:21 user nova-compute[75226]: DEBUG nova.virt.libvirt.guest [None req-b218022e-04f7-4626-9bf3-1e69ccf25619 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: a298d980-feed-4530-9499-f2833b404dcd] Failed to set time: agent not configured {{(pid=75226) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 17 01:35:21 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-b218022e-04f7-4626-9bf3-1e69ccf25619 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: a298d980-feed-4530-9499-f2833b404dcd] finish_migration finished successfully. {{(pid=75226) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 17 01:35:21 user nova-compute[75226]: DEBUG nova.compute.manager [req-fe8f2c8d-0749-4b76-9d5f-bb817bc58db2 req-78f76fd5-4787-4e6d-9f62-ddda4b2310d0 service nova] [instance: a298d980-feed-4530-9499-f2833b404dcd] Received event network-vif-plugged-301235a9-5ec1-41f4-8e43-9dc7b20e872d {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:35:21 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-fe8f2c8d-0749-4b76-9d5f-bb817bc58db2 req-78f76fd5-4787-4e6d-9f62-ddda4b2310d0 service nova] Acquiring lock "a298d980-feed-4530-9499-f2833b404dcd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:35:21 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-fe8f2c8d-0749-4b76-9d5f-bb817bc58db2 req-78f76fd5-4787-4e6d-9f62-ddda4b2310d0 service nova] Lock "a298d980-feed-4530-9499-f2833b404dcd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:35:21 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-fe8f2c8d-0749-4b76-9d5f-bb817bc58db2 req-78f76fd5-4787-4e6d-9f62-ddda4b2310d0 service nova] Lock "a298d980-feed-4530-9499-f2833b404dcd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:35:21 user nova-compute[75226]: DEBUG nova.compute.manager [req-fe8f2c8d-0749-4b76-9d5f-bb817bc58db2 req-78f76fd5-4787-4e6d-9f62-ddda4b2310d0 service nova] [instance: a298d980-feed-4530-9499-f2833b404dcd] No waiting events found dispatching network-vif-plugged-301235a9-5ec1-41f4-8e43-9dc7b20e872d {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:35:21 user nova-compute[75226]: WARNING nova.compute.manager [req-fe8f2c8d-0749-4b76-9d5f-bb817bc58db2 req-78f76fd5-4787-4e6d-9f62-ddda4b2310d0 service nova] [instance: a298d980-feed-4530-9499-f2833b404dcd] Received unexpected event network-vif-plugged-301235a9-5ec1-41f4-8e43-9dc7b20e872d for instance with vm_state active and task_state resize_finish.
Nov 17 01:35:23 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:35:23 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:35:28 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:35:33 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:35:33 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:35:33 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75226) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 17 01:35:33 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75226) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 01:35:33 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75226) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 01:35:33 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:35:34 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:35:38 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:35:38 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:35:43 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:35:43 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:35:48 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:35:48 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:35:49 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-429128e5-18c5-4e5d-a0a7-c93c86eee67f tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Acquiring lock "2ea5a14b-c330-4a2b-926e-60e1b30f5981" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:35:49 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-429128e5-18c5-4e5d-a0a7-c93c86eee67f tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Lock "2ea5a14b-c330-4a2b-926e-60e1b30f5981" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:35:49 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-429128e5-18c5-4e5d-a0a7-c93c86eee67f tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Acquiring lock "2ea5a14b-c330-4a2b-926e-60e1b30f5981-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:35:49 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-429128e5-18c5-4e5d-a0a7-c93c86eee67f tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Lock "2ea5a14b-c330-4a2b-926e-60e1b30f5981-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.003s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:35:49 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-429128e5-18c5-4e5d-a0a7-c93c86eee67f tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Lock "2ea5a14b-c330-4a2b-926e-60e1b30f5981-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:35:49 user nova-compute[75226]: INFO nova.compute.manager [None req-429128e5-18c5-4e5d-a0a7-c93c86eee67f tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 2ea5a14b-c330-4a2b-926e-60e1b30f5981] Terminating instance
Nov 17 01:35:49 user nova-compute[75226]: DEBUG nova.compute.manager [None req-429128e5-18c5-4e5d-a0a7-c93c86eee67f tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 2ea5a14b-c330-4a2b-926e-60e1b30f5981] Start destroying the instance on the hypervisor. {{(pid=75226) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 17 01:35:49 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:35:49 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:35:50 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:35:50 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:35:50 user nova-compute[75226]: DEBUG nova.compute.manager [req-00f101d7-f28a-4cea-bfb9-246cc407b695 req-cc099abe-366c-4c40-9407-a583749e3ce5 service nova] [instance: 2ea5a14b-c330-4a2b-926e-60e1b30f5981] Received event network-vif-unplugged-86250373-f92f-4176-b242-382fa11f4e39 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:35:50 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-00f101d7-f28a-4cea-bfb9-246cc407b695 req-cc099abe-366c-4c40-9407-a583749e3ce5 service nova] Acquiring lock "2ea5a14b-c330-4a2b-926e-60e1b30f5981-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:35:50 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-00f101d7-f28a-4cea-bfb9-246cc407b695 req-cc099abe-366c-4c40-9407-a583749e3ce5 service nova] Lock "2ea5a14b-c330-4a2b-926e-60e1b30f5981-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:35:50 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-00f101d7-f28a-4cea-bfb9-246cc407b695 req-cc099abe-366c-4c40-9407-a583749e3ce5 service nova] Lock "2ea5a14b-c330-4a2b-926e-60e1b30f5981-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:35:50 user nova-compute[75226]: DEBUG nova.compute.manager [req-00f101d7-f28a-4cea-bfb9-246cc407b695 req-cc099abe-366c-4c40-9407-a583749e3ce5 service nova] [instance: 2ea5a14b-c330-4a2b-926e-60e1b30f5981] No waiting events found dispatching network-vif-unplugged-86250373-f92f-4176-b242-382fa11f4e39 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:35:50 user nova-compute[75226]: DEBUG nova.compute.manager [req-00f101d7-f28a-4cea-bfb9-246cc407b695 req-cc099abe-366c-4c40-9407-a583749e3ce5 service nova] [instance: 2ea5a14b-c330-4a2b-926e-60e1b30f5981] Received event network-vif-unplugged-86250373-f92f-4176-b242-382fa11f4e39 for instance with task_state deleting. {{(pid=75226) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 17 01:35:50 user nova-compute[75226]: INFO nova.virt.libvirt.driver [-] [instance: 2ea5a14b-c330-4a2b-926e-60e1b30f5981] Instance destroyed successfully.
Nov 17 01:35:50 user nova-compute[75226]: DEBUG nova.objects.instance [None req-429128e5-18c5-4e5d-a0a7-c93c86eee67f tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Lazy-loading 'resources' on Instance uuid 2ea5a14b-c330-4a2b-926e-60e1b30f5981 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:35:50 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-429128e5-18c5-4e5d-a0a7-c93c86eee67f tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:25:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1844763695',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1844763695',id=24,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-17T01:25:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e6cb6f679ee4468d82cc7fb5d0f67be9',ramdisk_id='',reservation_id='r-vcihpk6a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-76498640',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T01:27:34Z,user_data=None,user_id='1b793ce05bf44b939a9fb5a914a04cb0',uuid=2ea5a14b-c330-4a2b-926e-60e1b30f5981,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "86250373-f92f-4176-b242-382fa11f4e39", "address": "fa:16:3e:54:1e:3c", "network": {"id": "450540a3-ff7e-42fb-a0a6-808acd749943", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1503678778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6cb6f679ee4468d82cc7fb5d0f67be9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86250373-f9", "ovs_interfaceid": "86250373-f92f-4176-b242-382fa11f4e39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 17 01:35:50 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-429128e5-18c5-4e5d-a0a7-c93c86eee67f tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Converting VIF {"id": "86250373-f92f-4176-b242-382fa11f4e39", "address": "fa:16:3e:54:1e:3c", "network": {"id": "450540a3-ff7e-42fb-a0a6-808acd749943", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1503678778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6cb6f679ee4468d82cc7fb5d0f67be9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86250373-f9", "ovs_interfaceid": "86250373-f92f-4176-b242-382fa11f4e39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:35:50 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-429128e5-18c5-4e5d-a0a7-c93c86eee67f tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:54:1e:3c,bridge_name='br-int',has_traffic_filtering=True,id=86250373-f92f-4176-b242-382fa11f4e39,network=Network(450540a3-ff7e-42fb-a0a6-808acd749943),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86250373-f9') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:35:50 user nova-compute[75226]: DEBUG os_vif [None req-429128e5-18c5-4e5d-a0a7-c93c86eee67f tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:54:1e:3c,bridge_name='br-int',has_traffic_filtering=True,id=86250373-f92f-4176-b242-382fa11f4e39,network=Network(450540a3-ff7e-42fb-a0a6-808acd749943),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86250373-f9') {{(pid=75226) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 17 01:35:50 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:35:50 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap86250373-f9, bridge=br-int, if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:35:50 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:35:50 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:35:50 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:35:50 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=12303430-70e7-4850-9976-d76202198e17) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:35:50 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:35:50 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:35:50 user nova-compute[75226]: INFO os_vif [None req-429128e5-18c5-4e5d-a0a7-c93c86eee67f tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:54:1e:3c,bridge_name='br-int',has_traffic_filtering=True,id=86250373-f92f-4176-b242-382fa11f4e39,network=Network(450540a3-ff7e-42fb-a0a6-808acd749943),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86250373-f9')
Nov 17 01:35:50 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-429128e5-18c5-4e5d-a0a7-c93c86eee67f tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 2ea5a14b-c330-4a2b-926e-60e1b30f5981] Deleting instance files /opt/stack/data/nova/instances/2ea5a14b-c330-4a2b-926e-60e1b30f5981_del
Nov 17 01:35:50 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-429128e5-18c5-4e5d-a0a7-c93c86eee67f tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 2ea5a14b-c330-4a2b-926e-60e1b30f5981] Deletion of /opt/stack/data/nova/instances/2ea5a14b-c330-4a2b-926e-60e1b30f5981_del complete
Nov 17 01:35:50 user nova-compute[75226]: INFO nova.compute.manager [None req-429128e5-18c5-4e5d-a0a7-c93c86eee67f tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 2ea5a14b-c330-4a2b-926e-60e1b30f5981] Took 0.72 seconds to destroy the instance on the hypervisor.
Nov 17 01:35:50 user nova-compute[75226]: DEBUG oslo.service.loopingcall [None req-429128e5-18c5-4e5d-a0a7-c93c86eee67f tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75226) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 17 01:35:50 user nova-compute[75226]: DEBUG nova.compute.manager [-] [instance: 2ea5a14b-c330-4a2b-926e-60e1b30f5981] Deallocating network for instance {{(pid=75226) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 17 01:35:50 user nova-compute[75226]: DEBUG nova.network.neutron [-] [instance: 2ea5a14b-c330-4a2b-926e-60e1b30f5981] deallocate_for_instance() {{(pid=75226) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 17 01:35:50 user nova-compute[75226]: DEBUG nova.network.neutron [-] [instance: 2ea5a14b-c330-4a2b-926e-60e1b30f5981] Updating instance_info_cache with network_info: [] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:35:50 user nova-compute[75226]: INFO nova.compute.manager [-] [instance: 2ea5a14b-c330-4a2b-926e-60e1b30f5981] Took 0.51 seconds to deallocate network for instance.
Nov 17 01:35:50 user nova-compute[75226]: DEBUG nova.compute.manager [req-435423b3-a219-48e6-be0a-623f7e708151 req-5d89764c-d1c3-4fac-a3cc-aad71dbb687f service nova] [instance: 2ea5a14b-c330-4a2b-926e-60e1b30f5981] Received event network-vif-deleted-86250373-f92f-4176-b242-382fa11f4e39 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:35:50 user nova-compute[75226]: INFO nova.compute.manager [req-435423b3-a219-48e6-be0a-623f7e708151 req-5d89764c-d1c3-4fac-a3cc-aad71dbb687f service nova] [instance: 2ea5a14b-c330-4a2b-926e-60e1b30f5981] Neutron deleted interface 86250373-f92f-4176-b242-382fa11f4e39; detaching it from the instance and deleting it from the info cache
Nov 17 01:35:50 user nova-compute[75226]: DEBUG nova.network.neutron [req-435423b3-a219-48e6-be0a-623f7e708151 req-5d89764c-d1c3-4fac-a3cc-aad71dbb687f service nova] [instance: 2ea5a14b-c330-4a2b-926e-60e1b30f5981] Updating instance_info_cache with network_info: [] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:35:51 user nova-compute[75226]: DEBUG nova.compute.manager [req-435423b3-a219-48e6-be0a-623f7e708151 req-5d89764c-d1c3-4fac-a3cc-aad71dbb687f service nova] [instance: 2ea5a14b-c330-4a2b-926e-60e1b30f5981] Detach interface failed, port_id=86250373-f92f-4176-b242-382fa11f4e39, reason: Instance 2ea5a14b-c330-4a2b-926e-60e1b30f5981 could not be found. {{(pid=75226) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 17 01:35:51 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-429128e5-18c5-4e5d-a0a7-c93c86eee67f tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:35:51 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-429128e5-18c5-4e5d-a0a7-c93c86eee67f tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:35:51 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-429128e5-18c5-4e5d-a0a7-c93c86eee67f tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:35:51 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-429128e5-18c5-4e5d-a0a7-c93c86eee67f tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:35:51 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-429128e5-18c5-4e5d-a0a7-c93c86eee67f tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.334s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:35:51 user nova-compute[75226]: INFO nova.scheduler.client.report [None req-429128e5-18c5-4e5d-a0a7-c93c86eee67f tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Deleted allocations for instance 2ea5a14b-c330-4a2b-926e-60e1b30f5981
Nov 17 01:35:51 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-429128e5-18c5-4e5d-a0a7-c93c86eee67f tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Lock "2ea5a14b-c330-4a2b-926e-60e1b30f5981" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.766s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:35:52 user nova-compute[75226]: DEBUG nova.compute.manager [req-23bbc565-5394-4dfe-b5b1-af268411b94e req-0336301a-e15c-41bd-a7a6-54c3b7292c53 service nova] [instance: 2ea5a14b-c330-4a2b-926e-60e1b30f5981] Received event network-vif-plugged-86250373-f92f-4176-b242-382fa11f4e39 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:35:52 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-23bbc565-5394-4dfe-b5b1-af268411b94e req-0336301a-e15c-41bd-a7a6-54c3b7292c53 service nova] Acquiring lock "2ea5a14b-c330-4a2b-926e-60e1b30f5981-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:35:52 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-23bbc565-5394-4dfe-b5b1-af268411b94e req-0336301a-e15c-41bd-a7a6-54c3b7292c53 service nova] Lock "2ea5a14b-c330-4a2b-926e-60e1b30f5981-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:35:52 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-23bbc565-5394-4dfe-b5b1-af268411b94e req-0336301a-e15c-41bd-a7a6-54c3b7292c53 service nova] Lock "2ea5a14b-c330-4a2b-926e-60e1b30f5981-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:35:52 user nova-compute[75226]: DEBUG nova.compute.manager [req-23bbc565-5394-4dfe-b5b1-af268411b94e req-0336301a-e15c-41bd-a7a6-54c3b7292c53 service nova] [instance: 2ea5a14b-c330-4a2b-926e-60e1b30f5981] No waiting events found dispatching network-vif-plugged-86250373-f92f-4176-b242-382fa11f4e39 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:35:52 user nova-compute[75226]: WARNING nova.compute.manager [req-23bbc565-5394-4dfe-b5b1-af268411b94e req-0336301a-e15c-41bd-a7a6-54c3b7292c53 service nova] [instance: 2ea5a14b-c330-4a2b-926e-60e1b30f5981] Received unexpected event network-vif-plugged-86250373-f92f-4176-b242-382fa11f4e39 for instance with vm_state deleted and task_state None.
Nov 17 01:35:53 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:35:55 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:35:56 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-60b827a9-696d-4309-8542-b6ab6ed63065 tempest-VolumesNegativeTest-618394537 tempest-VolumesNegativeTest-618394537-project-member] Acquiring lock "18a445fd-6ca2-470f-85c4-301cde767284" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:35:56 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-60b827a9-696d-4309-8542-b6ab6ed63065 tempest-VolumesNegativeTest-618394537 tempest-VolumesNegativeTest-618394537-project-member] Lock "18a445fd-6ca2-470f-85c4-301cde767284" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:35:56 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-60b827a9-696d-4309-8542-b6ab6ed63065 tempest-VolumesNegativeTest-618394537 tempest-VolumesNegativeTest-618394537-project-member] Acquiring lock "18a445fd-6ca2-470f-85c4-301cde767284-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:35:56 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-60b827a9-696d-4309-8542-b6ab6ed63065 tempest-VolumesNegativeTest-618394537 tempest-VolumesNegativeTest-618394537-project-member] Lock "18a445fd-6ca2-470f-85c4-301cde767284-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:35:56 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-60b827a9-696d-4309-8542-b6ab6ed63065 tempest-VolumesNegativeTest-618394537 tempest-VolumesNegativeTest-618394537-project-member] Lock "18a445fd-6ca2-470f-85c4-301cde767284-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:35:56 user nova-compute[75226]: INFO nova.compute.manager [None req-60b827a9-696d-4309-8542-b6ab6ed63065 tempest-VolumesNegativeTest-618394537 tempest-VolumesNegativeTest-618394537-project-member] [instance: 18a445fd-6ca2-470f-85c4-301cde767284] Terminating instance
Nov 17 01:35:56 user nova-compute[75226]: DEBUG nova.compute.manager [None req-60b827a9-696d-4309-8542-b6ab6ed63065 tempest-VolumesNegativeTest-618394537 tempest-VolumesNegativeTest-618394537-project-member] [instance: 18a445fd-6ca2-470f-85c4-301cde767284] Start destroying the instance on the hypervisor. {{(pid=75226) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 17 01:35:56 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:35:56 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:35:56 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:35:56 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:35:57 user nova-compute[75226]: DEBUG nova.compute.manager [req-2edff84e-bd45-4623-abc5-865669408b24 req-011f6173-f703-48ca-8f14-78a8b7ee6f30 service nova] [instance: 18a445fd-6ca2-470f-85c4-301cde767284] Received event network-vif-unplugged-abcd9fa6-496b-4a78-87d8-e5e8e2a5a31c {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:35:57 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-2edff84e-bd45-4623-abc5-865669408b24 req-011f6173-f703-48ca-8f14-78a8b7ee6f30 service nova] Acquiring lock "18a445fd-6ca2-470f-85c4-301cde767284-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:35:57 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-2edff84e-bd45-4623-abc5-865669408b24 req-011f6173-f703-48ca-8f14-78a8b7ee6f30 service nova] Lock "18a445fd-6ca2-470f-85c4-301cde767284-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:35:57 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-2edff84e-bd45-4623-abc5-865669408b24 req-011f6173-f703-48ca-8f14-78a8b7ee6f30 service nova] Lock "18a445fd-6ca2-470f-85c4-301cde767284-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:35:57 user nova-compute[75226]: DEBUG nova.compute.manager [req-2edff84e-bd45-4623-abc5-865669408b24 req-011f6173-f703-48ca-8f14-78a8b7ee6f30 service nova] [instance: 18a445fd-6ca2-470f-85c4-301cde767284] No waiting events found dispatching network-vif-unplugged-abcd9fa6-496b-4a78-87d8-e5e8e2a5a31c {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:35:57 user nova-compute[75226]: DEBUG nova.compute.manager [req-2edff84e-bd45-4623-abc5-865669408b24 req-011f6173-f703-48ca-8f14-78a8b7ee6f30 service nova] [instance: 18a445fd-6ca2-470f-85c4-301cde767284] Received event network-vif-unplugged-abcd9fa6-496b-4a78-87d8-e5e8e2a5a31c for instance with task_state deleting. {{(pid=75226) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 17 01:35:57 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:35:57 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:35:57 user nova-compute[75226]: INFO nova.virt.libvirt.driver [-] [instance: 18a445fd-6ca2-470f-85c4-301cde767284] Instance destroyed successfully.
Nov 17 01:35:57 user nova-compute[75226]: DEBUG nova.objects.instance [None req-60b827a9-696d-4309-8542-b6ab6ed63065 tempest-VolumesNegativeTest-618394537 tempest-VolumesNegativeTest-618394537-project-member] Lazy-loading 'resources' on Instance uuid 18a445fd-6ca2-470f-85c4-301cde767284 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:35:57 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-60b827a9-696d-4309-8542-b6ab6ed63065 tempest-VolumesNegativeTest-618394537 tempest-VolumesNegativeTest-618394537-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:34:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1922127987',display_name='tempest-VolumesNegativeTest-instance-1922127987',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1922127987',id=34,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-17T01:34:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b6578c3a9a49416f90039f0a0dcefbfe',ramdisk_id='',reservation_id='r-q3r4id6d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-618394537',owner_user_name='tempest-VolumesNegativeTest-618394537-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T01:34:14Z,user_data=None,user_id='3121ba344d8d4d418e79deda1a1b30af',uuid=18a445fd-6ca2-470f-85c4-301cde767284,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "abcd9fa6-496b-4a78-87d8-e5e8e2a5a31c", "address": "fa:16:3e:60:05:c6", "network": {"id": "918c1267-3f3d-4c5b-8c79-b443112890c6", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.180", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e4e110cbf9a84362a6864a7732c435a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabcd9fa6-49", "ovs_interfaceid": "abcd9fa6-496b-4a78-87d8-e5e8e2a5a31c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 17 01:35:57 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-60b827a9-696d-4309-8542-b6ab6ed63065 tempest-VolumesNegativeTest-618394537 tempest-VolumesNegativeTest-618394537-project-member] Converting VIF {"id": "abcd9fa6-496b-4a78-87d8-e5e8e2a5a31c", "address": "fa:16:3e:60:05:c6", "network": {"id": "918c1267-3f3d-4c5b-8c79-b443112890c6", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.180", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e4e110cbf9a84362a6864a7732c435a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabcd9fa6-49", "ovs_interfaceid": "abcd9fa6-496b-4a78-87d8-e5e8e2a5a31c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:35:57 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-60b827a9-696d-4309-8542-b6ab6ed63065 tempest-VolumesNegativeTest-618394537 tempest-VolumesNegativeTest-618394537-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:05:c6,bridge_name='br-int',has_traffic_filtering=True,id=abcd9fa6-496b-4a78-87d8-e5e8e2a5a31c,network=Network(918c1267-3f3d-4c5b-8c79-b443112890c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabcd9fa6-49') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:35:57 user nova-compute[75226]: DEBUG os_vif [None req-60b827a9-696d-4309-8542-b6ab6ed63065 tempest-VolumesNegativeTest-618394537 tempest-VolumesNegativeTest-618394537-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:05:c6,bridge_name='br-int',has_traffic_filtering=True,id=abcd9fa6-496b-4a78-87d8-e5e8e2a5a31c,network=Network(918c1267-3f3d-4c5b-8c79-b443112890c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabcd9fa6-49') {{(pid=75226) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 17 01:35:57 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:35:57 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapabcd9fa6-49, bridge=br-int, if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:35:57 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:35:57 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:35:57 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:35:57 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2d43d4e1-b977-4afc-bfbc-4104d87622bb) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:35:57 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:35:57 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:35:57 user nova-compute[75226]: INFO os_vif [None req-60b827a9-696d-4309-8542-b6ab6ed63065 tempest-VolumesNegativeTest-618394537 tempest-VolumesNegativeTest-618394537-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:05:c6,bridge_name='br-int',has_traffic_filtering=True,id=abcd9fa6-496b-4a78-87d8-e5e8e2a5a31c,network=Network(918c1267-3f3d-4c5b-8c79-b443112890c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabcd9fa6-49')
Nov 17 01:35:57 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-60b827a9-696d-4309-8542-b6ab6ed63065 tempest-VolumesNegativeTest-618394537 tempest-VolumesNegativeTest-618394537-project-member] [instance: 18a445fd-6ca2-470f-85c4-301cde767284] Deleting instance files /opt/stack/data/nova/instances/18a445fd-6ca2-470f-85c4-301cde767284_del
Nov 17 01:35:57 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-60b827a9-696d-4309-8542-b6ab6ed63065 tempest-VolumesNegativeTest-618394537 tempest-VolumesNegativeTest-618394537-project-member] [instance: 18a445fd-6ca2-470f-85c4-301cde767284] Deletion of /opt/stack/data/nova/instances/18a445fd-6ca2-470f-85c4-301cde767284_del complete
Nov 17 01:35:57 user nova-compute[75226]: INFO nova.compute.manager [None req-60b827a9-696d-4309-8542-b6ab6ed63065 tempest-VolumesNegativeTest-618394537 tempest-VolumesNegativeTest-618394537-project-member] [instance: 18a445fd-6ca2-470f-85c4-301cde767284] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 17 01:35:57 user nova-compute[75226]: DEBUG oslo.service.loopingcall [None req-60b827a9-696d-4309-8542-b6ab6ed63065 tempest-VolumesNegativeTest-618394537 tempest-VolumesNegativeTest-618394537-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75226) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 17 01:35:57 user nova-compute[75226]: DEBUG nova.compute.manager [-] [instance: 18a445fd-6ca2-470f-85c4-301cde767284] Deallocating network for instance {{(pid=75226) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 17 01:35:57 user nova-compute[75226]: DEBUG nova.network.neutron [-] [instance: 18a445fd-6ca2-470f-85c4-301cde767284] deallocate_for_instance() {{(pid=75226) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 17 01:35:58 user nova-compute[75226]: DEBUG nova.network.neutron [-] [instance: 18a445fd-6ca2-470f-85c4-301cde767284] Updating instance_info_cache with network_info: [] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:35:58 user nova-compute[75226]: INFO nova.compute.manager [-] [instance: 18a445fd-6ca2-470f-85c4-301cde767284] Took 0.45 seconds to deallocate network for instance.
Nov 17 01:35:58 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-60b827a9-696d-4309-8542-b6ab6ed63065 tempest-VolumesNegativeTest-618394537 tempest-VolumesNegativeTest-618394537-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:35:58 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-60b827a9-696d-4309-8542-b6ab6ed63065 tempest-VolumesNegativeTest-618394537 tempest-VolumesNegativeTest-618394537-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:35:58 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-60b827a9-696d-4309-8542-b6ab6ed63065 tempest-VolumesNegativeTest-618394537 tempest-VolumesNegativeTest-618394537-project-member] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:35:58 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-60b827a9-696d-4309-8542-b6ab6ed63065 tempest-VolumesNegativeTest-618394537 tempest-VolumesNegativeTest-618394537-project-member] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:35:58 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-60b827a9-696d-4309-8542-b6ab6ed63065 tempest-VolumesNegativeTest-618394537 tempest-VolumesNegativeTest-618394537-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.394s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:35:58 user nova-compute[75226]: INFO nova.scheduler.client.report [None req-60b827a9-696d-4309-8542-b6ab6ed63065 tempest-VolumesNegativeTest-618394537 tempest-VolumesNegativeTest-618394537-project-member] Deleted allocations for instance 18a445fd-6ca2-470f-85c4-301cde767284
Nov 17 01:35:58 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-60b827a9-696d-4309-8542-b6ab6ed63065 tempest-VolumesNegativeTest-618394537 tempest-VolumesNegativeTest-618394537-project-member] Lock "18a445fd-6ca2-470f-85c4-301cde767284" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.962s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:35:59 user nova-compute[75226]: DEBUG nova.compute.manager [req-0d1e007c-809b-4378-aca9-2de945ce56d9 req-8302328e-4cc8-4535-8dcb-b4a419b4d10a service nova] [instance: 18a445fd-6ca2-470f-85c4-301cde767284] Received event network-vif-plugged-abcd9fa6-496b-4a78-87d8-e5e8e2a5a31c {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:35:59 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-0d1e007c-809b-4378-aca9-2de945ce56d9 req-8302328e-4cc8-4535-8dcb-b4a419b4d10a service nova] Acquiring lock "18a445fd-6ca2-470f-85c4-301cde767284-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:35:59 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-0d1e007c-809b-4378-aca9-2de945ce56d9 req-8302328e-4cc8-4535-8dcb-b4a419b4d10a service nova] Lock "18a445fd-6ca2-470f-85c4-301cde767284-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:35:59 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-0d1e007c-809b-4378-aca9-2de945ce56d9 req-8302328e-4cc8-4535-8dcb-b4a419b4d10a service nova] Lock "18a445fd-6ca2-470f-85c4-301cde767284-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:35:59 user nova-compute[75226]: DEBUG nova.compute.manager [req-0d1e007c-809b-4378-aca9-2de945ce56d9 req-8302328e-4cc8-4535-8dcb-b4a419b4d10a service nova] [instance: 18a445fd-6ca2-470f-85c4-301cde767284] No waiting events found dispatching network-vif-plugged-abcd9fa6-496b-4a78-87d8-e5e8e2a5a31c {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:35:59 user nova-compute[75226]: WARNING nova.compute.manager [req-0d1e007c-809b-4378-aca9-2de945ce56d9 req-8302328e-4cc8-4535-8dcb-b4a419b4d10a service nova] [instance: 18a445fd-6ca2-470f-85c4-301cde767284] Received unexpected event network-vif-plugged-abcd9fa6-496b-4a78-87d8-e5e8e2a5a31c for instance with vm_state deleted and task_state None.
Nov 17 01:35:59 user nova-compute[75226]: DEBUG nova.compute.manager [req-0d1e007c-809b-4378-aca9-2de945ce56d9 req-8302328e-4cc8-4535-8dcb-b4a419b4d10a service nova] [instance: 18a445fd-6ca2-470f-85c4-301cde767284] Received event network-vif-deleted-abcd9fa6-496b-4a78-87d8-e5e8e2a5a31c {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:36:02 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:36:02 user nova-compute[75226]: DEBUG nova.compute.manager [req-78f7ddb3-3552-4c75-b7f1-a0ddc55aa225 req-db965540-3ea7-496b-9bb2-bbffec6c28ac service nova] [instance: 8d983732-91aa-4f20-9d7d-3de66029cba5] Received event network-changed-2ef7c6ef-e077-49c7-aaca-1d8ba7e7335c {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:36:02 user nova-compute[75226]: DEBUG nova.compute.manager [req-78f7ddb3-3552-4c75-b7f1-a0ddc55aa225 req-db965540-3ea7-496b-9bb2-bbffec6c28ac service nova] [instance: 8d983732-91aa-4f20-9d7d-3de66029cba5] Refreshing instance network info cache due to event network-changed-2ef7c6ef-e077-49c7-aaca-1d8ba7e7335c. {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 01:36:02 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-78f7ddb3-3552-4c75-b7f1-a0ddc55aa225 req-db965540-3ea7-496b-9bb2-bbffec6c28ac service nova] Acquiring lock "refresh_cache-8d983732-91aa-4f20-9d7d-3de66029cba5" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:36:02 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-78f7ddb3-3552-4c75-b7f1-a0ddc55aa225 req-db965540-3ea7-496b-9bb2-bbffec6c28ac service nova] Acquired lock "refresh_cache-8d983732-91aa-4f20-9d7d-3de66029cba5" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:36:02 user nova-compute[75226]: DEBUG nova.network.neutron [req-78f7ddb3-3552-4c75-b7f1-a0ddc55aa225 req-db965540-3ea7-496b-9bb2-bbffec6c28ac service nova] [instance: 8d983732-91aa-4f20-9d7d-3de66029cba5] Refreshing network info cache for port 2ef7c6ef-e077-49c7-aaca-1d8ba7e7335c {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 01:36:02 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-20e9257d-fe52-4f30-8de8-91f2cd5bb1b1 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Acquiring lock "8d983732-91aa-4f20-9d7d-3de66029cba5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:36:02 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-20e9257d-fe52-4f30-8de8-91f2cd5bb1b1 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Lock "8d983732-91aa-4f20-9d7d-3de66029cba5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:36:02 user nova-compute[75226]: DEBUG nova.objects.instance [None req-20e9257d-fe52-4f30-8de8-91f2cd5bb1b1 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Lazy-loading 'flavor' on Instance uuid 8d983732-91aa-4f20-9d7d-3de66029cba5 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:36:02 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-20e9257d-fe52-4f30-8de8-91f2cd5bb1b1 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Lock "8d983732-91aa-4f20-9d7d-3de66029cba5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:36:03 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-20e9257d-fe52-4f30-8de8-91f2cd5bb1b1 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Acquiring lock "8d983732-91aa-4f20-9d7d-3de66029cba5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:36:03 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-20e9257d-fe52-4f30-8de8-91f2cd5bb1b1 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Lock "8d983732-91aa-4f20-9d7d-3de66029cba5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:36:03 user nova-compute[75226]: INFO nova.compute.manager [None req-20e9257d-fe52-4f30-8de8-91f2cd5bb1b1 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] [instance: 8d983732-91aa-4f20-9d7d-3de66029cba5] Attaching volume 9bb94c67-f3ce-4642-8f8d-3c59a63802ac to /dev/vdb
Nov 17 01:36:03 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:36:03 user nova-compute[75226]: DEBUG os_brick.utils [None req-20e9257d-fe52-4f30-8de8-91f2cd5bb1b1 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:36:03 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:36:03 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:36:03 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[727678ab-9aff-4c4d-98f9-e6ff4a76dbe8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f62857db69\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:36:03 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:36:03 user nova-compute[75226]: DEBUG nova.network.neutron [req-78f7ddb3-3552-4c75-b7f1-a0ddc55aa225 req-db965540-3ea7-496b-9bb2-bbffec6c28ac service nova] [instance: 8d983732-91aa-4f20-9d7d-3de66029cba5] Updated VIF entry in instance network info cache for port 2ef7c6ef-e077-49c7-aaca-1d8ba7e7335c. {{(pid=75226) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 01:36:03 user nova-compute[75226]: DEBUG nova.network.neutron [req-78f7ddb3-3552-4c75-b7f1-a0ddc55aa225 req-db965540-3ea7-496b-9bb2-bbffec6c28ac service nova] [instance: 8d983732-91aa-4f20-9d7d-3de66029cba5] Updating instance_info_cache with network_info: [{"id": "2ef7c6ef-e077-49c7-aaca-1d8ba7e7335c", "address": "fa:16:3e:90:7b:a1", "network": {"id": "a9710b94-56f8-4cf6-9bb6-344b275e5bf2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-512340839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2052a37a068e4d948c57560c0f4445e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ef7c6ef-e0", "ovs_interfaceid": "2ef7c6ef-e077-49c7-aaca-1d8ba7e7335c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:36:03 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:36:03 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1cfdbb8-ceaa-4a18-aaf2-5db598e16ee1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:36:03 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:36:03 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-78f7ddb3-3552-4c75-b7f1-a0ddc55aa225 req-db965540-3ea7-496b-9bb2-bbffec6c28ac service nova] Releasing lock "refresh_cache-8d983732-91aa-4f20-9d7d-3de66029cba5" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:36:03 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:36:03 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[c41bec54-4d2a-4fbb-9bbd-aed5436fe9cb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:36:03 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[40e2a843-857d-47dc-af6a-e6634e86b038]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:36:03 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-20e9257d-fe52-4f30-8de8-91f2cd5bb1b1 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Running cmd (subprocess): nvme version {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:36:03 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-20e9257d-fe52-4f30-8de8-91f2cd5bb1b1 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] 'nvme version' failed. Not Retrying. {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 01:36:03 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.nvmeof [None req-20e9257d-fe52-4f30-8de8-91f2cd5bb1b1 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] nvme not present on system {{(pid=75226) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 17 01:36:03 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:36:03 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 01:36:03 user nova-compute[75226]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 17 01:36:03 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[f853d37a-0886-4cf1-915b-90be861a702c]: (4, '') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:36:03 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-20e9257d-fe52-4f30-8de8-91f2cd5bb1b1 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75226) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 17 01:36:03 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-20e9257d-fe52-4f30-8de8-91f2cd5bb1b1 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75226) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 17 01:36:03 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-20e9257d-fe52-4f30-8de8-91f2cd5bb1b1 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] LIGHTOS: no hostnqn found. {{(pid=75226) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 17 01:36:03 user nova-compute[75226]: DEBUG os_brick.utils [None req-20e9257d-fe52-4f30-8de8-91f2cd5bb1b1 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f62857db69', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:36:03 user nova-compute[75226]: DEBUG nova.virt.block_device [None req-20e9257d-fe52-4f30-8de8-91f2cd5bb1b1 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] [instance: 8d983732-91aa-4f20-9d7d-3de66029cba5] Updating existing volume attachment record: 78fe114a-2595-41e1-816f-b8c1b93b9c4c {{(pid=75226) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 17 01:36:04 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:36:05 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:36:06 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:36:06 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:36:06 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:36:06 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:36:06 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:36:06 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:36:06 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75226) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 17 01:36:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa84e575-bdad-45b9-80ce-86b1c2826fb0/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:36:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa84e575-bdad-45b9-80ce-86b1c2826fb0/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:36:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa84e575-bdad-45b9-80ce-86b1c2826fb0/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:36:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa84e575-bdad-45b9-80ce-86b1c2826fb0/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:36:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38062487-67ca-4962-974f-81456aebe97b/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:36:07 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:36:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38062487-67ca-4962-974f-81456aebe97b/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:36:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38062487-67ca-4962-974f-81456aebe97b/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:36:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38062487-67ca-4962-974f-81456aebe97b/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:36:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c280142-8901-4f83-bde4-baaa097e05b0/disk.rescue --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:36:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c280142-8901-4f83-bde4-baaa097e05b0/disk.rescue --force-share --output=json" returned: 0 in 0.198s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:36:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c280142-8901-4f83-bde4-baaa097e05b0/disk.rescue --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:36:08 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:36:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c280142-8901-4f83-bde4-baaa097e05b0/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:36:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c280142-8901-4f83-bde4-baaa097e05b0/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:36:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c280142-8901-4f83-bde4-baaa097e05b0/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:36:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c280142-8901-4f83-bde4-baaa097e05b0/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:36:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c280142-8901-4f83-bde4-baaa097e05b0/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:36:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6555d72-6094-4ea9-b071-a3d3c8a300a9/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:36:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6555d72-6094-4ea9-b071-a3d3c8a300a9/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:36:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6555d72-6094-4ea9-b071-a3d3c8a300a9/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:36:09 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6555d72-6094-4ea9-b071-a3d3c8a300a9/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:36:09 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75226) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 01:36:09 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d983732-91aa-4f20-9d7d-3de66029cba5/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:36:09 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d983732-91aa-4f20-9d7d-3de66029cba5/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:36:09 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d983732-91aa-4f20-9d7d-3de66029cba5/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:36:09 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d983732-91aa-4f20-9d7d-3de66029cba5/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:36:09 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75226) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 01:36:10 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:36:10 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:36:10 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Hypervisor/Node resource view: name=user free_ram=8138MB free_disk=24.997554779052734GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75226) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 17 01:36:10 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:36:10 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:36:10 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Applying migration context for instance a298d980-feed-4530-9499-f2833b404dcd as it has an incoming, in-progress migration b0f48d1c-5955-4eec-b50d-8c2e90f1e86b. Migration status is finished {{(pid=75226) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 17 01:36:10 user nova-compute[75226]: INFO nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] [instance: a298d980-feed-4530-9499-f2833b404dcd] Updating resource usage from migration b0f48d1c-5955-4eec-b50d-8c2e90f1e86b
Nov 17 01:36:10 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance aa84e575-bdad-45b9-80ce-86b1c2826fb0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:36:10 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 6b7e9611-be35-4e51-b886-91a2fac0a653 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:36:10 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 38062487-67ca-4962-974f-81456aebe97b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:36:10 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance d6555d72-6094-4ea9-b071-a3d3c8a300a9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:36:10 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 5c280142-8901-4f83-bde4-baaa097e05b0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:36:10 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 8d983732-91aa-4f20-9d7d-3de66029cba5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:36:10 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Migration b0f48d1c-5955-4eec-b50d-8c2e90f1e86b is active on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 17 01:36:10 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance a298d980-feed-4530-9499-f2833b404dcd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:36:10 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75226) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 17 01:36:10 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75226) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 17 01:36:10 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:36:10 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:36:10 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Compute_service record updated for user:user {{(pid=75226) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 17 01:36:10 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.606s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:36:11 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:36:11 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:36:11 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-20e9257d-fe52-4f30-8de8-91f2cd5bb1b1 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] [instance: 8d983732-91aa-4f20-9d7d-3de66029cba5] Calling os-brick to attach iSCSI Volume {{(pid=75226) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 17 01:36:11 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-20e9257d-fe52-4f30-8de8-91f2cd5bb1b1 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc4cc36b490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9bb94c67-f3ce-4642-8f8d-3c59a63802ac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AyETfcZx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:36:11 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-20e9257d-fe52-4f30-8de8-91f2cd5bb1b1 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:36:11 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-20e9257d-fe52-4f30-8de8-91f2cd5bb1b1 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:36:11 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-20e9257d-fe52-4f30-8de8-91f2cd5bb1b1 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:36:11 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-20e9257d-fe52-4f30-8de8-91f2cd5bb1b1 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:36:11 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-20e9257d-fe52-4f30-8de8-91f2cd5bb1b1 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9bb94c67-f3ce-4642-8f8d-3c59a63802ac" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:36:11 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-20e9257d-fe52-4f30-8de8-91f2cd5bb1b1 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9bb94c67-f3ce-4642-8f8d-3c59a63802ac" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:36:11 user nova-compute[75226]: INFO os_brick.initiator.connectors.iscsi [None req-20e9257d-fe52-4f30-8de8-91f2cd5bb1b1 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 17 01:36:11 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9bb94c67-f3ce-4642-8f8d-3c59a63802ac -p 172.16.0.220:3260 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:36:11 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:36:11 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9bb94c67-f3ce-4642-8f8d-3c59a63802ac -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:36:11 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f660dec-ad71-4400-870d-70eb5359ee5b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:36:11 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-20e9257d-fe52-4f30-8de8-91f2cd5bb1b1 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 17 01:36:11 user nova-compute[75226]:  {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:36:11 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9bb94c67-f3ce-4642-8f8d-3c59a63802ac -p 172.16.0.220:3260 --interface default --op new {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:36:11 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9bb94c67-f3ce-4642-8f8d-3c59a63802ac -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:36:11 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7427bba-323a-47f6-998e-a8ba08854771]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9bb94c67-f3ce-4642-8f8d-3c59a63802ac] added\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:36:11 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-20e9257d-fe52-4f30-8de8-91f2cd5bb1b1 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9bb94c67-f3ce-4642-8f8d-3c59a63802ac] added
Nov 17 01:36:11 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:36:11 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9bb94c67-f3ce-4642-8f8d-3c59a63802ac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:36:12 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9bb94c67-f3ce-4642-8f8d-3c59a63802ac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:36:12 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a636cb9-921d-49f2-bd59-6445959fa7f2]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:36:12 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-20e9257d-fe52-4f30-8de8-91f2cd5bb1b1 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:36:12 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9bb94c67-f3ce-4642-8f8d-3c59a63802ac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:36:12 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9bb94c67-f3ce-4642-8f8d-3c59a63802ac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:36:12 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[2709baa5-4bba-48be-af99-3fcb3eb79a61]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:36:12 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-20e9257d-fe52-4f30-8de8-91f2cd5bb1b1 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:36:12 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9bb94c67-f3ce-4642-8f8d-3c59a63802ac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AyETfcZx {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:36:12 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9bb94c67-f3ce-4642-8f8d-3c59a63802ac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AyETfcZx" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:36:12 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[a85b0e85-7a61-466e-99e5-7fcce6d5b560]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:36:12 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-20e9257d-fe52-4f30-8de8-91f2cd5bb1b1 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AyETfcZx'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:36:12 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9bb94c67-f3ce-4642-8f8d-3c59a63802ac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:36:12 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9bb94c67-f3ce-4642-8f8d-3c59a63802ac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:36:12 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[f194ed19-ed39-4c41-aea7-f30c9a5ea3aa]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:36:12 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-20e9257d-fe52-4f30-8de8-91f2cd5bb1b1 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:36:12 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:36:12 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:36:12 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[98a56dd1-06c8-4aae-8f05-614d44a88b73]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:36:12 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-20e9257d-fe52-4f30-8de8-91f2cd5bb1b1 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)
Nov 17 01:36:12 user nova-compute[75226]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419 (non-flash)
Nov 17 01:36:12 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:36:12 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-20e9257d-fe52-4f30-8de8-91f2cd5bb1b1 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)
Nov 17 01:36:12 user nova-compute[75226]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419 (non-flash)
Nov 17 01:36:12 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:36:12 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9bb94c67-f3ce-4642-8f8d-3c59a63802ac -p 172.16.0.220:3260 --login {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:36:12 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9bb94c67-f3ce-4642-8f8d-3c59a63802ac -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:36:12 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[455cfb04-b2db-47ef-a026-e3358a79c160]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9bb94c67-f3ce-4642-8f8d-3c59a63802ac, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9bb94c67-f3ce-4642-8f8d-3c59a63802ac, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:36:12 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-20e9257d-fe52-4f30-8de8-91f2cd5bb1b1 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9bb94c67-f3ce-4642-8f8d-3c59a63802ac, portal: 172.16.0.220,3260]
Nov 17 01:36:12 user nova-compute[75226]: Login to [iface: default, target: iqn.2010-10.org.openstack:9bb94c67-f3ce-4642-8f8d-3c59a63802ac, portal: 172.16.0.220,3260] successful.
Nov 17 01:36:12 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:36:12 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9bb94c67-f3ce-4642-8f8d-3c59a63802ac -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:36:12 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9bb94c67-f3ce-4642-8f8d-3c59a63802ac -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:36:12 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[813795fd-b64e-4762-a033-4b2eadd2599f]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:36:12 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-20e9257d-fe52-4f30-8de8-91f2cd5bb1b1 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:36:12 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:36:12 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:36:12 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[362c1fac-fae4-49c4-8e02-aa624d94cfaf]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bb94c67-f3ce-4642-8f8d-3c59a63802ac (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:36:12 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-20e9257d-fe52-4f30-8de8-91f2cd5bb1b1 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)
Nov 17 01:36:12 user nova-compute[75226]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419 (non-flash)
Nov 17 01:36:12 user nova-compute[75226]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bb94c67-f3ce-4642-8f8d-3c59a63802ac (non-flash)
Nov 17 01:36:12 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:36:12 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-20e9257d-fe52-4f30-8de8-91f2cd5bb1b1 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)
Nov 17 01:36:12 user nova-compute[75226]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419 (non-flash)
Nov 17 01:36:12 user nova-compute[75226]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bb94c67-f3ce-4642-8f8d-3c59a63802ac (non-flash)
Nov 17 01:36:12 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:36:12 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-20e9257d-fe52-4f30-8de8-91f2cd5bb1b1 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9bb94c67-f3ce-4642-8f8d-3c59a63802ac" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.284s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:36:12 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-20e9257d-fe52-4f30-8de8-91f2cd5bb1b1 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Connected to 172.16.0.220:3260 {{(pid=75226) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 17 01:36:12 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-20e9257d-fe52-4f30-8de8-91f2cd5bb1b1 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] HCTL ('35', '-', '-', 0) found on session 40 with lun 0 {{(pid=75226) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 17 01:36:12 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-20e9257d-fe52-4f30-8de8-91f2cd5bb1b1 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75226) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 17 01:36:12 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:36:12 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:36:12 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[a50facec-9244-429c-aa77-3c7be6dcf239]: (4, ('- - 0', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:36:12 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-20e9257d-fe52-4f30-8de8-91f2cd5bb1b1 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Searching for a device in session 40 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75226) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 01:36:12 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-20e9257d-fe52-4f30-8de8-91f2cd5bb1b1 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:9bb94c67-f3ce-4642-8f8d-3c59a63802ac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AyETfcZx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75226) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 17 01:36:12 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:36:13 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:36:13 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-20e9257d-fe52-4f30-8de8-91f2cd5bb1b1 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.320s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:36:13 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-20e9257d-fe52-4f30-8de8-91f2cd5bb1b1 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] <== connect_volume: return (1322ms) {'type': 'block', 'scsi_wwn': '26235346564313265', 'path': '/dev/sdd'} {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:36:13 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-20e9257d-fe52-4f30-8de8-91f2cd5bb1b1 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] [instance: 8d983732-91aa-4f20-9d7d-3de66029cba5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26235346564313265', 'path': '/dev/sdd'} {{(pid=75226) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 17 01:36:13 user nova-compute[75226]: DEBUG nova.objects.instance [None req-20e9257d-fe52-4f30-8de8-91f2cd5bb1b1 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Lazy-loading 'flavor' on Instance uuid 8d983732-91aa-4f20-9d7d-3de66029cba5 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:36:13 user nova-compute[75226]: DEBUG nova.virt.libvirt.guest [None req-20e9257d-fe52-4f30-8de8-91f2cd5bb1b1 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] attach device xml: <disk type="block" device="disk">
Nov 17 01:36:13 user nova-compute[75226]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 01:36:13 user nova-compute[75226]:   <source dev="/dev/sdd"/>
Nov 17 01:36:13 user nova-compute[75226]:   <target dev="vdb" bus="virtio"/>
Nov 17 01:36:13 user nova-compute[75226]:   <serial>9bb94c67-f3ce-4642-8f8d-3c59a63802ac</serial>
Nov 17 01:36:13 user nova-compute[75226]: </disk>
Nov 17 01:36:13 user nova-compute[75226]:  {{(pid=75226) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 17 01:36:13 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-20e9257d-fe52-4f30-8de8-91f2cd5bb1b1 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] No BDM found with device name vda, not building metadata. {{(pid=75226) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 01:36:13 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-20e9257d-fe52-4f30-8de8-91f2cd5bb1b1 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75226) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 01:36:13 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-20e9257d-fe52-4f30-8de8-91f2cd5bb1b1 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] No VIF found with MAC fa:16:3e:90:7b:a1, not building metadata {{(pid=75226) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 01:36:13 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-20e9257d-fe52-4f30-8de8-91f2cd5bb1b1 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Lock "8d983732-91aa-4f20-9d7d-3de66029cba5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.731s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:36:14 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:36:15 user nova-compute[75226]: INFO nova.compute.manager [None req-29835320-3b4a-4c6b-a27e-5419a9be07d0 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] [instance: 8d983732-91aa-4f20-9d7d-3de66029cba5] Rescuing
Nov 17 01:36:15 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-29835320-3b4a-4c6b-a27e-5419a9be07d0 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Acquiring lock "refresh_cache-8d983732-91aa-4f20-9d7d-3de66029cba5" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:36:15 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-29835320-3b4a-4c6b-a27e-5419a9be07d0 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Acquired lock "refresh_cache-8d983732-91aa-4f20-9d7d-3de66029cba5" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:36:15 user nova-compute[75226]: DEBUG nova.network.neutron [None req-29835320-3b4a-4c6b-a27e-5419a9be07d0 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] [instance: 8d983732-91aa-4f20-9d7d-3de66029cba5] Building network info cache for instance {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 01:36:15 user nova-compute[75226]: DEBUG nova.network.neutron [None req-29835320-3b4a-4c6b-a27e-5419a9be07d0 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] [instance: 8d983732-91aa-4f20-9d7d-3de66029cba5] Updating instance_info_cache with network_info: [{"id": "2ef7c6ef-e077-49c7-aaca-1d8ba7e7335c", "address": "fa:16:3e:90:7b:a1", "network": {"id": "a9710b94-56f8-4cf6-9bb6-344b275e5bf2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-512340839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2052a37a068e4d948c57560c0f4445e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ef7c6ef-e0", "ovs_interfaceid": "2ef7c6ef-e077-49c7-aaca-1d8ba7e7335c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:36:15 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-29835320-3b4a-4c6b-a27e-5419a9be07d0 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Releasing lock "refresh_cache-8d983732-91aa-4f20-9d7d-3de66029cba5" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:36:15 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:36:15 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:36:16 user nova-compute[75226]: DEBUG nova.compute.manager [req-a5d67a0d-b9a1-41d9-b9ed-879700f40446 req-f7e3725d-e1e9-4ebe-ab3d-312e822dcd90 service nova] [instance: 8d983732-91aa-4f20-9d7d-3de66029cba5] Received event network-vif-unplugged-2ef7c6ef-e077-49c7-aaca-1d8ba7e7335c {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:36:16 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-a5d67a0d-b9a1-41d9-b9ed-879700f40446 req-f7e3725d-e1e9-4ebe-ab3d-312e822dcd90 service nova] Acquiring lock "8d983732-91aa-4f20-9d7d-3de66029cba5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:36:16 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-a5d67a0d-b9a1-41d9-b9ed-879700f40446 req-f7e3725d-e1e9-4ebe-ab3d-312e822dcd90 service nova] Lock "8d983732-91aa-4f20-9d7d-3de66029cba5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:36:16 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-a5d67a0d-b9a1-41d9-b9ed-879700f40446 req-f7e3725d-e1e9-4ebe-ab3d-312e822dcd90 service nova] Lock "8d983732-91aa-4f20-9d7d-3de66029cba5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:36:16 user nova-compute[75226]: DEBUG nova.compute.manager [req-a5d67a0d-b9a1-41d9-b9ed-879700f40446 req-f7e3725d-e1e9-4ebe-ab3d-312e822dcd90 service nova] [instance: 8d983732-91aa-4f20-9d7d-3de66029cba5] No waiting events found dispatching network-vif-unplugged-2ef7c6ef-e077-49c7-aaca-1d8ba7e7335c {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:36:16 user nova-compute[75226]: WARNING nova.compute.manager [req-a5d67a0d-b9a1-41d9-b9ed-879700f40446 req-f7e3725d-e1e9-4ebe-ab3d-312e822dcd90 service nova] [instance: 8d983732-91aa-4f20-9d7d-3de66029cba5] Received unexpected event network-vif-unplugged-2ef7c6ef-e077-49c7-aaca-1d8ba7e7335c for instance with vm_state active and task_state rescuing.
Nov 17 01:36:16 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:36:16 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:36:16 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:36:16 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:36:16 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:36:16 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:36:16 user nova-compute[75226]: INFO nova.virt.libvirt.driver [-] [instance: 8d983732-91aa-4f20-9d7d-3de66029cba5] Instance destroyed successfully.
Nov 17 01:36:16 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-29835320-3b4a-4c6b-a27e-5419a9be07d0 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] [instance: 8d983732-91aa-4f20-9d7d-3de66029cba5] Attempting rescue
Nov 17 01:36:16 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-29835320-3b4a-4c6b-a27e-5419a9be07d0 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75226) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 17 01:36:16 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:36:16 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-29835320-3b4a-4c6b-a27e-5419a9be07d0 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] [instance: 8d983732-91aa-4f20-9d7d-3de66029cba5] Instance directory exists: not creating {{(pid=75226) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 17 01:36:16 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-29835320-3b4a-4c6b-a27e-5419a9be07d0 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] [instance: 8d983732-91aa-4f20-9d7d-3de66029cba5] Creating image(s)
Nov 17 01:36:16 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-29835320-3b4a-4c6b-a27e-5419a9be07d0 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Acquiring lock "/opt/stack/data/nova/instances/8d983732-91aa-4f20-9d7d-3de66029cba5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:36:16 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-29835320-3b4a-4c6b-a27e-5419a9be07d0 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Lock "/opt/stack/data/nova/instances/8d983732-91aa-4f20-9d7d-3de66029cba5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:36:16 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-29835320-3b4a-4c6b-a27e-5419a9be07d0 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Lock "/opt/stack/data/nova/instances/8d983732-91aa-4f20-9d7d-3de66029cba5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:36:16 user nova-compute[75226]: DEBUG nova.objects.instance [None req-29835320-3b4a-4c6b-a27e-5419a9be07d0 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Lazy-loading 'trusted_certs' on Instance uuid 8d983732-91aa-4f20-9d7d-3de66029cba5 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:36:16 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-29835320-3b4a-4c6b-a27e-5419a9be07d0 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Acquiring lock "a8a62c2546af3a2036b853250c5ac64d4c6b4371" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:36:16 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-29835320-3b4a-4c6b-a27e-5419a9be07d0 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Lock "a8a62c2546af3a2036b853250c5ac64d4c6b4371" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:36:16 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-29835320-3b4a-4c6b-a27e-5419a9be07d0 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:36:16 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:36:16 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:36:16 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-29835320-3b4a-4c6b-a27e-5419a9be07d0 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json" returned: 0 in 0.213s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:36:16 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-29835320-3b4a-4c6b-a27e-5419a9be07d0 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371,backing_fmt=raw /opt/stack/data/nova/instances/8d983732-91aa-4f20-9d7d-3de66029cba5/disk.rescue {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:36:16 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-29835320-3b4a-4c6b-a27e-5419a9be07d0 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371,backing_fmt=raw /opt/stack/data/nova/instances/8d983732-91aa-4f20-9d7d-3de66029cba5/disk.rescue" returned: 0 in 0.052s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:36:16 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-29835320-3b4a-4c6b-a27e-5419a9be07d0 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Lock "a8a62c2546af3a2036b853250c5ac64d4c6b4371" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.271s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:36:16 user nova-compute[75226]: DEBUG nova.objects.instance [None req-29835320-3b4a-4c6b-a27e-5419a9be07d0 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Lazy-loading 'migration_context' on Instance uuid 8d983732-91aa-4f20-9d7d-3de66029cba5 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:36:16 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:36:16 user nova-compute[75226]: DEBUG nova.objects.base [None req-29835320-3b4a-4c6b-a27e-5419a9be07d0 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Object Instance<8d983732-91aa-4f20-9d7d-3de66029cba5> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75226) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 17 01:36:16 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-29835320-3b4a-4c6b-a27e-5419a9be07d0 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] [instance: 8d983732-91aa-4f20-9d7d-3de66029cba5] Created local disks {{(pid=75226) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 17 01:36:16 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-29835320-3b4a-4c6b-a27e-5419a9be07d0 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] [instance: 8d983732-91aa-4f20-9d7d-3de66029cba5] Start _get_guest_xml network_info=[{"id": "2ef7c6ef-e077-49c7-aaca-1d8ba7e7335c", "address": "fa:16:3e:90:7b:a1", "network": {"id": "a9710b94-56f8-4cf6-9bb6-344b275e5bf2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-512340839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-512340839-network", "vif_mac": "fa:16:3e:90:7b:a1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2052a37a068e4d948c57560c0f4445e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ef7c6ef-e0", "ovs_interfaceid": "2ef7c6ef-e077-49c7-aaca-1d8ba7e7335c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T01:13:22Z,direct_url=<?>,disk_format='qcow2',id=0b369aea-6f3f-4690-9f01-229b90ab6310,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4e110cbf9a84362a6864a7732c435a1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T01:13:23Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '0b369aea-6f3f-4690-9f01-229b90ab6310', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75226) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 17 01:36:16 user nova-compute[75226]: DEBUG nova.objects.instance [None req-29835320-3b4a-4c6b-a27e-5419a9be07d0 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Lazy-loading 'resources' on Instance uuid 8d983732-91aa-4f20-9d7d-3de66029cba5 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:36:17 user nova-compute[75226]: DEBUG nova.objects.base [None req-29835320-3b4a-4c6b-a27e-5419a9be07d0 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Object Instance<8d983732-91aa-4f20-9d7d-3de66029cba5> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75226) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 17 01:36:17 user nova-compute[75226]: DEBUG nova.objects.instance [None req-29835320-3b4a-4c6b-a27e-5419a9be07d0 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Lazy-loading 'numa_topology' on Instance uuid 8d983732-91aa-4f20-9d7d-3de66029cba5 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:36:17 user nova-compute[75226]: DEBUG nova.objects.base [None req-29835320-3b4a-4c6b-a27e-5419a9be07d0 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Object Instance<8d983732-91aa-4f20-9d7d-3de66029cba5> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75226) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 17 01:36:17 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-29835320-3b4a-4c6b-a27e-5419a9be07d0 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:36:17 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-29835320-3b4a-4c6b-a27e-5419a9be07d0 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:36:17 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-29835320-3b4a-4c6b-a27e-5419a9be07d0 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75226) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 17 01:36:17 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-29835320-3b4a-4c6b-a27e-5419a9be07d0 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] CPU controller missing on host. {{(pid=75226) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 17 01:36:17 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-29835320-3b4a-4c6b-a27e-5419a9be07d0 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75226) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 17 01:36:17 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-29835320-3b4a-4c6b-a27e-5419a9be07d0 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] CPU controller found on host. {{(pid=75226) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 17 01:36:17 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-29835320-3b4a-4c6b-a27e-5419a9be07d0 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75226) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 17 01:36:17 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-29835320-3b4a-4c6b-a27e-5419a9be07d0 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-17T01:13:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T01:13:22Z,direct_url=<?>,disk_format='qcow2',id=0b369aea-6f3f-4690-9f01-229b90ab6310,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4e110cbf9a84362a6864a7732c435a1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T01:13:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 17 01:36:17 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-29835320-3b4a-4c6b-a27e-5419a9be07d0 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Flavor limits 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 17 01:36:17 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-29835320-3b4a-4c6b-a27e-5419a9be07d0 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Image limits 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 17 01:36:17 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-29835320-3b4a-4c6b-a27e-5419a9be07d0 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Flavor pref 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 17 01:36:17 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-29835320-3b4a-4c6b-a27e-5419a9be07d0 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Image pref 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 17 01:36:17 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-29835320-3b4a-4c6b-a27e-5419a9be07d0 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 17 01:36:17 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-29835320-3b4a-4c6b-a27e-5419a9be07d0 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 17 01:36:17 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-29835320-3b4a-4c6b-a27e-5419a9be07d0 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75226) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 17 01:36:17 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-29835320-3b4a-4c6b-a27e-5419a9be07d0 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Got 1 possible topologies {{(pid=75226) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 17 01:36:17 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-29835320-3b4a-4c6b-a27e-5419a9be07d0 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 17 01:36:17 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-29835320-3b4a-4c6b-a27e-5419a9be07d0 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 17 01:36:17 user nova-compute[75226]: DEBUG nova.objects.instance [None req-29835320-3b4a-4c6b-a27e-5419a9be07d0 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Lazy-loading 'vcpu_model' on Instance uuid 8d983732-91aa-4f20-9d7d-3de66029cba5 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:36:17 user nova-compute[75226]: DEBUG nova.objects.base [None req-29835320-3b4a-4c6b-a27e-5419a9be07d0 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Object Instance<8d983732-91aa-4f20-9d7d-3de66029cba5> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75226) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 17 01:36:17 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-29835320-3b4a-4c6b-a27e-5419a9be07d0 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:34:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-483037740',display_name='tempest-ServerRescueNegativeTestJSON-server-483037740',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-483037740',id=35,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOVRakfmKG4XwLomtS+/jC13ImozUfCSHgByLANg2qVBj+muP2PNHXh8ZrfOah4b/BlgXMz/oIJTeq+c9dBzYhbjAocJ7t33Td2l/vK8u2gWzu5nr29e4L+F2Hdr873C7g==',key_name='tempest-keypair-769708112',keypairs=<?>,launch_index=0,launched_at=2023-11-17T01:34:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2052a37a068e4d948c57560c0f4445e4',ramdisk_id='',reservation_id='r-fwlr0hcq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-344970408',owner_user_name='tempest-ServerRescueNegativeTestJSON-344970408-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T01:34:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='12f405f1486a4f5187e628c60f223e98',uuid=8d983732-91aa-4f20-9d7d-3de66029cba5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2ef7c6ef-e077-49c7-aaca-1d8ba7e7335c", "address": "fa:16:3e:90:7b:a1", "network": {"id": "a9710b94-56f8-4cf6-9bb6-344b275e5bf2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-512340839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-512340839-network", "vif_mac": "fa:16:3e:90:7b:a1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2052a37a068e4d948c57560c0f4445e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ef7c6ef-e0", "ovs_interfaceid": "2ef7c6ef-e077-49c7-aaca-1d8ba7e7335c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75226) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 01:36:17 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-29835320-3b4a-4c6b-a27e-5419a9be07d0 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Converting VIF {"id": "2ef7c6ef-e077-49c7-aaca-1d8ba7e7335c", "address": "fa:16:3e:90:7b:a1", "network": {"id": "a9710b94-56f8-4cf6-9bb6-344b275e5bf2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-512340839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-512340839-network", "vif_mac": "fa:16:3e:90:7b:a1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2052a37a068e4d948c57560c0f4445e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ef7c6ef-e0", "ovs_interfaceid": "2ef7c6ef-e077-49c7-aaca-1d8ba7e7335c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:36:17 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-29835320-3b4a-4c6b-a27e-5419a9be07d0 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:90:7b:a1,bridge_name='br-int',has_traffic_filtering=True,id=2ef7c6ef-e077-49c7-aaca-1d8ba7e7335c,network=Network(a9710b94-56f8-4cf6-9bb6-344b275e5bf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ef7c6ef-e0') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:36:17 user nova-compute[75226]: DEBUG nova.objects.instance [None req-29835320-3b4a-4c6b-a27e-5419a9be07d0 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Lazy-loading 'pci_devices' on Instance uuid 8d983732-91aa-4f20-9d7d-3de66029cba5 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:36:17 user nova-compute[75226]: DEBUG nova.objects.base [None req-29835320-3b4a-4c6b-a27e-5419a9be07d0 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Object Instance<8d983732-91aa-4f20-9d7d-3de66029cba5> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75226) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 17 01:36:17 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-29835320-3b4a-4c6b-a27e-5419a9be07d0 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] [instance: 8d983732-91aa-4f20-9d7d-3de66029cba5] End _get_guest_xml xml=<domain type="kvm">
Nov 17 01:36:17 user nova-compute[75226]:   <uuid>8d983732-91aa-4f20-9d7d-3de66029cba5</uuid>
Nov 17 01:36:17 user nova-compute[75226]:   <name>instance-00000023</name>
Nov 17 01:36:17 user nova-compute[75226]:   <memory>524288</memory>
Nov 17 01:36:17 user nova-compute[75226]:   <vcpu>1</vcpu>
Nov 17 01:36:17 user nova-compute[75226]:   <metadata>
Nov 17 01:36:17 user nova-compute[75226]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 17 01:36:17 user nova-compute[75226]:       <nova:package version="0.0.0"/>
Nov 17 01:36:17 user nova-compute[75226]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-483037740</nova:name>
Nov 17 01:36:17 user nova-compute[75226]:       <nova:creationTime>2023-11-17 01:36:17</nova:creationTime>
Nov 17 01:36:17 user nova-compute[75226]:       <nova:flavor name="m1.tiny">
Nov 17 01:36:17 user nova-compute[75226]:         <nova:memory>512</nova:memory>
Nov 17 01:36:17 user nova-compute[75226]:         <nova:disk>1</nova:disk>
Nov 17 01:36:17 user nova-compute[75226]:         <nova:swap>0</nova:swap>
Nov 17 01:36:17 user nova-compute[75226]:         <nova:ephemeral>0</nova:ephemeral>
Nov 17 01:36:17 user nova-compute[75226]:         <nova:vcpus>1</nova:vcpus>
Nov 17 01:36:17 user nova-compute[75226]:       </nova:flavor>
Nov 17 01:36:17 user nova-compute[75226]:       <nova:owner>
Nov 17 01:36:17 user nova-compute[75226]:         <nova:user uuid="12f405f1486a4f5187e628c60f223e98">tempest-ServerRescueNegativeTestJSON-344970408-project-member</nova:user>
Nov 17 01:36:17 user nova-compute[75226]:         <nova:project uuid="2052a37a068e4d948c57560c0f4445e4">tempest-ServerRescueNegativeTestJSON-344970408</nova:project>
Nov 17 01:36:17 user nova-compute[75226]:       </nova:owner>
Nov 17 01:36:17 user nova-compute[75226]:       <nova:root type="image" uuid="0b369aea-6f3f-4690-9f01-229b90ab6310"/>
Nov 17 01:36:17 user nova-compute[75226]:       <nova:ports>
Nov 17 01:36:17 user nova-compute[75226]:         <nova:port uuid="2ef7c6ef-e077-49c7-aaca-1d8ba7e7335c">
Nov 17 01:36:17 user nova-compute[75226]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 17 01:36:17 user nova-compute[75226]:         </nova:port>
Nov 17 01:36:17 user nova-compute[75226]:       </nova:ports>
Nov 17 01:36:17 user nova-compute[75226]:     </nova:instance>
Nov 17 01:36:17 user nova-compute[75226]:   </metadata>
Nov 17 01:36:17 user nova-compute[75226]:   <sysinfo type="smbios">
Nov 17 01:36:17 user nova-compute[75226]:     <system>
Nov 17 01:36:17 user nova-compute[75226]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 17 01:36:17 user nova-compute[75226]:       <entry name="product">OpenStack Nova</entry>
Nov 17 01:36:17 user nova-compute[75226]:       <entry name="version">0.0.0</entry>
Nov 17 01:36:17 user nova-compute[75226]:       <entry name="serial">8d983732-91aa-4f20-9d7d-3de66029cba5</entry>
Nov 17 01:36:17 user nova-compute[75226]:       <entry name="uuid">8d983732-91aa-4f20-9d7d-3de66029cba5</entry>
Nov 17 01:36:17 user nova-compute[75226]:       <entry name="family">Virtual Machine</entry>
Nov 17 01:36:17 user nova-compute[75226]:     </system>
Nov 17 01:36:17 user nova-compute[75226]:   </sysinfo>
Nov 17 01:36:17 user nova-compute[75226]:   <os>
Nov 17 01:36:17 user nova-compute[75226]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 17 01:36:17 user nova-compute[75226]:     <smbios mode="sysinfo"/>
Nov 17 01:36:17 user nova-compute[75226]:   </os>
Nov 17 01:36:17 user nova-compute[75226]:   <features>
Nov 17 01:36:17 user nova-compute[75226]:     <acpi/>
Nov 17 01:36:17 user nova-compute[75226]:     <apic/>
Nov 17 01:36:17 user nova-compute[75226]:     <vmcoreinfo/>
Nov 17 01:36:17 user nova-compute[75226]:   </features>
Nov 17 01:36:17 user nova-compute[75226]:   <clock offset="utc">
Nov 17 01:36:17 user nova-compute[75226]:     <timer name="pit" tickpolicy="delay"/>
Nov 17 01:36:17 user nova-compute[75226]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 17 01:36:17 user nova-compute[75226]:     <timer name="hpet" present="no"/>
Nov 17 01:36:17 user nova-compute[75226]:   </clock>
Nov 17 01:36:17 user nova-compute[75226]:   <cpu mode="custom" match="exact">
Nov 17 01:36:17 user nova-compute[75226]:     <model>Nehalem</model>
Nov 17 01:36:17 user nova-compute[75226]:     <topology sockets="1" cores="1" threads="1"/>
Nov 17 01:36:17 user nova-compute[75226]:   </cpu>
Nov 17 01:36:17 user nova-compute[75226]:   <devices>
Nov 17 01:36:17 user nova-compute[75226]:     <disk type="file" device="disk">
Nov 17 01:36:17 user nova-compute[75226]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 17 01:36:17 user nova-compute[75226]:       <source file="/opt/stack/data/nova/instances/8d983732-91aa-4f20-9d7d-3de66029cba5/disk.rescue"/>
Nov 17 01:36:17 user nova-compute[75226]:       <target dev="vda" bus="virtio"/>
Nov 17 01:36:17 user nova-compute[75226]:     </disk>
Nov 17 01:36:17 user nova-compute[75226]:     <disk type="file" device="disk">
Nov 17 01:36:17 user nova-compute[75226]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 17 01:36:17 user nova-compute[75226]:       <source file="/opt/stack/data/nova/instances/8d983732-91aa-4f20-9d7d-3de66029cba5/disk"/>
Nov 17 01:36:17 user nova-compute[75226]:       <target dev="vdb" bus="virtio"/>
Nov 17 01:36:17 user nova-compute[75226]:     </disk>
Nov 17 01:36:17 user nova-compute[75226]:     <interface type="ethernet">
Nov 17 01:36:17 user nova-compute[75226]:       <mac address="fa:16:3e:90:7b:a1"/>
Nov 17 01:36:17 user nova-compute[75226]:       <model type="virtio"/>
Nov 17 01:36:17 user nova-compute[75226]:       <mtu size="1442"/>
Nov 17 01:36:17 user nova-compute[75226]:       <target dev="tap2ef7c6ef-e0"/>
Nov 17 01:36:17 user nova-compute[75226]:     </interface>
Nov 17 01:36:17 user nova-compute[75226]:     <serial type="pty">
Nov 17 01:36:17 user nova-compute[75226]:       <log file="/opt/stack/data/nova/instances/8d983732-91aa-4f20-9d7d-3de66029cba5/console.log" append="off"/>
Nov 17 01:36:17 user nova-compute[75226]:     </serial>
Nov 17 01:36:17 user nova-compute[75226]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 17 01:36:17 user nova-compute[75226]:     <video>
Nov 17 01:36:17 user nova-compute[75226]:       <model type="virtio"/>
Nov 17 01:36:17 user nova-compute[75226]:     </video>
Nov 17 01:36:17 user nova-compute[75226]:     <rng model="virtio">
Nov 17 01:36:17 user nova-compute[75226]:       <backend model="random">/dev/urandom</backend>
Nov 17 01:36:17 user nova-compute[75226]:     </rng>
Nov 17 01:36:17 user nova-compute[75226]:     <controller type="usb" index="0" model="none"/>
Nov 17 01:36:17 user nova-compute[75226]:     <memballoon model="virtio">
Nov 17 01:36:17 user nova-compute[75226]:       <stats period="10"/>
Nov 17 01:36:17 user nova-compute[75226]:     </memballoon>
Nov 17 01:36:17 user nova-compute[75226]:   </devices>
Nov 17 01:36:17 user nova-compute[75226]: </domain>
Nov 17 01:36:17 user nova-compute[75226]:  {{(pid=75226) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 17 01:36:17 user nova-compute[75226]: INFO nova.virt.libvirt.driver [-] [instance: 8d983732-91aa-4f20-9d7d-3de66029cba5] Instance destroyed successfully.
Nov 17 01:36:17 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:36:17 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:36:17 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-29835320-3b4a-4c6b-a27e-5419a9be07d0 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] No BDM found with device name vda, not building metadata. {{(pid=75226) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 01:36:17 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-29835320-3b4a-4c6b-a27e-5419a9be07d0 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75226) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 01:36:17 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-29835320-3b4a-4c6b-a27e-5419a9be07d0 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] No VIF found with MAC fa:16:3e:90:7b:a1, not building metadata {{(pid=75226) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 01:36:17 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:36:18 user nova-compute[75226]: DEBUG nova.compute.manager [req-58e12232-c027-4a6a-8fca-a1b115ac5735 req-f7dc2ae5-80af-463a-8c71-6eb279c00640 service nova] [instance: 8d983732-91aa-4f20-9d7d-3de66029cba5] Received event network-vif-plugged-2ef7c6ef-e077-49c7-aaca-1d8ba7e7335c {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:36:18 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-58e12232-c027-4a6a-8fca-a1b115ac5735 req-f7dc2ae5-80af-463a-8c71-6eb279c00640 service nova] Acquiring lock "8d983732-91aa-4f20-9d7d-3de66029cba5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:36:18 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-58e12232-c027-4a6a-8fca-a1b115ac5735 req-f7dc2ae5-80af-463a-8c71-6eb279c00640 service nova] Lock "8d983732-91aa-4f20-9d7d-3de66029cba5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:36:18 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-58e12232-c027-4a6a-8fca-a1b115ac5735 req-f7dc2ae5-80af-463a-8c71-6eb279c00640 service nova] Lock "8d983732-91aa-4f20-9d7d-3de66029cba5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:36:18 user nova-compute[75226]: DEBUG nova.compute.manager [req-58e12232-c027-4a6a-8fca-a1b115ac5735 req-f7dc2ae5-80af-463a-8c71-6eb279c00640 service nova] [instance: 8d983732-91aa-4f20-9d7d-3de66029cba5] No waiting events found dispatching network-vif-plugged-2ef7c6ef-e077-49c7-aaca-1d8ba7e7335c {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:36:18 user nova-compute[75226]: WARNING nova.compute.manager [req-58e12232-c027-4a6a-8fca-a1b115ac5735 req-f7dc2ae5-80af-463a-8c71-6eb279c00640 service nova] [instance: 8d983732-91aa-4f20-9d7d-3de66029cba5] Received unexpected event network-vif-plugged-2ef7c6ef-e077-49c7-aaca-1d8ba7e7335c for instance with vm_state active and task_state rescuing.
Nov 17 01:36:18 user nova-compute[75226]: DEBUG nova.compute.manager [req-58e12232-c027-4a6a-8fca-a1b115ac5735 req-f7dc2ae5-80af-463a-8c71-6eb279c00640 service nova] [instance: 8d983732-91aa-4f20-9d7d-3de66029cba5] Received event network-vif-plugged-2ef7c6ef-e077-49c7-aaca-1d8ba7e7335c {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:36:18 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-58e12232-c027-4a6a-8fca-a1b115ac5735 req-f7dc2ae5-80af-463a-8c71-6eb279c00640 service nova] Acquiring lock "8d983732-91aa-4f20-9d7d-3de66029cba5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:36:18 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-58e12232-c027-4a6a-8fca-a1b115ac5735 req-f7dc2ae5-80af-463a-8c71-6eb279c00640 service nova] Lock "8d983732-91aa-4f20-9d7d-3de66029cba5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:36:18 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-58e12232-c027-4a6a-8fca-a1b115ac5735 req-f7dc2ae5-80af-463a-8c71-6eb279c00640 service nova] Lock "8d983732-91aa-4f20-9d7d-3de66029cba5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:36:18 user nova-compute[75226]: DEBUG nova.compute.manager [req-58e12232-c027-4a6a-8fca-a1b115ac5735 req-f7dc2ae5-80af-463a-8c71-6eb279c00640 service nova] [instance: 8d983732-91aa-4f20-9d7d-3de66029cba5] No waiting events found dispatching network-vif-plugged-2ef7c6ef-e077-49c7-aaca-1d8ba7e7335c {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:36:18 user nova-compute[75226]: WARNING nova.compute.manager [req-58e12232-c027-4a6a-8fca-a1b115ac5735 req-f7dc2ae5-80af-463a-8c71-6eb279c00640 service nova] [instance: 8d983732-91aa-4f20-9d7d-3de66029cba5] Received unexpected event network-vif-plugged-2ef7c6ef-e077-49c7-aaca-1d8ba7e7335c for instance with vm_state active and task_state rescuing.
Nov 17 01:36:18 user nova-compute[75226]: DEBUG nova.compute.manager [req-58e12232-c027-4a6a-8fca-a1b115ac5735 req-f7dc2ae5-80af-463a-8c71-6eb279c00640 service nova] [instance: 8d983732-91aa-4f20-9d7d-3de66029cba5] Received event network-vif-plugged-2ef7c6ef-e077-49c7-aaca-1d8ba7e7335c {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:36:18 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-58e12232-c027-4a6a-8fca-a1b115ac5735 req-f7dc2ae5-80af-463a-8c71-6eb279c00640 service nova] Acquiring lock "8d983732-91aa-4f20-9d7d-3de66029cba5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:36:18 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-58e12232-c027-4a6a-8fca-a1b115ac5735 req-f7dc2ae5-80af-463a-8c71-6eb279c00640 service nova] Lock "8d983732-91aa-4f20-9d7d-3de66029cba5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:36:18 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-58e12232-c027-4a6a-8fca-a1b115ac5735 req-f7dc2ae5-80af-463a-8c71-6eb279c00640 service nova] Lock "8d983732-91aa-4f20-9d7d-3de66029cba5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:36:18 user nova-compute[75226]: DEBUG nova.compute.manager [req-58e12232-c027-4a6a-8fca-a1b115ac5735 req-f7dc2ae5-80af-463a-8c71-6eb279c00640 service nova] [instance: 8d983732-91aa-4f20-9d7d-3de66029cba5] No waiting events found dispatching network-vif-plugged-2ef7c6ef-e077-49c7-aaca-1d8ba7e7335c {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:36:18 user nova-compute[75226]: WARNING nova.compute.manager [req-58e12232-c027-4a6a-8fca-a1b115ac5735 req-f7dc2ae5-80af-463a-8c71-6eb279c00640 service nova] [instance: 8d983732-91aa-4f20-9d7d-3de66029cba5] Received unexpected event network-vif-plugged-2ef7c6ef-e077-49c7-aaca-1d8ba7e7335c for instance with vm_state active and task_state rescuing.
Nov 17 01:36:18 user nova-compute[75226]: DEBUG nova.compute.manager [req-58e12232-c027-4a6a-8fca-a1b115ac5735 req-f7dc2ae5-80af-463a-8c71-6eb279c00640 service nova] [instance: 8d983732-91aa-4f20-9d7d-3de66029cba5] Received event network-vif-unplugged-2ef7c6ef-e077-49c7-aaca-1d8ba7e7335c {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:36:18 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-58e12232-c027-4a6a-8fca-a1b115ac5735 req-f7dc2ae5-80af-463a-8c71-6eb279c00640 service nova] Acquiring lock "8d983732-91aa-4f20-9d7d-3de66029cba5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:36:18 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-58e12232-c027-4a6a-8fca-a1b115ac5735 req-f7dc2ae5-80af-463a-8c71-6eb279c00640 service nova] Lock "8d983732-91aa-4f20-9d7d-3de66029cba5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:36:18 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-58e12232-c027-4a6a-8fca-a1b115ac5735 req-f7dc2ae5-80af-463a-8c71-6eb279c00640 service nova] Lock "8d983732-91aa-4f20-9d7d-3de66029cba5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:36:18 user nova-compute[75226]: DEBUG nova.compute.manager [req-58e12232-c027-4a6a-8fca-a1b115ac5735 req-f7dc2ae5-80af-463a-8c71-6eb279c00640 service nova] [instance: 8d983732-91aa-4f20-9d7d-3de66029cba5] No waiting events found dispatching network-vif-unplugged-2ef7c6ef-e077-49c7-aaca-1d8ba7e7335c {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:36:18 user nova-compute[75226]: WARNING nova.compute.manager [req-58e12232-c027-4a6a-8fca-a1b115ac5735 req-f7dc2ae5-80af-463a-8c71-6eb279c00640 service nova] [instance: 8d983732-91aa-4f20-9d7d-3de66029cba5] Received unexpected event network-vif-unplugged-2ef7c6ef-e077-49c7-aaca-1d8ba7e7335c for instance with vm_state active and task_state rescuing.
Nov 17 01:36:18 user nova-compute[75226]: DEBUG nova.compute.manager [req-58e12232-c027-4a6a-8fca-a1b115ac5735 req-f7dc2ae5-80af-463a-8c71-6eb279c00640 service nova] [instance: 8d983732-91aa-4f20-9d7d-3de66029cba5] Received event network-vif-plugged-2ef7c6ef-e077-49c7-aaca-1d8ba7e7335c {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:36:18 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-58e12232-c027-4a6a-8fca-a1b115ac5735 req-f7dc2ae5-80af-463a-8c71-6eb279c00640 service nova] Acquiring lock "8d983732-91aa-4f20-9d7d-3de66029cba5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:36:18 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-58e12232-c027-4a6a-8fca-a1b115ac5735 req-f7dc2ae5-80af-463a-8c71-6eb279c00640 service nova] Lock "8d983732-91aa-4f20-9d7d-3de66029cba5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:36:18 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-58e12232-c027-4a6a-8fca-a1b115ac5735 req-f7dc2ae5-80af-463a-8c71-6eb279c00640 service nova] Lock "8d983732-91aa-4f20-9d7d-3de66029cba5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:36:18 user nova-compute[75226]: DEBUG nova.compute.manager [req-58e12232-c027-4a6a-8fca-a1b115ac5735 req-f7dc2ae5-80af-463a-8c71-6eb279c00640 service nova] [instance: 8d983732-91aa-4f20-9d7d-3de66029cba5] No waiting events found dispatching network-vif-plugged-2ef7c6ef-e077-49c7-aaca-1d8ba7e7335c {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:36:18 user nova-compute[75226]: WARNING nova.compute.manager [req-58e12232-c027-4a6a-8fca-a1b115ac5735 req-f7dc2ae5-80af-463a-8c71-6eb279c00640 service nova] [instance: 8d983732-91aa-4f20-9d7d-3de66029cba5] Received unexpected event network-vif-plugged-2ef7c6ef-e077-49c7-aaca-1d8ba7e7335c for instance with vm_state active and task_state rescuing.
Nov 17 01:36:18 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:36:18 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:36:18 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:36:18 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:36:18 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:36:18 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:36:19 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:36:19 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Starting heal instance info cache {{(pid=75226) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 17 01:36:20 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "refresh_cache-5c280142-8901-4f83-bde4-baaa097e05b0" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:36:20 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquired lock "refresh_cache-5c280142-8901-4f83-bde4-baaa097e05b0" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:36:20 user nova-compute[75226]: DEBUG nova.network.neutron [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] [instance: 5c280142-8901-4f83-bde4-baaa097e05b0] Forcefully refreshing network info cache for instance {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 17 01:36:20 user nova-compute[75226]: DEBUG nova.compute.manager [req-87f3899b-24a3-4875-9b6c-4445abca7002 req-e02ba289-3afa-4f0b-9c4c-28ef9a09c6f2 service nova] [instance: 8d983732-91aa-4f20-9d7d-3de66029cba5] Received event network-vif-plugged-2ef7c6ef-e077-49c7-aaca-1d8ba7e7335c {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:36:20 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-87f3899b-24a3-4875-9b6c-4445abca7002 req-e02ba289-3afa-4f0b-9c4c-28ef9a09c6f2 service nova] Acquiring lock "8d983732-91aa-4f20-9d7d-3de66029cba5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:36:20 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-87f3899b-24a3-4875-9b6c-4445abca7002 req-e02ba289-3afa-4f0b-9c4c-28ef9a09c6f2 service nova] Lock "8d983732-91aa-4f20-9d7d-3de66029cba5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:36:20 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-87f3899b-24a3-4875-9b6c-4445abca7002 req-e02ba289-3afa-4f0b-9c4c-28ef9a09c6f2 service nova] Lock "8d983732-91aa-4f20-9d7d-3de66029cba5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:36:20 user nova-compute[75226]: DEBUG nova.compute.manager [req-87f3899b-24a3-4875-9b6c-4445abca7002 req-e02ba289-3afa-4f0b-9c4c-28ef9a09c6f2 service nova] [instance: 8d983732-91aa-4f20-9d7d-3de66029cba5] No waiting events found dispatching network-vif-plugged-2ef7c6ef-e077-49c7-aaca-1d8ba7e7335c {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:36:20 user nova-compute[75226]: WARNING nova.compute.manager [req-87f3899b-24a3-4875-9b6c-4445abca7002 req-e02ba289-3afa-4f0b-9c4c-28ef9a09c6f2 service nova] [instance: 8d983732-91aa-4f20-9d7d-3de66029cba5] Received unexpected event network-vif-plugged-2ef7c6ef-e077-49c7-aaca-1d8ba7e7335c for instance with vm_state active and task_state rescuing.
Nov 17 01:36:20 user nova-compute[75226]: DEBUG nova.compute.manager [req-87f3899b-24a3-4875-9b6c-4445abca7002 req-e02ba289-3afa-4f0b-9c4c-28ef9a09c6f2 service nova] [instance: 8d983732-91aa-4f20-9d7d-3de66029cba5] Received event network-vif-plugged-2ef7c6ef-e077-49c7-aaca-1d8ba7e7335c {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:36:20 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-87f3899b-24a3-4875-9b6c-4445abca7002 req-e02ba289-3afa-4f0b-9c4c-28ef9a09c6f2 service nova] Acquiring lock "8d983732-91aa-4f20-9d7d-3de66029cba5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:36:20 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-87f3899b-24a3-4875-9b6c-4445abca7002 req-e02ba289-3afa-4f0b-9c4c-28ef9a09c6f2 service nova] Lock "8d983732-91aa-4f20-9d7d-3de66029cba5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:36:20 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-87f3899b-24a3-4875-9b6c-4445abca7002 req-e02ba289-3afa-4f0b-9c4c-28ef9a09c6f2 service nova] Lock "8d983732-91aa-4f20-9d7d-3de66029cba5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:36:20 user nova-compute[75226]: DEBUG nova.compute.manager [req-87f3899b-24a3-4875-9b6c-4445abca7002 req-e02ba289-3afa-4f0b-9c4c-28ef9a09c6f2 service nova] [instance: 8d983732-91aa-4f20-9d7d-3de66029cba5] No waiting events found dispatching network-vif-plugged-2ef7c6ef-e077-49c7-aaca-1d8ba7e7335c {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:36:20 user nova-compute[75226]: WARNING nova.compute.manager [req-87f3899b-24a3-4875-9b6c-4445abca7002 req-e02ba289-3afa-4f0b-9c4c-28ef9a09c6f2 service nova] [instance: 8d983732-91aa-4f20-9d7d-3de66029cba5] Received unexpected event network-vif-plugged-2ef7c6ef-e077-49c7-aaca-1d8ba7e7335c for instance with vm_state active and task_state rescuing.
Nov 17 01:36:20 user nova-compute[75226]: DEBUG nova.network.neutron [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] [instance: 5c280142-8901-4f83-bde4-baaa097e05b0] Updating instance_info_cache with network_info: [{"id": "3f54cf07-6d64-4e03-a3f7-bab096a18e89", "address": "fa:16:3e:41:48:98", "network": {"id": "a9710b94-56f8-4cf6-9bb6-344b275e5bf2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-512340839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2052a37a068e4d948c57560c0f4445e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f54cf07-6d", "ovs_interfaceid": "3f54cf07-6d64-4e03-a3f7-bab096a18e89", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:36:20 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Releasing lock "refresh_cache-5c280142-8901-4f83-bde4-baaa097e05b0" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:36:20 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] [instance: 5c280142-8901-4f83-bde4-baaa097e05b0] Updated the network info_cache for instance {{(pid=75226) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 17 01:36:20 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:36:20 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75226) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 17 01:36:21 user nova-compute[75226]: DEBUG nova.compute.manager [None req-29835320-3b4a-4c6b-a27e-5419a9be07d0 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] [instance: 8d983732-91aa-4f20-9d7d-3de66029cba5] Checking state {{(pid=75226) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 01:36:22 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:36:23 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:36:27 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:36:32 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:36:32 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:36:32 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75226) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 17 01:36:32 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75226) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 01:36:32 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75226) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 01:36:32 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:36:33 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:36:37 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:36:38 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:36:40 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-cd74e1bb-8c8e-467e-96b7-50afc0211f10 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Acquiring lock "6b7e9611-be35-4e51-b886-91a2fac0a653" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:36:40 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-cd74e1bb-8c8e-467e-96b7-50afc0211f10 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Lock "6b7e9611-be35-4e51-b886-91a2fac0a653" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:36:40 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-cd74e1bb-8c8e-467e-96b7-50afc0211f10 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Acquiring lock "6b7e9611-be35-4e51-b886-91a2fac0a653-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:36:40 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-cd74e1bb-8c8e-467e-96b7-50afc0211f10 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Lock "6b7e9611-be35-4e51-b886-91a2fac0a653-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:36:40 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-cd74e1bb-8c8e-467e-96b7-50afc0211f10 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Lock "6b7e9611-be35-4e51-b886-91a2fac0a653-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:36:40 user nova-compute[75226]: INFO nova.compute.manager [None req-cd74e1bb-8c8e-467e-96b7-50afc0211f10 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 6b7e9611-be35-4e51-b886-91a2fac0a653] Terminating instance
Nov 17 01:36:40 user nova-compute[75226]: DEBUG nova.compute.manager [None req-cd74e1bb-8c8e-467e-96b7-50afc0211f10 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 6b7e9611-be35-4e51-b886-91a2fac0a653] Start destroying the instance on the hypervisor. {{(pid=75226) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 17 01:36:40 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:36:40 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:36:40 user nova-compute[75226]: DEBUG nova.compute.manager [req-0c968cf7-d430-4da3-9ca8-a9cabe0b88c6 req-c1fac9aa-b290-4778-92d7-c70497740731 service nova] [instance: 6b7e9611-be35-4e51-b886-91a2fac0a653] Received event network-vif-unplugged-657af53c-fc3a-45ab-81e5-b2eeea1c88d7 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:36:40 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-0c968cf7-d430-4da3-9ca8-a9cabe0b88c6 req-c1fac9aa-b290-4778-92d7-c70497740731 service nova] Acquiring lock "6b7e9611-be35-4e51-b886-91a2fac0a653-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:36:40 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-0c968cf7-d430-4da3-9ca8-a9cabe0b88c6 req-c1fac9aa-b290-4778-92d7-c70497740731 service nova] Lock "6b7e9611-be35-4e51-b886-91a2fac0a653-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:36:40 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-0c968cf7-d430-4da3-9ca8-a9cabe0b88c6 req-c1fac9aa-b290-4778-92d7-c70497740731 service nova] Lock "6b7e9611-be35-4e51-b886-91a2fac0a653-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:36:40 user nova-compute[75226]: DEBUG nova.compute.manager [req-0c968cf7-d430-4da3-9ca8-a9cabe0b88c6 req-c1fac9aa-b290-4778-92d7-c70497740731 service nova] [instance: 6b7e9611-be35-4e51-b886-91a2fac0a653] No waiting events found dispatching network-vif-unplugged-657af53c-fc3a-45ab-81e5-b2eeea1c88d7 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:36:40 user nova-compute[75226]: DEBUG nova.compute.manager [req-0c968cf7-d430-4da3-9ca8-a9cabe0b88c6 req-c1fac9aa-b290-4778-92d7-c70497740731 service nova] [instance: 6b7e9611-be35-4e51-b886-91a2fac0a653] Received event network-vif-unplugged-657af53c-fc3a-45ab-81e5-b2eeea1c88d7 for instance with task_state deleting. {{(pid=75226) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 17 01:36:40 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:36:40 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:36:41 user nova-compute[75226]: INFO nova.virt.libvirt.driver [-] [instance: 6b7e9611-be35-4e51-b886-91a2fac0a653] Instance destroyed successfully.
Nov 17 01:36:41 user nova-compute[75226]: DEBUG nova.objects.instance [None req-cd74e1bb-8c8e-467e-96b7-50afc0211f10 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Lazy-loading 'resources' on Instance uuid 6b7e9611-be35-4e51-b886-91a2fac0a653 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:36:41 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-cd74e1bb-8c8e-467e-96b7-50afc0211f10 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:20:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-614527780',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-614527780',id=11,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-17T01:22:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e6cb6f679ee4468d82cc7fb5d0f67be9',ramdisk_id='',reservation_id='r-do7w6o8m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-76498640',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T01:23:50Z,user_data=None,user_id='1b793ce05bf44b939a9fb5a914a04cb0',uuid=6b7e9611-be35-4e51-b886-91a2fac0a653,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "657af53c-fc3a-45ab-81e5-b2eeea1c88d7", "address": "fa:16:3e:91:de:17", "network": {"id": "450540a3-ff7e-42fb-a0a6-808acd749943", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1503678778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6cb6f679ee4468d82cc7fb5d0f67be9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap657af53c-fc", "ovs_interfaceid": "657af53c-fc3a-45ab-81e5-b2eeea1c88d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 17 01:36:41 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-cd74e1bb-8c8e-467e-96b7-50afc0211f10 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Converting VIF {"id": "657af53c-fc3a-45ab-81e5-b2eeea1c88d7", "address": "fa:16:3e:91:de:17", "network": {"id": "450540a3-ff7e-42fb-a0a6-808acd749943", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1503678778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6cb6f679ee4468d82cc7fb5d0f67be9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap657af53c-fc", "ovs_interfaceid": "657af53c-fc3a-45ab-81e5-b2eeea1c88d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:36:41 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-cd74e1bb-8c8e-467e-96b7-50afc0211f10 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:91:de:17,bridge_name='br-int',has_traffic_filtering=True,id=657af53c-fc3a-45ab-81e5-b2eeea1c88d7,network=Network(450540a3-ff7e-42fb-a0a6-808acd749943),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap657af53c-fc') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:36:41 user nova-compute[75226]: DEBUG os_vif [None req-cd74e1bb-8c8e-467e-96b7-50afc0211f10 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:91:de:17,bridge_name='br-int',has_traffic_filtering=True,id=657af53c-fc3a-45ab-81e5-b2eeea1c88d7,network=Network(450540a3-ff7e-42fb-a0a6-808acd749943),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap657af53c-fc') {{(pid=75226) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 17 01:36:41 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:36:41 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap657af53c-fc, bridge=br-int, if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:36:41 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:36:41 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:36:41 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:36:41 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=010cd372-a211-40d9-9ecb-f3cce7c62f33) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:36:41 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:36:41 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:36:41 user nova-compute[75226]: INFO os_vif [None req-cd74e1bb-8c8e-467e-96b7-50afc0211f10 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:91:de:17,bridge_name='br-int',has_traffic_filtering=True,id=657af53c-fc3a-45ab-81e5-b2eeea1c88d7,network=Network(450540a3-ff7e-42fb-a0a6-808acd749943),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap657af53c-fc')
Nov 17 01:36:41 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd74e1bb-8c8e-467e-96b7-50afc0211f10 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 6b7e9611-be35-4e51-b886-91a2fac0a653] calling os-brick to detach iSCSI Volume {{(pid=75226) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 17 01:36:41 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd74e1bb-8c8e-467e-96b7-50afc0211f10 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc4cc36b490>, {'target_iqn': 'iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aEbhyCZJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:36:41 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-cd74e1bb-8c8e-467e-96b7-50afc0211f10 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:36:41 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-cd74e1bb-8c8e-467e-96b7-50afc0211f10 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:36:41 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-cd74e1bb-8c8e-467e-96b7-50afc0211f10 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:36:41 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:36:41 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:36:41 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[3999f148-bf11-4118-9a65-b181b0f2f87f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9bb94c67-f3ce-4642-8f8d-3c59a63802ac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:36:41 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd74e1bb-8c8e-467e-96b7-50afc0211f10 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 17 01:36:41 user nova-compute[75226]: No targets found.
Nov 17 01:36:41 user nova-compute[75226]: iSNS:
Nov 17 01:36:41 user nova-compute[75226]: No targets found.
Nov 17 01:36:41 user nova-compute[75226]: STATIC:
Nov 17 01:36:41 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:9bb94c67-f3ce-4642-8f8d-3c59a63802ac
Nov 17 01:36:41 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:36:41 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:36:41 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8
Nov 17 01:36:41 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:36:41 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:36:41 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419
Nov 17 01:36:41 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:36:41 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:36:41 user nova-compute[75226]: FIRMWARE:
Nov 17 01:36:41 user nova-compute[75226]: No targets found.
Nov 17 01:36:41 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:36:41 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd74e1bb-8c8e-467e-96b7-50afc0211f10 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 17 01:36:41 user nova-compute[75226]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 17 01:36:41 user nova-compute[75226]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75226) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 17 01:36:41 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd74e1bb-8c8e-467e-96b7-50afc0211f10 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8', 0)] {{(pid=75226) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 17 01:36:41 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:36:41 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:36:41 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3c19a4b-227a-482d-a706-4f27a85a264c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9bb94c67-f3ce-4642-8f8d-3c59a63802ac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:36:41 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:36:41 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:36:41 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[c15d231c-c964-4020-8bf2-779e89643271]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bb94c67-f3ce-4642-8f8d-3c59a63802ac (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:36:41 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd74e1bb-8c8e-467e-96b7-50afc0211f10 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)
Nov 17 01:36:41 user nova-compute[75226]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419 (non-flash)
Nov 17 01:36:41 user nova-compute[75226]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bb94c67-f3ce-4642-8f8d-3c59a63802ac (non-flash)
Nov 17 01:36:41 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:36:41 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd74e1bb-8c8e-467e-96b7-50afc0211f10 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 (non-flash)
Nov 17 01:36:41 user nova-compute[75226]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419 (non-flash)
Nov 17 01:36:41 user nova-compute[75226]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bb94c67-f3ce-4642-8f8d-3c59a63802ac (non-flash)
Nov 17 01:36:41 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:36:41 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd74e1bb-8c8e-467e-96b7-50afc0211f10 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc4b41bed40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8'): ({'sdc'}, set())}) {{(pid=75226) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 17 01:36:41 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-cd74e1bb-8c8e-467e-96b7-50afc0211f10 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Removing single pathed devices sdc {{(pid=75226) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 17 01:36:41 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:36:41 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:36:41 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[be912a59-49fd-4c0d-8652-94c5a7750448]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:36:41 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:36:41 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:36:41 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d55e5f5-78a7-4d47-8ebc-6d77f17e0f6e]: (4, ('ok\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:36:41 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-cd74e1bb-8c8e-467e-96b7-50afc0211f10 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Flushing IO for device /dev/sdc {{(pid=75226) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 17 01:36:41 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:36:41 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:36:41 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[b659c4a2-5d22-4105-a15c-f5443d7fb7e7]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:36:41 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-cd74e1bb-8c8e-467e-96b7-50afc0211f10 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75226) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 17 01:36:41 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:36:41 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.039s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:36:41 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[9adc315e-6115-480c-8671-e45b47998057]: (4, ('1', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:36:41 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-cd74e1bb-8c8e-467e-96b7-50afc0211f10 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75226) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 17 01:36:41 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-cd74e1bb-8c8e-467e-96b7-50afc0211f10 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] SCSI volumes sdc have been removed. {{(pid=75226) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 17 01:36:41 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd74e1bb-8c8e-467e-96b7-50afc0211f10 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8')] {{(pid=75226) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 17 01:36:41 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:36:41 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:36:41 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[c02fd3e0-93ce-4292-b15f-5c9ec9aa58c5]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:36:41 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd74e1bb-8c8e-467e-96b7-50afc0211f10 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:36:41 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 -p 172.16.0.220:3260 --logout {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:36:41 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:36:41 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff669cec-1413-4d09-a4c1-50c3fdfc1d81]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:36:41 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd74e1bb-8c8e-467e-96b7-50afc0211f10 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8, portal: 172.16.0.220,3260]
Nov 17 01:36:41 user nova-compute[75226]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8, portal: 172.16.0.220,3260] successful.
Nov 17 01:36:41 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:36:41 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 -p 172.16.0.220:3260 --op delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:36:41 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cf1355f-12ee-4285-9c07-f120d1308cb8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:36:41 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[235ea963-95e3-41f0-8b19-f8eb433d3a98]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:36:41 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd74e1bb-8c8e-467e-96b7-50afc0211f10 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:36:41 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-cd74e1bb-8c8e-467e-96b7-50afc0211f10 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.373s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:36:41 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd74e1bb-8c8e-467e-96b7-50afc0211f10 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] <== disconnect_volume: return (375ms) None {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:36:41 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd74e1bb-8c8e-467e-96b7-50afc0211f10 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 6b7e9611-be35-4e51-b886-91a2fac0a653] Disconnected iSCSI Volume {{(pid=75226) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 17 01:36:41 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-cd74e1bb-8c8e-467e-96b7-50afc0211f10 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 6b7e9611-be35-4e51-b886-91a2fac0a653] Deleting instance files /opt/stack/data/nova/instances/6b7e9611-be35-4e51-b886-91a2fac0a653_del
Nov 17 01:36:41 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-cd74e1bb-8c8e-467e-96b7-50afc0211f10 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 6b7e9611-be35-4e51-b886-91a2fac0a653] Deletion of /opt/stack/data/nova/instances/6b7e9611-be35-4e51-b886-91a2fac0a653_del complete
Nov 17 01:36:41 user nova-compute[75226]: INFO nova.compute.manager [None req-cd74e1bb-8c8e-467e-96b7-50afc0211f10 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 6b7e9611-be35-4e51-b886-91a2fac0a653] Took 1.35 seconds to destroy the instance on the hypervisor.
Nov 17 01:36:41 user nova-compute[75226]: DEBUG oslo.service.loopingcall [None req-cd74e1bb-8c8e-467e-96b7-50afc0211f10 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75226) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 17 01:36:41 user nova-compute[75226]: DEBUG nova.compute.manager [-] [instance: 6b7e9611-be35-4e51-b886-91a2fac0a653] Deallocating network for instance {{(pid=75226) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 17 01:36:41 user nova-compute[75226]: DEBUG nova.network.neutron [-] [instance: 6b7e9611-be35-4e51-b886-91a2fac0a653] deallocate_for_instance() {{(pid=75226) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 17 01:36:42 user nova-compute[75226]: DEBUG nova.network.neutron [-] [instance: 6b7e9611-be35-4e51-b886-91a2fac0a653] Updating instance_info_cache with network_info: [] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:36:42 user nova-compute[75226]: INFO nova.compute.manager [-] [instance: 6b7e9611-be35-4e51-b886-91a2fac0a653] Took 0.46 seconds to deallocate network for instance.
Nov 17 01:36:42 user nova-compute[75226]: DEBUG nova.compute.manager [req-a1f8bec7-0f36-46fb-84eb-975703fda285 req-de02c770-e0fe-4dde-918c-10ccca85c0dd service nova] [instance: 6b7e9611-be35-4e51-b886-91a2fac0a653] Received event network-vif-deleted-657af53c-fc3a-45ab-81e5-b2eeea1c88d7 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:36:42 user nova-compute[75226]: DEBUG nova.compute.manager [req-c335a7eb-0d62-4fd8-b192-d80800b5a612 req-3419df61-8bd4-4d6b-8747-999e076c4617 service nova] [instance: 6b7e9611-be35-4e51-b886-91a2fac0a653] Received event network-vif-plugged-657af53c-fc3a-45ab-81e5-b2eeea1c88d7 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:36:42 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-c335a7eb-0d62-4fd8-b192-d80800b5a612 req-3419df61-8bd4-4d6b-8747-999e076c4617 service nova] Acquiring lock "6b7e9611-be35-4e51-b886-91a2fac0a653-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:36:42 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-c335a7eb-0d62-4fd8-b192-d80800b5a612 req-3419df61-8bd4-4d6b-8747-999e076c4617 service nova] Lock "6b7e9611-be35-4e51-b886-91a2fac0a653-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:36:42 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-c335a7eb-0d62-4fd8-b192-d80800b5a612 req-3419df61-8bd4-4d6b-8747-999e076c4617 service nova] Lock "6b7e9611-be35-4e51-b886-91a2fac0a653-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:36:42 user nova-compute[75226]: DEBUG nova.compute.manager [req-c335a7eb-0d62-4fd8-b192-d80800b5a612 req-3419df61-8bd4-4d6b-8747-999e076c4617 service nova] [instance: 6b7e9611-be35-4e51-b886-91a2fac0a653] No waiting events found dispatching network-vif-plugged-657af53c-fc3a-45ab-81e5-b2eeea1c88d7 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:36:42 user nova-compute[75226]: WARNING nova.compute.manager [req-c335a7eb-0d62-4fd8-b192-d80800b5a612 req-3419df61-8bd4-4d6b-8747-999e076c4617 service nova] [instance: 6b7e9611-be35-4e51-b886-91a2fac0a653] Received unexpected event network-vif-plugged-657af53c-fc3a-45ab-81e5-b2eeea1c88d7 for instance with vm_state active and task_state deleting.
Nov 17 01:36:42 user nova-compute[75226]: INFO nova.compute.manager [None req-cd74e1bb-8c8e-467e-96b7-50afc0211f10 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: 6b7e9611-be35-4e51-b886-91a2fac0a653] Took 0.75 seconds to detach 1 volumes for instance.
Nov 17 01:36:42 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-cd74e1bb-8c8e-467e-96b7-50afc0211f10 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:36:42 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-cd74e1bb-8c8e-467e-96b7-50afc0211f10 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:36:43 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-cd74e1bb-8c8e-467e-96b7-50afc0211f10 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:36:43 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-cd74e1bb-8c8e-467e-96b7-50afc0211f10 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:36:43 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:36:43 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-cd74e1bb-8c8e-467e-96b7-50afc0211f10 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.299s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:36:43 user nova-compute[75226]: INFO nova.scheduler.client.report [None req-cd74e1bb-8c8e-467e-96b7-50afc0211f10 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Deleted allocations for instance 6b7e9611-be35-4e51-b886-91a2fac0a653
Nov 17 01:36:43 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-cd74e1bb-8c8e-467e-96b7-50afc0211f10 tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Lock "6b7e9611-be35-4e51-b886-91a2fac0a653" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.075s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:36:46 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:36:48 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:36:51 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:36:53 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:36:55 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-efefc8c2-10d1-4bb8-9a29-2048aecf682f tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Acquiring lock "a298d980-feed-4530-9499-f2833b404dcd" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:36:55 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-efefc8c2-10d1-4bb8-9a29-2048aecf682f tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Lock "a298d980-feed-4530-9499-f2833b404dcd" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:36:55 user nova-compute[75226]: DEBUG nova.compute.manager [None req-efefc8c2-10d1-4bb8-9a29-2048aecf682f tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: a298d980-feed-4530-9499-f2833b404dcd] Going to confirm migration 2 {{(pid=75226) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4774}}
Nov 17 01:36:55 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-efefc8c2-10d1-4bb8-9a29-2048aecf682f tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Acquiring lock "refresh_cache-a298d980-feed-4530-9499-f2833b404dcd" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:36:55 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-efefc8c2-10d1-4bb8-9a29-2048aecf682f tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Acquired lock "refresh_cache-a298d980-feed-4530-9499-f2833b404dcd" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:36:55 user nova-compute[75226]: DEBUG nova.network.neutron [None req-efefc8c2-10d1-4bb8-9a29-2048aecf682f tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: a298d980-feed-4530-9499-f2833b404dcd] Building network info cache for instance {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 01:36:55 user nova-compute[75226]: DEBUG nova.objects.instance [None req-efefc8c2-10d1-4bb8-9a29-2048aecf682f tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Lazy-loading 'info_cache' on Instance uuid a298d980-feed-4530-9499-f2833b404dcd {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:36:56 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:36:56 user nova-compute[75226]: DEBUG nova.network.neutron [None req-efefc8c2-10d1-4bb8-9a29-2048aecf682f tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: a298d980-feed-4530-9499-f2833b404dcd] Updating instance_info_cache with network_info: [{"id": "301235a9-5ec1-41f4-8e43-9dc7b20e872d", "address": "fa:16:3e:9a:7d:e3", "network": {"id": "9f39d3e5-b106-4bd9-b8ba-0f326e89c481", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-675861281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9042fe4ecc245dd97553f6e942c3e05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap301235a9-5e", "ovs_interfaceid": "301235a9-5ec1-41f4-8e43-9dc7b20e872d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:36:56 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-efefc8c2-10d1-4bb8-9a29-2048aecf682f tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Releasing lock "refresh_cache-a298d980-feed-4530-9499-f2833b404dcd" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:36:56 user nova-compute[75226]: DEBUG nova.objects.instance [None req-efefc8c2-10d1-4bb8-9a29-2048aecf682f tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Lazy-loading 'migration_context' on Instance uuid a298d980-feed-4530-9499-f2833b404dcd {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:36:56 user nova-compute[75226]: DEBUG nova.objects.base [None req-efefc8c2-10d1-4bb8-9a29-2048aecf682f tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Object Instance<a298d980-feed-4530-9499-f2833b404dcd> lazy-loaded attributes: info_cache,migration_context {{(pid=75226) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 17 01:36:56 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-efefc8c2-10d1-4bb8-9a29-2048aecf682f tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:36:56 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-efefc8c2-10d1-4bb8-9a29-2048aecf682f tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:36:56 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-efefc8c2-10d1-4bb8-9a29-2048aecf682f tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:36:56 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-efefc8c2-10d1-4bb8-9a29-2048aecf682f tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:36:56 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-efefc8c2-10d1-4bb8-9a29-2048aecf682f tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.541s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:36:57 user nova-compute[75226]: INFO nova.scheduler.client.report [None req-efefc8c2-10d1-4bb8-9a29-2048aecf682f tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Deleted allocation for migration b0f48d1c-5955-4eec-b50d-8c2e90f1e86b
Nov 17 01:36:57 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-efefc8c2-10d1-4bb8-9a29-2048aecf682f tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Lock "a298d980-feed-4530-9499-f2833b404dcd" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.559s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:37:00 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:37:01 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:37:02 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:37:03 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:37:03 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:37:04 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:37:06 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:37:06 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:37:06 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:37:06 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:37:06 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:37:06 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:37:06 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75226) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 17 01:37:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa84e575-bdad-45b9-80ce-86b1c2826fb0/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:37:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa84e575-bdad-45b9-80ce-86b1c2826fb0/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:37:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa84e575-bdad-45b9-80ce-86b1c2826fb0/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:37:07 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:37:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa84e575-bdad-45b9-80ce-86b1c2826fb0/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:37:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38062487-67ca-4962-974f-81456aebe97b/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:37:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38062487-67ca-4962-974f-81456aebe97b/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:37:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38062487-67ca-4962-974f-81456aebe97b/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:37:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38062487-67ca-4962-974f-81456aebe97b/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:37:07 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c280142-8901-4f83-bde4-baaa097e05b0/disk.rescue --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:37:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c280142-8901-4f83-bde4-baaa097e05b0/disk.rescue --force-share --output=json" returned: 0 in 0.219s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:37:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c280142-8901-4f83-bde4-baaa097e05b0/disk.rescue --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:37:08 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:37:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c280142-8901-4f83-bde4-baaa097e05b0/disk.rescue --force-share --output=json" returned: 0 in 0.220s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:37:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c280142-8901-4f83-bde4-baaa097e05b0/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:37:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c280142-8901-4f83-bde4-baaa097e05b0/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:37:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c280142-8901-4f83-bde4-baaa097e05b0/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:37:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c280142-8901-4f83-bde4-baaa097e05b0/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:37:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6555d72-6094-4ea9-b071-a3d3c8a300a9/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:37:09 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6555d72-6094-4ea9-b071-a3d3c8a300a9/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:37:09 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6555d72-6094-4ea9-b071-a3d3c8a300a9/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:37:09 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6555d72-6094-4ea9-b071-a3d3c8a300a9/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:37:09 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d983732-91aa-4f20-9d7d-3de66029cba5/disk.rescue --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:37:09 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d983732-91aa-4f20-9d7d-3de66029cba5/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:37:09 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d983732-91aa-4f20-9d7d-3de66029cba5/disk.rescue --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:37:09 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:37:09 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d983732-91aa-4f20-9d7d-3de66029cba5/disk.rescue --force-share --output=json" returned: 0 in 0.203s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:37:09 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] skipping disk /opt/stack/data/nova/instances/8d983732-91aa-4f20-9d7d-3de66029cba5/disk (vdb) as it is a volume {{(pid=75226) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 01:37:09 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75226) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 01:37:10 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:37:10 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:37:10 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Hypervisor/Node resource view: name=user free_ram=8143MB free_disk=24.963871002197266GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75226) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 17 01:37:10 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:37:10 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:37:10 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance aa84e575-bdad-45b9-80ce-86b1c2826fb0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:37:10 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 38062487-67ca-4962-974f-81456aebe97b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:37:10 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance d6555d72-6094-4ea9-b071-a3d3c8a300a9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:37:10 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 5c280142-8901-4f83-bde4-baaa097e05b0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:37:10 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 8d983732-91aa-4f20-9d7d-3de66029cba5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:37:10 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance a298d980-feed-4530-9499-f2833b404dcd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:37:10 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75226) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 17 01:37:10 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75226) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 17 01:37:10 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:37:10 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:37:10 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Compute_service record updated for user:user {{(pid=75226) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 17 01:37:10 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.479s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:37:11 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:37:11 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:37:11 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:37:11 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:37:11 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:37:13 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:37:13 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:37:13 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:37:14 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-8153f6e9-aeb8-463e-a9ad-30dc7b662425 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Acquiring lock "8c4a9724-533e-40c8-ab2a-ce3415af240a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:37:14 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-8153f6e9-aeb8-463e-a9ad-30dc7b662425 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Lock "8c4a9724-533e-40c8-ab2a-ce3415af240a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:37:14 user nova-compute[75226]: DEBUG nova.compute.manager [None req-8153f6e9-aeb8-463e-a9ad-30dc7b662425 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] [instance: 8c4a9724-533e-40c8-ab2a-ce3415af240a] Starting instance... {{(pid=75226) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 17 01:37:15 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-8153f6e9-aeb8-463e-a9ad-30dc7b662425 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:37:15 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-8153f6e9-aeb8-463e-a9ad-30dc7b662425 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:37:15 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-8153f6e9-aeb8-463e-a9ad-30dc7b662425 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75226) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 17 01:37:15 user nova-compute[75226]: INFO nova.compute.claims [None req-8153f6e9-aeb8-463e-a9ad-30dc7b662425 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] [instance: 8c4a9724-533e-40c8-ab2a-ce3415af240a] Claim successful on node user
Nov 17 01:37:15 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-8153f6e9-aeb8-463e-a9ad-30dc7b662425 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:37:15 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-8153f6e9-aeb8-463e-a9ad-30dc7b662425 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:37:15 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-8153f6e9-aeb8-463e-a9ad-30dc7b662425 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.425s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:37:15 user nova-compute[75226]: DEBUG nova.compute.manager [None req-8153f6e9-aeb8-463e-a9ad-30dc7b662425 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] [instance: 8c4a9724-533e-40c8-ab2a-ce3415af240a] Start building networks asynchronously for instance. {{(pid=75226) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 17 01:37:15 user nova-compute[75226]: DEBUG nova.compute.manager [None req-8153f6e9-aeb8-463e-a9ad-30dc7b662425 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] [instance: 8c4a9724-533e-40c8-ab2a-ce3415af240a] Allocating IP information in the background. {{(pid=75226) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 17 01:37:15 user nova-compute[75226]: DEBUG nova.network.neutron [None req-8153f6e9-aeb8-463e-a9ad-30dc7b662425 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] [instance: 8c4a9724-533e-40c8-ab2a-ce3415af240a] allocate_for_instance() {{(pid=75226) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 17 01:37:15 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-8153f6e9-aeb8-463e-a9ad-30dc7b662425 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] [instance: 8c4a9724-533e-40c8-ab2a-ce3415af240a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 17 01:37:15 user nova-compute[75226]: DEBUG nova.compute.manager [None req-8153f6e9-aeb8-463e-a9ad-30dc7b662425 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] [instance: 8c4a9724-533e-40c8-ab2a-ce3415af240a] Start building block device mappings for instance. {{(pid=75226) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 17 01:37:15 user nova-compute[75226]: DEBUG nova.policy [None req-8153f6e9-aeb8-463e-a9ad-30dc7b662425 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e7c57c13ff8a48f7b8b206d71e413646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33699aa6c9db4815a1e79aff4685801e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75226) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 17 01:37:15 user nova-compute[75226]: DEBUG nova.compute.manager [None req-8153f6e9-aeb8-463e-a9ad-30dc7b662425 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] [instance: 8c4a9724-533e-40c8-ab2a-ce3415af240a] Start spawning the instance on the hypervisor. {{(pid=75226) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 17 01:37:15 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-8153f6e9-aeb8-463e-a9ad-30dc7b662425 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] [instance: 8c4a9724-533e-40c8-ab2a-ce3415af240a] Creating instance directory {{(pid=75226) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 17 01:37:15 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-8153f6e9-aeb8-463e-a9ad-30dc7b662425 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] [instance: 8c4a9724-533e-40c8-ab2a-ce3415af240a] Creating image(s)
Nov 17 01:37:15 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-8153f6e9-aeb8-463e-a9ad-30dc7b662425 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Acquiring lock "/opt/stack/data/nova/instances/8c4a9724-533e-40c8-ab2a-ce3415af240a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:37:15 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-8153f6e9-aeb8-463e-a9ad-30dc7b662425 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Lock "/opt/stack/data/nova/instances/8c4a9724-533e-40c8-ab2a-ce3415af240a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:37:15 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-8153f6e9-aeb8-463e-a9ad-30dc7b662425 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Lock "/opt/stack/data/nova/instances/8c4a9724-533e-40c8-ab2a-ce3415af240a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:37:15 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-8153f6e9-aeb8-463e-a9ad-30dc7b662425 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Acquiring lock "c26246469b0fe452ea7e2a241a7e59c8d5f2dd53" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:37:15 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-8153f6e9-aeb8-463e-a9ad-30dc7b662425 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Lock "c26246469b0fe452ea7e2a241a7e59c8d5f2dd53" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:37:16 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-8153f6e9-aeb8-463e-a9ad-30dc7b662425 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c26246469b0fe452ea7e2a241a7e59c8d5f2dd53.part --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:37:16 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:37:16 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:37:16 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:37:16 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-8153f6e9-aeb8-463e-a9ad-30dc7b662425 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c26246469b0fe452ea7e2a241a7e59c8d5f2dd53.part --force-share --output=json" returned: 0 in 0.189s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:37:16 user nova-compute[75226]: DEBUG nova.virt.images [None req-8153f6e9-aeb8-463e-a9ad-30dc7b662425 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] 40bf979b-5f8a-47f7-a942-0f80525fa754 was qcow2, converting to raw {{(pid=75226) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 17 01:37:16 user nova-compute[75226]: DEBUG nova.privsep.utils [None req-8153f6e9-aeb8-463e-a9ad-30dc7b662425 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75226) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 17 01:37:16 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-8153f6e9-aeb8-463e-a9ad-30dc7b662425 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c26246469b0fe452ea7e2a241a7e59c8d5f2dd53.part /opt/stack/data/nova/instances/_base/c26246469b0fe452ea7e2a241a7e59c8d5f2dd53.converted {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:37:16 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-8153f6e9-aeb8-463e-a9ad-30dc7b662425 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c26246469b0fe452ea7e2a241a7e59c8d5f2dd53.part /opt/stack/data/nova/instances/_base/c26246469b0fe452ea7e2a241a7e59c8d5f2dd53.converted" returned: 0 in 0.301s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:37:16 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-8153f6e9-aeb8-463e-a9ad-30dc7b662425 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c26246469b0fe452ea7e2a241a7e59c8d5f2dd53.converted --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:37:16 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:37:17 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-8153f6e9-aeb8-463e-a9ad-30dc7b662425 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c26246469b0fe452ea7e2a241a7e59c8d5f2dd53.converted --force-share --output=json" returned: 0 in 0.213s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:37:17 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-8153f6e9-aeb8-463e-a9ad-30dc7b662425 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Lock "c26246469b0fe452ea7e2a241a7e59c8d5f2dd53" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.237s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:37:17 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-8153f6e9-aeb8-463e-a9ad-30dc7b662425 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c26246469b0fe452ea7e2a241a7e59c8d5f2dd53 --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:37:17 user nova-compute[75226]: DEBUG nova.network.neutron [None req-8153f6e9-aeb8-463e-a9ad-30dc7b662425 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] [instance: 8c4a9724-533e-40c8-ab2a-ce3415af240a] Successfully created port: e30eaa7a-30df-48f5-b8de-30da75d74972 {{(pid=75226) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 17 01:37:17 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-8153f6e9-aeb8-463e-a9ad-30dc7b662425 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c26246469b0fe452ea7e2a241a7e59c8d5f2dd53 --force-share --output=json" returned: 0 in 0.201s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:37:17 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-8153f6e9-aeb8-463e-a9ad-30dc7b662425 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Acquiring lock "c26246469b0fe452ea7e2a241a7e59c8d5f2dd53" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:37:17 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-8153f6e9-aeb8-463e-a9ad-30dc7b662425 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Lock "c26246469b0fe452ea7e2a241a7e59c8d5f2dd53" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:37:17 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-8153f6e9-aeb8-463e-a9ad-30dc7b662425 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c26246469b0fe452ea7e2a241a7e59c8d5f2dd53 --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:37:17 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-8153f6e9-aeb8-463e-a9ad-30dc7b662425 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c26246469b0fe452ea7e2a241a7e59c8d5f2dd53 --force-share --output=json" returned: 0 in 0.202s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:37:17 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-8153f6e9-aeb8-463e-a9ad-30dc7b662425 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c26246469b0fe452ea7e2a241a7e59c8d5f2dd53,backing_fmt=raw /opt/stack/data/nova/instances/8c4a9724-533e-40c8-ab2a-ce3415af240a/disk 1073741824 {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:37:17 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-8153f6e9-aeb8-463e-a9ad-30dc7b662425 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c26246469b0fe452ea7e2a241a7e59c8d5f2dd53,backing_fmt=raw /opt/stack/data/nova/instances/8c4a9724-533e-40c8-ab2a-ce3415af240a/disk 1073741824" returned: 0 in 0.105s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:37:17 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-8153f6e9-aeb8-463e-a9ad-30dc7b662425 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Lock "c26246469b0fe452ea7e2a241a7e59c8d5f2dd53" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.317s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:37:17 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-8153f6e9-aeb8-463e-a9ad-30dc7b662425 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c26246469b0fe452ea7e2a241a7e59c8d5f2dd53 --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:37:17 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-8153f6e9-aeb8-463e-a9ad-30dc7b662425 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c26246469b0fe452ea7e2a241a7e59c8d5f2dd53 --force-share --output=json" returned: 0 in 0.219s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:37:17 user nova-compute[75226]: DEBUG nova.virt.disk.api [None req-8153f6e9-aeb8-463e-a9ad-30dc7b662425 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8c4a9724-533e-40c8-ab2a-ce3415af240a/disk. size=1073741824 {{(pid=75226) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 17 01:37:17 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-8153f6e9-aeb8-463e-a9ad-30dc7b662425 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c4a9724-533e-40c8-ab2a-ce3415af240a/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:37:18 user nova-compute[75226]: DEBUG nova.network.neutron [None req-8153f6e9-aeb8-463e-a9ad-30dc7b662425 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] [instance: 8c4a9724-533e-40c8-ab2a-ce3415af240a] Successfully updated port: e30eaa7a-30df-48f5-b8de-30da75d74972 {{(pid=75226) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 17 01:37:18 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-8153f6e9-aeb8-463e-a9ad-30dc7b662425 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c4a9724-533e-40c8-ab2a-ce3415af240a/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:37:18 user nova-compute[75226]: DEBUG nova.virt.disk.api [None req-8153f6e9-aeb8-463e-a9ad-30dc7b662425 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Cannot resize image /opt/stack/data/nova/instances/8c4a9724-533e-40c8-ab2a-ce3415af240a/disk to a smaller size. {{(pid=75226) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 17 01:37:18 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-8153f6e9-aeb8-463e-a9ad-30dc7b662425 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] [instance: 8c4a9724-533e-40c8-ab2a-ce3415af240a] Created local disks {{(pid=75226) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 17 01:37:18 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-8153f6e9-aeb8-463e-a9ad-30dc7b662425 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] [instance: 8c4a9724-533e-40c8-ab2a-ce3415af240a] Ensure instance console log exists: /opt/stack/data/nova/instances/8c4a9724-533e-40c8-ab2a-ce3415af240a/console.log {{(pid=75226) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 17 01:37:18 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-8153f6e9-aeb8-463e-a9ad-30dc7b662425 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:37:18 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-8153f6e9-aeb8-463e-a9ad-30dc7b662425 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:37:18 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-8153f6e9-aeb8-463e-a9ad-30dc7b662425 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:37:18 user nova-compute[75226]: DEBUG nova.compute.manager [req-76c00757-5bff-4fb2-8d59-1769fc941edc req-f32f2c6d-5619-47cc-b9eb-a7b1744bbf69 service nova] [instance: 8c4a9724-533e-40c8-ab2a-ce3415af240a] Received event network-changed-e30eaa7a-30df-48f5-b8de-30da75d74972 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:37:18 user nova-compute[75226]: DEBUG nova.compute.manager [req-76c00757-5bff-4fb2-8d59-1769fc941edc req-f32f2c6d-5619-47cc-b9eb-a7b1744bbf69 service nova] [instance: 8c4a9724-533e-40c8-ab2a-ce3415af240a] Refreshing instance network info cache due to event network-changed-e30eaa7a-30df-48f5-b8de-30da75d74972. {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 01:37:18 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-76c00757-5bff-4fb2-8d59-1769fc941edc req-f32f2c6d-5619-47cc-b9eb-a7b1744bbf69 service nova] Acquiring lock "refresh_cache-8c4a9724-533e-40c8-ab2a-ce3415af240a" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:37:18 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-76c00757-5bff-4fb2-8d59-1769fc941edc req-f32f2c6d-5619-47cc-b9eb-a7b1744bbf69 service nova] Acquired lock "refresh_cache-8c4a9724-533e-40c8-ab2a-ce3415af240a" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:37:18 user nova-compute[75226]: DEBUG nova.network.neutron [req-76c00757-5bff-4fb2-8d59-1769fc941edc req-f32f2c6d-5619-47cc-b9eb-a7b1744bbf69 service nova] [instance: 8c4a9724-533e-40c8-ab2a-ce3415af240a] Refreshing network info cache for port e30eaa7a-30df-48f5-b8de-30da75d74972 {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 01:37:18 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-8153f6e9-aeb8-463e-a9ad-30dc7b662425 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Acquiring lock "refresh_cache-8c4a9724-533e-40c8-ab2a-ce3415af240a" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:37:18 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:37:18 user nova-compute[75226]: DEBUG nova.network.neutron [req-76c00757-5bff-4fb2-8d59-1769fc941edc req-f32f2c6d-5619-47cc-b9eb-a7b1744bbf69 service nova] [instance: 8c4a9724-533e-40c8-ab2a-ce3415af240a] Instance cache missing network info. {{(pid=75226) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 17 01:37:18 user nova-compute[75226]: DEBUG nova.network.neutron [req-76c00757-5bff-4fb2-8d59-1769fc941edc req-f32f2c6d-5619-47cc-b9eb-a7b1744bbf69 service nova] [instance: 8c4a9724-533e-40c8-ab2a-ce3415af240a] Updating instance_info_cache with network_info: [] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:37:18 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-76c00757-5bff-4fb2-8d59-1769fc941edc req-f32f2c6d-5619-47cc-b9eb-a7b1744bbf69 service nova] Releasing lock "refresh_cache-8c4a9724-533e-40c8-ab2a-ce3415af240a" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:37:18 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-8153f6e9-aeb8-463e-a9ad-30dc7b662425 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Acquired lock "refresh_cache-8c4a9724-533e-40c8-ab2a-ce3415af240a" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:37:18 user nova-compute[75226]: DEBUG nova.network.neutron [None req-8153f6e9-aeb8-463e-a9ad-30dc7b662425 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] [instance: 8c4a9724-533e-40c8-ab2a-ce3415af240a] Building network info cache for instance {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 01:37:18 user nova-compute[75226]: DEBUG nova.network.neutron [None req-8153f6e9-aeb8-463e-a9ad-30dc7b662425 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] [instance: 8c4a9724-533e-40c8-ab2a-ce3415af240a] Instance cache missing network info. {{(pid=75226) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 17 01:37:18 user nova-compute[75226]: DEBUG nova.network.neutron [None req-8153f6e9-aeb8-463e-a9ad-30dc7b662425 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] [instance: 8c4a9724-533e-40c8-ab2a-ce3415af240a] Updating instance_info_cache with network_info: [{"id": "e30eaa7a-30df-48f5-b8de-30da75d74972", "address": "fa:16:3e:f6:83:b8", "network": {"id": "44f50686-24e7-4e75-8269-4391a53286d0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1611114801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33699aa6c9db4815a1e79aff4685801e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape30eaa7a-30", "ovs_interfaceid": "e30eaa7a-30df-48f5-b8de-30da75d74972", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:37:18 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-8153f6e9-aeb8-463e-a9ad-30dc7b662425 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Releasing lock "refresh_cache-8c4a9724-533e-40c8-ab2a-ce3415af240a" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:37:18 user nova-compute[75226]: DEBUG nova.compute.manager [None req-8153f6e9-aeb8-463e-a9ad-30dc7b662425 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] [instance: 8c4a9724-533e-40c8-ab2a-ce3415af240a] Instance network_info: |[{"id": "e30eaa7a-30df-48f5-b8de-30da75d74972", "address": "fa:16:3e:f6:83:b8", "network": {"id": "44f50686-24e7-4e75-8269-4391a53286d0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1611114801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33699aa6c9db4815a1e79aff4685801e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape30eaa7a-30", "ovs_interfaceid": "e30eaa7a-30df-48f5-b8de-30da75d74972", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75226) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 17 01:37:18 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-8153f6e9-aeb8-463e-a9ad-30dc7b662425 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] [instance: 8c4a9724-533e-40c8-ab2a-ce3415af240a] Start _get_guest_xml network_info=[{"id": "e30eaa7a-30df-48f5-b8de-30da75d74972", "address": "fa:16:3e:f6:83:b8", "network": {"id": "44f50686-24e7-4e75-8269-4391a53286d0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1611114801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33699aa6c9db4815a1e79aff4685801e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape30eaa7a-30", "ovs_interfaceid": "e30eaa7a-30df-48f5-b8de-30da75d74972", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T01:37:11Z,direct_url=<?>,disk_format='qcow2',id=40bf979b-5f8a-47f7-a942-0f80525fa754,min_disk=0,min_ram=0,name='tempest-scenario-img--458559821',owner='33699aa6c9db4815a1e79aff4685801e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T01:37:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '40bf979b-5f8a-47f7-a942-0f80525fa754'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75226) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 17 01:37:18 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-8153f6e9-aeb8-463e-a9ad-30dc7b662425 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:37:18 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-8153f6e9-aeb8-463e-a9ad-30dc7b662425 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:37:18 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-8153f6e9-aeb8-463e-a9ad-30dc7b662425 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75226) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 17 01:37:18 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-8153f6e9-aeb8-463e-a9ad-30dc7b662425 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] CPU controller missing on host. {{(pid=75226) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 17 01:37:18 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-8153f6e9-aeb8-463e-a9ad-30dc7b662425 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75226) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 17 01:37:18 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-8153f6e9-aeb8-463e-a9ad-30dc7b662425 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] CPU controller found on host. {{(pid=75226) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 17 01:37:18 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-8153f6e9-aeb8-463e-a9ad-30dc7b662425 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75226) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 17 01:37:18 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-8153f6e9-aeb8-463e-a9ad-30dc7b662425 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-17T01:13:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T01:37:11Z,direct_url=<?>,disk_format='qcow2',id=40bf979b-5f8a-47f7-a942-0f80525fa754,min_disk=0,min_ram=0,name='tempest-scenario-img--458559821',owner='33699aa6c9db4815a1e79aff4685801e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T01:37:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 17 01:37:18 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-8153f6e9-aeb8-463e-a9ad-30dc7b662425 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Flavor limits 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 17 01:37:18 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-8153f6e9-aeb8-463e-a9ad-30dc7b662425 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Image limits 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 17 01:37:18 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-8153f6e9-aeb8-463e-a9ad-30dc7b662425 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Flavor pref 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 17 01:37:18 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-8153f6e9-aeb8-463e-a9ad-30dc7b662425 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Image pref 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 17 01:37:18 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-8153f6e9-aeb8-463e-a9ad-30dc7b662425 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 17 01:37:18 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-8153f6e9-aeb8-463e-a9ad-30dc7b662425 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 17 01:37:18 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-8153f6e9-aeb8-463e-a9ad-30dc7b662425 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75226) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 17 01:37:18 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-8153f6e9-aeb8-463e-a9ad-30dc7b662425 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Got 1 possible topologies {{(pid=75226) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 17 01:37:18 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-8153f6e9-aeb8-463e-a9ad-30dc7b662425 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 17 01:37:18 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-8153f6e9-aeb8-463e-a9ad-30dc7b662425 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 17 01:37:18 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-8153f6e9-aeb8-463e-a9ad-30dc7b662425 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:37:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2008555941',display_name='tempest-TestMinimumBasicScenario-server-2008555941',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2008555941',id=36,image_ref='40bf979b-5f8a-47f7-a942-0f80525fa754',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCdVsOUEJpOAsYDEFoGSrG2wZFHOFgpDHZxULbqhtmsHzngB+dzQ7shkC/vD5WlKGtDNdpdTeECAwcQe2pnhYO1KZ+i4VBBB4HMu36IpgRb7B+gq2o4uWntqgX+CEw8urA==',key_name='tempest-TestMinimumBasicScenario-114436321',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='33699aa6c9db4815a1e79aff4685801e',ramdisk_id='',reservation_id='r-7uved0ch',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40bf979b-5f8a-47f7-a942-0f80525fa754',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1224009744',owner_user_name='tempest-TestMinimumBasicScenario-1224009744-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T01:37:16Z,user_data=None,user_id='e7c57c13ff8a48f7b8b206d71e413646',uuid=8c4a9724-533e-40c8-ab2a-ce3415af240a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e30eaa7a-30df-48f5-b8de-30da75d74972", "address": "fa:16:3e:f6:83:b8", "network": {"id": "44f50686-24e7-4e75-8269-4391a53286d0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1611114801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33699aa6c9db4815a1e79aff4685801e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape30eaa7a-30", "ovs_interfaceid": "e30eaa7a-30df-48f5-b8de-30da75d74972", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75226) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 01:37:18 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-8153f6e9-aeb8-463e-a9ad-30dc7b662425 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Converting VIF {"id": "e30eaa7a-30df-48f5-b8de-30da75d74972", "address": "fa:16:3e:f6:83:b8", "network": {"id": "44f50686-24e7-4e75-8269-4391a53286d0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1611114801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33699aa6c9db4815a1e79aff4685801e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape30eaa7a-30", "ovs_interfaceid": "e30eaa7a-30df-48f5-b8de-30da75d74972", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:37:18 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-8153f6e9-aeb8-463e-a9ad-30dc7b662425 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:83:b8,bridge_name='br-int',has_traffic_filtering=True,id=e30eaa7a-30df-48f5-b8de-30da75d74972,network=Network(44f50686-24e7-4e75-8269-4391a53286d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape30eaa7a-30') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:37:18 user nova-compute[75226]: DEBUG nova.objects.instance [None req-8153f6e9-aeb8-463e-a9ad-30dc7b662425 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Lazy-loading 'pci_devices' on Instance uuid 8c4a9724-533e-40c8-ab2a-ce3415af240a {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:37:18 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-8153f6e9-aeb8-463e-a9ad-30dc7b662425 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] [instance: 8c4a9724-533e-40c8-ab2a-ce3415af240a] End _get_guest_xml xml=<domain type="kvm">
Nov 17 01:37:18 user nova-compute[75226]:   <uuid>8c4a9724-533e-40c8-ab2a-ce3415af240a</uuid>
Nov 17 01:37:18 user nova-compute[75226]:   <name>instance-00000024</name>
Nov 17 01:37:18 user nova-compute[75226]:   <memory>524288</memory>
Nov 17 01:37:18 user nova-compute[75226]:   <vcpu>1</vcpu>
Nov 17 01:37:18 user nova-compute[75226]:   <metadata>
Nov 17 01:37:18 user nova-compute[75226]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 17 01:37:18 user nova-compute[75226]:       <nova:package version="0.0.0"/>
Nov 17 01:37:18 user nova-compute[75226]:       <nova:name>tempest-TestMinimumBasicScenario-server-2008555941</nova:name>
Nov 17 01:37:18 user nova-compute[75226]:       <nova:creationTime>2023-11-17 01:37:18</nova:creationTime>
Nov 17 01:37:18 user nova-compute[75226]:       <nova:flavor name="m1.tiny">
Nov 17 01:37:18 user nova-compute[75226]:         <nova:memory>512</nova:memory>
Nov 17 01:37:18 user nova-compute[75226]:         <nova:disk>1</nova:disk>
Nov 17 01:37:18 user nova-compute[75226]:         <nova:swap>0</nova:swap>
Nov 17 01:37:18 user nova-compute[75226]:         <nova:ephemeral>0</nova:ephemeral>
Nov 17 01:37:18 user nova-compute[75226]:         <nova:vcpus>1</nova:vcpus>
Nov 17 01:37:18 user nova-compute[75226]:       </nova:flavor>
Nov 17 01:37:18 user nova-compute[75226]:       <nova:owner>
Nov 17 01:37:18 user nova-compute[75226]:         <nova:user uuid="e7c57c13ff8a48f7b8b206d71e413646">tempest-TestMinimumBasicScenario-1224009744-project-member</nova:user>
Nov 17 01:37:18 user nova-compute[75226]:         <nova:project uuid="33699aa6c9db4815a1e79aff4685801e">tempest-TestMinimumBasicScenario-1224009744</nova:project>
Nov 17 01:37:18 user nova-compute[75226]:       </nova:owner>
Nov 17 01:37:18 user nova-compute[75226]:       <nova:root type="image" uuid="40bf979b-5f8a-47f7-a942-0f80525fa754"/>
Nov 17 01:37:18 user nova-compute[75226]:       <nova:ports>
Nov 17 01:37:18 user nova-compute[75226]:         <nova:port uuid="e30eaa7a-30df-48f5-b8de-30da75d74972">
Nov 17 01:37:18 user nova-compute[75226]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 17 01:37:18 user nova-compute[75226]:         </nova:port>
Nov 17 01:37:18 user nova-compute[75226]:       </nova:ports>
Nov 17 01:37:18 user nova-compute[75226]:     </nova:instance>
Nov 17 01:37:18 user nova-compute[75226]:   </metadata>
Nov 17 01:37:18 user nova-compute[75226]:   <sysinfo type="smbios">
Nov 17 01:37:18 user nova-compute[75226]:     <system>
Nov 17 01:37:18 user nova-compute[75226]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 17 01:37:18 user nova-compute[75226]:       <entry name="product">OpenStack Nova</entry>
Nov 17 01:37:18 user nova-compute[75226]:       <entry name="version">0.0.0</entry>
Nov 17 01:37:18 user nova-compute[75226]:       <entry name="serial">8c4a9724-533e-40c8-ab2a-ce3415af240a</entry>
Nov 17 01:37:18 user nova-compute[75226]:       <entry name="uuid">8c4a9724-533e-40c8-ab2a-ce3415af240a</entry>
Nov 17 01:37:18 user nova-compute[75226]:       <entry name="family">Virtual Machine</entry>
Nov 17 01:37:18 user nova-compute[75226]:     </system>
Nov 17 01:37:18 user nova-compute[75226]:   </sysinfo>
Nov 17 01:37:18 user nova-compute[75226]:   <os>
Nov 17 01:37:18 user nova-compute[75226]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 17 01:37:18 user nova-compute[75226]:     <boot dev="hd"/>
Nov 17 01:37:18 user nova-compute[75226]:     <smbios mode="sysinfo"/>
Nov 17 01:37:18 user nova-compute[75226]:   </os>
Nov 17 01:37:18 user nova-compute[75226]:   <features>
Nov 17 01:37:18 user nova-compute[75226]:     <acpi/>
Nov 17 01:37:18 user nova-compute[75226]:     <apic/>
Nov 17 01:37:18 user nova-compute[75226]:     <vmcoreinfo/>
Nov 17 01:37:18 user nova-compute[75226]:   </features>
Nov 17 01:37:18 user nova-compute[75226]:   <clock offset="utc">
Nov 17 01:37:18 user nova-compute[75226]:     <timer name="pit" tickpolicy="delay"/>
Nov 17 01:37:18 user nova-compute[75226]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 17 01:37:18 user nova-compute[75226]:     <timer name="hpet" present="no"/>
Nov 17 01:37:18 user nova-compute[75226]:   </clock>
Nov 17 01:37:18 user nova-compute[75226]:   <cpu mode="custom" match="exact">
Nov 17 01:37:18 user nova-compute[75226]:     <model>Nehalem</model>
Nov 17 01:37:18 user nova-compute[75226]:     <topology sockets="1" cores="1" threads="1"/>
Nov 17 01:37:18 user nova-compute[75226]:   </cpu>
Nov 17 01:37:18 user nova-compute[75226]:   <devices>
Nov 17 01:37:18 user nova-compute[75226]:     <disk type="file" device="disk">
Nov 17 01:37:18 user nova-compute[75226]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 17 01:37:18 user nova-compute[75226]:       <source file="/opt/stack/data/nova/instances/8c4a9724-533e-40c8-ab2a-ce3415af240a/disk"/>
Nov 17 01:37:18 user nova-compute[75226]:       <target dev="vda" bus="virtio"/>
Nov 17 01:37:18 user nova-compute[75226]:     </disk>
Nov 17 01:37:18 user nova-compute[75226]:     <interface type="ethernet">
Nov 17 01:37:18 user nova-compute[75226]:       <mac address="fa:16:3e:f6:83:b8"/>
Nov 17 01:37:18 user nova-compute[75226]:       <model type="virtio"/>
Nov 17 01:37:18 user nova-compute[75226]:       <mtu size="1442"/>
Nov 17 01:37:18 user nova-compute[75226]:       <target dev="tape30eaa7a-30"/>
Nov 17 01:37:18 user nova-compute[75226]:     </interface>
Nov 17 01:37:18 user nova-compute[75226]:     <serial type="pty">
Nov 17 01:37:18 user nova-compute[75226]:       <log file="/opt/stack/data/nova/instances/8c4a9724-533e-40c8-ab2a-ce3415af240a/console.log" append="off"/>
Nov 17 01:37:18 user nova-compute[75226]:     </serial>
Nov 17 01:37:18 user nova-compute[75226]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 17 01:37:18 user nova-compute[75226]:     <video>
Nov 17 01:37:18 user nova-compute[75226]:       <model type="virtio"/>
Nov 17 01:37:18 user nova-compute[75226]:     </video>
Nov 17 01:37:18 user nova-compute[75226]:     <rng model="virtio">
Nov 17 01:37:18 user nova-compute[75226]:       <backend model="random">/dev/urandom</backend>
Nov 17 01:37:18 user nova-compute[75226]:     </rng>
Nov 17 01:37:18 user nova-compute[75226]:     <controller type="usb" index="0" model="none"/>
Nov 17 01:37:18 user nova-compute[75226]:     <memballoon model="virtio">
Nov 17 01:37:18 user nova-compute[75226]:       <stats period="10"/>
Nov 17 01:37:18 user nova-compute[75226]:     </memballoon>
Nov 17 01:37:18 user nova-compute[75226]:   </devices>
Nov 17 01:37:18 user nova-compute[75226]: </domain>
Nov 17 01:37:18 user nova-compute[75226]:  {{(pid=75226) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 17 01:37:18 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-8153f6e9-aeb8-463e-a9ad-30dc7b662425 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:37:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2008555941',display_name='tempest-TestMinimumBasicScenario-server-2008555941',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2008555941',id=36,image_ref='40bf979b-5f8a-47f7-a942-0f80525fa754',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCdVsOUEJpOAsYDEFoGSrG2wZFHOFgpDHZxULbqhtmsHzngB+dzQ7shkC/vD5WlKGtDNdpdTeECAwcQe2pnhYO1KZ+i4VBBB4HMu36IpgRb7B+gq2o4uWntqgX+CEw8urA==',key_name='tempest-TestMinimumBasicScenario-114436321',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='33699aa6c9db4815a1e79aff4685801e',ramdisk_id='',reservation_id='r-7uved0ch',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40bf979b-5f8a-47f7-a942-0f80525fa754',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1224009744',owner_user_name='tempest-TestMinimumBasicScenario-1224009744-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T01:37:16Z,user_data=None,user_id='e7c57c13ff8a48f7b8b206d71e413646',uuid=8c4a9724-533e-40c8-ab2a-ce3415af240a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e30eaa7a-30df-48f5-b8de-30da75d74972", "address": "fa:16:3e:f6:83:b8", "network": {"id": "44f50686-24e7-4e75-8269-4391a53286d0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1611114801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33699aa6c9db4815a1e79aff4685801e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape30eaa7a-30", "ovs_interfaceid": "e30eaa7a-30df-48f5-b8de-30da75d74972", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 17 01:37:18 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-8153f6e9-aeb8-463e-a9ad-30dc7b662425 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Converting VIF {"id": "e30eaa7a-30df-48f5-b8de-30da75d74972", "address": "fa:16:3e:f6:83:b8", "network": {"id": "44f50686-24e7-4e75-8269-4391a53286d0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1611114801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33699aa6c9db4815a1e79aff4685801e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape30eaa7a-30", "ovs_interfaceid": "e30eaa7a-30df-48f5-b8de-30da75d74972", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:37:18 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-8153f6e9-aeb8-463e-a9ad-30dc7b662425 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:83:b8,bridge_name='br-int',has_traffic_filtering=True,id=e30eaa7a-30df-48f5-b8de-30da75d74972,network=Network(44f50686-24e7-4e75-8269-4391a53286d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape30eaa7a-30') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:37:18 user nova-compute[75226]: DEBUG os_vif [None req-8153f6e9-aeb8-463e-a9ad-30dc7b662425 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:83:b8,bridge_name='br-int',has_traffic_filtering=True,id=e30eaa7a-30df-48f5-b8de-30da75d74972,network=Network(44f50686-24e7-4e75-8269-4391a53286d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape30eaa7a-30') {{(pid=75226) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 17 01:37:18 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:37:18 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:37:18 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 17 01:37:18 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:37:18 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0acb5548-94e3-5bbd-8b2c-d37e5601bc1a', '_type': 'linux-noop'}}, row=False) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:37:18 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:37:18 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:37:18 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:37:18 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape30eaa7a-30, may_exist=True, interface_attrs={}) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:37:18 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape30eaa7a-30, col_values=(('qos', UUID('7d878be9-6efc-414b-b003-5ece5eeb1f15')),), if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:37:18 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape30eaa7a-30, col_values=(('external_ids', {'iface-id': 'e30eaa7a-30df-48f5-b8de-30da75d74972', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f6:83:b8', 'vm-uuid': '8c4a9724-533e-40c8-ab2a-ce3415af240a'}),), if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:37:18 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:37:18 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:37:18 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:37:18 user nova-compute[75226]: INFO os_vif [None req-8153f6e9-aeb8-463e-a9ad-30dc7b662425 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:83:b8,bridge_name='br-int',has_traffic_filtering=True,id=e30eaa7a-30df-48f5-b8de-30da75d74972,network=Network(44f50686-24e7-4e75-8269-4391a53286d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape30eaa7a-30')
Nov 17 01:37:19 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-8153f6e9-aeb8-463e-a9ad-30dc7b662425 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] No BDM found with device name vda, not building metadata. {{(pid=75226) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 01:37:19 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-8153f6e9-aeb8-463e-a9ad-30dc7b662425 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] No VIF found with MAC fa:16:3e:f6:83:b8, not building metadata {{(pid=75226) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 01:37:19 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-de0427cd-4b85-4ae1-8e69-2678f614c225 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] Acquiring lock "d6d21784-2ebe-4a39-9ceb-f6607f02e3c4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:37:19 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-de0427cd-4b85-4ae1-8e69-2678f614c225 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] Lock "d6d21784-2ebe-4a39-9ceb-f6607f02e3c4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:37:19 user nova-compute[75226]: DEBUG nova.compute.manager [None req-de0427cd-4b85-4ae1-8e69-2678f614c225 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] [instance: d6d21784-2ebe-4a39-9ceb-f6607f02e3c4] Starting instance... {{(pid=75226) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 17 01:37:19 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-de0427cd-4b85-4ae1-8e69-2678f614c225 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:37:19 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-de0427cd-4b85-4ae1-8e69-2678f614c225 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:37:19 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-de0427cd-4b85-4ae1-8e69-2678f614c225 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75226) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 17 01:37:19 user nova-compute[75226]: INFO nova.compute.claims [None req-de0427cd-4b85-4ae1-8e69-2678f614c225 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] [instance: d6d21784-2ebe-4a39-9ceb-f6607f02e3c4] Claim successful on node user
Nov 17 01:37:19 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:37:19 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-de0427cd-4b85-4ae1-8e69-2678f614c225 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:37:19 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-de0427cd-4b85-4ae1-8e69-2678f614c225 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:37:19 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-de0427cd-4b85-4ae1-8e69-2678f614c225 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.487s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:37:19 user nova-compute[75226]: DEBUG nova.compute.manager [None req-de0427cd-4b85-4ae1-8e69-2678f614c225 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] [instance: d6d21784-2ebe-4a39-9ceb-f6607f02e3c4] Start building networks asynchronously for instance. {{(pid=75226) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 17 01:37:19 user nova-compute[75226]: DEBUG nova.compute.manager [None req-de0427cd-4b85-4ae1-8e69-2678f614c225 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] [instance: d6d21784-2ebe-4a39-9ceb-f6607f02e3c4] Allocating IP information in the background. {{(pid=75226) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 17 01:37:19 user nova-compute[75226]: DEBUG nova.network.neutron [None req-de0427cd-4b85-4ae1-8e69-2678f614c225 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] [instance: d6d21784-2ebe-4a39-9ceb-f6607f02e3c4] allocate_for_instance() {{(pid=75226) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 17 01:37:19 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-de0427cd-4b85-4ae1-8e69-2678f614c225 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] [instance: d6d21784-2ebe-4a39-9ceb-f6607f02e3c4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 17 01:37:19 user nova-compute[75226]: DEBUG nova.compute.manager [None req-de0427cd-4b85-4ae1-8e69-2678f614c225 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] [instance: d6d21784-2ebe-4a39-9ceb-f6607f02e3c4] Start building block device mappings for instance. {{(pid=75226) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 17 01:37:19 user nova-compute[75226]: DEBUG nova.policy [None req-de0427cd-4b85-4ae1-8e69-2678f614c225 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f5fd46cfdc1b4c4cb5b4c4f2e13ba6e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14e1b64486542989695083243768720', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75226) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 17 01:37:19 user nova-compute[75226]: DEBUG nova.compute.manager [None req-de0427cd-4b85-4ae1-8e69-2678f614c225 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] [instance: d6d21784-2ebe-4a39-9ceb-f6607f02e3c4] Start spawning the instance on the hypervisor. {{(pid=75226) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 17 01:37:19 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-de0427cd-4b85-4ae1-8e69-2678f614c225 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] [instance: d6d21784-2ebe-4a39-9ceb-f6607f02e3c4] Creating instance directory {{(pid=75226) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 17 01:37:19 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-de0427cd-4b85-4ae1-8e69-2678f614c225 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] [instance: d6d21784-2ebe-4a39-9ceb-f6607f02e3c4] Creating image(s)
Nov 17 01:37:19 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-de0427cd-4b85-4ae1-8e69-2678f614c225 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] Acquiring lock "/opt/stack/data/nova/instances/d6d21784-2ebe-4a39-9ceb-f6607f02e3c4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:37:19 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-de0427cd-4b85-4ae1-8e69-2678f614c225 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] Lock "/opt/stack/data/nova/instances/d6d21784-2ebe-4a39-9ceb-f6607f02e3c4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:37:19 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-de0427cd-4b85-4ae1-8e69-2678f614c225 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] Lock "/opt/stack/data/nova/instances/d6d21784-2ebe-4a39-9ceb-f6607f02e3c4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:37:19 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-de0427cd-4b85-4ae1-8e69-2678f614c225 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:37:19 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:37:19 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:37:19 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Starting heal instance info cache {{(pid=75226) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 17 01:37:20 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Didn't find any instances for network info cache update. {{(pid=75226) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 17 01:37:20 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:37:20 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75226) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 17 01:37:20 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-de0427cd-4b85-4ae1-8e69-2678f614c225 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json" returned: 0 in 0.188s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:37:20 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-de0427cd-4b85-4ae1-8e69-2678f614c225 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] Acquiring lock "a8a62c2546af3a2036b853250c5ac64d4c6b4371" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:37:20 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-de0427cd-4b85-4ae1-8e69-2678f614c225 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] Lock "a8a62c2546af3a2036b853250c5ac64d4c6b4371" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:37:20 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-de0427cd-4b85-4ae1-8e69-2678f614c225 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:37:20 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-de0427cd-4b85-4ae1-8e69-2678f614c225 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json" returned: 0 in 0.195s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:37:20 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-de0427cd-4b85-4ae1-8e69-2678f614c225 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371,backing_fmt=raw /opt/stack/data/nova/instances/d6d21784-2ebe-4a39-9ceb-f6607f02e3c4/disk 1073741824 {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:37:20 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-de0427cd-4b85-4ae1-8e69-2678f614c225 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371,backing_fmt=raw /opt/stack/data/nova/instances/d6d21784-2ebe-4a39-9ceb-f6607f02e3c4/disk 1073741824" returned: 0 in 0.049s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:37:20 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-de0427cd-4b85-4ae1-8e69-2678f614c225 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] Lock "a8a62c2546af3a2036b853250c5ac64d4c6b4371" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.255s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:37:20 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-de0427cd-4b85-4ae1-8e69-2678f614c225 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:37:20 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:37:20 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-de0427cd-4b85-4ae1-8e69-2678f614c225 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json" returned: 0 in 0.271s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:37:20 user nova-compute[75226]: DEBUG nova.virt.disk.api [None req-de0427cd-4b85-4ae1-8e69-2678f614c225 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d6d21784-2ebe-4a39-9ceb-f6607f02e3c4/disk. size=1073741824 {{(pid=75226) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 17 01:37:20 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-de0427cd-4b85-4ae1-8e69-2678f614c225 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6d21784-2ebe-4a39-9ceb-f6607f02e3c4/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:37:20 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-de0427cd-4b85-4ae1-8e69-2678f614c225 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6d21784-2ebe-4a39-9ceb-f6607f02e3c4/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:37:20 user nova-compute[75226]: DEBUG nova.virt.disk.api [None req-de0427cd-4b85-4ae1-8e69-2678f614c225 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] Cannot resize image /opt/stack/data/nova/instances/d6d21784-2ebe-4a39-9ceb-f6607f02e3c4/disk to a smaller size. {{(pid=75226) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 17 01:37:20 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-de0427cd-4b85-4ae1-8e69-2678f614c225 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] [instance: d6d21784-2ebe-4a39-9ceb-f6607f02e3c4] Created local disks {{(pid=75226) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 17 01:37:20 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-de0427cd-4b85-4ae1-8e69-2678f614c225 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] [instance: d6d21784-2ebe-4a39-9ceb-f6607f02e3c4] Ensure instance console log exists: /opt/stack/data/nova/instances/d6d21784-2ebe-4a39-9ceb-f6607f02e3c4/console.log {{(pid=75226) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 17 01:37:20 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-de0427cd-4b85-4ae1-8e69-2678f614c225 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:37:20 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-de0427cd-4b85-4ae1-8e69-2678f614c225 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:37:20 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-de0427cd-4b85-4ae1-8e69-2678f614c225 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:37:20 user nova-compute[75226]: DEBUG nova.network.neutron [None req-de0427cd-4b85-4ae1-8e69-2678f614c225 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] [instance: d6d21784-2ebe-4a39-9ceb-f6607f02e3c4] Successfully created port: 2a4dd370-0638-425d-ba53-19c724a14644 {{(pid=75226) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 17 01:37:21 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:37:21 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:37:21 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:37:21 user nova-compute[75226]: DEBUG nova.network.neutron [None req-de0427cd-4b85-4ae1-8e69-2678f614c225 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] [instance: d6d21784-2ebe-4a39-9ceb-f6607f02e3c4] Successfully updated port: 2a4dd370-0638-425d-ba53-19c724a14644 {{(pid=75226) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 17 01:37:21 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-de0427cd-4b85-4ae1-8e69-2678f614c225 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] Acquiring lock "refresh_cache-d6d21784-2ebe-4a39-9ceb-f6607f02e3c4" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:37:21 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-de0427cd-4b85-4ae1-8e69-2678f614c225 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] Acquired lock "refresh_cache-d6d21784-2ebe-4a39-9ceb-f6607f02e3c4" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:37:21 user nova-compute[75226]: DEBUG nova.network.neutron [None req-de0427cd-4b85-4ae1-8e69-2678f614c225 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] [instance: d6d21784-2ebe-4a39-9ceb-f6607f02e3c4] Building network info cache for instance {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 01:37:21 user nova-compute[75226]: DEBUG nova.compute.manager [req-b0ddd72d-48b6-4ceb-b4c2-fd85e1d0d970 req-651d36bd-2e1d-4c2b-9b96-9863e2be7764 service nova] [instance: d6d21784-2ebe-4a39-9ceb-f6607f02e3c4] Received event network-changed-2a4dd370-0638-425d-ba53-19c724a14644 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:37:21 user nova-compute[75226]: DEBUG nova.compute.manager [req-b0ddd72d-48b6-4ceb-b4c2-fd85e1d0d970 req-651d36bd-2e1d-4c2b-9b96-9863e2be7764 service nova] [instance: d6d21784-2ebe-4a39-9ceb-f6607f02e3c4] Refreshing instance network info cache due to event network-changed-2a4dd370-0638-425d-ba53-19c724a14644. {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 01:37:21 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-b0ddd72d-48b6-4ceb-b4c2-fd85e1d0d970 req-651d36bd-2e1d-4c2b-9b96-9863e2be7764 service nova] Acquiring lock "refresh_cache-d6d21784-2ebe-4a39-9ceb-f6607f02e3c4" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:37:21 user nova-compute[75226]: DEBUG nova.network.neutron [None req-de0427cd-4b85-4ae1-8e69-2678f614c225 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] [instance: d6d21784-2ebe-4a39-9ceb-f6607f02e3c4] Instance cache missing network info. {{(pid=75226) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 17 01:37:22 user nova-compute[75226]: DEBUG nova.network.neutron [None req-de0427cd-4b85-4ae1-8e69-2678f614c225 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] [instance: d6d21784-2ebe-4a39-9ceb-f6607f02e3c4] Updating instance_info_cache with network_info: [{"id": "2a4dd370-0638-425d-ba53-19c724a14644", "address": "fa:16:3e:f6:f1:ac", "network": {"id": "e3bdabce-76e0-4de2-9b44-dbe96b162892", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1190388267-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c14e1b64486542989695083243768720", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a4dd370-06", "ovs_interfaceid": "2a4dd370-0638-425d-ba53-19c724a14644", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:37:22 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-de0427cd-4b85-4ae1-8e69-2678f614c225 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] Releasing lock "refresh_cache-d6d21784-2ebe-4a39-9ceb-f6607f02e3c4" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:37:22 user nova-compute[75226]: DEBUG nova.compute.manager [None req-de0427cd-4b85-4ae1-8e69-2678f614c225 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] [instance: d6d21784-2ebe-4a39-9ceb-f6607f02e3c4] Instance network_info: |[{"id": "2a4dd370-0638-425d-ba53-19c724a14644", "address": "fa:16:3e:f6:f1:ac", "network": {"id": "e3bdabce-76e0-4de2-9b44-dbe96b162892", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1190388267-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c14e1b64486542989695083243768720", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a4dd370-06", "ovs_interfaceid": "2a4dd370-0638-425d-ba53-19c724a14644", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75226) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 17 01:37:22 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-b0ddd72d-48b6-4ceb-b4c2-fd85e1d0d970 req-651d36bd-2e1d-4c2b-9b96-9863e2be7764 service nova] Acquired lock "refresh_cache-d6d21784-2ebe-4a39-9ceb-f6607f02e3c4" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:37:22 user nova-compute[75226]: DEBUG nova.network.neutron [req-b0ddd72d-48b6-4ceb-b4c2-fd85e1d0d970 req-651d36bd-2e1d-4c2b-9b96-9863e2be7764 service nova] [instance: d6d21784-2ebe-4a39-9ceb-f6607f02e3c4] Refreshing network info cache for port 2a4dd370-0638-425d-ba53-19c724a14644 {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 01:37:22 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-de0427cd-4b85-4ae1-8e69-2678f614c225 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] [instance: d6d21784-2ebe-4a39-9ceb-f6607f02e3c4] Start _get_guest_xml network_info=[{"id": "2a4dd370-0638-425d-ba53-19c724a14644", "address": "fa:16:3e:f6:f1:ac", "network": {"id": "e3bdabce-76e0-4de2-9b44-dbe96b162892", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1190388267-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c14e1b64486542989695083243768720", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a4dd370-06", "ovs_interfaceid": "2a4dd370-0638-425d-ba53-19c724a14644", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T01:13:22Z,direct_url=<?>,disk_format='qcow2',id=0b369aea-6f3f-4690-9f01-229b90ab6310,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4e110cbf9a84362a6864a7732c435a1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T01:13:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '0b369aea-6f3f-4690-9f01-229b90ab6310'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75226) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 17 01:37:22 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-de0427cd-4b85-4ae1-8e69-2678f614c225 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:37:22 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-de0427cd-4b85-4ae1-8e69-2678f614c225 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:37:22 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-de0427cd-4b85-4ae1-8e69-2678f614c225 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75226) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 17 01:37:22 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-de0427cd-4b85-4ae1-8e69-2678f614c225 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] CPU controller missing on host. {{(pid=75226) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 17 01:37:22 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-de0427cd-4b85-4ae1-8e69-2678f614c225 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75226) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 17 01:37:22 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-de0427cd-4b85-4ae1-8e69-2678f614c225 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] CPU controller found on host. {{(pid=75226) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 17 01:37:22 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-de0427cd-4b85-4ae1-8e69-2678f614c225 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75226) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 17 01:37:22 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-de0427cd-4b85-4ae1-8e69-2678f614c225 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-17T01:13:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T01:13:22Z,direct_url=<?>,disk_format='qcow2',id=0b369aea-6f3f-4690-9f01-229b90ab6310,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4e110cbf9a84362a6864a7732c435a1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T01:13:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 17 01:37:22 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-de0427cd-4b85-4ae1-8e69-2678f614c225 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] Flavor limits 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 17 01:37:22 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-de0427cd-4b85-4ae1-8e69-2678f614c225 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] Image limits 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 17 01:37:22 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-de0427cd-4b85-4ae1-8e69-2678f614c225 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] Flavor pref 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 17 01:37:22 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-de0427cd-4b85-4ae1-8e69-2678f614c225 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] Image pref 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 17 01:37:22 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-de0427cd-4b85-4ae1-8e69-2678f614c225 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 17 01:37:22 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-de0427cd-4b85-4ae1-8e69-2678f614c225 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 17 01:37:22 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-de0427cd-4b85-4ae1-8e69-2678f614c225 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75226) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 17 01:37:22 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-de0427cd-4b85-4ae1-8e69-2678f614c225 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] Got 1 possible topologies {{(pid=75226) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 17 01:37:22 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-de0427cd-4b85-4ae1-8e69-2678f614c225 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 17 01:37:22 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-de0427cd-4b85-4ae1-8e69-2678f614c225 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 17 01:37:22 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-de0427cd-4b85-4ae1-8e69-2678f614c225 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:37:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-135638902',display_name='tempest-TestServerVolumeAttachmentScenario-server-135638902',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-135638902',id=37,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKQ1mLoAH8kDpQunuaByJ163vN2/Z2P9qpqcGqugijJ2MCSFeSDRi4EN+EXQlXba/VswtI0JQpDXQ0KhoK2IzpfPBPKmsCGMko5EpbYjZ8j46licGNscA6I+MQz5ogFI6Q==',key_name='tempest-keypair-1187688175',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c14e1b64486542989695083243768720',ramdisk_id='',reservation_id='r-pxmqwjqj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1206704109',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1206704109-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T01:37:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f5fd46cfdc1b4c4cb5b4c4f2e13ba6e6',uuid=d6d21784-2ebe-4a39-9ceb-f6607f02e3c4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2a4dd370-0638-425d-ba53-19c724a14644", "address": "fa:16:3e:f6:f1:ac", "network": {"id": "e3bdabce-76e0-4de2-9b44-dbe96b162892", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1190388267-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c14e1b64486542989695083243768720", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a4dd370-06", "ovs_interfaceid": "2a4dd370-0638-425d-ba53-19c724a14644", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75226) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 01:37:22 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-de0427cd-4b85-4ae1-8e69-2678f614c225 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] Converting VIF {"id": "2a4dd370-0638-425d-ba53-19c724a14644", "address": "fa:16:3e:f6:f1:ac", "network": {"id": "e3bdabce-76e0-4de2-9b44-dbe96b162892", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1190388267-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c14e1b64486542989695083243768720", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a4dd370-06", "ovs_interfaceid": "2a4dd370-0638-425d-ba53-19c724a14644", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:37:22 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-de0427cd-4b85-4ae1-8e69-2678f614c225 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:f1:ac,bridge_name='br-int',has_traffic_filtering=True,id=2a4dd370-0638-425d-ba53-19c724a14644,network=Network(e3bdabce-76e0-4de2-9b44-dbe96b162892),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a4dd370-06') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:37:22 user nova-compute[75226]: DEBUG nova.objects.instance [None req-de0427cd-4b85-4ae1-8e69-2678f614c225 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] Lazy-loading 'pci_devices' on Instance uuid d6d21784-2ebe-4a39-9ceb-f6607f02e3c4 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:37:22 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-de0427cd-4b85-4ae1-8e69-2678f614c225 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] [instance: d6d21784-2ebe-4a39-9ceb-f6607f02e3c4] End _get_guest_xml xml=<domain type="kvm">
Nov 17 01:37:22 user nova-compute[75226]:   <uuid>d6d21784-2ebe-4a39-9ceb-f6607f02e3c4</uuid>
Nov 17 01:37:22 user nova-compute[75226]:   <name>instance-00000025</name>
Nov 17 01:37:22 user nova-compute[75226]:   <memory>524288</memory>
Nov 17 01:37:22 user nova-compute[75226]:   <vcpu>1</vcpu>
Nov 17 01:37:22 user nova-compute[75226]:   <metadata>
Nov 17 01:37:22 user nova-compute[75226]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 17 01:37:22 user nova-compute[75226]:       <nova:package version="0.0.0"/>
Nov 17 01:37:22 user nova-compute[75226]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-135638902</nova:name>
Nov 17 01:37:22 user nova-compute[75226]:       <nova:creationTime>2023-11-17 01:37:22</nova:creationTime>
Nov 17 01:37:22 user nova-compute[75226]:       <nova:flavor name="m1.tiny">
Nov 17 01:37:22 user nova-compute[75226]:         <nova:memory>512</nova:memory>
Nov 17 01:37:22 user nova-compute[75226]:         <nova:disk>1</nova:disk>
Nov 17 01:37:22 user nova-compute[75226]:         <nova:swap>0</nova:swap>
Nov 17 01:37:22 user nova-compute[75226]:         <nova:ephemeral>0</nova:ephemeral>
Nov 17 01:37:22 user nova-compute[75226]:         <nova:vcpus>1</nova:vcpus>
Nov 17 01:37:22 user nova-compute[75226]:       </nova:flavor>
Nov 17 01:37:22 user nova-compute[75226]:       <nova:owner>
Nov 17 01:37:22 user nova-compute[75226]:         <nova:user uuid="f5fd46cfdc1b4c4cb5b4c4f2e13ba6e6">tempest-TestServerVolumeAttachmentScenario-1206704109-project-member</nova:user>
Nov 17 01:37:22 user nova-compute[75226]:         <nova:project uuid="c14e1b64486542989695083243768720">tempest-TestServerVolumeAttachmentScenario-1206704109</nova:project>
Nov 17 01:37:22 user nova-compute[75226]:       </nova:owner>
Nov 17 01:37:22 user nova-compute[75226]:       <nova:root type="image" uuid="0b369aea-6f3f-4690-9f01-229b90ab6310"/>
Nov 17 01:37:22 user nova-compute[75226]:       <nova:ports>
Nov 17 01:37:22 user nova-compute[75226]:         <nova:port uuid="2a4dd370-0638-425d-ba53-19c724a14644">
Nov 17 01:37:22 user nova-compute[75226]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 17 01:37:22 user nova-compute[75226]:         </nova:port>
Nov 17 01:37:22 user nova-compute[75226]:       </nova:ports>
Nov 17 01:37:22 user nova-compute[75226]:     </nova:instance>
Nov 17 01:37:22 user nova-compute[75226]:   </metadata>
Nov 17 01:37:22 user nova-compute[75226]:   <sysinfo type="smbios">
Nov 17 01:37:22 user nova-compute[75226]:     <system>
Nov 17 01:37:22 user nova-compute[75226]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 17 01:37:22 user nova-compute[75226]:       <entry name="product">OpenStack Nova</entry>
Nov 17 01:37:22 user nova-compute[75226]:       <entry name="version">0.0.0</entry>
Nov 17 01:37:22 user nova-compute[75226]:       <entry name="serial">d6d21784-2ebe-4a39-9ceb-f6607f02e3c4</entry>
Nov 17 01:37:22 user nova-compute[75226]:       <entry name="uuid">d6d21784-2ebe-4a39-9ceb-f6607f02e3c4</entry>
Nov 17 01:37:22 user nova-compute[75226]:       <entry name="family">Virtual Machine</entry>
Nov 17 01:37:22 user nova-compute[75226]:     </system>
Nov 17 01:37:22 user nova-compute[75226]:   </sysinfo>
Nov 17 01:37:22 user nova-compute[75226]:   <os>
Nov 17 01:37:22 user nova-compute[75226]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 17 01:37:22 user nova-compute[75226]:     <boot dev="hd"/>
Nov 17 01:37:22 user nova-compute[75226]:     <smbios mode="sysinfo"/>
Nov 17 01:37:22 user nova-compute[75226]:   </os>
Nov 17 01:37:22 user nova-compute[75226]:   <features>
Nov 17 01:37:22 user nova-compute[75226]:     <acpi/>
Nov 17 01:37:22 user nova-compute[75226]:     <apic/>
Nov 17 01:37:22 user nova-compute[75226]:     <vmcoreinfo/>
Nov 17 01:37:22 user nova-compute[75226]:   </features>
Nov 17 01:37:22 user nova-compute[75226]:   <clock offset="utc">
Nov 17 01:37:22 user nova-compute[75226]:     <timer name="pit" tickpolicy="delay"/>
Nov 17 01:37:22 user nova-compute[75226]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 17 01:37:22 user nova-compute[75226]:     <timer name="hpet" present="no"/>
Nov 17 01:37:22 user nova-compute[75226]:   </clock>
Nov 17 01:37:22 user nova-compute[75226]:   <cpu mode="custom" match="exact">
Nov 17 01:37:22 user nova-compute[75226]:     <model>Nehalem</model>
Nov 17 01:37:22 user nova-compute[75226]:     <topology sockets="1" cores="1" threads="1"/>
Nov 17 01:37:22 user nova-compute[75226]:   </cpu>
Nov 17 01:37:22 user nova-compute[75226]:   <devices>
Nov 17 01:37:22 user nova-compute[75226]:     <disk type="file" device="disk">
Nov 17 01:37:22 user nova-compute[75226]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 17 01:37:22 user nova-compute[75226]:       <source file="/opt/stack/data/nova/instances/d6d21784-2ebe-4a39-9ceb-f6607f02e3c4/disk"/>
Nov 17 01:37:22 user nova-compute[75226]:       <target dev="vda" bus="virtio"/>
Nov 17 01:37:22 user nova-compute[75226]:     </disk>
Nov 17 01:37:22 user nova-compute[75226]:     <interface type="ethernet">
Nov 17 01:37:22 user nova-compute[75226]:       <mac address="fa:16:3e:f6:f1:ac"/>
Nov 17 01:37:22 user nova-compute[75226]:       <model type="virtio"/>
Nov 17 01:37:22 user nova-compute[75226]:       <mtu size="1442"/>
Nov 17 01:37:22 user nova-compute[75226]:       <target dev="tap2a4dd370-06"/>
Nov 17 01:37:22 user nova-compute[75226]:     </interface>
Nov 17 01:37:22 user nova-compute[75226]:     <serial type="pty">
Nov 17 01:37:22 user nova-compute[75226]:       <log file="/opt/stack/data/nova/instances/d6d21784-2ebe-4a39-9ceb-f6607f02e3c4/console.log" append="off"/>
Nov 17 01:37:22 user nova-compute[75226]:     </serial>
Nov 17 01:37:22 user nova-compute[75226]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 17 01:37:22 user nova-compute[75226]:     <video>
Nov 17 01:37:22 user nova-compute[75226]:       <model type="virtio"/>
Nov 17 01:37:22 user nova-compute[75226]:     </video>
Nov 17 01:37:22 user nova-compute[75226]:     <rng model="virtio">
Nov 17 01:37:22 user nova-compute[75226]:       <backend model="random">/dev/urandom</backend>
Nov 17 01:37:22 user nova-compute[75226]:     </rng>
Nov 17 01:37:22 user nova-compute[75226]:     <controller type="usb" index="0" model="none"/>
Nov 17 01:37:22 user nova-compute[75226]:     <memballoon model="virtio">
Nov 17 01:37:22 user nova-compute[75226]:       <stats period="10"/>
Nov 17 01:37:22 user nova-compute[75226]:     </memballoon>
Nov 17 01:37:22 user nova-compute[75226]:   </devices>
Nov 17 01:37:22 user nova-compute[75226]: </domain>
Nov 17 01:37:22 user nova-compute[75226]:  {{(pid=75226) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 17 01:37:22 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-de0427cd-4b85-4ae1-8e69-2678f614c225 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:37:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-135638902',display_name='tempest-TestServerVolumeAttachmentScenario-server-135638902',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-135638902',id=37,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKQ1mLoAH8kDpQunuaByJ163vN2/Z2P9qpqcGqugijJ2MCSFeSDRi4EN+EXQlXba/VswtI0JQpDXQ0KhoK2IzpfPBPKmsCGMko5EpbYjZ8j46licGNscA6I+MQz5ogFI6Q==',key_name='tempest-keypair-1187688175',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c14e1b64486542989695083243768720',ramdisk_id='',reservation_id='r-pxmqwjqj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1206704109',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1206704109-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T01:37:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f5fd46cfdc1b4c4cb5b4c4f2e13ba6e6',uuid=d6d21784-2ebe-4a39-9ceb-f6607f02e3c4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2a4dd370-0638-425d-ba53-19c724a14644", "address": "fa:16:3e:f6:f1:ac", "network": {"id": "e3bdabce-76e0-4de2-9b44-dbe96b162892", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1190388267-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c14e1b64486542989695083243768720", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a4dd370-06", "ovs_interfaceid": "2a4dd370-0638-425d-ba53-19c724a14644", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 17 01:37:22 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-de0427cd-4b85-4ae1-8e69-2678f614c225 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] Converting VIF {"id": "2a4dd370-0638-425d-ba53-19c724a14644", "address": "fa:16:3e:f6:f1:ac", "network": {"id": "e3bdabce-76e0-4de2-9b44-dbe96b162892", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1190388267-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c14e1b64486542989695083243768720", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a4dd370-06", "ovs_interfaceid": "2a4dd370-0638-425d-ba53-19c724a14644", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:37:22 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-de0427cd-4b85-4ae1-8e69-2678f614c225 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:f1:ac,bridge_name='br-int',has_traffic_filtering=True,id=2a4dd370-0638-425d-ba53-19c724a14644,network=Network(e3bdabce-76e0-4de2-9b44-dbe96b162892),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a4dd370-06') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:37:22 user nova-compute[75226]: DEBUG os_vif [None req-de0427cd-4b85-4ae1-8e69-2678f614c225 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:f1:ac,bridge_name='br-int',has_traffic_filtering=True,id=2a4dd370-0638-425d-ba53-19c724a14644,network=Network(e3bdabce-76e0-4de2-9b44-dbe96b162892),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a4dd370-06') {{(pid=75226) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 17 01:37:22 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:37:22 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:37:22 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 17 01:37:22 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:37:22 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '31899430-5bce-5398-8cba-a71bea402286', '_type': 'linux-noop'}}, row=False) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:37:22 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:37:22 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:37:22 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:37:22 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2a4dd370-06, may_exist=True, interface_attrs={}) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:37:22 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2a4dd370-06, col_values=(('qos', UUID('e9283263-fd28-4896-b6f1-87fffb047bd5')),), if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:37:22 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2a4dd370-06, col_values=(('external_ids', {'iface-id': '2a4dd370-0638-425d-ba53-19c724a14644', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f6:f1:ac', 'vm-uuid': 'd6d21784-2ebe-4a39-9ceb-f6607f02e3c4'}),), if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:37:22 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:37:22 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:37:22 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:37:22 user nova-compute[75226]: INFO os_vif [None req-de0427cd-4b85-4ae1-8e69-2678f614c225 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:f1:ac,bridge_name='br-int',has_traffic_filtering=True,id=2a4dd370-0638-425d-ba53-19c724a14644,network=Network(e3bdabce-76e0-4de2-9b44-dbe96b162892),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a4dd370-06')
Nov 17 01:37:22 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-de0427cd-4b85-4ae1-8e69-2678f614c225 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] No BDM found with device name vda, not building metadata. {{(pid=75226) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 01:37:22 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-de0427cd-4b85-4ae1-8e69-2678f614c225 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] No VIF found with MAC fa:16:3e:f6:f1:ac, not building metadata {{(pid=75226) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 01:37:22 user nova-compute[75226]: DEBUG nova.network.neutron [req-b0ddd72d-48b6-4ceb-b4c2-fd85e1d0d970 req-651d36bd-2e1d-4c2b-9b96-9863e2be7764 service nova] [instance: d6d21784-2ebe-4a39-9ceb-f6607f02e3c4] Updated VIF entry in instance network info cache for port 2a4dd370-0638-425d-ba53-19c724a14644. {{(pid=75226) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 01:37:22 user nova-compute[75226]: DEBUG nova.network.neutron [req-b0ddd72d-48b6-4ceb-b4c2-fd85e1d0d970 req-651d36bd-2e1d-4c2b-9b96-9863e2be7764 service nova] [instance: d6d21784-2ebe-4a39-9ceb-f6607f02e3c4] Updating instance_info_cache with network_info: [{"id": "2a4dd370-0638-425d-ba53-19c724a14644", "address": "fa:16:3e:f6:f1:ac", "network": {"id": "e3bdabce-76e0-4de2-9b44-dbe96b162892", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1190388267-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c14e1b64486542989695083243768720", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a4dd370-06", "ovs_interfaceid": "2a4dd370-0638-425d-ba53-19c724a14644", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:37:22 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-b0ddd72d-48b6-4ceb-b4c2-fd85e1d0d970 req-651d36bd-2e1d-4c2b-9b96-9863e2be7764 service nova] Releasing lock "refresh_cache-d6d21784-2ebe-4a39-9ceb-f6607f02e3c4" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:37:22 user nova-compute[75226]: DEBUG nova.compute.manager [None req-8153f6e9-aeb8-463e-a9ad-30dc7b662425 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] [instance: 8c4a9724-533e-40c8-ab2a-ce3415af240a] Instance event wait completed in 0 seconds for  {{(pid=75226) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 17 01:37:22 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-8153f6e9-aeb8-463e-a9ad-30dc7b662425 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] [instance: 8c4a9724-533e-40c8-ab2a-ce3415af240a] Guest created on hypervisor {{(pid=75226) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 17 01:37:22 user nova-compute[75226]: INFO nova.virt.libvirt.driver [-] [instance: 8c4a9724-533e-40c8-ab2a-ce3415af240a] Instance spawned successfully.
Nov 17 01:37:22 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-8153f6e9-aeb8-463e-a9ad-30dc7b662425 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] [instance: 8c4a9724-533e-40c8-ab2a-ce3415af240a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 17 01:37:22 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-8153f6e9-aeb8-463e-a9ad-30dc7b662425 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] [instance: 8c4a9724-533e-40c8-ab2a-ce3415af240a] Found default for hw_cdrom_bus of ide {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:37:22 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-8153f6e9-aeb8-463e-a9ad-30dc7b662425 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] [instance: 8c4a9724-533e-40c8-ab2a-ce3415af240a] Found default for hw_disk_bus of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:37:22 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-8153f6e9-aeb8-463e-a9ad-30dc7b662425 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] [instance: 8c4a9724-533e-40c8-ab2a-ce3415af240a] Found default for hw_input_bus of None {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:37:22 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-8153f6e9-aeb8-463e-a9ad-30dc7b662425 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] [instance: 8c4a9724-533e-40c8-ab2a-ce3415af240a] Found default for hw_pointer_model of None {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:37:22 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-8153f6e9-aeb8-463e-a9ad-30dc7b662425 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] [instance: 8c4a9724-533e-40c8-ab2a-ce3415af240a] Found default for hw_video_model of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:37:22 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-8153f6e9-aeb8-463e-a9ad-30dc7b662425 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] [instance: 8c4a9724-533e-40c8-ab2a-ce3415af240a] Found default for hw_vif_model of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:37:22 user nova-compute[75226]: INFO nova.compute.manager [None req-8153f6e9-aeb8-463e-a9ad-30dc7b662425 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] [instance: 8c4a9724-533e-40c8-ab2a-ce3415af240a] Took 6.99 seconds to spawn the instance on the hypervisor.
Nov 17 01:37:22 user nova-compute[75226]: DEBUG nova.compute.manager [None req-8153f6e9-aeb8-463e-a9ad-30dc7b662425 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] [instance: 8c4a9724-533e-40c8-ab2a-ce3415af240a] Checking state {{(pid=75226) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 01:37:22 user nova-compute[75226]: INFO nova.compute.manager [None req-8153f6e9-aeb8-463e-a9ad-30dc7b662425 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] [instance: 8c4a9724-533e-40c8-ab2a-ce3415af240a] Took 7.85 seconds to build instance.
Nov 17 01:37:22 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-8153f6e9-aeb8-463e-a9ad-30dc7b662425 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Lock "8c4a9724-533e-40c8-ab2a-ce3415af240a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.991s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:37:23 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:37:23 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:37:23 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:37:24 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:37:24 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:37:25 user nova-compute[75226]: DEBUG nova.compute.manager [req-8c66a9ef-239f-4bda-920a-dd980ab7b78d req-1f553045-ea1e-4a24-970d-f107819ad69e service nova] [instance: 8c4a9724-533e-40c8-ab2a-ce3415af240a] Received event network-vif-plugged-e30eaa7a-30df-48f5-b8de-30da75d74972 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:37:25 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-8c66a9ef-239f-4bda-920a-dd980ab7b78d req-1f553045-ea1e-4a24-970d-f107819ad69e service nova] Acquiring lock "8c4a9724-533e-40c8-ab2a-ce3415af240a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:37:25 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-8c66a9ef-239f-4bda-920a-dd980ab7b78d req-1f553045-ea1e-4a24-970d-f107819ad69e service nova] Lock "8c4a9724-533e-40c8-ab2a-ce3415af240a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:37:25 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-8c66a9ef-239f-4bda-920a-dd980ab7b78d req-1f553045-ea1e-4a24-970d-f107819ad69e service nova] Lock "8c4a9724-533e-40c8-ab2a-ce3415af240a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:37:25 user nova-compute[75226]: DEBUG nova.compute.manager [req-8c66a9ef-239f-4bda-920a-dd980ab7b78d req-1f553045-ea1e-4a24-970d-f107819ad69e service nova] [instance: 8c4a9724-533e-40c8-ab2a-ce3415af240a] No waiting events found dispatching network-vif-plugged-e30eaa7a-30df-48f5-b8de-30da75d74972 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:37:25 user nova-compute[75226]: WARNING nova.compute.manager [req-8c66a9ef-239f-4bda-920a-dd980ab7b78d req-1f553045-ea1e-4a24-970d-f107819ad69e service nova] [instance: 8c4a9724-533e-40c8-ab2a-ce3415af240a] Received unexpected event network-vif-plugged-e30eaa7a-30df-48f5-b8de-30da75d74972 for instance with vm_state active and task_state None.
Nov 17 01:37:26 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:37:26 user nova-compute[75226]: DEBUG nova.compute.manager [None req-de0427cd-4b85-4ae1-8e69-2678f614c225 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] [instance: d6d21784-2ebe-4a39-9ceb-f6607f02e3c4] Instance event wait completed in 0 seconds for  {{(pid=75226) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 17 01:37:26 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-de0427cd-4b85-4ae1-8e69-2678f614c225 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] [instance: d6d21784-2ebe-4a39-9ceb-f6607f02e3c4] Guest created on hypervisor {{(pid=75226) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 17 01:37:26 user nova-compute[75226]: INFO nova.virt.libvirt.driver [-] [instance: d6d21784-2ebe-4a39-9ceb-f6607f02e3c4] Instance spawned successfully.
Nov 17 01:37:26 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-de0427cd-4b85-4ae1-8e69-2678f614c225 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] [instance: d6d21784-2ebe-4a39-9ceb-f6607f02e3c4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 17 01:37:26 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-de0427cd-4b85-4ae1-8e69-2678f614c225 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] [instance: d6d21784-2ebe-4a39-9ceb-f6607f02e3c4] Found default for hw_cdrom_bus of ide {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:37:26 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-de0427cd-4b85-4ae1-8e69-2678f614c225 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] [instance: d6d21784-2ebe-4a39-9ceb-f6607f02e3c4] Found default for hw_disk_bus of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:37:26 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-de0427cd-4b85-4ae1-8e69-2678f614c225 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] [instance: d6d21784-2ebe-4a39-9ceb-f6607f02e3c4] Found default for hw_input_bus of None {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:37:26 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-de0427cd-4b85-4ae1-8e69-2678f614c225 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] [instance: d6d21784-2ebe-4a39-9ceb-f6607f02e3c4] Found default for hw_pointer_model of None {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:37:26 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-de0427cd-4b85-4ae1-8e69-2678f614c225 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] [instance: d6d21784-2ebe-4a39-9ceb-f6607f02e3c4] Found default for hw_video_model of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:37:26 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-de0427cd-4b85-4ae1-8e69-2678f614c225 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] [instance: d6d21784-2ebe-4a39-9ceb-f6607f02e3c4] Found default for hw_vif_model of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:37:26 user nova-compute[75226]: INFO nova.compute.manager [None req-de0427cd-4b85-4ae1-8e69-2678f614c225 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] [instance: d6d21784-2ebe-4a39-9ceb-f6607f02e3c4] Took 6.52 seconds to spawn the instance on the hypervisor.
Nov 17 01:37:26 user nova-compute[75226]: DEBUG nova.compute.manager [None req-de0427cd-4b85-4ae1-8e69-2678f614c225 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] [instance: d6d21784-2ebe-4a39-9ceb-f6607f02e3c4] Checking state {{(pid=75226) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 01:37:26 user nova-compute[75226]: INFO nova.compute.manager [None req-de0427cd-4b85-4ae1-8e69-2678f614c225 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] [instance: d6d21784-2ebe-4a39-9ceb-f6607f02e3c4] Took 7.39 seconds to build instance.
Nov 17 01:37:26 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-de0427cd-4b85-4ae1-8e69-2678f614c225 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] Lock "d6d21784-2ebe-4a39-9ceb-f6607f02e3c4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.488s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:37:27 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:37:27 user nova-compute[75226]: DEBUG nova.compute.manager [req-b507a1a8-b50c-466e-9771-9ac04051e0be req-ac014393-79fe-467b-b6f5-deef5f648a99 service nova] [instance: 8c4a9724-533e-40c8-ab2a-ce3415af240a] Received event network-vif-plugged-e30eaa7a-30df-48f5-b8de-30da75d74972 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:37:27 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-b507a1a8-b50c-466e-9771-9ac04051e0be req-ac014393-79fe-467b-b6f5-deef5f648a99 service nova] Acquiring lock "8c4a9724-533e-40c8-ab2a-ce3415af240a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:37:27 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-b507a1a8-b50c-466e-9771-9ac04051e0be req-ac014393-79fe-467b-b6f5-deef5f648a99 service nova] Lock "8c4a9724-533e-40c8-ab2a-ce3415af240a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:37:27 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-b507a1a8-b50c-466e-9771-9ac04051e0be req-ac014393-79fe-467b-b6f5-deef5f648a99 service nova] Lock "8c4a9724-533e-40c8-ab2a-ce3415af240a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:37:27 user nova-compute[75226]: DEBUG nova.compute.manager [req-b507a1a8-b50c-466e-9771-9ac04051e0be req-ac014393-79fe-467b-b6f5-deef5f648a99 service nova] [instance: 8c4a9724-533e-40c8-ab2a-ce3415af240a] No waiting events found dispatching network-vif-plugged-e30eaa7a-30df-48f5-b8de-30da75d74972 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:37:27 user nova-compute[75226]: WARNING nova.compute.manager [req-b507a1a8-b50c-466e-9771-9ac04051e0be req-ac014393-79fe-467b-b6f5-deef5f648a99 service nova] [instance: 8c4a9724-533e-40c8-ab2a-ce3415af240a] Received unexpected event network-vif-plugged-e30eaa7a-30df-48f5-b8de-30da75d74972 for instance with vm_state active and task_state None.
Nov 17 01:37:27 user nova-compute[75226]: DEBUG nova.compute.manager [req-b507a1a8-b50c-466e-9771-9ac04051e0be req-ac014393-79fe-467b-b6f5-deef5f648a99 service nova] [instance: d6d21784-2ebe-4a39-9ceb-f6607f02e3c4] Received event network-vif-plugged-2a4dd370-0638-425d-ba53-19c724a14644 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:37:27 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-b507a1a8-b50c-466e-9771-9ac04051e0be req-ac014393-79fe-467b-b6f5-deef5f648a99 service nova] Acquiring lock "d6d21784-2ebe-4a39-9ceb-f6607f02e3c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:37:27 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-b507a1a8-b50c-466e-9771-9ac04051e0be req-ac014393-79fe-467b-b6f5-deef5f648a99 service nova] Lock "d6d21784-2ebe-4a39-9ceb-f6607f02e3c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:37:27 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-b507a1a8-b50c-466e-9771-9ac04051e0be req-ac014393-79fe-467b-b6f5-deef5f648a99 service nova] Lock "d6d21784-2ebe-4a39-9ceb-f6607f02e3c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:37:27 user nova-compute[75226]: DEBUG nova.compute.manager [req-b507a1a8-b50c-466e-9771-9ac04051e0be req-ac014393-79fe-467b-b6f5-deef5f648a99 service nova] [instance: d6d21784-2ebe-4a39-9ceb-f6607f02e3c4] No waiting events found dispatching network-vif-plugged-2a4dd370-0638-425d-ba53-19c724a14644 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:37:27 user nova-compute[75226]: WARNING nova.compute.manager [req-b507a1a8-b50c-466e-9771-9ac04051e0be req-ac014393-79fe-467b-b6f5-deef5f648a99 service nova] [instance: d6d21784-2ebe-4a39-9ceb-f6607f02e3c4] Received unexpected event network-vif-plugged-2a4dd370-0638-425d-ba53-19c724a14644 for instance with vm_state active and task_state None.
Nov 17 01:37:27 user nova-compute[75226]: DEBUG nova.compute.manager [req-b507a1a8-b50c-466e-9771-9ac04051e0be req-ac014393-79fe-467b-b6f5-deef5f648a99 service nova] [instance: d6d21784-2ebe-4a39-9ceb-f6607f02e3c4] Received event network-vif-plugged-2a4dd370-0638-425d-ba53-19c724a14644 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:37:27 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-b507a1a8-b50c-466e-9771-9ac04051e0be req-ac014393-79fe-467b-b6f5-deef5f648a99 service nova] Acquiring lock "d6d21784-2ebe-4a39-9ceb-f6607f02e3c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:37:27 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-b507a1a8-b50c-466e-9771-9ac04051e0be req-ac014393-79fe-467b-b6f5-deef5f648a99 service nova] Lock "d6d21784-2ebe-4a39-9ceb-f6607f02e3c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:37:27 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-b507a1a8-b50c-466e-9771-9ac04051e0be req-ac014393-79fe-467b-b6f5-deef5f648a99 service nova] Lock "d6d21784-2ebe-4a39-9ceb-f6607f02e3c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:37:27 user nova-compute[75226]: DEBUG nova.compute.manager [req-b507a1a8-b50c-466e-9771-9ac04051e0be req-ac014393-79fe-467b-b6f5-deef5f648a99 service nova] [instance: d6d21784-2ebe-4a39-9ceb-f6607f02e3c4] No waiting events found dispatching network-vif-plugged-2a4dd370-0638-425d-ba53-19c724a14644 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:37:27 user nova-compute[75226]: WARNING nova.compute.manager [req-b507a1a8-b50c-466e-9771-9ac04051e0be req-ac014393-79fe-467b-b6f5-deef5f648a99 service nova] [instance: d6d21784-2ebe-4a39-9ceb-f6607f02e3c4] Received unexpected event network-vif-plugged-2a4dd370-0638-425d-ba53-19c724a14644 for instance with vm_state active and task_state None.
Nov 17 01:37:28 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:37:30 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-5d888cce-124b-449a-afbc-3a150e134c5c tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Acquiring lock "0597c05a-1049-4117-a8ae-8177d590e024" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:37:30 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-5d888cce-124b-449a-afbc-3a150e134c5c tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Lock "0597c05a-1049-4117-a8ae-8177d590e024" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:37:30 user nova-compute[75226]: DEBUG nova.compute.manager [None req-5d888cce-124b-449a-afbc-3a150e134c5c tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] [instance: 0597c05a-1049-4117-a8ae-8177d590e024] Starting instance... {{(pid=75226) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 17 01:37:30 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-5d888cce-124b-449a-afbc-3a150e134c5c tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:37:30 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-5d888cce-124b-449a-afbc-3a150e134c5c tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:37:30 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-5d888cce-124b-449a-afbc-3a150e134c5c tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75226) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 17 01:37:30 user nova-compute[75226]: INFO nova.compute.claims [None req-5d888cce-124b-449a-afbc-3a150e134c5c tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] [instance: 0597c05a-1049-4117-a8ae-8177d590e024] Claim successful on node user
Nov 17 01:37:31 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-934bfc5f-25e3-44fc-8af8-16dc459ebedd tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Acquiring lock "aa84e575-bdad-45b9-80ce-86b1c2826fb0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:37:31 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-934bfc5f-25e3-44fc-8af8-16dc459ebedd tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Lock "aa84e575-bdad-45b9-80ce-86b1c2826fb0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:37:31 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-934bfc5f-25e3-44fc-8af8-16dc459ebedd tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Acquiring lock "aa84e575-bdad-45b9-80ce-86b1c2826fb0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:37:31 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-934bfc5f-25e3-44fc-8af8-16dc459ebedd tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Lock "aa84e575-bdad-45b9-80ce-86b1c2826fb0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:37:31 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-934bfc5f-25e3-44fc-8af8-16dc459ebedd tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Lock "aa84e575-bdad-45b9-80ce-86b1c2826fb0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:37:31 user nova-compute[75226]: INFO nova.compute.manager [None req-934bfc5f-25e3-44fc-8af8-16dc459ebedd tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: aa84e575-bdad-45b9-80ce-86b1c2826fb0] Terminating instance
Nov 17 01:37:31 user nova-compute[75226]: DEBUG nova.compute.manager [None req-934bfc5f-25e3-44fc-8af8-16dc459ebedd tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: aa84e575-bdad-45b9-80ce-86b1c2826fb0] Start destroying the instance on the hypervisor. {{(pid=75226) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 17 01:37:31 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-5d888cce-124b-449a-afbc-3a150e134c5c tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:37:31 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-5d888cce-124b-449a-afbc-3a150e134c5c tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:37:31 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:37:31 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-5d888cce-124b-449a-afbc-3a150e134c5c tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.592s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:37:31 user nova-compute[75226]: DEBUG nova.compute.manager [None req-5d888cce-124b-449a-afbc-3a150e134c5c tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] [instance: 0597c05a-1049-4117-a8ae-8177d590e024] Start building networks asynchronously for instance. {{(pid=75226) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 17 01:37:31 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:37:31 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:37:31 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:37:31 user nova-compute[75226]: DEBUG nova.compute.manager [None req-5d888cce-124b-449a-afbc-3a150e134c5c tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] [instance: 0597c05a-1049-4117-a8ae-8177d590e024] Allocating IP information in the background. {{(pid=75226) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 17 01:37:31 user nova-compute[75226]: DEBUG nova.network.neutron [None req-5d888cce-124b-449a-afbc-3a150e134c5c tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] [instance: 0597c05a-1049-4117-a8ae-8177d590e024] allocate_for_instance() {{(pid=75226) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 17 01:37:31 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-5d888cce-124b-449a-afbc-3a150e134c5c tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] [instance: 0597c05a-1049-4117-a8ae-8177d590e024] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 17 01:37:31 user nova-compute[75226]: DEBUG nova.compute.manager [None req-5d888cce-124b-449a-afbc-3a150e134c5c tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] [instance: 0597c05a-1049-4117-a8ae-8177d590e024] Start building block device mappings for instance. {{(pid=75226) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 17 01:37:31 user nova-compute[75226]: DEBUG nova.policy [None req-5d888cce-124b-449a-afbc-3a150e134c5c tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0357cbff2e7f4a3ebf4ab02e717b451f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8046d4519e4b4f0b864f9ea10a4886fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75226) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 17 01:37:31 user nova-compute[75226]: DEBUG nova.compute.manager [None req-5d888cce-124b-449a-afbc-3a150e134c5c tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] [instance: 0597c05a-1049-4117-a8ae-8177d590e024] Start spawning the instance on the hypervisor. {{(pid=75226) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 17 01:37:31 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-5d888cce-124b-449a-afbc-3a150e134c5c tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] [instance: 0597c05a-1049-4117-a8ae-8177d590e024] Creating instance directory {{(pid=75226) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 17 01:37:31 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-5d888cce-124b-449a-afbc-3a150e134c5c tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] [instance: 0597c05a-1049-4117-a8ae-8177d590e024] Creating image(s)
Nov 17 01:37:31 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-5d888cce-124b-449a-afbc-3a150e134c5c tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Acquiring lock "/opt/stack/data/nova/instances/0597c05a-1049-4117-a8ae-8177d590e024/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:37:31 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-5d888cce-124b-449a-afbc-3a150e134c5c tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Lock "/opt/stack/data/nova/instances/0597c05a-1049-4117-a8ae-8177d590e024/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:37:31 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-5d888cce-124b-449a-afbc-3a150e134c5c tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Lock "/opt/stack/data/nova/instances/0597c05a-1049-4117-a8ae-8177d590e024/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:37:31 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-5d888cce-124b-449a-afbc-3a150e134c5c tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:37:31 user nova-compute[75226]: DEBUG nova.compute.manager [req-d48398d8-dc47-4d13-acc3-9e8a0fa7ef16 req-af9e38a1-82a9-40e2-9ef6-696e01e36c31 service nova] [instance: aa84e575-bdad-45b9-80ce-86b1c2826fb0] Received event network-vif-unplugged-734a9e23-26e5-4282-b842-62e0bb37c782 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:37:31 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-d48398d8-dc47-4d13-acc3-9e8a0fa7ef16 req-af9e38a1-82a9-40e2-9ef6-696e01e36c31 service nova] Acquiring lock "aa84e575-bdad-45b9-80ce-86b1c2826fb0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:37:31 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-d48398d8-dc47-4d13-acc3-9e8a0fa7ef16 req-af9e38a1-82a9-40e2-9ef6-696e01e36c31 service nova] Lock "aa84e575-bdad-45b9-80ce-86b1c2826fb0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:37:31 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-d48398d8-dc47-4d13-acc3-9e8a0fa7ef16 req-af9e38a1-82a9-40e2-9ef6-696e01e36c31 service nova] Lock "aa84e575-bdad-45b9-80ce-86b1c2826fb0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:37:31 user nova-compute[75226]: DEBUG nova.compute.manager [req-d48398d8-dc47-4d13-acc3-9e8a0fa7ef16 req-af9e38a1-82a9-40e2-9ef6-696e01e36c31 service nova] [instance: aa84e575-bdad-45b9-80ce-86b1c2826fb0] No waiting events found dispatching network-vif-unplugged-734a9e23-26e5-4282-b842-62e0bb37c782 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:37:31 user nova-compute[75226]: DEBUG nova.compute.manager [req-d48398d8-dc47-4d13-acc3-9e8a0fa7ef16 req-af9e38a1-82a9-40e2-9ef6-696e01e36c31 service nova] [instance: aa84e575-bdad-45b9-80ce-86b1c2826fb0] Received event network-vif-unplugged-734a9e23-26e5-4282-b842-62e0bb37c782 for instance with task_state deleting. {{(pid=75226) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 17 01:37:32 user nova-compute[75226]: INFO nova.virt.libvirt.driver [-] [instance: aa84e575-bdad-45b9-80ce-86b1c2826fb0] Instance destroyed successfully.
Nov 17 01:37:32 user nova-compute[75226]: DEBUG nova.objects.instance [None req-934bfc5f-25e3-44fc-8af8-16dc459ebedd tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Lazy-loading 'resources' on Instance uuid aa84e575-bdad-45b9-80ce-86b1c2826fb0 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:37:32 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-5d888cce-124b-449a-afbc-3a150e134c5c tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json" returned: 0 in 0.313s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:37:32 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-5d888cce-124b-449a-afbc-3a150e134c5c tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Acquiring lock "a8a62c2546af3a2036b853250c5ac64d4c6b4371" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:37:32 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-5d888cce-124b-449a-afbc-3a150e134c5c tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Lock "a8a62c2546af3a2036b853250c5ac64d4c6b4371" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:37:32 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-5d888cce-124b-449a-afbc-3a150e134c5c tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:37:32 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-934bfc5f-25e3-44fc-8af8-16dc459ebedd tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:17:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1718702311',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1718702311',id=2,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-17T01:17:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e6cb6f679ee4468d82cc7fb5d0f67be9',ramdisk_id='',reservation_id='r-nhu0m49b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-76498640',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T01:19:01Z,user_data=None,user_id='1b793ce05bf44b939a9fb5a914a04cb0',uuid=aa84e575-bdad-45b9-80ce-86b1c2826fb0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "734a9e23-26e5-4282-b842-62e0bb37c782", "address": "fa:16:3e:60:90:47", "network": {"id": "450540a3-ff7e-42fb-a0a6-808acd749943", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1503678778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6cb6f679ee4468d82cc7fb5d0f67be9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap734a9e23-26", "ovs_interfaceid": "734a9e23-26e5-4282-b842-62e0bb37c782", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 17 01:37:32 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-934bfc5f-25e3-44fc-8af8-16dc459ebedd tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Converting VIF {"id": "734a9e23-26e5-4282-b842-62e0bb37c782", "address": "fa:16:3e:60:90:47", "network": {"id": "450540a3-ff7e-42fb-a0a6-808acd749943", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1503678778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6cb6f679ee4468d82cc7fb5d0f67be9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap734a9e23-26", "ovs_interfaceid": "734a9e23-26e5-4282-b842-62e0bb37c782", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:37:32 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-934bfc5f-25e3-44fc-8af8-16dc459ebedd tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:60:90:47,bridge_name='br-int',has_traffic_filtering=True,id=734a9e23-26e5-4282-b842-62e0bb37c782,network=Network(450540a3-ff7e-42fb-a0a6-808acd749943),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap734a9e23-26') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:37:32 user nova-compute[75226]: DEBUG os_vif [None req-934bfc5f-25e3-44fc-8af8-16dc459ebedd tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:60:90:47,bridge_name='br-int',has_traffic_filtering=True,id=734a9e23-26e5-4282-b842-62e0bb37c782,network=Network(450540a3-ff7e-42fb-a0a6-808acd749943),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap734a9e23-26') {{(pid=75226) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 17 01:37:32 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:37:32 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap734a9e23-26, bridge=br-int, if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:37:32 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:37:32 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:37:32 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:37:32 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2d4d87ee-55d6-433d-96f8-4c6284fece25) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:37:32 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:37:32 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:37:32 user nova-compute[75226]: INFO os_vif [None req-934bfc5f-25e3-44fc-8af8-16dc459ebedd tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:60:90:47,bridge_name='br-int',has_traffic_filtering=True,id=734a9e23-26e5-4282-b842-62e0bb37c782,network=Network(450540a3-ff7e-42fb-a0a6-808acd749943),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap734a9e23-26')
Nov 17 01:37:32 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-934bfc5f-25e3-44fc-8af8-16dc459ebedd tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: aa84e575-bdad-45b9-80ce-86b1c2826fb0] Deleting instance files /opt/stack/data/nova/instances/aa84e575-bdad-45b9-80ce-86b1c2826fb0_del
Nov 17 01:37:32 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-934bfc5f-25e3-44fc-8af8-16dc459ebedd tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: aa84e575-bdad-45b9-80ce-86b1c2826fb0] Deletion of /opt/stack/data/nova/instances/aa84e575-bdad-45b9-80ce-86b1c2826fb0_del complete
Nov 17 01:37:32 user nova-compute[75226]: INFO nova.compute.manager [None req-934bfc5f-25e3-44fc-8af8-16dc459ebedd tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] [instance: aa84e575-bdad-45b9-80ce-86b1c2826fb0] Took 1.06 seconds to destroy the instance on the hypervisor.
Nov 17 01:37:32 user nova-compute[75226]: DEBUG oslo.service.loopingcall [None req-934bfc5f-25e3-44fc-8af8-16dc459ebedd tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75226) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 17 01:37:32 user nova-compute[75226]: DEBUG nova.compute.manager [-] [instance: aa84e575-bdad-45b9-80ce-86b1c2826fb0] Deallocating network for instance {{(pid=75226) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 17 01:37:32 user nova-compute[75226]: DEBUG nova.network.neutron [-] [instance: aa84e575-bdad-45b9-80ce-86b1c2826fb0] deallocate_for_instance() {{(pid=75226) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 17 01:37:32 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-5d888cce-124b-449a-afbc-3a150e134c5c tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json" returned: 0 in 0.206s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:37:32 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-5d888cce-124b-449a-afbc-3a150e134c5c tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371,backing_fmt=raw /opt/stack/data/nova/instances/0597c05a-1049-4117-a8ae-8177d590e024/disk 1073741824 {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:37:32 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-5d888cce-124b-449a-afbc-3a150e134c5c tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371,backing_fmt=raw /opt/stack/data/nova/instances/0597c05a-1049-4117-a8ae-8177d590e024/disk 1073741824" returned: 0 in 0.057s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:37:32 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-5d888cce-124b-449a-afbc-3a150e134c5c tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Lock "a8a62c2546af3a2036b853250c5ac64d4c6b4371" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.270s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:37:32 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-5d888cce-124b-449a-afbc-3a150e134c5c tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:37:32 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-5d888cce-124b-449a-afbc-3a150e134c5c tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json" returned: 0 in 0.221s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:37:32 user nova-compute[75226]: DEBUG nova.virt.disk.api [None req-5d888cce-124b-449a-afbc-3a150e134c5c tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0597c05a-1049-4117-a8ae-8177d590e024/disk. size=1073741824 {{(pid=75226) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 17 01:37:32 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-5d888cce-124b-449a-afbc-3a150e134c5c tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0597c05a-1049-4117-a8ae-8177d590e024/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:37:32 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-5d888cce-124b-449a-afbc-3a150e134c5c tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0597c05a-1049-4117-a8ae-8177d590e024/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:37:32 user nova-compute[75226]: DEBUG nova.virt.disk.api [None req-5d888cce-124b-449a-afbc-3a150e134c5c tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Cannot resize image /opt/stack/data/nova/instances/0597c05a-1049-4117-a8ae-8177d590e024/disk to a smaller size. {{(pid=75226) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 17 01:37:32 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-5d888cce-124b-449a-afbc-3a150e134c5c tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] [instance: 0597c05a-1049-4117-a8ae-8177d590e024] Created local disks {{(pid=75226) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 17 01:37:32 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-5d888cce-124b-449a-afbc-3a150e134c5c tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] [instance: 0597c05a-1049-4117-a8ae-8177d590e024] Ensure instance console log exists: /opt/stack/data/nova/instances/0597c05a-1049-4117-a8ae-8177d590e024/console.log {{(pid=75226) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 17 01:37:32 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-5d888cce-124b-449a-afbc-3a150e134c5c tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:37:32 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-5d888cce-124b-449a-afbc-3a150e134c5c tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.005s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:37:32 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-5d888cce-124b-449a-afbc-3a150e134c5c tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:37:33 user nova-compute[75226]: DEBUG nova.network.neutron [None req-5d888cce-124b-449a-afbc-3a150e134c5c tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] [instance: 0597c05a-1049-4117-a8ae-8177d590e024] Successfully created port: e8a7ded4-d849-40ce-a0a9-ecf66e146e56 {{(pid=75226) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 17 01:37:33 user nova-compute[75226]: DEBUG nova.network.neutron [-] [instance: aa84e575-bdad-45b9-80ce-86b1c2826fb0] Updating instance_info_cache with network_info: [] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:37:33 user nova-compute[75226]: INFO nova.compute.manager [-] [instance: aa84e575-bdad-45b9-80ce-86b1c2826fb0] Took 0.81 seconds to deallocate network for instance.
Nov 17 01:37:33 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-934bfc5f-25e3-44fc-8af8-16dc459ebedd tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:37:33 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-934bfc5f-25e3-44fc-8af8-16dc459ebedd tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:37:33 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:37:33 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-934bfc5f-25e3-44fc-8af8-16dc459ebedd tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:37:33 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-934bfc5f-25e3-44fc-8af8-16dc459ebedd tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:37:33 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-934bfc5f-25e3-44fc-8af8-16dc459ebedd tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.401s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:37:33 user nova-compute[75226]: INFO nova.scheduler.client.report [None req-934bfc5f-25e3-44fc-8af8-16dc459ebedd tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Deleted allocations for instance aa84e575-bdad-45b9-80ce-86b1c2826fb0
Nov 17 01:37:33 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-934bfc5f-25e3-44fc-8af8-16dc459ebedd tempest-ServerBootFromVolumeStableRescueTest-76498640 tempest-ServerBootFromVolumeStableRescueTest-76498640-project-member] Lock "aa84e575-bdad-45b9-80ce-86b1c2826fb0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.522s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:37:33 user nova-compute[75226]: DEBUG nova.network.neutron [None req-5d888cce-124b-449a-afbc-3a150e134c5c tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] [instance: 0597c05a-1049-4117-a8ae-8177d590e024] Successfully updated port: e8a7ded4-d849-40ce-a0a9-ecf66e146e56 {{(pid=75226) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 17 01:37:33 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-5d888cce-124b-449a-afbc-3a150e134c5c tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Acquiring lock "refresh_cache-0597c05a-1049-4117-a8ae-8177d590e024" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:37:33 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-5d888cce-124b-449a-afbc-3a150e134c5c tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Acquired lock "refresh_cache-0597c05a-1049-4117-a8ae-8177d590e024" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:37:33 user nova-compute[75226]: DEBUG nova.network.neutron [None req-5d888cce-124b-449a-afbc-3a150e134c5c tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] [instance: 0597c05a-1049-4117-a8ae-8177d590e024] Building network info cache for instance {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 01:37:33 user nova-compute[75226]: DEBUG nova.compute.manager [req-17a6dc80-8426-443a-93f3-749a55fb6cce req-48563e2e-5659-4e60-9e77-100448908097 service nova] [instance: aa84e575-bdad-45b9-80ce-86b1c2826fb0] Received event network-vif-plugged-734a9e23-26e5-4282-b842-62e0bb37c782 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:37:33 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-17a6dc80-8426-443a-93f3-749a55fb6cce req-48563e2e-5659-4e60-9e77-100448908097 service nova] Acquiring lock "aa84e575-bdad-45b9-80ce-86b1c2826fb0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:37:33 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-17a6dc80-8426-443a-93f3-749a55fb6cce req-48563e2e-5659-4e60-9e77-100448908097 service nova] Lock "aa84e575-bdad-45b9-80ce-86b1c2826fb0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:37:33 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-17a6dc80-8426-443a-93f3-749a55fb6cce req-48563e2e-5659-4e60-9e77-100448908097 service nova] Lock "aa84e575-bdad-45b9-80ce-86b1c2826fb0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:37:33 user nova-compute[75226]: DEBUG nova.compute.manager [req-17a6dc80-8426-443a-93f3-749a55fb6cce req-48563e2e-5659-4e60-9e77-100448908097 service nova] [instance: aa84e575-bdad-45b9-80ce-86b1c2826fb0] No waiting events found dispatching network-vif-plugged-734a9e23-26e5-4282-b842-62e0bb37c782 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:37:33 user nova-compute[75226]: WARNING nova.compute.manager [req-17a6dc80-8426-443a-93f3-749a55fb6cce req-48563e2e-5659-4e60-9e77-100448908097 service nova] [instance: aa84e575-bdad-45b9-80ce-86b1c2826fb0] Received unexpected event network-vif-plugged-734a9e23-26e5-4282-b842-62e0bb37c782 for instance with vm_state deleted and task_state None.
Nov 17 01:37:33 user nova-compute[75226]: DEBUG nova.compute.manager [req-17a6dc80-8426-443a-93f3-749a55fb6cce req-48563e2e-5659-4e60-9e77-100448908097 service nova] [instance: aa84e575-bdad-45b9-80ce-86b1c2826fb0] Received event network-vif-deleted-734a9e23-26e5-4282-b842-62e0bb37c782 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:37:33 user nova-compute[75226]: DEBUG nova.compute.manager [req-17a6dc80-8426-443a-93f3-749a55fb6cce req-48563e2e-5659-4e60-9e77-100448908097 service nova] [instance: 0597c05a-1049-4117-a8ae-8177d590e024] Received event network-changed-e8a7ded4-d849-40ce-a0a9-ecf66e146e56 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:37:33 user nova-compute[75226]: DEBUG nova.compute.manager [req-17a6dc80-8426-443a-93f3-749a55fb6cce req-48563e2e-5659-4e60-9e77-100448908097 service nova] [instance: 0597c05a-1049-4117-a8ae-8177d590e024] Refreshing instance network info cache due to event network-changed-e8a7ded4-d849-40ce-a0a9-ecf66e146e56. {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 01:37:33 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-17a6dc80-8426-443a-93f3-749a55fb6cce req-48563e2e-5659-4e60-9e77-100448908097 service nova] Acquiring lock "refresh_cache-0597c05a-1049-4117-a8ae-8177d590e024" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:37:33 user nova-compute[75226]: DEBUG nova.network.neutron [None req-5d888cce-124b-449a-afbc-3a150e134c5c tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] [instance: 0597c05a-1049-4117-a8ae-8177d590e024] Instance cache missing network info. {{(pid=75226) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 17 01:37:34 user nova-compute[75226]: DEBUG nova.network.neutron [None req-5d888cce-124b-449a-afbc-3a150e134c5c tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] [instance: 0597c05a-1049-4117-a8ae-8177d590e024] Updating instance_info_cache with network_info: [{"id": "e8a7ded4-d849-40ce-a0a9-ecf66e146e56", "address": "fa:16:3e:6d:db:0b", "network": {"id": "b6c26fa5-eacc-41d3-b790-795e59c84966", "bridge": "br-int", "label": "tempest-TestStampPattern-2002555642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8046d4519e4b4f0b864f9ea10a4886fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8a7ded4-d8", "ovs_interfaceid": "e8a7ded4-d849-40ce-a0a9-ecf66e146e56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:37:34 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-5d888cce-124b-449a-afbc-3a150e134c5c tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Releasing lock "refresh_cache-0597c05a-1049-4117-a8ae-8177d590e024" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:37:34 user nova-compute[75226]: DEBUG nova.compute.manager [None req-5d888cce-124b-449a-afbc-3a150e134c5c tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] [instance: 0597c05a-1049-4117-a8ae-8177d590e024] Instance network_info: |[{"id": "e8a7ded4-d849-40ce-a0a9-ecf66e146e56", "address": "fa:16:3e:6d:db:0b", "network": {"id": "b6c26fa5-eacc-41d3-b790-795e59c84966", "bridge": "br-int", "label": "tempest-TestStampPattern-2002555642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8046d4519e4b4f0b864f9ea10a4886fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8a7ded4-d8", "ovs_interfaceid": "e8a7ded4-d849-40ce-a0a9-ecf66e146e56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75226) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 17 01:37:34 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-17a6dc80-8426-443a-93f3-749a55fb6cce req-48563e2e-5659-4e60-9e77-100448908097 service nova] Acquired lock "refresh_cache-0597c05a-1049-4117-a8ae-8177d590e024" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:37:34 user nova-compute[75226]: DEBUG nova.network.neutron [req-17a6dc80-8426-443a-93f3-749a55fb6cce req-48563e2e-5659-4e60-9e77-100448908097 service nova] [instance: 0597c05a-1049-4117-a8ae-8177d590e024] Refreshing network info cache for port e8a7ded4-d849-40ce-a0a9-ecf66e146e56 {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 01:37:34 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-5d888cce-124b-449a-afbc-3a150e134c5c tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] [instance: 0597c05a-1049-4117-a8ae-8177d590e024] Start _get_guest_xml network_info=[{"id": "e8a7ded4-d849-40ce-a0a9-ecf66e146e56", "address": "fa:16:3e:6d:db:0b", "network": {"id": "b6c26fa5-eacc-41d3-b790-795e59c84966", "bridge": "br-int", "label": "tempest-TestStampPattern-2002555642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8046d4519e4b4f0b864f9ea10a4886fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8a7ded4-d8", "ovs_interfaceid": "e8a7ded4-d849-40ce-a0a9-ecf66e146e56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T01:13:22Z,direct_url=<?>,disk_format='qcow2',id=0b369aea-6f3f-4690-9f01-229b90ab6310,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4e110cbf9a84362a6864a7732c435a1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T01:13:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '0b369aea-6f3f-4690-9f01-229b90ab6310'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75226) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 17 01:37:34 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-5d888cce-124b-449a-afbc-3a150e134c5c tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:37:34 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-5d888cce-124b-449a-afbc-3a150e134c5c tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:37:34 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-5d888cce-124b-449a-afbc-3a150e134c5c tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75226) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 17 01:37:34 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-5d888cce-124b-449a-afbc-3a150e134c5c tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] CPU controller missing on host. {{(pid=75226) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 17 01:37:34 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-5d888cce-124b-449a-afbc-3a150e134c5c tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75226) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 17 01:37:34 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-5d888cce-124b-449a-afbc-3a150e134c5c tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] CPU controller found on host. {{(pid=75226) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 17 01:37:34 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-5d888cce-124b-449a-afbc-3a150e134c5c tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75226) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 17 01:37:34 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-5d888cce-124b-449a-afbc-3a150e134c5c tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-17T01:13:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T01:13:22Z,direct_url=<?>,disk_format='qcow2',id=0b369aea-6f3f-4690-9f01-229b90ab6310,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4e110cbf9a84362a6864a7732c435a1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T01:13:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 17 01:37:34 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-5d888cce-124b-449a-afbc-3a150e134c5c tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Flavor limits 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 17 01:37:34 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-5d888cce-124b-449a-afbc-3a150e134c5c tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Image limits 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 17 01:37:34 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-5d888cce-124b-449a-afbc-3a150e134c5c tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Flavor pref 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 17 01:37:34 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-5d888cce-124b-449a-afbc-3a150e134c5c tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Image pref 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 17 01:37:34 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-5d888cce-124b-449a-afbc-3a150e134c5c tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 17 01:37:34 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-5d888cce-124b-449a-afbc-3a150e134c5c tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 17 01:37:34 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-5d888cce-124b-449a-afbc-3a150e134c5c tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75226) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 17 01:37:34 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-5d888cce-124b-449a-afbc-3a150e134c5c tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Got 1 possible topologies {{(pid=75226) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 17 01:37:34 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-5d888cce-124b-449a-afbc-3a150e134c5c tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 17 01:37:34 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-5d888cce-124b-449a-afbc-3a150e134c5c tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 17 01:37:34 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-5d888cce-124b-449a-afbc-3a150e134c5c tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:37:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1423998118',display_name='tempest-TestStampPattern-server-1423998118',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1423998118',id=38,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJo/tAB5VbatxtFO3qcGvVQYO+DJCVCBnHzmF73L8NhWbPARofXbPE3d/rvN9G86C2CwqSw7WTEjMfEOGTjqYfRxtLwEwauLFrL7ndRptXBl9uTXrST97QU1m8g2Jvz0/g==',key_name='tempest-TestStampPattern-635437790',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8046d4519e4b4f0b864f9ea10a4886fa',ramdisk_id='',reservation_id='r-c6hggt8x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-266167712',owner_user_name='tempest-TestStampPattern-266167712-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T01:37:32Z,user_data=None,user_id='0357cbff2e7f4a3ebf4ab02e717b451f',uuid=0597c05a-1049-4117-a8ae-8177d590e024,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e8a7ded4-d849-40ce-a0a9-ecf66e146e56", "address": "fa:16:3e:6d:db:0b", "network": {"id": "b6c26fa5-eacc-41d3-b790-795e59c84966", "bridge": "br-int", "label": "tempest-TestStampPattern-2002555642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8046d4519e4b4f0b864f9ea10a4886fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8a7ded4-d8", "ovs_interfaceid": "e8a7ded4-d849-40ce-a0a9-ecf66e146e56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75226) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 01:37:34 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-5d888cce-124b-449a-afbc-3a150e134c5c tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Converting VIF {"id": "e8a7ded4-d849-40ce-a0a9-ecf66e146e56", "address": "fa:16:3e:6d:db:0b", "network": {"id": "b6c26fa5-eacc-41d3-b790-795e59c84966", "bridge": "br-int", "label": "tempest-TestStampPattern-2002555642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8046d4519e4b4f0b864f9ea10a4886fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8a7ded4-d8", "ovs_interfaceid": "e8a7ded4-d849-40ce-a0a9-ecf66e146e56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:37:34 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-5d888cce-124b-449a-afbc-3a150e134c5c tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:db:0b,bridge_name='br-int',has_traffic_filtering=True,id=e8a7ded4-d849-40ce-a0a9-ecf66e146e56,network=Network(b6c26fa5-eacc-41d3-b790-795e59c84966),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8a7ded4-d8') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:37:34 user nova-compute[75226]: DEBUG nova.objects.instance [None req-5d888cce-124b-449a-afbc-3a150e134c5c tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Lazy-loading 'pci_devices' on Instance uuid 0597c05a-1049-4117-a8ae-8177d590e024 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:37:34 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-5d888cce-124b-449a-afbc-3a150e134c5c tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] [instance: 0597c05a-1049-4117-a8ae-8177d590e024] End _get_guest_xml xml=<domain type="kvm">
Nov 17 01:37:34 user nova-compute[75226]:   <uuid>0597c05a-1049-4117-a8ae-8177d590e024</uuid>
Nov 17 01:37:34 user nova-compute[75226]:   <name>instance-00000026</name>
Nov 17 01:37:34 user nova-compute[75226]:   <memory>524288</memory>
Nov 17 01:37:34 user nova-compute[75226]:   <vcpu>1</vcpu>
Nov 17 01:37:34 user nova-compute[75226]:   <metadata>
Nov 17 01:37:34 user nova-compute[75226]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 17 01:37:34 user nova-compute[75226]:       <nova:package version="0.0.0"/>
Nov 17 01:37:34 user nova-compute[75226]:       <nova:name>tempest-TestStampPattern-server-1423998118</nova:name>
Nov 17 01:37:34 user nova-compute[75226]:       <nova:creationTime>2023-11-17 01:37:34</nova:creationTime>
Nov 17 01:37:34 user nova-compute[75226]:       <nova:flavor name="m1.tiny">
Nov 17 01:37:34 user nova-compute[75226]:         <nova:memory>512</nova:memory>
Nov 17 01:37:34 user nova-compute[75226]:         <nova:disk>1</nova:disk>
Nov 17 01:37:34 user nova-compute[75226]:         <nova:swap>0</nova:swap>
Nov 17 01:37:34 user nova-compute[75226]:         <nova:ephemeral>0</nova:ephemeral>
Nov 17 01:37:34 user nova-compute[75226]:         <nova:vcpus>1</nova:vcpus>
Nov 17 01:37:34 user nova-compute[75226]:       </nova:flavor>
Nov 17 01:37:34 user nova-compute[75226]:       <nova:owner>
Nov 17 01:37:34 user nova-compute[75226]:         <nova:user uuid="0357cbff2e7f4a3ebf4ab02e717b451f">tempest-TestStampPattern-266167712-project-member</nova:user>
Nov 17 01:37:34 user nova-compute[75226]:         <nova:project uuid="8046d4519e4b4f0b864f9ea10a4886fa">tempest-TestStampPattern-266167712</nova:project>
Nov 17 01:37:34 user nova-compute[75226]:       </nova:owner>
Nov 17 01:37:34 user nova-compute[75226]:       <nova:root type="image" uuid="0b369aea-6f3f-4690-9f01-229b90ab6310"/>
Nov 17 01:37:34 user nova-compute[75226]:       <nova:ports>
Nov 17 01:37:34 user nova-compute[75226]:         <nova:port uuid="e8a7ded4-d849-40ce-a0a9-ecf66e146e56">
Nov 17 01:37:34 user nova-compute[75226]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 17 01:37:34 user nova-compute[75226]:         </nova:port>
Nov 17 01:37:34 user nova-compute[75226]:       </nova:ports>
Nov 17 01:37:34 user nova-compute[75226]:     </nova:instance>
Nov 17 01:37:34 user nova-compute[75226]:   </metadata>
Nov 17 01:37:34 user nova-compute[75226]:   <sysinfo type="smbios">
Nov 17 01:37:34 user nova-compute[75226]:     <system>
Nov 17 01:37:34 user nova-compute[75226]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 17 01:37:34 user nova-compute[75226]:       <entry name="product">OpenStack Nova</entry>
Nov 17 01:37:34 user nova-compute[75226]:       <entry name="version">0.0.0</entry>
Nov 17 01:37:34 user nova-compute[75226]:       <entry name="serial">0597c05a-1049-4117-a8ae-8177d590e024</entry>
Nov 17 01:37:34 user nova-compute[75226]:       <entry name="uuid">0597c05a-1049-4117-a8ae-8177d590e024</entry>
Nov 17 01:37:34 user nova-compute[75226]:       <entry name="family">Virtual Machine</entry>
Nov 17 01:37:34 user nova-compute[75226]:     </system>
Nov 17 01:37:34 user nova-compute[75226]:   </sysinfo>
Nov 17 01:37:34 user nova-compute[75226]:   <os>
Nov 17 01:37:34 user nova-compute[75226]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 17 01:37:34 user nova-compute[75226]:     <boot dev="hd"/>
Nov 17 01:37:34 user nova-compute[75226]:     <smbios mode="sysinfo"/>
Nov 17 01:37:34 user nova-compute[75226]:   </os>
Nov 17 01:37:34 user nova-compute[75226]:   <features>
Nov 17 01:37:34 user nova-compute[75226]:     <acpi/>
Nov 17 01:37:34 user nova-compute[75226]:     <apic/>
Nov 17 01:37:34 user nova-compute[75226]:     <vmcoreinfo/>
Nov 17 01:37:34 user nova-compute[75226]:   </features>
Nov 17 01:37:34 user nova-compute[75226]:   <clock offset="utc">
Nov 17 01:37:34 user nova-compute[75226]:     <timer name="pit" tickpolicy="delay"/>
Nov 17 01:37:34 user nova-compute[75226]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 17 01:37:34 user nova-compute[75226]:     <timer name="hpet" present="no"/>
Nov 17 01:37:34 user nova-compute[75226]:   </clock>
Nov 17 01:37:34 user nova-compute[75226]:   <cpu mode="custom" match="exact">
Nov 17 01:37:34 user nova-compute[75226]:     <model>Nehalem</model>
Nov 17 01:37:34 user nova-compute[75226]:     <topology sockets="1" cores="1" threads="1"/>
Nov 17 01:37:34 user nova-compute[75226]:   </cpu>
Nov 17 01:37:34 user nova-compute[75226]:   <devices>
Nov 17 01:37:34 user nova-compute[75226]:     <disk type="file" device="disk">
Nov 17 01:37:34 user nova-compute[75226]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 17 01:37:34 user nova-compute[75226]:       <source file="/opt/stack/data/nova/instances/0597c05a-1049-4117-a8ae-8177d590e024/disk"/>
Nov 17 01:37:34 user nova-compute[75226]:       <target dev="vda" bus="virtio"/>
Nov 17 01:37:34 user nova-compute[75226]:     </disk>
Nov 17 01:37:34 user nova-compute[75226]:     <interface type="ethernet">
Nov 17 01:37:34 user nova-compute[75226]:       <mac address="fa:16:3e:6d:db:0b"/>
Nov 17 01:37:34 user nova-compute[75226]:       <model type="virtio"/>
Nov 17 01:37:34 user nova-compute[75226]:       <mtu size="1442"/>
Nov 17 01:37:34 user nova-compute[75226]:       <target dev="tape8a7ded4-d8"/>
Nov 17 01:37:34 user nova-compute[75226]:     </interface>
Nov 17 01:37:34 user nova-compute[75226]:     <serial type="pty">
Nov 17 01:37:34 user nova-compute[75226]:       <log file="/opt/stack/data/nova/instances/0597c05a-1049-4117-a8ae-8177d590e024/console.log" append="off"/>
Nov 17 01:37:34 user nova-compute[75226]:     </serial>
Nov 17 01:37:34 user nova-compute[75226]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 17 01:37:34 user nova-compute[75226]:     <video>
Nov 17 01:37:34 user nova-compute[75226]:       <model type="virtio"/>
Nov 17 01:37:34 user nova-compute[75226]:     </video>
Nov 17 01:37:34 user nova-compute[75226]:     <rng model="virtio">
Nov 17 01:37:34 user nova-compute[75226]:       <backend model="random">/dev/urandom</backend>
Nov 17 01:37:34 user nova-compute[75226]:     </rng>
Nov 17 01:37:34 user nova-compute[75226]:     <controller type="usb" index="0" model="none"/>
Nov 17 01:37:34 user nova-compute[75226]:     <memballoon model="virtio">
Nov 17 01:37:34 user nova-compute[75226]:       <stats period="10"/>
Nov 17 01:37:34 user nova-compute[75226]:     </memballoon>
Nov 17 01:37:34 user nova-compute[75226]:   </devices>
Nov 17 01:37:34 user nova-compute[75226]: </domain>
Nov 17 01:37:34 user nova-compute[75226]:  {{(pid=75226) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 17 01:37:34 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-5d888cce-124b-449a-afbc-3a150e134c5c tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:37:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1423998118',display_name='tempest-TestStampPattern-server-1423998118',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1423998118',id=38,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJo/tAB5VbatxtFO3qcGvVQYO+DJCVCBnHzmF73L8NhWbPARofXbPE3d/rvN9G86C2CwqSw7WTEjMfEOGTjqYfRxtLwEwauLFrL7ndRptXBl9uTXrST97QU1m8g2Jvz0/g==',key_name='tempest-TestStampPattern-635437790',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8046d4519e4b4f0b864f9ea10a4886fa',ramdisk_id='',reservation_id='r-c6hggt8x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-266167712',owner_user_name='tempest-TestStampPattern-266167712-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T01:37:32Z,user_data=None,user_id='0357cbff2e7f4a3ebf4ab02e717b451f',uuid=0597c05a-1049-4117-a8ae-8177d590e024,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e8a7ded4-d849-40ce-a0a9-ecf66e146e56", "address": "fa:16:3e:6d:db:0b", "network": {"id": "b6c26fa5-eacc-41d3-b790-795e59c84966", "bridge": "br-int", "label": "tempest-TestStampPattern-2002555642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8046d4519e4b4f0b864f9ea10a4886fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8a7ded4-d8", "ovs_interfaceid": "e8a7ded4-d849-40ce-a0a9-ecf66e146e56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 17 01:37:34 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-5d888cce-124b-449a-afbc-3a150e134c5c tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Converting VIF {"id": "e8a7ded4-d849-40ce-a0a9-ecf66e146e56", "address": "fa:16:3e:6d:db:0b", "network": {"id": "b6c26fa5-eacc-41d3-b790-795e59c84966", "bridge": "br-int", "label": "tempest-TestStampPattern-2002555642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8046d4519e4b4f0b864f9ea10a4886fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8a7ded4-d8", "ovs_interfaceid": "e8a7ded4-d849-40ce-a0a9-ecf66e146e56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:37:34 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-5d888cce-124b-449a-afbc-3a150e134c5c tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:db:0b,bridge_name='br-int',has_traffic_filtering=True,id=e8a7ded4-d849-40ce-a0a9-ecf66e146e56,network=Network(b6c26fa5-eacc-41d3-b790-795e59c84966),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8a7ded4-d8') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:37:34 user nova-compute[75226]: DEBUG os_vif [None req-5d888cce-124b-449a-afbc-3a150e134c5c tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:db:0b,bridge_name='br-int',has_traffic_filtering=True,id=e8a7ded4-d849-40ce-a0a9-ecf66e146e56,network=Network(b6c26fa5-eacc-41d3-b790-795e59c84966),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8a7ded4-d8') {{(pid=75226) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 17 01:37:34 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:37:34 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:37:34 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 17 01:37:34 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:37:34 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8dffb299-7f58-5774-9f67-e34d017cdb30', '_type': 'linux-noop'}}, row=False) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:37:34 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:37:34 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:37:34 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:37:34 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape8a7ded4-d8, may_exist=True, interface_attrs={}) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:37:34 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape8a7ded4-d8, col_values=(('qos', UUID('53295858-fab4-4220-9eff-02b5f2a60e96')),), if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:37:34 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape8a7ded4-d8, col_values=(('external_ids', {'iface-id': 'e8a7ded4-d849-40ce-a0a9-ecf66e146e56', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6d:db:0b', 'vm-uuid': '0597c05a-1049-4117-a8ae-8177d590e024'}),), if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:37:34 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:37:34 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:37:34 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:37:34 user nova-compute[75226]: INFO os_vif [None req-5d888cce-124b-449a-afbc-3a150e134c5c tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:db:0b,bridge_name='br-int',has_traffic_filtering=True,id=e8a7ded4-d849-40ce-a0a9-ecf66e146e56,network=Network(b6c26fa5-eacc-41d3-b790-795e59c84966),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8a7ded4-d8')
Nov 17 01:37:34 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-5d888cce-124b-449a-afbc-3a150e134c5c tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] No BDM found with device name vda, not building metadata. {{(pid=75226) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 01:37:34 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-5d888cce-124b-449a-afbc-3a150e134c5c tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] No VIF found with MAC fa:16:3e:6d:db:0b, not building metadata {{(pid=75226) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 01:37:34 user nova-compute[75226]: DEBUG nova.network.neutron [req-17a6dc80-8426-443a-93f3-749a55fb6cce req-48563e2e-5659-4e60-9e77-100448908097 service nova] [instance: 0597c05a-1049-4117-a8ae-8177d590e024] Updated VIF entry in instance network info cache for port e8a7ded4-d849-40ce-a0a9-ecf66e146e56. {{(pid=75226) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 01:37:34 user nova-compute[75226]: DEBUG nova.network.neutron [req-17a6dc80-8426-443a-93f3-749a55fb6cce req-48563e2e-5659-4e60-9e77-100448908097 service nova] [instance: 0597c05a-1049-4117-a8ae-8177d590e024] Updating instance_info_cache with network_info: [{"id": "e8a7ded4-d849-40ce-a0a9-ecf66e146e56", "address": "fa:16:3e:6d:db:0b", "network": {"id": "b6c26fa5-eacc-41d3-b790-795e59c84966", "bridge": "br-int", "label": "tempest-TestStampPattern-2002555642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8046d4519e4b4f0b864f9ea10a4886fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8a7ded4-d8", "ovs_interfaceid": "e8a7ded4-d849-40ce-a0a9-ecf66e146e56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:37:34 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-17a6dc80-8426-443a-93f3-749a55fb6cce req-48563e2e-5659-4e60-9e77-100448908097 service nova] Releasing lock "refresh_cache-0597c05a-1049-4117-a8ae-8177d590e024" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:37:36 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:37:36 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:37:36 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:37:36 user nova-compute[75226]: DEBUG nova.compute.manager [req-153fdade-3903-460e-a716-621d8e65c36e req-f00d592d-6801-462a-9f25-80ee5499e2ac service nova] [instance: 0597c05a-1049-4117-a8ae-8177d590e024] Received event network-vif-plugged-e8a7ded4-d849-40ce-a0a9-ecf66e146e56 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:37:36 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-153fdade-3903-460e-a716-621d8e65c36e req-f00d592d-6801-462a-9f25-80ee5499e2ac service nova] Acquiring lock "0597c05a-1049-4117-a8ae-8177d590e024-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:37:36 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-153fdade-3903-460e-a716-621d8e65c36e req-f00d592d-6801-462a-9f25-80ee5499e2ac service nova] Lock "0597c05a-1049-4117-a8ae-8177d590e024-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:37:36 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-153fdade-3903-460e-a716-621d8e65c36e req-f00d592d-6801-462a-9f25-80ee5499e2ac service nova] Lock "0597c05a-1049-4117-a8ae-8177d590e024-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:37:36 user nova-compute[75226]: DEBUG nova.compute.manager [req-153fdade-3903-460e-a716-621d8e65c36e req-f00d592d-6801-462a-9f25-80ee5499e2ac service nova] [instance: 0597c05a-1049-4117-a8ae-8177d590e024] No waiting events found dispatching network-vif-plugged-e8a7ded4-d849-40ce-a0a9-ecf66e146e56 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:37:36 user nova-compute[75226]: WARNING nova.compute.manager [req-153fdade-3903-460e-a716-621d8e65c36e req-f00d592d-6801-462a-9f25-80ee5499e2ac service nova] [instance: 0597c05a-1049-4117-a8ae-8177d590e024] Received unexpected event network-vif-plugged-e8a7ded4-d849-40ce-a0a9-ecf66e146e56 for instance with vm_state building and task_state spawning.
Nov 17 01:37:36 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:37:36 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:37:36 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:37:36 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:37:38 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:37:38 user nova-compute[75226]: DEBUG nova.compute.manager [req-50039da1-3939-45b2-b6ef-eadc27d0723d req-8e44a300-3d58-4032-9198-d64ad1010a0e service nova] [instance: 0597c05a-1049-4117-a8ae-8177d590e024] Received event network-vif-plugged-e8a7ded4-d849-40ce-a0a9-ecf66e146e56 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:37:38 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-50039da1-3939-45b2-b6ef-eadc27d0723d req-8e44a300-3d58-4032-9198-d64ad1010a0e service nova] Acquiring lock "0597c05a-1049-4117-a8ae-8177d590e024-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:37:38 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-50039da1-3939-45b2-b6ef-eadc27d0723d req-8e44a300-3d58-4032-9198-d64ad1010a0e service nova] Lock "0597c05a-1049-4117-a8ae-8177d590e024-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:37:38 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-50039da1-3939-45b2-b6ef-eadc27d0723d req-8e44a300-3d58-4032-9198-d64ad1010a0e service nova] Lock "0597c05a-1049-4117-a8ae-8177d590e024-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:37:38 user nova-compute[75226]: DEBUG nova.compute.manager [req-50039da1-3939-45b2-b6ef-eadc27d0723d req-8e44a300-3d58-4032-9198-d64ad1010a0e service nova] [instance: 0597c05a-1049-4117-a8ae-8177d590e024] No waiting events found dispatching network-vif-plugged-e8a7ded4-d849-40ce-a0a9-ecf66e146e56 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:37:38 user nova-compute[75226]: WARNING nova.compute.manager [req-50039da1-3939-45b2-b6ef-eadc27d0723d req-8e44a300-3d58-4032-9198-d64ad1010a0e service nova] [instance: 0597c05a-1049-4117-a8ae-8177d590e024] Received unexpected event network-vif-plugged-e8a7ded4-d849-40ce-a0a9-ecf66e146e56 for instance with vm_state building and task_state spawning.
Nov 17 01:37:38 user nova-compute[75226]: DEBUG nova.compute.manager [None req-5d888cce-124b-449a-afbc-3a150e134c5c tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] [instance: 0597c05a-1049-4117-a8ae-8177d590e024] Instance event wait completed in 0 seconds for  {{(pid=75226) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 17 01:37:38 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-5d888cce-124b-449a-afbc-3a150e134c5c tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] [instance: 0597c05a-1049-4117-a8ae-8177d590e024] Guest created on hypervisor {{(pid=75226) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 17 01:37:38 user nova-compute[75226]: INFO nova.virt.libvirt.driver [-] [instance: 0597c05a-1049-4117-a8ae-8177d590e024] Instance spawned successfully.
Nov 17 01:37:38 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-5d888cce-124b-449a-afbc-3a150e134c5c tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] [instance: 0597c05a-1049-4117-a8ae-8177d590e024] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 17 01:37:38 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-5d888cce-124b-449a-afbc-3a150e134c5c tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] [instance: 0597c05a-1049-4117-a8ae-8177d590e024] Found default for hw_cdrom_bus of ide {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:37:38 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-5d888cce-124b-449a-afbc-3a150e134c5c tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] [instance: 0597c05a-1049-4117-a8ae-8177d590e024] Found default for hw_disk_bus of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:37:38 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-5d888cce-124b-449a-afbc-3a150e134c5c tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] [instance: 0597c05a-1049-4117-a8ae-8177d590e024] Found default for hw_input_bus of None {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:37:38 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-5d888cce-124b-449a-afbc-3a150e134c5c tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] [instance: 0597c05a-1049-4117-a8ae-8177d590e024] Found default for hw_pointer_model of None {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:37:38 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-5d888cce-124b-449a-afbc-3a150e134c5c tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] [instance: 0597c05a-1049-4117-a8ae-8177d590e024] Found default for hw_video_model of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:37:38 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-5d888cce-124b-449a-afbc-3a150e134c5c tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] [instance: 0597c05a-1049-4117-a8ae-8177d590e024] Found default for hw_vif_model of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:37:38 user nova-compute[75226]: INFO nova.compute.manager [None req-5d888cce-124b-449a-afbc-3a150e134c5c tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] [instance: 0597c05a-1049-4117-a8ae-8177d590e024] Took 6.93 seconds to spawn the instance on the hypervisor.
Nov 17 01:37:38 user nova-compute[75226]: DEBUG nova.compute.manager [None req-5d888cce-124b-449a-afbc-3a150e134c5c tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] [instance: 0597c05a-1049-4117-a8ae-8177d590e024] Checking state {{(pid=75226) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 01:37:38 user nova-compute[75226]: INFO nova.compute.manager [None req-5d888cce-124b-449a-afbc-3a150e134c5c tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] [instance: 0597c05a-1049-4117-a8ae-8177d590e024] Took 8.06 seconds to build instance.
Nov 17 01:37:38 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-5d888cce-124b-449a-afbc-3a150e134c5c tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Lock "0597c05a-1049-4117-a8ae-8177d590e024" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.175s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:37:39 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:37:43 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:37:44 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:37:48 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:37:49 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:37:53 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:37:54 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:37:58 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:37:59 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:38:03 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:38:04 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:38:06 user nova-compute[75226]: INFO nova.compute.manager [None req-d5f4f1d1-5747-4aa4-a9ce-b5ac26254a4c tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] [instance: 8d983732-91aa-4f20-9d7d-3de66029cba5] Unrescuing
Nov 17 01:38:06 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-d5f4f1d1-5747-4aa4-a9ce-b5ac26254a4c tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Acquiring lock "refresh_cache-8d983732-91aa-4f20-9d7d-3de66029cba5" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:38:06 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-d5f4f1d1-5747-4aa4-a9ce-b5ac26254a4c tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Acquired lock "refresh_cache-8d983732-91aa-4f20-9d7d-3de66029cba5" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:38:06 user nova-compute[75226]: DEBUG nova.network.neutron [None req-d5f4f1d1-5747-4aa4-a9ce-b5ac26254a4c tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] [instance: 8d983732-91aa-4f20-9d7d-3de66029cba5] Building network info cache for instance {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 01:38:07 user nova-compute[75226]: DEBUG nova.network.neutron [None req-d5f4f1d1-5747-4aa4-a9ce-b5ac26254a4c tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] [instance: 8d983732-91aa-4f20-9d7d-3de66029cba5] Updating instance_info_cache with network_info: [{"id": "2ef7c6ef-e077-49c7-aaca-1d8ba7e7335c", "address": "fa:16:3e:90:7b:a1", "network": {"id": "a9710b94-56f8-4cf6-9bb6-344b275e5bf2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-512340839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2052a37a068e4d948c57560c0f4445e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ef7c6ef-e0", "ovs_interfaceid": "2ef7c6ef-e077-49c7-aaca-1d8ba7e7335c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:38:07 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-d5f4f1d1-5747-4aa4-a9ce-b5ac26254a4c tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Releasing lock "refresh_cache-8d983732-91aa-4f20-9d7d-3de66029cba5" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:38:07 user nova-compute[75226]: DEBUG nova.objects.instance [None req-d5f4f1d1-5747-4aa4-a9ce-b5ac26254a4c tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Lazy-loading 'flavor' on Instance uuid 8d983732-91aa-4f20-9d7d-3de66029cba5 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:38:07 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:38:07 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:38:07 user nova-compute[75226]: DEBUG nova.compute.manager [req-abdcc21a-208f-4f22-9ce4-10aff02630c8 req-0612702b-f763-4302-8eb5-6a6aa3ab8a86 service nova] [instance: 8d983732-91aa-4f20-9d7d-3de66029cba5] Received event network-vif-unplugged-2ef7c6ef-e077-49c7-aaca-1d8ba7e7335c {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:38:07 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-abdcc21a-208f-4f22-9ce4-10aff02630c8 req-0612702b-f763-4302-8eb5-6a6aa3ab8a86 service nova] Acquiring lock "8d983732-91aa-4f20-9d7d-3de66029cba5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:38:07 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-abdcc21a-208f-4f22-9ce4-10aff02630c8 req-0612702b-f763-4302-8eb5-6a6aa3ab8a86 service nova] Lock "8d983732-91aa-4f20-9d7d-3de66029cba5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:38:07 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-abdcc21a-208f-4f22-9ce4-10aff02630c8 req-0612702b-f763-4302-8eb5-6a6aa3ab8a86 service nova] Lock "8d983732-91aa-4f20-9d7d-3de66029cba5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:38:07 user nova-compute[75226]: DEBUG nova.compute.manager [req-abdcc21a-208f-4f22-9ce4-10aff02630c8 req-0612702b-f763-4302-8eb5-6a6aa3ab8a86 service nova] [instance: 8d983732-91aa-4f20-9d7d-3de66029cba5] No waiting events found dispatching network-vif-unplugged-2ef7c6ef-e077-49c7-aaca-1d8ba7e7335c {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:38:07 user nova-compute[75226]: WARNING nova.compute.manager [req-abdcc21a-208f-4f22-9ce4-10aff02630c8 req-0612702b-f763-4302-8eb5-6a6aa3ab8a86 service nova] [instance: 8d983732-91aa-4f20-9d7d-3de66029cba5] Received unexpected event network-vif-unplugged-2ef7c6ef-e077-49c7-aaca-1d8ba7e7335c for instance with vm_state rescued and task_state unrescuing.
Nov 17 01:38:07 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:38:07 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:38:07 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:38:07 user nova-compute[75226]: INFO nova.virt.libvirt.driver [-] [instance: 8d983732-91aa-4f20-9d7d-3de66029cba5] Instance destroyed successfully.
Nov 17 01:38:07 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:38:08 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:38:08 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:38:08 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:38:08 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:38:08 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:38:08 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75226) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 17 01:38:09 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:38:09 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:38:09 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:38:09 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:38:09 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:38:09 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:38:09 user nova-compute[75226]: DEBUG nova.compute.manager [req-2a4fdff7-7f1c-4dff-ac33-49fc645b8cf0 req-e1065086-1b81-4b96-aef6-f4b9021b8293 service nova] [instance: 8d983732-91aa-4f20-9d7d-3de66029cba5] Received event network-vif-plugged-2ef7c6ef-e077-49c7-aaca-1d8ba7e7335c {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:38:09 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-2a4fdff7-7f1c-4dff-ac33-49fc645b8cf0 req-e1065086-1b81-4b96-aef6-f4b9021b8293 service nova] Acquiring lock "8d983732-91aa-4f20-9d7d-3de66029cba5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:38:09 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-2a4fdff7-7f1c-4dff-ac33-49fc645b8cf0 req-e1065086-1b81-4b96-aef6-f4b9021b8293 service nova] Lock "8d983732-91aa-4f20-9d7d-3de66029cba5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:38:09 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-2a4fdff7-7f1c-4dff-ac33-49fc645b8cf0 req-e1065086-1b81-4b96-aef6-f4b9021b8293 service nova] Lock "8d983732-91aa-4f20-9d7d-3de66029cba5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:38:09 user nova-compute[75226]: DEBUG nova.compute.manager [req-2a4fdff7-7f1c-4dff-ac33-49fc645b8cf0 req-e1065086-1b81-4b96-aef6-f4b9021b8293 service nova] [instance: 8d983732-91aa-4f20-9d7d-3de66029cba5] No waiting events found dispatching network-vif-plugged-2ef7c6ef-e077-49c7-aaca-1d8ba7e7335c {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:38:09 user nova-compute[75226]: WARNING nova.compute.manager [req-2a4fdff7-7f1c-4dff-ac33-49fc645b8cf0 req-e1065086-1b81-4b96-aef6-f4b9021b8293 service nova] [instance: 8d983732-91aa-4f20-9d7d-3de66029cba5] Received unexpected event network-vif-plugged-2ef7c6ef-e077-49c7-aaca-1d8ba7e7335c for instance with vm_state rescued and task_state unrescuing.
Nov 17 01:38:09 user nova-compute[75226]: DEBUG nova.compute.manager [req-2a4fdff7-7f1c-4dff-ac33-49fc645b8cf0 req-e1065086-1b81-4b96-aef6-f4b9021b8293 service nova] [instance: 8d983732-91aa-4f20-9d7d-3de66029cba5] Received event network-vif-plugged-2ef7c6ef-e077-49c7-aaca-1d8ba7e7335c {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:38:09 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-2a4fdff7-7f1c-4dff-ac33-49fc645b8cf0 req-e1065086-1b81-4b96-aef6-f4b9021b8293 service nova] Acquiring lock "8d983732-91aa-4f20-9d7d-3de66029cba5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:38:09 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-2a4fdff7-7f1c-4dff-ac33-49fc645b8cf0 req-e1065086-1b81-4b96-aef6-f4b9021b8293 service nova] Lock "8d983732-91aa-4f20-9d7d-3de66029cba5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:38:09 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-2a4fdff7-7f1c-4dff-ac33-49fc645b8cf0 req-e1065086-1b81-4b96-aef6-f4b9021b8293 service nova] Lock "8d983732-91aa-4f20-9d7d-3de66029cba5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:38:09 user nova-compute[75226]: DEBUG nova.compute.manager [req-2a4fdff7-7f1c-4dff-ac33-49fc645b8cf0 req-e1065086-1b81-4b96-aef6-f4b9021b8293 service nova] [instance: 8d983732-91aa-4f20-9d7d-3de66029cba5] No waiting events found dispatching network-vif-plugged-2ef7c6ef-e077-49c7-aaca-1d8ba7e7335c {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:38:09 user nova-compute[75226]: WARNING nova.compute.manager [req-2a4fdff7-7f1c-4dff-ac33-49fc645b8cf0 req-e1065086-1b81-4b96-aef6-f4b9021b8293 service nova] [instance: 8d983732-91aa-4f20-9d7d-3de66029cba5] Received unexpected event network-vif-plugged-2ef7c6ef-e077-49c7-aaca-1d8ba7e7335c for instance with vm_state rescued and task_state unrescuing.
Nov 17 01:38:09 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c4a9724-533e-40c8-ab2a-ce3415af240a/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:38:09 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c4a9724-533e-40c8-ab2a-ce3415af240a/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:38:09 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c4a9724-533e-40c8-ab2a-ce3415af240a/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:38:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c4a9724-533e-40c8-ab2a-ce3415af240a/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:38:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6d21784-2ebe-4a39-9ceb-f6607f02e3c4/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:38:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6d21784-2ebe-4a39-9ceb-f6607f02e3c4/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:38:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6d21784-2ebe-4a39-9ceb-f6607f02e3c4/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:38:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6d21784-2ebe-4a39-9ceb-f6607f02e3c4/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:38:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38062487-67ca-4962-974f-81456aebe97b/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:38:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38062487-67ca-4962-974f-81456aebe97b/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:38:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38062487-67ca-4962-974f-81456aebe97b/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:38:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38062487-67ca-4962-974f-81456aebe97b/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:38:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c280142-8901-4f83-bde4-baaa097e05b0/disk.rescue --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:38:11 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c280142-8901-4f83-bde4-baaa097e05b0/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:38:11 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c280142-8901-4f83-bde4-baaa097e05b0/disk.rescue --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:38:11 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c280142-8901-4f83-bde4-baaa097e05b0/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:38:11 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c280142-8901-4f83-bde4-baaa097e05b0/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:38:11 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c280142-8901-4f83-bde4-baaa097e05b0/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:38:11 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c280142-8901-4f83-bde4-baaa097e05b0/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:38:11 user nova-compute[75226]: DEBUG nova.compute.manager [None req-d5f4f1d1-5747-4aa4-a9ce-b5ac26254a4c tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] [instance: 8d983732-91aa-4f20-9d7d-3de66029cba5] Checking state {{(pid=75226) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 01:38:11 user nova-compute[75226]: DEBUG nova.compute.manager [req-73c14541-7809-42f9-9df6-d21d903b2bd7 req-1670bf09-f1e1-454d-a735-48ec1f63cba6 service nova] [instance: 8d983732-91aa-4f20-9d7d-3de66029cba5] Received event network-vif-plugged-2ef7c6ef-e077-49c7-aaca-1d8ba7e7335c {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:38:11 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-73c14541-7809-42f9-9df6-d21d903b2bd7 req-1670bf09-f1e1-454d-a735-48ec1f63cba6 service nova] Acquiring lock "8d983732-91aa-4f20-9d7d-3de66029cba5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:38:11 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-73c14541-7809-42f9-9df6-d21d903b2bd7 req-1670bf09-f1e1-454d-a735-48ec1f63cba6 service nova] Lock "8d983732-91aa-4f20-9d7d-3de66029cba5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:38:11 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-73c14541-7809-42f9-9df6-d21d903b2bd7 req-1670bf09-f1e1-454d-a735-48ec1f63cba6 service nova] Lock "8d983732-91aa-4f20-9d7d-3de66029cba5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:38:11 user nova-compute[75226]: DEBUG nova.compute.manager [req-73c14541-7809-42f9-9df6-d21d903b2bd7 req-1670bf09-f1e1-454d-a735-48ec1f63cba6 service nova] [instance: 8d983732-91aa-4f20-9d7d-3de66029cba5] No waiting events found dispatching network-vif-plugged-2ef7c6ef-e077-49c7-aaca-1d8ba7e7335c {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:38:11 user nova-compute[75226]: WARNING nova.compute.manager [req-73c14541-7809-42f9-9df6-d21d903b2bd7 req-1670bf09-f1e1-454d-a735-48ec1f63cba6 service nova] [instance: 8d983732-91aa-4f20-9d7d-3de66029cba5] Received unexpected event network-vif-plugged-2ef7c6ef-e077-49c7-aaca-1d8ba7e7335c for instance with vm_state rescued and task_state unrescuing.
Nov 17 01:38:11 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c280142-8901-4f83-bde4-baaa097e05b0/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:38:11 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6555d72-6094-4ea9-b071-a3d3c8a300a9/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:38:11 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6555d72-6094-4ea9-b071-a3d3c8a300a9/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:38:11 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6555d72-6094-4ea9-b071-a3d3c8a300a9/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:38:12 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6555d72-6094-4ea9-b071-a3d3c8a300a9/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:38:12 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0597c05a-1049-4117-a8ae-8177d590e024/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:38:12 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0597c05a-1049-4117-a8ae-8177d590e024/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:38:12 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0597c05a-1049-4117-a8ae-8177d590e024/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:38:12 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0597c05a-1049-4117-a8ae-8177d590e024/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:38:12 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d983732-91aa-4f20-9d7d-3de66029cba5/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:38:12 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d983732-91aa-4f20-9d7d-3de66029cba5/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:38:12 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d983732-91aa-4f20-9d7d-3de66029cba5/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:38:12 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d983732-91aa-4f20-9d7d-3de66029cba5/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:38:12 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75226) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 01:38:12 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75226) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 01:38:13 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:38:13 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:38:13 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Hypervisor/Node resource view: name=user free_ram=7888MB free_disk=24.921527862548828GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75226) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 17 01:38:13 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:38:13 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:38:13 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:38:13 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 38062487-67ca-4962-974f-81456aebe97b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:38:13 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance d6555d72-6094-4ea9-b071-a3d3c8a300a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:38:13 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 5c280142-8901-4f83-bde4-baaa097e05b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:38:13 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 8d983732-91aa-4f20-9d7d-3de66029cba5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:38:13 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance a298d980-feed-4530-9499-f2833b404dcd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:38:13 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 8c4a9724-533e-40c8-ab2a-ce3415af240a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:38:13 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance d6d21784-2ebe-4a39-9ceb-f6607f02e3c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:38:13 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 0597c05a-1049-4117-a8ae-8177d590e024 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:38:13 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75226) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 17 01:38:13 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75226) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 17 01:38:13 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:38:13 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:38:13 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Compute_service record updated for user:user {{(pid=75226) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 17 01:38:13 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.603s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:38:14 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:38:16 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:38:16 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:38:16 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:38:16 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:38:16 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:38:18 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:38:19 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:38:20 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:38:20 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Starting heal instance info cache {{(pid=75226) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 17 01:38:20 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Rebuilding the list of instances to heal {{(pid=75226) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 17 01:38:21 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "refresh_cache-38062487-67ca-4962-974f-81456aebe97b" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:38:21 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquired lock "refresh_cache-38062487-67ca-4962-974f-81456aebe97b" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:38:21 user nova-compute[75226]: DEBUG nova.network.neutron [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] [instance: 38062487-67ca-4962-974f-81456aebe97b] Forcefully refreshing network info cache for instance {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 17 01:38:21 user nova-compute[75226]: DEBUG nova.objects.instance [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lazy-loading 'info_cache' on Instance uuid 38062487-67ca-4962-974f-81456aebe97b {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:38:21 user nova-compute[75226]: DEBUG nova.network.neutron [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] [instance: 38062487-67ca-4962-974f-81456aebe97b] Updating instance_info_cache with network_info: [{"id": "b4bb80f3-212b-41bf-94a3-442865a852c7", "address": "fa:16:3e:ef:fd:97", "network": {"id": "9f39d3e5-b106-4bd9-b8ba-0f326e89c481", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-675861281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9042fe4ecc245dd97553f6e942c3e05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4bb80f3-21", "ovs_interfaceid": "b4bb80f3-212b-41bf-94a3-442865a852c7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:38:21 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Releasing lock "refresh_cache-38062487-67ca-4962-974f-81456aebe97b" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:38:21 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] [instance: 38062487-67ca-4962-974f-81456aebe97b] Updated the network info_cache for instance {{(pid=75226) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 17 01:38:21 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:38:21 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75226) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 17 01:38:24 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:38:24 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:38:24 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:38:24 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75226) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 17 01:38:26 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:38:26 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Cleaning up deleted instances {{(pid=75226) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 17 01:38:26 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] There are 0 instances to clean {{(pid=75226) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 17 01:38:28 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:38:29 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:38:33 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:38:34 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:38:38 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:38:39 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:38:43 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:38:44 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:38:46 user nova-compute[75226]: INFO nova.compute.manager [None req-9fd9d7f2-e19c-4d85-ad6f-1a8741596bf2 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: a298d980-feed-4530-9499-f2833b404dcd] Get console output
Nov 17 01:38:46 user nova-compute[75226]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Nov 17 01:38:48 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:38:49 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:38:54 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:38:59 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:39:04 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:39:07 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-683f667e-fe48-4b00-b01e-a5301e3312dc tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Acquiring lock "8c4a9724-533e-40c8-ab2a-ce3415af240a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:39:07 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-683f667e-fe48-4b00-b01e-a5301e3312dc tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Lock "8c4a9724-533e-40c8-ab2a-ce3415af240a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:39:07 user nova-compute[75226]: DEBUG nova.objects.instance [None req-683f667e-fe48-4b00-b01e-a5301e3312dc tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Lazy-loading 'flavor' on Instance uuid 8c4a9724-533e-40c8-ab2a-ce3415af240a {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:39:07 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-683f667e-fe48-4b00-b01e-a5301e3312dc tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Lock "8c4a9724-533e-40c8-ab2a-ce3415af240a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:39:08 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-683f667e-fe48-4b00-b01e-a5301e3312dc tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Acquiring lock "8c4a9724-533e-40c8-ab2a-ce3415af240a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:39:08 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-683f667e-fe48-4b00-b01e-a5301e3312dc tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Lock "8c4a9724-533e-40c8-ab2a-ce3415af240a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:39:08 user nova-compute[75226]: INFO nova.compute.manager [None req-683f667e-fe48-4b00-b01e-a5301e3312dc tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] [instance: 8c4a9724-533e-40c8-ab2a-ce3415af240a] Attaching volume 42287bb8-179a-4f5d-adc3-ab6e03ef12dd to /dev/vdb
Nov 17 01:39:08 user nova-compute[75226]: DEBUG os_brick.utils [None req-683f667e-fe48-4b00-b01e-a5301e3312dc tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:39:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:39:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:39:08 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f15fd54-091f-4ba2-9798-0801a33b9ea7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f62857db69\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:39:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:39:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:39:08 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d0b1b32-3b03-4f90-82e8-47839381e0d8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:39:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:39:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:39:08 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[4deb77b2-19d3-4789-8158-7ba1d2adde74]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:39:08 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[f663b79d-2af1-4c9f-abab-c410e14eb44f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:39:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-683f667e-fe48-4b00-b01e-a5301e3312dc tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Running cmd (subprocess): nvme version {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:39:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-683f667e-fe48-4b00-b01e-a5301e3312dc tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] 'nvme version' failed. Not Retrying. {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 01:39:08 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.nvmeof [None req-683f667e-fe48-4b00-b01e-a5301e3312dc tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] nvme not present on system {{(pid=75226) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 17 01:39:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:39:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 01:39:08 user nova-compute[75226]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 17 01:39:08 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[438b89b6-4641-418b-adb5-667acdeaa39e]: (4, '') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:39:08 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-683f667e-fe48-4b00-b01e-a5301e3312dc tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75226) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 17 01:39:08 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-683f667e-fe48-4b00-b01e-a5301e3312dc tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75226) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 17 01:39:08 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-683f667e-fe48-4b00-b01e-a5301e3312dc tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] LIGHTOS: no hostnqn found. {{(pid=75226) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 17 01:39:08 user nova-compute[75226]: DEBUG os_brick.utils [None req-683f667e-fe48-4b00-b01e-a5301e3312dc tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f62857db69', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:39:08 user nova-compute[75226]: DEBUG nova.virt.block_device [None req-683f667e-fe48-4b00-b01e-a5301e3312dc tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] [instance: 8c4a9724-533e-40c8-ab2a-ce3415af240a] Updating existing volume attachment record: 0fca66df-ca70-43ac-9254-4ab19839a689 {{(pid=75226) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 17 01:39:08 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:39:08 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:39:09 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:39:09 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:39:09 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:39:09 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75226) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 17 01:39:09 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c4a9724-533e-40c8-ab2a-ce3415af240a/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:39:09 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c4a9724-533e-40c8-ab2a-ce3415af240a/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:39:09 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c4a9724-533e-40c8-ab2a-ce3415af240a/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:39:09 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:39:09 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c4a9724-533e-40c8-ab2a-ce3415af240a/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:39:09 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6d21784-2ebe-4a39-9ceb-f6607f02e3c4/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:39:09 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6d21784-2ebe-4a39-9ceb-f6607f02e3c4/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:39:09 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6d21784-2ebe-4a39-9ceb-f6607f02e3c4/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:39:09 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6d21784-2ebe-4a39-9ceb-f6607f02e3c4/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:39:09 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38062487-67ca-4962-974f-81456aebe97b/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:39:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38062487-67ca-4962-974f-81456aebe97b/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:39:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38062487-67ca-4962-974f-81456aebe97b/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:39:10 user nova-compute[75226]: DEBUG nova.compute.manager [req-690f27a3-fb84-46d9-ba5e-055ad54877a3 req-901f0fdd-e49d-4d75-bf04-217dbc6e5e82 service nova] [instance: d6d21784-2ebe-4a39-9ceb-f6607f02e3c4] Received event network-changed-2a4dd370-0638-425d-ba53-19c724a14644 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:39:10 user nova-compute[75226]: DEBUG nova.compute.manager [req-690f27a3-fb84-46d9-ba5e-055ad54877a3 req-901f0fdd-e49d-4d75-bf04-217dbc6e5e82 service nova] [instance: d6d21784-2ebe-4a39-9ceb-f6607f02e3c4] Refreshing instance network info cache due to event network-changed-2a4dd370-0638-425d-ba53-19c724a14644. {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 01:39:10 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-690f27a3-fb84-46d9-ba5e-055ad54877a3 req-901f0fdd-e49d-4d75-bf04-217dbc6e5e82 service nova] Acquiring lock "refresh_cache-d6d21784-2ebe-4a39-9ceb-f6607f02e3c4" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:39:10 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-690f27a3-fb84-46d9-ba5e-055ad54877a3 req-901f0fdd-e49d-4d75-bf04-217dbc6e5e82 service nova] Acquired lock "refresh_cache-d6d21784-2ebe-4a39-9ceb-f6607f02e3c4" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:39:10 user nova-compute[75226]: DEBUG nova.network.neutron [req-690f27a3-fb84-46d9-ba5e-055ad54877a3 req-901f0fdd-e49d-4d75-bf04-217dbc6e5e82 service nova] [instance: d6d21784-2ebe-4a39-9ceb-f6607f02e3c4] Refreshing network info cache for port 2a4dd370-0638-425d-ba53-19c724a14644 {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 01:39:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38062487-67ca-4962-974f-81456aebe97b/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:39:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c280142-8901-4f83-bde4-baaa097e05b0/disk.rescue --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:39:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c280142-8901-4f83-bde4-baaa097e05b0/disk.rescue --force-share --output=json" returned: 0 in 0.210s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:39:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c280142-8901-4f83-bde4-baaa097e05b0/disk.rescue --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:39:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c280142-8901-4f83-bde4-baaa097e05b0/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:39:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c280142-8901-4f83-bde4-baaa097e05b0/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:39:10 user nova-compute[75226]: DEBUG nova.network.neutron [req-690f27a3-fb84-46d9-ba5e-055ad54877a3 req-901f0fdd-e49d-4d75-bf04-217dbc6e5e82 service nova] [instance: d6d21784-2ebe-4a39-9ceb-f6607f02e3c4] Updated VIF entry in instance network info cache for port 2a4dd370-0638-425d-ba53-19c724a14644. {{(pid=75226) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 01:39:10 user nova-compute[75226]: DEBUG nova.network.neutron [req-690f27a3-fb84-46d9-ba5e-055ad54877a3 req-901f0fdd-e49d-4d75-bf04-217dbc6e5e82 service nova] [instance: d6d21784-2ebe-4a39-9ceb-f6607f02e3c4] Updating instance_info_cache with network_info: [{"id": "2a4dd370-0638-425d-ba53-19c724a14644", "address": "fa:16:3e:f6:f1:ac", "network": {"id": "e3bdabce-76e0-4de2-9b44-dbe96b162892", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1190388267-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c14e1b64486542989695083243768720", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a4dd370-06", "ovs_interfaceid": "2a4dd370-0638-425d-ba53-19c724a14644", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:39:10 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-690f27a3-fb84-46d9-ba5e-055ad54877a3 req-901f0fdd-e49d-4d75-bf04-217dbc6e5e82 service nova] Releasing lock "refresh_cache-d6d21784-2ebe-4a39-9ceb-f6607f02e3c4" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:39:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c280142-8901-4f83-bde4-baaa097e05b0/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:39:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c280142-8901-4f83-bde4-baaa097e05b0/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:39:10 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-b8936e0e-b2c9-479e-b558-905d0ce8162a tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] Acquiring lock "d6d21784-2ebe-4a39-9ceb-f6607f02e3c4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:39:10 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-b8936e0e-b2c9-479e-b558-905d0ce8162a tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] Lock "d6d21784-2ebe-4a39-9ceb-f6607f02e3c4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:39:10 user nova-compute[75226]: DEBUG nova.objects.instance [None req-b8936e0e-b2c9-479e-b558-905d0ce8162a tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] Lazy-loading 'flavor' on Instance uuid d6d21784-2ebe-4a39-9ceb-f6607f02e3c4 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:39:11 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-b8936e0e-b2c9-479e-b558-905d0ce8162a tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] Lock "d6d21784-2ebe-4a39-9ceb-f6607f02e3c4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:39:11 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c280142-8901-4f83-bde4-baaa097e05b0/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:39:11 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6555d72-6094-4ea9-b071-a3d3c8a300a9/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:39:11 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-b8936e0e-b2c9-479e-b558-905d0ce8162a tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] Acquiring lock "d6d21784-2ebe-4a39-9ceb-f6607f02e3c4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:39:11 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-b8936e0e-b2c9-479e-b558-905d0ce8162a tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] Lock "d6d21784-2ebe-4a39-9ceb-f6607f02e3c4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:39:11 user nova-compute[75226]: INFO nova.compute.manager [None req-b8936e0e-b2c9-479e-b558-905d0ce8162a tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] [instance: d6d21784-2ebe-4a39-9ceb-f6607f02e3c4] Attaching volume afbcbbf4-d90c-4224-869f-904342190f6c to /dev/vdb
Nov 17 01:39:11 user nova-compute[75226]: DEBUG os_brick.utils [None req-b8936e0e-b2c9-479e-b558-905d0ce8162a tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:39:11 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:39:11 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:39:11 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[15200353-462e-4752-be39-36b370d734d4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f62857db69\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:39:11 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:39:11 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:39:11 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[647cd071-54ed-4af8-b319-1cb564bdc507]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:39:11 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:39:11 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6555d72-6094-4ea9-b071-a3d3c8a300a9/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:39:11 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6555d72-6094-4ea9-b071-a3d3c8a300a9/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:39:11 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:39:11 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[028179de-908f-46d5-96e2-04e16a3f1758]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:39:11 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7980196-a805-4430-94a4-1cd317ee1ff5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:39:11 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-b8936e0e-b2c9-479e-b558-905d0ce8162a tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] Running cmd (subprocess): nvme version {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:39:11 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-b8936e0e-b2c9-479e-b558-905d0ce8162a tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] 'nvme version' failed. Not Retrying. {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 01:39:11 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b8936e0e-b2c9-479e-b558-905d0ce8162a tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] nvme not present on system {{(pid=75226) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 17 01:39:11 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:39:11 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 01:39:11 user nova-compute[75226]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 17 01:39:11 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[14e11fcf-13f0-4384-9cf0-3320323ed2f5]: (4, '') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:39:11 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-b8936e0e-b2c9-479e-b558-905d0ce8162a tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75226) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 17 01:39:11 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-b8936e0e-b2c9-479e-b558-905d0ce8162a tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75226) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 17 01:39:11 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-b8936e0e-b2c9-479e-b558-905d0ce8162a tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] LIGHTOS: no hostnqn found. {{(pid=75226) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 17 01:39:11 user nova-compute[75226]: DEBUG os_brick.utils [None req-b8936e0e-b2c9-479e-b558-905d0ce8162a tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f62857db69', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:39:11 user nova-compute[75226]: DEBUG nova.virt.block_device [None req-b8936e0e-b2c9-479e-b558-905d0ce8162a tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] [instance: d6d21784-2ebe-4a39-9ceb-f6607f02e3c4] Updating existing volume attachment record: d7bb7135-cfb6-4659-9605-462a36c1c0bc {{(pid=75226) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 17 01:39:11 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6555d72-6094-4ea9-b071-a3d3c8a300a9/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:39:11 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0597c05a-1049-4117-a8ae-8177d590e024/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:39:11 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0597c05a-1049-4117-a8ae-8177d590e024/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:39:11 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0597c05a-1049-4117-a8ae-8177d590e024/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:39:11 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0597c05a-1049-4117-a8ae-8177d590e024/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:39:11 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d983732-91aa-4f20-9d7d-3de66029cba5/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:39:12 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d983732-91aa-4f20-9d7d-3de66029cba5/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:39:12 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d983732-91aa-4f20-9d7d-3de66029cba5/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:39:12 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d983732-91aa-4f20-9d7d-3de66029cba5/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:39:12 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75226) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 01:39:12 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75226) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 01:39:12 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:39:12 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:39:12 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Hypervisor/Node resource view: name=user free_ram=7987MB free_disk=24.917659759521484GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75226) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 17 01:39:12 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:39:12 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:39:12 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 38062487-67ca-4962-974f-81456aebe97b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:39:12 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance d6555d72-6094-4ea9-b071-a3d3c8a300a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:39:12 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 5c280142-8901-4f83-bde4-baaa097e05b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:39:12 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 8d983732-91aa-4f20-9d7d-3de66029cba5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:39:12 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance a298d980-feed-4530-9499-f2833b404dcd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:39:12 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 8c4a9724-533e-40c8-ab2a-ce3415af240a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:39:12 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance d6d21784-2ebe-4a39-9ceb-f6607f02e3c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:39:12 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 0597c05a-1049-4117-a8ae-8177d590e024 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:39:12 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75226) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 17 01:39:12 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75226) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 17 01:39:12 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Refreshing inventories for resource provider f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 17 01:39:12 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Updating ProviderTree inventory for provider f431122b-abb2-4ecb-9e21-e3ec333d823b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 17 01:39:12 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Updating inventory in ProviderTree for provider f431122b-abb2-4ecb-9e21-e3ec333d823b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 17 01:39:12 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Refreshing aggregate associations for resource provider f431122b-abb2-4ecb-9e21-e3ec333d823b, aggregates: None {{(pid=75226) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 17 01:39:13 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Refreshing trait associations for resource provider f431122b-abb2-4ecb-9e21-e3ec333d823b, traits: COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE42,HW_CPU_X86_SSE,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSSE3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_SATA {{(pid=75226) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 17 01:39:13 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:39:13 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:39:13 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Compute_service record updated for user:user {{(pid=75226) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 17 01:39:13 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.523s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:39:13 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:39:14 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-683f667e-fe48-4b00-b01e-a5301e3312dc tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] [instance: 8c4a9724-533e-40c8-ab2a-ce3415af240a] Calling os-brick to attach iSCSI Volume {{(pid=75226) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 17 01:39:14 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-683f667e-fe48-4b00-b01e-a5301e3312dc tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc4cc36b490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:42287bb8-179a-4f5d-adc3-ab6e03ef12dd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ihpBPKdw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:39:14 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-683f667e-fe48-4b00-b01e-a5301e3312dc tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:39:14 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-683f667e-fe48-4b00-b01e-a5301e3312dc tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:39:14 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-683f667e-fe48-4b00-b01e-a5301e3312dc tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:39:14 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-683f667e-fe48-4b00-b01e-a5301e3312dc tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:39:14 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-683f667e-fe48-4b00-b01e-a5301e3312dc tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:42287bb8-179a-4f5d-adc3-ab6e03ef12dd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:39:14 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-683f667e-fe48-4b00-b01e-a5301e3312dc tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:42287bb8-179a-4f5d-adc3-ab6e03ef12dd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:39:14 user nova-compute[75226]: INFO os_brick.initiator.connectors.iscsi [None req-683f667e-fe48-4b00-b01e-a5301e3312dc tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 17 01:39:14 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42287bb8-179a-4f5d-adc3-ab6e03ef12dd -p 172.16.0.220:3260 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:39:14 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42287bb8-179a-4f5d-adc3-ab6e03ef12dd -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:39:14 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[20019f60-12a1-41a7-b02c-49e4afcce206]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:39:14 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-683f667e-fe48-4b00-b01e-a5301e3312dc tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 17 01:39:14 user nova-compute[75226]:  {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:39:14 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42287bb8-179a-4f5d-adc3-ab6e03ef12dd -p 172.16.0.220:3260 --interface default --op new {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:39:14 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42287bb8-179a-4f5d-adc3-ab6e03ef12dd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:39:14 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e8fbe5b-6a29-402e-a78d-ea70270bd4db]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:42287bb8-179a-4f5d-adc3-ab6e03ef12dd] added\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:39:14 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-683f667e-fe48-4b00-b01e-a5301e3312dc tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:42287bb8-179a-4f5d-adc3-ab6e03ef12dd] added
Nov 17 01:39:14 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:39:14 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42287bb8-179a-4f5d-adc3-ab6e03ef12dd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:39:14 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42287bb8-179a-4f5d-adc3-ab6e03ef12dd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:39:14 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[21677551-a2a4-4b99-889c-cc6140d37e2f]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:39:14 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-683f667e-fe48-4b00-b01e-a5301e3312dc tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:39:14 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42287bb8-179a-4f5d-adc3-ab6e03ef12dd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:39:14 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42287bb8-179a-4f5d-adc3-ab6e03ef12dd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:39:14 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[b853ea41-6e07-4a96-9e54-df7304157f8f]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:39:14 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-683f667e-fe48-4b00-b01e-a5301e3312dc tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:39:14 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42287bb8-179a-4f5d-adc3-ab6e03ef12dd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ihpBPKdw {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:39:14 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42287bb8-179a-4f5d-adc3-ab6e03ef12dd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ihpBPKdw" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:39:14 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b91abb2-bffb-46eb-ad36-c30c1b5e50f8]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:39:14 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-683f667e-fe48-4b00-b01e-a5301e3312dc tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ihpBPKdw'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:39:14 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42287bb8-179a-4f5d-adc3-ab6e03ef12dd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:39:14 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42287bb8-179a-4f5d-adc3-ab6e03ef12dd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:39:14 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[39c68555-951f-4048-b501-560c065348f8]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:39:14 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-683f667e-fe48-4b00-b01e-a5301e3312dc tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:39:14 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:39:14 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:39:14 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[a72cbb5b-1858-4874-9b1c-98f1fa0644e5]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bb94c67-f3ce-4642-8f8d-3c59a63802ac (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:39:14 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-683f667e-fe48-4b00-b01e-a5301e3312dc tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419 (non-flash)
Nov 17 01:39:14 user nova-compute[75226]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bb94c67-f3ce-4642-8f8d-3c59a63802ac (non-flash)
Nov 17 01:39:14 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:39:14 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-683f667e-fe48-4b00-b01e-a5301e3312dc tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419 (non-flash)
Nov 17 01:39:14 user nova-compute[75226]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bb94c67-f3ce-4642-8f8d-3c59a63802ac (non-flash)
Nov 17 01:39:14 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:39:14 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42287bb8-179a-4f5d-adc3-ab6e03ef12dd -p 172.16.0.220:3260 --login {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:39:14 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42287bb8-179a-4f5d-adc3-ab6e03ef12dd -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:39:14 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[efb5a587-519a-452d-9b01-35503fea2a1c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:42287bb8-179a-4f5d-adc3-ab6e03ef12dd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:42287bb8-179a-4f5d-adc3-ab6e03ef12dd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:39:14 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-683f667e-fe48-4b00-b01e-a5301e3312dc tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:42287bb8-179a-4f5d-adc3-ab6e03ef12dd, portal: 172.16.0.220,3260]
Nov 17 01:39:14 user nova-compute[75226]: Login to [iface: default, target: iqn.2010-10.org.openstack:42287bb8-179a-4f5d-adc3-ab6e03ef12dd, portal: 172.16.0.220,3260] successful.
Nov 17 01:39:14 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:39:14 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42287bb8-179a-4f5d-adc3-ab6e03ef12dd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:39:14 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42287bb8-179a-4f5d-adc3-ab6e03ef12dd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:39:14 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ad26468-555f-434a-8b80-1bd6f0607add]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:39:14 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-683f667e-fe48-4b00-b01e-a5301e3312dc tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:39:14 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:39:14 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:39:14 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[46d2f330-ce71-4336-b0ae-09f41fb7c6bb]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bb94c67-f3ce-4642-8f8d-3c59a63802ac (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42287bb8-179a-4f5d-adc3-ab6e03ef12dd (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:39:14 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-683f667e-fe48-4b00-b01e-a5301e3312dc tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419 (non-flash)
Nov 17 01:39:14 user nova-compute[75226]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bb94c67-f3ce-4642-8f8d-3c59a63802ac (non-flash)
Nov 17 01:39:14 user nova-compute[75226]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42287bb8-179a-4f5d-adc3-ab6e03ef12dd (non-flash)
Nov 17 01:39:14 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:39:14 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-683f667e-fe48-4b00-b01e-a5301e3312dc tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419 (non-flash)
Nov 17 01:39:14 user nova-compute[75226]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bb94c67-f3ce-4642-8f8d-3c59a63802ac (non-flash)
Nov 17 01:39:14 user nova-compute[75226]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42287bb8-179a-4f5d-adc3-ab6e03ef12dd (non-flash)
Nov 17 01:39:14 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:39:14 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-683f667e-fe48-4b00-b01e-a5301e3312dc tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:42287bb8-179a-4f5d-adc3-ab6e03ef12dd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.269s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:39:14 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-683f667e-fe48-4b00-b01e-a5301e3312dc tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Connected to 172.16.0.220:3260 {{(pid=75226) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 17 01:39:14 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-683f667e-fe48-4b00-b01e-a5301e3312dc tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] HCTL ('34', '-', '-', 0) found on session 44 with lun 0 {{(pid=75226) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 17 01:39:14 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-683f667e-fe48-4b00-b01e-a5301e3312dc tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75226) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 17 01:39:14 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:39:14 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:39:14 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[824e1b8c-8aa0-4571-bf2b-2653b0e5f557]: (4, ('- - 0', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:39:14 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-683f667e-fe48-4b00-b01e-a5301e3312dc tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Searching for a device in session 44 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75226) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 01:39:14 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-683f667e-fe48-4b00-b01e-a5301e3312dc tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:42287bb8-179a-4f5d-adc3-ab6e03ef12dd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ihpBPKdw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75226) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 17 01:39:14 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:39:14 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:39:14 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:39:15 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-683f667e-fe48-4b00-b01e-a5301e3312dc tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.301s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:39:15 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-683f667e-fe48-4b00-b01e-a5301e3312dc tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] <== connect_volume: return (1303ms) {'type': 'block', 'scsi_wwn': '23763366237393336', 'path': '/dev/sdc'} {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:39:15 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-683f667e-fe48-4b00-b01e-a5301e3312dc tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] [instance: 8c4a9724-533e-40c8-ab2a-ce3415af240a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23763366237393336', 'path': '/dev/sdc'} {{(pid=75226) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 17 01:39:15 user nova-compute[75226]: DEBUG nova.objects.instance [None req-683f667e-fe48-4b00-b01e-a5301e3312dc tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Lazy-loading 'flavor' on Instance uuid 8c4a9724-533e-40c8-ab2a-ce3415af240a {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:39:15 user nova-compute[75226]: DEBUG nova.virt.libvirt.guest [None req-683f667e-fe48-4b00-b01e-a5301e3312dc tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] attach device xml: <disk type="block" device="disk">
Nov 17 01:39:15 user nova-compute[75226]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 01:39:15 user nova-compute[75226]:   <source dev="/dev/sdc"/>
Nov 17 01:39:15 user nova-compute[75226]:   <target dev="vdb" bus="virtio"/>
Nov 17 01:39:15 user nova-compute[75226]:   <serial>42287bb8-179a-4f5d-adc3-ab6e03ef12dd</serial>
Nov 17 01:39:15 user nova-compute[75226]: </disk>
Nov 17 01:39:15 user nova-compute[75226]:  {{(pid=75226) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 17 01:39:15 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-683f667e-fe48-4b00-b01e-a5301e3312dc tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] No BDM found with device name vda, not building metadata. {{(pid=75226) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 01:39:15 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-683f667e-fe48-4b00-b01e-a5301e3312dc tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75226) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 01:39:15 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-683f667e-fe48-4b00-b01e-a5301e3312dc tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] No VIF found with MAC fa:16:3e:f6:83:b8, not building metadata {{(pid=75226) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 01:39:15 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-683f667e-fe48-4b00-b01e-a5301e3312dc tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Lock "8c4a9724-533e-40c8-ab2a-ce3415af240a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.838s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:39:16 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:39:16 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b8936e0e-b2c9-479e-b558-905d0ce8162a tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] [instance: d6d21784-2ebe-4a39-9ceb-f6607f02e3c4] Calling os-brick to attach iSCSI Volume {{(pid=75226) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 17 01:39:16 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8936e0e-b2c9-479e-b558-905d0ce8162a tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc4cc36b490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:afbcbbf4-d90c-4224-869f-904342190f6c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nkDbXhmW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:39:16 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-b8936e0e-b2c9-479e-b558-905d0ce8162a tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:39:16 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-b8936e0e-b2c9-479e-b558-905d0ce8162a tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:39:16 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-b8936e0e-b2c9-479e-b558-905d0ce8162a tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:39:16 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-b8936e0e-b2c9-479e-b558-905d0ce8162a tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:39:16 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-b8936e0e-b2c9-479e-b558-905d0ce8162a tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:afbcbbf4-d90c-4224-869f-904342190f6c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:39:16 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-b8936e0e-b2c9-479e-b558-905d0ce8162a tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:afbcbbf4-d90c-4224-869f-904342190f6c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:39:16 user nova-compute[75226]: INFO os_brick.initiator.connectors.iscsi [None req-b8936e0e-b2c9-479e-b558-905d0ce8162a tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 17 01:39:16 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afbcbbf4-d90c-4224-869f-904342190f6c -p 172.16.0.220:3260 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:39:16 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afbcbbf4-d90c-4224-869f-904342190f6c -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:39:16 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[46e41f9f-ccc1-4e46-a686-e446c4109d1b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:39:16 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8936e0e-b2c9-479e-b558-905d0ce8162a tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 17 01:39:16 user nova-compute[75226]:  {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:39:16 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afbcbbf4-d90c-4224-869f-904342190f6c -p 172.16.0.220:3260 --interface default --op new {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:39:16 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afbcbbf4-d90c-4224-869f-904342190f6c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:39:16 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[dabb10ef-bcc8-4b3d-ade7-e20e2d36429b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:afbcbbf4-d90c-4224-869f-904342190f6c] added\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:39:16 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8936e0e-b2c9-479e-b558-905d0ce8162a tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:afbcbbf4-d90c-4224-869f-904342190f6c] added
Nov 17 01:39:16 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:39:16 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afbcbbf4-d90c-4224-869f-904342190f6c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:39:16 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afbcbbf4-d90c-4224-869f-904342190f6c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:39:16 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[410d40d7-c66c-47a9-8a85-d3debb75f2d4]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:39:16 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8936e0e-b2c9-479e-b558-905d0ce8162a tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:39:16 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afbcbbf4-d90c-4224-869f-904342190f6c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:39:16 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afbcbbf4-d90c-4224-869f-904342190f6c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:39:16 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a9a6e75-3f0a-4403-bb25-f763912d66ae]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:39:16 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8936e0e-b2c9-479e-b558-905d0ce8162a tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:39:16 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afbcbbf4-d90c-4224-869f-904342190f6c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nkDbXhmW {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:39:17 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afbcbbf4-d90c-4224-869f-904342190f6c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nkDbXhmW" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:39:17 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a4948ac-fa70-41df-b966-5b1025abea5d]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:39:17 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8936e0e-b2c9-479e-b558-905d0ce8162a tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nkDbXhmW'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:39:17 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afbcbbf4-d90c-4224-869f-904342190f6c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:39:17 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afbcbbf4-d90c-4224-869f-904342190f6c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:39:17 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccebc6d8-b26a-499a-849a-81ad8780639f]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:39:17 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8936e0e-b2c9-479e-b558-905d0ce8162a tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:39:17 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:39:17 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:39:17 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[31409d92-8ed9-46e9-a506-72f8480f7a10]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bb94c67-f3ce-4642-8f8d-3c59a63802ac (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42287bb8-179a-4f5d-adc3-ab6e03ef12dd (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:39:17 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8936e0e-b2c9-479e-b558-905d0ce8162a tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419 (non-flash)
Nov 17 01:39:17 user nova-compute[75226]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bb94c67-f3ce-4642-8f8d-3c59a63802ac (non-flash)
Nov 17 01:39:17 user nova-compute[75226]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42287bb8-179a-4f5d-adc3-ab6e03ef12dd (non-flash)
Nov 17 01:39:17 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:39:17 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8936e0e-b2c9-479e-b558-905d0ce8162a tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419 (non-flash)
Nov 17 01:39:17 user nova-compute[75226]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bb94c67-f3ce-4642-8f8d-3c59a63802ac (non-flash)
Nov 17 01:39:17 user nova-compute[75226]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42287bb8-179a-4f5d-adc3-ab6e03ef12dd (non-flash)
Nov 17 01:39:17 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:39:17 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afbcbbf4-d90c-4224-869f-904342190f6c -p 172.16.0.220:3260 --login {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:39:17 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afbcbbf4-d90c-4224-869f-904342190f6c -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:39:17 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[eae4fb11-0481-464f-a7c1-e7b7084d6b1f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:afbcbbf4-d90c-4224-869f-904342190f6c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:afbcbbf4-d90c-4224-869f-904342190f6c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:39:17 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8936e0e-b2c9-479e-b558-905d0ce8162a tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:afbcbbf4-d90c-4224-869f-904342190f6c, portal: 172.16.0.220,3260]
Nov 17 01:39:17 user nova-compute[75226]: Login to [iface: default, target: iqn.2010-10.org.openstack:afbcbbf4-d90c-4224-869f-904342190f6c, portal: 172.16.0.220,3260] successful.
Nov 17 01:39:17 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:39:17 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afbcbbf4-d90c-4224-869f-904342190f6c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:39:17 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afbcbbf4-d90c-4224-869f-904342190f6c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:39:17 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[82f2955f-00c5-4898-852c-c2f5f74bb03e]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:39:17 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8936e0e-b2c9-479e-b558-905d0ce8162a tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:39:17 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:39:17 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:39:17 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d956623-e0e5-4b88-a87d-d98674ae2d23]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bb94c67-f3ce-4642-8f8d-3c59a63802ac (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42287bb8-179a-4f5d-adc3-ab6e03ef12dd (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afbcbbf4-d90c-4224-869f-904342190f6c (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:39:17 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8936e0e-b2c9-479e-b558-905d0ce8162a tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419 (non-flash)
Nov 17 01:39:17 user nova-compute[75226]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bb94c67-f3ce-4642-8f8d-3c59a63802ac (non-flash)
Nov 17 01:39:17 user nova-compute[75226]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42287bb8-179a-4f5d-adc3-ab6e03ef12dd (non-flash)
Nov 17 01:39:17 user nova-compute[75226]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afbcbbf4-d90c-4224-869f-904342190f6c (non-flash)
Nov 17 01:39:17 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:39:17 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8936e0e-b2c9-479e-b558-905d0ce8162a tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419 (non-flash)
Nov 17 01:39:17 user nova-compute[75226]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bb94c67-f3ce-4642-8f8d-3c59a63802ac (non-flash)
Nov 17 01:39:17 user nova-compute[75226]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42287bb8-179a-4f5d-adc3-ab6e03ef12dd (non-flash)
Nov 17 01:39:17 user nova-compute[75226]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afbcbbf4-d90c-4224-869f-904342190f6c (non-flash)
Nov 17 01:39:17 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:39:17 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-b8936e0e-b2c9-479e-b558-905d0ce8162a tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:afbcbbf4-d90c-4224-869f-904342190f6c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:39:17 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8936e0e-b2c9-479e-b558-905d0ce8162a tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] Connected to 172.16.0.220:3260 {{(pid=75226) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 17 01:39:17 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-b8936e0e-b2c9-479e-b558-905d0ce8162a tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] HCTL ('36', '-', '-', 0) found on session 45 with lun 0 {{(pid=75226) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 17 01:39:17 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-b8936e0e-b2c9-479e-b558-905d0ce8162a tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75226) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 17 01:39:17 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:39:17 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:39:17 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1bf9a4e-a7f7-4cef-b77a-ab9e8b1e864c]: (4, ('- - 0', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:39:17 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-b8936e0e-b2c9-479e-b558-905d0ce8162a tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] Searching for a device in session 45 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75226) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 01:39:17 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8936e0e-b2c9-479e-b558-905d0ce8162a tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:afbcbbf4-d90c-4224-869f-904342190f6c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nkDbXhmW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75226) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 17 01:39:17 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:39:17 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:39:17 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:39:17 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:39:18 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-b8936e0e-b2c9-479e-b558-905d0ce8162a tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.309s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:39:18 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8936e0e-b2c9-479e-b558-905d0ce8162a tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] <== connect_volume: return (1310ms) {'type': 'block', 'scsi_wwn': '26530633536343762', 'path': '/dev/sde'} {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:39:18 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b8936e0e-b2c9-479e-b558-905d0ce8162a tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] [instance: d6d21784-2ebe-4a39-9ceb-f6607f02e3c4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26530633536343762', 'path': '/dev/sde'} {{(pid=75226) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 17 01:39:18 user nova-compute[75226]: DEBUG nova.objects.instance [None req-b8936e0e-b2c9-479e-b558-905d0ce8162a tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] Lazy-loading 'flavor' on Instance uuid d6d21784-2ebe-4a39-9ceb-f6607f02e3c4 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:39:18 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:39:18 user nova-compute[75226]: DEBUG nova.virt.libvirt.guest [None req-b8936e0e-b2c9-479e-b558-905d0ce8162a tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] attach device xml: <disk type="block" device="disk">
Nov 17 01:39:18 user nova-compute[75226]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 01:39:18 user nova-compute[75226]:   <source dev="/dev/sde"/>
Nov 17 01:39:18 user nova-compute[75226]:   <target dev="vdb" bus="virtio"/>
Nov 17 01:39:18 user nova-compute[75226]:   <serial>afbcbbf4-d90c-4224-869f-904342190f6c</serial>
Nov 17 01:39:18 user nova-compute[75226]: </disk>
Nov 17 01:39:18 user nova-compute[75226]:  {{(pid=75226) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 17 01:39:18 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-b8936e0e-b2c9-479e-b558-905d0ce8162a tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] No BDM found with device name vda, not building metadata. {{(pid=75226) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 01:39:18 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-b8936e0e-b2c9-479e-b558-905d0ce8162a tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75226) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 01:39:18 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-b8936e0e-b2c9-479e-b558-905d0ce8162a tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] No VIF found with MAC fa:16:3e:f6:f1:ac, not building metadata {{(pid=75226) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 01:39:18 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-b8936e0e-b2c9-479e-b558-905d0ce8162a tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] Lock "d6d21784-2ebe-4a39-9ceb-f6607f02e3c4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.675s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:39:18 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:39:19 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:39:20 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-f0de00e9-59cf-4080-b88d-2266b18c5fdd tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] Acquiring lock "d57f2553-feb4-49d8-a47b-dedbb4487f9e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:39:20 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-f0de00e9-59cf-4080-b88d-2266b18c5fdd tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] Lock "d57f2553-feb4-49d8-a47b-dedbb4487f9e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:39:20 user nova-compute[75226]: DEBUG nova.compute.manager [None req-f0de00e9-59cf-4080-b88d-2266b18c5fdd tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] [instance: d57f2553-feb4-49d8-a47b-dedbb4487f9e] Starting instance... {{(pid=75226) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 17 01:39:20 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-f0de00e9-59cf-4080-b88d-2266b18c5fdd tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:39:20 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-f0de00e9-59cf-4080-b88d-2266b18c5fdd tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:39:20 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-f0de00e9-59cf-4080-b88d-2266b18c5fdd tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75226) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 17 01:39:20 user nova-compute[75226]: INFO nova.compute.claims [None req-f0de00e9-59cf-4080-b88d-2266b18c5fdd tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] [instance: d57f2553-feb4-49d8-a47b-dedbb4487f9e] Claim successful on node user
Nov 17 01:39:20 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-f0de00e9-59cf-4080-b88d-2266b18c5fdd tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:39:20 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-f0de00e9-59cf-4080-b88d-2266b18c5fdd tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:39:20 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-f0de00e9-59cf-4080-b88d-2266b18c5fdd tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.549s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:39:20 user nova-compute[75226]: DEBUG nova.compute.manager [None req-f0de00e9-59cf-4080-b88d-2266b18c5fdd tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] [instance: d57f2553-feb4-49d8-a47b-dedbb4487f9e] Start building networks asynchronously for instance. {{(pid=75226) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 17 01:39:20 user nova-compute[75226]: DEBUG nova.compute.manager [None req-f0de00e9-59cf-4080-b88d-2266b18c5fdd tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] [instance: d57f2553-feb4-49d8-a47b-dedbb4487f9e] Allocating IP information in the background. {{(pid=75226) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 17 01:39:20 user nova-compute[75226]: DEBUG nova.network.neutron [None req-f0de00e9-59cf-4080-b88d-2266b18c5fdd tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] [instance: d57f2553-feb4-49d8-a47b-dedbb4487f9e] allocate_for_instance() {{(pid=75226) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 17 01:39:20 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-f0de00e9-59cf-4080-b88d-2266b18c5fdd tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] [instance: d57f2553-feb4-49d8-a47b-dedbb4487f9e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 17 01:39:20 user nova-compute[75226]: DEBUG nova.compute.manager [None req-f0de00e9-59cf-4080-b88d-2266b18c5fdd tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] [instance: d57f2553-feb4-49d8-a47b-dedbb4487f9e] Start building block device mappings for instance. {{(pid=75226) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 17 01:39:20 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:39:20 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Starting heal instance info cache {{(pid=75226) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 17 01:39:20 user nova-compute[75226]: DEBUG nova.policy [None req-f0de00e9-59cf-4080-b88d-2266b18c5fdd tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2aa9906ec44847448446b6fb94339028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f00bc826d34bbb8f2f93b550b7431a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75226) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 17 01:39:21 user nova-compute[75226]: DEBUG nova.compute.manager [None req-f0de00e9-59cf-4080-b88d-2266b18c5fdd tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] [instance: d57f2553-feb4-49d8-a47b-dedbb4487f9e] Start spawning the instance on the hypervisor. {{(pid=75226) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 17 01:39:21 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-f0de00e9-59cf-4080-b88d-2266b18c5fdd tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] [instance: d57f2553-feb4-49d8-a47b-dedbb4487f9e] Creating instance directory {{(pid=75226) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 17 01:39:21 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-f0de00e9-59cf-4080-b88d-2266b18c5fdd tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] [instance: d57f2553-feb4-49d8-a47b-dedbb4487f9e] Creating image(s)
Nov 17 01:39:21 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-f0de00e9-59cf-4080-b88d-2266b18c5fdd tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] Acquiring lock "/opt/stack/data/nova/instances/d57f2553-feb4-49d8-a47b-dedbb4487f9e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:39:21 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-f0de00e9-59cf-4080-b88d-2266b18c5fdd tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] Lock "/opt/stack/data/nova/instances/d57f2553-feb4-49d8-a47b-dedbb4487f9e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:39:21 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-f0de00e9-59cf-4080-b88d-2266b18c5fdd tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] Lock "/opt/stack/data/nova/instances/d57f2553-feb4-49d8-a47b-dedbb4487f9e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:39:21 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "refresh_cache-d6555d72-6094-4ea9-b071-a3d3c8a300a9" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:39:21 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquired lock "refresh_cache-d6555d72-6094-4ea9-b071-a3d3c8a300a9" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:39:21 user nova-compute[75226]: DEBUG nova.network.neutron [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] [instance: d6555d72-6094-4ea9-b071-a3d3c8a300a9] Forcefully refreshing network info cache for instance {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 17 01:39:21 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-f0de00e9-59cf-4080-b88d-2266b18c5fdd tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:39:21 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-f0de00e9-59cf-4080-b88d-2266b18c5fdd tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json" returned: 0 in 0.186s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:39:21 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-f0de00e9-59cf-4080-b88d-2266b18c5fdd tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] Acquiring lock "a8a62c2546af3a2036b853250c5ac64d4c6b4371" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:39:21 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-f0de00e9-59cf-4080-b88d-2266b18c5fdd tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] Lock "a8a62c2546af3a2036b853250c5ac64d4c6b4371" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:39:21 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-f0de00e9-59cf-4080-b88d-2266b18c5fdd tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:39:21 user nova-compute[75226]: DEBUG nova.compute.manager [req-4b15a39c-45d8-490e-9210-96c83daabd79 req-a5e37eb1-db2d-47f7-9f46-4cc6912a9bf0 service nova] [instance: 8c4a9724-533e-40c8-ab2a-ce3415af240a] Received event network-changed-e30eaa7a-30df-48f5-b8de-30da75d74972 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:39:21 user nova-compute[75226]: DEBUG nova.compute.manager [req-4b15a39c-45d8-490e-9210-96c83daabd79 req-a5e37eb1-db2d-47f7-9f46-4cc6912a9bf0 service nova] [instance: 8c4a9724-533e-40c8-ab2a-ce3415af240a] Refreshing instance network info cache due to event network-changed-e30eaa7a-30df-48f5-b8de-30da75d74972. {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 01:39:21 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-4b15a39c-45d8-490e-9210-96c83daabd79 req-a5e37eb1-db2d-47f7-9f46-4cc6912a9bf0 service nova] Acquiring lock "refresh_cache-8c4a9724-533e-40c8-ab2a-ce3415af240a" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:39:21 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-4b15a39c-45d8-490e-9210-96c83daabd79 req-a5e37eb1-db2d-47f7-9f46-4cc6912a9bf0 service nova] Acquired lock "refresh_cache-8c4a9724-533e-40c8-ab2a-ce3415af240a" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:39:21 user nova-compute[75226]: DEBUG nova.network.neutron [req-4b15a39c-45d8-490e-9210-96c83daabd79 req-a5e37eb1-db2d-47f7-9f46-4cc6912a9bf0 service nova] [instance: 8c4a9724-533e-40c8-ab2a-ce3415af240a] Refreshing network info cache for port e30eaa7a-30df-48f5-b8de-30da75d74972 {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 01:39:21 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-f0de00e9-59cf-4080-b88d-2266b18c5fdd tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json" returned: 0 in 0.192s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:39:21 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-f0de00e9-59cf-4080-b88d-2266b18c5fdd tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371,backing_fmt=raw /opt/stack/data/nova/instances/d57f2553-feb4-49d8-a47b-dedbb4487f9e/disk 1073741824 {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:39:21 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-f0de00e9-59cf-4080-b88d-2266b18c5fdd tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371,backing_fmt=raw /opt/stack/data/nova/instances/d57f2553-feb4-49d8-a47b-dedbb4487f9e/disk 1073741824" returned: 0 in 0.071s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:39:21 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-f0de00e9-59cf-4080-b88d-2266b18c5fdd tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] Lock "a8a62c2546af3a2036b853250c5ac64d4c6b4371" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.268s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:39:21 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-f0de00e9-59cf-4080-b88d-2266b18c5fdd tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:39:21 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-f0de00e9-59cf-4080-b88d-2266b18c5fdd tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json" returned: 0 in 0.192s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:39:21 user nova-compute[75226]: DEBUG nova.virt.disk.api [None req-f0de00e9-59cf-4080-b88d-2266b18c5fdd tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d57f2553-feb4-49d8-a47b-dedbb4487f9e/disk. size=1073741824 {{(pid=75226) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 17 01:39:21 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-f0de00e9-59cf-4080-b88d-2266b18c5fdd tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57f2553-feb4-49d8-a47b-dedbb4487f9e/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:39:21 user nova-compute[75226]: DEBUG nova.network.neutron [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] [instance: d6555d72-6094-4ea9-b071-a3d3c8a300a9] Updating instance_info_cache with network_info: [{"id": "1315a3d4-9d0a-4a65-8044-45959bf1f754", "address": "fa:16:3e:83:57:31", "network": {"id": "a9710b94-56f8-4cf6-9bb6-344b275e5bf2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-512340839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2052a37a068e4d948c57560c0f4445e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1315a3d4-9d", "ovs_interfaceid": "1315a3d4-9d0a-4a65-8044-45959bf1f754", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:39:21 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Releasing lock "refresh_cache-d6555d72-6094-4ea9-b071-a3d3c8a300a9" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:39:21 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] [instance: d6555d72-6094-4ea9-b071-a3d3c8a300a9] Updated the network info_cache for instance {{(pid=75226) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 17 01:39:21 user nova-compute[75226]: DEBUG nova.network.neutron [None req-f0de00e9-59cf-4080-b88d-2266b18c5fdd tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] [instance: d57f2553-feb4-49d8-a47b-dedbb4487f9e] Successfully created port: c5f31505-49e5-4d1f-95c5-80847769e0b7 {{(pid=75226) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 17 01:39:21 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-f0de00e9-59cf-4080-b88d-2266b18c5fdd tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57f2553-feb4-49d8-a47b-dedbb4487f9e/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:39:21 user nova-compute[75226]: DEBUG nova.virt.disk.api [None req-f0de00e9-59cf-4080-b88d-2266b18c5fdd tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] Cannot resize image /opt/stack/data/nova/instances/d57f2553-feb4-49d8-a47b-dedbb4487f9e/disk to a smaller size. {{(pid=75226) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 17 01:39:21 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-f0de00e9-59cf-4080-b88d-2266b18c5fdd tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] [instance: d57f2553-feb4-49d8-a47b-dedbb4487f9e] Created local disks {{(pid=75226) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 17 01:39:21 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-f0de00e9-59cf-4080-b88d-2266b18c5fdd tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] [instance: d57f2553-feb4-49d8-a47b-dedbb4487f9e] Ensure instance console log exists: /opt/stack/data/nova/instances/d57f2553-feb4-49d8-a47b-dedbb4487f9e/console.log {{(pid=75226) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 17 01:39:21 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-f0de00e9-59cf-4080-b88d-2266b18c5fdd tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:39:21 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-f0de00e9-59cf-4080-b88d-2266b18c5fdd tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:39:21 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-f0de00e9-59cf-4080-b88d-2266b18c5fdd tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:39:21 user nova-compute[75226]: DEBUG nova.network.neutron [req-4b15a39c-45d8-490e-9210-96c83daabd79 req-a5e37eb1-db2d-47f7-9f46-4cc6912a9bf0 service nova] [instance: 8c4a9724-533e-40c8-ab2a-ce3415af240a] Updated VIF entry in instance network info cache for port e30eaa7a-30df-48f5-b8de-30da75d74972. {{(pid=75226) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 01:39:21 user nova-compute[75226]: DEBUG nova.network.neutron [req-4b15a39c-45d8-490e-9210-96c83daabd79 req-a5e37eb1-db2d-47f7-9f46-4cc6912a9bf0 service nova] [instance: 8c4a9724-533e-40c8-ab2a-ce3415af240a] Updating instance_info_cache with network_info: [{"id": "e30eaa7a-30df-48f5-b8de-30da75d74972", "address": "fa:16:3e:f6:83:b8", "network": {"id": "44f50686-24e7-4e75-8269-4391a53286d0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1611114801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33699aa6c9db4815a1e79aff4685801e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape30eaa7a-30", "ovs_interfaceid": "e30eaa7a-30df-48f5-b8de-30da75d74972", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:39:21 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:39:21 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:39:21 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75226) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 17 01:39:21 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-4b15a39c-45d8-490e-9210-96c83daabd79 req-a5e37eb1-db2d-47f7-9f46-4cc6912a9bf0 service nova] Releasing lock "refresh_cache-8c4a9724-533e-40c8-ab2a-ce3415af240a" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:39:22 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-ee875a85-b89d-47fe-8abf-0fde7e3cedc9 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] Acquiring lock "d6d21784-2ebe-4a39-9ceb-f6607f02e3c4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:39:22 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-ee875a85-b89d-47fe-8abf-0fde7e3cedc9 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] Lock "d6d21784-2ebe-4a39-9ceb-f6607f02e3c4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:39:22 user nova-compute[75226]: DEBUG nova.objects.instance [None req-ee875a85-b89d-47fe-8abf-0fde7e3cedc9 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] Lazy-loading 'flavor' on Instance uuid d6d21784-2ebe-4a39-9ceb-f6607f02e3c4 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:39:22 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-ee875a85-b89d-47fe-8abf-0fde7e3cedc9 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] Lock "d6d21784-2ebe-4a39-9ceb-f6607f02e3c4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:39:22 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-ee875a85-b89d-47fe-8abf-0fde7e3cedc9 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] Acquiring lock "d6d21784-2ebe-4a39-9ceb-f6607f02e3c4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:39:22 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-ee875a85-b89d-47fe-8abf-0fde7e3cedc9 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] Lock "d6d21784-2ebe-4a39-9ceb-f6607f02e3c4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:39:22 user nova-compute[75226]: INFO nova.compute.manager [None req-ee875a85-b89d-47fe-8abf-0fde7e3cedc9 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] [instance: d6d21784-2ebe-4a39-9ceb-f6607f02e3c4] Attaching volume a17c9b1e-9d6c-44b4-8c8a-c4b152e806d7 to /dev/vdc
Nov 17 01:39:22 user nova-compute[75226]: DEBUG nova.compute.manager [req-61970c2d-59c9-4765-8588-7cdfae0d9072 req-02374405-37f4-469e-9c43-36d691ec0973 service nova] [instance: 0597c05a-1049-4117-a8ae-8177d590e024] Received event network-changed-e8a7ded4-d849-40ce-a0a9-ecf66e146e56 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:39:22 user nova-compute[75226]: DEBUG nova.compute.manager [req-61970c2d-59c9-4765-8588-7cdfae0d9072 req-02374405-37f4-469e-9c43-36d691ec0973 service nova] [instance: 0597c05a-1049-4117-a8ae-8177d590e024] Refreshing instance network info cache due to event network-changed-e8a7ded4-d849-40ce-a0a9-ecf66e146e56. {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 01:39:22 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-61970c2d-59c9-4765-8588-7cdfae0d9072 req-02374405-37f4-469e-9c43-36d691ec0973 service nova] Acquiring lock "refresh_cache-0597c05a-1049-4117-a8ae-8177d590e024" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:39:22 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-61970c2d-59c9-4765-8588-7cdfae0d9072 req-02374405-37f4-469e-9c43-36d691ec0973 service nova] Acquired lock "refresh_cache-0597c05a-1049-4117-a8ae-8177d590e024" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:39:22 user nova-compute[75226]: DEBUG nova.network.neutron [req-61970c2d-59c9-4765-8588-7cdfae0d9072 req-02374405-37f4-469e-9c43-36d691ec0973 service nova] [instance: 0597c05a-1049-4117-a8ae-8177d590e024] Refreshing network info cache for port e8a7ded4-d849-40ce-a0a9-ecf66e146e56 {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 01:39:22 user nova-compute[75226]: DEBUG nova.network.neutron [None req-f0de00e9-59cf-4080-b88d-2266b18c5fdd tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] [instance: d57f2553-feb4-49d8-a47b-dedbb4487f9e] Successfully updated port: c5f31505-49e5-4d1f-95c5-80847769e0b7 {{(pid=75226) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 17 01:39:22 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-f0de00e9-59cf-4080-b88d-2266b18c5fdd tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] Acquiring lock "refresh_cache-d57f2553-feb4-49d8-a47b-dedbb4487f9e" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:39:22 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-f0de00e9-59cf-4080-b88d-2266b18c5fdd tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] Acquired lock "refresh_cache-d57f2553-feb4-49d8-a47b-dedbb4487f9e" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:39:22 user nova-compute[75226]: DEBUG nova.network.neutron [None req-f0de00e9-59cf-4080-b88d-2266b18c5fdd tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] [instance: d57f2553-feb4-49d8-a47b-dedbb4487f9e] Building network info cache for instance {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 01:39:22 user nova-compute[75226]: DEBUG os_brick.utils [None req-ee875a85-b89d-47fe-8abf-0fde7e3cedc9 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:39:22 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:39:22 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:39:22 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4e65dce-5ae9-4341-8745-bc5dccade281]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f62857db69\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:39:22 user nova-compute[75226]: DEBUG nova.network.neutron [None req-f0de00e9-59cf-4080-b88d-2266b18c5fdd tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] [instance: d57f2553-feb4-49d8-a47b-dedbb4487f9e] Instance cache missing network info. {{(pid=75226) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 17 01:39:22 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:39:22 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:39:22 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[a07ddfed-b5af-4cb1-b7b1-811b8e6b34b9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:39:22 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:39:22 user nova-compute[75226]: DEBUG nova.compute.manager [req-ecb3bdd4-21fa-47be-b1d4-494a653db299 req-1de6db4d-5fc1-41c2-a441-620c4045538f service nova] [instance: d57f2553-feb4-49d8-a47b-dedbb4487f9e] Received event network-changed-c5f31505-49e5-4d1f-95c5-80847769e0b7 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:39:22 user nova-compute[75226]: DEBUG nova.compute.manager [req-ecb3bdd4-21fa-47be-b1d4-494a653db299 req-1de6db4d-5fc1-41c2-a441-620c4045538f service nova] [instance: d57f2553-feb4-49d8-a47b-dedbb4487f9e] Refreshing instance network info cache due to event network-changed-c5f31505-49e5-4d1f-95c5-80847769e0b7. {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 01:39:22 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-ecb3bdd4-21fa-47be-b1d4-494a653db299 req-1de6db4d-5fc1-41c2-a441-620c4045538f service nova] Acquiring lock "refresh_cache-d57f2553-feb4-49d8-a47b-dedbb4487f9e" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:39:22 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:39:22 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[f119cf7c-5cae-48d1-bc3c-9d3a5c70f0ee]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:39:22 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ebb2516-a6aa-4c95-b9db-b6e45a65aa7b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:39:22 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-ee875a85-b89d-47fe-8abf-0fde7e3cedc9 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] Running cmd (subprocess): nvme version {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:39:22 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-ee875a85-b89d-47fe-8abf-0fde7e3cedc9 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] 'nvme version' failed. Not Retrying. {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 01:39:22 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ee875a85-b89d-47fe-8abf-0fde7e3cedc9 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] nvme not present on system {{(pid=75226) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 17 01:39:22 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:39:22 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 01:39:22 user nova-compute[75226]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 17 01:39:22 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5d6949e-c1a7-48fc-8a20-537896b74b83]: (4, '') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:39:22 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-ee875a85-b89d-47fe-8abf-0fde7e3cedc9 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75226) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 17 01:39:22 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-ee875a85-b89d-47fe-8abf-0fde7e3cedc9 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75226) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 17 01:39:22 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-ee875a85-b89d-47fe-8abf-0fde7e3cedc9 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] LIGHTOS: no hostnqn found. {{(pid=75226) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 17 01:39:22 user nova-compute[75226]: DEBUG os_brick.utils [None req-ee875a85-b89d-47fe-8abf-0fde7e3cedc9 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f62857db69', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:39:22 user nova-compute[75226]: DEBUG nova.virt.block_device [None req-ee875a85-b89d-47fe-8abf-0fde7e3cedc9 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] [instance: d6d21784-2ebe-4a39-9ceb-f6607f02e3c4] Updating existing volume attachment record: 47561e7f-2129-4130-9358-6a812d6ef890 {{(pid=75226) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 17 01:39:23 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-dcd67311-7f00-4f77-a3bc-6ffbcb1e1ed9 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Acquiring lock "0597c05a-1049-4117-a8ae-8177d590e024" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:39:23 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-dcd67311-7f00-4f77-a3bc-6ffbcb1e1ed9 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Lock "0597c05a-1049-4117-a8ae-8177d590e024" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:39:23 user nova-compute[75226]: DEBUG nova.objects.instance [None req-dcd67311-7f00-4f77-a3bc-6ffbcb1e1ed9 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Lazy-loading 'flavor' on Instance uuid 0597c05a-1049-4117-a8ae-8177d590e024 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:39:23 user nova-compute[75226]: DEBUG nova.network.neutron [None req-f0de00e9-59cf-4080-b88d-2266b18c5fdd tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] [instance: d57f2553-feb4-49d8-a47b-dedbb4487f9e] Updating instance_info_cache with network_info: [{"id": "c5f31505-49e5-4d1f-95c5-80847769e0b7", "address": "fa:16:3e:04:d3:44", "network": {"id": "fe08b87c-6bf1-4842-a770-6522ba026ba4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1133747653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50f00bc826d34bbb8f2f93b550b7431a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5f31505-49", "ovs_interfaceid": "c5f31505-49e5-4d1f-95c5-80847769e0b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:39:23 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-f0de00e9-59cf-4080-b88d-2266b18c5fdd tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] Releasing lock "refresh_cache-d57f2553-feb4-49d8-a47b-dedbb4487f9e" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:39:23 user nova-compute[75226]: DEBUG nova.compute.manager [None req-f0de00e9-59cf-4080-b88d-2266b18c5fdd tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] [instance: d57f2553-feb4-49d8-a47b-dedbb4487f9e] Instance network_info: |[{"id": "c5f31505-49e5-4d1f-95c5-80847769e0b7", "address": "fa:16:3e:04:d3:44", "network": {"id": "fe08b87c-6bf1-4842-a770-6522ba026ba4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1133747653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50f00bc826d34bbb8f2f93b550b7431a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5f31505-49", "ovs_interfaceid": "c5f31505-49e5-4d1f-95c5-80847769e0b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75226) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 17 01:39:23 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-ecb3bdd4-21fa-47be-b1d4-494a653db299 req-1de6db4d-5fc1-41c2-a441-620c4045538f service nova] Acquired lock "refresh_cache-d57f2553-feb4-49d8-a47b-dedbb4487f9e" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:39:23 user nova-compute[75226]: DEBUG nova.network.neutron [req-ecb3bdd4-21fa-47be-b1d4-494a653db299 req-1de6db4d-5fc1-41c2-a441-620c4045538f service nova] [instance: d57f2553-feb4-49d8-a47b-dedbb4487f9e] Refreshing network info cache for port c5f31505-49e5-4d1f-95c5-80847769e0b7 {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 01:39:23 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-f0de00e9-59cf-4080-b88d-2266b18c5fdd tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] [instance: d57f2553-feb4-49d8-a47b-dedbb4487f9e] Start _get_guest_xml network_info=[{"id": "c5f31505-49e5-4d1f-95c5-80847769e0b7", "address": "fa:16:3e:04:d3:44", "network": {"id": "fe08b87c-6bf1-4842-a770-6522ba026ba4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1133747653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50f00bc826d34bbb8f2f93b550b7431a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5f31505-49", "ovs_interfaceid": "c5f31505-49e5-4d1f-95c5-80847769e0b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T01:13:22Z,direct_url=<?>,disk_format='qcow2',id=0b369aea-6f3f-4690-9f01-229b90ab6310,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4e110cbf9a84362a6864a7732c435a1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T01:13:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '0b369aea-6f3f-4690-9f01-229b90ab6310'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75226) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 17 01:39:23 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-dcd67311-7f00-4f77-a3bc-6ffbcb1e1ed9 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Lock "0597c05a-1049-4117-a8ae-8177d590e024" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:39:23 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-f0de00e9-59cf-4080-b88d-2266b18c5fdd tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:39:23 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-f0de00e9-59cf-4080-b88d-2266b18c5fdd tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:39:23 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-f0de00e9-59cf-4080-b88d-2266b18c5fdd tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75226) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 17 01:39:23 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-f0de00e9-59cf-4080-b88d-2266b18c5fdd tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] CPU controller missing on host. {{(pid=75226) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 17 01:39:23 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-f0de00e9-59cf-4080-b88d-2266b18c5fdd tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75226) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 17 01:39:23 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-f0de00e9-59cf-4080-b88d-2266b18c5fdd tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] CPU controller found on host. {{(pid=75226) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 17 01:39:23 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-f0de00e9-59cf-4080-b88d-2266b18c5fdd tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75226) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 17 01:39:23 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-f0de00e9-59cf-4080-b88d-2266b18c5fdd tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-17T01:13:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T01:13:22Z,direct_url=<?>,disk_format='qcow2',id=0b369aea-6f3f-4690-9f01-229b90ab6310,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4e110cbf9a84362a6864a7732c435a1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T01:13:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 17 01:39:23 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-f0de00e9-59cf-4080-b88d-2266b18c5fdd tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] Flavor limits 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 17 01:39:23 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-f0de00e9-59cf-4080-b88d-2266b18c5fdd tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] Image limits 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 17 01:39:23 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-f0de00e9-59cf-4080-b88d-2266b18c5fdd tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] Flavor pref 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 17 01:39:23 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-f0de00e9-59cf-4080-b88d-2266b18c5fdd tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] Image pref 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 17 01:39:23 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-f0de00e9-59cf-4080-b88d-2266b18c5fdd tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 17 01:39:23 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-f0de00e9-59cf-4080-b88d-2266b18c5fdd tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 17 01:39:23 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-f0de00e9-59cf-4080-b88d-2266b18c5fdd tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75226) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 17 01:39:23 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-f0de00e9-59cf-4080-b88d-2266b18c5fdd tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] Got 1 possible topologies {{(pid=75226) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 17 01:39:23 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-f0de00e9-59cf-4080-b88d-2266b18c5fdd tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 17 01:39:23 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-f0de00e9-59cf-4080-b88d-2266b18c5fdd tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 17 01:39:23 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-f0de00e9-59cf-4080-b88d-2266b18c5fdd tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:39:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-315353669',display_name='tempest-VolumesActionsTest-instance-315353669',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-315353669',id=39,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='50f00bc826d34bbb8f2f93b550b7431a',ramdisk_id='',reservation_id='r-hv96tpy0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1397730864',owner_user_name='tempest-VolumesActionsTest-1397730864-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T01:39:21Z,user_data=None,user_id='2aa9906ec44847448446b6fb94339028',uuid=d57f2553-feb4-49d8-a47b-dedbb4487f9e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c5f31505-49e5-4d1f-95c5-80847769e0b7", "address": "fa:16:3e:04:d3:44", "network": {"id": "fe08b87c-6bf1-4842-a770-6522ba026ba4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1133747653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50f00bc826d34bbb8f2f93b550b7431a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5f31505-49", "ovs_interfaceid": "c5f31505-49e5-4d1f-95c5-80847769e0b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75226) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 01:39:23 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-f0de00e9-59cf-4080-b88d-2266b18c5fdd tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] Converting VIF {"id": "c5f31505-49e5-4d1f-95c5-80847769e0b7", "address": "fa:16:3e:04:d3:44", "network": {"id": "fe08b87c-6bf1-4842-a770-6522ba026ba4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1133747653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50f00bc826d34bbb8f2f93b550b7431a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5f31505-49", "ovs_interfaceid": "c5f31505-49e5-4d1f-95c5-80847769e0b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:39:23 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-f0de00e9-59cf-4080-b88d-2266b18c5fdd tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:d3:44,bridge_name='br-int',has_traffic_filtering=True,id=c5f31505-49e5-4d1f-95c5-80847769e0b7,network=Network(fe08b87c-6bf1-4842-a770-6522ba026ba4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5f31505-49') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:39:23 user nova-compute[75226]: DEBUG nova.objects.instance [None req-f0de00e9-59cf-4080-b88d-2266b18c5fdd tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] Lazy-loading 'pci_devices' on Instance uuid d57f2553-feb4-49d8-a47b-dedbb4487f9e {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:39:23 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:39:23 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-f0de00e9-59cf-4080-b88d-2266b18c5fdd tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] [instance: d57f2553-feb4-49d8-a47b-dedbb4487f9e] End _get_guest_xml xml=<domain type="kvm">
Nov 17 01:39:23 user nova-compute[75226]:   <uuid>d57f2553-feb4-49d8-a47b-dedbb4487f9e</uuid>
Nov 17 01:39:23 user nova-compute[75226]:   <name>instance-00000027</name>
Nov 17 01:39:23 user nova-compute[75226]:   <memory>524288</memory>
Nov 17 01:39:23 user nova-compute[75226]:   <vcpu>1</vcpu>
Nov 17 01:39:23 user nova-compute[75226]:   <metadata>
Nov 17 01:39:23 user nova-compute[75226]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 17 01:39:23 user nova-compute[75226]:       <nova:package version="0.0.0"/>
Nov 17 01:39:23 user nova-compute[75226]:       <nova:name>tempest-VolumesActionsTest-instance-315353669</nova:name>
Nov 17 01:39:23 user nova-compute[75226]:       <nova:creationTime>2023-11-17 01:39:23</nova:creationTime>
Nov 17 01:39:23 user nova-compute[75226]:       <nova:flavor name="m1.tiny">
Nov 17 01:39:23 user nova-compute[75226]:         <nova:memory>512</nova:memory>
Nov 17 01:39:23 user nova-compute[75226]:         <nova:disk>1</nova:disk>
Nov 17 01:39:23 user nova-compute[75226]:         <nova:swap>0</nova:swap>
Nov 17 01:39:23 user nova-compute[75226]:         <nova:ephemeral>0</nova:ephemeral>
Nov 17 01:39:23 user nova-compute[75226]:         <nova:vcpus>1</nova:vcpus>
Nov 17 01:39:23 user nova-compute[75226]:       </nova:flavor>
Nov 17 01:39:23 user nova-compute[75226]:       <nova:owner>
Nov 17 01:39:23 user nova-compute[75226]:         <nova:user uuid="2aa9906ec44847448446b6fb94339028">tempest-VolumesActionsTest-1397730864-project-member</nova:user>
Nov 17 01:39:23 user nova-compute[75226]:         <nova:project uuid="50f00bc826d34bbb8f2f93b550b7431a">tempest-VolumesActionsTest-1397730864</nova:project>
Nov 17 01:39:23 user nova-compute[75226]:       </nova:owner>
Nov 17 01:39:23 user nova-compute[75226]:       <nova:root type="image" uuid="0b369aea-6f3f-4690-9f01-229b90ab6310"/>
Nov 17 01:39:23 user nova-compute[75226]:       <nova:ports>
Nov 17 01:39:23 user nova-compute[75226]:         <nova:port uuid="c5f31505-49e5-4d1f-95c5-80847769e0b7">
Nov 17 01:39:23 user nova-compute[75226]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 17 01:39:23 user nova-compute[75226]:         </nova:port>
Nov 17 01:39:23 user nova-compute[75226]:       </nova:ports>
Nov 17 01:39:23 user nova-compute[75226]:     </nova:instance>
Nov 17 01:39:23 user nova-compute[75226]:   </metadata>
Nov 17 01:39:23 user nova-compute[75226]:   <sysinfo type="smbios">
Nov 17 01:39:23 user nova-compute[75226]:     <system>
Nov 17 01:39:23 user nova-compute[75226]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 17 01:39:23 user nova-compute[75226]:       <entry name="product">OpenStack Nova</entry>
Nov 17 01:39:23 user nova-compute[75226]:       <entry name="version">0.0.0</entry>
Nov 17 01:39:23 user nova-compute[75226]:       <entry name="serial">d57f2553-feb4-49d8-a47b-dedbb4487f9e</entry>
Nov 17 01:39:23 user nova-compute[75226]:       <entry name="uuid">d57f2553-feb4-49d8-a47b-dedbb4487f9e</entry>
Nov 17 01:39:23 user nova-compute[75226]:       <entry name="family">Virtual Machine</entry>
Nov 17 01:39:23 user nova-compute[75226]:     </system>
Nov 17 01:39:23 user nova-compute[75226]:   </sysinfo>
Nov 17 01:39:23 user nova-compute[75226]:   <os>
Nov 17 01:39:23 user nova-compute[75226]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 17 01:39:23 user nova-compute[75226]:     <boot dev="hd"/>
Nov 17 01:39:23 user nova-compute[75226]:     <smbios mode="sysinfo"/>
Nov 17 01:39:23 user nova-compute[75226]:   </os>
Nov 17 01:39:23 user nova-compute[75226]:   <features>
Nov 17 01:39:23 user nova-compute[75226]:     <acpi/>
Nov 17 01:39:23 user nova-compute[75226]:     <apic/>
Nov 17 01:39:23 user nova-compute[75226]:     <vmcoreinfo/>
Nov 17 01:39:23 user nova-compute[75226]:   </features>
Nov 17 01:39:23 user nova-compute[75226]:   <clock offset="utc">
Nov 17 01:39:23 user nova-compute[75226]:     <timer name="pit" tickpolicy="delay"/>
Nov 17 01:39:23 user nova-compute[75226]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 17 01:39:23 user nova-compute[75226]:     <timer name="hpet" present="no"/>
Nov 17 01:39:23 user nova-compute[75226]:   </clock>
Nov 17 01:39:23 user nova-compute[75226]:   <cpu mode="custom" match="exact">
Nov 17 01:39:23 user nova-compute[75226]:     <model>Nehalem</model>
Nov 17 01:39:23 user nova-compute[75226]:     <topology sockets="1" cores="1" threads="1"/>
Nov 17 01:39:23 user nova-compute[75226]:   </cpu>
Nov 17 01:39:23 user nova-compute[75226]:   <devices>
Nov 17 01:39:23 user nova-compute[75226]:     <disk type="file" device="disk">
Nov 17 01:39:23 user nova-compute[75226]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 17 01:39:23 user nova-compute[75226]:       <source file="/opt/stack/data/nova/instances/d57f2553-feb4-49d8-a47b-dedbb4487f9e/disk"/>
Nov 17 01:39:23 user nova-compute[75226]:       <target dev="vda" bus="virtio"/>
Nov 17 01:39:23 user nova-compute[75226]:     </disk>
Nov 17 01:39:23 user nova-compute[75226]:     <interface type="ethernet">
Nov 17 01:39:23 user nova-compute[75226]:       <mac address="fa:16:3e:04:d3:44"/>
Nov 17 01:39:23 user nova-compute[75226]:       <model type="virtio"/>
Nov 17 01:39:23 user nova-compute[75226]:       <mtu size="1442"/>
Nov 17 01:39:23 user nova-compute[75226]:       <target dev="tapc5f31505-49"/>
Nov 17 01:39:23 user nova-compute[75226]:     </interface>
Nov 17 01:39:23 user nova-compute[75226]:     <serial type="pty">
Nov 17 01:39:23 user nova-compute[75226]:       <log file="/opt/stack/data/nova/instances/d57f2553-feb4-49d8-a47b-dedbb4487f9e/console.log" append="off"/>
Nov 17 01:39:23 user nova-compute[75226]:     </serial>
Nov 17 01:39:23 user nova-compute[75226]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 17 01:39:23 user nova-compute[75226]:     <video>
Nov 17 01:39:23 user nova-compute[75226]:       <model type="virtio"/>
Nov 17 01:39:23 user nova-compute[75226]:     </video>
Nov 17 01:39:23 user nova-compute[75226]:     <rng model="virtio">
Nov 17 01:39:23 user nova-compute[75226]:       <backend model="random">/dev/urandom</backend>
Nov 17 01:39:23 user nova-compute[75226]:     </rng>
Nov 17 01:39:23 user nova-compute[75226]:     <controller type="usb" index="0" model="none"/>
Nov 17 01:39:23 user nova-compute[75226]:     <memballoon model="virtio">
Nov 17 01:39:23 user nova-compute[75226]:       <stats period="10"/>
Nov 17 01:39:23 user nova-compute[75226]:     </memballoon>
Nov 17 01:39:23 user nova-compute[75226]:   </devices>
Nov 17 01:39:23 user nova-compute[75226]: </domain>
Nov 17 01:39:23 user nova-compute[75226]:  {{(pid=75226) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 17 01:39:23 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-f0de00e9-59cf-4080-b88d-2266b18c5fdd tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:39:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-315353669',display_name='tempest-VolumesActionsTest-instance-315353669',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-315353669',id=39,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='50f00bc826d34bbb8f2f93b550b7431a',ramdisk_id='',reservation_id='r-hv96tpy0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1397730864',owner_user_name='tempest-VolumesActionsTest-1397730864-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T01:39:21Z,user_data=None,user_id='2aa9906ec44847448446b6fb94339028',uuid=d57f2553-feb4-49d8-a47b-dedbb4487f9e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c5f31505-49e5-4d1f-95c5-80847769e0b7", "address": "fa:16:3e:04:d3:44", "network": {"id": "fe08b87c-6bf1-4842-a770-6522ba026ba4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1133747653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50f00bc826d34bbb8f2f93b550b7431a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5f31505-49", "ovs_interfaceid": "c5f31505-49e5-4d1f-95c5-80847769e0b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 17 01:39:23 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-f0de00e9-59cf-4080-b88d-2266b18c5fdd tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] Converting VIF {"id": "c5f31505-49e5-4d1f-95c5-80847769e0b7", "address": "fa:16:3e:04:d3:44", "network": {"id": "fe08b87c-6bf1-4842-a770-6522ba026ba4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1133747653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50f00bc826d34bbb8f2f93b550b7431a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5f31505-49", "ovs_interfaceid": "c5f31505-49e5-4d1f-95c5-80847769e0b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:39:23 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-f0de00e9-59cf-4080-b88d-2266b18c5fdd tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:d3:44,bridge_name='br-int',has_traffic_filtering=True,id=c5f31505-49e5-4d1f-95c5-80847769e0b7,network=Network(fe08b87c-6bf1-4842-a770-6522ba026ba4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5f31505-49') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:39:23 user nova-compute[75226]: DEBUG os_vif [None req-f0de00e9-59cf-4080-b88d-2266b18c5fdd tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:d3:44,bridge_name='br-int',has_traffic_filtering=True,id=c5f31505-49e5-4d1f-95c5-80847769e0b7,network=Network(fe08b87c-6bf1-4842-a770-6522ba026ba4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5f31505-49') {{(pid=75226) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 17 01:39:23 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:39:23 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:39:23 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 17 01:39:23 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:39:23 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b327ee92-fb2e-583c-9c2f-f71d79d5ad48', '_type': 'linux-noop'}}, row=False) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:39:23 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:39:23 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:39:23 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:39:23 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc5f31505-49, may_exist=True, interface_attrs={}) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:39:23 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc5f31505-49, col_values=(('qos', UUID('7881ecfc-6e51-4994-8db0-eabb605e83ea')),), if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:39:23 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc5f31505-49, col_values=(('external_ids', {'iface-id': 'c5f31505-49e5-4d1f-95c5-80847769e0b7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:04:d3:44', 'vm-uuid': 'd57f2553-feb4-49d8-a47b-dedbb4487f9e'}),), if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:39:23 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:39:23 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:39:23 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:39:23 user nova-compute[75226]: INFO os_vif [None req-f0de00e9-59cf-4080-b88d-2266b18c5fdd tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:d3:44,bridge_name='br-int',has_traffic_filtering=True,id=c5f31505-49e5-4d1f-95c5-80847769e0b7,network=Network(fe08b87c-6bf1-4842-a770-6522ba026ba4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5f31505-49')
Nov 17 01:39:23 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-dcd67311-7f00-4f77-a3bc-6ffbcb1e1ed9 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Acquiring lock "0597c05a-1049-4117-a8ae-8177d590e024" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:39:23 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-dcd67311-7f00-4f77-a3bc-6ffbcb1e1ed9 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Lock "0597c05a-1049-4117-a8ae-8177d590e024" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:39:23 user nova-compute[75226]: INFO nova.compute.manager [None req-dcd67311-7f00-4f77-a3bc-6ffbcb1e1ed9 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] [instance: 0597c05a-1049-4117-a8ae-8177d590e024] Attaching volume 8533a134-db8d-4602-84e0-cf4c2fd4dd30 to /dev/vdb
Nov 17 01:39:23 user nova-compute[75226]: DEBUG nova.network.neutron [req-61970c2d-59c9-4765-8588-7cdfae0d9072 req-02374405-37f4-469e-9c43-36d691ec0973 service nova] [instance: 0597c05a-1049-4117-a8ae-8177d590e024] Updated VIF entry in instance network info cache for port e8a7ded4-d849-40ce-a0a9-ecf66e146e56. {{(pid=75226) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 01:39:23 user nova-compute[75226]: DEBUG nova.network.neutron [req-61970c2d-59c9-4765-8588-7cdfae0d9072 req-02374405-37f4-469e-9c43-36d691ec0973 service nova] [instance: 0597c05a-1049-4117-a8ae-8177d590e024] Updating instance_info_cache with network_info: [{"id": "e8a7ded4-d849-40ce-a0a9-ecf66e146e56", "address": "fa:16:3e:6d:db:0b", "network": {"id": "b6c26fa5-eacc-41d3-b790-795e59c84966", "bridge": "br-int", "label": "tempest-TestStampPattern-2002555642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8046d4519e4b4f0b864f9ea10a4886fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8a7ded4-d8", "ovs_interfaceid": "e8a7ded4-d849-40ce-a0a9-ecf66e146e56", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:39:23 user nova-compute[75226]: DEBUG os_brick.utils [None req-dcd67311-7f00-4f77-a3bc-6ffbcb1e1ed9 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:39:23 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:39:23 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-f0de00e9-59cf-4080-b88d-2266b18c5fdd tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] No BDM found with device name vda, not building metadata. {{(pid=75226) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 01:39:23 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-f0de00e9-59cf-4080-b88d-2266b18c5fdd tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] No VIF found with MAC fa:16:3e:04:d3:44, not building metadata {{(pid=75226) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 01:39:23 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.031s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:39:23 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d4f09ad-6f2f-4377-881c-03bb73739293]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f62857db69\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:39:23 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-61970c2d-59c9-4765-8588-7cdfae0d9072 req-02374405-37f4-469e-9c43-36d691ec0973 service nova] Releasing lock "refresh_cache-0597c05a-1049-4117-a8ae-8177d590e024" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:39:23 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:39:23 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:39:23 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cf49c10-4a93-41e8-8cb3-133b2c33467e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:39:23 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:39:23 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:39:23 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cb89732-409e-49a2-b699-35eb8014fb65]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:39:23 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[c813a4aa-77b4-4f6c-890b-344e3bf1ef91]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:39:23 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-dcd67311-7f00-4f77-a3bc-6ffbcb1e1ed9 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Running cmd (subprocess): nvme version {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:39:23 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-dcd67311-7f00-4f77-a3bc-6ffbcb1e1ed9 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] 'nvme version' failed. Not Retrying. {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 01:39:23 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dcd67311-7f00-4f77-a3bc-6ffbcb1e1ed9 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] nvme not present on system {{(pid=75226) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 17 01:39:23 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:39:23 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 01:39:23 user nova-compute[75226]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 17 01:39:23 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[e86c900d-bbe3-4f7c-b561-8eb320f67dbc]: (4, '') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:39:23 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-dcd67311-7f00-4f77-a3bc-6ffbcb1e1ed9 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75226) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 17 01:39:23 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-dcd67311-7f00-4f77-a3bc-6ffbcb1e1ed9 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75226) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 17 01:39:23 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-dcd67311-7f00-4f77-a3bc-6ffbcb1e1ed9 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] LIGHTOS: no hostnqn found. {{(pid=75226) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 17 01:39:23 user nova-compute[75226]: DEBUG os_brick.utils [None req-dcd67311-7f00-4f77-a3bc-6ffbcb1e1ed9 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] <== get_connector_properties: return (150ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f62857db69', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:39:23 user nova-compute[75226]: DEBUG nova.virt.block_device [None req-dcd67311-7f00-4f77-a3bc-6ffbcb1e1ed9 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] [instance: 0597c05a-1049-4117-a8ae-8177d590e024] Updating existing volume attachment record: 039bbdec-6db8-494c-a5e3-2f2292dc63e6 {{(pid=75226) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 17 01:39:23 user nova-compute[75226]: DEBUG nova.network.neutron [req-ecb3bdd4-21fa-47be-b1d4-494a653db299 req-1de6db4d-5fc1-41c2-a441-620c4045538f service nova] [instance: d57f2553-feb4-49d8-a47b-dedbb4487f9e] Updated VIF entry in instance network info cache for port c5f31505-49e5-4d1f-95c5-80847769e0b7. {{(pid=75226) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 01:39:23 user nova-compute[75226]: DEBUG nova.network.neutron [req-ecb3bdd4-21fa-47be-b1d4-494a653db299 req-1de6db4d-5fc1-41c2-a441-620c4045538f service nova] [instance: d57f2553-feb4-49d8-a47b-dedbb4487f9e] Updating instance_info_cache with network_info: [{"id": "c5f31505-49e5-4d1f-95c5-80847769e0b7", "address": "fa:16:3e:04:d3:44", "network": {"id": "fe08b87c-6bf1-4842-a770-6522ba026ba4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1133747653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50f00bc826d34bbb8f2f93b550b7431a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5f31505-49", "ovs_interfaceid": "c5f31505-49e5-4d1f-95c5-80847769e0b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:39:23 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-ecb3bdd4-21fa-47be-b1d4-494a653db299 req-1de6db4d-5fc1-41c2-a441-620c4045538f service nova] Releasing lock "refresh_cache-d57f2553-feb4-49d8-a47b-dedbb4487f9e" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:39:24 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:39:24 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:39:24 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:39:24 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:39:24 user nova-compute[75226]: DEBUG nova.compute.manager [req-baaa646f-03bf-4a48-a5e8-a52eca53be9e req-2be1cc58-3384-4472-8b58-d8c628e722cb service nova] [instance: 8c4a9724-533e-40c8-ab2a-ce3415af240a] Received event network-changed-e30eaa7a-30df-48f5-b8de-30da75d74972 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:39:24 user nova-compute[75226]: DEBUG nova.compute.manager [req-baaa646f-03bf-4a48-a5e8-a52eca53be9e req-2be1cc58-3384-4472-8b58-d8c628e722cb service nova] [instance: 8c4a9724-533e-40c8-ab2a-ce3415af240a] Refreshing instance network info cache due to event network-changed-e30eaa7a-30df-48f5-b8de-30da75d74972. {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 01:39:24 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-baaa646f-03bf-4a48-a5e8-a52eca53be9e req-2be1cc58-3384-4472-8b58-d8c628e722cb service nova] Acquiring lock "refresh_cache-8c4a9724-533e-40c8-ab2a-ce3415af240a" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:39:24 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-baaa646f-03bf-4a48-a5e8-a52eca53be9e req-2be1cc58-3384-4472-8b58-d8c628e722cb service nova] Acquired lock "refresh_cache-8c4a9724-533e-40c8-ab2a-ce3415af240a" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:39:24 user nova-compute[75226]: DEBUG nova.network.neutron [req-baaa646f-03bf-4a48-a5e8-a52eca53be9e req-2be1cc58-3384-4472-8b58-d8c628e722cb service nova] [instance: 8c4a9724-533e-40c8-ab2a-ce3415af240a] Refreshing network info cache for port e30eaa7a-30df-48f5-b8de-30da75d74972 {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 01:39:25 user nova-compute[75226]: DEBUG nova.compute.manager [req-65c5d883-3513-4ca5-b9be-29651d2d37b9 req-f84e05ce-7357-4b95-a575-2b7d669128b3 service nova] [instance: d57f2553-feb4-49d8-a47b-dedbb4487f9e] Received event network-vif-plugged-c5f31505-49e5-4d1f-95c5-80847769e0b7 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:39:25 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-65c5d883-3513-4ca5-b9be-29651d2d37b9 req-f84e05ce-7357-4b95-a575-2b7d669128b3 service nova] Acquiring lock "d57f2553-feb4-49d8-a47b-dedbb4487f9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:39:25 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-65c5d883-3513-4ca5-b9be-29651d2d37b9 req-f84e05ce-7357-4b95-a575-2b7d669128b3 service nova] Lock "d57f2553-feb4-49d8-a47b-dedbb4487f9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:39:25 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-65c5d883-3513-4ca5-b9be-29651d2d37b9 req-f84e05ce-7357-4b95-a575-2b7d669128b3 service nova] Lock "d57f2553-feb4-49d8-a47b-dedbb4487f9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:39:25 user nova-compute[75226]: DEBUG nova.compute.manager [req-65c5d883-3513-4ca5-b9be-29651d2d37b9 req-f84e05ce-7357-4b95-a575-2b7d669128b3 service nova] [instance: d57f2553-feb4-49d8-a47b-dedbb4487f9e] No waiting events found dispatching network-vif-plugged-c5f31505-49e5-4d1f-95c5-80847769e0b7 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:39:25 user nova-compute[75226]: WARNING nova.compute.manager [req-65c5d883-3513-4ca5-b9be-29651d2d37b9 req-f84e05ce-7357-4b95-a575-2b7d669128b3 service nova] [instance: d57f2553-feb4-49d8-a47b-dedbb4487f9e] Received unexpected event network-vif-plugged-c5f31505-49e5-4d1f-95c5-80847769e0b7 for instance with vm_state building and task_state spawning.
Nov 17 01:39:25 user nova-compute[75226]: DEBUG nova.network.neutron [req-baaa646f-03bf-4a48-a5e8-a52eca53be9e req-2be1cc58-3384-4472-8b58-d8c628e722cb service nova] [instance: 8c4a9724-533e-40c8-ab2a-ce3415af240a] Updated VIF entry in instance network info cache for port e30eaa7a-30df-48f5-b8de-30da75d74972. {{(pid=75226) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 01:39:25 user nova-compute[75226]: DEBUG nova.network.neutron [req-baaa646f-03bf-4a48-a5e8-a52eca53be9e req-2be1cc58-3384-4472-8b58-d8c628e722cb service nova] [instance: 8c4a9724-533e-40c8-ab2a-ce3415af240a] Updating instance_info_cache with network_info: [{"id": "e30eaa7a-30df-48f5-b8de-30da75d74972", "address": "fa:16:3e:f6:83:b8", "network": {"id": "44f50686-24e7-4e75-8269-4391a53286d0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1611114801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33699aa6c9db4815a1e79aff4685801e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape30eaa7a-30", "ovs_interfaceid": "e30eaa7a-30df-48f5-b8de-30da75d74972", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:39:25 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-baaa646f-03bf-4a48-a5e8-a52eca53be9e req-2be1cc58-3384-4472-8b58-d8c628e722cb service nova] Releasing lock "refresh_cache-8c4a9724-533e-40c8-ab2a-ce3415af240a" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:39:25 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:39:25 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:39:25 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:39:25 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:39:27 user nova-compute[75226]: DEBUG nova.compute.manager [None req-f0de00e9-59cf-4080-b88d-2266b18c5fdd tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] [instance: d57f2553-feb4-49d8-a47b-dedbb4487f9e] Instance event wait completed in 0 seconds for  {{(pid=75226) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 17 01:39:27 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-f0de00e9-59cf-4080-b88d-2266b18c5fdd tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] [instance: d57f2553-feb4-49d8-a47b-dedbb4487f9e] Guest created on hypervisor {{(pid=75226) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 17 01:39:27 user nova-compute[75226]: INFO nova.virt.libvirt.driver [-] [instance: d57f2553-feb4-49d8-a47b-dedbb4487f9e] Instance spawned successfully.
Nov 17 01:39:27 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-f0de00e9-59cf-4080-b88d-2266b18c5fdd tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] [instance: d57f2553-feb4-49d8-a47b-dedbb4487f9e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 17 01:39:27 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-f0de00e9-59cf-4080-b88d-2266b18c5fdd tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] [instance: d57f2553-feb4-49d8-a47b-dedbb4487f9e] Found default for hw_cdrom_bus of ide {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:39:27 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-f0de00e9-59cf-4080-b88d-2266b18c5fdd tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] [instance: d57f2553-feb4-49d8-a47b-dedbb4487f9e] Found default for hw_disk_bus of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:39:27 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-f0de00e9-59cf-4080-b88d-2266b18c5fdd tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] [instance: d57f2553-feb4-49d8-a47b-dedbb4487f9e] Found default for hw_input_bus of None {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:39:27 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-f0de00e9-59cf-4080-b88d-2266b18c5fdd tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] [instance: d57f2553-feb4-49d8-a47b-dedbb4487f9e] Found default for hw_pointer_model of None {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:39:27 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-f0de00e9-59cf-4080-b88d-2266b18c5fdd tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] [instance: d57f2553-feb4-49d8-a47b-dedbb4487f9e] Found default for hw_video_model of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:39:27 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-f0de00e9-59cf-4080-b88d-2266b18c5fdd tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] [instance: d57f2553-feb4-49d8-a47b-dedbb4487f9e] Found default for hw_vif_model of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:39:27 user nova-compute[75226]: DEBUG nova.compute.manager [req-b302fff4-2375-4c45-bbb3-7fc07ba7341d req-3172d1ea-4546-4d1c-bd0a-907766516ea9 service nova] [instance: d57f2553-feb4-49d8-a47b-dedbb4487f9e] Received event network-vif-plugged-c5f31505-49e5-4d1f-95c5-80847769e0b7 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:39:27 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-b302fff4-2375-4c45-bbb3-7fc07ba7341d req-3172d1ea-4546-4d1c-bd0a-907766516ea9 service nova] Acquiring lock "d57f2553-feb4-49d8-a47b-dedbb4487f9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:39:27 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-b302fff4-2375-4c45-bbb3-7fc07ba7341d req-3172d1ea-4546-4d1c-bd0a-907766516ea9 service nova] Lock "d57f2553-feb4-49d8-a47b-dedbb4487f9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:39:27 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-b302fff4-2375-4c45-bbb3-7fc07ba7341d req-3172d1ea-4546-4d1c-bd0a-907766516ea9 service nova] Lock "d57f2553-feb4-49d8-a47b-dedbb4487f9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:39:27 user nova-compute[75226]: DEBUG nova.compute.manager [req-b302fff4-2375-4c45-bbb3-7fc07ba7341d req-3172d1ea-4546-4d1c-bd0a-907766516ea9 service nova] [instance: d57f2553-feb4-49d8-a47b-dedbb4487f9e] No waiting events found dispatching network-vif-plugged-c5f31505-49e5-4d1f-95c5-80847769e0b7 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:39:27 user nova-compute[75226]: WARNING nova.compute.manager [req-b302fff4-2375-4c45-bbb3-7fc07ba7341d req-3172d1ea-4546-4d1c-bd0a-907766516ea9 service nova] [instance: d57f2553-feb4-49d8-a47b-dedbb4487f9e] Received unexpected event network-vif-plugged-c5f31505-49e5-4d1f-95c5-80847769e0b7 for instance with vm_state building and task_state spawning.
Nov 17 01:39:27 user nova-compute[75226]: INFO nova.compute.manager [None req-f0de00e9-59cf-4080-b88d-2266b18c5fdd tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] [instance: d57f2553-feb4-49d8-a47b-dedbb4487f9e] Took 6.14 seconds to spawn the instance on the hypervisor.
Nov 17 01:39:27 user nova-compute[75226]: DEBUG nova.compute.manager [None req-f0de00e9-59cf-4080-b88d-2266b18c5fdd tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] [instance: d57f2553-feb4-49d8-a47b-dedbb4487f9e] Checking state {{(pid=75226) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 01:39:27 user nova-compute[75226]: INFO nova.compute.manager [None req-f0de00e9-59cf-4080-b88d-2266b18c5fdd tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] [instance: d57f2553-feb4-49d8-a47b-dedbb4487f9e] Took 7.02 seconds to build instance.
Nov 17 01:39:27 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-f0de00e9-59cf-4080-b88d-2266b18c5fdd tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] Lock "d57f2553-feb4-49d8-a47b-dedbb4487f9e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.109s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:39:28 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:39:28 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:39:28 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-3b0747da-aa80-42f0-9a07-9e99be281883 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Acquiring lock "8c4a9724-533e-40c8-ab2a-ce3415af240a" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:39:28 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-3b0747da-aa80-42f0-9a07-9e99be281883 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Lock "8c4a9724-533e-40c8-ab2a-ce3415af240a" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:39:28 user nova-compute[75226]: INFO nova.compute.manager [None req-3b0747da-aa80-42f0-9a07-9e99be281883 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] [instance: 8c4a9724-533e-40c8-ab2a-ce3415af240a] Rebooting instance
Nov 17 01:39:28 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-3b0747da-aa80-42f0-9a07-9e99be281883 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Acquiring lock "refresh_cache-8c4a9724-533e-40c8-ab2a-ce3415af240a" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:39:28 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-3b0747da-aa80-42f0-9a07-9e99be281883 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Acquired lock "refresh_cache-8c4a9724-533e-40c8-ab2a-ce3415af240a" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:39:28 user nova-compute[75226]: DEBUG nova.network.neutron [None req-3b0747da-aa80-42f0-9a07-9e99be281883 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] [instance: 8c4a9724-533e-40c8-ab2a-ce3415af240a] Building network info cache for instance {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 01:39:28 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ee875a85-b89d-47fe-8abf-0fde7e3cedc9 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] [instance: d6d21784-2ebe-4a39-9ceb-f6607f02e3c4] Calling os-brick to attach iSCSI Volume {{(pid=75226) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 17 01:39:28 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee875a85-b89d-47fe-8abf-0fde7e3cedc9 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc4cc36b490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a17c9b1e-9d6c-44b4-8c8a-c4b152e806d7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WoFEvqxr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:39:28 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-ee875a85-b89d-47fe-8abf-0fde7e3cedc9 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:39:28 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-ee875a85-b89d-47fe-8abf-0fde7e3cedc9 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:39:28 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-ee875a85-b89d-47fe-8abf-0fde7e3cedc9 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:39:28 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-ee875a85-b89d-47fe-8abf-0fde7e3cedc9 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:39:28 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-ee875a85-b89d-47fe-8abf-0fde7e3cedc9 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a17c9b1e-9d6c-44b4-8c8a-c4b152e806d7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:39:28 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-ee875a85-b89d-47fe-8abf-0fde7e3cedc9 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a17c9b1e-9d6c-44b4-8c8a-c4b152e806d7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:39:28 user nova-compute[75226]: INFO os_brick.initiator.connectors.iscsi [None req-ee875a85-b89d-47fe-8abf-0fde7e3cedc9 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 17 01:39:28 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a17c9b1e-9d6c-44b4-8c8a-c4b152e806d7 -p 172.16.0.220:3260 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:39:28 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a17c9b1e-9d6c-44b4-8c8a-c4b152e806d7 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:39:28 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[e30a68e2-08c8-41ba-bdc4-694734a6341e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:39:28 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee875a85-b89d-47fe-8abf-0fde7e3cedc9 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 17 01:39:28 user nova-compute[75226]:  {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:39:28 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a17c9b1e-9d6c-44b4-8c8a-c4b152e806d7 -p 172.16.0.220:3260 --interface default --op new {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:39:28 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a17c9b1e-9d6c-44b4-8c8a-c4b152e806d7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:39:28 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[c081325c-7cac-4ef3-8788-c4d67148bf79]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a17c9b1e-9d6c-44b4-8c8a-c4b152e806d7] added\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:39:28 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee875a85-b89d-47fe-8abf-0fde7e3cedc9 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a17c9b1e-9d6c-44b4-8c8a-c4b152e806d7] added
Nov 17 01:39:28 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:39:28 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a17c9b1e-9d6c-44b4-8c8a-c4b152e806d7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:39:28 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a17c9b1e-9d6c-44b4-8c8a-c4b152e806d7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:39:28 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4713121-39e1-4796-909a-8fa996751f90]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:39:28 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee875a85-b89d-47fe-8abf-0fde7e3cedc9 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:39:28 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a17c9b1e-9d6c-44b4-8c8a-c4b152e806d7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:39:29 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a17c9b1e-9d6c-44b4-8c8a-c4b152e806d7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:39:29 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba4e74f6-7fce-4021-8781-37861a410409]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:39:29 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee875a85-b89d-47fe-8abf-0fde7e3cedc9 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:39:29 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a17c9b1e-9d6c-44b4-8c8a-c4b152e806d7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WoFEvqxr {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:39:29 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a17c9b1e-9d6c-44b4-8c8a-c4b152e806d7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WoFEvqxr" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:39:29 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[0202f734-d9a2-4d01-8230-5849e5eb53fd]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:39:29 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee875a85-b89d-47fe-8abf-0fde7e3cedc9 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WoFEvqxr'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:39:29 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a17c9b1e-9d6c-44b4-8c8a-c4b152e806d7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:39:29 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a17c9b1e-9d6c-44b4-8c8a-c4b152e806d7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:39:29 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dd37361-8886-4918-9953-2eb2a58db212]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:39:29 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee875a85-b89d-47fe-8abf-0fde7e3cedc9 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:39:29 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:39:29 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:39:29 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[093d15c8-aa45-4f6e-bda7-12f820836eb5]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bb94c67-f3ce-4642-8f8d-3c59a63802ac (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42287bb8-179a-4f5d-adc3-ab6e03ef12dd (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afbcbbf4-d90c-4224-869f-904342190f6c (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:39:29 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee875a85-b89d-47fe-8abf-0fde7e3cedc9 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419 (non-flash)
Nov 17 01:39:29 user nova-compute[75226]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bb94c67-f3ce-4642-8f8d-3c59a63802ac (non-flash)
Nov 17 01:39:29 user nova-compute[75226]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42287bb8-179a-4f5d-adc3-ab6e03ef12dd (non-flash)
Nov 17 01:39:29 user nova-compute[75226]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afbcbbf4-d90c-4224-869f-904342190f6c (non-flash)
Nov 17 01:39:29 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:39:29 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee875a85-b89d-47fe-8abf-0fde7e3cedc9 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419 (non-flash)
Nov 17 01:39:29 user nova-compute[75226]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bb94c67-f3ce-4642-8f8d-3c59a63802ac (non-flash)
Nov 17 01:39:29 user nova-compute[75226]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42287bb8-179a-4f5d-adc3-ab6e03ef12dd (non-flash)
Nov 17 01:39:29 user nova-compute[75226]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afbcbbf4-d90c-4224-869f-904342190f6c (non-flash)
Nov 17 01:39:29 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:39:29 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a17c9b1e-9d6c-44b4-8c8a-c4b152e806d7 -p 172.16.0.220:3260 --login {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:39:29 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a17c9b1e-9d6c-44b4-8c8a-c4b152e806d7 -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:39:29 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[11227794-485f-4e4e-91ef-282a96fa4be3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a17c9b1e-9d6c-44b4-8c8a-c4b152e806d7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a17c9b1e-9d6c-44b4-8c8a-c4b152e806d7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:39:29 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee875a85-b89d-47fe-8abf-0fde7e3cedc9 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a17c9b1e-9d6c-44b4-8c8a-c4b152e806d7, portal: 172.16.0.220,3260]
Nov 17 01:39:29 user nova-compute[75226]: Login to [iface: default, target: iqn.2010-10.org.openstack:a17c9b1e-9d6c-44b4-8c8a-c4b152e806d7, portal: 172.16.0.220,3260] successful.
Nov 17 01:39:29 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:39:29 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a17c9b1e-9d6c-44b4-8c8a-c4b152e806d7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:39:29 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a17c9b1e-9d6c-44b4-8c8a-c4b152e806d7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:39:29 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[0354f055-e610-4b2c-bbf4-b4e2b0fa069a]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:39:29 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee875a85-b89d-47fe-8abf-0fde7e3cedc9 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:39:29 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:39:29 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:39:29 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7ec0b49-e656-4a6d-9bf3-8d7f707d2d2b]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bb94c67-f3ce-4642-8f8d-3c59a63802ac (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42287bb8-179a-4f5d-adc3-ab6e03ef12dd (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afbcbbf4-d90c-4224-869f-904342190f6c (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a17c9b1e-9d6c-44b4-8c8a-c4b152e806d7 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:39:29 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee875a85-b89d-47fe-8abf-0fde7e3cedc9 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419 (non-flash)
Nov 17 01:39:29 user nova-compute[75226]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bb94c67-f3ce-4642-8f8d-3c59a63802ac (non-flash)
Nov 17 01:39:29 user nova-compute[75226]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42287bb8-179a-4f5d-adc3-ab6e03ef12dd (non-flash)
Nov 17 01:39:29 user nova-compute[75226]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afbcbbf4-d90c-4224-869f-904342190f6c (non-flash)
Nov 17 01:39:29 user nova-compute[75226]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a17c9b1e-9d6c-44b4-8c8a-c4b152e806d7 (non-flash)
Nov 17 01:39:29 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:39:29 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee875a85-b89d-47fe-8abf-0fde7e3cedc9 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419 (non-flash)
Nov 17 01:39:29 user nova-compute[75226]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bb94c67-f3ce-4642-8f8d-3c59a63802ac (non-flash)
Nov 17 01:39:29 user nova-compute[75226]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42287bb8-179a-4f5d-adc3-ab6e03ef12dd (non-flash)
Nov 17 01:39:29 user nova-compute[75226]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afbcbbf4-d90c-4224-869f-904342190f6c (non-flash)
Nov 17 01:39:29 user nova-compute[75226]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a17c9b1e-9d6c-44b4-8c8a-c4b152e806d7 (non-flash)
Nov 17 01:39:29 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:39:29 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-ee875a85-b89d-47fe-8abf-0fde7e3cedc9 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a17c9b1e-9d6c-44b4-8c8a-c4b152e806d7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.318s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:39:29 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee875a85-b89d-47fe-8abf-0fde7e3cedc9 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] Connected to 172.16.0.220:3260 {{(pid=75226) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 17 01:39:29 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-ee875a85-b89d-47fe-8abf-0fde7e3cedc9 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] HCTL ('37', '-', '-', 0) found on session 46 with lun 0 {{(pid=75226) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 17 01:39:29 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-ee875a85-b89d-47fe-8abf-0fde7e3cedc9 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75226) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 17 01:39:29 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:39:29 user nova-compute[75226]: DEBUG nova.network.neutron [None req-3b0747da-aa80-42f0-9a07-9e99be281883 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] [instance: 8c4a9724-533e-40c8-ab2a-ce3415af240a] Updating instance_info_cache with network_info: [{"id": "e30eaa7a-30df-48f5-b8de-30da75d74972", "address": "fa:16:3e:f6:83:b8", "network": {"id": "44f50686-24e7-4e75-8269-4391a53286d0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1611114801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33699aa6c9db4815a1e79aff4685801e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape30eaa7a-30", "ovs_interfaceid": "e30eaa7a-30df-48f5-b8de-30da75d74972", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:39:29 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:39:29 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-3b0747da-aa80-42f0-9a07-9e99be281883 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Releasing lock "refresh_cache-8c4a9724-533e-40c8-ab2a-ce3415af240a" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:39:29 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a0a366f-219c-43da-b1dc-57183f4b1f5f]: (4, ('- - 0', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:39:29 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-ee875a85-b89d-47fe-8abf-0fde7e3cedc9 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] Searching for a device in session 46 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75226) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 01:39:29 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee875a85-b89d-47fe-8abf-0fde7e3cedc9 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:a17c9b1e-9d6c-44b4-8c8a-c4b152e806d7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WoFEvqxr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75226) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 17 01:39:29 user nova-compute[75226]: DEBUG nova.compute.manager [None req-3b0747da-aa80-42f0-9a07-9e99be281883 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] [instance: 8c4a9724-533e-40c8-ab2a-ce3415af240a] Checking state {{(pid=75226) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 01:39:29 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:39:29 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:39:29 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:39:29 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:39:29 user nova-compute[75226]: DEBUG nova.compute.manager [req-530aab97-89d0-4510-aa03-4356f4d93f5f req-bc977d12-53b7-4d90-84b0-9d9fe11123f4 service nova] [instance: 8c4a9724-533e-40c8-ab2a-ce3415af240a] Received event network-vif-unplugged-e30eaa7a-30df-48f5-b8de-30da75d74972 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:39:29 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-530aab97-89d0-4510-aa03-4356f4d93f5f req-bc977d12-53b7-4d90-84b0-9d9fe11123f4 service nova] Acquiring lock "8c4a9724-533e-40c8-ab2a-ce3415af240a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:39:29 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-530aab97-89d0-4510-aa03-4356f4d93f5f req-bc977d12-53b7-4d90-84b0-9d9fe11123f4 service nova] Lock "8c4a9724-533e-40c8-ab2a-ce3415af240a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:39:29 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-530aab97-89d0-4510-aa03-4356f4d93f5f req-bc977d12-53b7-4d90-84b0-9d9fe11123f4 service nova] Lock "8c4a9724-533e-40c8-ab2a-ce3415af240a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:39:29 user nova-compute[75226]: DEBUG nova.compute.manager [req-530aab97-89d0-4510-aa03-4356f4d93f5f req-bc977d12-53b7-4d90-84b0-9d9fe11123f4 service nova] [instance: 8c4a9724-533e-40c8-ab2a-ce3415af240a] No waiting events found dispatching network-vif-unplugged-e30eaa7a-30df-48f5-b8de-30da75d74972 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:39:29 user nova-compute[75226]: WARNING nova.compute.manager [req-530aab97-89d0-4510-aa03-4356f4d93f5f req-bc977d12-53b7-4d90-84b0-9d9fe11123f4 service nova] [instance: 8c4a9724-533e-40c8-ab2a-ce3415af240a] Received unexpected event network-vif-unplugged-e30eaa7a-30df-48f5-b8de-30da75d74972 for instance with vm_state active and task_state reboot_started_hard.
Nov 17 01:39:29 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dcd67311-7f00-4f77-a3bc-6ffbcb1e1ed9 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] [instance: 0597c05a-1049-4117-a8ae-8177d590e024] Calling os-brick to attach iSCSI Volume {{(pid=75226) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 17 01:39:29 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcd67311-7f00-4f77-a3bc-6ffbcb1e1ed9 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc4cc36b490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8533a134-db8d-4602-84e0-cf4c2fd4dd30', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FOYBQJNy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:39:29 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-dcd67311-7f00-4f77-a3bc-6ffbcb1e1ed9 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:39:29 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-dcd67311-7f00-4f77-a3bc-6ffbcb1e1ed9 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:39:30 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:39:30 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:39:30 user nova-compute[75226]: INFO nova.virt.libvirt.driver [-] [instance: 8c4a9724-533e-40c8-ab2a-ce3415af240a] Instance destroyed successfully.
Nov 17 01:39:30 user nova-compute[75226]: DEBUG nova.objects.instance [None req-3b0747da-aa80-42f0-9a07-9e99be281883 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Lazy-loading 'resources' on Instance uuid 8c4a9724-533e-40c8-ab2a-ce3415af240a {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:39:30 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-3b0747da-aa80-42f0-9a07-9e99be281883 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:37:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2008555941',display_name='tempest-TestMinimumBasicScenario-server-2008555941',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2008555941',id=36,image_ref='40bf979b-5f8a-47f7-a942-0f80525fa754',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCdVsOUEJpOAsYDEFoGSrG2wZFHOFgpDHZxULbqhtmsHzngB+dzQ7shkC/vD5WlKGtDNdpdTeECAwcQe2pnhYO1KZ+i4VBBB4HMu36IpgRb7B+gq2o4uWntqgX+CEw8urA==',key_name='tempest-TestMinimumBasicScenario-114436321',keypairs=<?>,launch_index=0,launched_at=2023-11-17T01:37:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='33699aa6c9db4815a1e79aff4685801e',ramdisk_id='',reservation_id='r-7uved0ch',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40bf979b-5f8a-47f7-a942-0f80525fa754',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1224009744',owner_user_name='tempest-TestMinimumBasicScenario-1224009744-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T01:39:29Z,user_data=None,user_id='e7c57c13ff8a48f7b8b206d71e413646',uuid=8c4a9724-533e-40c8-ab2a-ce3415af240a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e30eaa7a-30df-48f5-b8de-30da75d74972", "address": "fa:16:3e:f6:83:b8", "network": {"id": "44f50686-24e7-4e75-8269-4391a53286d0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1611114801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33699aa6c9db4815a1e79aff4685801e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape30eaa7a-30", "ovs_interfaceid": "e30eaa7a-30df-48f5-b8de-30da75d74972", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 17 01:39:30 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-3b0747da-aa80-42f0-9a07-9e99be281883 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Converting VIF {"id": "e30eaa7a-30df-48f5-b8de-30da75d74972", "address": "fa:16:3e:f6:83:b8", "network": {"id": "44f50686-24e7-4e75-8269-4391a53286d0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1611114801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33699aa6c9db4815a1e79aff4685801e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape30eaa7a-30", "ovs_interfaceid": "e30eaa7a-30df-48f5-b8de-30da75d74972", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:39:30 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-3b0747da-aa80-42f0-9a07-9e99be281883 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f6:83:b8,bridge_name='br-int',has_traffic_filtering=True,id=e30eaa7a-30df-48f5-b8de-30da75d74972,network=Network(44f50686-24e7-4e75-8269-4391a53286d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape30eaa7a-30') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:39:30 user nova-compute[75226]: DEBUG os_vif [None req-3b0747da-aa80-42f0-9a07-9e99be281883 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f6:83:b8,bridge_name='br-int',has_traffic_filtering=True,id=e30eaa7a-30df-48f5-b8de-30da75d74972,network=Network(44f50686-24e7-4e75-8269-4391a53286d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape30eaa7a-30') {{(pid=75226) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 17 01:39:30 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:39:30 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape30eaa7a-30, bridge=br-int, if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:39:30 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:39:30 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:39:30 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:39:30 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7d878be9-6efc-414b-b003-5ece5eeb1f15) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:39:30 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:39:30 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:39:30 user nova-compute[75226]: INFO os_vif [None req-3b0747da-aa80-42f0-9a07-9e99be281883 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f6:83:b8,bridge_name='br-int',has_traffic_filtering=True,id=e30eaa7a-30df-48f5-b8de-30da75d74972,network=Network(44f50686-24e7-4e75-8269-4391a53286d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape30eaa7a-30')
Nov 17 01:39:30 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b0747da-aa80-42f0-9a07-9e99be281883 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] [instance: 8c4a9724-533e-40c8-ab2a-ce3415af240a] calling os-brick to detach iSCSI Volume {{(pid=75226) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 17 01:39:30 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b0747da-aa80-42f0-9a07-9e99be281883 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc4cc36b490>, {'target_iqn': 'iqn.2010-10.org.openstack:42287bb8-179a-4f5d-adc3-ab6e03ef12dd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ihpBPKdw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:39:30 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-3b0747da-aa80-42f0-9a07-9e99be281883 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:39:30 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-3b0747da-aa80-42f0-9a07-9e99be281883 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:39:30 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-ee875a85-b89d-47fe-8abf-0fde7e3cedc9 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.356s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:39:30 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee875a85-b89d-47fe-8abf-0fde7e3cedc9 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] <== connect_volume: return (1358ms) {'type': 'block', 'scsi_wwn': '26464343066633036', 'path': '/dev/sdf'} {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:39:30 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ee875a85-b89d-47fe-8abf-0fde7e3cedc9 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] [instance: d6d21784-2ebe-4a39-9ceb-f6607f02e3c4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26464343066633036', 'path': '/dev/sdf'} {{(pid=75226) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 17 01:39:30 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-dcd67311-7f00-4f77-a3bc-6ffbcb1e1ed9 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.407s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:39:30 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-dcd67311-7f00-4f77-a3bc-6ffbcb1e1ed9 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:39:30 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-dcd67311-7f00-4f77-a3bc-6ffbcb1e1ed9 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8533a134-db8d-4602-84e0-cf4c2fd4dd30" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:39:30 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-dcd67311-7f00-4f77-a3bc-6ffbcb1e1ed9 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8533a134-db8d-4602-84e0-cf4c2fd4dd30" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:39:30 user nova-compute[75226]: INFO os_brick.initiator.connectors.iscsi [None req-dcd67311-7f00-4f77-a3bc-6ffbcb1e1ed9 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 17 01:39:30 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8533a134-db8d-4602-84e0-cf4c2fd4dd30 -p 172.16.0.220:3260 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:39:30 user nova-compute[75226]: DEBUG nova.objects.instance [None req-ee875a85-b89d-47fe-8abf-0fde7e3cedc9 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] Lazy-loading 'flavor' on Instance uuid d6d21784-2ebe-4a39-9ceb-f6607f02e3c4 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:39:30 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8533a134-db8d-4602-84e0-cf4c2fd4dd30 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:39:30 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fb240ad-033e-4f2e-a1ee-5d7e816c342e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:39:30 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcd67311-7f00-4f77-a3bc-6ffbcb1e1ed9 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 17 01:39:30 user nova-compute[75226]:  {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:39:30 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8533a134-db8d-4602-84e0-cf4c2fd4dd30 -p 172.16.0.220:3260 --interface default --op new {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:39:30 user nova-compute[75226]: DEBUG nova.virt.libvirt.guest [None req-ee875a85-b89d-47fe-8abf-0fde7e3cedc9 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] attach device xml: <disk type="block" device="disk">
Nov 17 01:39:30 user nova-compute[75226]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 01:39:30 user nova-compute[75226]:   <source dev="/dev/sdf"/>
Nov 17 01:39:30 user nova-compute[75226]:   <target dev="vdc" bus="virtio"/>
Nov 17 01:39:30 user nova-compute[75226]:   <serial>a17c9b1e-9d6c-44b4-8c8a-c4b152e806d7</serial>
Nov 17 01:39:30 user nova-compute[75226]: </disk>
Nov 17 01:39:30 user nova-compute[75226]:  {{(pid=75226) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 17 01:39:30 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8533a134-db8d-4602-84e0-cf4c2fd4dd30 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:39:30 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4355e66-0098-47e8-80d7-64c5bc459818]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8533a134-db8d-4602-84e0-cf4c2fd4dd30] added\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:39:30 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcd67311-7f00-4f77-a3bc-6ffbcb1e1ed9 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8533a134-db8d-4602-84e0-cf4c2fd4dd30] added
Nov 17 01:39:30 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:39:30 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8533a134-db8d-4602-84e0-cf4c2fd4dd30 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:39:30 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8533a134-db8d-4602-84e0-cf4c2fd4dd30 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:39:30 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[48484e7c-1d82-494f-bfce-3824241adf5b]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:39:30 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcd67311-7f00-4f77-a3bc-6ffbcb1e1ed9 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:39:30 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8533a134-db8d-4602-84e0-cf4c2fd4dd30 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:39:30 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8533a134-db8d-4602-84e0-cf4c2fd4dd30 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:39:30 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[eedc89d7-765c-4403-9893-4976ee9c92a9]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:39:30 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcd67311-7f00-4f77-a3bc-6ffbcb1e1ed9 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:39:30 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8533a134-db8d-4602-84e0-cf4c2fd4dd30 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FOYBQJNy {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:39:30 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8533a134-db8d-4602-84e0-cf4c2fd4dd30 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FOYBQJNy" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:39:30 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[905c8e8b-e02e-40da-9deb-fa05468a3f8d]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:39:30 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcd67311-7f00-4f77-a3bc-6ffbcb1e1ed9 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FOYBQJNy'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:39:30 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8533a134-db8d-4602-84e0-cf4c2fd4dd30 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:39:30 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8533a134-db8d-4602-84e0-cf4c2fd4dd30 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:39:30 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[9354626b-d4b0-4d5c-87b2-249a7a3b99be]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:39:30 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcd67311-7f00-4f77-a3bc-6ffbcb1e1ed9 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:39:30 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:39:30 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:39:30 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[9727e8da-c3f4-42dc-9bdb-462c30a449e9]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bb94c67-f3ce-4642-8f8d-3c59a63802ac (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42287bb8-179a-4f5d-adc3-ab6e03ef12dd (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afbcbbf4-d90c-4224-869f-904342190f6c (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a17c9b1e-9d6c-44b4-8c8a-c4b152e806d7 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:39:30 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcd67311-7f00-4f77-a3bc-6ffbcb1e1ed9 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419 (non-flash)
Nov 17 01:39:30 user nova-compute[75226]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bb94c67-f3ce-4642-8f8d-3c59a63802ac (non-flash)
Nov 17 01:39:30 user nova-compute[75226]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42287bb8-179a-4f5d-adc3-ab6e03ef12dd (non-flash)
Nov 17 01:39:30 user nova-compute[75226]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afbcbbf4-d90c-4224-869f-904342190f6c (non-flash)
Nov 17 01:39:30 user nova-compute[75226]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a17c9b1e-9d6c-44b4-8c8a-c4b152e806d7 (non-flash)
Nov 17 01:39:30 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:39:30 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcd67311-7f00-4f77-a3bc-6ffbcb1e1ed9 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419 (non-flash)
Nov 17 01:39:30 user nova-compute[75226]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bb94c67-f3ce-4642-8f8d-3c59a63802ac (non-flash)
Nov 17 01:39:30 user nova-compute[75226]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42287bb8-179a-4f5d-adc3-ab6e03ef12dd (non-flash)
Nov 17 01:39:30 user nova-compute[75226]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afbcbbf4-d90c-4224-869f-904342190f6c (non-flash)
Nov 17 01:39:30 user nova-compute[75226]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a17c9b1e-9d6c-44b4-8c8a-c4b152e806d7 (non-flash)
Nov 17 01:39:30 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:39:30 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8533a134-db8d-4602-84e0-cf4c2fd4dd30 -p 172.16.0.220:3260 --login {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:39:30 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8533a134-db8d-4602-84e0-cf4c2fd4dd30 -p 172.16.0.220:3260 --login" returned: 0 in 0.094s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:39:30 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc0a31ac-2a8b-4296-bfc2-09ae09b4a025]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8533a134-db8d-4602-84e0-cf4c2fd4dd30, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8533a134-db8d-4602-84e0-cf4c2fd4dd30, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:39:30 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcd67311-7f00-4f77-a3bc-6ffbcb1e1ed9 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8533a134-db8d-4602-84e0-cf4c2fd4dd30, portal: 172.16.0.220,3260]
Nov 17 01:39:30 user nova-compute[75226]: Login to [iface: default, target: iqn.2010-10.org.openstack:8533a134-db8d-4602-84e0-cf4c2fd4dd30, portal: 172.16.0.220,3260] successful.
Nov 17 01:39:30 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:39:30 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8533a134-db8d-4602-84e0-cf4c2fd4dd30 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:39:30 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8533a134-db8d-4602-84e0-cf4c2fd4dd30 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:39:30 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cb04952-df9f-4e23-94a6-5d1b6deea322]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:39:30 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcd67311-7f00-4f77-a3bc-6ffbcb1e1ed9 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:39:30 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:39:30 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:39:30 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[6146a208-ec42-415b-a823-24baa61cdfc6]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bb94c67-f3ce-4642-8f8d-3c59a63802ac (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42287bb8-179a-4f5d-adc3-ab6e03ef12dd (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afbcbbf4-d90c-4224-869f-904342190f6c (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a17c9b1e-9d6c-44b4-8c8a-c4b152e806d7 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8533a134-db8d-4602-84e0-cf4c2fd4dd30 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:39:30 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcd67311-7f00-4f77-a3bc-6ffbcb1e1ed9 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419 (non-flash)
Nov 17 01:39:30 user nova-compute[75226]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bb94c67-f3ce-4642-8f8d-3c59a63802ac (non-flash)
Nov 17 01:39:30 user nova-compute[75226]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42287bb8-179a-4f5d-adc3-ab6e03ef12dd (non-flash)
Nov 17 01:39:30 user nova-compute[75226]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afbcbbf4-d90c-4224-869f-904342190f6c (non-flash)
Nov 17 01:39:30 user nova-compute[75226]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a17c9b1e-9d6c-44b4-8c8a-c4b152e806d7 (non-flash)
Nov 17 01:39:30 user nova-compute[75226]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8533a134-db8d-4602-84e0-cf4c2fd4dd30 (non-flash)
Nov 17 01:39:30 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:39:30 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcd67311-7f00-4f77-a3bc-6ffbcb1e1ed9 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419 (non-flash)
Nov 17 01:39:30 user nova-compute[75226]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bb94c67-f3ce-4642-8f8d-3c59a63802ac (non-flash)
Nov 17 01:39:30 user nova-compute[75226]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42287bb8-179a-4f5d-adc3-ab6e03ef12dd (non-flash)
Nov 17 01:39:30 user nova-compute[75226]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afbcbbf4-d90c-4224-869f-904342190f6c (non-flash)
Nov 17 01:39:30 user nova-compute[75226]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a17c9b1e-9d6c-44b4-8c8a-c4b152e806d7 (non-flash)
Nov 17 01:39:30 user nova-compute[75226]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8533a134-db8d-4602-84e0-cf4c2fd4dd30 (non-flash)
Nov 17 01:39:30 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:39:30 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-dcd67311-7f00-4f77-a3bc-6ffbcb1e1ed9 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8533a134-db8d-4602-84e0-cf4c2fd4dd30" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.333s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:39:30 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcd67311-7f00-4f77-a3bc-6ffbcb1e1ed9 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Connected to 172.16.0.220:3260 {{(pid=75226) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 17 01:39:30 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-dcd67311-7f00-4f77-a3bc-6ffbcb1e1ed9 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] HCTL ('38', '-', '-', 0) found on session 47 with lun 0 {{(pid=75226) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 17 01:39:30 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-dcd67311-7f00-4f77-a3bc-6ffbcb1e1ed9 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75226) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 17 01:39:30 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:39:30 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:39:30 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f574419-015b-45eb-89f3-31bcaf334fd2]: (4, ('- - 0', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:39:30 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-dcd67311-7f00-4f77-a3bc-6ffbcb1e1ed9 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Searching for a device in session 47 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75226) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 01:39:30 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcd67311-7f00-4f77-a3bc-6ffbcb1e1ed9 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:8533a134-db8d-4602-84e0-cf4c2fd4dd30', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FOYBQJNy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75226) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 17 01:39:30 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-ee875a85-b89d-47fe-8abf-0fde7e3cedc9 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] No BDM found with device name vda, not building metadata. {{(pid=75226) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 01:39:30 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-ee875a85-b89d-47fe-8abf-0fde7e3cedc9 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75226) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 01:39:30 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-ee875a85-b89d-47fe-8abf-0fde7e3cedc9 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75226) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 01:39:30 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-ee875a85-b89d-47fe-8abf-0fde7e3cedc9 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] No VIF found with MAC fa:16:3e:f6:f1:ac, not building metadata {{(pid=75226) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 01:39:30 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-ee875a85-b89d-47fe-8abf-0fde7e3cedc9 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] Lock "d6d21784-2ebe-4a39-9ceb-f6607f02e3c4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.107s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:39:31 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-dcd67311-7f00-4f77-a3bc-6ffbcb1e1ed9 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.377s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:39:31 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcd67311-7f00-4f77-a3bc-6ffbcb1e1ed9 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] <== connect_volume: return (1784ms) {'type': 'block', 'scsi_wwn': '26130393137306261', 'path': '/dev/sdg'} {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:39:31 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dcd67311-7f00-4f77-a3bc-6ffbcb1e1ed9 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] [instance: 0597c05a-1049-4117-a8ae-8177d590e024] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26130393137306261', 'path': '/dev/sdg'} {{(pid=75226) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 17 01:39:31 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-3b0747da-aa80-42f0-9a07-9e99be281883 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.448s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:39:31 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:39:31 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-8e4939dd-63f1-40df-a295-6ccc9596da8f tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] Acquiring lock "d6d21784-2ebe-4a39-9ceb-f6607f02e3c4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:39:31 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-8e4939dd-63f1-40df-a295-6ccc9596da8f tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] Lock "d6d21784-2ebe-4a39-9ceb-f6607f02e3c4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:39:31 user nova-compute[75226]: DEBUG nova.objects.instance [None req-dcd67311-7f00-4f77-a3bc-6ffbcb1e1ed9 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Lazy-loading 'flavor' on Instance uuid 0597c05a-1049-4117-a8ae-8177d590e024 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:39:31 user nova-compute[75226]: INFO nova.compute.manager [None req-8e4939dd-63f1-40df-a295-6ccc9596da8f tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] [instance: d6d21784-2ebe-4a39-9ceb-f6607f02e3c4] Detaching volume a17c9b1e-9d6c-44b4-8c8a-c4b152e806d7
Nov 17 01:39:31 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:39:31 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d76f5be-4b33-483e-9ba4-33ac3bd8c505]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9bb94c67-f3ce-4642-8f8d-3c59a63802ac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:42287bb8-179a-4f5d-adc3-ab6e03ef12dd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8533a134-db8d-4602-84e0-cf4c2fd4dd30\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:afbcbbf4-d90c-4224-869f-904342190f6c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a17c9b1e-9d6c-44b4-8c8a-c4b152e806d7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:39:31 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b0747da-aa80-42f0-9a07-9e99be281883 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 17 01:39:31 user nova-compute[75226]: No targets found.
Nov 17 01:39:31 user nova-compute[75226]: iSNS:
Nov 17 01:39:31 user nova-compute[75226]: No targets found.
Nov 17 01:39:31 user nova-compute[75226]: STATIC:
Nov 17 01:39:31 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:9bb94c67-f3ce-4642-8f8d-3c59a63802ac
Nov 17 01:39:31 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:39:31 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:39:31 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:42287bb8-179a-4f5d-adc3-ab6e03ef12dd
Nov 17 01:39:31 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:39:31 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:39:31 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:8533a134-db8d-4602-84e0-cf4c2fd4dd30
Nov 17 01:39:31 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:39:31 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:39:31 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:afbcbbf4-d90c-4224-869f-904342190f6c
Nov 17 01:39:31 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:39:31 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:39:31 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:a17c9b1e-9d6c-44b4-8c8a-c4b152e806d7
Nov 17 01:39:31 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:39:31 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:39:31 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419
Nov 17 01:39:31 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:39:31 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:39:31 user nova-compute[75226]: FIRMWARE:
Nov 17 01:39:31 user nova-compute[75226]: No targets found.
Nov 17 01:39:31 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:39:31 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b0747da-aa80-42f0-9a07-9e99be281883 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 17 01:39:31 user nova-compute[75226]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 17 01:39:31 user nova-compute[75226]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75226) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 17 01:39:31 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b0747da-aa80-42f0-9a07-9e99be281883 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:42287bb8-179a-4f5d-adc3-ab6e03ef12dd', 0)] {{(pid=75226) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 17 01:39:31 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:39:31 user nova-compute[75226]: DEBUG nova.virt.libvirt.guest [None req-dcd67311-7f00-4f77-a3bc-6ffbcb1e1ed9 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] attach device xml: <disk type="block" device="disk">
Nov 17 01:39:31 user nova-compute[75226]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 01:39:31 user nova-compute[75226]:   <source dev="/dev/sdg"/>
Nov 17 01:39:31 user nova-compute[75226]:   <target dev="vdb" bus="virtio"/>
Nov 17 01:39:31 user nova-compute[75226]:   <serial>8533a134-db8d-4602-84e0-cf4c2fd4dd30</serial>
Nov 17 01:39:31 user nova-compute[75226]: </disk>
Nov 17 01:39:31 user nova-compute[75226]:  {{(pid=75226) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 17 01:39:31 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:39:31 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca1409c5-d765-4bb9-ab75-5d91c7f5b79c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:42287bb8-179a-4f5d-adc3-ab6e03ef12dd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8533a134-db8d-4602-84e0-cf4c2fd4dd30\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9bb94c67-f3ce-4642-8f8d-3c59a63802ac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a17c9b1e-9d6c-44b4-8c8a-c4b152e806d7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:afbcbbf4-d90c-4224-869f-904342190f6c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:39:31 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:39:31 user nova-compute[75226]: DEBUG nova.compute.manager [req-3e783be5-c2ad-4e27-8e8a-bfe2a8ffa4cc req-80e69b6c-cecf-45d6-a0aa-efe97c201953 service nova] [instance: 8c4a9724-533e-40c8-ab2a-ce3415af240a] Received event network-vif-plugged-e30eaa7a-30df-48f5-b8de-30da75d74972 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:39:31 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-3e783be5-c2ad-4e27-8e8a-bfe2a8ffa4cc req-80e69b6c-cecf-45d6-a0aa-efe97c201953 service nova] Acquiring lock "8c4a9724-533e-40c8-ab2a-ce3415af240a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:39:31 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-3e783be5-c2ad-4e27-8e8a-bfe2a8ffa4cc req-80e69b6c-cecf-45d6-a0aa-efe97c201953 service nova] Lock "8c4a9724-533e-40c8-ab2a-ce3415af240a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:39:31 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-3e783be5-c2ad-4e27-8e8a-bfe2a8ffa4cc req-80e69b6c-cecf-45d6-a0aa-efe97c201953 service nova] Lock "8c4a9724-533e-40c8-ab2a-ce3415af240a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:39:31 user nova-compute[75226]: DEBUG nova.compute.manager [req-3e783be5-c2ad-4e27-8e8a-bfe2a8ffa4cc req-80e69b6c-cecf-45d6-a0aa-efe97c201953 service nova] [instance: 8c4a9724-533e-40c8-ab2a-ce3415af240a] No waiting events found dispatching network-vif-plugged-e30eaa7a-30df-48f5-b8de-30da75d74972 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:39:31 user nova-compute[75226]: WARNING nova.compute.manager [req-3e783be5-c2ad-4e27-8e8a-bfe2a8ffa4cc req-80e69b6c-cecf-45d6-a0aa-efe97c201953 service nova] [instance: 8c4a9724-533e-40c8-ab2a-ce3415af240a] Received unexpected event network-vif-plugged-e30eaa7a-30df-48f5-b8de-30da75d74972 for instance with vm_state active and task_state reboot_started_hard.
Nov 17 01:39:31 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:39:31 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dee1f91-8717-4c50-83b1-2b0671aa4694]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bb94c67-f3ce-4642-8f8d-3c59a63802ac (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42287bb8-179a-4f5d-adc3-ab6e03ef12dd (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afbcbbf4-d90c-4224-869f-904342190f6c (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a17c9b1e-9d6c-44b4-8c8a-c4b152e806d7 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8533a134-db8d-4602-84e0-cf4c2fd4dd30 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:39:31 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b0747da-aa80-42f0-9a07-9e99be281883 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419 (non-flash)
Nov 17 01:39:31 user nova-compute[75226]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bb94c67-f3ce-4642-8f8d-3c59a63802ac (non-flash)
Nov 17 01:39:31 user nova-compute[75226]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42287bb8-179a-4f5d-adc3-ab6e03ef12dd (non-flash)
Nov 17 01:39:31 user nova-compute[75226]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afbcbbf4-d90c-4224-869f-904342190f6c (non-flash)
Nov 17 01:39:31 user nova-compute[75226]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a17c9b1e-9d6c-44b4-8c8a-c4b152e806d7 (non-flash)
Nov 17 01:39:31 user nova-compute[75226]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8533a134-db8d-4602-84e0-cf4c2fd4dd30 (non-flash)
Nov 17 01:39:31 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:39:31 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b0747da-aa80-42f0-9a07-9e99be281883 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419 (non-flash)
Nov 17 01:39:31 user nova-compute[75226]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bb94c67-f3ce-4642-8f8d-3c59a63802ac (non-flash)
Nov 17 01:39:31 user nova-compute[75226]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42287bb8-179a-4f5d-adc3-ab6e03ef12dd (non-flash)
Nov 17 01:39:31 user nova-compute[75226]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afbcbbf4-d90c-4224-869f-904342190f6c (non-flash)
Nov 17 01:39:31 user nova-compute[75226]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a17c9b1e-9d6c-44b4-8c8a-c4b152e806d7 (non-flash)
Nov 17 01:39:31 user nova-compute[75226]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8533a134-db8d-4602-84e0-cf4c2fd4dd30 (non-flash)
Nov 17 01:39:31 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:39:31 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b0747da-aa80-42f0-9a07-9e99be281883 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc494750430>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:42287bb8-179a-4f5d-adc3-ab6e03ef12dd'): ({'sdc'}, set())}) {{(pid=75226) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 17 01:39:31 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-3b0747da-aa80-42f0-9a07-9e99be281883 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Removing single pathed devices sdc {{(pid=75226) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 17 01:39:31 user nova-compute[75226]: INFO nova.virt.block_device [None req-8e4939dd-63f1-40df-a295-6ccc9596da8f tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] [instance: d6d21784-2ebe-4a39-9ceb-f6607f02e3c4] Attempting to driver detach volume a17c9b1e-9d6c-44b4-8c8a-c4b152e806d7 from mountpoint /dev/vdc
Nov 17 01:39:31 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:39:31 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-8e4939dd-63f1-40df-a295-6ccc9596da8f tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] Attempting to detach device vdc from instance d6d21784-2ebe-4a39-9ceb-f6607f02e3c4 from the persistent domain config. {{(pid=75226) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 17 01:39:31 user nova-compute[75226]: DEBUG nova.virt.libvirt.guest [None req-8e4939dd-63f1-40df-a295-6ccc9596da8f tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] detach device xml: <disk type="block" device="disk">
Nov 17 01:39:31 user nova-compute[75226]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 01:39:31 user nova-compute[75226]:   <source dev="/dev/sdf"/>
Nov 17 01:39:31 user nova-compute[75226]:   <target dev="vdc" bus="virtio"/>
Nov 17 01:39:31 user nova-compute[75226]:   <serial>a17c9b1e-9d6c-44b4-8c8a-c4b152e806d7</serial>
Nov 17 01:39:31 user nova-compute[75226]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 17 01:39:31 user nova-compute[75226]: </disk>
Nov 17 01:39:31 user nova-compute[75226]:  {{(pid=75226) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 17 01:39:31 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:39:31 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[32aeb577-9bf9-4306-b287-084e59380bd8]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:39:31 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:39:31 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-8e4939dd-63f1-40df-a295-6ccc9596da8f tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] Successfully detached device vdc from instance d6d21784-2ebe-4a39-9ceb-f6607f02e3c4 from the persistent domain config.
Nov 17 01:39:31 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-8e4939dd-63f1-40df-a295-6ccc9596da8f tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance d6d21784-2ebe-4a39-9ceb-f6607f02e3c4 from the live domain config. {{(pid=75226) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 17 01:39:31 user nova-compute[75226]: DEBUG nova.virt.libvirt.guest [None req-8e4939dd-63f1-40df-a295-6ccc9596da8f tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] detach device xml: <disk type="block" device="disk">
Nov 17 01:39:31 user nova-compute[75226]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 01:39:31 user nova-compute[75226]:   <source dev="/dev/sdf"/>
Nov 17 01:39:31 user nova-compute[75226]:   <target dev="vdc" bus="virtio"/>
Nov 17 01:39:31 user nova-compute[75226]:   <serial>a17c9b1e-9d6c-44b4-8c8a-c4b152e806d7</serial>
Nov 17 01:39:31 user nova-compute[75226]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 17 01:39:31 user nova-compute[75226]: </disk>
Nov 17 01:39:31 user nova-compute[75226]:  {{(pid=75226) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 17 01:39:31 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:39:31 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[92aded06-d52c-4b41-9e02-cdfbae399471]: (4, ('ok\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:39:31 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-3b0747da-aa80-42f0-9a07-9e99be281883 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Flushing IO for device /dev/sdc {{(pid=75226) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 17 01:39:31 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:39:31 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:39:31 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c755b76-d874-48f4-9c48-bdc40579520a]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:39:31 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-3b0747da-aa80-42f0-9a07-9e99be281883 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75226) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 17 01:39:31 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:39:31 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.053s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:39:31 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[b92d1f93-0ae4-4de2-81cb-f84875bec5bc]: (4, ('1', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:39:31 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-3b0747da-aa80-42f0-9a07-9e99be281883 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75226) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 17 01:39:31 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-3b0747da-aa80-42f0-9a07-9e99be281883 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] SCSI volumes sdc have been removed. {{(pid=75226) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 17 01:39:31 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b0747da-aa80-42f0-9a07-9e99be281883 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:42287bb8-179a-4f5d-adc3-ab6e03ef12dd')] {{(pid=75226) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 17 01:39:31 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42287bb8-179a-4f5d-adc3-ab6e03ef12dd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:39:31 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42287bb8-179a-4f5d-adc3-ab6e03ef12dd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:39:31 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4dbe625-d593-4ebf-b2b2-ea0a013f19db]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:39:31 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b0747da-aa80-42f0-9a07-9e99be281883 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:39:31 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42287bb8-179a-4f5d-adc3-ab6e03ef12dd -p 172.16.0.220:3260 --logout {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:39:31 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42287bb8-179a-4f5d-adc3-ab6e03ef12dd -p 172.16.0.220:3260 --logout" returned: 0 in 0.091s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:39:31 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[aabbbadb-63b9-4671-9a7a-8f8b899cef9e]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:42287bb8-179a-4f5d-adc3-ab6e03ef12dd, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:42287bb8-179a-4f5d-adc3-ab6e03ef12dd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:39:31 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b0747da-aa80-42f0-9a07-9e99be281883 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:42287bb8-179a-4f5d-adc3-ab6e03ef12dd, portal: 172.16.0.220,3260]
Nov 17 01:39:31 user nova-compute[75226]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:42287bb8-179a-4f5d-adc3-ab6e03ef12dd, portal: 172.16.0.220,3260] successful.
Nov 17 01:39:31 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:39:31 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42287bb8-179a-4f5d-adc3-ab6e03ef12dd -p 172.16.0.220:3260 --op delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:39:32 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42287bb8-179a-4f5d-adc3-ab6e03ef12dd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:39:32 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[0383ec6d-6078-4c48-ae69-0aca9e0cf1c6]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:39:32 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b0747da-aa80-42f0-9a07-9e99be281883 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:39:32 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-3b0747da-aa80-42f0-9a07-9e99be281883 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.382s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:39:32 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b0747da-aa80-42f0-9a07-9e99be281883 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] <== disconnect_volume: return (1830ms) None {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:39:32 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b0747da-aa80-42f0-9a07-9e99be281883 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] [instance: 8c4a9724-533e-40c8-ab2a-ce3415af240a] Disconnected iSCSI Volume {{(pid=75226) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 17 01:39:32 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-3b0747da-aa80-42f0-9a07-9e99be281883 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] [instance: 8c4a9724-533e-40c8-ab2a-ce3415af240a] Start _get_guest_xml network_info=[{"id": "e30eaa7a-30df-48f5-b8de-30da75d74972", "address": "fa:16:3e:f6:83:b8", "network": {"id": "44f50686-24e7-4e75-8269-4391a53286d0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1611114801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33699aa6c9db4815a1e79aff4685801e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape30eaa7a-30", "ovs_interfaceid": "e30eaa7a-30df-48f5-b8de-30da75d74972", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=40bf979b-5f8a-47f7-a942-0f80525fa754,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '40bf979b-5f8a-47f7-a942-0f80525fa754'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'boot_index': None, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:42287bb8-179a-4f5d-adc3-ab6e03ef12dd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ihpBPKdw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '8c4a9724-533e-40c8-ab2a-ce3415af240a', 'attached_at': '', 'detached_at': '', 'volume_id': '42287bb8-179a-4f5d-adc3-ab6e03ef12dd', 'serial': '42287bb8-179a-4f5d-adc3-ab6e03ef12dd'}, 'attachment_id': '0fca66df-ca70-43ac-9254-4ab19839a689', 'device_type': 'disk', 'volume_type': None} {{(pid=75226) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 17 01:39:32 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-3b0747da-aa80-42f0-9a07-9e99be281883 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:39:32 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-3b0747da-aa80-42f0-9a07-9e99be281883 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:39:32 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-3b0747da-aa80-42f0-9a07-9e99be281883 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75226) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 17 01:39:32 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-3b0747da-aa80-42f0-9a07-9e99be281883 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] CPU controller missing on host. {{(pid=75226) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 17 01:39:32 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-3b0747da-aa80-42f0-9a07-9e99be281883 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75226) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 17 01:39:32 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-3b0747da-aa80-42f0-9a07-9e99be281883 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] CPU controller found on host. {{(pid=75226) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 17 01:39:32 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-3b0747da-aa80-42f0-9a07-9e99be281883 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75226) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 17 01:39:32 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-3b0747da-aa80-42f0-9a07-9e99be281883 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-17T01:13:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=40bf979b-5f8a-47f7-a942-0f80525fa754,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 17 01:39:32 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-3b0747da-aa80-42f0-9a07-9e99be281883 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Flavor limits 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 17 01:39:32 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-3b0747da-aa80-42f0-9a07-9e99be281883 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Image limits 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 17 01:39:32 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-3b0747da-aa80-42f0-9a07-9e99be281883 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Flavor pref 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 17 01:39:32 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-3b0747da-aa80-42f0-9a07-9e99be281883 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Image pref 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 17 01:39:32 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-3b0747da-aa80-42f0-9a07-9e99be281883 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 17 01:39:32 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-3b0747da-aa80-42f0-9a07-9e99be281883 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 17 01:39:32 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-3b0747da-aa80-42f0-9a07-9e99be281883 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75226) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 17 01:39:32 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-3b0747da-aa80-42f0-9a07-9e99be281883 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Got 1 possible topologies {{(pid=75226) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 17 01:39:32 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-3b0747da-aa80-42f0-9a07-9e99be281883 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 17 01:39:32 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-3b0747da-aa80-42f0-9a07-9e99be281883 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 17 01:39:32 user nova-compute[75226]: DEBUG nova.objects.instance [None req-3b0747da-aa80-42f0-9a07-9e99be281883 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Lazy-loading 'vcpu_model' on Instance uuid 8c4a9724-533e-40c8-ab2a-ce3415af240a {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:39:32 user nova-compute[75226]: DEBUG nova.objects.base [None req-3b0747da-aa80-42f0-9a07-9e99be281883 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Object Instance<8c4a9724-533e-40c8-ab2a-ce3415af240a> lazy-loaded attributes: resources,vcpu_model {{(pid=75226) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 17 01:39:32 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b0747da-aa80-42f0-9a07-9e99be281883 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] [instance: 8c4a9724-533e-40c8-ab2a-ce3415af240a] Calling os-brick to attach iSCSI Volume {{(pid=75226) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 17 01:39:32 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b0747da-aa80-42f0-9a07-9e99be281883 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc4cc36b490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:42287bb8-179a-4f5d-adc3-ab6e03ef12dd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ihpBPKdw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:39:32 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-3b0747da-aa80-42f0-9a07-9e99be281883 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:39:32 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-3b0747da-aa80-42f0-9a07-9e99be281883 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:39:32 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-3b0747da-aa80-42f0-9a07-9e99be281883 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:39:32 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-3b0747da-aa80-42f0-9a07-9e99be281883 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:39:32 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-3b0747da-aa80-42f0-9a07-9e99be281883 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:42287bb8-179a-4f5d-adc3-ab6e03ef12dd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:39:32 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-3b0747da-aa80-42f0-9a07-9e99be281883 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:42287bb8-179a-4f5d-adc3-ab6e03ef12dd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:39:32 user nova-compute[75226]: INFO os_brick.initiator.connectors.iscsi [None req-3b0747da-aa80-42f0-9a07-9e99be281883 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 17 01:39:32 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42287bb8-179a-4f5d-adc3-ab6e03ef12dd -p 172.16.0.220:3260 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:39:32 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42287bb8-179a-4f5d-adc3-ab6e03ef12dd -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:39:32 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[10c11102-0395-4453-bf12-e055f1030caf]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:39:32 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b0747da-aa80-42f0-9a07-9e99be281883 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 17 01:39:32 user nova-compute[75226]:  {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:39:32 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42287bb8-179a-4f5d-adc3-ab6e03ef12dd -p 172.16.0.220:3260 --interface default --op new {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:39:32 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42287bb8-179a-4f5d-adc3-ab6e03ef12dd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:39:32 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1fcc1f3-ef1a-4216-8862-728ecd1fb741]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:42287bb8-179a-4f5d-adc3-ab6e03ef12dd] added\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:39:32 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b0747da-aa80-42f0-9a07-9e99be281883 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:42287bb8-179a-4f5d-adc3-ab6e03ef12dd] added
Nov 17 01:39:32 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:39:32 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42287bb8-179a-4f5d-adc3-ab6e03ef12dd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:39:32 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42287bb8-179a-4f5d-adc3-ab6e03ef12dd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:39:32 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dbf5130-810a-451c-bab5-f0c2beee9671]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:39:32 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b0747da-aa80-42f0-9a07-9e99be281883 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:39:32 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42287bb8-179a-4f5d-adc3-ab6e03ef12dd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:39:32 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42287bb8-179a-4f5d-adc3-ab6e03ef12dd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:39:32 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[046f0c62-05be-4e1c-b668-a00bdd8475f9]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:39:32 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b0747da-aa80-42f0-9a07-9e99be281883 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:39:32 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42287bb8-179a-4f5d-adc3-ab6e03ef12dd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ihpBPKdw {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:39:32 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42287bb8-179a-4f5d-adc3-ab6e03ef12dd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ihpBPKdw" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:39:32 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8d55671-e52c-4c2b-9b0f-fb1f979e326e]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:39:32 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b0747da-aa80-42f0-9a07-9e99be281883 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ihpBPKdw'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:39:32 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42287bb8-179a-4f5d-adc3-ab6e03ef12dd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:39:32 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42287bb8-179a-4f5d-adc3-ab6e03ef12dd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:39:32 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea284452-5f00-463b-ad5b-e4945934f878]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:39:32 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b0747da-aa80-42f0-9a07-9e99be281883 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:39:32 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:39:32 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:39:32 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f0d9e69-54b6-4925-8e28-4e30a01601bd]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bb94c67-f3ce-4642-8f8d-3c59a63802ac (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afbcbbf4-d90c-4224-869f-904342190f6c (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a17c9b1e-9d6c-44b4-8c8a-c4b152e806d7 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8533a134-db8d-4602-84e0-cf4c2fd4dd30 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:39:32 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b0747da-aa80-42f0-9a07-9e99be281883 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419 (non-flash)
Nov 17 01:39:32 user nova-compute[75226]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bb94c67-f3ce-4642-8f8d-3c59a63802ac (non-flash)
Nov 17 01:39:32 user nova-compute[75226]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afbcbbf4-d90c-4224-869f-904342190f6c (non-flash)
Nov 17 01:39:32 user nova-compute[75226]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a17c9b1e-9d6c-44b4-8c8a-c4b152e806d7 (non-flash)
Nov 17 01:39:32 user nova-compute[75226]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8533a134-db8d-4602-84e0-cf4c2fd4dd30 (non-flash)
Nov 17 01:39:32 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:39:32 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b0747da-aa80-42f0-9a07-9e99be281883 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419 (non-flash)
Nov 17 01:39:32 user nova-compute[75226]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bb94c67-f3ce-4642-8f8d-3c59a63802ac (non-flash)
Nov 17 01:39:32 user nova-compute[75226]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afbcbbf4-d90c-4224-869f-904342190f6c (non-flash)
Nov 17 01:39:32 user nova-compute[75226]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a17c9b1e-9d6c-44b4-8c8a-c4b152e806d7 (non-flash)
Nov 17 01:39:32 user nova-compute[75226]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8533a134-db8d-4602-84e0-cf4c2fd4dd30 (non-flash)
Nov 17 01:39:32 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:39:32 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42287bb8-179a-4f5d-adc3-ab6e03ef12dd -p 172.16.0.220:3260 --login {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:39:32 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-8e4939dd-63f1-40df-a295-6ccc9596da8f tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance d6d21784-2ebe-4a39-9ceb-f6607f02e3c4 {{(pid=75226) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 17 01:39:32 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42287bb8-179a-4f5d-adc3-ab6e03ef12dd -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:39:32 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[78c17bb1-feb0-4541-94e3-d18c39bc5ab4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:42287bb8-179a-4f5d-adc3-ab6e03ef12dd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:42287bb8-179a-4f5d-adc3-ab6e03ef12dd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:39:32 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b0747da-aa80-42f0-9a07-9e99be281883 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:42287bb8-179a-4f5d-adc3-ab6e03ef12dd, portal: 172.16.0.220,3260]
Nov 17 01:39:32 user nova-compute[75226]: Login to [iface: default, target: iqn.2010-10.org.openstack:42287bb8-179a-4f5d-adc3-ab6e03ef12dd, portal: 172.16.0.220,3260] successful.
Nov 17 01:39:32 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:39:32 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42287bb8-179a-4f5d-adc3-ab6e03ef12dd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:39:32 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42287bb8-179a-4f5d-adc3-ab6e03ef12dd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:39:32 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[d912d4c8-534c-4b55-b137-901af076d7cd]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:39:32 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b0747da-aa80-42f0-9a07-9e99be281883 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:39:32 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-dcd67311-7f00-4f77-a3bc-6ffbcb1e1ed9 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] No BDM found with device name vda, not building metadata. {{(pid=75226) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 01:39:32 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-dcd67311-7f00-4f77-a3bc-6ffbcb1e1ed9 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75226) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 01:39:32 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-dcd67311-7f00-4f77-a3bc-6ffbcb1e1ed9 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] No VIF found with MAC fa:16:3e:6d:db:0b, not building metadata {{(pid=75226) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 01:39:32 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:39:32 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:39:32 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[b51955b6-ea82-496a-892a-092c6b9c9b10]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bb94c67-f3ce-4642-8f8d-3c59a63802ac (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afbcbbf4-d90c-4224-869f-904342190f6c (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a17c9b1e-9d6c-44b4-8c8a-c4b152e806d7 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8533a134-db8d-4602-84e0-cf4c2fd4dd30 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42287bb8-179a-4f5d-adc3-ab6e03ef12dd (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:39:32 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b0747da-aa80-42f0-9a07-9e99be281883 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419 (non-flash)
Nov 17 01:39:32 user nova-compute[75226]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bb94c67-f3ce-4642-8f8d-3c59a63802ac (non-flash)
Nov 17 01:39:32 user nova-compute[75226]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afbcbbf4-d90c-4224-869f-904342190f6c (non-flash)
Nov 17 01:39:32 user nova-compute[75226]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a17c9b1e-9d6c-44b4-8c8a-c4b152e806d7 (non-flash)
Nov 17 01:39:32 user nova-compute[75226]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8533a134-db8d-4602-84e0-cf4c2fd4dd30 (non-flash)
Nov 17 01:39:32 user nova-compute[75226]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42287bb8-179a-4f5d-adc3-ab6e03ef12dd (non-flash)
Nov 17 01:39:32 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:39:32 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b0747da-aa80-42f0-9a07-9e99be281883 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419 (non-flash)
Nov 17 01:39:32 user nova-compute[75226]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bb94c67-f3ce-4642-8f8d-3c59a63802ac (non-flash)
Nov 17 01:39:32 user nova-compute[75226]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afbcbbf4-d90c-4224-869f-904342190f6c (non-flash)
Nov 17 01:39:32 user nova-compute[75226]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a17c9b1e-9d6c-44b4-8c8a-c4b152e806d7 (non-flash)
Nov 17 01:39:32 user nova-compute[75226]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8533a134-db8d-4602-84e0-cf4c2fd4dd30 (non-flash)
Nov 17 01:39:32 user nova-compute[75226]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42287bb8-179a-4f5d-adc3-ab6e03ef12dd (non-flash)
Nov 17 01:39:32 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:39:32 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-3b0747da-aa80-42f0-9a07-9e99be281883 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:42287bb8-179a-4f5d-adc3-ab6e03ef12dd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.311s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:39:32 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b0747da-aa80-42f0-9a07-9e99be281883 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Connected to 172.16.0.220:3260 {{(pid=75226) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 17 01:39:32 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-3b0747da-aa80-42f0-9a07-9e99be281883 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] HCTL ('34', '-', '-', 0) found on session 48 with lun 0 {{(pid=75226) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 17 01:39:32 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-3b0747da-aa80-42f0-9a07-9e99be281883 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75226) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 17 01:39:32 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:39:32 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:39:32 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[c42dd9ed-2f97-4bf9-b373-e8e1563e1f69]: (4, ('- - 0', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:39:32 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-3b0747da-aa80-42f0-9a07-9e99be281883 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Searching for a device in session 48 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75226) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 01:39:32 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b0747da-aa80-42f0-9a07-9e99be281883 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:42287bb8-179a-4f5d-adc3-ab6e03ef12dd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ihpBPKdw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75226) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 17 01:39:32 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-dcd67311-7f00-4f77-a3bc-6ffbcb1e1ed9 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Lock "0597c05a-1049-4117-a8ae-8177d590e024" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.108s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:39:33 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:39:33 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-3b0747da-aa80-42f0-9a07-9e99be281883 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.347s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:39:33 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b0747da-aa80-42f0-9a07-9e99be281883 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] <== connect_volume: return (1348ms) {'type': 'block', 'scsi_wwn': '23763366237393336', 'path': '/dev/sdc'} {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:39:33 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b0747da-aa80-42f0-9a07-9e99be281883 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] [instance: 8c4a9724-533e-40c8-ab2a-ce3415af240a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23763366237393336', 'path': '/dev/sdc'} {{(pid=75226) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 17 01:39:33 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-3b0747da-aa80-42f0-9a07-9e99be281883 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:37:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2008555941',display_name='tempest-TestMinimumBasicScenario-server-2008555941',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2008555941',id=36,image_ref='40bf979b-5f8a-47f7-a942-0f80525fa754',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCdVsOUEJpOAsYDEFoGSrG2wZFHOFgpDHZxULbqhtmsHzngB+dzQ7shkC/vD5WlKGtDNdpdTeECAwcQe2pnhYO1KZ+i4VBBB4HMu36IpgRb7B+gq2o4uWntqgX+CEw8urA==',key_name='tempest-TestMinimumBasicScenario-114436321',keypairs=<?>,launch_index=0,launched_at=2023-11-17T01:37:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='33699aa6c9db4815a1e79aff4685801e',ramdisk_id='',reservation_id='r-7uved0ch',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40bf979b-5f8a-47f7-a942-0f80525fa754',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1224009744',owner_user_name='tempest-TestMinimumBasicScenario-1224009744-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T01:39:29Z,user_data=None,user_id='e7c57c13ff8a48f7b8b206d71e413646',uuid=8c4a9724-533e-40c8-ab2a-ce3415af240a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e30eaa7a-30df-48f5-b8de-30da75d74972", "address": "fa:16:3e:f6:83:b8", "network": {"id": "44f50686-24e7-4e75-8269-4391a53286d0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1611114801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33699aa6c9db4815a1e79aff4685801e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape30eaa7a-30", "ovs_interfaceid": "e30eaa7a-30df-48f5-b8de-30da75d74972", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75226) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 01:39:33 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-3b0747da-aa80-42f0-9a07-9e99be281883 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Converting VIF {"id": "e30eaa7a-30df-48f5-b8de-30da75d74972", "address": "fa:16:3e:f6:83:b8", "network": {"id": "44f50686-24e7-4e75-8269-4391a53286d0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1611114801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33699aa6c9db4815a1e79aff4685801e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape30eaa7a-30", "ovs_interfaceid": "e30eaa7a-30df-48f5-b8de-30da75d74972", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:39:33 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-3b0747da-aa80-42f0-9a07-9e99be281883 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f6:83:b8,bridge_name='br-int',has_traffic_filtering=True,id=e30eaa7a-30df-48f5-b8de-30da75d74972,network=Network(44f50686-24e7-4e75-8269-4391a53286d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape30eaa7a-30') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:39:33 user nova-compute[75226]: DEBUG nova.objects.instance [None req-3b0747da-aa80-42f0-9a07-9e99be281883 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Lazy-loading 'pci_devices' on Instance uuid 8c4a9724-533e-40c8-ab2a-ce3415af240a {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:39:33 user nova-compute[75226]: DEBUG nova.objects.base [None req-3b0747da-aa80-42f0-9a07-9e99be281883 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Object Instance<8c4a9724-533e-40c8-ab2a-ce3415af240a> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=75226) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 17 01:39:33 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-3b0747da-aa80-42f0-9a07-9e99be281883 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] [instance: 8c4a9724-533e-40c8-ab2a-ce3415af240a] End _get_guest_xml xml=<domain type="kvm">
Nov 17 01:39:33 user nova-compute[75226]:   <uuid>8c4a9724-533e-40c8-ab2a-ce3415af240a</uuid>
Nov 17 01:39:33 user nova-compute[75226]:   <name>instance-00000024</name>
Nov 17 01:39:33 user nova-compute[75226]:   <memory>524288</memory>
Nov 17 01:39:33 user nova-compute[75226]:   <vcpu>1</vcpu>
Nov 17 01:39:33 user nova-compute[75226]:   <metadata>
Nov 17 01:39:33 user nova-compute[75226]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 17 01:39:33 user nova-compute[75226]:       <nova:package version="0.0.0"/>
Nov 17 01:39:33 user nova-compute[75226]:       <nova:name>tempest-TestMinimumBasicScenario-server-2008555941</nova:name>
Nov 17 01:39:33 user nova-compute[75226]:       <nova:creationTime>2023-11-17 01:39:32</nova:creationTime>
Nov 17 01:39:33 user nova-compute[75226]:       <nova:flavor name="m1.tiny">
Nov 17 01:39:33 user nova-compute[75226]:         <nova:memory>512</nova:memory>
Nov 17 01:39:33 user nova-compute[75226]:         <nova:disk>1</nova:disk>
Nov 17 01:39:33 user nova-compute[75226]:         <nova:swap>0</nova:swap>
Nov 17 01:39:33 user nova-compute[75226]:         <nova:ephemeral>0</nova:ephemeral>
Nov 17 01:39:33 user nova-compute[75226]:         <nova:vcpus>1</nova:vcpus>
Nov 17 01:39:33 user nova-compute[75226]:       </nova:flavor>
Nov 17 01:39:33 user nova-compute[75226]:       <nova:owner>
Nov 17 01:39:33 user nova-compute[75226]:         <nova:user uuid="e7c57c13ff8a48f7b8b206d71e413646">tempest-TestMinimumBasicScenario-1224009744-project-member</nova:user>
Nov 17 01:39:33 user nova-compute[75226]:         <nova:project uuid="33699aa6c9db4815a1e79aff4685801e">tempest-TestMinimumBasicScenario-1224009744</nova:project>
Nov 17 01:39:33 user nova-compute[75226]:       </nova:owner>
Nov 17 01:39:33 user nova-compute[75226]:       <nova:root type="image" uuid="40bf979b-5f8a-47f7-a942-0f80525fa754"/>
Nov 17 01:39:33 user nova-compute[75226]:       <nova:ports>
Nov 17 01:39:33 user nova-compute[75226]:         <nova:port uuid="e30eaa7a-30df-48f5-b8de-30da75d74972">
Nov 17 01:39:33 user nova-compute[75226]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 17 01:39:33 user nova-compute[75226]:         </nova:port>
Nov 17 01:39:33 user nova-compute[75226]:       </nova:ports>
Nov 17 01:39:33 user nova-compute[75226]:     </nova:instance>
Nov 17 01:39:33 user nova-compute[75226]:   </metadata>
Nov 17 01:39:33 user nova-compute[75226]:   <sysinfo type="smbios">
Nov 17 01:39:33 user nova-compute[75226]:     <system>
Nov 17 01:39:33 user nova-compute[75226]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 17 01:39:33 user nova-compute[75226]:       <entry name="product">OpenStack Nova</entry>
Nov 17 01:39:33 user nova-compute[75226]:       <entry name="version">0.0.0</entry>
Nov 17 01:39:33 user nova-compute[75226]:       <entry name="serial">8c4a9724-533e-40c8-ab2a-ce3415af240a</entry>
Nov 17 01:39:33 user nova-compute[75226]:       <entry name="uuid">8c4a9724-533e-40c8-ab2a-ce3415af240a</entry>
Nov 17 01:39:33 user nova-compute[75226]:       <entry name="family">Virtual Machine</entry>
Nov 17 01:39:33 user nova-compute[75226]:     </system>
Nov 17 01:39:33 user nova-compute[75226]:   </sysinfo>
Nov 17 01:39:33 user nova-compute[75226]:   <os>
Nov 17 01:39:33 user nova-compute[75226]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 17 01:39:33 user nova-compute[75226]:     <boot dev="hd"/>
Nov 17 01:39:33 user nova-compute[75226]:     <smbios mode="sysinfo"/>
Nov 17 01:39:33 user nova-compute[75226]:   </os>
Nov 17 01:39:33 user nova-compute[75226]:   <features>
Nov 17 01:39:33 user nova-compute[75226]:     <acpi/>
Nov 17 01:39:33 user nova-compute[75226]:     <apic/>
Nov 17 01:39:33 user nova-compute[75226]:     <vmcoreinfo/>
Nov 17 01:39:33 user nova-compute[75226]:   </features>
Nov 17 01:39:33 user nova-compute[75226]:   <clock offset="utc">
Nov 17 01:39:33 user nova-compute[75226]:     <timer name="pit" tickpolicy="delay"/>
Nov 17 01:39:33 user nova-compute[75226]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 17 01:39:33 user nova-compute[75226]:     <timer name="hpet" present="no"/>
Nov 17 01:39:33 user nova-compute[75226]:   </clock>
Nov 17 01:39:33 user nova-compute[75226]:   <cpu mode="custom" match="exact">
Nov 17 01:39:33 user nova-compute[75226]:     <model>Nehalem</model>
Nov 17 01:39:33 user nova-compute[75226]:     <topology sockets="1" cores="1" threads="1"/>
Nov 17 01:39:33 user nova-compute[75226]:   </cpu>
Nov 17 01:39:33 user nova-compute[75226]:   <devices>
Nov 17 01:39:33 user nova-compute[75226]:     <disk type="file" device="disk">
Nov 17 01:39:33 user nova-compute[75226]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 17 01:39:33 user nova-compute[75226]:       <source file="/opt/stack/data/nova/instances/8c4a9724-533e-40c8-ab2a-ce3415af240a/disk"/>
Nov 17 01:39:33 user nova-compute[75226]:       <target dev="vda" bus="virtio"/>
Nov 17 01:39:33 user nova-compute[75226]:     </disk>
Nov 17 01:39:33 user nova-compute[75226]:     <disk type="block" device="disk">
Nov 17 01:39:33 user nova-compute[75226]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 01:39:33 user nova-compute[75226]:       <source dev="/dev/sdc"/>
Nov 17 01:39:33 user nova-compute[75226]:       <target dev="vdb" bus="virtio"/>
Nov 17 01:39:33 user nova-compute[75226]:       <serial>42287bb8-179a-4f5d-adc3-ab6e03ef12dd</serial>
Nov 17 01:39:33 user nova-compute[75226]:     </disk>
Nov 17 01:39:33 user nova-compute[75226]:     <interface type="ethernet">
Nov 17 01:39:33 user nova-compute[75226]:       <mac address="fa:16:3e:f6:83:b8"/>
Nov 17 01:39:33 user nova-compute[75226]:       <model type="virtio"/>
Nov 17 01:39:33 user nova-compute[75226]:       <mtu size="1442"/>
Nov 17 01:39:33 user nova-compute[75226]:       <target dev="tape30eaa7a-30"/>
Nov 17 01:39:33 user nova-compute[75226]:     </interface>
Nov 17 01:39:33 user nova-compute[75226]:     <serial type="pty">
Nov 17 01:39:33 user nova-compute[75226]:       <log file="/opt/stack/data/nova/instances/8c4a9724-533e-40c8-ab2a-ce3415af240a/console.log" append="off"/>
Nov 17 01:39:33 user nova-compute[75226]:     </serial>
Nov 17 01:39:33 user nova-compute[75226]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 17 01:39:33 user nova-compute[75226]:     <video>
Nov 17 01:39:33 user nova-compute[75226]:       <model type="virtio"/>
Nov 17 01:39:33 user nova-compute[75226]:     </video>
Nov 17 01:39:33 user nova-compute[75226]:     <rng model="virtio">
Nov 17 01:39:33 user nova-compute[75226]:       <backend model="random">/dev/urandom</backend>
Nov 17 01:39:33 user nova-compute[75226]:     </rng>
Nov 17 01:39:33 user nova-compute[75226]:     <controller type="usb" index="0" model="none"/>
Nov 17 01:39:33 user nova-compute[75226]:     <memballoon model="virtio">
Nov 17 01:39:33 user nova-compute[75226]:       <stats period="10"/>
Nov 17 01:39:33 user nova-compute[75226]:     </memballoon>
Nov 17 01:39:33 user nova-compute[75226]:   </devices>
Nov 17 01:39:33 user nova-compute[75226]: </domain>
Nov 17 01:39:33 user nova-compute[75226]:  {{(pid=75226) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 17 01:39:33 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-3b0747da-aa80-42f0-9a07-9e99be281883 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c4a9724-533e-40c8-ab2a-ce3415af240a/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:39:33 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-3b0747da-aa80-42f0-9a07-9e99be281883 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c4a9724-533e-40c8-ab2a-ce3415af240a/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:39:33 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-3b0747da-aa80-42f0-9a07-9e99be281883 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c4a9724-533e-40c8-ab2a-ce3415af240a/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:39:33 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-3b0747da-aa80-42f0-9a07-9e99be281883 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c4a9724-533e-40c8-ab2a-ce3415af240a/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:39:33 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-3b0747da-aa80-42f0-9a07-9e99be281883 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75226) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 01:39:33 user nova-compute[75226]: DEBUG nova.objects.instance [None req-3b0747da-aa80-42f0-9a07-9e99be281883 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Lazy-loading 'trusted_certs' on Instance uuid 8c4a9724-533e-40c8-ab2a-ce3415af240a {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:39:33 user nova-compute[75226]: DEBUG nova.objects.base [None req-3b0747da-aa80-42f0-9a07-9e99be281883 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Object Instance<8c4a9724-533e-40c8-ab2a-ce3415af240a> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=75226) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 17 01:39:33 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-3b0747da-aa80-42f0-9a07-9e99be281883 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c26246469b0fe452ea7e2a241a7e59c8d5f2dd53 --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:39:34 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-3b0747da-aa80-42f0-9a07-9e99be281883 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c26246469b0fe452ea7e2a241a7e59c8d5f2dd53 --force-share --output=json" returned: 0 in 0.178s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:39:34 user nova-compute[75226]: DEBUG nova.virt.disk.api [None req-3b0747da-aa80-42f0-9a07-9e99be281883 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8c4a9724-533e-40c8-ab2a-ce3415af240a/disk. size=1073741824 {{(pid=75226) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 17 01:39:34 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-3b0747da-aa80-42f0-9a07-9e99be281883 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c4a9724-533e-40c8-ab2a-ce3415af240a/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:39:34 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-3b0747da-aa80-42f0-9a07-9e99be281883 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c4a9724-533e-40c8-ab2a-ce3415af240a/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:39:34 user nova-compute[75226]: DEBUG nova.virt.disk.api [None req-3b0747da-aa80-42f0-9a07-9e99be281883 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Cannot resize image /opt/stack/data/nova/instances/8c4a9724-533e-40c8-ab2a-ce3415af240a/disk to a smaller size. {{(pid=75226) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 17 01:39:34 user nova-compute[75226]: DEBUG nova.objects.instance [None req-3b0747da-aa80-42f0-9a07-9e99be281883 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Lazy-loading 'migration_context' on Instance uuid 8c4a9724-533e-40c8-ab2a-ce3415af240a {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:39:34 user nova-compute[75226]: DEBUG nova.objects.base [None req-3b0747da-aa80-42f0-9a07-9e99be281883 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Object Instance<8c4a9724-533e-40c8-ab2a-ce3415af240a> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75226) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 17 01:39:34 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-3b0747da-aa80-42f0-9a07-9e99be281883 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:37:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2008555941',display_name='tempest-TestMinimumBasicScenario-server-2008555941',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2008555941',id=36,image_ref='40bf979b-5f8a-47f7-a942-0f80525fa754',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCdVsOUEJpOAsYDEFoGSrG2wZFHOFgpDHZxULbqhtmsHzngB+dzQ7shkC/vD5WlKGtDNdpdTeECAwcQe2pnhYO1KZ+i4VBBB4HMu36IpgRb7B+gq2o4uWntqgX+CEw8urA==',key_name='tempest-TestMinimumBasicScenario-114436321',keypairs=<?>,launch_index=0,launched_at=2023-11-17T01:37:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='33699aa6c9db4815a1e79aff4685801e',ramdisk_id='',reservation_id='r-7uved0ch',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40bf979b-5f8a-47f7-a942-0f80525fa754',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1224009744',owner_user_name='tempest-TestMinimumBasicScenario-1224009744-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T01:39:29Z,user_data=None,user_id='e7c57c13ff8a48f7b8b206d71e413646',uuid=8c4a9724-533e-40c8-ab2a-ce3415af240a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e30eaa7a-30df-48f5-b8de-30da75d74972", "address": "fa:16:3e:f6:83:b8", "network": {"id": "44f50686-24e7-4e75-8269-4391a53286d0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1611114801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33699aa6c9db4815a1e79aff4685801e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape30eaa7a-30", "ovs_interfaceid": "e30eaa7a-30df-48f5-b8de-30da75d74972", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 17 01:39:34 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-3b0747da-aa80-42f0-9a07-9e99be281883 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Converting VIF {"id": "e30eaa7a-30df-48f5-b8de-30da75d74972", "address": "fa:16:3e:f6:83:b8", "network": {"id": "44f50686-24e7-4e75-8269-4391a53286d0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1611114801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33699aa6c9db4815a1e79aff4685801e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape30eaa7a-30", "ovs_interfaceid": "e30eaa7a-30df-48f5-b8de-30da75d74972", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:39:34 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-3b0747da-aa80-42f0-9a07-9e99be281883 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f6:83:b8,bridge_name='br-int',has_traffic_filtering=True,id=e30eaa7a-30df-48f5-b8de-30da75d74972,network=Network(44f50686-24e7-4e75-8269-4391a53286d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape30eaa7a-30') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:39:34 user nova-compute[75226]: DEBUG os_vif [None req-3b0747da-aa80-42f0-9a07-9e99be281883 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f6:83:b8,bridge_name='br-int',has_traffic_filtering=True,id=e30eaa7a-30df-48f5-b8de-30da75d74972,network=Network(44f50686-24e7-4e75-8269-4391a53286d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape30eaa7a-30') {{(pid=75226) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 17 01:39:34 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:39:34 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:39:34 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 17 01:39:34 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:39:34 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0acb5548-94e3-5bbd-8b2c-d37e5601bc1a', '_type': 'linux-noop'}}, row=False) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:39:34 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:39:34 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:39:34 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:39:34 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape30eaa7a-30, may_exist=True, interface_attrs={}) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:39:34 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape30eaa7a-30, col_values=(('qos', UUID('b4d8a35c-bd58-471d-9789-663ba1f45e60')),), if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:39:34 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape30eaa7a-30, col_values=(('external_ids', {'iface-id': 'e30eaa7a-30df-48f5-b8de-30da75d74972', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f6:83:b8', 'vm-uuid': '8c4a9724-533e-40c8-ab2a-ce3415af240a'}),), if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:39:34 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:39:34 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:39:34 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:39:34 user nova-compute[75226]: INFO os_vif [None req-3b0747da-aa80-42f0-9a07-9e99be281883 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f6:83:b8,bridge_name='br-int',has_traffic_filtering=True,id=e30eaa7a-30df-48f5-b8de-30da75d74972,network=Network(44f50686-24e7-4e75-8269-4391a53286d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape30eaa7a-30')
Nov 17 01:39:34 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-c9d63f9a-eccb-4a98-b14f-3c76c306ce29 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Acquiring lock "0597c05a-1049-4117-a8ae-8177d590e024" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:39:34 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-c9d63f9a-eccb-4a98-b14f-3c76c306ce29 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Lock "0597c05a-1049-4117-a8ae-8177d590e024" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:39:34 user nova-compute[75226]: INFO nova.compute.manager [None req-c9d63f9a-eccb-4a98-b14f-3c76c306ce29 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] [instance: 0597c05a-1049-4117-a8ae-8177d590e024] Detaching volume 8533a134-db8d-4602-84e0-cf4c2fd4dd30
Nov 17 01:39:34 user nova-compute[75226]: INFO nova.virt.block_device [None req-c9d63f9a-eccb-4a98-b14f-3c76c306ce29 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] [instance: 0597c05a-1049-4117-a8ae-8177d590e024] Attempting to driver detach volume 8533a134-db8d-4602-84e0-cf4c2fd4dd30 from mountpoint /dev/vdb
Nov 17 01:39:34 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-c9d63f9a-eccb-4a98-b14f-3c76c306ce29 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Attempting to detach device vdb from instance 0597c05a-1049-4117-a8ae-8177d590e024 from the persistent domain config. {{(pid=75226) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 17 01:39:34 user nova-compute[75226]: DEBUG nova.virt.libvirt.guest [None req-c9d63f9a-eccb-4a98-b14f-3c76c306ce29 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] detach device xml: <disk type="block" device="disk">
Nov 17 01:39:34 user nova-compute[75226]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 01:39:34 user nova-compute[75226]:   <source dev="/dev/sdg"/>
Nov 17 01:39:34 user nova-compute[75226]:   <target dev="vdb" bus="virtio"/>
Nov 17 01:39:34 user nova-compute[75226]:   <serial>8533a134-db8d-4602-84e0-cf4c2fd4dd30</serial>
Nov 17 01:39:34 user nova-compute[75226]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 17 01:39:34 user nova-compute[75226]: </disk>
Nov 17 01:39:34 user nova-compute[75226]:  {{(pid=75226) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 17 01:39:34 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-c9d63f9a-eccb-4a98-b14f-3c76c306ce29 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Successfully detached device vdb from instance 0597c05a-1049-4117-a8ae-8177d590e024 from the persistent domain config.
Nov 17 01:39:34 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-c9d63f9a-eccb-4a98-b14f-3c76c306ce29 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0597c05a-1049-4117-a8ae-8177d590e024 from the live domain config. {{(pid=75226) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 17 01:39:34 user nova-compute[75226]: DEBUG nova.virt.libvirt.guest [None req-c9d63f9a-eccb-4a98-b14f-3c76c306ce29 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] detach device xml: <disk type="block" device="disk">
Nov 17 01:39:34 user nova-compute[75226]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 01:39:34 user nova-compute[75226]:   <source dev="/dev/sdg"/>
Nov 17 01:39:34 user nova-compute[75226]:   <target dev="vdb" bus="virtio"/>
Nov 17 01:39:34 user nova-compute[75226]:   <serial>8533a134-db8d-4602-84e0-cf4c2fd4dd30</serial>
Nov 17 01:39:34 user nova-compute[75226]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 17 01:39:34 user nova-compute[75226]: </disk>
Nov 17 01:39:34 user nova-compute[75226]:  {{(pid=75226) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 17 01:39:35 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-c9d63f9a-eccb-4a98-b14f-3c76c306ce29 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0597c05a-1049-4117-a8ae-8177d590e024 {{(pid=75226) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 17 01:39:36 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:39:36 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:39:36 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:39:36 user nova-compute[75226]: DEBUG nova.compute.manager [req-986db4f2-c7fa-4438-9bd9-da52997af81c req-0f6145af-26ab-4c3c-a878-c0da7fe5d136 service nova] [instance: 8c4a9724-533e-40c8-ab2a-ce3415af240a] Received event network-vif-plugged-e30eaa7a-30df-48f5-b8de-30da75d74972 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:39:36 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-986db4f2-c7fa-4438-9bd9-da52997af81c req-0f6145af-26ab-4c3c-a878-c0da7fe5d136 service nova] Acquiring lock "8c4a9724-533e-40c8-ab2a-ce3415af240a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:39:36 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-986db4f2-c7fa-4438-9bd9-da52997af81c req-0f6145af-26ab-4c3c-a878-c0da7fe5d136 service nova] Lock "8c4a9724-533e-40c8-ab2a-ce3415af240a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:39:36 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-986db4f2-c7fa-4438-9bd9-da52997af81c req-0f6145af-26ab-4c3c-a878-c0da7fe5d136 service nova] Lock "8c4a9724-533e-40c8-ab2a-ce3415af240a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:39:36 user nova-compute[75226]: DEBUG nova.compute.manager [req-986db4f2-c7fa-4438-9bd9-da52997af81c req-0f6145af-26ab-4c3c-a878-c0da7fe5d136 service nova] [instance: 8c4a9724-533e-40c8-ab2a-ce3415af240a] No waiting events found dispatching network-vif-plugged-e30eaa7a-30df-48f5-b8de-30da75d74972 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:39:36 user nova-compute[75226]: WARNING nova.compute.manager [req-986db4f2-c7fa-4438-9bd9-da52997af81c req-0f6145af-26ab-4c3c-a878-c0da7fe5d136 service nova] [instance: 8c4a9724-533e-40c8-ab2a-ce3415af240a] Received unexpected event network-vif-plugged-e30eaa7a-30df-48f5-b8de-30da75d74972 for instance with vm_state active and task_state reboot_started_hard.
Nov 17 01:39:36 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:39:36 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:39:36 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:39:38 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:39:38 user nova-compute[75226]: DEBUG nova.compute.manager [None req-3b0747da-aa80-42f0-9a07-9e99be281883 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] [instance: 8c4a9724-533e-40c8-ab2a-ce3415af240a] Instance event wait completed in 0 seconds for  {{(pid=75226) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 17 01:39:38 user nova-compute[75226]: INFO nova.virt.libvirt.driver [-] [instance: 8c4a9724-533e-40c8-ab2a-ce3415af240a] Instance rebooted successfully.
Nov 17 01:39:38 user nova-compute[75226]: DEBUG nova.compute.manager [None req-3b0747da-aa80-42f0-9a07-9e99be281883 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] [instance: 8c4a9724-533e-40c8-ab2a-ce3415af240a] Checking state {{(pid=75226) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 01:39:38 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-3b0747da-aa80-42f0-9a07-9e99be281883 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Lock "8c4a9724-533e-40c8-ab2a-ce3415af240a" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 9.707s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:39:38 user nova-compute[75226]: DEBUG nova.compute.manager [req-87b6b39d-1995-40c5-b66e-66da6521d323 req-27bca4ab-d2e4-45dc-844b-09933d862428 service nova] [instance: 8c4a9724-533e-40c8-ab2a-ce3415af240a] Received event network-vif-plugged-e30eaa7a-30df-48f5-b8de-30da75d74972 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:39:38 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-87b6b39d-1995-40c5-b66e-66da6521d323 req-27bca4ab-d2e4-45dc-844b-09933d862428 service nova] Acquiring lock "8c4a9724-533e-40c8-ab2a-ce3415af240a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:39:38 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-87b6b39d-1995-40c5-b66e-66da6521d323 req-27bca4ab-d2e4-45dc-844b-09933d862428 service nova] Lock "8c4a9724-533e-40c8-ab2a-ce3415af240a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:39:38 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-87b6b39d-1995-40c5-b66e-66da6521d323 req-27bca4ab-d2e4-45dc-844b-09933d862428 service nova] Lock "8c4a9724-533e-40c8-ab2a-ce3415af240a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:39:38 user nova-compute[75226]: DEBUG nova.compute.manager [req-87b6b39d-1995-40c5-b66e-66da6521d323 req-27bca4ab-d2e4-45dc-844b-09933d862428 service nova] [instance: 8c4a9724-533e-40c8-ab2a-ce3415af240a] No waiting events found dispatching network-vif-plugged-e30eaa7a-30df-48f5-b8de-30da75d74972 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:39:38 user nova-compute[75226]: WARNING nova.compute.manager [req-87b6b39d-1995-40c5-b66e-66da6521d323 req-27bca4ab-d2e4-45dc-844b-09933d862428 service nova] [instance: 8c4a9724-533e-40c8-ab2a-ce3415af240a] Received unexpected event network-vif-plugged-e30eaa7a-30df-48f5-b8de-30da75d74972 for instance with vm_state active and task_state None.
Nov 17 01:39:39 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:39:43 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:39:44 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:39:47 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-4e7ccc77-c1c5-4695-8636-7ba25aefdc08 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Acquiring lock "a298d980-feed-4530-9499-f2833b404dcd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:39:47 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-4e7ccc77-c1c5-4695-8636-7ba25aefdc08 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Lock "a298d980-feed-4530-9499-f2833b404dcd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:39:47 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-4e7ccc77-c1c5-4695-8636-7ba25aefdc08 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Acquiring lock "a298d980-feed-4530-9499-f2833b404dcd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:39:47 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-4e7ccc77-c1c5-4695-8636-7ba25aefdc08 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Lock "a298d980-feed-4530-9499-f2833b404dcd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:39:47 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-4e7ccc77-c1c5-4695-8636-7ba25aefdc08 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Lock "a298d980-feed-4530-9499-f2833b404dcd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:39:47 user nova-compute[75226]: INFO nova.compute.manager [None req-4e7ccc77-c1c5-4695-8636-7ba25aefdc08 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: a298d980-feed-4530-9499-f2833b404dcd] Terminating instance
Nov 17 01:39:47 user nova-compute[75226]: DEBUG nova.compute.manager [None req-4e7ccc77-c1c5-4695-8636-7ba25aefdc08 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: a298d980-feed-4530-9499-f2833b404dcd] Start destroying the instance on the hypervisor. {{(pid=75226) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 17 01:39:47 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:39:47 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:39:47 user nova-compute[75226]: DEBUG nova.compute.manager [req-92e8d177-788f-4f51-ab51-c141caa4eb25 req-e3077be3-3808-48f1-ac4c-99637f221843 service nova] [instance: a298d980-feed-4530-9499-f2833b404dcd] Received event network-vif-unplugged-301235a9-5ec1-41f4-8e43-9dc7b20e872d {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:39:47 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-92e8d177-788f-4f51-ab51-c141caa4eb25 req-e3077be3-3808-48f1-ac4c-99637f221843 service nova] Acquiring lock "a298d980-feed-4530-9499-f2833b404dcd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:39:47 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-92e8d177-788f-4f51-ab51-c141caa4eb25 req-e3077be3-3808-48f1-ac4c-99637f221843 service nova] Lock "a298d980-feed-4530-9499-f2833b404dcd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:39:47 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-92e8d177-788f-4f51-ab51-c141caa4eb25 req-e3077be3-3808-48f1-ac4c-99637f221843 service nova] Lock "a298d980-feed-4530-9499-f2833b404dcd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:39:47 user nova-compute[75226]: DEBUG nova.compute.manager [req-92e8d177-788f-4f51-ab51-c141caa4eb25 req-e3077be3-3808-48f1-ac4c-99637f221843 service nova] [instance: a298d980-feed-4530-9499-f2833b404dcd] No waiting events found dispatching network-vif-unplugged-301235a9-5ec1-41f4-8e43-9dc7b20e872d {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:39:47 user nova-compute[75226]: DEBUG nova.compute.manager [req-92e8d177-788f-4f51-ab51-c141caa4eb25 req-e3077be3-3808-48f1-ac4c-99637f221843 service nova] [instance: a298d980-feed-4530-9499-f2833b404dcd] Received event network-vif-unplugged-301235a9-5ec1-41f4-8e43-9dc7b20e872d for instance with task_state deleting. {{(pid=75226) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 17 01:39:47 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:39:47 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:39:48 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:39:48 user nova-compute[75226]: INFO nova.virt.libvirt.driver [-] [instance: a298d980-feed-4530-9499-f2833b404dcd] Instance destroyed successfully.
Nov 17 01:39:48 user nova-compute[75226]: DEBUG nova.objects.instance [None req-4e7ccc77-c1c5-4695-8636-7ba25aefdc08 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Lazy-loading 'resources' on Instance uuid a298d980-feed-4530-9499-f2833b404dcd {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:39:48 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-4e7ccc77-c1c5-4695-8636-7ba25aefdc08 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:33:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-652050362',display_name='tempest-ServerActionsTestOtherA-server-652050362',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-652050362',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFcMGt3BPMgKZBdescHicrTnz7kyNBHfMwmrFONg75JAKc8VfRVh1PCQT3W5iiYYT6fcflPeuhtfYyaPi/d36jL88Vz6dOEwhdGgUoOilw3GKb90qUp0hFoOK7faoQkiRg==',key_name='tempest-keypair-1413404210',keypairs=<?>,launch_index=0,launched_at=2023-11-17T01:35:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f9042fe4ecc245dd97553f6e942c3e05',ramdisk_id='',reservation_id='r-e60zxux4',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2125452149',owner_user_name='tempest-ServerActionsTestOtherA-2125452149-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T01:36:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a13dd8231937440185c9fc628c3bd5db',uuid=a298d980-feed-4530-9499-f2833b404dcd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "301235a9-5ec1-41f4-8e43-9dc7b20e872d", "address": "fa:16:3e:9a:7d:e3", "network": {"id": "9f39d3e5-b106-4bd9-b8ba-0f326e89c481", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-675861281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9042fe4ecc245dd97553f6e942c3e05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap301235a9-5e", "ovs_interfaceid": "301235a9-5ec1-41f4-8e43-9dc7b20e872d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 17 01:39:48 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-4e7ccc77-c1c5-4695-8636-7ba25aefdc08 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Converting VIF {"id": "301235a9-5ec1-41f4-8e43-9dc7b20e872d", "address": "fa:16:3e:9a:7d:e3", "network": {"id": "9f39d3e5-b106-4bd9-b8ba-0f326e89c481", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-675861281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9042fe4ecc245dd97553f6e942c3e05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap301235a9-5e", "ovs_interfaceid": "301235a9-5ec1-41f4-8e43-9dc7b20e872d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:39:48 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-4e7ccc77-c1c5-4695-8636-7ba25aefdc08 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9a:7d:e3,bridge_name='br-int',has_traffic_filtering=True,id=301235a9-5ec1-41f4-8e43-9dc7b20e872d,network=Network(9f39d3e5-b106-4bd9-b8ba-0f326e89c481),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap301235a9-5e') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:39:48 user nova-compute[75226]: DEBUG os_vif [None req-4e7ccc77-c1c5-4695-8636-7ba25aefdc08 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9a:7d:e3,bridge_name='br-int',has_traffic_filtering=True,id=301235a9-5ec1-41f4-8e43-9dc7b20e872d,network=Network(9f39d3e5-b106-4bd9-b8ba-0f326e89c481),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap301235a9-5e') {{(pid=75226) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 17 01:39:48 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:39:48 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap301235a9-5e, bridge=br-int, if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:39:48 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:39:48 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:39:48 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:39:48 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fa6beefd-ed9c-48db-9225-5cf8b21888d3) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:39:48 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:39:48 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:39:48 user nova-compute[75226]: INFO os_vif [None req-4e7ccc77-c1c5-4695-8636-7ba25aefdc08 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9a:7d:e3,bridge_name='br-int',has_traffic_filtering=True,id=301235a9-5ec1-41f4-8e43-9dc7b20e872d,network=Network(9f39d3e5-b106-4bd9-b8ba-0f326e89c481),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap301235a9-5e')
Nov 17 01:39:48 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e7ccc77-c1c5-4695-8636-7ba25aefdc08 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: a298d980-feed-4530-9499-f2833b404dcd] calling os-brick to detach iSCSI Volume {{(pid=75226) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 17 01:39:48 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e7ccc77-c1c5-4695-8636-7ba25aefdc08 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc4cc36b490>, {'target_iqn': 'iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VUyvFGLr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:39:48 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-4e7ccc77-c1c5-4695-8636-7ba25aefdc08 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:39:48 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-4e7ccc77-c1c5-4695-8636-7ba25aefdc08 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:39:48 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-4e7ccc77-c1c5-4695-8636-7ba25aefdc08 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:39:48 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:39:48 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:39:48 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9f98dfb-f218-4655-aa07-fd70aca34417]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9bb94c67-f3ce-4642-8f8d-3c59a63802ac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:42287bb8-179a-4f5d-adc3-ab6e03ef12dd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8533a134-db8d-4602-84e0-cf4c2fd4dd30\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:afbcbbf4-d90c-4224-869f-904342190f6c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a17c9b1e-9d6c-44b4-8c8a-c4b152e806d7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:39:48 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e7ccc77-c1c5-4695-8636-7ba25aefdc08 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 17 01:39:48 user nova-compute[75226]: No targets found.
Nov 17 01:39:48 user nova-compute[75226]: iSNS:
Nov 17 01:39:48 user nova-compute[75226]: No targets found.
Nov 17 01:39:48 user nova-compute[75226]: STATIC:
Nov 17 01:39:48 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:9bb94c67-f3ce-4642-8f8d-3c59a63802ac
Nov 17 01:39:48 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:39:48 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:39:48 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:42287bb8-179a-4f5d-adc3-ab6e03ef12dd
Nov 17 01:39:48 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:39:48 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:39:48 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:8533a134-db8d-4602-84e0-cf4c2fd4dd30
Nov 17 01:39:48 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:39:48 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:39:48 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:afbcbbf4-d90c-4224-869f-904342190f6c
Nov 17 01:39:48 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:39:48 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:39:48 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:a17c9b1e-9d6c-44b4-8c8a-c4b152e806d7
Nov 17 01:39:48 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:39:48 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:39:48 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419
Nov 17 01:39:48 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:39:48 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:39:48 user nova-compute[75226]: FIRMWARE:
Nov 17 01:39:48 user nova-compute[75226]: No targets found.
Nov 17 01:39:48 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:39:48 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e7ccc77-c1c5-4695-8636-7ba25aefdc08 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 17 01:39:48 user nova-compute[75226]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 17 01:39:48 user nova-compute[75226]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75226) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 17 01:39:48 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e7ccc77-c1c5-4695-8636-7ba25aefdc08 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419', 0)] {{(pid=75226) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 17 01:39:48 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:39:48 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:39:48 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[59a07bcc-4823-45a6-b615-6942a89be87e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:42287bb8-179a-4f5d-adc3-ab6e03ef12dd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8533a134-db8d-4602-84e0-cf4c2fd4dd30\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9bb94c67-f3ce-4642-8f8d-3c59a63802ac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a17c9b1e-9d6c-44b4-8c8a-c4b152e806d7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:afbcbbf4-d90c-4224-869f-904342190f6c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:39:48 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:39:48 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:39:48 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce1c95cd-d299-4963-82a1-315b19579288]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bb94c67-f3ce-4642-8f8d-3c59a63802ac (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afbcbbf4-d90c-4224-869f-904342190f6c (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a17c9b1e-9d6c-44b4-8c8a-c4b152e806d7 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8533a134-db8d-4602-84e0-cf4c2fd4dd30 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42287bb8-179a-4f5d-adc3-ab6e03ef12dd (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:39:48 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e7ccc77-c1c5-4695-8636-7ba25aefdc08 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419 (non-flash)
Nov 17 01:39:48 user nova-compute[75226]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bb94c67-f3ce-4642-8f8d-3c59a63802ac (non-flash)
Nov 17 01:39:48 user nova-compute[75226]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afbcbbf4-d90c-4224-869f-904342190f6c (non-flash)
Nov 17 01:39:48 user nova-compute[75226]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a17c9b1e-9d6c-44b4-8c8a-c4b152e806d7 (non-flash)
Nov 17 01:39:48 user nova-compute[75226]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8533a134-db8d-4602-84e0-cf4c2fd4dd30 (non-flash)
Nov 17 01:39:48 user nova-compute[75226]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42287bb8-179a-4f5d-adc3-ab6e03ef12dd (non-flash)
Nov 17 01:39:48 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:39:48 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e7ccc77-c1c5-4695-8636-7ba25aefdc08 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419 (non-flash)
Nov 17 01:39:48 user nova-compute[75226]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bb94c67-f3ce-4642-8f8d-3c59a63802ac (non-flash)
Nov 17 01:39:48 user nova-compute[75226]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afbcbbf4-d90c-4224-869f-904342190f6c (non-flash)
Nov 17 01:39:48 user nova-compute[75226]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a17c9b1e-9d6c-44b4-8c8a-c4b152e806d7 (non-flash)
Nov 17 01:39:48 user nova-compute[75226]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8533a134-db8d-4602-84e0-cf4c2fd4dd30 (non-flash)
Nov 17 01:39:48 user nova-compute[75226]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42287bb8-179a-4f5d-adc3-ab6e03ef12dd (non-flash)
Nov 17 01:39:48 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:39:48 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e7ccc77-c1c5-4695-8636-7ba25aefdc08 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc4b44589d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419'): ({'sdb'}, set())}) {{(pid=75226) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 17 01:39:48 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-4e7ccc77-c1c5-4695-8636-7ba25aefdc08 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Removing single pathed devices sdb {{(pid=75226) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 17 01:39:48 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:39:48 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:39:48 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd3cd5e5-a78d-4ffa-b39b-35ed0bb3cbed]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:39:48 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:39:48 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:39:48 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec70603e-1c91-4017-aef9-7e8c88d7a7f1]: (4, ('ok\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:39:48 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-4e7ccc77-c1c5-4695-8636-7ba25aefdc08 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Flushing IO for device /dev/sdb {{(pid=75226) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 17 01:39:48 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:39:48 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:39:48 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc9a5589-7e78-4ad1-a60e-55e0c8ea5f42]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:39:48 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-4e7ccc77-c1c5-4695-8636-7ba25aefdc08 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75226) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 17 01:39:48 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:39:48 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:39:48 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[02fdaf52-4697-430f-b20e-6e4f59ce1e22]: (4, ('1', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:39:48 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-4e7ccc77-c1c5-4695-8636-7ba25aefdc08 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75226) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 17 01:39:48 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-4e7ccc77-c1c5-4695-8636-7ba25aefdc08 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] SCSI volumes sdb have been removed. {{(pid=75226) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 17 01:39:48 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e7ccc77-c1c5-4695-8636-7ba25aefdc08 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419')] {{(pid=75226) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 17 01:39:48 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:39:48 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:39:48 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[273a1db7-36f2-47b9-8345-3e94d8124122]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:39:48 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e7ccc77-c1c5-4695-8636-7ba25aefdc08 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:39:48 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419 -p 172.16.0.220:3260 --logout {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:39:48 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:39:48 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[87cb5558-6241-462b-a305-953a91e7050b]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:39:48 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e7ccc77-c1c5-4695-8636-7ba25aefdc08 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419, portal: 172.16.0.220,3260]
Nov 17 01:39:48 user nova-compute[75226]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419, portal: 172.16.0.220,3260] successful.
Nov 17 01:39:48 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:39:48 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419 -p 172.16.0.220:3260 --op delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:39:48 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9b3d0d6-bd04-414b-99e5-da9402f5f419 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:39:48 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a02b3d8-91fc-4ea7-b172-e89108d6bec6]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:39:48 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e7ccc77-c1c5-4695-8636-7ba25aefdc08 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:39:48 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-4e7ccc77-c1c5-4695-8636-7ba25aefdc08 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:39:48 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e7ccc77-c1c5-4695-8636-7ba25aefdc08 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] <== disconnect_volume: return (311ms) None {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:39:48 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e7ccc77-c1c5-4695-8636-7ba25aefdc08 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: a298d980-feed-4530-9499-f2833b404dcd] Disconnected iSCSI Volume {{(pid=75226) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 17 01:39:48 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-4e7ccc77-c1c5-4695-8636-7ba25aefdc08 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: a298d980-feed-4530-9499-f2833b404dcd] Deleting instance files /opt/stack/data/nova/instances/a298d980-feed-4530-9499-f2833b404dcd_del
Nov 17 01:39:48 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-4e7ccc77-c1c5-4695-8636-7ba25aefdc08 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: a298d980-feed-4530-9499-f2833b404dcd] Deletion of /opt/stack/data/nova/instances/a298d980-feed-4530-9499-f2833b404dcd_del complete
Nov 17 01:39:48 user nova-compute[75226]: INFO nova.compute.manager [None req-4e7ccc77-c1c5-4695-8636-7ba25aefdc08 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: a298d980-feed-4530-9499-f2833b404dcd] Took 1.22 seconds to destroy the instance on the hypervisor.
Nov 17 01:39:48 user nova-compute[75226]: DEBUG oslo.service.loopingcall [None req-4e7ccc77-c1c5-4695-8636-7ba25aefdc08 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75226) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 17 01:39:48 user nova-compute[75226]: DEBUG nova.compute.manager [-] [instance: a298d980-feed-4530-9499-f2833b404dcd] Deallocating network for instance {{(pid=75226) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 17 01:39:48 user nova-compute[75226]: DEBUG nova.network.neutron [-] [instance: a298d980-feed-4530-9499-f2833b404dcd] deallocate_for_instance() {{(pid=75226) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 17 01:39:49 user nova-compute[75226]: DEBUG nova.network.neutron [-] [instance: a298d980-feed-4530-9499-f2833b404dcd] Updating instance_info_cache with network_info: [] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:39:49 user nova-compute[75226]: INFO nova.compute.manager [-] [instance: a298d980-feed-4530-9499-f2833b404dcd] Took 0.77 seconds to deallocate network for instance.
Nov 17 01:39:49 user nova-compute[75226]: DEBUG nova.compute.manager [req-2f4b707c-5cee-4711-9e55-32b8d8617876 req-6311ef48-eebf-4682-b2ad-51793c1e4999 service nova] [instance: a298d980-feed-4530-9499-f2833b404dcd] Received event network-vif-plugged-301235a9-5ec1-41f4-8e43-9dc7b20e872d {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:39:49 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-2f4b707c-5cee-4711-9e55-32b8d8617876 req-6311ef48-eebf-4682-b2ad-51793c1e4999 service nova] Acquiring lock "a298d980-feed-4530-9499-f2833b404dcd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:39:49 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-2f4b707c-5cee-4711-9e55-32b8d8617876 req-6311ef48-eebf-4682-b2ad-51793c1e4999 service nova] Lock "a298d980-feed-4530-9499-f2833b404dcd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:39:49 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-2f4b707c-5cee-4711-9e55-32b8d8617876 req-6311ef48-eebf-4682-b2ad-51793c1e4999 service nova] Lock "a298d980-feed-4530-9499-f2833b404dcd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:39:49 user nova-compute[75226]: DEBUG nova.compute.manager [req-2f4b707c-5cee-4711-9e55-32b8d8617876 req-6311ef48-eebf-4682-b2ad-51793c1e4999 service nova] [instance: a298d980-feed-4530-9499-f2833b404dcd] No waiting events found dispatching network-vif-plugged-301235a9-5ec1-41f4-8e43-9dc7b20e872d {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:39:49 user nova-compute[75226]: WARNING nova.compute.manager [req-2f4b707c-5cee-4711-9e55-32b8d8617876 req-6311ef48-eebf-4682-b2ad-51793c1e4999 service nova] [instance: a298d980-feed-4530-9499-f2833b404dcd] Received unexpected event network-vif-plugged-301235a9-5ec1-41f4-8e43-9dc7b20e872d for instance with vm_state active and task_state deleting.
Nov 17 01:39:49 user nova-compute[75226]: DEBUG nova.compute.manager [req-2f4b707c-5cee-4711-9e55-32b8d8617876 req-6311ef48-eebf-4682-b2ad-51793c1e4999 service nova] [instance: a298d980-feed-4530-9499-f2833b404dcd] Received event network-vif-deleted-301235a9-5ec1-41f4-8e43-9dc7b20e872d {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:39:50 user nova-compute[75226]: INFO nova.compute.manager [None req-4e7ccc77-c1c5-4695-8636-7ba25aefdc08 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: a298d980-feed-4530-9499-f2833b404dcd] Took 0.82 seconds to detach 1 volumes for instance.
Nov 17 01:39:50 user nova-compute[75226]: DEBUG nova.compute.manager [None req-4e7ccc77-c1c5-4695-8636-7ba25aefdc08 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: a298d980-feed-4530-9499-f2833b404dcd] Deleting volume: c9b3d0d6-bd04-414b-99e5-da9402f5f419 {{(pid=75226) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 17 01:39:50 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-4e7ccc77-c1c5-4695-8636-7ba25aefdc08 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:39:50 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-4e7ccc77-c1c5-4695-8636-7ba25aefdc08 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:39:50 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-4e7ccc77-c1c5-4695-8636-7ba25aefdc08 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:39:50 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-4e7ccc77-c1c5-4695-8636-7ba25aefdc08 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:39:50 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-4e7ccc77-c1c5-4695-8636-7ba25aefdc08 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.307s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:39:50 user nova-compute[75226]: INFO nova.scheduler.client.report [None req-4e7ccc77-c1c5-4695-8636-7ba25aefdc08 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Deleted allocations for instance a298d980-feed-4530-9499-f2833b404dcd
Nov 17 01:39:51 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-4e7ccc77-c1c5-4695-8636-7ba25aefdc08 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Lock "a298d980-feed-4530-9499-f2833b404dcd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.399s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:39:52 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-8e4939dd-63f1-40df-a295-6ccc9596da8f tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance d6d21784-2ebe-4a39-9ceb-f6607f02e3c4 is timed out.
Nov 17 01:39:52 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-8e4939dd-63f1-40df-a295-6ccc9596da8f tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] Successfully detached device vdc from instance d6d21784-2ebe-4a39-9ceb-f6607f02e3c4 from the live domain config.
Nov 17 01:39:52 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e4939dd-63f1-40df-a295-6ccc9596da8f tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] [instance: d6d21784-2ebe-4a39-9ceb-f6607f02e3c4] calling os-brick to detach iSCSI Volume {{(pid=75226) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 17 01:39:52 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e4939dd-63f1-40df-a295-6ccc9596da8f tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc4cc36b490>, {'target_iqn': 'iqn.2010-10.org.openstack:a17c9b1e-9d6c-44b4-8c8a-c4b152e806d7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WoFEvqxr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:39:52 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-8e4939dd-63f1-40df-a295-6ccc9596da8f tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:39:52 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-8e4939dd-63f1-40df-a295-6ccc9596da8f tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:39:52 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-8e4939dd-63f1-40df-a295-6ccc9596da8f tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:39:52 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:39:52 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:39:52 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[05d0259a-1e83-44e3-a4a7-238f43050324]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9bb94c67-f3ce-4642-8f8d-3c59a63802ac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:42287bb8-179a-4f5d-adc3-ab6e03ef12dd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8533a134-db8d-4602-84e0-cf4c2fd4dd30\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:afbcbbf4-d90c-4224-869f-904342190f6c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a17c9b1e-9d6c-44b4-8c8a-c4b152e806d7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:39:52 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e4939dd-63f1-40df-a295-6ccc9596da8f tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 17 01:39:52 user nova-compute[75226]: No targets found.
Nov 17 01:39:52 user nova-compute[75226]: iSNS:
Nov 17 01:39:52 user nova-compute[75226]: No targets found.
Nov 17 01:39:52 user nova-compute[75226]: STATIC:
Nov 17 01:39:52 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:9bb94c67-f3ce-4642-8f8d-3c59a63802ac
Nov 17 01:39:52 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:39:52 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:39:52 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:42287bb8-179a-4f5d-adc3-ab6e03ef12dd
Nov 17 01:39:52 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:39:52 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:39:52 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:8533a134-db8d-4602-84e0-cf4c2fd4dd30
Nov 17 01:39:52 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:39:52 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:39:52 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:afbcbbf4-d90c-4224-869f-904342190f6c
Nov 17 01:39:52 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:39:52 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:39:52 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:a17c9b1e-9d6c-44b4-8c8a-c4b152e806d7
Nov 17 01:39:52 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:39:52 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:39:52 user nova-compute[75226]: FIRMWARE:
Nov 17 01:39:52 user nova-compute[75226]: No targets found.
Nov 17 01:39:52 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:39:52 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e4939dd-63f1-40df-a295-6ccc9596da8f tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 17 01:39:52 user nova-compute[75226]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 17 01:39:52 user nova-compute[75226]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75226) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 17 01:39:52 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e4939dd-63f1-40df-a295-6ccc9596da8f tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a17c9b1e-9d6c-44b4-8c8a-c4b152e806d7', 0)] {{(pid=75226) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 17 01:39:52 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:39:52 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:39:52 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[46e098a3-5465-4ed9-83a2-c44548f49321]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:42287bb8-179a-4f5d-adc3-ab6e03ef12dd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8533a134-db8d-4602-84e0-cf4c2fd4dd30\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9bb94c67-f3ce-4642-8f8d-3c59a63802ac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a17c9b1e-9d6c-44b4-8c8a-c4b152e806d7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:afbcbbf4-d90c-4224-869f-904342190f6c\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:39:52 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:39:52 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:39:52 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[c52ba2e4-a6de-405e-b0f7-b015a7f310a6]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bb94c67-f3ce-4642-8f8d-3c59a63802ac (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afbcbbf4-d90c-4224-869f-904342190f6c (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a17c9b1e-9d6c-44b4-8c8a-c4b152e806d7 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8533a134-db8d-4602-84e0-cf4c2fd4dd30 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42287bb8-179a-4f5d-adc3-ab6e03ef12dd (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:39:52 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e4939dd-63f1-40df-a295-6ccc9596da8f tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bb94c67-f3ce-4642-8f8d-3c59a63802ac (non-flash)
Nov 17 01:39:52 user nova-compute[75226]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afbcbbf4-d90c-4224-869f-904342190f6c (non-flash)
Nov 17 01:39:52 user nova-compute[75226]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a17c9b1e-9d6c-44b4-8c8a-c4b152e806d7 (non-flash)
Nov 17 01:39:52 user nova-compute[75226]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8533a134-db8d-4602-84e0-cf4c2fd4dd30 (non-flash)
Nov 17 01:39:52 user nova-compute[75226]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42287bb8-179a-4f5d-adc3-ab6e03ef12dd (non-flash)
Nov 17 01:39:52 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:39:52 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e4939dd-63f1-40df-a295-6ccc9596da8f tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bb94c67-f3ce-4642-8f8d-3c59a63802ac (non-flash)
Nov 17 01:39:52 user nova-compute[75226]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afbcbbf4-d90c-4224-869f-904342190f6c (non-flash)
Nov 17 01:39:52 user nova-compute[75226]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a17c9b1e-9d6c-44b4-8c8a-c4b152e806d7 (non-flash)
Nov 17 01:39:52 user nova-compute[75226]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8533a134-db8d-4602-84e0-cf4c2fd4dd30 (non-flash)
Nov 17 01:39:52 user nova-compute[75226]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42287bb8-179a-4f5d-adc3-ab6e03ef12dd (non-flash)
Nov 17 01:39:52 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:39:52 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e4939dd-63f1-40df-a295-6ccc9596da8f tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc4b41ffeb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a17c9b1e-9d6c-44b4-8c8a-c4b152e806d7'): ({'sdf'}, set())}) {{(pid=75226) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 17 01:39:52 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-8e4939dd-63f1-40df-a295-6ccc9596da8f tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] Removing single pathed devices sdf {{(pid=75226) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 17 01:39:52 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:39:52 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:39:52 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[92397513-8e39-4257-bcc7-004ea45111de]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:39:52 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:39:52 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:39:52 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[d01db1a8-6f6a-4aa1-add0-29d5efaaa4be]: (4, ('ok\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:39:52 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-8e4939dd-63f1-40df-a295-6ccc9596da8f tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] Flushing IO for device /dev/sdf {{(pid=75226) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 17 01:39:52 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:39:52 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.012s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:39:52 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[37ec2e6f-a325-459a-91cc-0c4a66cef241]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:39:52 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-8e4939dd-63f1-40df-a295-6ccc9596da8f tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75226) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 17 01:39:52 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:39:52 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.033s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:39:52 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[efaf2c5a-bd95-4a32-8613-9ea711101843]: (4, ('1', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:39:52 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-8e4939dd-63f1-40df-a295-6ccc9596da8f tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75226) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 17 01:39:52 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-8e4939dd-63f1-40df-a295-6ccc9596da8f tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] SCSI volumes sdf have been removed. {{(pid=75226) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 17 01:39:52 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e4939dd-63f1-40df-a295-6ccc9596da8f tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a17c9b1e-9d6c-44b4-8c8a-c4b152e806d7')] {{(pid=75226) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 17 01:39:52 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a17c9b1e-9d6c-44b4-8c8a-c4b152e806d7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:39:52 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a17c9b1e-9d6c-44b4-8c8a-c4b152e806d7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:39:52 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ed8e20e-a2d3-44ce-9882-296b84c08d2b]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:39:52 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e4939dd-63f1-40df-a295-6ccc9596da8f tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:39:52 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a17c9b1e-9d6c-44b4-8c8a-c4b152e806d7 -p 172.16.0.220:3260 --logout {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:39:52 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a17c9b1e-9d6c-44b4-8c8a-c4b152e806d7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:39:52 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc4d07ea-b8b8-417f-b4cf-a6b503f6fff6]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:a17c9b1e-9d6c-44b4-8c8a-c4b152e806d7, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:a17c9b1e-9d6c-44b4-8c8a-c4b152e806d7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:39:52 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e4939dd-63f1-40df-a295-6ccc9596da8f tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:a17c9b1e-9d6c-44b4-8c8a-c4b152e806d7, portal: 172.16.0.220,3260]
Nov 17 01:39:52 user nova-compute[75226]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:a17c9b1e-9d6c-44b4-8c8a-c4b152e806d7, portal: 172.16.0.220,3260] successful.
Nov 17 01:39:52 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:39:52 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a17c9b1e-9d6c-44b4-8c8a-c4b152e806d7 -p 172.16.0.220:3260 --op delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:39:52 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a17c9b1e-9d6c-44b4-8c8a-c4b152e806d7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:39:52 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffe9739f-5c00-4e9a-9269-3e5e5e9ceb8c]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:39:52 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e4939dd-63f1-40df-a295-6ccc9596da8f tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:39:52 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-8e4939dd-63f1-40df-a295-6ccc9596da8f tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:39:52 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e4939dd-63f1-40df-a295-6ccc9596da8f tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] <== disconnect_volume: return (297ms) None {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:39:52 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e4939dd-63f1-40df-a295-6ccc9596da8f tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] [instance: d6d21784-2ebe-4a39-9ceb-f6607f02e3c4] Disconnected iSCSI Volume {{(pid=75226) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 17 01:39:53 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:39:53 user nova-compute[75226]: DEBUG nova.objects.instance [None req-8e4939dd-63f1-40df-a295-6ccc9596da8f tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] Lazy-loading 'flavor' on Instance uuid d6d21784-2ebe-4a39-9ceb-f6607f02e3c4 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:39:53 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-8e4939dd-63f1-40df-a295-6ccc9596da8f tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] Lock "d6d21784-2ebe-4a39-9ceb-f6607f02e3c4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.739s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:39:53 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:39:55 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-c9d63f9a-eccb-4a98-b14f-3c76c306ce29 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 0597c05a-1049-4117-a8ae-8177d590e024 is timed out.
Nov 17 01:39:55 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-c9d63f9a-eccb-4a98-b14f-3c76c306ce29 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Successfully detached device vdb from instance 0597c05a-1049-4117-a8ae-8177d590e024 from the live domain config.
Nov 17 01:39:55 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9d63f9a-eccb-4a98-b14f-3c76c306ce29 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] [instance: 0597c05a-1049-4117-a8ae-8177d590e024] calling os-brick to detach iSCSI Volume {{(pid=75226) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 17 01:39:55 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d63f9a-eccb-4a98-b14f-3c76c306ce29 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc4cc36b490>, {'target_iqn': 'iqn.2010-10.org.openstack:8533a134-db8d-4602-84e0-cf4c2fd4dd30', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FOYBQJNy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:39:55 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-c9d63f9a-eccb-4a98-b14f-3c76c306ce29 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:39:55 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-c9d63f9a-eccb-4a98-b14f-3c76c306ce29 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:39:55 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-c9d63f9a-eccb-4a98-b14f-3c76c306ce29 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:39:55 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:39:55 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:39:55 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a769cd9-a3bf-4406-a48d-f542d4d12982]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9bb94c67-f3ce-4642-8f8d-3c59a63802ac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:42287bb8-179a-4f5d-adc3-ab6e03ef12dd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8533a134-db8d-4602-84e0-cf4c2fd4dd30\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:afbcbbf4-d90c-4224-869f-904342190f6c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:39:55 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d63f9a-eccb-4a98-b14f-3c76c306ce29 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 17 01:39:55 user nova-compute[75226]: No targets found.
Nov 17 01:39:55 user nova-compute[75226]: iSNS:
Nov 17 01:39:55 user nova-compute[75226]: No targets found.
Nov 17 01:39:55 user nova-compute[75226]: STATIC:
Nov 17 01:39:55 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:9bb94c67-f3ce-4642-8f8d-3c59a63802ac
Nov 17 01:39:55 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:39:55 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:39:55 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:42287bb8-179a-4f5d-adc3-ab6e03ef12dd
Nov 17 01:39:55 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:39:55 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:39:55 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:8533a134-db8d-4602-84e0-cf4c2fd4dd30
Nov 17 01:39:55 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:39:55 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:39:55 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:afbcbbf4-d90c-4224-869f-904342190f6c
Nov 17 01:39:55 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:39:55 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:39:55 user nova-compute[75226]: FIRMWARE:
Nov 17 01:39:55 user nova-compute[75226]: No targets found.
Nov 17 01:39:55 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:39:55 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d63f9a-eccb-4a98-b14f-3c76c306ce29 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 17 01:39:55 user nova-compute[75226]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 17 01:39:55 user nova-compute[75226]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75226) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 17 01:39:55 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d63f9a-eccb-4a98-b14f-3c76c306ce29 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8533a134-db8d-4602-84e0-cf4c2fd4dd30', 0)] {{(pid=75226) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 17 01:39:55 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:39:55 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:39:55 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca8e941d-0e13-4933-8a96-52c24b8d5dd3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:42287bb8-179a-4f5d-adc3-ab6e03ef12dd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8533a134-db8d-4602-84e0-cf4c2fd4dd30\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9bb94c67-f3ce-4642-8f8d-3c59a63802ac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:afbcbbf4-d90c-4224-869f-904342190f6c\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:39:55 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:39:55 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:39:55 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cd47461-8eb5-41fa-8bf7-f9230fcc9147]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bb94c67-f3ce-4642-8f8d-3c59a63802ac (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afbcbbf4-d90c-4224-869f-904342190f6c (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8533a134-db8d-4602-84e0-cf4c2fd4dd30 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42287bb8-179a-4f5d-adc3-ab6e03ef12dd (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:39:55 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d63f9a-eccb-4a98-b14f-3c76c306ce29 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bb94c67-f3ce-4642-8f8d-3c59a63802ac (non-flash)
Nov 17 01:39:55 user nova-compute[75226]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afbcbbf4-d90c-4224-869f-904342190f6c (non-flash)
Nov 17 01:39:55 user nova-compute[75226]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8533a134-db8d-4602-84e0-cf4c2fd4dd30 (non-flash)
Nov 17 01:39:55 user nova-compute[75226]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42287bb8-179a-4f5d-adc3-ab6e03ef12dd (non-flash)
Nov 17 01:39:55 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:39:55 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d63f9a-eccb-4a98-b14f-3c76c306ce29 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bb94c67-f3ce-4642-8f8d-3c59a63802ac (non-flash)
Nov 17 01:39:55 user nova-compute[75226]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afbcbbf4-d90c-4224-869f-904342190f6c (non-flash)
Nov 17 01:39:55 user nova-compute[75226]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8533a134-db8d-4602-84e0-cf4c2fd4dd30 (non-flash)
Nov 17 01:39:55 user nova-compute[75226]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42287bb8-179a-4f5d-adc3-ab6e03ef12dd (non-flash)
Nov 17 01:39:55 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:39:55 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d63f9a-eccb-4a98-b14f-3c76c306ce29 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc4b445ac20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8533a134-db8d-4602-84e0-cf4c2fd4dd30'): ({'sdg'}, set())}) {{(pid=75226) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 17 01:39:55 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-c9d63f9a-eccb-4a98-b14f-3c76c306ce29 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Removing single pathed devices sdg {{(pid=75226) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 17 01:39:55 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:39:55 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:39:55 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[12001082-ac5f-4a3e-a388-98323285ca24]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:39:55 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:39:55 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:39:55 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[97aaed08-b69a-41cf-8e8a-e2070edafd1a]: (4, ('ok\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:39:55 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-c9d63f9a-eccb-4a98-b14f-3c76c306ce29 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Flushing IO for device /dev/sdg {{(pid=75226) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 17 01:39:55 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:39:55 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.015s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:39:55 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[770f15c8-de8c-4f1c-a431-6216870ed4a6]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:39:55 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-c9d63f9a-eccb-4a98-b14f-3c76c306ce29 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75226) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 17 01:39:55 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:39:55 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.045s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:39:55 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[0043bb16-790e-4764-8a2b-733ea59c38b6]: (4, ('1', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:39:55 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-c9d63f9a-eccb-4a98-b14f-3c76c306ce29 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75226) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 17 01:39:55 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-c9d63f9a-eccb-4a98-b14f-3c76c306ce29 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] SCSI volumes sdg have been removed. {{(pid=75226) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 17 01:39:55 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d63f9a-eccb-4a98-b14f-3c76c306ce29 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8533a134-db8d-4602-84e0-cf4c2fd4dd30')] {{(pid=75226) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 17 01:39:55 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8533a134-db8d-4602-84e0-cf4c2fd4dd30 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:39:55 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8533a134-db8d-4602-84e0-cf4c2fd4dd30 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.033s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:39:55 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[08b11635-110d-4b1b-ba3f-c4794cb46e15]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:39:55 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d63f9a-eccb-4a98-b14f-3c76c306ce29 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:39:55 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8533a134-db8d-4602-84e0-cf4c2fd4dd30 -p 172.16.0.220:3260 --logout {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:39:55 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8533a134-db8d-4602-84e0-cf4c2fd4dd30 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:39:55 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[c78b8ee8-be7e-4959-b5cc-ce465711d8e2]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:8533a134-db8d-4602-84e0-cf4c2fd4dd30, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:8533a134-db8d-4602-84e0-cf4c2fd4dd30, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:39:55 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d63f9a-eccb-4a98-b14f-3c76c306ce29 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:8533a134-db8d-4602-84e0-cf4c2fd4dd30, portal: 172.16.0.220,3260]
Nov 17 01:39:55 user nova-compute[75226]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:8533a134-db8d-4602-84e0-cf4c2fd4dd30, portal: 172.16.0.220,3260] successful.
Nov 17 01:39:55 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:39:55 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8533a134-db8d-4602-84e0-cf4c2fd4dd30 -p 172.16.0.220:3260 --op delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:39:55 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8533a134-db8d-4602-84e0-cf4c2fd4dd30 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:39:55 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bd76a18-882a-4ac8-b17d-f937c45d2d19]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:39:55 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d63f9a-eccb-4a98-b14f-3c76c306ce29 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:39:55 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-c9d63f9a-eccb-4a98-b14f-3c76c306ce29 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.330s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:39:55 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d63f9a-eccb-4a98-b14f-3c76c306ce29 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] <== disconnect_volume: return (332ms) None {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:39:55 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9d63f9a-eccb-4a98-b14f-3c76c306ce29 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] [instance: 0597c05a-1049-4117-a8ae-8177d590e024] Disconnected iSCSI Volume {{(pid=75226) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 17 01:39:56 user nova-compute[75226]: DEBUG nova.objects.instance [None req-c9d63f9a-eccb-4a98-b14f-3c76c306ce29 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Lazy-loading 'flavor' on Instance uuid 0597c05a-1049-4117-a8ae-8177d590e024 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:39:56 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-c9d63f9a-eccb-4a98-b14f-3c76c306ce29 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Lock "0597c05a-1049-4117-a8ae-8177d590e024" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.722s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:39:58 user nova-compute[75226]: DEBUG nova.compute.manager [req-f33732a4-ca60-4ca8-8944-f3ab7b8ac240 req-5de23249-c724-403b-83c5-1584d7072735 service nova] [instance: 8d983732-91aa-4f20-9d7d-3de66029cba5] Received event network-changed-2ef7c6ef-e077-49c7-aaca-1d8ba7e7335c {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:39:58 user nova-compute[75226]: DEBUG nova.compute.manager [req-f33732a4-ca60-4ca8-8944-f3ab7b8ac240 req-5de23249-c724-403b-83c5-1584d7072735 service nova] [instance: 8d983732-91aa-4f20-9d7d-3de66029cba5] Refreshing instance network info cache due to event network-changed-2ef7c6ef-e077-49c7-aaca-1d8ba7e7335c. {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 01:39:58 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-f33732a4-ca60-4ca8-8944-f3ab7b8ac240 req-5de23249-c724-403b-83c5-1584d7072735 service nova] Acquiring lock "refresh_cache-8d983732-91aa-4f20-9d7d-3de66029cba5" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:39:58 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-f33732a4-ca60-4ca8-8944-f3ab7b8ac240 req-5de23249-c724-403b-83c5-1584d7072735 service nova] Acquired lock "refresh_cache-8d983732-91aa-4f20-9d7d-3de66029cba5" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:39:58 user nova-compute[75226]: DEBUG nova.network.neutron [req-f33732a4-ca60-4ca8-8944-f3ab7b8ac240 req-5de23249-c724-403b-83c5-1584d7072735 service nova] [instance: 8d983732-91aa-4f20-9d7d-3de66029cba5] Refreshing network info cache for port 2ef7c6ef-e077-49c7-aaca-1d8ba7e7335c {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 01:39:58 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:39:58 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:39:58 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-58488bee-3991-4172-b16a-bb1d4394ee70 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Acquiring lock "8d983732-91aa-4f20-9d7d-3de66029cba5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:39:58 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-58488bee-3991-4172-b16a-bb1d4394ee70 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Lock "8d983732-91aa-4f20-9d7d-3de66029cba5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:39:58 user nova-compute[75226]: INFO nova.compute.manager [None req-58488bee-3991-4172-b16a-bb1d4394ee70 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] [instance: 8d983732-91aa-4f20-9d7d-3de66029cba5] Detaching volume 9bb94c67-f3ce-4642-8f8d-3c59a63802ac
Nov 17 01:39:58 user nova-compute[75226]: DEBUG nova.network.neutron [req-f33732a4-ca60-4ca8-8944-f3ab7b8ac240 req-5de23249-c724-403b-83c5-1584d7072735 service nova] [instance: 8d983732-91aa-4f20-9d7d-3de66029cba5] Updated VIF entry in instance network info cache for port 2ef7c6ef-e077-49c7-aaca-1d8ba7e7335c. {{(pid=75226) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 01:39:58 user nova-compute[75226]: DEBUG nova.network.neutron [req-f33732a4-ca60-4ca8-8944-f3ab7b8ac240 req-5de23249-c724-403b-83c5-1584d7072735 service nova] [instance: 8d983732-91aa-4f20-9d7d-3de66029cba5] Updating instance_info_cache with network_info: [{"id": "2ef7c6ef-e077-49c7-aaca-1d8ba7e7335c", "address": "fa:16:3e:90:7b:a1", "network": {"id": "a9710b94-56f8-4cf6-9bb6-344b275e5bf2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-512340839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2052a37a068e4d948c57560c0f4445e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ef7c6ef-e0", "ovs_interfaceid": "2ef7c6ef-e077-49c7-aaca-1d8ba7e7335c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:39:58 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-f33732a4-ca60-4ca8-8944-f3ab7b8ac240 req-5de23249-c724-403b-83c5-1584d7072735 service nova] Releasing lock "refresh_cache-8d983732-91aa-4f20-9d7d-3de66029cba5" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:39:58 user nova-compute[75226]: INFO nova.virt.block_device [None req-58488bee-3991-4172-b16a-bb1d4394ee70 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] [instance: 8d983732-91aa-4f20-9d7d-3de66029cba5] Attempting to driver detach volume 9bb94c67-f3ce-4642-8f8d-3c59a63802ac from mountpoint /dev/vdb
Nov 17 01:39:58 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-58488bee-3991-4172-b16a-bb1d4394ee70 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Attempting to detach device vdb from instance 8d983732-91aa-4f20-9d7d-3de66029cba5 from the persistent domain config. {{(pid=75226) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 17 01:39:58 user nova-compute[75226]: DEBUG nova.virt.libvirt.guest [None req-58488bee-3991-4172-b16a-bb1d4394ee70 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] detach device xml: <disk type="block" device="disk">
Nov 17 01:39:58 user nova-compute[75226]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 01:39:58 user nova-compute[75226]:   <source dev="/dev/sdd"/>
Nov 17 01:39:58 user nova-compute[75226]:   <target dev="vdb" bus="virtio"/>
Nov 17 01:39:58 user nova-compute[75226]:   <serial>9bb94c67-f3ce-4642-8f8d-3c59a63802ac</serial>
Nov 17 01:39:58 user nova-compute[75226]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 17 01:39:58 user nova-compute[75226]: </disk>
Nov 17 01:39:58 user nova-compute[75226]:  {{(pid=75226) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 17 01:39:58 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-58488bee-3991-4172-b16a-bb1d4394ee70 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Successfully detached device vdb from instance 8d983732-91aa-4f20-9d7d-3de66029cba5 from the persistent domain config.
Nov 17 01:39:58 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-58488bee-3991-4172-b16a-bb1d4394ee70 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8d983732-91aa-4f20-9d7d-3de66029cba5 from the live domain config. {{(pid=75226) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 17 01:39:58 user nova-compute[75226]: DEBUG nova.virt.libvirt.guest [None req-58488bee-3991-4172-b16a-bb1d4394ee70 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] detach device xml: <disk type="block" device="disk">
Nov 17 01:39:58 user nova-compute[75226]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 01:39:58 user nova-compute[75226]:   <source dev="/dev/sdd"/>
Nov 17 01:39:58 user nova-compute[75226]:   <target dev="vdb" bus="virtio"/>
Nov 17 01:39:58 user nova-compute[75226]:   <serial>9bb94c67-f3ce-4642-8f8d-3c59a63802ac</serial>
Nov 17 01:39:58 user nova-compute[75226]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 17 01:39:58 user nova-compute[75226]: </disk>
Nov 17 01:39:58 user nova-compute[75226]:  {{(pid=75226) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 17 01:39:59 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-58488bee-3991-4172-b16a-bb1d4394ee70 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8d983732-91aa-4f20-9d7d-3de66029cba5 {{(pid=75226) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 17 01:40:00 user nova-compute[75226]: DEBUG nova.compute.manager [req-35251cdf-b4bc-489c-a5ca-1a539837f21b req-dbda9670-7b23-4c7a-9baa-a7a8879028ee service nova] [instance: 8d983732-91aa-4f20-9d7d-3de66029cba5] Received event network-changed-2ef7c6ef-e077-49c7-aaca-1d8ba7e7335c {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:40:00 user nova-compute[75226]: DEBUG nova.compute.manager [req-35251cdf-b4bc-489c-a5ca-1a539837f21b req-dbda9670-7b23-4c7a-9baa-a7a8879028ee service nova] [instance: 8d983732-91aa-4f20-9d7d-3de66029cba5] Refreshing instance network info cache due to event network-changed-2ef7c6ef-e077-49c7-aaca-1d8ba7e7335c. {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 01:40:00 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-35251cdf-b4bc-489c-a5ca-1a539837f21b req-dbda9670-7b23-4c7a-9baa-a7a8879028ee service nova] Acquiring lock "refresh_cache-8d983732-91aa-4f20-9d7d-3de66029cba5" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:40:00 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-35251cdf-b4bc-489c-a5ca-1a539837f21b req-dbda9670-7b23-4c7a-9baa-a7a8879028ee service nova] Acquired lock "refresh_cache-8d983732-91aa-4f20-9d7d-3de66029cba5" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:40:00 user nova-compute[75226]: DEBUG nova.network.neutron [req-35251cdf-b4bc-489c-a5ca-1a539837f21b req-dbda9670-7b23-4c7a-9baa-a7a8879028ee service nova] [instance: 8d983732-91aa-4f20-9d7d-3de66029cba5] Refreshing network info cache for port 2ef7c6ef-e077-49c7-aaca-1d8ba7e7335c {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 01:40:00 user nova-compute[75226]: DEBUG nova.network.neutron [req-35251cdf-b4bc-489c-a5ca-1a539837f21b req-dbda9670-7b23-4c7a-9baa-a7a8879028ee service nova] [instance: 8d983732-91aa-4f20-9d7d-3de66029cba5] Updated VIF entry in instance network info cache for port 2ef7c6ef-e077-49c7-aaca-1d8ba7e7335c. {{(pid=75226) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 01:40:00 user nova-compute[75226]: DEBUG nova.network.neutron [req-35251cdf-b4bc-489c-a5ca-1a539837f21b req-dbda9670-7b23-4c7a-9baa-a7a8879028ee service nova] [instance: 8d983732-91aa-4f20-9d7d-3de66029cba5] Updating instance_info_cache with network_info: [{"id": "2ef7c6ef-e077-49c7-aaca-1d8ba7e7335c", "address": "fa:16:3e:90:7b:a1", "network": {"id": "a9710b94-56f8-4cf6-9bb6-344b275e5bf2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-512340839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2052a37a068e4d948c57560c0f4445e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ef7c6ef-e0", "ovs_interfaceid": "2ef7c6ef-e077-49c7-aaca-1d8ba7e7335c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:40:00 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-35251cdf-b4bc-489c-a5ca-1a539837f21b req-dbda9670-7b23-4c7a-9baa-a7a8879028ee service nova] Releasing lock "refresh_cache-8d983732-91aa-4f20-9d7d-3de66029cba5" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:40:03 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:40:03 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:40:08 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:40:08 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:40:08 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:40:08 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:40:08 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:40:08 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:40:08 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75226) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 17 01:40:09 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c4a9724-533e-40c8-ab2a-ce3415af240a/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:40:09 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c4a9724-533e-40c8-ab2a-ce3415af240a/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:40:09 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c4a9724-533e-40c8-ab2a-ce3415af240a/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:40:09 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c4a9724-533e-40c8-ab2a-ce3415af240a/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:40:09 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75226) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 01:40:09 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6d21784-2ebe-4a39-9ceb-f6607f02e3c4/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:40:09 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6d21784-2ebe-4a39-9ceb-f6607f02e3c4/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:40:09 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6d21784-2ebe-4a39-9ceb-f6607f02e3c4/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:40:09 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6d21784-2ebe-4a39-9ceb-f6607f02e3c4/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:40:09 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75226) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 01:40:09 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57f2553-feb4-49d8-a47b-dedbb4487f9e/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:40:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57f2553-feb4-49d8-a47b-dedbb4487f9e/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:40:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57f2553-feb4-49d8-a47b-dedbb4487f9e/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:40:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57f2553-feb4-49d8-a47b-dedbb4487f9e/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:40:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38062487-67ca-4962-974f-81456aebe97b/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:40:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38062487-67ca-4962-974f-81456aebe97b/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:40:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38062487-67ca-4962-974f-81456aebe97b/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:40:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38062487-67ca-4962-974f-81456aebe97b/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:40:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c280142-8901-4f83-bde4-baaa097e05b0/disk.rescue --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:40:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c280142-8901-4f83-bde4-baaa097e05b0/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:40:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c280142-8901-4f83-bde4-baaa097e05b0/disk.rescue --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:40:11 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c280142-8901-4f83-bde4-baaa097e05b0/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:40:11 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c280142-8901-4f83-bde4-baaa097e05b0/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:40:11 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c280142-8901-4f83-bde4-baaa097e05b0/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:40:11 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c280142-8901-4f83-bde4-baaa097e05b0/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:40:11 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c280142-8901-4f83-bde4-baaa097e05b0/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:40:11 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6555d72-6094-4ea9-b071-a3d3c8a300a9/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:40:11 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6555d72-6094-4ea9-b071-a3d3c8a300a9/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:40:11 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6555d72-6094-4ea9-b071-a3d3c8a300a9/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:40:11 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6555d72-6094-4ea9-b071-a3d3c8a300a9/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:40:11 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0597c05a-1049-4117-a8ae-8177d590e024/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:40:11 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0597c05a-1049-4117-a8ae-8177d590e024/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:40:11 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0597c05a-1049-4117-a8ae-8177d590e024/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:40:12 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0597c05a-1049-4117-a8ae-8177d590e024/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:40:12 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d983732-91aa-4f20-9d7d-3de66029cba5/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:40:12 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d983732-91aa-4f20-9d7d-3de66029cba5/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:40:12 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d983732-91aa-4f20-9d7d-3de66029cba5/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:40:12 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d983732-91aa-4f20-9d7d-3de66029cba5/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:40:12 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:40:12 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:40:12 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Hypervisor/Node resource view: name=user free_ram=7926MB free_disk=24.876331329345703GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75226) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 17 01:40:12 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:40:12 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:40:13 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 38062487-67ca-4962-974f-81456aebe97b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:40:13 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance d6555d72-6094-4ea9-b071-a3d3c8a300a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:40:13 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 5c280142-8901-4f83-bde4-baaa097e05b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:40:13 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 8d983732-91aa-4f20-9d7d-3de66029cba5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:40:13 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 8c4a9724-533e-40c8-ab2a-ce3415af240a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:40:13 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance d6d21784-2ebe-4a39-9ceb-f6607f02e3c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:40:13 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 0597c05a-1049-4117-a8ae-8177d590e024 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:40:13 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance d57f2553-feb4-49d8-a47b-dedbb4487f9e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:40:13 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75226) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 17 01:40:13 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75226) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 17 01:40:13 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:40:13 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:40:13 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Compute_service record updated for user:user {{(pid=75226) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 17 01:40:13 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.414s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:40:13 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:40:14 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:40:14 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:40:15 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:40:17 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:40:18 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:40:19 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-58488bee-3991-4172-b16a-bb1d4394ee70 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 8d983732-91aa-4f20-9d7d-3de66029cba5 is timed out.
Nov 17 01:40:19 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-58488bee-3991-4172-b16a-bb1d4394ee70 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Successfully detached device vdb from instance 8d983732-91aa-4f20-9d7d-3de66029cba5 from the live domain config.
Nov 17 01:40:19 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-58488bee-3991-4172-b16a-bb1d4394ee70 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] [instance: 8d983732-91aa-4f20-9d7d-3de66029cba5] calling os-brick to detach iSCSI Volume {{(pid=75226) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 17 01:40:19 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-58488bee-3991-4172-b16a-bb1d4394ee70 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc4cc36b490>, {'target_iqn': 'iqn.2010-10.org.openstack:9bb94c67-f3ce-4642-8f8d-3c59a63802ac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AyETfcZx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:40:19 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-58488bee-3991-4172-b16a-bb1d4394ee70 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:40:19 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-58488bee-3991-4172-b16a-bb1d4394ee70 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:40:19 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-58488bee-3991-4172-b16a-bb1d4394ee70 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:40:19 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:40:19 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:40:19 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5c9379a-0c65-42a0-9a86-985c9618eab9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9bb94c67-f3ce-4642-8f8d-3c59a63802ac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:42287bb8-179a-4f5d-adc3-ab6e03ef12dd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:afbcbbf4-d90c-4224-869f-904342190f6c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:40:19 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-58488bee-3991-4172-b16a-bb1d4394ee70 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 17 01:40:19 user nova-compute[75226]: No targets found.
Nov 17 01:40:19 user nova-compute[75226]: iSNS:
Nov 17 01:40:19 user nova-compute[75226]: No targets found.
Nov 17 01:40:19 user nova-compute[75226]: STATIC:
Nov 17 01:40:19 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:9bb94c67-f3ce-4642-8f8d-3c59a63802ac
Nov 17 01:40:19 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:40:19 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:40:19 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:42287bb8-179a-4f5d-adc3-ab6e03ef12dd
Nov 17 01:40:19 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:40:19 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:40:19 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:afbcbbf4-d90c-4224-869f-904342190f6c
Nov 17 01:40:19 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:40:19 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:40:19 user nova-compute[75226]: FIRMWARE:
Nov 17 01:40:19 user nova-compute[75226]: No targets found.
Nov 17 01:40:19 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:40:19 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-58488bee-3991-4172-b16a-bb1d4394ee70 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 17 01:40:19 user nova-compute[75226]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 17 01:40:19 user nova-compute[75226]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75226) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 17 01:40:19 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-58488bee-3991-4172-b16a-bb1d4394ee70 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9bb94c67-f3ce-4642-8f8d-3c59a63802ac', 0)] {{(pid=75226) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 17 01:40:19 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:40:19 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:40:19 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6a514c5-f2a4-47dc-ac8a-5e6a2955c5ea]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:42287bb8-179a-4f5d-adc3-ab6e03ef12dd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9bb94c67-f3ce-4642-8f8d-3c59a63802ac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:afbcbbf4-d90c-4224-869f-904342190f6c\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:40:19 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:40:19 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:40:19 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed977234-188c-4f3d-8c94-74c5d6c879a5]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bb94c67-f3ce-4642-8f8d-3c59a63802ac (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afbcbbf4-d90c-4224-869f-904342190f6c (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42287bb8-179a-4f5d-adc3-ab6e03ef12dd (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:40:19 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-58488bee-3991-4172-b16a-bb1d4394ee70 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bb94c67-f3ce-4642-8f8d-3c59a63802ac (non-flash)
Nov 17 01:40:19 user nova-compute[75226]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afbcbbf4-d90c-4224-869f-904342190f6c (non-flash)
Nov 17 01:40:19 user nova-compute[75226]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42287bb8-179a-4f5d-adc3-ab6e03ef12dd (non-flash)
Nov 17 01:40:19 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:40:19 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-58488bee-3991-4172-b16a-bb1d4394ee70 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bb94c67-f3ce-4642-8f8d-3c59a63802ac (non-flash)
Nov 17 01:40:19 user nova-compute[75226]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afbcbbf4-d90c-4224-869f-904342190f6c (non-flash)
Nov 17 01:40:19 user nova-compute[75226]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42287bb8-179a-4f5d-adc3-ab6e03ef12dd (non-flash)
Nov 17 01:40:19 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:40:19 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-58488bee-3991-4172-b16a-bb1d4394ee70 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc4b45d3490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9bb94c67-f3ce-4642-8f8d-3c59a63802ac'): ({'sdd'}, set())}) {{(pid=75226) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 17 01:40:19 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-58488bee-3991-4172-b16a-bb1d4394ee70 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Removing single pathed devices sdd {{(pid=75226) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 17 01:40:19 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:40:19 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:40:19 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ced86fa-a975-470a-a913-bf3cd8006048]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:40:19 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:40:19 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:40:19 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[74a61be1-a777-4866-9660-89095fdb5b76]: (4, ('ok\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:40:19 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-58488bee-3991-4172-b16a-bb1d4394ee70 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Flushing IO for device /dev/sdd {{(pid=75226) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 17 01:40:19 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:40:19 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:40:19 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0cff7bc-b064-4eb1-883d-eafaa99abc69]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:40:19 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-58488bee-3991-4172-b16a-bb1d4394ee70 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75226) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 17 01:40:19 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:40:19 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.060s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:40:19 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[d694305f-12c2-4d89-a202-1018a9bb7823]: (4, ('1', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:40:19 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-58488bee-3991-4172-b16a-bb1d4394ee70 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75226) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 17 01:40:19 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-58488bee-3991-4172-b16a-bb1d4394ee70 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] SCSI volumes sdd have been removed. {{(pid=75226) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 17 01:40:19 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-58488bee-3991-4172-b16a-bb1d4394ee70 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9bb94c67-f3ce-4642-8f8d-3c59a63802ac')] {{(pid=75226) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 17 01:40:19 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9bb94c67-f3ce-4642-8f8d-3c59a63802ac -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:40:19 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9bb94c67-f3ce-4642-8f8d-3c59a63802ac -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:40:19 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[c73785b7-19ca-45b2-b6b6-e0d2cb0f6861]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:40:19 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-58488bee-3991-4172-b16a-bb1d4394ee70 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:40:19 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9bb94c67-f3ce-4642-8f8d-3c59a63802ac -p 172.16.0.220:3260 --logout {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:40:19 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9bb94c67-f3ce-4642-8f8d-3c59a63802ac -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:40:19 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[57d764b8-5d0a-4416-a714-93e6b54b326e]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:9bb94c67-f3ce-4642-8f8d-3c59a63802ac, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:9bb94c67-f3ce-4642-8f8d-3c59a63802ac, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:40:19 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-58488bee-3991-4172-b16a-bb1d4394ee70 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:9bb94c67-f3ce-4642-8f8d-3c59a63802ac, portal: 172.16.0.220,3260]
Nov 17 01:40:19 user nova-compute[75226]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:9bb94c67-f3ce-4642-8f8d-3c59a63802ac, portal: 172.16.0.220,3260] successful.
Nov 17 01:40:19 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:40:19 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9bb94c67-f3ce-4642-8f8d-3c59a63802ac -p 172.16.0.220:3260 --op delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:40:19 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9bb94c67-f3ce-4642-8f8d-3c59a63802ac -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:40:19 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[77e22730-708f-4f46-9dd4-dc63365f1a26]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:40:19 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-58488bee-3991-4172-b16a-bb1d4394ee70 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:40:19 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-58488bee-3991-4172-b16a-bb1d4394ee70 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.330s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:40:19 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-58488bee-3991-4172-b16a-bb1d4394ee70 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] <== disconnect_volume: return (331ms) None {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:40:19 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-58488bee-3991-4172-b16a-bb1d4394ee70 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] [instance: 8d983732-91aa-4f20-9d7d-3de66029cba5] Disconnected iSCSI Volume {{(pid=75226) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 17 01:40:19 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:40:19 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:40:20 user nova-compute[75226]: DEBUG nova.objects.instance [None req-58488bee-3991-4172-b16a-bb1d4394ee70 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Lazy-loading 'flavor' on Instance uuid 8d983732-91aa-4f20-9d7d-3de66029cba5 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:40:20 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-58488bee-3991-4172-b16a-bb1d4394ee70 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Lock "8d983732-91aa-4f20-9d7d-3de66029cba5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.679s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:40:20 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:40:20 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Starting heal instance info cache {{(pid=75226) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 17 01:40:21 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "refresh_cache-5c280142-8901-4f83-bde4-baaa097e05b0" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:40:21 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquired lock "refresh_cache-5c280142-8901-4f83-bde4-baaa097e05b0" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:40:21 user nova-compute[75226]: DEBUG nova.network.neutron [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] [instance: 5c280142-8901-4f83-bde4-baaa097e05b0] Forcefully refreshing network info cache for instance {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 17 01:40:21 user nova-compute[75226]: DEBUG nova.network.neutron [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] [instance: 5c280142-8901-4f83-bde4-baaa097e05b0] Updating instance_info_cache with network_info: [{"id": "3f54cf07-6d64-4e03-a3f7-bab096a18e89", "address": "fa:16:3e:41:48:98", "network": {"id": "a9710b94-56f8-4cf6-9bb6-344b275e5bf2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-512340839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2052a37a068e4d948c57560c0f4445e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f54cf07-6d", "ovs_interfaceid": "3f54cf07-6d64-4e03-a3f7-bab096a18e89", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:40:21 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Releasing lock "refresh_cache-5c280142-8901-4f83-bde4-baaa097e05b0" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:40:21 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] [instance: 5c280142-8901-4f83-bde4-baaa097e05b0] Updated the network info_cache for instance {{(pid=75226) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 17 01:40:22 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-cce77794-097f-42d5-919b-4a54da635036 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] Acquiring lock "d6d21784-2ebe-4a39-9ceb-f6607f02e3c4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:40:22 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-cce77794-097f-42d5-919b-4a54da635036 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] Lock "d6d21784-2ebe-4a39-9ceb-f6607f02e3c4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:40:22 user nova-compute[75226]: INFO nova.compute.manager [None req-cce77794-097f-42d5-919b-4a54da635036 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] [instance: d6d21784-2ebe-4a39-9ceb-f6607f02e3c4] Detaching volume afbcbbf4-d90c-4224-869f-904342190f6c
Nov 17 01:40:22 user nova-compute[75226]: INFO nova.virt.block_device [None req-cce77794-097f-42d5-919b-4a54da635036 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] [instance: d6d21784-2ebe-4a39-9ceb-f6607f02e3c4] Attempting to driver detach volume afbcbbf4-d90c-4224-869f-904342190f6c from mountpoint /dev/vdb
Nov 17 01:40:22 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-cce77794-097f-42d5-919b-4a54da635036 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] Attempting to detach device vdb from instance d6d21784-2ebe-4a39-9ceb-f6607f02e3c4 from the persistent domain config. {{(pid=75226) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 17 01:40:22 user nova-compute[75226]: DEBUG nova.virt.libvirt.guest [None req-cce77794-097f-42d5-919b-4a54da635036 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] detach device xml: <disk type="block" device="disk">
Nov 17 01:40:22 user nova-compute[75226]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 01:40:22 user nova-compute[75226]:   <source dev="/dev/sde"/>
Nov 17 01:40:22 user nova-compute[75226]:   <target dev="vdb" bus="virtio"/>
Nov 17 01:40:22 user nova-compute[75226]:   <serial>afbcbbf4-d90c-4224-869f-904342190f6c</serial>
Nov 17 01:40:22 user nova-compute[75226]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 17 01:40:22 user nova-compute[75226]: </disk>
Nov 17 01:40:22 user nova-compute[75226]:  {{(pid=75226) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 17 01:40:22 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-cce77794-097f-42d5-919b-4a54da635036 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] Successfully detached device vdb from instance d6d21784-2ebe-4a39-9ceb-f6607f02e3c4 from the persistent domain config.
Nov 17 01:40:22 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-cce77794-097f-42d5-919b-4a54da635036 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d6d21784-2ebe-4a39-9ceb-f6607f02e3c4 from the live domain config. {{(pid=75226) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 17 01:40:22 user nova-compute[75226]: DEBUG nova.virt.libvirt.guest [None req-cce77794-097f-42d5-919b-4a54da635036 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] detach device xml: <disk type="block" device="disk">
Nov 17 01:40:22 user nova-compute[75226]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 01:40:22 user nova-compute[75226]:   <source dev="/dev/sde"/>
Nov 17 01:40:22 user nova-compute[75226]:   <target dev="vdb" bus="virtio"/>
Nov 17 01:40:22 user nova-compute[75226]:   <serial>afbcbbf4-d90c-4224-869f-904342190f6c</serial>
Nov 17 01:40:22 user nova-compute[75226]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 17 01:40:22 user nova-compute[75226]: </disk>
Nov 17 01:40:22 user nova-compute[75226]:  {{(pid=75226) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 17 01:40:22 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-cce77794-097f-42d5-919b-4a54da635036 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d6d21784-2ebe-4a39-9ceb-f6607f02e3c4 {{(pid=75226) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 17 01:40:23 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:40:23 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:40:23 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75226) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 17 01:40:23 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75226) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 01:40:23 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75226) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 01:40:23 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:40:23 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:40:23 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75226) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 17 01:40:28 user nova-compute[75226]: DEBUG nova.compute.manager [None req-4356fbf5-c934-47e9-8b3f-374992cc5307 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] [instance: 0597c05a-1049-4117-a8ae-8177d590e024] Checking state {{(pid=75226) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 01:40:28 user nova-compute[75226]: INFO nova.compute.manager [None req-4356fbf5-c934-47e9-8b3f-374992cc5307 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] [instance: 0597c05a-1049-4117-a8ae-8177d590e024] instance snapshotting
Nov 17 01:40:28 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-4356fbf5-c934-47e9-8b3f-374992cc5307 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] [instance: 0597c05a-1049-4117-a8ae-8177d590e024] Beginning live snapshot process
Nov 17 01:40:28 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-4356fbf5-c934-47e9-8b3f-374992cc5307 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0597c05a-1049-4117-a8ae-8177d590e024/disk --force-share --output=json -f qcow2 {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:40:28 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:40:28 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-4356fbf5-c934-47e9-8b3f-374992cc5307 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0597c05a-1049-4117-a8ae-8177d590e024/disk --force-share --output=json -f qcow2" returned: 0 in 0.181s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:40:28 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-4356fbf5-c934-47e9-8b3f-374992cc5307 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0597c05a-1049-4117-a8ae-8177d590e024/disk --force-share --output=json -f qcow2 {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:40:28 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-4356fbf5-c934-47e9-8b3f-374992cc5307 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0597c05a-1049-4117-a8ae-8177d590e024/disk --force-share --output=json -f qcow2" returned: 0 in 0.184s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:40:28 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-4356fbf5-c934-47e9-8b3f-374992cc5307 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:40:28 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-4356fbf5-c934-47e9-8b3f-374992cc5307 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json" returned: 0 in 0.180s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:40:28 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-4356fbf5-c934-47e9-8b3f-374992cc5307 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmphdlrgat1/5e9139d119ee4b8696653ebba510312a.delta 1073741824 {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:40:29 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-4356fbf5-c934-47e9-8b3f-374992cc5307 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmphdlrgat1/5e9139d119ee4b8696653ebba510312a.delta 1073741824" returned: 0 in 0.059s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:40:29 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-4356fbf5-c934-47e9-8b3f-374992cc5307 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] [instance: 0597c05a-1049-4117-a8ae-8177d590e024] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 17 01:40:29 user nova-compute[75226]: DEBUG nova.virt.libvirt.guest [None req-4356fbf5-c934-47e9-8b3f-374992cc5307 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=75226) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 17 01:40:30 user nova-compute[75226]: DEBUG nova.virt.libvirt.guest [None req-4356fbf5-c934-47e9-8b3f-374992cc5307 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=75226) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 17 01:40:30 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-4356fbf5-c934-47e9-8b3f-374992cc5307 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] [instance: 0597c05a-1049-4117-a8ae-8177d590e024] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 17 01:40:30 user nova-compute[75226]: DEBUG nova.privsep.utils [None req-4356fbf5-c934-47e9-8b3f-374992cc5307 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75226) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 17 01:40:30 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-4356fbf5-c934-47e9-8b3f-374992cc5307 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmphdlrgat1/5e9139d119ee4b8696653ebba510312a.delta /opt/stack/data/nova/instances/snapshots/tmphdlrgat1/5e9139d119ee4b8696653ebba510312a {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:40:30 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-4356fbf5-c934-47e9-8b3f-374992cc5307 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmphdlrgat1/5e9139d119ee4b8696653ebba510312a.delta /opt/stack/data/nova/instances/snapshots/tmphdlrgat1/5e9139d119ee4b8696653ebba510312a" returned: 0 in 0.509s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:40:30 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-4356fbf5-c934-47e9-8b3f-374992cc5307 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] [instance: 0597c05a-1049-4117-a8ae-8177d590e024] Snapshot extracted, beginning image upload
Nov 17 01:40:33 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-4356fbf5-c934-47e9-8b3f-374992cc5307 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] [instance: 0597c05a-1049-4117-a8ae-8177d590e024] Snapshot image upload complete
Nov 17 01:40:33 user nova-compute[75226]: INFO nova.compute.manager [None req-4356fbf5-c934-47e9-8b3f-374992cc5307 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] [instance: 0597c05a-1049-4117-a8ae-8177d590e024] Took 5.06 seconds to snapshot the instance on the hypervisor.
Nov 17 01:40:33 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:40:34 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-5581ce6f-e68c-4d0a-961b-ad177375bbaa tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Acquiring lock "6f3b54ce-4dc1-445a-9108-3f628713e6ec" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:40:34 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-5581ce6f-e68c-4d0a-961b-ad177375bbaa tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Lock "6f3b54ce-4dc1-445a-9108-3f628713e6ec" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:40:34 user nova-compute[75226]: DEBUG nova.compute.manager [None req-5581ce6f-e68c-4d0a-961b-ad177375bbaa tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] [instance: 6f3b54ce-4dc1-445a-9108-3f628713e6ec] Starting instance... {{(pid=75226) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 17 01:40:34 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-5581ce6f-e68c-4d0a-961b-ad177375bbaa tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:40:34 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-5581ce6f-e68c-4d0a-961b-ad177375bbaa tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:40:34 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-5581ce6f-e68c-4d0a-961b-ad177375bbaa tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75226) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 17 01:40:34 user nova-compute[75226]: INFO nova.compute.claims [None req-5581ce6f-e68c-4d0a-961b-ad177375bbaa tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] [instance: 6f3b54ce-4dc1-445a-9108-3f628713e6ec] Claim successful on node user
Nov 17 01:40:35 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-5581ce6f-e68c-4d0a-961b-ad177375bbaa tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:40:35 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-5581ce6f-e68c-4d0a-961b-ad177375bbaa tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:40:35 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-5581ce6f-e68c-4d0a-961b-ad177375bbaa tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.361s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:40:35 user nova-compute[75226]: DEBUG nova.compute.manager [None req-5581ce6f-e68c-4d0a-961b-ad177375bbaa tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] [instance: 6f3b54ce-4dc1-445a-9108-3f628713e6ec] Start building networks asynchronously for instance. {{(pid=75226) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 17 01:40:35 user nova-compute[75226]: DEBUG nova.compute.manager [None req-5581ce6f-e68c-4d0a-961b-ad177375bbaa tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] [instance: 6f3b54ce-4dc1-445a-9108-3f628713e6ec] Allocating IP information in the background. {{(pid=75226) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 17 01:40:35 user nova-compute[75226]: DEBUG nova.network.neutron [None req-5581ce6f-e68c-4d0a-961b-ad177375bbaa tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] [instance: 6f3b54ce-4dc1-445a-9108-3f628713e6ec] allocate_for_instance() {{(pid=75226) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 17 01:40:35 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-5581ce6f-e68c-4d0a-961b-ad177375bbaa tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] [instance: 6f3b54ce-4dc1-445a-9108-3f628713e6ec] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 17 01:40:35 user nova-compute[75226]: DEBUG nova.compute.manager [None req-5581ce6f-e68c-4d0a-961b-ad177375bbaa tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] [instance: 6f3b54ce-4dc1-445a-9108-3f628713e6ec] Start building block device mappings for instance. {{(pid=75226) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 17 01:40:35 user nova-compute[75226]: DEBUG nova.policy [None req-5581ce6f-e68c-4d0a-961b-ad177375bbaa tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0357cbff2e7f4a3ebf4ab02e717b451f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8046d4519e4b4f0b864f9ea10a4886fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75226) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 17 01:40:35 user nova-compute[75226]: DEBUG nova.compute.manager [None req-5581ce6f-e68c-4d0a-961b-ad177375bbaa tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] [instance: 6f3b54ce-4dc1-445a-9108-3f628713e6ec] Start spawning the instance on the hypervisor. {{(pid=75226) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 17 01:40:35 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-5581ce6f-e68c-4d0a-961b-ad177375bbaa tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] [instance: 6f3b54ce-4dc1-445a-9108-3f628713e6ec] Creating instance directory {{(pid=75226) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 17 01:40:35 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-5581ce6f-e68c-4d0a-961b-ad177375bbaa tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] [instance: 6f3b54ce-4dc1-445a-9108-3f628713e6ec] Creating image(s)
Nov 17 01:40:35 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-5581ce6f-e68c-4d0a-961b-ad177375bbaa tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Acquiring lock "/opt/stack/data/nova/instances/6f3b54ce-4dc1-445a-9108-3f628713e6ec/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:40:35 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-5581ce6f-e68c-4d0a-961b-ad177375bbaa tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Lock "/opt/stack/data/nova/instances/6f3b54ce-4dc1-445a-9108-3f628713e6ec/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:40:35 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-5581ce6f-e68c-4d0a-961b-ad177375bbaa tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Lock "/opt/stack/data/nova/instances/6f3b54ce-4dc1-445a-9108-3f628713e6ec/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:40:35 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-5581ce6f-e68c-4d0a-961b-ad177375bbaa tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Acquiring lock "9157a104ed5ed8b51d920dc191d70012eed08815" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:40:35 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-5581ce6f-e68c-4d0a-961b-ad177375bbaa tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Lock "9157a104ed5ed8b51d920dc191d70012eed08815" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:40:36 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-5581ce6f-e68c-4d0a-961b-ad177375bbaa tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9157a104ed5ed8b51d920dc191d70012eed08815.part --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:40:36 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:40:36 user nova-compute[75226]: DEBUG nova.network.neutron [None req-5581ce6f-e68c-4d0a-961b-ad177375bbaa tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] [instance: 6f3b54ce-4dc1-445a-9108-3f628713e6ec] Successfully created port: eacf2a0d-87c7-49a0-bc53-5412b6c4a19c {{(pid=75226) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 17 01:40:36 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-5581ce6f-e68c-4d0a-961b-ad177375bbaa tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9157a104ed5ed8b51d920dc191d70012eed08815.part --force-share --output=json" returned: 0 in 0.200s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:40:36 user nova-compute[75226]: DEBUG nova.virt.images [None req-5581ce6f-e68c-4d0a-961b-ad177375bbaa tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] a5779370-ca0e-4d81-9e6f-9f3e641698c8 was qcow2, converting to raw {{(pid=75226) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 17 01:40:36 user nova-compute[75226]: DEBUG nova.privsep.utils [None req-5581ce6f-e68c-4d0a-961b-ad177375bbaa tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75226) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 17 01:40:36 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-5581ce6f-e68c-4d0a-961b-ad177375bbaa tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9157a104ed5ed8b51d920dc191d70012eed08815.part /opt/stack/data/nova/instances/_base/9157a104ed5ed8b51d920dc191d70012eed08815.converted {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:40:36 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-5581ce6f-e68c-4d0a-961b-ad177375bbaa tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9157a104ed5ed8b51d920dc191d70012eed08815.part /opt/stack/data/nova/instances/_base/9157a104ed5ed8b51d920dc191d70012eed08815.converted" returned: 0 in 0.450s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:40:36 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-5581ce6f-e68c-4d0a-961b-ad177375bbaa tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9157a104ed5ed8b51d920dc191d70012eed08815.converted --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:40:37 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-5581ce6f-e68c-4d0a-961b-ad177375bbaa tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9157a104ed5ed8b51d920dc191d70012eed08815.converted --force-share --output=json" returned: 0 in 0.179s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:40:37 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-5581ce6f-e68c-4d0a-961b-ad177375bbaa tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Lock "9157a104ed5ed8b51d920dc191d70012eed08815" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.667s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:40:37 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-5581ce6f-e68c-4d0a-961b-ad177375bbaa tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9157a104ed5ed8b51d920dc191d70012eed08815 --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:40:37 user nova-compute[75226]: DEBUG nova.network.neutron [None req-5581ce6f-e68c-4d0a-961b-ad177375bbaa tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] [instance: 6f3b54ce-4dc1-445a-9108-3f628713e6ec] Successfully updated port: eacf2a0d-87c7-49a0-bc53-5412b6c4a19c {{(pid=75226) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 17 01:40:37 user nova-compute[75226]: DEBUG nova.compute.manager [req-2e48d3a3-248b-4272-a61f-aa15f9f3b779 req-897cfc51-9235-43e3-8b85-0e586b8af19b service nova] [instance: 6f3b54ce-4dc1-445a-9108-3f628713e6ec] Received event network-changed-eacf2a0d-87c7-49a0-bc53-5412b6c4a19c {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:40:37 user nova-compute[75226]: DEBUG nova.compute.manager [req-2e48d3a3-248b-4272-a61f-aa15f9f3b779 req-897cfc51-9235-43e3-8b85-0e586b8af19b service nova] [instance: 6f3b54ce-4dc1-445a-9108-3f628713e6ec] Refreshing instance network info cache due to event network-changed-eacf2a0d-87c7-49a0-bc53-5412b6c4a19c. {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 01:40:37 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-2e48d3a3-248b-4272-a61f-aa15f9f3b779 req-897cfc51-9235-43e3-8b85-0e586b8af19b service nova] Acquiring lock "refresh_cache-6f3b54ce-4dc1-445a-9108-3f628713e6ec" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:40:37 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-2e48d3a3-248b-4272-a61f-aa15f9f3b779 req-897cfc51-9235-43e3-8b85-0e586b8af19b service nova] Acquired lock "refresh_cache-6f3b54ce-4dc1-445a-9108-3f628713e6ec" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:40:37 user nova-compute[75226]: DEBUG nova.network.neutron [req-2e48d3a3-248b-4272-a61f-aa15f9f3b779 req-897cfc51-9235-43e3-8b85-0e586b8af19b service nova] [instance: 6f3b54ce-4dc1-445a-9108-3f628713e6ec] Refreshing network info cache for port eacf2a0d-87c7-49a0-bc53-5412b6c4a19c {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 01:40:37 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-5581ce6f-e68c-4d0a-961b-ad177375bbaa tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Acquiring lock "refresh_cache-6f3b54ce-4dc1-445a-9108-3f628713e6ec" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:40:37 user nova-compute[75226]: DEBUG nova.network.neutron [req-2e48d3a3-248b-4272-a61f-aa15f9f3b779 req-897cfc51-9235-43e3-8b85-0e586b8af19b service nova] [instance: 6f3b54ce-4dc1-445a-9108-3f628713e6ec] Instance cache missing network info. {{(pid=75226) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 17 01:40:37 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-5581ce6f-e68c-4d0a-961b-ad177375bbaa tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9157a104ed5ed8b51d920dc191d70012eed08815 --force-share --output=json" returned: 0 in 0.184s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:40:37 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-5581ce6f-e68c-4d0a-961b-ad177375bbaa tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Acquiring lock "9157a104ed5ed8b51d920dc191d70012eed08815" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:40:37 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-5581ce6f-e68c-4d0a-961b-ad177375bbaa tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Lock "9157a104ed5ed8b51d920dc191d70012eed08815" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:40:37 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-5581ce6f-e68c-4d0a-961b-ad177375bbaa tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9157a104ed5ed8b51d920dc191d70012eed08815 --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:40:37 user nova-compute[75226]: DEBUG nova.network.neutron [req-2e48d3a3-248b-4272-a61f-aa15f9f3b779 req-897cfc51-9235-43e3-8b85-0e586b8af19b service nova] [instance: 6f3b54ce-4dc1-445a-9108-3f628713e6ec] Updating instance_info_cache with network_info: [] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:40:37 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-2e48d3a3-248b-4272-a61f-aa15f9f3b779 req-897cfc51-9235-43e3-8b85-0e586b8af19b service nova] Releasing lock "refresh_cache-6f3b54ce-4dc1-445a-9108-3f628713e6ec" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:40:37 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-5581ce6f-e68c-4d0a-961b-ad177375bbaa tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Acquired lock "refresh_cache-6f3b54ce-4dc1-445a-9108-3f628713e6ec" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:40:37 user nova-compute[75226]: DEBUG nova.network.neutron [None req-5581ce6f-e68c-4d0a-961b-ad177375bbaa tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] [instance: 6f3b54ce-4dc1-445a-9108-3f628713e6ec] Building network info cache for instance {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 01:40:37 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-5581ce6f-e68c-4d0a-961b-ad177375bbaa tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9157a104ed5ed8b51d920dc191d70012eed08815 --force-share --output=json" returned: 0 in 0.176s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:40:37 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-5581ce6f-e68c-4d0a-961b-ad177375bbaa tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9157a104ed5ed8b51d920dc191d70012eed08815,backing_fmt=raw /opt/stack/data/nova/instances/6f3b54ce-4dc1-445a-9108-3f628713e6ec/disk 1073741824 {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:40:37 user nova-compute[75226]: DEBUG nova.network.neutron [None req-5581ce6f-e68c-4d0a-961b-ad177375bbaa tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] [instance: 6f3b54ce-4dc1-445a-9108-3f628713e6ec] Instance cache missing network info. {{(pid=75226) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 17 01:40:37 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-5581ce6f-e68c-4d0a-961b-ad177375bbaa tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9157a104ed5ed8b51d920dc191d70012eed08815,backing_fmt=raw /opt/stack/data/nova/instances/6f3b54ce-4dc1-445a-9108-3f628713e6ec/disk 1073741824" returned: 0 in 0.051s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:40:37 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-5581ce6f-e68c-4d0a-961b-ad177375bbaa tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Lock "9157a104ed5ed8b51d920dc191d70012eed08815" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.231s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:40:37 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-5581ce6f-e68c-4d0a-961b-ad177375bbaa tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9157a104ed5ed8b51d920dc191d70012eed08815 --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:40:37 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-5581ce6f-e68c-4d0a-961b-ad177375bbaa tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9157a104ed5ed8b51d920dc191d70012eed08815 --force-share --output=json" returned: 0 in 0.172s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:40:37 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-5581ce6f-e68c-4d0a-961b-ad177375bbaa tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] [instance: 6f3b54ce-4dc1-445a-9108-3f628713e6ec] Created local disks {{(pid=75226) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 17 01:40:37 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-5581ce6f-e68c-4d0a-961b-ad177375bbaa tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] [instance: 6f3b54ce-4dc1-445a-9108-3f628713e6ec] Ensure instance console log exists: /opt/stack/data/nova/instances/6f3b54ce-4dc1-445a-9108-3f628713e6ec/console.log {{(pid=75226) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 17 01:40:37 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-5581ce6f-e68c-4d0a-961b-ad177375bbaa tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:40:37 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-5581ce6f-e68c-4d0a-961b-ad177375bbaa tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:40:37 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-5581ce6f-e68c-4d0a-961b-ad177375bbaa tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:40:37 user nova-compute[75226]: DEBUG nova.network.neutron [None req-5581ce6f-e68c-4d0a-961b-ad177375bbaa tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] [instance: 6f3b54ce-4dc1-445a-9108-3f628713e6ec] Updating instance_info_cache with network_info: [{"id": "eacf2a0d-87c7-49a0-bc53-5412b6c4a19c", "address": "fa:16:3e:8a:af:7c", "network": {"id": "b6c26fa5-eacc-41d3-b790-795e59c84966", "bridge": "br-int", "label": "tempest-TestStampPattern-2002555642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8046d4519e4b4f0b864f9ea10a4886fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeacf2a0d-87", "ovs_interfaceid": "eacf2a0d-87c7-49a0-bc53-5412b6c4a19c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:40:37 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-5581ce6f-e68c-4d0a-961b-ad177375bbaa tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Releasing lock "refresh_cache-6f3b54ce-4dc1-445a-9108-3f628713e6ec" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:40:37 user nova-compute[75226]: DEBUG nova.compute.manager [None req-5581ce6f-e68c-4d0a-961b-ad177375bbaa tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] [instance: 6f3b54ce-4dc1-445a-9108-3f628713e6ec] Instance network_info: |[{"id": "eacf2a0d-87c7-49a0-bc53-5412b6c4a19c", "address": "fa:16:3e:8a:af:7c", "network": {"id": "b6c26fa5-eacc-41d3-b790-795e59c84966", "bridge": "br-int", "label": "tempest-TestStampPattern-2002555642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8046d4519e4b4f0b864f9ea10a4886fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeacf2a0d-87", "ovs_interfaceid": "eacf2a0d-87c7-49a0-bc53-5412b6c4a19c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75226) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 17 01:40:37 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-5581ce6f-e68c-4d0a-961b-ad177375bbaa tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] [instance: 6f3b54ce-4dc1-445a-9108-3f628713e6ec] Start _get_guest_xml network_info=[{"id": "eacf2a0d-87c7-49a0-bc53-5412b6c4a19c", "address": "fa:16:3e:8a:af:7c", "network": {"id": "b6c26fa5-eacc-41d3-b790-795e59c84966", "bridge": "br-int", "label": "tempest-TestStampPattern-2002555642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8046d4519e4b4f0b864f9ea10a4886fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeacf2a0d-87", "ovs_interfaceid": "eacf2a0d-87c7-49a0-bc53-5412b6c4a19c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='5253dc15771b60bb1557f3e10e5eafa7',container_format='bare',created_at=2023-11-17T01:40:28Z,direct_url=<?>,disk_format='qcow2',id=a5779370-ca0e-4d81-9e6f-9f3e641698c8,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1220654047',owner='8046d4519e4b4f0b864f9ea10a4886fa',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-17T01:40:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encrypted': False, 'image_id': 'a5779370-ca0e-4d81-9e6f-9f3e641698c8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75226) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 17 01:40:37 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-5581ce6f-e68c-4d0a-961b-ad177375bbaa tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:40:37 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-5581ce6f-e68c-4d0a-961b-ad177375bbaa tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:40:37 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-5581ce6f-e68c-4d0a-961b-ad177375bbaa tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75226) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 17 01:40:37 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-5581ce6f-e68c-4d0a-961b-ad177375bbaa tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] CPU controller missing on host. {{(pid=75226) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 17 01:40:37 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-5581ce6f-e68c-4d0a-961b-ad177375bbaa tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75226) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 17 01:40:37 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-5581ce6f-e68c-4d0a-961b-ad177375bbaa tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] CPU controller found on host. {{(pid=75226) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 17 01:40:37 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-5581ce6f-e68c-4d0a-961b-ad177375bbaa tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75226) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 17 01:40:37 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-5581ce6f-e68c-4d0a-961b-ad177375bbaa tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-17T01:13:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='5253dc15771b60bb1557f3e10e5eafa7',container_format='bare',created_at=2023-11-17T01:40:28Z,direct_url=<?>,disk_format='qcow2',id=a5779370-ca0e-4d81-9e6f-9f3e641698c8,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1220654047',owner='8046d4519e4b4f0b864f9ea10a4886fa',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-17T01:40:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 17 01:40:37 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-5581ce6f-e68c-4d0a-961b-ad177375bbaa tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Flavor limits 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 17 01:40:37 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-5581ce6f-e68c-4d0a-961b-ad177375bbaa tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Image limits 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 17 01:40:37 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-5581ce6f-e68c-4d0a-961b-ad177375bbaa tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Flavor pref 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 17 01:40:37 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-5581ce6f-e68c-4d0a-961b-ad177375bbaa tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Image pref 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 17 01:40:37 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-5581ce6f-e68c-4d0a-961b-ad177375bbaa tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 17 01:40:37 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-5581ce6f-e68c-4d0a-961b-ad177375bbaa tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 17 01:40:37 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-5581ce6f-e68c-4d0a-961b-ad177375bbaa tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75226) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 17 01:40:37 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-5581ce6f-e68c-4d0a-961b-ad177375bbaa tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Got 1 possible topologies {{(pid=75226) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 17 01:40:37 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-5581ce6f-e68c-4d0a-961b-ad177375bbaa tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 17 01:40:37 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-5581ce6f-e68c-4d0a-961b-ad177375bbaa tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 17 01:40:37 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-5581ce6f-e68c-4d0a-961b-ad177375bbaa tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:40:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-584158405',display_name='tempest-TestStampPattern-server-584158405',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-584158405',id=40,image_ref='a5779370-ca0e-4d81-9e6f-9f3e641698c8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJo/tAB5VbatxtFO3qcGvVQYO+DJCVCBnHzmF73L8NhWbPARofXbPE3d/rvN9G86C2CwqSw7WTEjMfEOGTjqYfRxtLwEwauLFrL7ndRptXBl9uTXrST97QU1m8g2Jvz0/g==',key_name='tempest-TestStampPattern-635437790',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8046d4519e4b4f0b864f9ea10a4886fa',ramdisk_id='',reservation_id='r-74yv4vnz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='0597c05a-1049-4117-a8ae-8177d590e024',image_min_disk='1',image_min_ram='0',image_owner_id='8046d4519e4b4f0b864f9ea10a4886fa',image_owner_project_name='tempest-TestStampPattern-266167712',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-266167712-project-member',image_user_id='0357cbff2e7f4a3ebf4ab02e717b451f',network_allocated='True',owner_project_name='tempest-TestStampPattern-266167712',owner_user_name='tempest-TestStampPattern-266167712-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T01:40:35Z,user_data=None,user_id='0357cbff2e7f4a3ebf4ab02e717b451f',uuid=6f3b54ce-4dc1-445a-9108-3f628713e6ec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eacf2a0d-87c7-49a0-bc53-5412b6c4a19c", "address": "fa:16:3e:8a:af:7c", "network": {"id": "b6c26fa5-eacc-41d3-b790-795e59c84966", "bridge": "br-int", "label": "tempest-TestStampPattern-2002555642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8046d4519e4b4f0b864f9ea10a4886fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeacf2a0d-87", "ovs_interfaceid": "eacf2a0d-87c7-49a0-bc53-5412b6c4a19c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75226) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 01:40:37 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-5581ce6f-e68c-4d0a-961b-ad177375bbaa tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Converting VIF {"id": "eacf2a0d-87c7-49a0-bc53-5412b6c4a19c", "address": "fa:16:3e:8a:af:7c", "network": {"id": "b6c26fa5-eacc-41d3-b790-795e59c84966", "bridge": "br-int", "label": "tempest-TestStampPattern-2002555642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8046d4519e4b4f0b864f9ea10a4886fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeacf2a0d-87", "ovs_interfaceid": "eacf2a0d-87c7-49a0-bc53-5412b6c4a19c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:40:37 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-5581ce6f-e68c-4d0a-961b-ad177375bbaa tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:af:7c,bridge_name='br-int',has_traffic_filtering=True,id=eacf2a0d-87c7-49a0-bc53-5412b6c4a19c,network=Network(b6c26fa5-eacc-41d3-b790-795e59c84966),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeacf2a0d-87') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:40:37 user nova-compute[75226]: DEBUG nova.objects.instance [None req-5581ce6f-e68c-4d0a-961b-ad177375bbaa tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Lazy-loading 'pci_devices' on Instance uuid 6f3b54ce-4dc1-445a-9108-3f628713e6ec {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:40:37 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-5581ce6f-e68c-4d0a-961b-ad177375bbaa tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] [instance: 6f3b54ce-4dc1-445a-9108-3f628713e6ec] End _get_guest_xml xml=<domain type="kvm">
Nov 17 01:40:37 user nova-compute[75226]:   <uuid>6f3b54ce-4dc1-445a-9108-3f628713e6ec</uuid>
Nov 17 01:40:37 user nova-compute[75226]:   <name>instance-00000028</name>
Nov 17 01:40:37 user nova-compute[75226]:   <memory>524288</memory>
Nov 17 01:40:37 user nova-compute[75226]:   <vcpu>1</vcpu>
Nov 17 01:40:37 user nova-compute[75226]:   <metadata>
Nov 17 01:40:37 user nova-compute[75226]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 17 01:40:37 user nova-compute[75226]:       <nova:package version="0.0.0"/>
Nov 17 01:40:37 user nova-compute[75226]:       <nova:name>tempest-TestStampPattern-server-584158405</nova:name>
Nov 17 01:40:37 user nova-compute[75226]:       <nova:creationTime>2023-11-17 01:40:37</nova:creationTime>
Nov 17 01:40:37 user nova-compute[75226]:       <nova:flavor name="m1.tiny">
Nov 17 01:40:37 user nova-compute[75226]:         <nova:memory>512</nova:memory>
Nov 17 01:40:37 user nova-compute[75226]:         <nova:disk>1</nova:disk>
Nov 17 01:40:37 user nova-compute[75226]:         <nova:swap>0</nova:swap>
Nov 17 01:40:37 user nova-compute[75226]:         <nova:ephemeral>0</nova:ephemeral>
Nov 17 01:40:37 user nova-compute[75226]:         <nova:vcpus>1</nova:vcpus>
Nov 17 01:40:37 user nova-compute[75226]:       </nova:flavor>
Nov 17 01:40:37 user nova-compute[75226]:       <nova:owner>
Nov 17 01:40:37 user nova-compute[75226]:         <nova:user uuid="0357cbff2e7f4a3ebf4ab02e717b451f">tempest-TestStampPattern-266167712-project-member</nova:user>
Nov 17 01:40:37 user nova-compute[75226]:         <nova:project uuid="8046d4519e4b4f0b864f9ea10a4886fa">tempest-TestStampPattern-266167712</nova:project>
Nov 17 01:40:37 user nova-compute[75226]:       </nova:owner>
Nov 17 01:40:37 user nova-compute[75226]:       <nova:root type="image" uuid="a5779370-ca0e-4d81-9e6f-9f3e641698c8"/>
Nov 17 01:40:37 user nova-compute[75226]:       <nova:ports>
Nov 17 01:40:37 user nova-compute[75226]:         <nova:port uuid="eacf2a0d-87c7-49a0-bc53-5412b6c4a19c">
Nov 17 01:40:37 user nova-compute[75226]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 17 01:40:37 user nova-compute[75226]:         </nova:port>
Nov 17 01:40:37 user nova-compute[75226]:       </nova:ports>
Nov 17 01:40:37 user nova-compute[75226]:     </nova:instance>
Nov 17 01:40:37 user nova-compute[75226]:   </metadata>
Nov 17 01:40:37 user nova-compute[75226]:   <sysinfo type="smbios">
Nov 17 01:40:37 user nova-compute[75226]:     <system>
Nov 17 01:40:37 user nova-compute[75226]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 17 01:40:37 user nova-compute[75226]:       <entry name="product">OpenStack Nova</entry>
Nov 17 01:40:37 user nova-compute[75226]:       <entry name="version">0.0.0</entry>
Nov 17 01:40:37 user nova-compute[75226]:       <entry name="serial">6f3b54ce-4dc1-445a-9108-3f628713e6ec</entry>
Nov 17 01:40:37 user nova-compute[75226]:       <entry name="uuid">6f3b54ce-4dc1-445a-9108-3f628713e6ec</entry>
Nov 17 01:40:37 user nova-compute[75226]:       <entry name="family">Virtual Machine</entry>
Nov 17 01:40:37 user nova-compute[75226]:     </system>
Nov 17 01:40:37 user nova-compute[75226]:   </sysinfo>
Nov 17 01:40:37 user nova-compute[75226]:   <os>
Nov 17 01:40:37 user nova-compute[75226]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 17 01:40:37 user nova-compute[75226]:     <boot dev="hd"/>
Nov 17 01:40:37 user nova-compute[75226]:     <smbios mode="sysinfo"/>
Nov 17 01:40:37 user nova-compute[75226]:   </os>
Nov 17 01:40:37 user nova-compute[75226]:   <features>
Nov 17 01:40:37 user nova-compute[75226]:     <acpi/>
Nov 17 01:40:37 user nova-compute[75226]:     <apic/>
Nov 17 01:40:37 user nova-compute[75226]:     <vmcoreinfo/>
Nov 17 01:40:37 user nova-compute[75226]:   </features>
Nov 17 01:40:37 user nova-compute[75226]:   <clock offset="utc">
Nov 17 01:40:37 user nova-compute[75226]:     <timer name="pit" tickpolicy="delay"/>
Nov 17 01:40:37 user nova-compute[75226]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 17 01:40:37 user nova-compute[75226]:     <timer name="hpet" present="no"/>
Nov 17 01:40:37 user nova-compute[75226]:   </clock>
Nov 17 01:40:37 user nova-compute[75226]:   <cpu mode="custom" match="exact">
Nov 17 01:40:37 user nova-compute[75226]:     <model>Nehalem</model>
Nov 17 01:40:37 user nova-compute[75226]:     <topology sockets="1" cores="1" threads="1"/>
Nov 17 01:40:37 user nova-compute[75226]:   </cpu>
Nov 17 01:40:37 user nova-compute[75226]:   <devices>
Nov 17 01:40:37 user nova-compute[75226]:     <disk type="file" device="disk">
Nov 17 01:40:37 user nova-compute[75226]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 17 01:40:37 user nova-compute[75226]:       <source file="/opt/stack/data/nova/instances/6f3b54ce-4dc1-445a-9108-3f628713e6ec/disk"/>
Nov 17 01:40:37 user nova-compute[75226]:       <target dev="vda" bus="virtio"/>
Nov 17 01:40:37 user nova-compute[75226]:     </disk>
Nov 17 01:40:37 user nova-compute[75226]:     <interface type="ethernet">
Nov 17 01:40:37 user nova-compute[75226]:       <mac address="fa:16:3e:8a:af:7c"/>
Nov 17 01:40:37 user nova-compute[75226]:       <model type="virtio"/>
Nov 17 01:40:37 user nova-compute[75226]:       <mtu size="1442"/>
Nov 17 01:40:37 user nova-compute[75226]:       <target dev="tapeacf2a0d-87"/>
Nov 17 01:40:37 user nova-compute[75226]:     </interface>
Nov 17 01:40:37 user nova-compute[75226]:     <serial type="pty">
Nov 17 01:40:37 user nova-compute[75226]:       <log file="/opt/stack/data/nova/instances/6f3b54ce-4dc1-445a-9108-3f628713e6ec/console.log" append="off"/>
Nov 17 01:40:37 user nova-compute[75226]:     </serial>
Nov 17 01:40:37 user nova-compute[75226]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 17 01:40:37 user nova-compute[75226]:     <video>
Nov 17 01:40:37 user nova-compute[75226]:       <model type="virtio"/>
Nov 17 01:40:37 user nova-compute[75226]:     </video>
Nov 17 01:40:37 user nova-compute[75226]:     <rng model="virtio">
Nov 17 01:40:37 user nova-compute[75226]:       <backend model="random">/dev/urandom</backend>
Nov 17 01:40:37 user nova-compute[75226]:     </rng>
Nov 17 01:40:37 user nova-compute[75226]:     <controller type="usb" index="0" model="none"/>
Nov 17 01:40:37 user nova-compute[75226]:     <memballoon model="virtio">
Nov 17 01:40:37 user nova-compute[75226]:       <stats period="10"/>
Nov 17 01:40:37 user nova-compute[75226]:     </memballoon>
Nov 17 01:40:37 user nova-compute[75226]:   </devices>
Nov 17 01:40:37 user nova-compute[75226]: </domain>
Nov 17 01:40:37 user nova-compute[75226]:  {{(pid=75226) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 17 01:40:37 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-5581ce6f-e68c-4d0a-961b-ad177375bbaa tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:40:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-584158405',display_name='tempest-TestStampPattern-server-584158405',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-584158405',id=40,image_ref='a5779370-ca0e-4d81-9e6f-9f3e641698c8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJo/tAB5VbatxtFO3qcGvVQYO+DJCVCBnHzmF73L8NhWbPARofXbPE3d/rvN9G86C2CwqSw7WTEjMfEOGTjqYfRxtLwEwauLFrL7ndRptXBl9uTXrST97QU1m8g2Jvz0/g==',key_name='tempest-TestStampPattern-635437790',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8046d4519e4b4f0b864f9ea10a4886fa',ramdisk_id='',reservation_id='r-74yv4vnz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='0597c05a-1049-4117-a8ae-8177d590e024',image_min_disk='1',image_min_ram='0',image_owner_id='8046d4519e4b4f0b864f9ea10a4886fa',image_owner_project_name='tempest-TestStampPattern-266167712',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-266167712-project-member',image_user_id='0357cbff2e7f4a3ebf4ab02e717b451f',network_allocated='True',owner_project_name='tempest-TestStampPattern-266167712',owner_user_name='tempest-TestStampPattern-266167712-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T01:40:35Z,user_data=None,user_id='0357cbff2e7f4a3ebf4ab02e717b451f',uuid=6f3b54ce-4dc1-445a-9108-3f628713e6ec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eacf2a0d-87c7-49a0-bc53-5412b6c4a19c", "address": "fa:16:3e:8a:af:7c", "network": {"id": "b6c26fa5-eacc-41d3-b790-795e59c84966", "bridge": "br-int", "label": "tempest-TestStampPattern-2002555642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8046d4519e4b4f0b864f9ea10a4886fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeacf2a0d-87", "ovs_interfaceid": "eacf2a0d-87c7-49a0-bc53-5412b6c4a19c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 17 01:40:37 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-5581ce6f-e68c-4d0a-961b-ad177375bbaa tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Converting VIF {"id": "eacf2a0d-87c7-49a0-bc53-5412b6c4a19c", "address": "fa:16:3e:8a:af:7c", "network": {"id": "b6c26fa5-eacc-41d3-b790-795e59c84966", "bridge": "br-int", "label": "tempest-TestStampPattern-2002555642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8046d4519e4b4f0b864f9ea10a4886fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeacf2a0d-87", "ovs_interfaceid": "eacf2a0d-87c7-49a0-bc53-5412b6c4a19c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:40:37 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-5581ce6f-e68c-4d0a-961b-ad177375bbaa tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:af:7c,bridge_name='br-int',has_traffic_filtering=True,id=eacf2a0d-87c7-49a0-bc53-5412b6c4a19c,network=Network(b6c26fa5-eacc-41d3-b790-795e59c84966),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeacf2a0d-87') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:40:37 user nova-compute[75226]: DEBUG os_vif [None req-5581ce6f-e68c-4d0a-961b-ad177375bbaa tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:af:7c,bridge_name='br-int',has_traffic_filtering=True,id=eacf2a0d-87c7-49a0-bc53-5412b6c4a19c,network=Network(b6c26fa5-eacc-41d3-b790-795e59c84966),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeacf2a0d-87') {{(pid=75226) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 17 01:40:37 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:40:37 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:40:37 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 17 01:40:37 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:40:37 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '746d79ac-7342-5826-a950-ba4b8cc45558', '_type': 'linux-noop'}}, row=False) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:40:37 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:40:37 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:40:37 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeacf2a0d-87, may_exist=True, interface_attrs={}) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:40:37 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapeacf2a0d-87, col_values=(('qos', UUID('d7870e37-a5db-4353-8b6d-b4e457f12ee9')),), if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:40:37 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapeacf2a0d-87, col_values=(('external_ids', {'iface-id': 'eacf2a0d-87c7-49a0-bc53-5412b6c4a19c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8a:af:7c', 'vm-uuid': '6f3b54ce-4dc1-445a-9108-3f628713e6ec'}),), if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:40:37 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:40:37 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:40:37 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:40:37 user nova-compute[75226]: INFO os_vif [None req-5581ce6f-e68c-4d0a-961b-ad177375bbaa tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:af:7c,bridge_name='br-int',has_traffic_filtering=True,id=eacf2a0d-87c7-49a0-bc53-5412b6c4a19c,network=Network(b6c26fa5-eacc-41d3-b790-795e59c84966),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeacf2a0d-87')
Nov 17 01:40:37 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-5581ce6f-e68c-4d0a-961b-ad177375bbaa tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] No BDM found with device name vda, not building metadata. {{(pid=75226) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 01:40:37 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-5581ce6f-e68c-4d0a-961b-ad177375bbaa tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] No VIF found with MAC fa:16:3e:8a:af:7c, not building metadata {{(pid=75226) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 01:40:39 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:40:39 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:40:39 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:40:39 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:40:39 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:40:39 user nova-compute[75226]: DEBUG nova.compute.manager [req-888f7f92-1e5c-4e21-a541-a5227c48119d req-07840d0b-de2c-4b25-86cc-9324a0ed9567 service nova] [instance: 6f3b54ce-4dc1-445a-9108-3f628713e6ec] Received event network-vif-plugged-eacf2a0d-87c7-49a0-bc53-5412b6c4a19c {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:40:39 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-888f7f92-1e5c-4e21-a541-a5227c48119d req-07840d0b-de2c-4b25-86cc-9324a0ed9567 service nova] Acquiring lock "6f3b54ce-4dc1-445a-9108-3f628713e6ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:40:39 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-888f7f92-1e5c-4e21-a541-a5227c48119d req-07840d0b-de2c-4b25-86cc-9324a0ed9567 service nova] Lock "6f3b54ce-4dc1-445a-9108-3f628713e6ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:40:39 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-888f7f92-1e5c-4e21-a541-a5227c48119d req-07840d0b-de2c-4b25-86cc-9324a0ed9567 service nova] Lock "6f3b54ce-4dc1-445a-9108-3f628713e6ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:40:39 user nova-compute[75226]: DEBUG nova.compute.manager [req-888f7f92-1e5c-4e21-a541-a5227c48119d req-07840d0b-de2c-4b25-86cc-9324a0ed9567 service nova] [instance: 6f3b54ce-4dc1-445a-9108-3f628713e6ec] No waiting events found dispatching network-vif-plugged-eacf2a0d-87c7-49a0-bc53-5412b6c4a19c {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:40:39 user nova-compute[75226]: WARNING nova.compute.manager [req-888f7f92-1e5c-4e21-a541-a5227c48119d req-07840d0b-de2c-4b25-86cc-9324a0ed9567 service nova] [instance: 6f3b54ce-4dc1-445a-9108-3f628713e6ec] Received unexpected event network-vif-plugged-eacf2a0d-87c7-49a0-bc53-5412b6c4a19c for instance with vm_state building and task_state spawning.
Nov 17 01:40:40 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-8ad99888-68f8-484c-ac89-cff3a8201292 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Acquiring lock "38062487-67ca-4962-974f-81456aebe97b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:40:40 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-8ad99888-68f8-484c-ac89-cff3a8201292 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Lock "38062487-67ca-4962-974f-81456aebe97b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:40:40 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-8ad99888-68f8-484c-ac89-cff3a8201292 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Acquiring lock "38062487-67ca-4962-974f-81456aebe97b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:40:40 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-8ad99888-68f8-484c-ac89-cff3a8201292 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Lock "38062487-67ca-4962-974f-81456aebe97b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:40:40 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-8ad99888-68f8-484c-ac89-cff3a8201292 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Lock "38062487-67ca-4962-974f-81456aebe97b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:40:40 user nova-compute[75226]: INFO nova.compute.manager [None req-8ad99888-68f8-484c-ac89-cff3a8201292 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: 38062487-67ca-4962-974f-81456aebe97b] Terminating instance
Nov 17 01:40:40 user nova-compute[75226]: DEBUG nova.compute.manager [None req-8ad99888-68f8-484c-ac89-cff3a8201292 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: 38062487-67ca-4962-974f-81456aebe97b] Start destroying the instance on the hypervisor. {{(pid=75226) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 17 01:40:40 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:40:40 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:40:40 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:40:40 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:40:40 user nova-compute[75226]: DEBUG nova.compute.manager [req-ba833f11-3013-4f17-851b-aad14063daf3 req-dafa1e12-31ec-43d8-8f99-49fff92b9f64 service nova] [instance: 38062487-67ca-4962-974f-81456aebe97b] Received event network-vif-unplugged-b4bb80f3-212b-41bf-94a3-442865a852c7 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:40:40 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-ba833f11-3013-4f17-851b-aad14063daf3 req-dafa1e12-31ec-43d8-8f99-49fff92b9f64 service nova] Acquiring lock "38062487-67ca-4962-974f-81456aebe97b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:40:40 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-ba833f11-3013-4f17-851b-aad14063daf3 req-dafa1e12-31ec-43d8-8f99-49fff92b9f64 service nova] Lock "38062487-67ca-4962-974f-81456aebe97b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:40:40 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-ba833f11-3013-4f17-851b-aad14063daf3 req-dafa1e12-31ec-43d8-8f99-49fff92b9f64 service nova] Lock "38062487-67ca-4962-974f-81456aebe97b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:40:40 user nova-compute[75226]: DEBUG nova.compute.manager [req-ba833f11-3013-4f17-851b-aad14063daf3 req-dafa1e12-31ec-43d8-8f99-49fff92b9f64 service nova] [instance: 38062487-67ca-4962-974f-81456aebe97b] No waiting events found dispatching network-vif-unplugged-b4bb80f3-212b-41bf-94a3-442865a852c7 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:40:40 user nova-compute[75226]: DEBUG nova.compute.manager [req-ba833f11-3013-4f17-851b-aad14063daf3 req-dafa1e12-31ec-43d8-8f99-49fff92b9f64 service nova] [instance: 38062487-67ca-4962-974f-81456aebe97b] Received event network-vif-unplugged-b4bb80f3-212b-41bf-94a3-442865a852c7 for instance with task_state deleting. {{(pid=75226) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 17 01:40:41 user nova-compute[75226]: INFO nova.virt.libvirt.driver [-] [instance: 38062487-67ca-4962-974f-81456aebe97b] Instance destroyed successfully.
Nov 17 01:40:41 user nova-compute[75226]: DEBUG nova.objects.instance [None req-8ad99888-68f8-484c-ac89-cff3a8201292 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Lazy-loading 'resources' on Instance uuid 38062487-67ca-4962-974f-81456aebe97b {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:40:41 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-8ad99888-68f8-484c-ac89-cff3a8201292 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:21:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-258103968',display_name='tempest-ServerActionsTestOtherA-server-258103968',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-258103968',id=16,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFcMGt3BPMgKZBdescHicrTnz7kyNBHfMwmrFONg75JAKc8VfRVh1PCQT3W5iiYYT6fcflPeuhtfYyaPi/d36jL88Vz6dOEwhdGgUoOilw3GKb90qUp0hFoOK7faoQkiRg==',key_name='tempest-keypair-1413404210',keypairs=<?>,launch_index=0,launched_at=2023-11-17T01:21:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f9042fe4ecc245dd97553f6e942c3e05',ramdisk_id='',reservation_id='r-s08uzlt2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2125452149',owner_user_name='tempest-ServerActionsTestOtherA-2125452149-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T01:21:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a13dd8231937440185c9fc628c3bd5db',uuid=38062487-67ca-4962-974f-81456aebe97b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b4bb80f3-212b-41bf-94a3-442865a852c7", "address": "fa:16:3e:ef:fd:97", "network": {"id": "9f39d3e5-b106-4bd9-b8ba-0f326e89c481", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-675861281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9042fe4ecc245dd97553f6e942c3e05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4bb80f3-21", "ovs_interfaceid": "b4bb80f3-212b-41bf-94a3-442865a852c7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 17 01:40:41 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-8ad99888-68f8-484c-ac89-cff3a8201292 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Converting VIF {"id": "b4bb80f3-212b-41bf-94a3-442865a852c7", "address": "fa:16:3e:ef:fd:97", "network": {"id": "9f39d3e5-b106-4bd9-b8ba-0f326e89c481", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-675861281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9042fe4ecc245dd97553f6e942c3e05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4bb80f3-21", "ovs_interfaceid": "b4bb80f3-212b-41bf-94a3-442865a852c7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:40:41 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-8ad99888-68f8-484c-ac89-cff3a8201292 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ef:fd:97,bridge_name='br-int',has_traffic_filtering=True,id=b4bb80f3-212b-41bf-94a3-442865a852c7,network=Network(9f39d3e5-b106-4bd9-b8ba-0f326e89c481),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4bb80f3-21') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:40:41 user nova-compute[75226]: DEBUG os_vif [None req-8ad99888-68f8-484c-ac89-cff3a8201292 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ef:fd:97,bridge_name='br-int',has_traffic_filtering=True,id=b4bb80f3-212b-41bf-94a3-442865a852c7,network=Network(9f39d3e5-b106-4bd9-b8ba-0f326e89c481),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4bb80f3-21') {{(pid=75226) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 17 01:40:41 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:40:41 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb4bb80f3-21, bridge=br-int, if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:40:41 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:40:41 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:40:41 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:40:41 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c3875751-864c-497c-ae3a-8d8b217782a0) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:40:41 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:40:41 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:40:41 user nova-compute[75226]: INFO os_vif [None req-8ad99888-68f8-484c-ac89-cff3a8201292 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ef:fd:97,bridge_name='br-int',has_traffic_filtering=True,id=b4bb80f3-212b-41bf-94a3-442865a852c7,network=Network(9f39d3e5-b106-4bd9-b8ba-0f326e89c481),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4bb80f3-21')
Nov 17 01:40:41 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-8ad99888-68f8-484c-ac89-cff3a8201292 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: 38062487-67ca-4962-974f-81456aebe97b] Deleting instance files /opt/stack/data/nova/instances/38062487-67ca-4962-974f-81456aebe97b_del
Nov 17 01:40:41 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-8ad99888-68f8-484c-ac89-cff3a8201292 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: 38062487-67ca-4962-974f-81456aebe97b] Deletion of /opt/stack/data/nova/instances/38062487-67ca-4962-974f-81456aebe97b_del complete
Nov 17 01:40:41 user nova-compute[75226]: INFO nova.compute.manager [None req-8ad99888-68f8-484c-ac89-cff3a8201292 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] [instance: 38062487-67ca-4962-974f-81456aebe97b] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 17 01:40:41 user nova-compute[75226]: DEBUG oslo.service.loopingcall [None req-8ad99888-68f8-484c-ac89-cff3a8201292 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75226) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 17 01:40:41 user nova-compute[75226]: DEBUG nova.compute.manager [-] [instance: 38062487-67ca-4962-974f-81456aebe97b] Deallocating network for instance {{(pid=75226) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 17 01:40:41 user nova-compute[75226]: DEBUG nova.network.neutron [-] [instance: 38062487-67ca-4962-974f-81456aebe97b] deallocate_for_instance() {{(pid=75226) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 17 01:40:41 user nova-compute[75226]: DEBUG nova.compute.manager [None req-5581ce6f-e68c-4d0a-961b-ad177375bbaa tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] [instance: 6f3b54ce-4dc1-445a-9108-3f628713e6ec] Instance event wait completed in 0 seconds for  {{(pid=75226) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 17 01:40:41 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-5581ce6f-e68c-4d0a-961b-ad177375bbaa tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] [instance: 6f3b54ce-4dc1-445a-9108-3f628713e6ec] Guest created on hypervisor {{(pid=75226) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 17 01:40:41 user nova-compute[75226]: INFO nova.virt.libvirt.driver [-] [instance: 6f3b54ce-4dc1-445a-9108-3f628713e6ec] Instance spawned successfully.
Nov 17 01:40:41 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-5581ce6f-e68c-4d0a-961b-ad177375bbaa tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] [instance: 6f3b54ce-4dc1-445a-9108-3f628713e6ec] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 17 01:40:41 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-5581ce6f-e68c-4d0a-961b-ad177375bbaa tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] [instance: 6f3b54ce-4dc1-445a-9108-3f628713e6ec] Found default for hw_input_bus of None {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:40:41 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-5581ce6f-e68c-4d0a-961b-ad177375bbaa tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] [instance: 6f3b54ce-4dc1-445a-9108-3f628713e6ec] Found default for hw_pointer_model of None {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:40:41 user nova-compute[75226]: INFO nova.compute.manager [None req-5581ce6f-e68c-4d0a-961b-ad177375bbaa tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] [instance: 6f3b54ce-4dc1-445a-9108-3f628713e6ec] Took 6.25 seconds to spawn the instance on the hypervisor.
Nov 17 01:40:41 user nova-compute[75226]: DEBUG nova.compute.manager [None req-5581ce6f-e68c-4d0a-961b-ad177375bbaa tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] [instance: 6f3b54ce-4dc1-445a-9108-3f628713e6ec] Checking state {{(pid=75226) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 01:40:41 user nova-compute[75226]: DEBUG nova.compute.manager [req-b8871268-95d6-45d8-b132-6aad1ac8a84e req-ad5ffd6b-b375-40df-a0fb-95d0c5a0dc03 service nova] [instance: 6f3b54ce-4dc1-445a-9108-3f628713e6ec] Received event network-vif-plugged-eacf2a0d-87c7-49a0-bc53-5412b6c4a19c {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:40:41 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-b8871268-95d6-45d8-b132-6aad1ac8a84e req-ad5ffd6b-b375-40df-a0fb-95d0c5a0dc03 service nova] Acquiring lock "6f3b54ce-4dc1-445a-9108-3f628713e6ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:40:41 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-b8871268-95d6-45d8-b132-6aad1ac8a84e req-ad5ffd6b-b375-40df-a0fb-95d0c5a0dc03 service nova] Lock "6f3b54ce-4dc1-445a-9108-3f628713e6ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:40:41 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-b8871268-95d6-45d8-b132-6aad1ac8a84e req-ad5ffd6b-b375-40df-a0fb-95d0c5a0dc03 service nova] Lock "6f3b54ce-4dc1-445a-9108-3f628713e6ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:40:41 user nova-compute[75226]: DEBUG nova.compute.manager [req-b8871268-95d6-45d8-b132-6aad1ac8a84e req-ad5ffd6b-b375-40df-a0fb-95d0c5a0dc03 service nova] [instance: 6f3b54ce-4dc1-445a-9108-3f628713e6ec] No waiting events found dispatching network-vif-plugged-eacf2a0d-87c7-49a0-bc53-5412b6c4a19c {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:40:41 user nova-compute[75226]: WARNING nova.compute.manager [req-b8871268-95d6-45d8-b132-6aad1ac8a84e req-ad5ffd6b-b375-40df-a0fb-95d0c5a0dc03 service nova] [instance: 6f3b54ce-4dc1-445a-9108-3f628713e6ec] Received unexpected event network-vif-plugged-eacf2a0d-87c7-49a0-bc53-5412b6c4a19c for instance with vm_state building and task_state spawning.
Nov 17 01:40:41 user nova-compute[75226]: INFO nova.compute.manager [None req-5581ce6f-e68c-4d0a-961b-ad177375bbaa tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] [instance: 6f3b54ce-4dc1-445a-9108-3f628713e6ec] Took 7.02 seconds to build instance.
Nov 17 01:40:41 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-5581ce6f-e68c-4d0a-961b-ad177375bbaa tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Lock "6f3b54ce-4dc1-445a-9108-3f628713e6ec" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.114s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:40:41 user nova-compute[75226]: DEBUG nova.network.neutron [-] [instance: 38062487-67ca-4962-974f-81456aebe97b] Updating instance_info_cache with network_info: [] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:40:41 user nova-compute[75226]: INFO nova.compute.manager [-] [instance: 38062487-67ca-4962-974f-81456aebe97b] Took 0.60 seconds to deallocate network for instance.
Nov 17 01:40:41 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-8ad99888-68f8-484c-ac89-cff3a8201292 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:40:41 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-8ad99888-68f8-484c-ac89-cff3a8201292 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:40:42 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-8ad99888-68f8-484c-ac89-cff3a8201292 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:40:42 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-8ad99888-68f8-484c-ac89-cff3a8201292 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:40:42 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-8ad99888-68f8-484c-ac89-cff3a8201292 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.277s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:40:42 user nova-compute[75226]: INFO nova.scheduler.client.report [None req-8ad99888-68f8-484c-ac89-cff3a8201292 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Deleted allocations for instance 38062487-67ca-4962-974f-81456aebe97b
Nov 17 01:40:42 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-8ad99888-68f8-484c-ac89-cff3a8201292 tempest-ServerActionsTestOtherA-2125452149 tempest-ServerActionsTestOtherA-2125452149-project-member] Lock "38062487-67ca-4962-974f-81456aebe97b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.928s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:40:42 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-cce77794-097f-42d5-919b-4a54da635036 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d6d21784-2ebe-4a39-9ceb-f6607f02e3c4 is timed out.
Nov 17 01:40:42 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-cce77794-097f-42d5-919b-4a54da635036 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] Successfully detached device vdb from instance d6d21784-2ebe-4a39-9ceb-f6607f02e3c4 from the live domain config.
Nov 17 01:40:42 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cce77794-097f-42d5-919b-4a54da635036 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] [instance: d6d21784-2ebe-4a39-9ceb-f6607f02e3c4] calling os-brick to detach iSCSI Volume {{(pid=75226) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 17 01:40:42 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-cce77794-097f-42d5-919b-4a54da635036 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc4cc36b490>, {'target_iqn': 'iqn.2010-10.org.openstack:afbcbbf4-d90c-4224-869f-904342190f6c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nkDbXhmW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:40:42 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-cce77794-097f-42d5-919b-4a54da635036 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:40:42 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-cce77794-097f-42d5-919b-4a54da635036 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:40:42 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-cce77794-097f-42d5-919b-4a54da635036 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:40:42 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:40:42 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:40:42 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[7619db27-cafa-4a95-a4ab-2027cc0dc302]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:42287bb8-179a-4f5d-adc3-ab6e03ef12dd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:afbcbbf4-d90c-4224-869f-904342190f6c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:40:42 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-cce77794-097f-42d5-919b-4a54da635036 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 17 01:40:42 user nova-compute[75226]: No targets found.
Nov 17 01:40:42 user nova-compute[75226]: iSNS:
Nov 17 01:40:42 user nova-compute[75226]: No targets found.
Nov 17 01:40:42 user nova-compute[75226]: STATIC:
Nov 17 01:40:42 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:42287bb8-179a-4f5d-adc3-ab6e03ef12dd
Nov 17 01:40:42 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:40:42 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:40:42 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:afbcbbf4-d90c-4224-869f-904342190f6c
Nov 17 01:40:42 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:40:42 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:40:42 user nova-compute[75226]: FIRMWARE:
Nov 17 01:40:42 user nova-compute[75226]: No targets found.
Nov 17 01:40:42 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:40:42 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-cce77794-097f-42d5-919b-4a54da635036 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 17 01:40:42 user nova-compute[75226]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 17 01:40:42 user nova-compute[75226]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75226) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 17 01:40:42 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-cce77794-097f-42d5-919b-4a54da635036 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:afbcbbf4-d90c-4224-869f-904342190f6c', 0)] {{(pid=75226) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 17 01:40:42 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:40:42 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:40:42 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[2898a70f-274b-49ae-b1fc-fd2c575f88ab]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:42287bb8-179a-4f5d-adc3-ab6e03ef12dd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:afbcbbf4-d90c-4224-869f-904342190f6c\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:40:42 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:40:42 user nova-compute[75226]: DEBUG nova.compute.manager [req-0f1ff2eb-a297-48bb-8e9a-8f2c98cac511 req-3acb4dbe-598c-49e8-bc2e-c69d5ddfa152 service nova] [instance: 38062487-67ca-4962-974f-81456aebe97b] Received event network-vif-plugged-b4bb80f3-212b-41bf-94a3-442865a852c7 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:40:42 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-0f1ff2eb-a297-48bb-8e9a-8f2c98cac511 req-3acb4dbe-598c-49e8-bc2e-c69d5ddfa152 service nova] Acquiring lock "38062487-67ca-4962-974f-81456aebe97b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:40:42 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-0f1ff2eb-a297-48bb-8e9a-8f2c98cac511 req-3acb4dbe-598c-49e8-bc2e-c69d5ddfa152 service nova] Lock "38062487-67ca-4962-974f-81456aebe97b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:40:42 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-0f1ff2eb-a297-48bb-8e9a-8f2c98cac511 req-3acb4dbe-598c-49e8-bc2e-c69d5ddfa152 service nova] Lock "38062487-67ca-4962-974f-81456aebe97b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:40:42 user nova-compute[75226]: DEBUG nova.compute.manager [req-0f1ff2eb-a297-48bb-8e9a-8f2c98cac511 req-3acb4dbe-598c-49e8-bc2e-c69d5ddfa152 service nova] [instance: 38062487-67ca-4962-974f-81456aebe97b] No waiting events found dispatching network-vif-plugged-b4bb80f3-212b-41bf-94a3-442865a852c7 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:40:42 user nova-compute[75226]: WARNING nova.compute.manager [req-0f1ff2eb-a297-48bb-8e9a-8f2c98cac511 req-3acb4dbe-598c-49e8-bc2e-c69d5ddfa152 service nova] [instance: 38062487-67ca-4962-974f-81456aebe97b] Received unexpected event network-vif-plugged-b4bb80f3-212b-41bf-94a3-442865a852c7 for instance with vm_state deleted and task_state None.
Nov 17 01:40:42 user nova-compute[75226]: DEBUG nova.compute.manager [req-0f1ff2eb-a297-48bb-8e9a-8f2c98cac511 req-3acb4dbe-598c-49e8-bc2e-c69d5ddfa152 service nova] [instance: 38062487-67ca-4962-974f-81456aebe97b] Received event network-vif-deleted-b4bb80f3-212b-41bf-94a3-442865a852c7 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:40:42 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:40:42 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[b93575cb-360d-4a12-9c13-92bea592a6ba]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afbcbbf4-d90c-4224-869f-904342190f6c (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42287bb8-179a-4f5d-adc3-ab6e03ef12dd (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:40:42 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-cce77794-097f-42d5-919b-4a54da635036 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afbcbbf4-d90c-4224-869f-904342190f6c (non-flash)
Nov 17 01:40:42 user nova-compute[75226]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42287bb8-179a-4f5d-adc3-ab6e03ef12dd (non-flash)
Nov 17 01:40:42 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:40:42 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-cce77794-097f-42d5-919b-4a54da635036 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afbcbbf4-d90c-4224-869f-904342190f6c (non-flash)
Nov 17 01:40:42 user nova-compute[75226]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42287bb8-179a-4f5d-adc3-ab6e03ef12dd (non-flash)
Nov 17 01:40:42 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:40:42 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-cce77794-097f-42d5-919b-4a54da635036 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc4d42ee440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:afbcbbf4-d90c-4224-869f-904342190f6c'): ({'sde'}, set())}) {{(pid=75226) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 17 01:40:42 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-cce77794-097f-42d5-919b-4a54da635036 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] Removing single pathed devices sde {{(pid=75226) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 17 01:40:42 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:40:42 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:40:42 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[496afd72-24a9-4205-8728-0fd1fb82800b]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:40:42 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:40:42 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:40:42 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f514015-e41e-4e90-938f-73f615b11ff4]: (4, ('ok\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:40:42 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-cce77794-097f-42d5-919b-4a54da635036 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] Flushing IO for device /dev/sde {{(pid=75226) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 17 01:40:42 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:40:42 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:40:42 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[361a1d1f-085f-4d0e-82e1-17ac88c0289e]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:40:42 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-cce77794-097f-42d5-919b-4a54da635036 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75226) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 17 01:40:42 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:40:42 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.049s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:40:42 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fd393ac-4d10-4a5c-87f7-6c9e983b0e96]: (4, ('1', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:40:42 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-cce77794-097f-42d5-919b-4a54da635036 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75226) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 17 01:40:42 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-cce77794-097f-42d5-919b-4a54da635036 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] SCSI volumes sde have been removed. {{(pid=75226) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 17 01:40:42 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-cce77794-097f-42d5-919b-4a54da635036 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:afbcbbf4-d90c-4224-869f-904342190f6c')] {{(pid=75226) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 17 01:40:42 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afbcbbf4-d90c-4224-869f-904342190f6c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:40:43 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afbcbbf4-d90c-4224-869f-904342190f6c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.038s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:40:43 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[98096ead-d3cb-4563-9a3f-bb8a81395fb9]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:40:43 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-cce77794-097f-42d5-919b-4a54da635036 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:40:43 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afbcbbf4-d90c-4224-869f-904342190f6c -p 172.16.0.220:3260 --logout {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:40:43 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afbcbbf4-d90c-4224-869f-904342190f6c -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:40:43 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f016c19-8401-4282-b473-dc9120db87de]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:afbcbbf4-d90c-4224-869f-904342190f6c, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:afbcbbf4-d90c-4224-869f-904342190f6c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:40:43 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-cce77794-097f-42d5-919b-4a54da635036 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:afbcbbf4-d90c-4224-869f-904342190f6c, portal: 172.16.0.220,3260]
Nov 17 01:40:43 user nova-compute[75226]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:afbcbbf4-d90c-4224-869f-904342190f6c, portal: 172.16.0.220,3260] successful.
Nov 17 01:40:43 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:40:43 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afbcbbf4-d90c-4224-869f-904342190f6c -p 172.16.0.220:3260 --op delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:40:43 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afbcbbf4-d90c-4224-869f-904342190f6c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:40:43 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4e03a79-f9c3-41c9-9328-8788b9832b79]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:40:43 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-cce77794-097f-42d5-919b-4a54da635036 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:40:43 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-cce77794-097f-42d5-919b-4a54da635036 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.408s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:40:43 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-cce77794-097f-42d5-919b-4a54da635036 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] <== disconnect_volume: return (411ms) None {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:40:43 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cce77794-097f-42d5-919b-4a54da635036 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] [instance: d6d21784-2ebe-4a39-9ceb-f6607f02e3c4] Disconnected iSCSI Volume {{(pid=75226) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 17 01:40:43 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:40:43 user nova-compute[75226]: DEBUG nova.objects.instance [None req-cce77794-097f-42d5-919b-4a54da635036 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] Lazy-loading 'flavor' on Instance uuid d6d21784-2ebe-4a39-9ceb-f6607f02e3c4 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:40:44 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-cce77794-097f-42d5-919b-4a54da635036 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] Lock "d6d21784-2ebe-4a39-9ceb-f6607f02e3c4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.789s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:40:46 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:40:48 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-21887099-b862-4c2d-b325-5993585f1272 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Acquiring lock "8d983732-91aa-4f20-9d7d-3de66029cba5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:40:48 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-21887099-b862-4c2d-b325-5993585f1272 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Lock "8d983732-91aa-4f20-9d7d-3de66029cba5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:40:48 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-21887099-b862-4c2d-b325-5993585f1272 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Acquiring lock "8d983732-91aa-4f20-9d7d-3de66029cba5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:40:48 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-21887099-b862-4c2d-b325-5993585f1272 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Lock "8d983732-91aa-4f20-9d7d-3de66029cba5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:40:48 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-21887099-b862-4c2d-b325-5993585f1272 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Lock "8d983732-91aa-4f20-9d7d-3de66029cba5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:40:48 user nova-compute[75226]: INFO nova.compute.manager [None req-21887099-b862-4c2d-b325-5993585f1272 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] [instance: 8d983732-91aa-4f20-9d7d-3de66029cba5] Terminating instance
Nov 17 01:40:48 user nova-compute[75226]: DEBUG nova.compute.manager [None req-21887099-b862-4c2d-b325-5993585f1272 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] [instance: 8d983732-91aa-4f20-9d7d-3de66029cba5] Start destroying the instance on the hypervisor. {{(pid=75226) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 17 01:40:48 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:40:49 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:40:49 user nova-compute[75226]: DEBUG nova.compute.manager [req-5c1158cc-5557-4f28-bf3a-db0ffd9628f5 req-d2da4ead-25d5-467f-94ad-4a92a6b88b37 service nova] [instance: 8d983732-91aa-4f20-9d7d-3de66029cba5] Received event network-vif-unplugged-2ef7c6ef-e077-49c7-aaca-1d8ba7e7335c {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:40:49 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-5c1158cc-5557-4f28-bf3a-db0ffd9628f5 req-d2da4ead-25d5-467f-94ad-4a92a6b88b37 service nova] Acquiring lock "8d983732-91aa-4f20-9d7d-3de66029cba5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:40:49 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-5c1158cc-5557-4f28-bf3a-db0ffd9628f5 req-d2da4ead-25d5-467f-94ad-4a92a6b88b37 service nova] Lock "8d983732-91aa-4f20-9d7d-3de66029cba5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:40:49 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-5c1158cc-5557-4f28-bf3a-db0ffd9628f5 req-d2da4ead-25d5-467f-94ad-4a92a6b88b37 service nova] Lock "8d983732-91aa-4f20-9d7d-3de66029cba5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:40:49 user nova-compute[75226]: DEBUG nova.compute.manager [req-5c1158cc-5557-4f28-bf3a-db0ffd9628f5 req-d2da4ead-25d5-467f-94ad-4a92a6b88b37 service nova] [instance: 8d983732-91aa-4f20-9d7d-3de66029cba5] No waiting events found dispatching network-vif-unplugged-2ef7c6ef-e077-49c7-aaca-1d8ba7e7335c {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:40:49 user nova-compute[75226]: DEBUG nova.compute.manager [req-5c1158cc-5557-4f28-bf3a-db0ffd9628f5 req-d2da4ead-25d5-467f-94ad-4a92a6b88b37 service nova] [instance: 8d983732-91aa-4f20-9d7d-3de66029cba5] Received event network-vif-unplugged-2ef7c6ef-e077-49c7-aaca-1d8ba7e7335c for instance with task_state deleting. {{(pid=75226) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 17 01:40:49 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:40:49 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:40:49 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:40:49 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:40:49 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:40:49 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:40:49 user nova-compute[75226]: INFO nova.virt.libvirt.driver [-] [instance: 8d983732-91aa-4f20-9d7d-3de66029cba5] Instance destroyed successfully.
Nov 17 01:40:49 user nova-compute[75226]: DEBUG nova.objects.instance [None req-21887099-b862-4c2d-b325-5993585f1272 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Lazy-loading 'resources' on Instance uuid 8d983732-91aa-4f20-9d7d-3de66029cba5 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:40:49 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-21887099-b862-4c2d-b325-5993585f1272 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:34:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-483037740',display_name='tempest-ServerRescueNegativeTestJSON-server-483037740',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-483037740',id=35,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOVRakfmKG4XwLomtS+/jC13ImozUfCSHgByLANg2qVBj+muP2PNHXh8ZrfOah4b/BlgXMz/oIJTeq+c9dBzYhbjAocJ7t33Td2l/vK8u2gWzu5nr29e4L+F2Hdr873C7g==',key_name='tempest-keypair-769708112',keypairs=<?>,launch_index=0,launched_at=2023-11-17T01:36:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2052a37a068e4d948c57560c0f4445e4',ramdisk_id='',reservation_id='r-fwlr0hcq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-344970408',owner_user_name='tempest-ServerRescueNegativeTestJSON-344970408-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T01:38:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='12f405f1486a4f5187e628c60f223e98',uuid=8d983732-91aa-4f20-9d7d-3de66029cba5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2ef7c6ef-e077-49c7-aaca-1d8ba7e7335c", "address": "fa:16:3e:90:7b:a1", "network": {"id": "a9710b94-56f8-4cf6-9bb6-344b275e5bf2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-512340839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2052a37a068e4d948c57560c0f4445e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ef7c6ef-e0", "ovs_interfaceid": "2ef7c6ef-e077-49c7-aaca-1d8ba7e7335c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 17 01:40:49 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-21887099-b862-4c2d-b325-5993585f1272 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Converting VIF {"id": "2ef7c6ef-e077-49c7-aaca-1d8ba7e7335c", "address": "fa:16:3e:90:7b:a1", "network": {"id": "a9710b94-56f8-4cf6-9bb6-344b275e5bf2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-512340839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2052a37a068e4d948c57560c0f4445e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ef7c6ef-e0", "ovs_interfaceid": "2ef7c6ef-e077-49c7-aaca-1d8ba7e7335c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:40:49 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-21887099-b862-4c2d-b325-5993585f1272 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:90:7b:a1,bridge_name='br-int',has_traffic_filtering=True,id=2ef7c6ef-e077-49c7-aaca-1d8ba7e7335c,network=Network(a9710b94-56f8-4cf6-9bb6-344b275e5bf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ef7c6ef-e0') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:40:49 user nova-compute[75226]: DEBUG os_vif [None req-21887099-b862-4c2d-b325-5993585f1272 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:90:7b:a1,bridge_name='br-int',has_traffic_filtering=True,id=2ef7c6ef-e077-49c7-aaca-1d8ba7e7335c,network=Network(a9710b94-56f8-4cf6-9bb6-344b275e5bf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ef7c6ef-e0') {{(pid=75226) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 17 01:40:49 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:40:49 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2ef7c6ef-e0, bridge=br-int, if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:40:49 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:40:49 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:40:49 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:40:49 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=980445f5-b773-4798-a4a1-c4bddb58a941) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:40:49 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:40:49 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:40:49 user nova-compute[75226]: INFO os_vif [None req-21887099-b862-4c2d-b325-5993585f1272 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:90:7b:a1,bridge_name='br-int',has_traffic_filtering=True,id=2ef7c6ef-e077-49c7-aaca-1d8ba7e7335c,network=Network(a9710b94-56f8-4cf6-9bb6-344b275e5bf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ef7c6ef-e0')
Nov 17 01:40:49 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-21887099-b862-4c2d-b325-5993585f1272 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] [instance: 8d983732-91aa-4f20-9d7d-3de66029cba5] Deleting instance files /opt/stack/data/nova/instances/8d983732-91aa-4f20-9d7d-3de66029cba5_del
Nov 17 01:40:49 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-21887099-b862-4c2d-b325-5993585f1272 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] [instance: 8d983732-91aa-4f20-9d7d-3de66029cba5] Deletion of /opt/stack/data/nova/instances/8d983732-91aa-4f20-9d7d-3de66029cba5_del complete
Nov 17 01:40:49 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:40:49 user nova-compute[75226]: INFO nova.compute.manager [None req-21887099-b862-4c2d-b325-5993585f1272 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] [instance: 8d983732-91aa-4f20-9d7d-3de66029cba5] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 17 01:40:49 user nova-compute[75226]: DEBUG oslo.service.loopingcall [None req-21887099-b862-4c2d-b325-5993585f1272 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75226) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 17 01:40:49 user nova-compute[75226]: DEBUG nova.compute.manager [-] [instance: 8d983732-91aa-4f20-9d7d-3de66029cba5] Deallocating network for instance {{(pid=75226) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 17 01:40:49 user nova-compute[75226]: DEBUG nova.network.neutron [-] [instance: 8d983732-91aa-4f20-9d7d-3de66029cba5] deallocate_for_instance() {{(pid=75226) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 17 01:40:49 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:40:49 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:40:50 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:40:50 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:40:50 user nova-compute[75226]: DEBUG nova.network.neutron [-] [instance: 8d983732-91aa-4f20-9d7d-3de66029cba5] Updating instance_info_cache with network_info: [] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:40:50 user nova-compute[75226]: INFO nova.compute.manager [-] [instance: 8d983732-91aa-4f20-9d7d-3de66029cba5] Took 0.82 seconds to deallocate network for instance.
Nov 17 01:40:50 user nova-compute[75226]: DEBUG nova.compute.manager [req-efceedcf-1125-4a1e-bb35-dd2671348760 req-9a6e912c-fe45-44f1-b482-5927873a5677 service nova] [instance: 8d983732-91aa-4f20-9d7d-3de66029cba5] Received event network-vif-deleted-2ef7c6ef-e077-49c7-aaca-1d8ba7e7335c {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:40:50 user nova-compute[75226]: INFO nova.compute.manager [req-efceedcf-1125-4a1e-bb35-dd2671348760 req-9a6e912c-fe45-44f1-b482-5927873a5677 service nova] [instance: 8d983732-91aa-4f20-9d7d-3de66029cba5] Neutron deleted interface 2ef7c6ef-e077-49c7-aaca-1d8ba7e7335c; detaching it from the instance and deleting it from the info cache
Nov 17 01:40:50 user nova-compute[75226]: DEBUG nova.network.neutron [req-efceedcf-1125-4a1e-bb35-dd2671348760 req-9a6e912c-fe45-44f1-b482-5927873a5677 service nova] [instance: 8d983732-91aa-4f20-9d7d-3de66029cba5] Updating instance_info_cache with network_info: [] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:40:50 user nova-compute[75226]: DEBUG nova.compute.manager [req-efceedcf-1125-4a1e-bb35-dd2671348760 req-9a6e912c-fe45-44f1-b482-5927873a5677 service nova] [instance: 8d983732-91aa-4f20-9d7d-3de66029cba5] Detach interface failed, port_id=2ef7c6ef-e077-49c7-aaca-1d8ba7e7335c, reason: Instance 8d983732-91aa-4f20-9d7d-3de66029cba5 could not be found. {{(pid=75226) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 17 01:40:50 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-21887099-b862-4c2d-b325-5993585f1272 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:40:50 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-21887099-b862-4c2d-b325-5993585f1272 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:40:50 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-21887099-b862-4c2d-b325-5993585f1272 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:40:50 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-21887099-b862-4c2d-b325-5993585f1272 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:40:50 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-21887099-b862-4c2d-b325-5993585f1272 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.320s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:40:51 user nova-compute[75226]: INFO nova.scheduler.client.report [None req-21887099-b862-4c2d-b325-5993585f1272 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Deleted allocations for instance 8d983732-91aa-4f20-9d7d-3de66029cba5
Nov 17 01:40:51 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-21887099-b862-4c2d-b325-5993585f1272 tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Lock "8d983732-91aa-4f20-9d7d-3de66029cba5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.182s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:40:51 user nova-compute[75226]: DEBUG nova.compute.manager [req-9d163d2d-14cf-4585-9612-80a05d944439 req-14bcf669-ce7a-41eb-b5c2-c481ecdfb22c service nova] [instance: 8d983732-91aa-4f20-9d7d-3de66029cba5] Received event network-vif-plugged-2ef7c6ef-e077-49c7-aaca-1d8ba7e7335c {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:40:51 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-9d163d2d-14cf-4585-9612-80a05d944439 req-14bcf669-ce7a-41eb-b5c2-c481ecdfb22c service nova] Acquiring lock "8d983732-91aa-4f20-9d7d-3de66029cba5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:40:51 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-9d163d2d-14cf-4585-9612-80a05d944439 req-14bcf669-ce7a-41eb-b5c2-c481ecdfb22c service nova] Lock "8d983732-91aa-4f20-9d7d-3de66029cba5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:40:51 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-9d163d2d-14cf-4585-9612-80a05d944439 req-14bcf669-ce7a-41eb-b5c2-c481ecdfb22c service nova] Lock "8d983732-91aa-4f20-9d7d-3de66029cba5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:40:51 user nova-compute[75226]: DEBUG nova.compute.manager [req-9d163d2d-14cf-4585-9612-80a05d944439 req-14bcf669-ce7a-41eb-b5c2-c481ecdfb22c service nova] [instance: 8d983732-91aa-4f20-9d7d-3de66029cba5] No waiting events found dispatching network-vif-plugged-2ef7c6ef-e077-49c7-aaca-1d8ba7e7335c {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:40:51 user nova-compute[75226]: WARNING nova.compute.manager [req-9d163d2d-14cf-4585-9612-80a05d944439 req-14bcf669-ce7a-41eb-b5c2-c481ecdfb22c service nova] [instance: 8d983732-91aa-4f20-9d7d-3de66029cba5] Received unexpected event network-vif-plugged-2ef7c6ef-e077-49c7-aaca-1d8ba7e7335c for instance with vm_state deleted and task_state None.
Nov 17 01:40:51 user nova-compute[75226]: DEBUG nova.compute.manager [req-9d163d2d-14cf-4585-9612-80a05d944439 req-14bcf669-ce7a-41eb-b5c2-c481ecdfb22c service nova] [instance: 8d983732-91aa-4f20-9d7d-3de66029cba5] Received event network-vif-plugged-2ef7c6ef-e077-49c7-aaca-1d8ba7e7335c {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:40:51 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-9d163d2d-14cf-4585-9612-80a05d944439 req-14bcf669-ce7a-41eb-b5c2-c481ecdfb22c service nova] Acquiring lock "8d983732-91aa-4f20-9d7d-3de66029cba5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:40:51 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-9d163d2d-14cf-4585-9612-80a05d944439 req-14bcf669-ce7a-41eb-b5c2-c481ecdfb22c service nova] Lock "8d983732-91aa-4f20-9d7d-3de66029cba5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:40:51 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-9d163d2d-14cf-4585-9612-80a05d944439 req-14bcf669-ce7a-41eb-b5c2-c481ecdfb22c service nova] Lock "8d983732-91aa-4f20-9d7d-3de66029cba5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:40:51 user nova-compute[75226]: DEBUG nova.compute.manager [req-9d163d2d-14cf-4585-9612-80a05d944439 req-14bcf669-ce7a-41eb-b5c2-c481ecdfb22c service nova] [instance: 8d983732-91aa-4f20-9d7d-3de66029cba5] No waiting events found dispatching network-vif-plugged-2ef7c6ef-e077-49c7-aaca-1d8ba7e7335c {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:40:51 user nova-compute[75226]: WARNING nova.compute.manager [req-9d163d2d-14cf-4585-9612-80a05d944439 req-14bcf669-ce7a-41eb-b5c2-c481ecdfb22c service nova] [instance: 8d983732-91aa-4f20-9d7d-3de66029cba5] Received unexpected event network-vif-plugged-2ef7c6ef-e077-49c7-aaca-1d8ba7e7335c for instance with vm_state deleted and task_state None.
Nov 17 01:40:51 user nova-compute[75226]: DEBUG nova.compute.manager [req-9d163d2d-14cf-4585-9612-80a05d944439 req-14bcf669-ce7a-41eb-b5c2-c481ecdfb22c service nova] [instance: 8d983732-91aa-4f20-9d7d-3de66029cba5] Received event network-vif-plugged-2ef7c6ef-e077-49c7-aaca-1d8ba7e7335c {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:40:51 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-9d163d2d-14cf-4585-9612-80a05d944439 req-14bcf669-ce7a-41eb-b5c2-c481ecdfb22c service nova] Acquiring lock "8d983732-91aa-4f20-9d7d-3de66029cba5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:40:51 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-9d163d2d-14cf-4585-9612-80a05d944439 req-14bcf669-ce7a-41eb-b5c2-c481ecdfb22c service nova] Lock "8d983732-91aa-4f20-9d7d-3de66029cba5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:40:51 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-9d163d2d-14cf-4585-9612-80a05d944439 req-14bcf669-ce7a-41eb-b5c2-c481ecdfb22c service nova] Lock "8d983732-91aa-4f20-9d7d-3de66029cba5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:40:51 user nova-compute[75226]: DEBUG nova.compute.manager [req-9d163d2d-14cf-4585-9612-80a05d944439 req-14bcf669-ce7a-41eb-b5c2-c481ecdfb22c service nova] [instance: 8d983732-91aa-4f20-9d7d-3de66029cba5] No waiting events found dispatching network-vif-plugged-2ef7c6ef-e077-49c7-aaca-1d8ba7e7335c {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:40:51 user nova-compute[75226]: WARNING nova.compute.manager [req-9d163d2d-14cf-4585-9612-80a05d944439 req-14bcf669-ce7a-41eb-b5c2-c481ecdfb22c service nova] [instance: 8d983732-91aa-4f20-9d7d-3de66029cba5] Received unexpected event network-vif-plugged-2ef7c6ef-e077-49c7-aaca-1d8ba7e7335c for instance with vm_state deleted and task_state None.
Nov 17 01:40:51 user nova-compute[75226]: DEBUG nova.compute.manager [req-9d163d2d-14cf-4585-9612-80a05d944439 req-14bcf669-ce7a-41eb-b5c2-c481ecdfb22c service nova] [instance: 8d983732-91aa-4f20-9d7d-3de66029cba5] Received event network-vif-unplugged-2ef7c6ef-e077-49c7-aaca-1d8ba7e7335c {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:40:51 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-9d163d2d-14cf-4585-9612-80a05d944439 req-14bcf669-ce7a-41eb-b5c2-c481ecdfb22c service nova] Acquiring lock "8d983732-91aa-4f20-9d7d-3de66029cba5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:40:51 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-9d163d2d-14cf-4585-9612-80a05d944439 req-14bcf669-ce7a-41eb-b5c2-c481ecdfb22c service nova] Lock "8d983732-91aa-4f20-9d7d-3de66029cba5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:40:51 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-9d163d2d-14cf-4585-9612-80a05d944439 req-14bcf669-ce7a-41eb-b5c2-c481ecdfb22c service nova] Lock "8d983732-91aa-4f20-9d7d-3de66029cba5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:40:51 user nova-compute[75226]: DEBUG nova.compute.manager [req-9d163d2d-14cf-4585-9612-80a05d944439 req-14bcf669-ce7a-41eb-b5c2-c481ecdfb22c service nova] [instance: 8d983732-91aa-4f20-9d7d-3de66029cba5] No waiting events found dispatching network-vif-unplugged-2ef7c6ef-e077-49c7-aaca-1d8ba7e7335c {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:40:51 user nova-compute[75226]: WARNING nova.compute.manager [req-9d163d2d-14cf-4585-9612-80a05d944439 req-14bcf669-ce7a-41eb-b5c2-c481ecdfb22c service nova] [instance: 8d983732-91aa-4f20-9d7d-3de66029cba5] Received unexpected event network-vif-unplugged-2ef7c6ef-e077-49c7-aaca-1d8ba7e7335c for instance with vm_state deleted and task_state None.
Nov 17 01:40:51 user nova-compute[75226]: DEBUG nova.compute.manager [req-9d163d2d-14cf-4585-9612-80a05d944439 req-14bcf669-ce7a-41eb-b5c2-c481ecdfb22c service nova] [instance: 8d983732-91aa-4f20-9d7d-3de66029cba5] Received event network-vif-plugged-2ef7c6ef-e077-49c7-aaca-1d8ba7e7335c {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:40:51 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-9d163d2d-14cf-4585-9612-80a05d944439 req-14bcf669-ce7a-41eb-b5c2-c481ecdfb22c service nova] Acquiring lock "8d983732-91aa-4f20-9d7d-3de66029cba5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:40:51 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-9d163d2d-14cf-4585-9612-80a05d944439 req-14bcf669-ce7a-41eb-b5c2-c481ecdfb22c service nova] Lock "8d983732-91aa-4f20-9d7d-3de66029cba5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:40:51 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-9d163d2d-14cf-4585-9612-80a05d944439 req-14bcf669-ce7a-41eb-b5c2-c481ecdfb22c service nova] Lock "8d983732-91aa-4f20-9d7d-3de66029cba5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:40:51 user nova-compute[75226]: DEBUG nova.compute.manager [req-9d163d2d-14cf-4585-9612-80a05d944439 req-14bcf669-ce7a-41eb-b5c2-c481ecdfb22c service nova] [instance: 8d983732-91aa-4f20-9d7d-3de66029cba5] No waiting events found dispatching network-vif-plugged-2ef7c6ef-e077-49c7-aaca-1d8ba7e7335c {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:40:51 user nova-compute[75226]: WARNING nova.compute.manager [req-9d163d2d-14cf-4585-9612-80a05d944439 req-14bcf669-ce7a-41eb-b5c2-c481ecdfb22c service nova] [instance: 8d983732-91aa-4f20-9d7d-3de66029cba5] Received unexpected event network-vif-plugged-2ef7c6ef-e077-49c7-aaca-1d8ba7e7335c for instance with vm_state deleted and task_state None.
Nov 17 01:40:54 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:40:58 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:40:59 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:41:03 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:41:04 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:41:08 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:41:08 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:41:08 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:41:08 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:41:08 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:41:08 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75226) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 17 01:41:09 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c4a9724-533e-40c8-ab2a-ce3415af240a/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:41:09 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c4a9724-533e-40c8-ab2a-ce3415af240a/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:41:09 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c4a9724-533e-40c8-ab2a-ce3415af240a/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:41:09 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c4a9724-533e-40c8-ab2a-ce3415af240a/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:41:09 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75226) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 01:41:09 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6d21784-2ebe-4a39-9ceb-f6607f02e3c4/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:41:09 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6d21784-2ebe-4a39-9ceb-f6607f02e3c4/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:41:09 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6d21784-2ebe-4a39-9ceb-f6607f02e3c4/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:41:09 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:41:09 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6d21784-2ebe-4a39-9ceb-f6607f02e3c4/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:41:09 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57f2553-feb4-49d8-a47b-dedbb4487f9e/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:41:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57f2553-feb4-49d8-a47b-dedbb4487f9e/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:41:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57f2553-feb4-49d8-a47b-dedbb4487f9e/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:41:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57f2553-feb4-49d8-a47b-dedbb4487f9e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:41:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f3b54ce-4dc1-445a-9108-3f628713e6ec/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:41:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f3b54ce-4dc1-445a-9108-3f628713e6ec/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:41:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f3b54ce-4dc1-445a-9108-3f628713e6ec/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:41:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f3b54ce-4dc1-445a-9108-3f628713e6ec/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:41:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c280142-8901-4f83-bde4-baaa097e05b0/disk.rescue --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:41:10 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-1b7d5232-15ce-49b2-84cc-d77fba0cd975 tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] Acquiring lock "d57f2553-feb4-49d8-a47b-dedbb4487f9e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:41:10 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-1b7d5232-15ce-49b2-84cc-d77fba0cd975 tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] Lock "d57f2553-feb4-49d8-a47b-dedbb4487f9e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:41:10 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-1b7d5232-15ce-49b2-84cc-d77fba0cd975 tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] Acquiring lock "d57f2553-feb4-49d8-a47b-dedbb4487f9e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:41:10 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-1b7d5232-15ce-49b2-84cc-d77fba0cd975 tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] Lock "d57f2553-feb4-49d8-a47b-dedbb4487f9e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:41:10 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-1b7d5232-15ce-49b2-84cc-d77fba0cd975 tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] Lock "d57f2553-feb4-49d8-a47b-dedbb4487f9e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:41:10 user nova-compute[75226]: INFO nova.compute.manager [None req-1b7d5232-15ce-49b2-84cc-d77fba0cd975 tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] [instance: d57f2553-feb4-49d8-a47b-dedbb4487f9e] Terminating instance
Nov 17 01:41:10 user nova-compute[75226]: DEBUG nova.compute.manager [None req-1b7d5232-15ce-49b2-84cc-d77fba0cd975 tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] [instance: d57f2553-feb4-49d8-a47b-dedbb4487f9e] Start destroying the instance on the hypervisor. {{(pid=75226) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 17 01:41:10 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:41:10 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:41:10 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:41:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c280142-8901-4f83-bde4-baaa097e05b0/disk.rescue --force-share --output=json" returned: 0 in 0.205s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:41:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c280142-8901-4f83-bde4-baaa097e05b0/disk.rescue --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:41:10 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:41:11 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c280142-8901-4f83-bde4-baaa097e05b0/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:41:11 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c280142-8901-4f83-bde4-baaa097e05b0/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:41:11 user nova-compute[75226]: DEBUG nova.compute.manager [req-af6b5636-a535-459d-9ad0-bcd9fd8a09dd req-e13b26a8-a204-41ca-a54a-3ca60af963de service nova] [instance: d57f2553-feb4-49d8-a47b-dedbb4487f9e] Received event network-vif-unplugged-c5f31505-49e5-4d1f-95c5-80847769e0b7 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:41:11 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-af6b5636-a535-459d-9ad0-bcd9fd8a09dd req-e13b26a8-a204-41ca-a54a-3ca60af963de service nova] Acquiring lock "d57f2553-feb4-49d8-a47b-dedbb4487f9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:41:11 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-af6b5636-a535-459d-9ad0-bcd9fd8a09dd req-e13b26a8-a204-41ca-a54a-3ca60af963de service nova] Lock "d57f2553-feb4-49d8-a47b-dedbb4487f9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:41:11 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-af6b5636-a535-459d-9ad0-bcd9fd8a09dd req-e13b26a8-a204-41ca-a54a-3ca60af963de service nova] Lock "d57f2553-feb4-49d8-a47b-dedbb4487f9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:41:11 user nova-compute[75226]: DEBUG nova.compute.manager [req-af6b5636-a535-459d-9ad0-bcd9fd8a09dd req-e13b26a8-a204-41ca-a54a-3ca60af963de service nova] [instance: d57f2553-feb4-49d8-a47b-dedbb4487f9e] No waiting events found dispatching network-vif-unplugged-c5f31505-49e5-4d1f-95c5-80847769e0b7 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:41:11 user nova-compute[75226]: DEBUG nova.compute.manager [req-af6b5636-a535-459d-9ad0-bcd9fd8a09dd req-e13b26a8-a204-41ca-a54a-3ca60af963de service nova] [instance: d57f2553-feb4-49d8-a47b-dedbb4487f9e] Received event network-vif-unplugged-c5f31505-49e5-4d1f-95c5-80847769e0b7 for instance with task_state deleting. {{(pid=75226) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 17 01:41:11 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c280142-8901-4f83-bde4-baaa097e05b0/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:41:11 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c280142-8901-4f83-bde4-baaa097e05b0/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:41:11 user nova-compute[75226]: INFO nova.virt.libvirt.driver [-] [instance: d57f2553-feb4-49d8-a47b-dedbb4487f9e] Instance destroyed successfully.
Nov 17 01:41:11 user nova-compute[75226]: DEBUG nova.objects.instance [None req-1b7d5232-15ce-49b2-84cc-d77fba0cd975 tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] Lazy-loading 'resources' on Instance uuid d57f2553-feb4-49d8-a47b-dedbb4487f9e {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:41:11 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-1b7d5232-15ce-49b2-84cc-d77fba0cd975 tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:39:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-315353669',display_name='tempest-VolumesActionsTest-instance-315353669',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-315353669',id=39,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-17T01:39:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='50f00bc826d34bbb8f2f93b550b7431a',ramdisk_id='',reservation_id='r-hv96tpy0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1397730864',owner_user_name='tempest-VolumesActionsTest-1397730864-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T01:39:27Z,user_data=None,user_id='2aa9906ec44847448446b6fb94339028',uuid=d57f2553-feb4-49d8-a47b-dedbb4487f9e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c5f31505-49e5-4d1f-95c5-80847769e0b7", "address": "fa:16:3e:04:d3:44", "network": {"id": "fe08b87c-6bf1-4842-a770-6522ba026ba4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1133747653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50f00bc826d34bbb8f2f93b550b7431a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5f31505-49", "ovs_interfaceid": "c5f31505-49e5-4d1f-95c5-80847769e0b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 17 01:41:11 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-1b7d5232-15ce-49b2-84cc-d77fba0cd975 tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] Converting VIF {"id": "c5f31505-49e5-4d1f-95c5-80847769e0b7", "address": "fa:16:3e:04:d3:44", "network": {"id": "fe08b87c-6bf1-4842-a770-6522ba026ba4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1133747653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50f00bc826d34bbb8f2f93b550b7431a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5f31505-49", "ovs_interfaceid": "c5f31505-49e5-4d1f-95c5-80847769e0b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:41:11 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-1b7d5232-15ce-49b2-84cc-d77fba0cd975 tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:d3:44,bridge_name='br-int',has_traffic_filtering=True,id=c5f31505-49e5-4d1f-95c5-80847769e0b7,network=Network(fe08b87c-6bf1-4842-a770-6522ba026ba4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5f31505-49') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:41:11 user nova-compute[75226]: DEBUG os_vif [None req-1b7d5232-15ce-49b2-84cc-d77fba0cd975 tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:d3:44,bridge_name='br-int',has_traffic_filtering=True,id=c5f31505-49e5-4d1f-95c5-80847769e0b7,network=Network(fe08b87c-6bf1-4842-a770-6522ba026ba4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5f31505-49') {{(pid=75226) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 17 01:41:11 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:41:11 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc5f31505-49, bridge=br-int, if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:41:11 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:41:11 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:41:11 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:41:11 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7881ecfc-6e51-4994-8db0-eabb605e83ea) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:41:11 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:41:11 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:41:11 user nova-compute[75226]: INFO os_vif [None req-1b7d5232-15ce-49b2-84cc-d77fba0cd975 tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:d3:44,bridge_name='br-int',has_traffic_filtering=True,id=c5f31505-49e5-4d1f-95c5-80847769e0b7,network=Network(fe08b87c-6bf1-4842-a770-6522ba026ba4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5f31505-49')
Nov 17 01:41:11 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-1b7d5232-15ce-49b2-84cc-d77fba0cd975 tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] [instance: d57f2553-feb4-49d8-a47b-dedbb4487f9e] Deleting instance files /opt/stack/data/nova/instances/d57f2553-feb4-49d8-a47b-dedbb4487f9e_del
Nov 17 01:41:11 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-1b7d5232-15ce-49b2-84cc-d77fba0cd975 tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] [instance: d57f2553-feb4-49d8-a47b-dedbb4487f9e] Deletion of /opt/stack/data/nova/instances/d57f2553-feb4-49d8-a47b-dedbb4487f9e_del complete
Nov 17 01:41:11 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c280142-8901-4f83-bde4-baaa097e05b0/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:41:11 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6555d72-6094-4ea9-b071-a3d3c8a300a9/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:41:11 user nova-compute[75226]: INFO nova.compute.manager [None req-1b7d5232-15ce-49b2-84cc-d77fba0cd975 tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] [instance: d57f2553-feb4-49d8-a47b-dedbb4487f9e] Took 0.74 seconds to destroy the instance on the hypervisor.
Nov 17 01:41:11 user nova-compute[75226]: DEBUG oslo.service.loopingcall [None req-1b7d5232-15ce-49b2-84cc-d77fba0cd975 tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75226) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 17 01:41:11 user nova-compute[75226]: DEBUG nova.compute.manager [-] [instance: d57f2553-feb4-49d8-a47b-dedbb4487f9e] Deallocating network for instance {{(pid=75226) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 17 01:41:11 user nova-compute[75226]: DEBUG nova.network.neutron [-] [instance: d57f2553-feb4-49d8-a47b-dedbb4487f9e] deallocate_for_instance() {{(pid=75226) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 17 01:41:11 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6555d72-6094-4ea9-b071-a3d3c8a300a9/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:41:11 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6555d72-6094-4ea9-b071-a3d3c8a300a9/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:41:11 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6555d72-6094-4ea9-b071-a3d3c8a300a9/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:41:11 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0597c05a-1049-4117-a8ae-8177d590e024/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:41:11 user nova-compute[75226]: DEBUG nova.network.neutron [-] [instance: d57f2553-feb4-49d8-a47b-dedbb4487f9e] Updating instance_info_cache with network_info: [] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:41:11 user nova-compute[75226]: DEBUG nova.compute.manager [req-f33c0df3-35a3-4315-af85-eb6b1ef12743 req-3ce9b9ae-48f6-4208-ad5f-5f0e8dec85b5 service nova] [instance: d57f2553-feb4-49d8-a47b-dedbb4487f9e] Received event network-vif-deleted-c5f31505-49e5-4d1f-95c5-80847769e0b7 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:41:11 user nova-compute[75226]: INFO nova.compute.manager [req-f33c0df3-35a3-4315-af85-eb6b1ef12743 req-3ce9b9ae-48f6-4208-ad5f-5f0e8dec85b5 service nova] [instance: d57f2553-feb4-49d8-a47b-dedbb4487f9e] Neutron deleted interface c5f31505-49e5-4d1f-95c5-80847769e0b7; detaching it from the instance and deleting it from the info cache
Nov 17 01:41:11 user nova-compute[75226]: DEBUG nova.network.neutron [req-f33c0df3-35a3-4315-af85-eb6b1ef12743 req-3ce9b9ae-48f6-4208-ad5f-5f0e8dec85b5 service nova] [instance: d57f2553-feb4-49d8-a47b-dedbb4487f9e] Updating instance_info_cache with network_info: [] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:41:11 user nova-compute[75226]: INFO nova.compute.manager [-] [instance: d57f2553-feb4-49d8-a47b-dedbb4487f9e] Took 0.50 seconds to deallocate network for instance.
Nov 17 01:41:11 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0597c05a-1049-4117-a8ae-8177d590e024/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:41:11 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0597c05a-1049-4117-a8ae-8177d590e024/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:41:12 user nova-compute[75226]: DEBUG nova.compute.manager [req-f33c0df3-35a3-4315-af85-eb6b1ef12743 req-3ce9b9ae-48f6-4208-ad5f-5f0e8dec85b5 service nova] [instance: d57f2553-feb4-49d8-a47b-dedbb4487f9e] Detach interface failed, port_id=c5f31505-49e5-4d1f-95c5-80847769e0b7, reason: Instance d57f2553-feb4-49d8-a47b-dedbb4487f9e could not be found. {{(pid=75226) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 17 01:41:12 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-1b7d5232-15ce-49b2-84cc-d77fba0cd975 tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:41:12 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-1b7d5232-15ce-49b2-84cc-d77fba0cd975 tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:41:12 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0597c05a-1049-4117-a8ae-8177d590e024/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:41:12 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:41:12 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:41:12 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Hypervisor/Node resource view: name=user free_ram=8112MB free_disk=24.785625457763672GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75226) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 17 01:41:12 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:41:12 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-caeb5211-462e-455a-9787-970ab5702299 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] Acquiring lock "d6d21784-2ebe-4a39-9ceb-f6607f02e3c4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:41:12 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-caeb5211-462e-455a-9787-970ab5702299 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] Lock "d6d21784-2ebe-4a39-9ceb-f6607f02e3c4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:41:12 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-caeb5211-462e-455a-9787-970ab5702299 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] Acquiring lock "d6d21784-2ebe-4a39-9ceb-f6607f02e3c4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:41:12 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-caeb5211-462e-455a-9787-970ab5702299 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] Lock "d6d21784-2ebe-4a39-9ceb-f6607f02e3c4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:41:12 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-caeb5211-462e-455a-9787-970ab5702299 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] Lock "d6d21784-2ebe-4a39-9ceb-f6607f02e3c4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:41:12 user nova-compute[75226]: INFO nova.compute.manager [None req-caeb5211-462e-455a-9787-970ab5702299 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] [instance: d6d21784-2ebe-4a39-9ceb-f6607f02e3c4] Terminating instance
Nov 17 01:41:12 user nova-compute[75226]: DEBUG nova.compute.manager [None req-caeb5211-462e-455a-9787-970ab5702299 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] [instance: d6d21784-2ebe-4a39-9ceb-f6607f02e3c4] Start destroying the instance on the hypervisor. {{(pid=75226) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 17 01:41:12 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-1b7d5232-15ce-49b2-84cc-d77fba0cd975 tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:41:12 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-1b7d5232-15ce-49b2-84cc-d77fba0cd975 tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:41:12 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-1b7d5232-15ce-49b2-84cc-d77fba0cd975 tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.598s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:41:12 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:41:12 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.143s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:41:12 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:41:12 user nova-compute[75226]: INFO nova.scheduler.client.report [None req-1b7d5232-15ce-49b2-84cc-d77fba0cd975 tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] Deleted allocations for instance d57f2553-feb4-49d8-a47b-dedbb4487f9e
Nov 17 01:41:12 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:41:12 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:41:12 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-1b7d5232-15ce-49b2-84cc-d77fba0cd975 tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] Lock "d57f2553-feb4-49d8-a47b-dedbb4487f9e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.094s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:41:12 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance d6555d72-6094-4ea9-b071-a3d3c8a300a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:41:12 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 5c280142-8901-4f83-bde4-baaa097e05b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:41:12 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 8c4a9724-533e-40c8-ab2a-ce3415af240a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:41:12 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance d6d21784-2ebe-4a39-9ceb-f6607f02e3c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:41:12 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 0597c05a-1049-4117-a8ae-8177d590e024 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:41:12 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 6f3b54ce-4dc1-445a-9108-3f628713e6ec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:41:12 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75226) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 17 01:41:12 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75226) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 17 01:41:12 user nova-compute[75226]: DEBUG nova.compute.manager [req-5db84985-1a7e-4124-8152-61691e42b5db req-bb9a0b3e-fd06-4b97-88a4-2f51f9f8a0ce service nova] [instance: d6d21784-2ebe-4a39-9ceb-f6607f02e3c4] Received event network-vif-unplugged-2a4dd370-0638-425d-ba53-19c724a14644 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:41:12 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-5db84985-1a7e-4124-8152-61691e42b5db req-bb9a0b3e-fd06-4b97-88a4-2f51f9f8a0ce service nova] Acquiring lock "d6d21784-2ebe-4a39-9ceb-f6607f02e3c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:41:12 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-5db84985-1a7e-4124-8152-61691e42b5db req-bb9a0b3e-fd06-4b97-88a4-2f51f9f8a0ce service nova] Lock "d6d21784-2ebe-4a39-9ceb-f6607f02e3c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:41:12 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-5db84985-1a7e-4124-8152-61691e42b5db req-bb9a0b3e-fd06-4b97-88a4-2f51f9f8a0ce service nova] Lock "d6d21784-2ebe-4a39-9ceb-f6607f02e3c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:41:12 user nova-compute[75226]: DEBUG nova.compute.manager [req-5db84985-1a7e-4124-8152-61691e42b5db req-bb9a0b3e-fd06-4b97-88a4-2f51f9f8a0ce service nova] [instance: d6d21784-2ebe-4a39-9ceb-f6607f02e3c4] No waiting events found dispatching network-vif-unplugged-2a4dd370-0638-425d-ba53-19c724a14644 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:41:12 user nova-compute[75226]: DEBUG nova.compute.manager [req-5db84985-1a7e-4124-8152-61691e42b5db req-bb9a0b3e-fd06-4b97-88a4-2f51f9f8a0ce service nova] [instance: d6d21784-2ebe-4a39-9ceb-f6607f02e3c4] Received event network-vif-unplugged-2a4dd370-0638-425d-ba53-19c724a14644 for instance with task_state deleting. {{(pid=75226) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 17 01:41:12 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:41:12 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:41:13 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Compute_service record updated for user:user {{(pid=75226) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 17 01:41:13 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.376s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:41:13 user nova-compute[75226]: DEBUG nova.compute.manager [req-1fffe6f1-5190-4a8a-86bc-4555045034e5 req-552ab380-44a4-46c0-8181-917114dc089d service nova] [instance: d57f2553-feb4-49d8-a47b-dedbb4487f9e] Received event network-vif-plugged-c5f31505-49e5-4d1f-95c5-80847769e0b7 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:41:13 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-1fffe6f1-5190-4a8a-86bc-4555045034e5 req-552ab380-44a4-46c0-8181-917114dc089d service nova] Acquiring lock "d57f2553-feb4-49d8-a47b-dedbb4487f9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:41:13 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-1fffe6f1-5190-4a8a-86bc-4555045034e5 req-552ab380-44a4-46c0-8181-917114dc089d service nova] Lock "d57f2553-feb4-49d8-a47b-dedbb4487f9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:41:13 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-1fffe6f1-5190-4a8a-86bc-4555045034e5 req-552ab380-44a4-46c0-8181-917114dc089d service nova] Lock "d57f2553-feb4-49d8-a47b-dedbb4487f9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:41:13 user nova-compute[75226]: DEBUG nova.compute.manager [req-1fffe6f1-5190-4a8a-86bc-4555045034e5 req-552ab380-44a4-46c0-8181-917114dc089d service nova] [instance: d57f2553-feb4-49d8-a47b-dedbb4487f9e] No waiting events found dispatching network-vif-plugged-c5f31505-49e5-4d1f-95c5-80847769e0b7 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:41:13 user nova-compute[75226]: WARNING nova.compute.manager [req-1fffe6f1-5190-4a8a-86bc-4555045034e5 req-552ab380-44a4-46c0-8181-917114dc089d service nova] [instance: d57f2553-feb4-49d8-a47b-dedbb4487f9e] Received unexpected event network-vif-plugged-c5f31505-49e5-4d1f-95c5-80847769e0b7 for instance with vm_state deleted and task_state None.
Nov 17 01:41:13 user nova-compute[75226]: INFO nova.virt.libvirt.driver [-] [instance: d6d21784-2ebe-4a39-9ceb-f6607f02e3c4] Instance destroyed successfully.
Nov 17 01:41:13 user nova-compute[75226]: DEBUG nova.objects.instance [None req-caeb5211-462e-455a-9787-970ab5702299 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] Lazy-loading 'resources' on Instance uuid d6d21784-2ebe-4a39-9ceb-f6607f02e3c4 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:41:13 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-caeb5211-462e-455a-9787-970ab5702299 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:37:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-135638902',display_name='tempest-TestServerVolumeAttachmentScenario-server-135638902',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-135638902',id=37,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKQ1mLoAH8kDpQunuaByJ163vN2/Z2P9qpqcGqugijJ2MCSFeSDRi4EN+EXQlXba/VswtI0JQpDXQ0KhoK2IzpfPBPKmsCGMko5EpbYjZ8j46licGNscA6I+MQz5ogFI6Q==',key_name='tempest-keypair-1187688175',keypairs=<?>,launch_index=0,launched_at=2023-11-17T01:37:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c14e1b64486542989695083243768720',ramdisk_id='',reservation_id='r-pxmqwjqj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1206704109',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1206704109-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T01:37:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f5fd46cfdc1b4c4cb5b4c4f2e13ba6e6',uuid=d6d21784-2ebe-4a39-9ceb-f6607f02e3c4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2a4dd370-0638-425d-ba53-19c724a14644", "address": "fa:16:3e:f6:f1:ac", "network": {"id": "e3bdabce-76e0-4de2-9b44-dbe96b162892", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1190388267-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c14e1b64486542989695083243768720", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a4dd370-06", "ovs_interfaceid": "2a4dd370-0638-425d-ba53-19c724a14644", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 17 01:41:13 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-caeb5211-462e-455a-9787-970ab5702299 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] Converting VIF {"id": "2a4dd370-0638-425d-ba53-19c724a14644", "address": "fa:16:3e:f6:f1:ac", "network": {"id": "e3bdabce-76e0-4de2-9b44-dbe96b162892", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1190388267-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c14e1b64486542989695083243768720", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a4dd370-06", "ovs_interfaceid": "2a4dd370-0638-425d-ba53-19c724a14644", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:41:13 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-caeb5211-462e-455a-9787-970ab5702299 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f6:f1:ac,bridge_name='br-int',has_traffic_filtering=True,id=2a4dd370-0638-425d-ba53-19c724a14644,network=Network(e3bdabce-76e0-4de2-9b44-dbe96b162892),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a4dd370-06') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:41:13 user nova-compute[75226]: DEBUG os_vif [None req-caeb5211-462e-455a-9787-970ab5702299 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f6:f1:ac,bridge_name='br-int',has_traffic_filtering=True,id=2a4dd370-0638-425d-ba53-19c724a14644,network=Network(e3bdabce-76e0-4de2-9b44-dbe96b162892),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a4dd370-06') {{(pid=75226) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 17 01:41:13 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:41:13 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:41:13 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2a4dd370-06, bridge=br-int, if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:41:13 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:41:13 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:41:13 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e9283263-fd28-4896-b6f1-87fffb047bd5) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:41:13 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:41:13 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:41:13 user nova-compute[75226]: INFO os_vif [None req-caeb5211-462e-455a-9787-970ab5702299 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f6:f1:ac,bridge_name='br-int',has_traffic_filtering=True,id=2a4dd370-0638-425d-ba53-19c724a14644,network=Network(e3bdabce-76e0-4de2-9b44-dbe96b162892),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a4dd370-06')
Nov 17 01:41:13 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-caeb5211-462e-455a-9787-970ab5702299 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] [instance: d6d21784-2ebe-4a39-9ceb-f6607f02e3c4] Deleting instance files /opt/stack/data/nova/instances/d6d21784-2ebe-4a39-9ceb-f6607f02e3c4_del
Nov 17 01:41:13 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-caeb5211-462e-455a-9787-970ab5702299 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] [instance: d6d21784-2ebe-4a39-9ceb-f6607f02e3c4] Deletion of /opt/stack/data/nova/instances/d6d21784-2ebe-4a39-9ceb-f6607f02e3c4_del complete
Nov 17 01:41:13 user nova-compute[75226]: INFO nova.compute.manager [None req-caeb5211-462e-455a-9787-970ab5702299 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] [instance: d6d21784-2ebe-4a39-9ceb-f6607f02e3c4] Took 0.84 seconds to destroy the instance on the hypervisor.
Nov 17 01:41:13 user nova-compute[75226]: DEBUG oslo.service.loopingcall [None req-caeb5211-462e-455a-9787-970ab5702299 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75226) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 17 01:41:13 user nova-compute[75226]: DEBUG nova.compute.manager [-] [instance: d6d21784-2ebe-4a39-9ceb-f6607f02e3c4] Deallocating network for instance {{(pid=75226) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 17 01:41:13 user nova-compute[75226]: DEBUG nova.network.neutron [-] [instance: d6d21784-2ebe-4a39-9ceb-f6607f02e3c4] deallocate_for_instance() {{(pid=75226) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 17 01:41:14 user nova-compute[75226]: DEBUG nova.network.neutron [-] [instance: d6d21784-2ebe-4a39-9ceb-f6607f02e3c4] Updating instance_info_cache with network_info: [] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:41:14 user nova-compute[75226]: INFO nova.compute.manager [-] [instance: d6d21784-2ebe-4a39-9ceb-f6607f02e3c4] Took 0.72 seconds to deallocate network for instance.
Nov 17 01:41:14 user nova-compute[75226]: DEBUG nova.compute.manager [req-f1ced325-1c8d-487b-aa46-d39b8f2e4afc req-4f03b850-5d2e-417f-ac23-ea73e57425a2 service nova] [instance: d6d21784-2ebe-4a39-9ceb-f6607f02e3c4] Received event network-vif-deleted-2a4dd370-0638-425d-ba53-19c724a14644 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:41:14 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-caeb5211-462e-455a-9787-970ab5702299 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:41:14 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-caeb5211-462e-455a-9787-970ab5702299 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:41:14 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-caeb5211-462e-455a-9787-970ab5702299 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:41:14 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-caeb5211-462e-455a-9787-970ab5702299 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:41:14 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-caeb5211-462e-455a-9787-970ab5702299 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.230s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:41:14 user nova-compute[75226]: INFO nova.scheduler.client.report [None req-caeb5211-462e-455a-9787-970ab5702299 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] Deleted allocations for instance d6d21784-2ebe-4a39-9ceb-f6607f02e3c4
Nov 17 01:41:14 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-caeb5211-462e-455a-9787-970ab5702299 tempest-TestServerVolumeAttachmentScenario-1206704109 tempest-TestServerVolumeAttachmentScenario-1206704109-project-member] Lock "d6d21784-2ebe-4a39-9ceb-f6607f02e3c4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.186s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:41:14 user nova-compute[75226]: DEBUG nova.compute.manager [req-7ee38824-1c33-4deb-beb5-13de6094b989 req-1e7ad8bf-0c85-4ccc-884b-80ab6bcf9e50 service nova] [instance: d6d21784-2ebe-4a39-9ceb-f6607f02e3c4] Received event network-vif-plugged-2a4dd370-0638-425d-ba53-19c724a14644 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:41:14 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-7ee38824-1c33-4deb-beb5-13de6094b989 req-1e7ad8bf-0c85-4ccc-884b-80ab6bcf9e50 service nova] Acquiring lock "d6d21784-2ebe-4a39-9ceb-f6607f02e3c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:41:14 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-7ee38824-1c33-4deb-beb5-13de6094b989 req-1e7ad8bf-0c85-4ccc-884b-80ab6bcf9e50 service nova] Lock "d6d21784-2ebe-4a39-9ceb-f6607f02e3c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:41:14 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-7ee38824-1c33-4deb-beb5-13de6094b989 req-1e7ad8bf-0c85-4ccc-884b-80ab6bcf9e50 service nova] Lock "d6d21784-2ebe-4a39-9ceb-f6607f02e3c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:41:14 user nova-compute[75226]: DEBUG nova.compute.manager [req-7ee38824-1c33-4deb-beb5-13de6094b989 req-1e7ad8bf-0c85-4ccc-884b-80ab6bcf9e50 service nova] [instance: d6d21784-2ebe-4a39-9ceb-f6607f02e3c4] No waiting events found dispatching network-vif-plugged-2a4dd370-0638-425d-ba53-19c724a14644 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:41:14 user nova-compute[75226]: WARNING nova.compute.manager [req-7ee38824-1c33-4deb-beb5-13de6094b989 req-1e7ad8bf-0c85-4ccc-884b-80ab6bcf9e50 service nova] [instance: d6d21784-2ebe-4a39-9ceb-f6607f02e3c4] Received unexpected event network-vif-plugged-2a4dd370-0638-425d-ba53-19c724a14644 for instance with vm_state deleted and task_state None.
Nov 17 01:41:16 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:41:16 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:41:16 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:41:18 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:41:18 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:41:20 user nova-compute[75226]: DEBUG nova.compute.manager [req-b1b29f68-fc87-406b-8aba-7bff0e4b747f req-cc9765ff-7957-4ecc-a10c-ef80e2daeaef service nova] [instance: 8c4a9724-533e-40c8-ab2a-ce3415af240a] Received event network-changed-e30eaa7a-30df-48f5-b8de-30da75d74972 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:41:20 user nova-compute[75226]: DEBUG nova.compute.manager [req-b1b29f68-fc87-406b-8aba-7bff0e4b747f req-cc9765ff-7957-4ecc-a10c-ef80e2daeaef service nova] [instance: 8c4a9724-533e-40c8-ab2a-ce3415af240a] Refreshing instance network info cache due to event network-changed-e30eaa7a-30df-48f5-b8de-30da75d74972. {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 01:41:20 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-b1b29f68-fc87-406b-8aba-7bff0e4b747f req-cc9765ff-7957-4ecc-a10c-ef80e2daeaef service nova] Acquiring lock "refresh_cache-8c4a9724-533e-40c8-ab2a-ce3415af240a" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:41:20 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-b1b29f68-fc87-406b-8aba-7bff0e4b747f req-cc9765ff-7957-4ecc-a10c-ef80e2daeaef service nova] Acquired lock "refresh_cache-8c4a9724-533e-40c8-ab2a-ce3415af240a" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:41:20 user nova-compute[75226]: DEBUG nova.network.neutron [req-b1b29f68-fc87-406b-8aba-7bff0e4b747f req-cc9765ff-7957-4ecc-a10c-ef80e2daeaef service nova] [instance: 8c4a9724-533e-40c8-ab2a-ce3415af240a] Refreshing network info cache for port e30eaa7a-30df-48f5-b8de-30da75d74972 {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 01:41:20 user nova-compute[75226]: DEBUG nova.network.neutron [req-b1b29f68-fc87-406b-8aba-7bff0e4b747f req-cc9765ff-7957-4ecc-a10c-ef80e2daeaef service nova] [instance: 8c4a9724-533e-40c8-ab2a-ce3415af240a] Updated VIF entry in instance network info cache for port e30eaa7a-30df-48f5-b8de-30da75d74972. {{(pid=75226) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 01:41:20 user nova-compute[75226]: DEBUG nova.network.neutron [req-b1b29f68-fc87-406b-8aba-7bff0e4b747f req-cc9765ff-7957-4ecc-a10c-ef80e2daeaef service nova] [instance: 8c4a9724-533e-40c8-ab2a-ce3415af240a] Updating instance_info_cache with network_info: [{"id": "e30eaa7a-30df-48f5-b8de-30da75d74972", "address": "fa:16:3e:f6:83:b8", "network": {"id": "44f50686-24e7-4e75-8269-4391a53286d0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1611114801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33699aa6c9db4815a1e79aff4685801e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape30eaa7a-30", "ovs_interfaceid": "e30eaa7a-30df-48f5-b8de-30da75d74972", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:41:20 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:41:20 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Starting heal instance info cache {{(pid=75226) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 17 01:41:20 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-b1b29f68-fc87-406b-8aba-7bff0e4b747f req-cc9765ff-7957-4ecc-a10c-ef80e2daeaef service nova] Releasing lock "refresh_cache-8c4a9724-533e-40c8-ab2a-ce3415af240a" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:41:21 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "refresh_cache-8c4a9724-533e-40c8-ab2a-ce3415af240a" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:41:21 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquired lock "refresh_cache-8c4a9724-533e-40c8-ab2a-ce3415af240a" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:41:21 user nova-compute[75226]: DEBUG nova.network.neutron [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] [instance: 8c4a9724-533e-40c8-ab2a-ce3415af240a] Forcefully refreshing network info cache for instance {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 17 01:41:21 user nova-compute[75226]: DEBUG nova.compute.manager [req-e7386d46-51c4-4b3c-898b-e3de88eb7419 req-a0a9d987-163a-472b-b551-d34cd1bcb691 service nova] [instance: 8c4a9724-533e-40c8-ab2a-ce3415af240a] Received event network-changed-e30eaa7a-30df-48f5-b8de-30da75d74972 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:41:21 user nova-compute[75226]: DEBUG nova.compute.manager [req-e7386d46-51c4-4b3c-898b-e3de88eb7419 req-a0a9d987-163a-472b-b551-d34cd1bcb691 service nova] [instance: 8c4a9724-533e-40c8-ab2a-ce3415af240a] Refreshing instance network info cache due to event network-changed-e30eaa7a-30df-48f5-b8de-30da75d74972. {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 01:41:21 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-e7386d46-51c4-4b3c-898b-e3de88eb7419 req-a0a9d987-163a-472b-b551-d34cd1bcb691 service nova] Acquiring lock "refresh_cache-8c4a9724-533e-40c8-ab2a-ce3415af240a" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:41:21 user nova-compute[75226]: DEBUG nova.network.neutron [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] [instance: 8c4a9724-533e-40c8-ab2a-ce3415af240a] Updating instance_info_cache with network_info: [{"id": "e30eaa7a-30df-48f5-b8de-30da75d74972", "address": "fa:16:3e:f6:83:b8", "network": {"id": "44f50686-24e7-4e75-8269-4391a53286d0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1611114801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33699aa6c9db4815a1e79aff4685801e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape30eaa7a-30", "ovs_interfaceid": "e30eaa7a-30df-48f5-b8de-30da75d74972", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:41:21 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Releasing lock "refresh_cache-8c4a9724-533e-40c8-ab2a-ce3415af240a" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:41:21 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] [instance: 8c4a9724-533e-40c8-ab2a-ce3415af240a] Updated the network info_cache for instance {{(pid=75226) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 17 01:41:21 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-e7386d46-51c4-4b3c-898b-e3de88eb7419 req-a0a9d987-163a-472b-b551-d34cd1bcb691 service nova] Acquired lock "refresh_cache-8c4a9724-533e-40c8-ab2a-ce3415af240a" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:41:21 user nova-compute[75226]: DEBUG nova.network.neutron [req-e7386d46-51c4-4b3c-898b-e3de88eb7419 req-a0a9d987-163a-472b-b551-d34cd1bcb691 service nova] [instance: 8c4a9724-533e-40c8-ab2a-ce3415af240a] Refreshing network info cache for port e30eaa7a-30df-48f5-b8de-30da75d74972 {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 01:41:21 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:41:21 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-041a901b-d4db-4bb9-9861-722e587cc92c tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Acquiring lock "8c4a9724-533e-40c8-ab2a-ce3415af240a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:41:21 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-041a901b-d4db-4bb9-9861-722e587cc92c tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Lock "8c4a9724-533e-40c8-ab2a-ce3415af240a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:41:21 user nova-compute[75226]: INFO nova.compute.manager [None req-041a901b-d4db-4bb9-9861-722e587cc92c tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] [instance: 8c4a9724-533e-40c8-ab2a-ce3415af240a] Detaching volume 42287bb8-179a-4f5d-adc3-ab6e03ef12dd
Nov 17 01:41:21 user nova-compute[75226]: INFO nova.virt.block_device [None req-041a901b-d4db-4bb9-9861-722e587cc92c tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] [instance: 8c4a9724-533e-40c8-ab2a-ce3415af240a] Attempting to driver detach volume 42287bb8-179a-4f5d-adc3-ab6e03ef12dd from mountpoint /dev/vdb
Nov 17 01:41:21 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-041a901b-d4db-4bb9-9861-722e587cc92c tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Attempting to detach device vdb from instance 8c4a9724-533e-40c8-ab2a-ce3415af240a from the persistent domain config. {{(pid=75226) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 17 01:41:21 user nova-compute[75226]: DEBUG nova.virt.libvirt.guest [None req-041a901b-d4db-4bb9-9861-722e587cc92c tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] detach device xml: <disk type="block" device="disk">
Nov 17 01:41:21 user nova-compute[75226]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 01:41:21 user nova-compute[75226]:   <source dev="/dev/sdc"/>
Nov 17 01:41:21 user nova-compute[75226]:   <target dev="vdb" bus="virtio"/>
Nov 17 01:41:21 user nova-compute[75226]:   <serial>42287bb8-179a-4f5d-adc3-ab6e03ef12dd</serial>
Nov 17 01:41:21 user nova-compute[75226]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 17 01:41:21 user nova-compute[75226]: </disk>
Nov 17 01:41:21 user nova-compute[75226]:  {{(pid=75226) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 17 01:41:21 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-041a901b-d4db-4bb9-9861-722e587cc92c tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Successfully detached device vdb from instance 8c4a9724-533e-40c8-ab2a-ce3415af240a from the persistent domain config.
Nov 17 01:41:21 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-041a901b-d4db-4bb9-9861-722e587cc92c tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8c4a9724-533e-40c8-ab2a-ce3415af240a from the live domain config. {{(pid=75226) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 17 01:41:21 user nova-compute[75226]: DEBUG nova.virt.libvirt.guest [None req-041a901b-d4db-4bb9-9861-722e587cc92c tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] detach device xml: <disk type="block" device="disk">
Nov 17 01:41:21 user nova-compute[75226]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 01:41:21 user nova-compute[75226]:   <source dev="/dev/sdc"/>
Nov 17 01:41:21 user nova-compute[75226]:   <target dev="vdb" bus="virtio"/>
Nov 17 01:41:21 user nova-compute[75226]:   <serial>42287bb8-179a-4f5d-adc3-ab6e03ef12dd</serial>
Nov 17 01:41:21 user nova-compute[75226]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 17 01:41:21 user nova-compute[75226]: </disk>
Nov 17 01:41:21 user nova-compute[75226]:  {{(pid=75226) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 17 01:41:21 user nova-compute[75226]: DEBUG nova.network.neutron [req-e7386d46-51c4-4b3c-898b-e3de88eb7419 req-a0a9d987-163a-472b-b551-d34cd1bcb691 service nova] [instance: 8c4a9724-533e-40c8-ab2a-ce3415af240a] Updated VIF entry in instance network info cache for port e30eaa7a-30df-48f5-b8de-30da75d74972. {{(pid=75226) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 01:41:21 user nova-compute[75226]: DEBUG nova.network.neutron [req-e7386d46-51c4-4b3c-898b-e3de88eb7419 req-a0a9d987-163a-472b-b551-d34cd1bcb691 service nova] [instance: 8c4a9724-533e-40c8-ab2a-ce3415af240a] Updating instance_info_cache with network_info: [{"id": "e30eaa7a-30df-48f5-b8de-30da75d74972", "address": "fa:16:3e:f6:83:b8", "network": {"id": "44f50686-24e7-4e75-8269-4391a53286d0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1611114801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33699aa6c9db4815a1e79aff4685801e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape30eaa7a-30", "ovs_interfaceid": "e30eaa7a-30df-48f5-b8de-30da75d74972", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:41:21 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-e7386d46-51c4-4b3c-898b-e3de88eb7419 req-a0a9d987-163a-472b-b551-d34cd1bcb691 service nova] Releasing lock "refresh_cache-8c4a9724-533e-40c8-ab2a-ce3415af240a" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:41:21 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:41:21 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:41:22 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-041a901b-d4db-4bb9-9861-722e587cc92c tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8c4a9724-533e-40c8-ab2a-ce3415af240a {{(pid=75226) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 17 01:41:23 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:41:23 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:41:25 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:41:25 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75226) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 17 01:41:28 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:41:28 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:41:28 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75226) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 17 01:41:28 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75226) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 01:41:28 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75226) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 01:41:28 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:41:33 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:41:34 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:41:38 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:41:38 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:41:42 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-041a901b-d4db-4bb9-9861-722e587cc92c tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 8c4a9724-533e-40c8-ab2a-ce3415af240a is timed out.
Nov 17 01:41:42 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-041a901b-d4db-4bb9-9861-722e587cc92c tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Successfully detached device vdb from instance 8c4a9724-533e-40c8-ab2a-ce3415af240a from the live domain config.
Nov 17 01:41:42 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-041a901b-d4db-4bb9-9861-722e587cc92c tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] [instance: 8c4a9724-533e-40c8-ab2a-ce3415af240a] calling os-brick to detach iSCSI Volume {{(pid=75226) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 17 01:41:42 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-041a901b-d4db-4bb9-9861-722e587cc92c tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc4cc36b490>, {'target_iqn': 'iqn.2010-10.org.openstack:42287bb8-179a-4f5d-adc3-ab6e03ef12dd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ihpBPKdw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:41:42 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-041a901b-d4db-4bb9-9861-722e587cc92c tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:41:42 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-041a901b-d4db-4bb9-9861-722e587cc92c tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:41:42 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-041a901b-d4db-4bb9-9861-722e587cc92c tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:41:42 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:41:42 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:41:42 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[12621154-0b1e-4b0c-84e8-a5b47c5abbae]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:42287bb8-179a-4f5d-adc3-ab6e03ef12dd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:41:42 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-041a901b-d4db-4bb9-9861-722e587cc92c tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 17 01:41:42 user nova-compute[75226]: No targets found.
Nov 17 01:41:42 user nova-compute[75226]: iSNS:
Nov 17 01:41:42 user nova-compute[75226]: No targets found.
Nov 17 01:41:42 user nova-compute[75226]: STATIC:
Nov 17 01:41:42 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:42287bb8-179a-4f5d-adc3-ab6e03ef12dd
Nov 17 01:41:42 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:41:42 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:41:42 user nova-compute[75226]: FIRMWARE:
Nov 17 01:41:42 user nova-compute[75226]: No targets found.
Nov 17 01:41:42 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:41:42 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-041a901b-d4db-4bb9-9861-722e587cc92c tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 17 01:41:42 user nova-compute[75226]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 17 01:41:42 user nova-compute[75226]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75226) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 17 01:41:42 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-041a901b-d4db-4bb9-9861-722e587cc92c tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:42287bb8-179a-4f5d-adc3-ab6e03ef12dd', 0)] {{(pid=75226) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 17 01:41:42 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:41:42 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:41:42 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[511b740c-5d96-4c2d-ab7a-e9b33cfea710]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:42287bb8-179a-4f5d-adc3-ab6e03ef12dd\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:41:42 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:41:42 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:41:42 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe1b6214-1251-482a-9be9-df4c083b269b]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42287bb8-179a-4f5d-adc3-ab6e03ef12dd (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:41:42 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-041a901b-d4db-4bb9-9861-722e587cc92c tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42287bb8-179a-4f5d-adc3-ab6e03ef12dd (non-flash)
Nov 17 01:41:42 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:41:42 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-041a901b-d4db-4bb9-9861-722e587cc92c tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42287bb8-179a-4f5d-adc3-ab6e03ef12dd (non-flash)
Nov 17 01:41:42 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:41:42 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-041a901b-d4db-4bb9-9861-722e587cc92c tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc4b41db400>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:42287bb8-179a-4f5d-adc3-ab6e03ef12dd'): ({'sdc'}, set())}) {{(pid=75226) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 17 01:41:42 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-041a901b-d4db-4bb9-9861-722e587cc92c tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Removing single pathed devices sdc {{(pid=75226) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 17 01:41:42 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:41:42 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:41:42 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[041f838e-4293-4bf0-ba7d-2a95e669ca3b]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:41:42 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:41:42 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:41:42 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f85ef1a-6dc9-4920-ab42-4631086b0d0d]: (4, ('ok\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:41:42 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-041a901b-d4db-4bb9-9861-722e587cc92c tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Flushing IO for device /dev/sdc {{(pid=75226) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 17 01:41:42 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:41:42 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:41:42 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[41fcdac3-37ef-4d9e-9f41-f5e57a773f06]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:41:42 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-041a901b-d4db-4bb9-9861-722e587cc92c tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75226) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 17 01:41:42 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:41:42 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.035s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:41:42 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[184a2361-798d-4936-9caa-6c8d44e2e1f3]: (4, ('1', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:41:42 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-041a901b-d4db-4bb9-9861-722e587cc92c tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75226) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 17 01:41:42 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-041a901b-d4db-4bb9-9861-722e587cc92c tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] SCSI volumes sdc have been removed. {{(pid=75226) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 17 01:41:42 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-041a901b-d4db-4bb9-9861-722e587cc92c tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:42287bb8-179a-4f5d-adc3-ab6e03ef12dd')] {{(pid=75226) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 17 01:41:42 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42287bb8-179a-4f5d-adc3-ab6e03ef12dd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:41:42 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42287bb8-179a-4f5d-adc3-ab6e03ef12dd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:41:42 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bc98500-f42c-483a-8a4e-07c20c00b87e]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:41:42 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-041a901b-d4db-4bb9-9861-722e587cc92c tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:41:42 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42287bb8-179a-4f5d-adc3-ab6e03ef12dd -p 172.16.0.220:3260 --logout {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:41:42 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42287bb8-179a-4f5d-adc3-ab6e03ef12dd -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:41:42 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba0b8e05-9bbb-44b1-8278-6e31866b4f8c]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:42287bb8-179a-4f5d-adc3-ab6e03ef12dd, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:42287bb8-179a-4f5d-adc3-ab6e03ef12dd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:41:42 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-041a901b-d4db-4bb9-9861-722e587cc92c tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:42287bb8-179a-4f5d-adc3-ab6e03ef12dd, portal: 172.16.0.220,3260]
Nov 17 01:41:42 user nova-compute[75226]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:42287bb8-179a-4f5d-adc3-ab6e03ef12dd, portal: 172.16.0.220,3260] successful.
Nov 17 01:41:42 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:41:42 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42287bb8-179a-4f5d-adc3-ab6e03ef12dd -p 172.16.0.220:3260 --op delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:41:42 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42287bb8-179a-4f5d-adc3-ab6e03ef12dd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:41:42 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[f73bf8fb-741e-4074-84e4-0d1b48151f91]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:41:42 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-041a901b-d4db-4bb9-9861-722e587cc92c tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:41:42 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-041a901b-d4db-4bb9-9861-722e587cc92c tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.263s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:41:42 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-041a901b-d4db-4bb9-9861-722e587cc92c tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] <== disconnect_volume: return (265ms) None {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:41:42 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-041a901b-d4db-4bb9-9861-722e587cc92c tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] [instance: 8c4a9724-533e-40c8-ab2a-ce3415af240a] Disconnected iSCSI Volume {{(pid=75226) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 17 01:41:43 user nova-compute[75226]: DEBUG nova.objects.instance [None req-041a901b-d4db-4bb9-9861-722e587cc92c tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Lazy-loading 'flavor' on Instance uuid 8c4a9724-533e-40c8-ab2a-ce3415af240a {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:41:43 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-041a901b-d4db-4bb9-9861-722e587cc92c tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Lock "8c4a9724-533e-40c8-ab2a-ce3415af240a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.586s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:41:43 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:41:46 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-fbc3c9e3-ba74-4aa2-aa55-e22afd8f839e tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Acquiring lock "5c280142-8901-4f83-bde4-baaa097e05b0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:41:46 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-fbc3c9e3-ba74-4aa2-aa55-e22afd8f839e tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Lock "5c280142-8901-4f83-bde4-baaa097e05b0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:41:46 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-fbc3c9e3-ba74-4aa2-aa55-e22afd8f839e tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Acquiring lock "5c280142-8901-4f83-bde4-baaa097e05b0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:41:46 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-fbc3c9e3-ba74-4aa2-aa55-e22afd8f839e tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Lock "5c280142-8901-4f83-bde4-baaa097e05b0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:41:46 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-fbc3c9e3-ba74-4aa2-aa55-e22afd8f839e tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Lock "5c280142-8901-4f83-bde4-baaa097e05b0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:41:46 user nova-compute[75226]: INFO nova.compute.manager [None req-fbc3c9e3-ba74-4aa2-aa55-e22afd8f839e tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] [instance: 5c280142-8901-4f83-bde4-baaa097e05b0] Terminating instance
Nov 17 01:41:46 user nova-compute[75226]: DEBUG nova.compute.manager [None req-fbc3c9e3-ba74-4aa2-aa55-e22afd8f839e tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] [instance: 5c280142-8901-4f83-bde4-baaa097e05b0] Start destroying the instance on the hypervisor. {{(pid=75226) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 17 01:41:46 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:41:46 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:41:46 user nova-compute[75226]: DEBUG nova.compute.manager [req-04a0a781-7e9d-40bd-86bd-03475e8fc4c1 req-71d8ff0e-4b9f-42fa-b66c-953be01b231b service nova] [instance: 5c280142-8901-4f83-bde4-baaa097e05b0] Received event network-vif-unplugged-3f54cf07-6d64-4e03-a3f7-bab096a18e89 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:41:46 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-04a0a781-7e9d-40bd-86bd-03475e8fc4c1 req-71d8ff0e-4b9f-42fa-b66c-953be01b231b service nova] Acquiring lock "5c280142-8901-4f83-bde4-baaa097e05b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:41:46 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-04a0a781-7e9d-40bd-86bd-03475e8fc4c1 req-71d8ff0e-4b9f-42fa-b66c-953be01b231b service nova] Lock "5c280142-8901-4f83-bde4-baaa097e05b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:41:46 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-04a0a781-7e9d-40bd-86bd-03475e8fc4c1 req-71d8ff0e-4b9f-42fa-b66c-953be01b231b service nova] Lock "5c280142-8901-4f83-bde4-baaa097e05b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:41:46 user nova-compute[75226]: DEBUG nova.compute.manager [req-04a0a781-7e9d-40bd-86bd-03475e8fc4c1 req-71d8ff0e-4b9f-42fa-b66c-953be01b231b service nova] [instance: 5c280142-8901-4f83-bde4-baaa097e05b0] No waiting events found dispatching network-vif-unplugged-3f54cf07-6d64-4e03-a3f7-bab096a18e89 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:41:46 user nova-compute[75226]: DEBUG nova.compute.manager [req-04a0a781-7e9d-40bd-86bd-03475e8fc4c1 req-71d8ff0e-4b9f-42fa-b66c-953be01b231b service nova] [instance: 5c280142-8901-4f83-bde4-baaa097e05b0] Received event network-vif-unplugged-3f54cf07-6d64-4e03-a3f7-bab096a18e89 for instance with task_state deleting. {{(pid=75226) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 17 01:41:46 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:41:46 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:41:46 user nova-compute[75226]: INFO nova.virt.libvirt.driver [-] [instance: 5c280142-8901-4f83-bde4-baaa097e05b0] Instance destroyed successfully.
Nov 17 01:41:46 user nova-compute[75226]: DEBUG nova.objects.instance [None req-fbc3c9e3-ba74-4aa2-aa55-e22afd8f839e tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Lazy-loading 'resources' on Instance uuid 5c280142-8901-4f83-bde4-baaa097e05b0 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:41:46 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-fbc3c9e3-ba74-4aa2-aa55-e22afd8f839e tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:25:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1469039538',display_name='tempest-ServerRescueNegativeTestJSON-server-1469039538',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1469039538',id=26,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-17T01:27:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2052a37a068e4d948c57560c0f4445e4',ramdisk_id='',reservation_id='r-afes9mrt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-344970408',owner_user_name='tempest-ServerRescueNegativeTestJSON-344970408-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T01:27:37Z,user_data=None,user_id='12f405f1486a4f5187e628c60f223e98',uuid=5c280142-8901-4f83-bde4-baaa097e05b0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "3f54cf07-6d64-4e03-a3f7-bab096a18e89", "address": "fa:16:3e:41:48:98", "network": {"id": "a9710b94-56f8-4cf6-9bb6-344b275e5bf2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-512340839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2052a37a068e4d948c57560c0f4445e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f54cf07-6d", "ovs_interfaceid": "3f54cf07-6d64-4e03-a3f7-bab096a18e89", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 17 01:41:46 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-fbc3c9e3-ba74-4aa2-aa55-e22afd8f839e tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Converting VIF {"id": "3f54cf07-6d64-4e03-a3f7-bab096a18e89", "address": "fa:16:3e:41:48:98", "network": {"id": "a9710b94-56f8-4cf6-9bb6-344b275e5bf2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-512340839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2052a37a068e4d948c57560c0f4445e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f54cf07-6d", "ovs_interfaceid": "3f54cf07-6d64-4e03-a3f7-bab096a18e89", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:41:46 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-fbc3c9e3-ba74-4aa2-aa55-e22afd8f839e tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:41:48:98,bridge_name='br-int',has_traffic_filtering=True,id=3f54cf07-6d64-4e03-a3f7-bab096a18e89,network=Network(a9710b94-56f8-4cf6-9bb6-344b275e5bf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f54cf07-6d') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:41:46 user nova-compute[75226]: DEBUG os_vif [None req-fbc3c9e3-ba74-4aa2-aa55-e22afd8f839e tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:41:48:98,bridge_name='br-int',has_traffic_filtering=True,id=3f54cf07-6d64-4e03-a3f7-bab096a18e89,network=Network(a9710b94-56f8-4cf6-9bb6-344b275e5bf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f54cf07-6d') {{(pid=75226) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 17 01:41:46 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:41:46 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3f54cf07-6d, bridge=br-int, if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:41:46 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:41:46 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:41:46 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:41:46 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=962dc591-9ac7-4ad1-88e9-c5b4f43c3f34) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:41:46 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:41:46 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:41:46 user nova-compute[75226]: INFO os_vif [None req-fbc3c9e3-ba74-4aa2-aa55-e22afd8f839e tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:41:48:98,bridge_name='br-int',has_traffic_filtering=True,id=3f54cf07-6d64-4e03-a3f7-bab096a18e89,network=Network(a9710b94-56f8-4cf6-9bb6-344b275e5bf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f54cf07-6d')
Nov 17 01:41:46 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-fbc3c9e3-ba74-4aa2-aa55-e22afd8f839e tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] [instance: 5c280142-8901-4f83-bde4-baaa097e05b0] Deleting instance files /opt/stack/data/nova/instances/5c280142-8901-4f83-bde4-baaa097e05b0_del
Nov 17 01:41:47 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-fbc3c9e3-ba74-4aa2-aa55-e22afd8f839e tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] [instance: 5c280142-8901-4f83-bde4-baaa097e05b0] Deletion of /opt/stack/data/nova/instances/5c280142-8901-4f83-bde4-baaa097e05b0_del complete
Nov 17 01:41:47 user nova-compute[75226]: INFO nova.compute.manager [None req-fbc3c9e3-ba74-4aa2-aa55-e22afd8f839e tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] [instance: 5c280142-8901-4f83-bde4-baaa097e05b0] Took 1.00 seconds to destroy the instance on the hypervisor.
Nov 17 01:41:47 user nova-compute[75226]: DEBUG oslo.service.loopingcall [None req-fbc3c9e3-ba74-4aa2-aa55-e22afd8f839e tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75226) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 17 01:41:47 user nova-compute[75226]: DEBUG nova.compute.manager [-] [instance: 5c280142-8901-4f83-bde4-baaa097e05b0] Deallocating network for instance {{(pid=75226) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 17 01:41:47 user nova-compute[75226]: DEBUG nova.network.neutron [-] [instance: 5c280142-8901-4f83-bde4-baaa097e05b0] deallocate_for_instance() {{(pid=75226) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 17 01:41:47 user nova-compute[75226]: DEBUG nova.network.neutron [-] [instance: 5c280142-8901-4f83-bde4-baaa097e05b0] Updating instance_info_cache with network_info: [] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:41:47 user nova-compute[75226]: DEBUG nova.compute.manager [req-71fb27eb-83d4-4d96-abaf-4101eb0eaf6c req-bfc3c6a4-07a7-48bf-a75f-ac9b83be7c1a service nova] [instance: 5c280142-8901-4f83-bde4-baaa097e05b0] Received event network-vif-deleted-3f54cf07-6d64-4e03-a3f7-bab096a18e89 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:41:47 user nova-compute[75226]: INFO nova.compute.manager [req-71fb27eb-83d4-4d96-abaf-4101eb0eaf6c req-bfc3c6a4-07a7-48bf-a75f-ac9b83be7c1a service nova] [instance: 5c280142-8901-4f83-bde4-baaa097e05b0] Neutron deleted interface 3f54cf07-6d64-4e03-a3f7-bab096a18e89; detaching it from the instance and deleting it from the info cache
Nov 17 01:41:47 user nova-compute[75226]: DEBUG nova.network.neutron [req-71fb27eb-83d4-4d96-abaf-4101eb0eaf6c req-bfc3c6a4-07a7-48bf-a75f-ac9b83be7c1a service nova] [instance: 5c280142-8901-4f83-bde4-baaa097e05b0] Updating instance_info_cache with network_info: [] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:41:47 user nova-compute[75226]: INFO nova.compute.manager [-] [instance: 5c280142-8901-4f83-bde4-baaa097e05b0] Took 0.48 seconds to deallocate network for instance.
Nov 17 01:41:47 user nova-compute[75226]: DEBUG nova.compute.manager [req-71fb27eb-83d4-4d96-abaf-4101eb0eaf6c req-bfc3c6a4-07a7-48bf-a75f-ac9b83be7c1a service nova] [instance: 5c280142-8901-4f83-bde4-baaa097e05b0] Detach interface failed, port_id=3f54cf07-6d64-4e03-a3f7-bab096a18e89, reason: Instance 5c280142-8901-4f83-bde4-baaa097e05b0 could not be found. {{(pid=75226) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 17 01:41:47 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-fbc3c9e3-ba74-4aa2-aa55-e22afd8f839e tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:41:47 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-fbc3c9e3-ba74-4aa2-aa55-e22afd8f839e tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:41:47 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-fbc3c9e3-ba74-4aa2-aa55-e22afd8f839e tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:41:47 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-fbc3c9e3-ba74-4aa2-aa55-e22afd8f839e tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:41:47 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-fbc3c9e3-ba74-4aa2-aa55-e22afd8f839e tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.195s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:41:47 user nova-compute[75226]: INFO nova.scheduler.client.report [None req-fbc3c9e3-ba74-4aa2-aa55-e22afd8f839e tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Deleted allocations for instance 5c280142-8901-4f83-bde4-baaa097e05b0
Nov 17 01:41:47 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-fbc3c9e3-ba74-4aa2-aa55-e22afd8f839e tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Lock "5c280142-8901-4f83-bde4-baaa097e05b0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.852s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:41:48 user nova-compute[75226]: DEBUG nova.compute.manager [req-f9bfe584-2ecc-4be4-b956-5e0600a00fe8 req-a0a0a564-4d90-41ff-9a4a-1a90b8148c80 service nova] [instance: 5c280142-8901-4f83-bde4-baaa097e05b0] Received event network-vif-plugged-3f54cf07-6d64-4e03-a3f7-bab096a18e89 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:41:48 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-f9bfe584-2ecc-4be4-b956-5e0600a00fe8 req-a0a0a564-4d90-41ff-9a4a-1a90b8148c80 service nova] Acquiring lock "5c280142-8901-4f83-bde4-baaa097e05b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:41:48 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-f9bfe584-2ecc-4be4-b956-5e0600a00fe8 req-a0a0a564-4d90-41ff-9a4a-1a90b8148c80 service nova] Lock "5c280142-8901-4f83-bde4-baaa097e05b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:41:48 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-f9bfe584-2ecc-4be4-b956-5e0600a00fe8 req-a0a0a564-4d90-41ff-9a4a-1a90b8148c80 service nova] Lock "5c280142-8901-4f83-bde4-baaa097e05b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:41:48 user nova-compute[75226]: DEBUG nova.compute.manager [req-f9bfe584-2ecc-4be4-b956-5e0600a00fe8 req-a0a0a564-4d90-41ff-9a4a-1a90b8148c80 service nova] [instance: 5c280142-8901-4f83-bde4-baaa097e05b0] No waiting events found dispatching network-vif-plugged-3f54cf07-6d64-4e03-a3f7-bab096a18e89 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:41:48 user nova-compute[75226]: WARNING nova.compute.manager [req-f9bfe584-2ecc-4be4-b956-5e0600a00fe8 req-a0a0a564-4d90-41ff-9a4a-1a90b8148c80 service nova] [instance: 5c280142-8901-4f83-bde4-baaa097e05b0] Received unexpected event network-vif-plugged-3f54cf07-6d64-4e03-a3f7-bab096a18e89 for instance with vm_state deleted and task_state None.
Nov 17 01:41:51 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:41:56 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:42:00 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:42:01 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:42:02 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-fe98c74c-9c67-4312-a47b-13b41810255a tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] Acquiring lock "bd76f92b-0181-4291-aee3-9d0ccc095129" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:42:02 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-fe98c74c-9c67-4312-a47b-13b41810255a tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] Lock "bd76f92b-0181-4291-aee3-9d0ccc095129" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:42:02 user nova-compute[75226]: DEBUG nova.compute.manager [None req-fe98c74c-9c67-4312-a47b-13b41810255a tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] [instance: bd76f92b-0181-4291-aee3-9d0ccc095129] Starting instance... {{(pid=75226) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 17 01:42:02 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-fe98c74c-9c67-4312-a47b-13b41810255a tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:42:02 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-fe98c74c-9c67-4312-a47b-13b41810255a tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:42:02 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-fe98c74c-9c67-4312-a47b-13b41810255a tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75226) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 17 01:42:02 user nova-compute[75226]: INFO nova.compute.claims [None req-fe98c74c-9c67-4312-a47b-13b41810255a tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] [instance: bd76f92b-0181-4291-aee3-9d0ccc095129] Claim successful on node user
Nov 17 01:42:02 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-fe98c74c-9c67-4312-a47b-13b41810255a tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:42:02 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-fe98c74c-9c67-4312-a47b-13b41810255a tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:42:02 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-fe98c74c-9c67-4312-a47b-13b41810255a tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.303s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:42:02 user nova-compute[75226]: DEBUG nova.compute.manager [None req-fe98c74c-9c67-4312-a47b-13b41810255a tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] [instance: bd76f92b-0181-4291-aee3-9d0ccc095129] Start building networks asynchronously for instance. {{(pid=75226) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 17 01:42:02 user nova-compute[75226]: DEBUG nova.compute.manager [None req-fe98c74c-9c67-4312-a47b-13b41810255a tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] [instance: bd76f92b-0181-4291-aee3-9d0ccc095129] Allocating IP information in the background. {{(pid=75226) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 17 01:42:02 user nova-compute[75226]: DEBUG nova.network.neutron [None req-fe98c74c-9c67-4312-a47b-13b41810255a tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] [instance: bd76f92b-0181-4291-aee3-9d0ccc095129] allocate_for_instance() {{(pid=75226) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 17 01:42:02 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-fe98c74c-9c67-4312-a47b-13b41810255a tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] [instance: bd76f92b-0181-4291-aee3-9d0ccc095129] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 17 01:42:02 user nova-compute[75226]: DEBUG nova.compute.manager [None req-fe98c74c-9c67-4312-a47b-13b41810255a tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] [instance: bd76f92b-0181-4291-aee3-9d0ccc095129] Start building block device mappings for instance. {{(pid=75226) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 17 01:42:02 user nova-compute[75226]: DEBUG nova.compute.manager [None req-fe98c74c-9c67-4312-a47b-13b41810255a tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] [instance: bd76f92b-0181-4291-aee3-9d0ccc095129] Start spawning the instance on the hypervisor. {{(pid=75226) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 17 01:42:02 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-fe98c74c-9c67-4312-a47b-13b41810255a tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] [instance: bd76f92b-0181-4291-aee3-9d0ccc095129] Creating instance directory {{(pid=75226) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 17 01:42:02 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-fe98c74c-9c67-4312-a47b-13b41810255a tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] [instance: bd76f92b-0181-4291-aee3-9d0ccc095129] Creating image(s)
Nov 17 01:42:02 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-fe98c74c-9c67-4312-a47b-13b41810255a tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] Acquiring lock "/opt/stack/data/nova/instances/bd76f92b-0181-4291-aee3-9d0ccc095129/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:42:02 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-fe98c74c-9c67-4312-a47b-13b41810255a tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] Lock "/opt/stack/data/nova/instances/bd76f92b-0181-4291-aee3-9d0ccc095129/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:42:02 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-fe98c74c-9c67-4312-a47b-13b41810255a tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] Lock "/opt/stack/data/nova/instances/bd76f92b-0181-4291-aee3-9d0ccc095129/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:42:02 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-fe98c74c-9c67-4312-a47b-13b41810255a tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:42:02 user nova-compute[75226]: DEBUG nova.policy [None req-fe98c74c-9c67-4312-a47b-13b41810255a tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2aa9906ec44847448446b6fb94339028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f00bc826d34bbb8f2f93b550b7431a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75226) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 17 01:42:03 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-fe98c74c-9c67-4312-a47b-13b41810255a tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json" returned: 0 in 0.184s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:42:03 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-fe98c74c-9c67-4312-a47b-13b41810255a tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] Acquiring lock "a8a62c2546af3a2036b853250c5ac64d4c6b4371" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:42:03 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-fe98c74c-9c67-4312-a47b-13b41810255a tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] Lock "a8a62c2546af3a2036b853250c5ac64d4c6b4371" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:42:03 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-fe98c74c-9c67-4312-a47b-13b41810255a tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:42:03 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:42:03 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-fe98c74c-9c67-4312-a47b-13b41810255a tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json" returned: 0 in 0.185s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:42:03 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-fe98c74c-9c67-4312-a47b-13b41810255a tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371,backing_fmt=raw /opt/stack/data/nova/instances/bd76f92b-0181-4291-aee3-9d0ccc095129/disk 1073741824 {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:42:03 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-fe98c74c-9c67-4312-a47b-13b41810255a tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371,backing_fmt=raw /opt/stack/data/nova/instances/bd76f92b-0181-4291-aee3-9d0ccc095129/disk 1073741824" returned: 0 in 0.046s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:42:03 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-fe98c74c-9c67-4312-a47b-13b41810255a tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] Lock "a8a62c2546af3a2036b853250c5ac64d4c6b4371" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:42:03 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-fe98c74c-9c67-4312-a47b-13b41810255a tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:42:03 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:42:03 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-fe98c74c-9c67-4312-a47b-13b41810255a tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json" returned: 0 in 0.176s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:42:03 user nova-compute[75226]: DEBUG nova.virt.disk.api [None req-fe98c74c-9c67-4312-a47b-13b41810255a tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bd76f92b-0181-4291-aee3-9d0ccc095129/disk. size=1073741824 {{(pid=75226) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 17 01:42:03 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-fe98c74c-9c67-4312-a47b-13b41810255a tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd76f92b-0181-4291-aee3-9d0ccc095129/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:42:03 user nova-compute[75226]: DEBUG nova.network.neutron [None req-fe98c74c-9c67-4312-a47b-13b41810255a tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] [instance: bd76f92b-0181-4291-aee3-9d0ccc095129] Successfully created port: 0e9eda20-45e5-4acc-9343-366f0d5caccb {{(pid=75226) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 17 01:42:03 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-fe98c74c-9c67-4312-a47b-13b41810255a tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd76f92b-0181-4291-aee3-9d0ccc095129/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:42:03 user nova-compute[75226]: DEBUG nova.virt.disk.api [None req-fe98c74c-9c67-4312-a47b-13b41810255a tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] Cannot resize image /opt/stack/data/nova/instances/bd76f92b-0181-4291-aee3-9d0ccc095129/disk to a smaller size. {{(pid=75226) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 17 01:42:03 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-fe98c74c-9c67-4312-a47b-13b41810255a tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] [instance: bd76f92b-0181-4291-aee3-9d0ccc095129] Created local disks {{(pid=75226) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 17 01:42:03 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-fe98c74c-9c67-4312-a47b-13b41810255a tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] [instance: bd76f92b-0181-4291-aee3-9d0ccc095129] Ensure instance console log exists: /opt/stack/data/nova/instances/bd76f92b-0181-4291-aee3-9d0ccc095129/console.log {{(pid=75226) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 17 01:42:03 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-fe98c74c-9c67-4312-a47b-13b41810255a tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:42:03 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-fe98c74c-9c67-4312-a47b-13b41810255a tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:42:03 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-fe98c74c-9c67-4312-a47b-13b41810255a tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:42:04 user nova-compute[75226]: DEBUG nova.network.neutron [None req-fe98c74c-9c67-4312-a47b-13b41810255a tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] [instance: bd76f92b-0181-4291-aee3-9d0ccc095129] Successfully updated port: 0e9eda20-45e5-4acc-9343-366f0d5caccb {{(pid=75226) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 17 01:42:04 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-fe98c74c-9c67-4312-a47b-13b41810255a tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] Acquiring lock "refresh_cache-bd76f92b-0181-4291-aee3-9d0ccc095129" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:42:04 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-fe98c74c-9c67-4312-a47b-13b41810255a tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] Acquired lock "refresh_cache-bd76f92b-0181-4291-aee3-9d0ccc095129" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:42:04 user nova-compute[75226]: DEBUG nova.network.neutron [None req-fe98c74c-9c67-4312-a47b-13b41810255a tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] [instance: bd76f92b-0181-4291-aee3-9d0ccc095129] Building network info cache for instance {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 01:42:04 user nova-compute[75226]: DEBUG nova.compute.manager [req-c4081c6b-5e07-4a31-a518-661472273150 req-318a8dc5-547e-415e-a7bc-22238b3ebf04 service nova] [instance: bd76f92b-0181-4291-aee3-9d0ccc095129] Received event network-changed-0e9eda20-45e5-4acc-9343-366f0d5caccb {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:42:04 user nova-compute[75226]: DEBUG nova.compute.manager [req-c4081c6b-5e07-4a31-a518-661472273150 req-318a8dc5-547e-415e-a7bc-22238b3ebf04 service nova] [instance: bd76f92b-0181-4291-aee3-9d0ccc095129] Refreshing instance network info cache due to event network-changed-0e9eda20-45e5-4acc-9343-366f0d5caccb. {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 01:42:04 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-c4081c6b-5e07-4a31-a518-661472273150 req-318a8dc5-547e-415e-a7bc-22238b3ebf04 service nova] Acquiring lock "refresh_cache-bd76f92b-0181-4291-aee3-9d0ccc095129" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:42:04 user nova-compute[75226]: DEBUG nova.network.neutron [None req-fe98c74c-9c67-4312-a47b-13b41810255a tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] [instance: bd76f92b-0181-4291-aee3-9d0ccc095129] Instance cache missing network info. {{(pid=75226) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 17 01:42:04 user nova-compute[75226]: DEBUG nova.network.neutron [None req-fe98c74c-9c67-4312-a47b-13b41810255a tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] [instance: bd76f92b-0181-4291-aee3-9d0ccc095129] Updating instance_info_cache with network_info: [{"id": "0e9eda20-45e5-4acc-9343-366f0d5caccb", "address": "fa:16:3e:8b:74:bd", "network": {"id": "fe08b87c-6bf1-4842-a770-6522ba026ba4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1133747653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50f00bc826d34bbb8f2f93b550b7431a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e9eda20-45", "ovs_interfaceid": "0e9eda20-45e5-4acc-9343-366f0d5caccb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:42:04 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-fe98c74c-9c67-4312-a47b-13b41810255a tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] Releasing lock "refresh_cache-bd76f92b-0181-4291-aee3-9d0ccc095129" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:42:04 user nova-compute[75226]: DEBUG nova.compute.manager [None req-fe98c74c-9c67-4312-a47b-13b41810255a tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] [instance: bd76f92b-0181-4291-aee3-9d0ccc095129] Instance network_info: |[{"id": "0e9eda20-45e5-4acc-9343-366f0d5caccb", "address": "fa:16:3e:8b:74:bd", "network": {"id": "fe08b87c-6bf1-4842-a770-6522ba026ba4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1133747653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50f00bc826d34bbb8f2f93b550b7431a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e9eda20-45", "ovs_interfaceid": "0e9eda20-45e5-4acc-9343-366f0d5caccb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75226) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 17 01:42:04 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-c4081c6b-5e07-4a31-a518-661472273150 req-318a8dc5-547e-415e-a7bc-22238b3ebf04 service nova] Acquired lock "refresh_cache-bd76f92b-0181-4291-aee3-9d0ccc095129" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:42:04 user nova-compute[75226]: DEBUG nova.network.neutron [req-c4081c6b-5e07-4a31-a518-661472273150 req-318a8dc5-547e-415e-a7bc-22238b3ebf04 service nova] [instance: bd76f92b-0181-4291-aee3-9d0ccc095129] Refreshing network info cache for port 0e9eda20-45e5-4acc-9343-366f0d5caccb {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 01:42:04 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-fe98c74c-9c67-4312-a47b-13b41810255a tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] [instance: bd76f92b-0181-4291-aee3-9d0ccc095129] Start _get_guest_xml network_info=[{"id": "0e9eda20-45e5-4acc-9343-366f0d5caccb", "address": "fa:16:3e:8b:74:bd", "network": {"id": "fe08b87c-6bf1-4842-a770-6522ba026ba4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1133747653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50f00bc826d34bbb8f2f93b550b7431a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e9eda20-45", "ovs_interfaceid": "0e9eda20-45e5-4acc-9343-366f0d5caccb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T01:13:22Z,direct_url=<?>,disk_format='qcow2',id=0b369aea-6f3f-4690-9f01-229b90ab6310,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4e110cbf9a84362a6864a7732c435a1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T01:13:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '0b369aea-6f3f-4690-9f01-229b90ab6310'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75226) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 17 01:42:04 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-fe98c74c-9c67-4312-a47b-13b41810255a tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:42:04 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-fe98c74c-9c67-4312-a47b-13b41810255a tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:42:04 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-fe98c74c-9c67-4312-a47b-13b41810255a tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75226) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 17 01:42:04 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-fe98c74c-9c67-4312-a47b-13b41810255a tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] CPU controller missing on host. {{(pid=75226) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 17 01:42:04 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-fe98c74c-9c67-4312-a47b-13b41810255a tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75226) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 17 01:42:04 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-fe98c74c-9c67-4312-a47b-13b41810255a tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] CPU controller found on host. {{(pid=75226) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 17 01:42:04 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-fe98c74c-9c67-4312-a47b-13b41810255a tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75226) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 17 01:42:04 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-fe98c74c-9c67-4312-a47b-13b41810255a tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-17T01:13:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T01:13:22Z,direct_url=<?>,disk_format='qcow2',id=0b369aea-6f3f-4690-9f01-229b90ab6310,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4e110cbf9a84362a6864a7732c435a1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T01:13:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 17 01:42:04 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-fe98c74c-9c67-4312-a47b-13b41810255a tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] Flavor limits 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 17 01:42:04 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-fe98c74c-9c67-4312-a47b-13b41810255a tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] Image limits 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 17 01:42:04 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-fe98c74c-9c67-4312-a47b-13b41810255a tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] Flavor pref 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 17 01:42:04 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-fe98c74c-9c67-4312-a47b-13b41810255a tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] Image pref 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 17 01:42:04 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-fe98c74c-9c67-4312-a47b-13b41810255a tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 17 01:42:04 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-fe98c74c-9c67-4312-a47b-13b41810255a tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 17 01:42:04 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-fe98c74c-9c67-4312-a47b-13b41810255a tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75226) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 17 01:42:04 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-fe98c74c-9c67-4312-a47b-13b41810255a tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] Got 1 possible topologies {{(pid=75226) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 17 01:42:04 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-fe98c74c-9c67-4312-a47b-13b41810255a tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 17 01:42:04 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-fe98c74c-9c67-4312-a47b-13b41810255a tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 17 01:42:04 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-fe98c74c-9c67-4312-a47b-13b41810255a tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:42:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1608543635',display_name='tempest-VolumesActionsTest-instance-1608543635',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1608543635',id=41,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='50f00bc826d34bbb8f2f93b550b7431a',ramdisk_id='',reservation_id='r-s0unyo31',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1397730864',owner_user_name='tempest-VolumesActionsTest-1397730864-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T01:42:03Z,user_data=None,user_id='2aa9906ec44847448446b6fb94339028',uuid=bd76f92b-0181-4291-aee3-9d0ccc095129,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0e9eda20-45e5-4acc-9343-366f0d5caccb", "address": "fa:16:3e:8b:74:bd", "network": {"id": "fe08b87c-6bf1-4842-a770-6522ba026ba4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1133747653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50f00bc826d34bbb8f2f93b550b7431a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e9eda20-45", "ovs_interfaceid": "0e9eda20-45e5-4acc-9343-366f0d5caccb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75226) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 01:42:04 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-fe98c74c-9c67-4312-a47b-13b41810255a tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] Converting VIF {"id": "0e9eda20-45e5-4acc-9343-366f0d5caccb", "address": "fa:16:3e:8b:74:bd", "network": {"id": "fe08b87c-6bf1-4842-a770-6522ba026ba4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1133747653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50f00bc826d34bbb8f2f93b550b7431a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e9eda20-45", "ovs_interfaceid": "0e9eda20-45e5-4acc-9343-366f0d5caccb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:42:04 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-fe98c74c-9c67-4312-a47b-13b41810255a tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:74:bd,bridge_name='br-int',has_traffic_filtering=True,id=0e9eda20-45e5-4acc-9343-366f0d5caccb,network=Network(fe08b87c-6bf1-4842-a770-6522ba026ba4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e9eda20-45') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:42:04 user nova-compute[75226]: DEBUG nova.objects.instance [None req-fe98c74c-9c67-4312-a47b-13b41810255a tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] Lazy-loading 'pci_devices' on Instance uuid bd76f92b-0181-4291-aee3-9d0ccc095129 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:42:04 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-fe98c74c-9c67-4312-a47b-13b41810255a tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] [instance: bd76f92b-0181-4291-aee3-9d0ccc095129] End _get_guest_xml xml=<domain type="kvm">
Nov 17 01:42:04 user nova-compute[75226]:   <uuid>bd76f92b-0181-4291-aee3-9d0ccc095129</uuid>
Nov 17 01:42:04 user nova-compute[75226]:   <name>instance-00000029</name>
Nov 17 01:42:04 user nova-compute[75226]:   <memory>524288</memory>
Nov 17 01:42:04 user nova-compute[75226]:   <vcpu>1</vcpu>
Nov 17 01:42:04 user nova-compute[75226]:   <metadata>
Nov 17 01:42:04 user nova-compute[75226]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 17 01:42:04 user nova-compute[75226]:       <nova:package version="0.0.0"/>
Nov 17 01:42:04 user nova-compute[75226]:       <nova:name>tempest-VolumesActionsTest-instance-1608543635</nova:name>
Nov 17 01:42:04 user nova-compute[75226]:       <nova:creationTime>2023-11-17 01:42:04</nova:creationTime>
Nov 17 01:42:04 user nova-compute[75226]:       <nova:flavor name="m1.tiny">
Nov 17 01:42:04 user nova-compute[75226]:         <nova:memory>512</nova:memory>
Nov 17 01:42:04 user nova-compute[75226]:         <nova:disk>1</nova:disk>
Nov 17 01:42:04 user nova-compute[75226]:         <nova:swap>0</nova:swap>
Nov 17 01:42:04 user nova-compute[75226]:         <nova:ephemeral>0</nova:ephemeral>
Nov 17 01:42:04 user nova-compute[75226]:         <nova:vcpus>1</nova:vcpus>
Nov 17 01:42:04 user nova-compute[75226]:       </nova:flavor>
Nov 17 01:42:04 user nova-compute[75226]:       <nova:owner>
Nov 17 01:42:04 user nova-compute[75226]:         <nova:user uuid="2aa9906ec44847448446b6fb94339028">tempest-VolumesActionsTest-1397730864-project-member</nova:user>
Nov 17 01:42:04 user nova-compute[75226]:         <nova:project uuid="50f00bc826d34bbb8f2f93b550b7431a">tempest-VolumesActionsTest-1397730864</nova:project>
Nov 17 01:42:04 user nova-compute[75226]:       </nova:owner>
Nov 17 01:42:04 user nova-compute[75226]:       <nova:root type="image" uuid="0b369aea-6f3f-4690-9f01-229b90ab6310"/>
Nov 17 01:42:04 user nova-compute[75226]:       <nova:ports>
Nov 17 01:42:04 user nova-compute[75226]:         <nova:port uuid="0e9eda20-45e5-4acc-9343-366f0d5caccb">
Nov 17 01:42:04 user nova-compute[75226]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 17 01:42:04 user nova-compute[75226]:         </nova:port>
Nov 17 01:42:04 user nova-compute[75226]:       </nova:ports>
Nov 17 01:42:04 user nova-compute[75226]:     </nova:instance>
Nov 17 01:42:04 user nova-compute[75226]:   </metadata>
Nov 17 01:42:04 user nova-compute[75226]:   <sysinfo type="smbios">
Nov 17 01:42:04 user nova-compute[75226]:     <system>
Nov 17 01:42:04 user nova-compute[75226]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 17 01:42:04 user nova-compute[75226]:       <entry name="product">OpenStack Nova</entry>
Nov 17 01:42:04 user nova-compute[75226]:       <entry name="version">0.0.0</entry>
Nov 17 01:42:04 user nova-compute[75226]:       <entry name="serial">bd76f92b-0181-4291-aee3-9d0ccc095129</entry>
Nov 17 01:42:04 user nova-compute[75226]:       <entry name="uuid">bd76f92b-0181-4291-aee3-9d0ccc095129</entry>
Nov 17 01:42:04 user nova-compute[75226]:       <entry name="family">Virtual Machine</entry>
Nov 17 01:42:04 user nova-compute[75226]:     </system>
Nov 17 01:42:04 user nova-compute[75226]:   </sysinfo>
Nov 17 01:42:04 user nova-compute[75226]:   <os>
Nov 17 01:42:04 user nova-compute[75226]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 17 01:42:04 user nova-compute[75226]:     <boot dev="hd"/>
Nov 17 01:42:04 user nova-compute[75226]:     <smbios mode="sysinfo"/>
Nov 17 01:42:04 user nova-compute[75226]:   </os>
Nov 17 01:42:04 user nova-compute[75226]:   <features>
Nov 17 01:42:04 user nova-compute[75226]:     <acpi/>
Nov 17 01:42:04 user nova-compute[75226]:     <apic/>
Nov 17 01:42:04 user nova-compute[75226]:     <vmcoreinfo/>
Nov 17 01:42:04 user nova-compute[75226]:   </features>
Nov 17 01:42:04 user nova-compute[75226]:   <clock offset="utc">
Nov 17 01:42:04 user nova-compute[75226]:     <timer name="pit" tickpolicy="delay"/>
Nov 17 01:42:04 user nova-compute[75226]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 17 01:42:04 user nova-compute[75226]:     <timer name="hpet" present="no"/>
Nov 17 01:42:04 user nova-compute[75226]:   </clock>
Nov 17 01:42:04 user nova-compute[75226]:   <cpu mode="custom" match="exact">
Nov 17 01:42:04 user nova-compute[75226]:     <model>Nehalem</model>
Nov 17 01:42:04 user nova-compute[75226]:     <topology sockets="1" cores="1" threads="1"/>
Nov 17 01:42:04 user nova-compute[75226]:   </cpu>
Nov 17 01:42:04 user nova-compute[75226]:   <devices>
Nov 17 01:42:04 user nova-compute[75226]:     <disk type="file" device="disk">
Nov 17 01:42:04 user nova-compute[75226]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 17 01:42:04 user nova-compute[75226]:       <source file="/opt/stack/data/nova/instances/bd76f92b-0181-4291-aee3-9d0ccc095129/disk"/>
Nov 17 01:42:04 user nova-compute[75226]:       <target dev="vda" bus="virtio"/>
Nov 17 01:42:04 user nova-compute[75226]:     </disk>
Nov 17 01:42:04 user nova-compute[75226]:     <interface type="ethernet">
Nov 17 01:42:04 user nova-compute[75226]:       <mac address="fa:16:3e:8b:74:bd"/>
Nov 17 01:42:04 user nova-compute[75226]:       <model type="virtio"/>
Nov 17 01:42:04 user nova-compute[75226]:       <mtu size="1442"/>
Nov 17 01:42:04 user nova-compute[75226]:       <target dev="tap0e9eda20-45"/>
Nov 17 01:42:04 user nova-compute[75226]:     </interface>
Nov 17 01:42:04 user nova-compute[75226]:     <serial type="pty">
Nov 17 01:42:04 user nova-compute[75226]:       <log file="/opt/stack/data/nova/instances/bd76f92b-0181-4291-aee3-9d0ccc095129/console.log" append="off"/>
Nov 17 01:42:04 user nova-compute[75226]:     </serial>
Nov 17 01:42:04 user nova-compute[75226]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 17 01:42:04 user nova-compute[75226]:     <video>
Nov 17 01:42:04 user nova-compute[75226]:       <model type="virtio"/>
Nov 17 01:42:04 user nova-compute[75226]:     </video>
Nov 17 01:42:04 user nova-compute[75226]:     <rng model="virtio">
Nov 17 01:42:04 user nova-compute[75226]:       <backend model="random">/dev/urandom</backend>
Nov 17 01:42:04 user nova-compute[75226]:     </rng>
Nov 17 01:42:04 user nova-compute[75226]:     <controller type="usb" index="0" model="none"/>
Nov 17 01:42:04 user nova-compute[75226]:     <memballoon model="virtio">
Nov 17 01:42:04 user nova-compute[75226]:       <stats period="10"/>
Nov 17 01:42:04 user nova-compute[75226]:     </memballoon>
Nov 17 01:42:04 user nova-compute[75226]:   </devices>
Nov 17 01:42:04 user nova-compute[75226]: </domain>
Nov 17 01:42:04 user nova-compute[75226]:  {{(pid=75226) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 17 01:42:04 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-fe98c74c-9c67-4312-a47b-13b41810255a tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:42:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1608543635',display_name='tempest-VolumesActionsTest-instance-1608543635',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1608543635',id=41,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='50f00bc826d34bbb8f2f93b550b7431a',ramdisk_id='',reservation_id='r-s0unyo31',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1397730864',owner_user_name='tempest-VolumesActionsTest-1397730864-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T01:42:03Z,user_data=None,user_id='2aa9906ec44847448446b6fb94339028',uuid=bd76f92b-0181-4291-aee3-9d0ccc095129,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0e9eda20-45e5-4acc-9343-366f0d5caccb", "address": "fa:16:3e:8b:74:bd", "network": {"id": "fe08b87c-6bf1-4842-a770-6522ba026ba4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1133747653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50f00bc826d34bbb8f2f93b550b7431a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e9eda20-45", "ovs_interfaceid": "0e9eda20-45e5-4acc-9343-366f0d5caccb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 17 01:42:04 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-fe98c74c-9c67-4312-a47b-13b41810255a tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] Converting VIF {"id": "0e9eda20-45e5-4acc-9343-366f0d5caccb", "address": "fa:16:3e:8b:74:bd", "network": {"id": "fe08b87c-6bf1-4842-a770-6522ba026ba4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1133747653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50f00bc826d34bbb8f2f93b550b7431a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e9eda20-45", "ovs_interfaceid": "0e9eda20-45e5-4acc-9343-366f0d5caccb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:42:04 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-fe98c74c-9c67-4312-a47b-13b41810255a tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:74:bd,bridge_name='br-int',has_traffic_filtering=True,id=0e9eda20-45e5-4acc-9343-366f0d5caccb,network=Network(fe08b87c-6bf1-4842-a770-6522ba026ba4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e9eda20-45') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:42:04 user nova-compute[75226]: DEBUG os_vif [None req-fe98c74c-9c67-4312-a47b-13b41810255a tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:74:bd,bridge_name='br-int',has_traffic_filtering=True,id=0e9eda20-45e5-4acc-9343-366f0d5caccb,network=Network(fe08b87c-6bf1-4842-a770-6522ba026ba4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e9eda20-45') {{(pid=75226) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 17 01:42:04 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:42:04 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:42:04 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 17 01:42:04 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:42:04 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e0c617e6-cb1b-50b0-b406-a2d85395e6ae', '_type': 'linux-noop'}}, row=False) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:42:04 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:42:04 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:42:04 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:42:04 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0e9eda20-45, may_exist=True, interface_attrs={}) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:42:04 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0e9eda20-45, col_values=(('qos', UUID('9e42a536-d7d3-4be8-b873-05b9aefd3f85')),), if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:42:04 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0e9eda20-45, col_values=(('external_ids', {'iface-id': '0e9eda20-45e5-4acc-9343-366f0d5caccb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8b:74:bd', 'vm-uuid': 'bd76f92b-0181-4291-aee3-9d0ccc095129'}),), if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:42:04 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:42:04 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:42:04 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:42:04 user nova-compute[75226]: INFO os_vif [None req-fe98c74c-9c67-4312-a47b-13b41810255a tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:74:bd,bridge_name='br-int',has_traffic_filtering=True,id=0e9eda20-45e5-4acc-9343-366f0d5caccb,network=Network(fe08b87c-6bf1-4842-a770-6522ba026ba4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e9eda20-45')
Nov 17 01:42:04 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-fe98c74c-9c67-4312-a47b-13b41810255a tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] No BDM found with device name vda, not building metadata. {{(pid=75226) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 01:42:04 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-fe98c74c-9c67-4312-a47b-13b41810255a tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] No VIF found with MAC fa:16:3e:8b:74:bd, not building metadata {{(pid=75226) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 01:42:05 user nova-compute[75226]: DEBUG nova.network.neutron [req-c4081c6b-5e07-4a31-a518-661472273150 req-318a8dc5-547e-415e-a7bc-22238b3ebf04 service nova] [instance: bd76f92b-0181-4291-aee3-9d0ccc095129] Updated VIF entry in instance network info cache for port 0e9eda20-45e5-4acc-9343-366f0d5caccb. {{(pid=75226) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 01:42:05 user nova-compute[75226]: DEBUG nova.network.neutron [req-c4081c6b-5e07-4a31-a518-661472273150 req-318a8dc5-547e-415e-a7bc-22238b3ebf04 service nova] [instance: bd76f92b-0181-4291-aee3-9d0ccc095129] Updating instance_info_cache with network_info: [{"id": "0e9eda20-45e5-4acc-9343-366f0d5caccb", "address": "fa:16:3e:8b:74:bd", "network": {"id": "fe08b87c-6bf1-4842-a770-6522ba026ba4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1133747653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50f00bc826d34bbb8f2f93b550b7431a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e9eda20-45", "ovs_interfaceid": "0e9eda20-45e5-4acc-9343-366f0d5caccb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:42:05 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-c4081c6b-5e07-4a31-a518-661472273150 req-318a8dc5-547e-415e-a7bc-22238b3ebf04 service nova] Releasing lock "refresh_cache-bd76f92b-0181-4291-aee3-9d0ccc095129" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:42:06 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:42:06 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:42:06 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:42:06 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:42:06 user nova-compute[75226]: DEBUG nova.compute.manager [req-8fdb6585-3978-4253-a072-3e850a38c62c req-48e19ff3-c748-4137-8272-3208050b29f5 service nova] [instance: bd76f92b-0181-4291-aee3-9d0ccc095129] Received event network-vif-plugged-0e9eda20-45e5-4acc-9343-366f0d5caccb {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:42:06 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-8fdb6585-3978-4253-a072-3e850a38c62c req-48e19ff3-c748-4137-8272-3208050b29f5 service nova] Acquiring lock "bd76f92b-0181-4291-aee3-9d0ccc095129-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:42:06 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-8fdb6585-3978-4253-a072-3e850a38c62c req-48e19ff3-c748-4137-8272-3208050b29f5 service nova] Lock "bd76f92b-0181-4291-aee3-9d0ccc095129-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:42:06 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-8fdb6585-3978-4253-a072-3e850a38c62c req-48e19ff3-c748-4137-8272-3208050b29f5 service nova] Lock "bd76f92b-0181-4291-aee3-9d0ccc095129-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:42:06 user nova-compute[75226]: DEBUG nova.compute.manager [req-8fdb6585-3978-4253-a072-3e850a38c62c req-48e19ff3-c748-4137-8272-3208050b29f5 service nova] [instance: bd76f92b-0181-4291-aee3-9d0ccc095129] No waiting events found dispatching network-vif-plugged-0e9eda20-45e5-4acc-9343-366f0d5caccb {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:42:06 user nova-compute[75226]: WARNING nova.compute.manager [req-8fdb6585-3978-4253-a072-3e850a38c62c req-48e19ff3-c748-4137-8272-3208050b29f5 service nova] [instance: bd76f92b-0181-4291-aee3-9d0ccc095129] Received unexpected event network-vif-plugged-0e9eda20-45e5-4acc-9343-366f0d5caccb for instance with vm_state building and task_state spawning.
Nov 17 01:42:06 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:42:06 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:42:06 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:42:07 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:42:08 user nova-compute[75226]: DEBUG nova.compute.manager [None req-fe98c74c-9c67-4312-a47b-13b41810255a tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] [instance: bd76f92b-0181-4291-aee3-9d0ccc095129] Instance event wait completed in 0 seconds for  {{(pid=75226) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 17 01:42:08 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-fe98c74c-9c67-4312-a47b-13b41810255a tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] [instance: bd76f92b-0181-4291-aee3-9d0ccc095129] Guest created on hypervisor {{(pid=75226) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 17 01:42:08 user nova-compute[75226]: INFO nova.virt.libvirt.driver [-] [instance: bd76f92b-0181-4291-aee3-9d0ccc095129] Instance spawned successfully.
Nov 17 01:42:08 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-fe98c74c-9c67-4312-a47b-13b41810255a tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] [instance: bd76f92b-0181-4291-aee3-9d0ccc095129] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 17 01:42:08 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-fe98c74c-9c67-4312-a47b-13b41810255a tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] [instance: bd76f92b-0181-4291-aee3-9d0ccc095129] Found default for hw_cdrom_bus of ide {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:42:08 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-fe98c74c-9c67-4312-a47b-13b41810255a tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] [instance: bd76f92b-0181-4291-aee3-9d0ccc095129] Found default for hw_disk_bus of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:42:08 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-fe98c74c-9c67-4312-a47b-13b41810255a tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] [instance: bd76f92b-0181-4291-aee3-9d0ccc095129] Found default for hw_input_bus of None {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:42:08 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-fe98c74c-9c67-4312-a47b-13b41810255a tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] [instance: bd76f92b-0181-4291-aee3-9d0ccc095129] Found default for hw_pointer_model of None {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:42:08 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-fe98c74c-9c67-4312-a47b-13b41810255a tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] [instance: bd76f92b-0181-4291-aee3-9d0ccc095129] Found default for hw_video_model of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:42:08 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-fe98c74c-9c67-4312-a47b-13b41810255a tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] [instance: bd76f92b-0181-4291-aee3-9d0ccc095129] Found default for hw_vif_model of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:42:08 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:42:08 user nova-compute[75226]: DEBUG nova.compute.manager [req-8fb3c6a8-d5e4-40ff-992d-0d6b196af862 req-6cafbd0c-7f82-4efb-a7f1-b0f9832d7e88 service nova] [instance: bd76f92b-0181-4291-aee3-9d0ccc095129] Received event network-vif-plugged-0e9eda20-45e5-4acc-9343-366f0d5caccb {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:42:08 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-8fb3c6a8-d5e4-40ff-992d-0d6b196af862 req-6cafbd0c-7f82-4efb-a7f1-b0f9832d7e88 service nova] Acquiring lock "bd76f92b-0181-4291-aee3-9d0ccc095129-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:42:08 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-8fb3c6a8-d5e4-40ff-992d-0d6b196af862 req-6cafbd0c-7f82-4efb-a7f1-b0f9832d7e88 service nova] Lock "bd76f92b-0181-4291-aee3-9d0ccc095129-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:42:08 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-8fb3c6a8-d5e4-40ff-992d-0d6b196af862 req-6cafbd0c-7f82-4efb-a7f1-b0f9832d7e88 service nova] Lock "bd76f92b-0181-4291-aee3-9d0ccc095129-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:42:08 user nova-compute[75226]: DEBUG nova.compute.manager [req-8fb3c6a8-d5e4-40ff-992d-0d6b196af862 req-6cafbd0c-7f82-4efb-a7f1-b0f9832d7e88 service nova] [instance: bd76f92b-0181-4291-aee3-9d0ccc095129] No waiting events found dispatching network-vif-plugged-0e9eda20-45e5-4acc-9343-366f0d5caccb {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:42:08 user nova-compute[75226]: WARNING nova.compute.manager [req-8fb3c6a8-d5e4-40ff-992d-0d6b196af862 req-6cafbd0c-7f82-4efb-a7f1-b0f9832d7e88 service nova] [instance: bd76f92b-0181-4291-aee3-9d0ccc095129] Received unexpected event network-vif-plugged-0e9eda20-45e5-4acc-9343-366f0d5caccb for instance with vm_state building and task_state spawning.
Nov 17 01:42:08 user nova-compute[75226]: INFO nova.compute.manager [None req-fe98c74c-9c67-4312-a47b-13b41810255a tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] [instance: bd76f92b-0181-4291-aee3-9d0ccc095129] Took 5.55 seconds to spawn the instance on the hypervisor.
Nov 17 01:42:08 user nova-compute[75226]: DEBUG nova.compute.manager [None req-fe98c74c-9c67-4312-a47b-13b41810255a tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] [instance: bd76f92b-0181-4291-aee3-9d0ccc095129] Checking state {{(pid=75226) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 01:42:08 user nova-compute[75226]: INFO nova.compute.manager [None req-fe98c74c-9c67-4312-a47b-13b41810255a tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] [instance: bd76f92b-0181-4291-aee3-9d0ccc095129] Took 6.18 seconds to build instance.
Nov 17 01:42:08 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-fe98c74c-9c67-4312-a47b-13b41810255a tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] Lock "bd76f92b-0181-4291-aee3-9d0ccc095129" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.279s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:42:09 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:42:09 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:42:09 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:42:10 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:42:10 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:42:10 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:42:10 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75226) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 17 01:42:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c4a9724-533e-40c8-ab2a-ce3415af240a/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:42:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c4a9724-533e-40c8-ab2a-ce3415af240a/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:42:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c4a9724-533e-40c8-ab2a-ce3415af240a/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:42:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c4a9724-533e-40c8-ab2a-ce3415af240a/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:42:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f3b54ce-4dc1-445a-9108-3f628713e6ec/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:42:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f3b54ce-4dc1-445a-9108-3f628713e6ec/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:42:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f3b54ce-4dc1-445a-9108-3f628713e6ec/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:42:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f3b54ce-4dc1-445a-9108-3f628713e6ec/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:42:11 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6555d72-6094-4ea9-b071-a3d3c8a300a9/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:42:11 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6555d72-6094-4ea9-b071-a3d3c8a300a9/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:42:11 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6555d72-6094-4ea9-b071-a3d3c8a300a9/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:42:11 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6555d72-6094-4ea9-b071-a3d3c8a300a9/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:42:11 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0597c05a-1049-4117-a8ae-8177d590e024/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:42:11 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0597c05a-1049-4117-a8ae-8177d590e024/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:42:11 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0597c05a-1049-4117-a8ae-8177d590e024/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:42:11 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0597c05a-1049-4117-a8ae-8177d590e024/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:42:11 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd76f92b-0181-4291-aee3-9d0ccc095129/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:42:12 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd76f92b-0181-4291-aee3-9d0ccc095129/disk --force-share --output=json" returned: 0 in 0.274s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:42:12 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd76f92b-0181-4291-aee3-9d0ccc095129/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:42:12 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd76f92b-0181-4291-aee3-9d0ccc095129/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:42:12 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:42:12 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:42:12 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Hypervisor/Node resource view: name=user free_ram=8412MB free_disk=24.856754302978516GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75226) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 17 01:42:12 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:42:12 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:42:12 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance d6555d72-6094-4ea9-b071-a3d3c8a300a9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:42:12 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 8c4a9724-533e-40c8-ab2a-ce3415af240a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:42:12 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 0597c05a-1049-4117-a8ae-8177d590e024 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:42:12 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 6f3b54ce-4dc1-445a-9108-3f628713e6ec actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:42:12 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance bd76f92b-0181-4291-aee3-9d0ccc095129 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:42:12 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75226) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 17 01:42:12 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75226) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 17 01:42:13 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:42:13 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:42:13 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Compute_service record updated for user:user {{(pid=75226) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 17 01:42:13 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.365s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:42:13 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:42:13 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:42:14 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:42:15 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-c597bd0d-d0b5-41b4-9080-8386e2be950f tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Acquiring lock "8c4a9724-533e-40c8-ab2a-ce3415af240a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:42:15 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-c597bd0d-d0b5-41b4-9080-8386e2be950f tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Lock "8c4a9724-533e-40c8-ab2a-ce3415af240a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:42:15 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-c597bd0d-d0b5-41b4-9080-8386e2be950f tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Acquiring lock "8c4a9724-533e-40c8-ab2a-ce3415af240a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:42:15 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-c597bd0d-d0b5-41b4-9080-8386e2be950f tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Lock "8c4a9724-533e-40c8-ab2a-ce3415af240a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:42:15 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-c597bd0d-d0b5-41b4-9080-8386e2be950f tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Lock "8c4a9724-533e-40c8-ab2a-ce3415af240a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:42:15 user nova-compute[75226]: INFO nova.compute.manager [None req-c597bd0d-d0b5-41b4-9080-8386e2be950f tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] [instance: 8c4a9724-533e-40c8-ab2a-ce3415af240a] Terminating instance
Nov 17 01:42:15 user nova-compute[75226]: DEBUG nova.compute.manager [None req-c597bd0d-d0b5-41b4-9080-8386e2be950f tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] [instance: 8c4a9724-533e-40c8-ab2a-ce3415af240a] Start destroying the instance on the hypervisor. {{(pid=75226) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 17 01:42:15 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:42:15 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:42:15 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:42:15 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:42:15 user nova-compute[75226]: DEBUG nova.compute.manager [req-a13ac753-e58a-4a08-9bef-e48e51bd9c65 req-ab5eb78e-e358-4ec7-95d8-0df6c2fff38c service nova] [instance: 8c4a9724-533e-40c8-ab2a-ce3415af240a] Received event network-vif-unplugged-e30eaa7a-30df-48f5-b8de-30da75d74972 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:42:15 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-a13ac753-e58a-4a08-9bef-e48e51bd9c65 req-ab5eb78e-e358-4ec7-95d8-0df6c2fff38c service nova] Acquiring lock "8c4a9724-533e-40c8-ab2a-ce3415af240a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:42:15 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-a13ac753-e58a-4a08-9bef-e48e51bd9c65 req-ab5eb78e-e358-4ec7-95d8-0df6c2fff38c service nova] Lock "8c4a9724-533e-40c8-ab2a-ce3415af240a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:42:15 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-a13ac753-e58a-4a08-9bef-e48e51bd9c65 req-ab5eb78e-e358-4ec7-95d8-0df6c2fff38c service nova] Lock "8c4a9724-533e-40c8-ab2a-ce3415af240a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:42:15 user nova-compute[75226]: DEBUG nova.compute.manager [req-a13ac753-e58a-4a08-9bef-e48e51bd9c65 req-ab5eb78e-e358-4ec7-95d8-0df6c2fff38c service nova] [instance: 8c4a9724-533e-40c8-ab2a-ce3415af240a] No waiting events found dispatching network-vif-unplugged-e30eaa7a-30df-48f5-b8de-30da75d74972 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:42:15 user nova-compute[75226]: DEBUG nova.compute.manager [req-a13ac753-e58a-4a08-9bef-e48e51bd9c65 req-ab5eb78e-e358-4ec7-95d8-0df6c2fff38c service nova] [instance: 8c4a9724-533e-40c8-ab2a-ce3415af240a] Received event network-vif-unplugged-e30eaa7a-30df-48f5-b8de-30da75d74972 for instance with task_state deleting. {{(pid=75226) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 17 01:42:16 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:42:16 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:42:16 user nova-compute[75226]: INFO nova.virt.libvirt.driver [-] [instance: 8c4a9724-533e-40c8-ab2a-ce3415af240a] Instance destroyed successfully.
Nov 17 01:42:16 user nova-compute[75226]: DEBUG nova.objects.instance [None req-c597bd0d-d0b5-41b4-9080-8386e2be950f tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Lazy-loading 'resources' on Instance uuid 8c4a9724-533e-40c8-ab2a-ce3415af240a {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:42:16 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-c597bd0d-d0b5-41b4-9080-8386e2be950f tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:37:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2008555941',display_name='tempest-TestMinimumBasicScenario-server-2008555941',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2008555941',id=36,image_ref='40bf979b-5f8a-47f7-a942-0f80525fa754',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCdVsOUEJpOAsYDEFoGSrG2wZFHOFgpDHZxULbqhtmsHzngB+dzQ7shkC/vD5WlKGtDNdpdTeECAwcQe2pnhYO1KZ+i4VBBB4HMu36IpgRb7B+gq2o4uWntqgX+CEw8urA==',key_name='tempest-TestMinimumBasicScenario-114436321',keypairs=<?>,launch_index=0,launched_at=2023-11-17T01:37:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='33699aa6c9db4815a1e79aff4685801e',ramdisk_id='',reservation_id='r-7uved0ch',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40bf979b-5f8a-47f7-a942-0f80525fa754',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1224009744',owner_user_name='tempest-TestMinimumBasicScenario-1224009744-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T01:39:38Z,user_data=None,user_id='e7c57c13ff8a48f7b8b206d71e413646',uuid=8c4a9724-533e-40c8-ab2a-ce3415af240a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e30eaa7a-30df-48f5-b8de-30da75d74972", "address": "fa:16:3e:f6:83:b8", "network": {"id": "44f50686-24e7-4e75-8269-4391a53286d0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1611114801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33699aa6c9db4815a1e79aff4685801e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape30eaa7a-30", "ovs_interfaceid": "e30eaa7a-30df-48f5-b8de-30da75d74972", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 17 01:42:16 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-c597bd0d-d0b5-41b4-9080-8386e2be950f tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Converting VIF {"id": "e30eaa7a-30df-48f5-b8de-30da75d74972", "address": "fa:16:3e:f6:83:b8", "network": {"id": "44f50686-24e7-4e75-8269-4391a53286d0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1611114801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33699aa6c9db4815a1e79aff4685801e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape30eaa7a-30", "ovs_interfaceid": "e30eaa7a-30df-48f5-b8de-30da75d74972", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:42:16 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-c597bd0d-d0b5-41b4-9080-8386e2be950f tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f6:83:b8,bridge_name='br-int',has_traffic_filtering=True,id=e30eaa7a-30df-48f5-b8de-30da75d74972,network=Network(44f50686-24e7-4e75-8269-4391a53286d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape30eaa7a-30') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:42:16 user nova-compute[75226]: DEBUG os_vif [None req-c597bd0d-d0b5-41b4-9080-8386e2be950f tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f6:83:b8,bridge_name='br-int',has_traffic_filtering=True,id=e30eaa7a-30df-48f5-b8de-30da75d74972,network=Network(44f50686-24e7-4e75-8269-4391a53286d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape30eaa7a-30') {{(pid=75226) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 17 01:42:16 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:42:16 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape30eaa7a-30, bridge=br-int, if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:42:16 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:42:16 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:42:16 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:42:16 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b4d8a35c-bd58-471d-9789-663ba1f45e60) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:42:16 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:42:16 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:42:16 user nova-compute[75226]: INFO os_vif [None req-c597bd0d-d0b5-41b4-9080-8386e2be950f tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f6:83:b8,bridge_name='br-int',has_traffic_filtering=True,id=e30eaa7a-30df-48f5-b8de-30da75d74972,network=Network(44f50686-24e7-4e75-8269-4391a53286d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape30eaa7a-30')
Nov 17 01:42:16 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-c597bd0d-d0b5-41b4-9080-8386e2be950f tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] [instance: 8c4a9724-533e-40c8-ab2a-ce3415af240a] Deleting instance files /opt/stack/data/nova/instances/8c4a9724-533e-40c8-ab2a-ce3415af240a_del
Nov 17 01:42:16 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-c597bd0d-d0b5-41b4-9080-8386e2be950f tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] [instance: 8c4a9724-533e-40c8-ab2a-ce3415af240a] Deletion of /opt/stack/data/nova/instances/8c4a9724-533e-40c8-ab2a-ce3415af240a_del complete
Nov 17 01:42:16 user nova-compute[75226]: INFO nova.compute.manager [None req-c597bd0d-d0b5-41b4-9080-8386e2be950f tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] [instance: 8c4a9724-533e-40c8-ab2a-ce3415af240a] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 17 01:42:16 user nova-compute[75226]: DEBUG oslo.service.loopingcall [None req-c597bd0d-d0b5-41b4-9080-8386e2be950f tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75226) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 17 01:42:16 user nova-compute[75226]: DEBUG nova.compute.manager [-] [instance: 8c4a9724-533e-40c8-ab2a-ce3415af240a] Deallocating network for instance {{(pid=75226) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 17 01:42:16 user nova-compute[75226]: DEBUG nova.network.neutron [-] [instance: 8c4a9724-533e-40c8-ab2a-ce3415af240a] deallocate_for_instance() {{(pid=75226) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 17 01:42:16 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:42:16 user nova-compute[75226]: DEBUG nova.network.neutron [-] [instance: 8c4a9724-533e-40c8-ab2a-ce3415af240a] Updating instance_info_cache with network_info: [] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:42:16 user nova-compute[75226]: DEBUG nova.compute.manager [req-7f583655-85a1-498f-85b1-229d6a7bdefc req-602e436e-2df5-4fa5-aff4-966610120768 service nova] [instance: 8c4a9724-533e-40c8-ab2a-ce3415af240a] Received event network-vif-deleted-e30eaa7a-30df-48f5-b8de-30da75d74972 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:42:16 user nova-compute[75226]: INFO nova.compute.manager [req-7f583655-85a1-498f-85b1-229d6a7bdefc req-602e436e-2df5-4fa5-aff4-966610120768 service nova] [instance: 8c4a9724-533e-40c8-ab2a-ce3415af240a] Neutron deleted interface e30eaa7a-30df-48f5-b8de-30da75d74972; detaching it from the instance and deleting it from the info cache
Nov 17 01:42:16 user nova-compute[75226]: DEBUG nova.network.neutron [req-7f583655-85a1-498f-85b1-229d6a7bdefc req-602e436e-2df5-4fa5-aff4-966610120768 service nova] [instance: 8c4a9724-533e-40c8-ab2a-ce3415af240a] Updating instance_info_cache with network_info: [] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:42:16 user nova-compute[75226]: INFO nova.compute.manager [-] [instance: 8c4a9724-533e-40c8-ab2a-ce3415af240a] Took 0.64 seconds to deallocate network for instance.
Nov 17 01:42:16 user nova-compute[75226]: DEBUG nova.compute.manager [req-7f583655-85a1-498f-85b1-229d6a7bdefc req-602e436e-2df5-4fa5-aff4-966610120768 service nova] [instance: 8c4a9724-533e-40c8-ab2a-ce3415af240a] Detach interface failed, port_id=e30eaa7a-30df-48f5-b8de-30da75d74972, reason: Instance 8c4a9724-533e-40c8-ab2a-ce3415af240a could not be found. {{(pid=75226) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 17 01:42:16 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-c597bd0d-d0b5-41b4-9080-8386e2be950f tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:42:16 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-c597bd0d-d0b5-41b4-9080-8386e2be950f tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:42:17 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-42e8cb95-645e-4509-bc81-fe83d33278f4 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Acquiring lock "9c009cf0-99b6-4dc9-931e-b79ef4e2fc3a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:42:17 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-42e8cb95-645e-4509-bc81-fe83d33278f4 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Lock "9c009cf0-99b6-4dc9-931e-b79ef4e2fc3a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:42:17 user nova-compute[75226]: DEBUG nova.compute.manager [None req-42e8cb95-645e-4509-bc81-fe83d33278f4 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: 9c009cf0-99b6-4dc9-931e-b79ef4e2fc3a] Starting instance... {{(pid=75226) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 17 01:42:17 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:42:17 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:42:17 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-c597bd0d-d0b5-41b4-9080-8386e2be950f tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:42:17 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-42e8cb95-645e-4509-bc81-fe83d33278f4 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:42:17 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-c597bd0d-d0b5-41b4-9080-8386e2be950f tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:42:17 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-c597bd0d-d0b5-41b4-9080-8386e2be950f tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.257s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:42:17 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-42e8cb95-645e-4509-bc81-fe83d33278f4 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.071s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:42:17 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-42e8cb95-645e-4509-bc81-fe83d33278f4 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75226) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 17 01:42:17 user nova-compute[75226]: INFO nova.compute.claims [None req-42e8cb95-645e-4509-bc81-fe83d33278f4 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: 9c009cf0-99b6-4dc9-931e-b79ef4e2fc3a] Claim successful on node user
Nov 17 01:42:17 user nova-compute[75226]: INFO nova.scheduler.client.report [None req-c597bd0d-d0b5-41b4-9080-8386e2be950f tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Deleted allocations for instance 8c4a9724-533e-40c8-ab2a-ce3415af240a
Nov 17 01:42:17 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-c597bd0d-d0b5-41b4-9080-8386e2be950f tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Lock "8c4a9724-533e-40c8-ab2a-ce3415af240a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.009s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:42:17 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-42e8cb95-645e-4509-bc81-fe83d33278f4 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:42:17 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-42e8cb95-645e-4509-bc81-fe83d33278f4 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:42:17 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-42e8cb95-645e-4509-bc81-fe83d33278f4 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.313s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:42:17 user nova-compute[75226]: DEBUG nova.compute.manager [None req-42e8cb95-645e-4509-bc81-fe83d33278f4 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: 9c009cf0-99b6-4dc9-931e-b79ef4e2fc3a] Start building networks asynchronously for instance. {{(pid=75226) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 17 01:42:17 user nova-compute[75226]: DEBUG nova.compute.manager [None req-42e8cb95-645e-4509-bc81-fe83d33278f4 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: 9c009cf0-99b6-4dc9-931e-b79ef4e2fc3a] Allocating IP information in the background. {{(pid=75226) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 17 01:42:17 user nova-compute[75226]: DEBUG nova.network.neutron [None req-42e8cb95-645e-4509-bc81-fe83d33278f4 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: 9c009cf0-99b6-4dc9-931e-b79ef4e2fc3a] allocate_for_instance() {{(pid=75226) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 17 01:42:17 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-42e8cb95-645e-4509-bc81-fe83d33278f4 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: 9c009cf0-99b6-4dc9-931e-b79ef4e2fc3a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 17 01:42:17 user nova-compute[75226]: DEBUG nova.compute.manager [None req-42e8cb95-645e-4509-bc81-fe83d33278f4 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: 9c009cf0-99b6-4dc9-931e-b79ef4e2fc3a] Start building block device mappings for instance. {{(pid=75226) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 17 01:42:17 user nova-compute[75226]: DEBUG nova.compute.manager [req-c901af7f-e6c0-4b75-befd-313c47a06476 req-05ed29a9-9f62-47a7-a7f1-af6bc43b35f4 service nova] [instance: 8c4a9724-533e-40c8-ab2a-ce3415af240a] Received event network-vif-plugged-e30eaa7a-30df-48f5-b8de-30da75d74972 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:42:17 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-c901af7f-e6c0-4b75-befd-313c47a06476 req-05ed29a9-9f62-47a7-a7f1-af6bc43b35f4 service nova] Acquiring lock "8c4a9724-533e-40c8-ab2a-ce3415af240a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:42:17 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-c901af7f-e6c0-4b75-befd-313c47a06476 req-05ed29a9-9f62-47a7-a7f1-af6bc43b35f4 service nova] Lock "8c4a9724-533e-40c8-ab2a-ce3415af240a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:42:17 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-c901af7f-e6c0-4b75-befd-313c47a06476 req-05ed29a9-9f62-47a7-a7f1-af6bc43b35f4 service nova] Lock "8c4a9724-533e-40c8-ab2a-ce3415af240a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:42:17 user nova-compute[75226]: DEBUG nova.compute.manager [req-c901af7f-e6c0-4b75-befd-313c47a06476 req-05ed29a9-9f62-47a7-a7f1-af6bc43b35f4 service nova] [instance: 8c4a9724-533e-40c8-ab2a-ce3415af240a] No waiting events found dispatching network-vif-plugged-e30eaa7a-30df-48f5-b8de-30da75d74972 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:42:17 user nova-compute[75226]: WARNING nova.compute.manager [req-c901af7f-e6c0-4b75-befd-313c47a06476 req-05ed29a9-9f62-47a7-a7f1-af6bc43b35f4 service nova] [instance: 8c4a9724-533e-40c8-ab2a-ce3415af240a] Received unexpected event network-vif-plugged-e30eaa7a-30df-48f5-b8de-30da75d74972 for instance with vm_state deleted and task_state None.
Nov 17 01:42:17 user nova-compute[75226]: INFO nova.virt.block_device [None req-42e8cb95-645e-4509-bc81-fe83d33278f4 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: 9c009cf0-99b6-4dc9-931e-b79ef4e2fc3a] Booting with volume snapshot 7f2bc43c-fee5-4b5c-b255-c8a4d8b137bc at /dev/vda
Nov 17 01:42:17 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:42:18 user nova-compute[75226]: DEBUG nova.policy [None req-42e8cb95-645e-4509-bc81-fe83d33278f4 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7c8c8baa56884dcd9a90f0187c9fc06f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673620a69fba4a04af75baabe775dc8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75226) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 17 01:42:18 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:42:18 user nova-compute[75226]: DEBUG nova.network.neutron [None req-42e8cb95-645e-4509-bc81-fe83d33278f4 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: 9c009cf0-99b6-4dc9-931e-b79ef4e2fc3a] Successfully created port: fda4b1a7-6558-4658-ac36-502ac3f0ad6d {{(pid=75226) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 17 01:42:19 user nova-compute[75226]: DEBUG nova.network.neutron [None req-42e8cb95-645e-4509-bc81-fe83d33278f4 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: 9c009cf0-99b6-4dc9-931e-b79ef4e2fc3a] Successfully updated port: fda4b1a7-6558-4658-ac36-502ac3f0ad6d {{(pid=75226) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 17 01:42:19 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-42e8cb95-645e-4509-bc81-fe83d33278f4 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Acquiring lock "refresh_cache-9c009cf0-99b6-4dc9-931e-b79ef4e2fc3a" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:42:19 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-42e8cb95-645e-4509-bc81-fe83d33278f4 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Acquired lock "refresh_cache-9c009cf0-99b6-4dc9-931e-b79ef4e2fc3a" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:42:19 user nova-compute[75226]: DEBUG nova.network.neutron [None req-42e8cb95-645e-4509-bc81-fe83d33278f4 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: 9c009cf0-99b6-4dc9-931e-b79ef4e2fc3a] Building network info cache for instance {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 01:42:19 user nova-compute[75226]: DEBUG nova.compute.manager [req-60ab08c2-e23a-4dc4-984a-2343f061e3ef req-b1bcca70-2685-41dd-84d0-44a295e11b1c service nova] [instance: 9c009cf0-99b6-4dc9-931e-b79ef4e2fc3a] Received event network-changed-fda4b1a7-6558-4658-ac36-502ac3f0ad6d {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:42:19 user nova-compute[75226]: DEBUG nova.compute.manager [req-60ab08c2-e23a-4dc4-984a-2343f061e3ef req-b1bcca70-2685-41dd-84d0-44a295e11b1c service nova] [instance: 9c009cf0-99b6-4dc9-931e-b79ef4e2fc3a] Refreshing instance network info cache due to event network-changed-fda4b1a7-6558-4658-ac36-502ac3f0ad6d. {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 01:42:19 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-60ab08c2-e23a-4dc4-984a-2343f061e3ef req-b1bcca70-2685-41dd-84d0-44a295e11b1c service nova] Acquiring lock "refresh_cache-9c009cf0-99b6-4dc9-931e-b79ef4e2fc3a" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:42:19 user nova-compute[75226]: DEBUG nova.network.neutron [None req-42e8cb95-645e-4509-bc81-fe83d33278f4 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: 9c009cf0-99b6-4dc9-931e-b79ef4e2fc3a] Instance cache missing network info. {{(pid=75226) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 17 01:42:19 user nova-compute[75226]: DEBUG nova.network.neutron [None req-42e8cb95-645e-4509-bc81-fe83d33278f4 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: 9c009cf0-99b6-4dc9-931e-b79ef4e2fc3a] Updating instance_info_cache with network_info: [{"id": "fda4b1a7-6558-4658-ac36-502ac3f0ad6d", "address": "fa:16:3e:f3:ff:e0", "network": {"id": "81bbbdad-218b-4fcd-b7f5-427fd49361cb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1151874504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "673620a69fba4a04af75baabe775dc8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfda4b1a7-65", "ovs_interfaceid": "fda4b1a7-6558-4658-ac36-502ac3f0ad6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:42:19 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-42e8cb95-645e-4509-bc81-fe83d33278f4 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Releasing lock "refresh_cache-9c009cf0-99b6-4dc9-931e-b79ef4e2fc3a" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:42:19 user nova-compute[75226]: DEBUG nova.compute.manager [None req-42e8cb95-645e-4509-bc81-fe83d33278f4 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: 9c009cf0-99b6-4dc9-931e-b79ef4e2fc3a] Instance network_info: |[{"id": "fda4b1a7-6558-4658-ac36-502ac3f0ad6d", "address": "fa:16:3e:f3:ff:e0", "network": {"id": "81bbbdad-218b-4fcd-b7f5-427fd49361cb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1151874504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "673620a69fba4a04af75baabe775dc8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfda4b1a7-65", "ovs_interfaceid": "fda4b1a7-6558-4658-ac36-502ac3f0ad6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75226) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 17 01:42:19 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-60ab08c2-e23a-4dc4-984a-2343f061e3ef req-b1bcca70-2685-41dd-84d0-44a295e11b1c service nova] Acquired lock "refresh_cache-9c009cf0-99b6-4dc9-931e-b79ef4e2fc3a" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:42:19 user nova-compute[75226]: DEBUG nova.network.neutron [req-60ab08c2-e23a-4dc4-984a-2343f061e3ef req-b1bcca70-2685-41dd-84d0-44a295e11b1c service nova] [instance: 9c009cf0-99b6-4dc9-931e-b79ef4e2fc3a] Refreshing network info cache for port fda4b1a7-6558-4658-ac36-502ac3f0ad6d {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 01:42:19 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:42:20 user nova-compute[75226]: DEBUG nova.network.neutron [req-60ab08c2-e23a-4dc4-984a-2343f061e3ef req-b1bcca70-2685-41dd-84d0-44a295e11b1c service nova] [instance: 9c009cf0-99b6-4dc9-931e-b79ef4e2fc3a] Updated VIF entry in instance network info cache for port fda4b1a7-6558-4658-ac36-502ac3f0ad6d. {{(pid=75226) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 01:42:20 user nova-compute[75226]: DEBUG nova.network.neutron [req-60ab08c2-e23a-4dc4-984a-2343f061e3ef req-b1bcca70-2685-41dd-84d0-44a295e11b1c service nova] [instance: 9c009cf0-99b6-4dc9-931e-b79ef4e2fc3a] Updating instance_info_cache with network_info: [{"id": "fda4b1a7-6558-4658-ac36-502ac3f0ad6d", "address": "fa:16:3e:f3:ff:e0", "network": {"id": "81bbbdad-218b-4fcd-b7f5-427fd49361cb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1151874504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "673620a69fba4a04af75baabe775dc8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfda4b1a7-65", "ovs_interfaceid": "fda4b1a7-6558-4658-ac36-502ac3f0ad6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:42:20 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-60ab08c2-e23a-4dc4-984a-2343f061e3ef req-b1bcca70-2685-41dd-84d0-44a295e11b1c service nova] Releasing lock "refresh_cache-9c009cf0-99b6-4dc9-931e-b79ef4e2fc3a" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:42:20 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:42:21 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:42:21 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:42:21 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Starting heal instance info cache {{(pid=75226) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 17 01:42:22 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "refresh_cache-0597c05a-1049-4117-a8ae-8177d590e024" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:42:22 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquired lock "refresh_cache-0597c05a-1049-4117-a8ae-8177d590e024" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:42:22 user nova-compute[75226]: DEBUG nova.network.neutron [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] [instance: 0597c05a-1049-4117-a8ae-8177d590e024] Forcefully refreshing network info cache for instance {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 17 01:42:22 user nova-compute[75226]: DEBUG nova.network.neutron [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] [instance: 0597c05a-1049-4117-a8ae-8177d590e024] Updating instance_info_cache with network_info: [{"id": "e8a7ded4-d849-40ce-a0a9-ecf66e146e56", "address": "fa:16:3e:6d:db:0b", "network": {"id": "b6c26fa5-eacc-41d3-b790-795e59c84966", "bridge": "br-int", "label": "tempest-TestStampPattern-2002555642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8046d4519e4b4f0b864f9ea10a4886fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8a7ded4-d8", "ovs_interfaceid": "e8a7ded4-d849-40ce-a0a9-ecf66e146e56", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:42:22 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Releasing lock "refresh_cache-0597c05a-1049-4117-a8ae-8177d590e024" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:42:22 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] [instance: 0597c05a-1049-4117-a8ae-8177d590e024] Updated the network info_cache for instance {{(pid=75226) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 17 01:42:22 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:42:23 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:42:23 user nova-compute[75226]: DEBUG os_brick.utils [None req-42e8cb95-645e-4509-bc81-fe83d33278f4 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:42:23 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:42:23 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:42:23 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3bd253d-0500-4b53-9d01-7f0ce9da154a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f62857db69\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:42:23 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:42:23 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:42:23 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[14c4f7d4-8614-4c49-b127-06a0a64de5d9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:42:23 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:42:23 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:42:23 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[082e5fec-5b2f-41c4-acbf-9ee5d0cbec0d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:42:23 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ce9e5fe-b9d6-41e8-a07c-955e8c2ad8b1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:42:23 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-42e8cb95-645e-4509-bc81-fe83d33278f4 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Running cmd (subprocess): nvme version {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:42:23 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-42e8cb95-645e-4509-bc81-fe83d33278f4 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] 'nvme version' failed. Not Retrying. {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 01:42:23 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.nvmeof [None req-42e8cb95-645e-4509-bc81-fe83d33278f4 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] nvme not present on system {{(pid=75226) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 17 01:42:23 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:42:23 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 01:42:23 user nova-compute[75226]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 17 01:42:23 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaa30999-b4e5-463f-8c5d-0dbb09983a5e]: (4, '') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:42:23 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-42e8cb95-645e-4509-bc81-fe83d33278f4 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75226) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 17 01:42:23 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-42e8cb95-645e-4509-bc81-fe83d33278f4 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75226) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 17 01:42:23 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-42e8cb95-645e-4509-bc81-fe83d33278f4 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] LIGHTOS: no hostnqn found. {{(pid=75226) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 17 01:42:23 user nova-compute[75226]: DEBUG os_brick.utils [None req-42e8cb95-645e-4509-bc81-fe83d33278f4 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f62857db69', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:42:23 user nova-compute[75226]: DEBUG nova.virt.block_device [None req-42e8cb95-645e-4509-bc81-fe83d33278f4 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: 9c009cf0-99b6-4dc9-931e-b79ef4e2fc3a] Updating existing volume attachment record: 1d72c5b9-2018-448e-ba59-8c51ff1afe85 {{(pid=75226) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 17 01:42:26 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:42:26 user nova-compute[75226]: DEBUG nova.compute.manager [req-eb4559ac-3d89-47e1-b834-04a2a3e0dadf req-e7ee4ba2-0b1a-45c7-a39a-e53b2928a7bc service nova] [instance: 6f3b54ce-4dc1-445a-9108-3f628713e6ec] Received event network-changed-eacf2a0d-87c7-49a0-bc53-5412b6c4a19c {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:42:26 user nova-compute[75226]: DEBUG nova.compute.manager [req-eb4559ac-3d89-47e1-b834-04a2a3e0dadf req-e7ee4ba2-0b1a-45c7-a39a-e53b2928a7bc service nova] [instance: 6f3b54ce-4dc1-445a-9108-3f628713e6ec] Refreshing instance network info cache due to event network-changed-eacf2a0d-87c7-49a0-bc53-5412b6c4a19c. {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 01:42:26 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-eb4559ac-3d89-47e1-b834-04a2a3e0dadf req-e7ee4ba2-0b1a-45c7-a39a-e53b2928a7bc service nova] Acquiring lock "refresh_cache-6f3b54ce-4dc1-445a-9108-3f628713e6ec" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:42:26 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-eb4559ac-3d89-47e1-b834-04a2a3e0dadf req-e7ee4ba2-0b1a-45c7-a39a-e53b2928a7bc service nova] Acquired lock "refresh_cache-6f3b54ce-4dc1-445a-9108-3f628713e6ec" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:42:26 user nova-compute[75226]: DEBUG nova.network.neutron [req-eb4559ac-3d89-47e1-b834-04a2a3e0dadf req-e7ee4ba2-0b1a-45c7-a39a-e53b2928a7bc service nova] [instance: 6f3b54ce-4dc1-445a-9108-3f628713e6ec] Refreshing network info cache for port eacf2a0d-87c7-49a0-bc53-5412b6c4a19c {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 01:42:26 user nova-compute[75226]: DEBUG nova.network.neutron [req-eb4559ac-3d89-47e1-b834-04a2a3e0dadf req-e7ee4ba2-0b1a-45c7-a39a-e53b2928a7bc service nova] [instance: 6f3b54ce-4dc1-445a-9108-3f628713e6ec] Updated VIF entry in instance network info cache for port eacf2a0d-87c7-49a0-bc53-5412b6c4a19c. {{(pid=75226) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 01:42:26 user nova-compute[75226]: DEBUG nova.network.neutron [req-eb4559ac-3d89-47e1-b834-04a2a3e0dadf req-e7ee4ba2-0b1a-45c7-a39a-e53b2928a7bc service nova] [instance: 6f3b54ce-4dc1-445a-9108-3f628713e6ec] Updating instance_info_cache with network_info: [{"id": "eacf2a0d-87c7-49a0-bc53-5412b6c4a19c", "address": "fa:16:3e:8a:af:7c", "network": {"id": "b6c26fa5-eacc-41d3-b790-795e59c84966", "bridge": "br-int", "label": "tempest-TestStampPattern-2002555642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8046d4519e4b4f0b864f9ea10a4886fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeacf2a0d-87", "ovs_interfaceid": "eacf2a0d-87c7-49a0-bc53-5412b6c4a19c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:42:26 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-eb4559ac-3d89-47e1-b834-04a2a3e0dadf req-e7ee4ba2-0b1a-45c7-a39a-e53b2928a7bc service nova] Releasing lock "refresh_cache-6f3b54ce-4dc1-445a-9108-3f628713e6ec" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:42:26 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:42:26 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75226) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 17 01:42:27 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-d3672cdc-f598-40a7-acc9-ed4c8015bdf6 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Acquiring lock "6f3b54ce-4dc1-445a-9108-3f628713e6ec" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:42:27 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-d3672cdc-f598-40a7-acc9-ed4c8015bdf6 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Lock "6f3b54ce-4dc1-445a-9108-3f628713e6ec" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:42:28 user nova-compute[75226]: DEBUG nova.objects.instance [None req-d3672cdc-f598-40a7-acc9-ed4c8015bdf6 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Lazy-loading 'flavor' on Instance uuid 6f3b54ce-4dc1-445a-9108-3f628713e6ec {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:42:28 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-d3672cdc-f598-40a7-acc9-ed4c8015bdf6 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Lock "6f3b54ce-4dc1-445a-9108-3f628713e6ec" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:42:28 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-d3672cdc-f598-40a7-acc9-ed4c8015bdf6 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Acquiring lock "6f3b54ce-4dc1-445a-9108-3f628713e6ec" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:42:28 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-d3672cdc-f598-40a7-acc9-ed4c8015bdf6 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Lock "6f3b54ce-4dc1-445a-9108-3f628713e6ec" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:42:28 user nova-compute[75226]: INFO nova.compute.manager [None req-d3672cdc-f598-40a7-acc9-ed4c8015bdf6 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] [instance: 6f3b54ce-4dc1-445a-9108-3f628713e6ec] Attaching volume 8ce6c4b7-0c02-41b0-8243-b884beb9ca50 to /dev/vdb
Nov 17 01:42:28 user nova-compute[75226]: DEBUG os_brick.utils [None req-d3672cdc-f598-40a7-acc9-ed4c8015bdf6 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:42:28 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:42:28 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:42:28 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecd09415-18f8-48f3-b007-a2a22fda3914]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f62857db69\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:42:28 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:42:28 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:42:28 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[75ec85be-0d8e-40ac-bcde-c4e6df087082]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:42:28 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:42:28 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:42:28 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2b6a3d4-9194-4720-8bc3-29ca4afa7b5e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:42:28 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f83e7f7-2b1c-45a8-8080-15fb4e7adf1a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:42:28 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-d3672cdc-f598-40a7-acc9-ed4c8015bdf6 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Running cmd (subprocess): nvme version {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:42:28 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-d3672cdc-f598-40a7-acc9-ed4c8015bdf6 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] 'nvme version' failed. Not Retrying. {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 01:42:28 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d3672cdc-f598-40a7-acc9-ed4c8015bdf6 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] nvme not present on system {{(pid=75226) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 17 01:42:28 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:42:28 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 01:42:28 user nova-compute[75226]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 17 01:42:28 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[208bab25-7de1-497f-ad87-59fbd8a1e00d]: (4, '') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:42:28 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-d3672cdc-f598-40a7-acc9-ed4c8015bdf6 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75226) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 17 01:42:28 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-d3672cdc-f598-40a7-acc9-ed4c8015bdf6 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75226) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 17 01:42:28 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-d3672cdc-f598-40a7-acc9-ed4c8015bdf6 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] LIGHTOS: no hostnqn found. {{(pid=75226) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 17 01:42:28 user nova-compute[75226]: DEBUG os_brick.utils [None req-d3672cdc-f598-40a7-acc9-ed4c8015bdf6 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f62857db69', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:42:28 user nova-compute[75226]: DEBUG nova.virt.block_device [None req-d3672cdc-f598-40a7-acc9-ed4c8015bdf6 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] [instance: 6f3b54ce-4dc1-445a-9108-3f628713e6ec] Updating existing volume attachment record: 78535372-0977-41c6-9235-8544f5363400 {{(pid=75226) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 17 01:42:28 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:42:29 user nova-compute[75226]: DEBUG nova.compute.manager [None req-42e8cb95-645e-4509-bc81-fe83d33278f4 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: 9c009cf0-99b6-4dc9-931e-b79ef4e2fc3a] Start spawning the instance on the hypervisor. {{(pid=75226) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 17 01:42:29 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-42e8cb95-645e-4509-bc81-fe83d33278f4 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: 9c009cf0-99b6-4dc9-931e-b79ef4e2fc3a] Creating instance directory {{(pid=75226) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 17 01:42:29 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-42e8cb95-645e-4509-bc81-fe83d33278f4 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: 9c009cf0-99b6-4dc9-931e-b79ef4e2fc3a] Creating image(s)
Nov 17 01:42:29 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-42e8cb95-645e-4509-bc81-fe83d33278f4 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: 9c009cf0-99b6-4dc9-931e-b79ef4e2fc3a] Did not create local disks {{(pid=75226) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 17 01:42:29 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-42e8cb95-645e-4509-bc81-fe83d33278f4 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: 9c009cf0-99b6-4dc9-931e-b79ef4e2fc3a] Ensure instance console log exists: /opt/stack/data/nova/instances/9c009cf0-99b6-4dc9-931e-b79ef4e2fc3a/console.log {{(pid=75226) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 17 01:42:29 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-42e8cb95-645e-4509-bc81-fe83d33278f4 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:42:29 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-42e8cb95-645e-4509-bc81-fe83d33278f4 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:42:29 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-42e8cb95-645e-4509-bc81-fe83d33278f4 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:42:29 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-42e8cb95-645e-4509-bc81-fe83d33278f4 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: 9c009cf0-99b6-4dc9-931e-b79ef4e2fc3a] Start _get_guest_xml network_info=[{"id": "fda4b1a7-6558-4658-ac36-502ac3f0ad6d", "address": "fa:16:3e:f3:ff:e0", "network": {"id": "81bbbdad-218b-4fcd-b7f5-427fd49361cb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1151874504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "673620a69fba4a04af75baabe775dc8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfda4b1a7-65", "ovs_interfaceid": "fda4b1a7-6558-4658-ac36-502ac3f0ad6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3c8e2d11-ac6f-4568-b99e-9ad41a24e1bb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XEHmaLpw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9c009cf0-99b6-4dc9-931e-b79ef4e2fc3a', 'attached_at': '', 'detached_at': '', 'volume_id': '3c8e2d11-ac6f-4568-b99e-9ad41a24e1bb', 'serial': '3c8e2d11-ac6f-4568-b99e-9ad41a24e1bb'}, 'attachment_id': '1d72c5b9-2018-448e-ba59-8c51ff1afe85', 'device_type': 'disk', 'volume_type': None} {{(pid=75226) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 17 01:42:29 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-42e8cb95-645e-4509-bc81-fe83d33278f4 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:42:29 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-42e8cb95-645e-4509-bc81-fe83d33278f4 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:42:29 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-42e8cb95-645e-4509-bc81-fe83d33278f4 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75226) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 17 01:42:29 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-42e8cb95-645e-4509-bc81-fe83d33278f4 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] CPU controller missing on host. {{(pid=75226) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 17 01:42:29 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-42e8cb95-645e-4509-bc81-fe83d33278f4 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75226) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 17 01:42:29 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-42e8cb95-645e-4509-bc81-fe83d33278f4 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] CPU controller found on host. {{(pid=75226) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 17 01:42:29 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-42e8cb95-645e-4509-bc81-fe83d33278f4 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75226) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 17 01:42:29 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-42e8cb95-645e-4509-bc81-fe83d33278f4 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-17T01:13:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 17 01:42:29 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-42e8cb95-645e-4509-bc81-fe83d33278f4 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Flavor limits 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 17 01:42:29 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-42e8cb95-645e-4509-bc81-fe83d33278f4 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Image limits 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 17 01:42:29 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-42e8cb95-645e-4509-bc81-fe83d33278f4 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Flavor pref 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 17 01:42:29 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-42e8cb95-645e-4509-bc81-fe83d33278f4 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Image pref 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 17 01:42:29 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-42e8cb95-645e-4509-bc81-fe83d33278f4 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 17 01:42:29 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-42e8cb95-645e-4509-bc81-fe83d33278f4 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 17 01:42:29 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-42e8cb95-645e-4509-bc81-fe83d33278f4 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75226) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 17 01:42:29 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-42e8cb95-645e-4509-bc81-fe83d33278f4 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Got 1 possible topologies {{(pid=75226) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 17 01:42:29 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-42e8cb95-645e-4509-bc81-fe83d33278f4 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 17 01:42:29 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-42e8cb95-645e-4509-bc81-fe83d33278f4 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 17 01:42:29 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-42e8cb95-645e-4509-bc81-fe83d33278f4 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: 9c009cf0-99b6-4dc9-931e-b79ef4e2fc3a] Calling os-brick to attach iSCSI Volume {{(pid=75226) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 17 01:42:29 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-42e8cb95-645e-4509-bc81-fe83d33278f4 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc4cc36b490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3c8e2d11-ac6f-4568-b99e-9ad41a24e1bb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XEHmaLpw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:42:29 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-42e8cb95-645e-4509-bc81-fe83d33278f4 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:42:29 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-42e8cb95-645e-4509-bc81-fe83d33278f4 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:42:29 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-42e8cb95-645e-4509-bc81-fe83d33278f4 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:42:29 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-42e8cb95-645e-4509-bc81-fe83d33278f4 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:42:29 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-42e8cb95-645e-4509-bc81-fe83d33278f4 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3c8e2d11-ac6f-4568-b99e-9ad41a24e1bb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:42:29 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-42e8cb95-645e-4509-bc81-fe83d33278f4 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3c8e2d11-ac6f-4568-b99e-9ad41a24e1bb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:42:29 user nova-compute[75226]: INFO os_brick.initiator.connectors.iscsi [None req-42e8cb95-645e-4509-bc81-fe83d33278f4 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 17 01:42:29 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c8e2d11-ac6f-4568-b99e-9ad41a24e1bb -p 172.16.0.220:3260 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:42:29 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c8e2d11-ac6f-4568-b99e-9ad41a24e1bb -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:42:29 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[c77cfb94-2863-4bb8-bb54-47fb2bd902d8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:42:29 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-42e8cb95-645e-4509-bc81-fe83d33278f4 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 17 01:42:29 user nova-compute[75226]:  {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:42:29 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c8e2d11-ac6f-4568-b99e-9ad41a24e1bb -p 172.16.0.220:3260 --interface default --op new {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:42:29 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c8e2d11-ac6f-4568-b99e-9ad41a24e1bb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:42:29 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[627e5d26-6673-4e0a-9533-62539fe9b0ce]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3c8e2d11-ac6f-4568-b99e-9ad41a24e1bb] added\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:42:29 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-42e8cb95-645e-4509-bc81-fe83d33278f4 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3c8e2d11-ac6f-4568-b99e-9ad41a24e1bb] added
Nov 17 01:42:29 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:42:29 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c8e2d11-ac6f-4568-b99e-9ad41a24e1bb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:42:29 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c8e2d11-ac6f-4568-b99e-9ad41a24e1bb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:42:29 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcb3dae6-0a20-4781-a2e6-cb6bc5715fbf]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:42:29 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-42e8cb95-645e-4509-bc81-fe83d33278f4 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:42:29 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c8e2d11-ac6f-4568-b99e-9ad41a24e1bb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:42:29 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c8e2d11-ac6f-4568-b99e-9ad41a24e1bb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:42:29 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b66a53c-ff69-4abd-a3d7-6f79d1f31a09]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:42:29 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-42e8cb95-645e-4509-bc81-fe83d33278f4 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:42:29 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c8e2d11-ac6f-4568-b99e-9ad41a24e1bb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XEHmaLpw {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:42:29 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c8e2d11-ac6f-4568-b99e-9ad41a24e1bb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XEHmaLpw" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:42:29 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9e4b011-9f1b-4fa4-bd1d-04b382a98bf3]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:42:29 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-42e8cb95-645e-4509-bc81-fe83d33278f4 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XEHmaLpw'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:42:29 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c8e2d11-ac6f-4568-b99e-9ad41a24e1bb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:42:29 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c8e2d11-ac6f-4568-b99e-9ad41a24e1bb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:42:29 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[b788a854-5aaa-4524-9ecc-f0eb5ace538f]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:42:29 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-42e8cb95-645e-4509-bc81-fe83d33278f4 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:42:29 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:42:29 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:42:29 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[4df510e9-88a6-43cc-a3fd-6542de3134db]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:42:29 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-42e8cb95-645e-4509-bc81-fe83d33278f4 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 17 01:42:29 user nova-compute[75226]:  {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:42:29 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-42e8cb95-645e-4509-bc81-fe83d33278f4 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 17 01:42:29 user nova-compute[75226]:  {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:42:29 user nova-compute[75226]: WARNING os_brick.initiator.connectors.iscsi [None req-42e8cb95-645e-4509-bc81-fe83d33278f4 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 17 01:42:29 user nova-compute[75226]: 
Nov 17 01:42:29 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c8e2d11-ac6f-4568-b99e-9ad41a24e1bb -p 172.16.0.220:3260 --login {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:42:29 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c8e2d11-ac6f-4568-b99e-9ad41a24e1bb -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:42:29 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[77525cb5-dc7c-40e4-a5db-fe69e9dd909e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3c8e2d11-ac6f-4568-b99e-9ad41a24e1bb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3c8e2d11-ac6f-4568-b99e-9ad41a24e1bb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:42:29 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-42e8cb95-645e-4509-bc81-fe83d33278f4 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3c8e2d11-ac6f-4568-b99e-9ad41a24e1bb, portal: 172.16.0.220,3260]
Nov 17 01:42:29 user nova-compute[75226]: Login to [iface: default, target: iqn.2010-10.org.openstack:3c8e2d11-ac6f-4568-b99e-9ad41a24e1bb, portal: 172.16.0.220,3260] successful.
Nov 17 01:42:29 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:42:29 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c8e2d11-ac6f-4568-b99e-9ad41a24e1bb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:42:29 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c8e2d11-ac6f-4568-b99e-9ad41a24e1bb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:42:29 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[909bf561-acfb-4a18-9e14-73bc1c0ccd57]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:42:29 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-42e8cb95-645e-4509-bc81-fe83d33278f4 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:42:29 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:42:29 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:42:29 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[32643978-58f5-4fdc-a660-1c39b9ca6efb]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c8e2d11-ac6f-4568-b99e-9ad41a24e1bb (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:42:29 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-42e8cb95-645e-4509-bc81-fe83d33278f4 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c8e2d11-ac6f-4568-b99e-9ad41a24e1bb (non-flash)
Nov 17 01:42:29 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:42:29 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-42e8cb95-645e-4509-bc81-fe83d33278f4 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c8e2d11-ac6f-4568-b99e-9ad41a24e1bb (non-flash)
Nov 17 01:42:29 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:42:29 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-42e8cb95-645e-4509-bc81-fe83d33278f4 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3c8e2d11-ac6f-4568-b99e-9ad41a24e1bb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.251s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:42:29 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-42e8cb95-645e-4509-bc81-fe83d33278f4 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Connected to 172.16.0.220:3260 {{(pid=75226) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 17 01:42:29 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-42e8cb95-645e-4509-bc81-fe83d33278f4 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] HCTL ('33', '-', '-', 0) found on session 49 with lun 0 {{(pid=75226) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 17 01:42:29 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-42e8cb95-645e-4509-bc81-fe83d33278f4 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75226) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 17 01:42:29 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:42:29 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:42:29 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaaa4b21-df80-401d-8e23-7de01ac7576e]: (4, ('- - 0', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:42:29 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-42e8cb95-645e-4509-bc81-fe83d33278f4 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Searching for a device in session 49 and hctl ['33', '*', '*', 0] yield: None {{(pid=75226) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 01:42:30 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-42e8cb95-645e-4509-bc81-fe83d33278f4 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Searching for a device in session 49 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75226) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 01:42:30 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-42e8cb95-645e-4509-bc81-fe83d33278f4 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:3c8e2d11-ac6f-4568-b99e-9ad41a24e1bb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XEHmaLpw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75226) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 17 01:42:30 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-42e8cb95-645e-4509-bc81-fe83d33278f4 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.279s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:42:30 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-42e8cb95-645e-4509-bc81-fe83d33278f4 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] <== connect_volume: return (1280ms) {'type': 'block', 'scsi_wwn': '23164633236646637', 'path': '/dev/sdb'} {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:42:30 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-42e8cb95-645e-4509-bc81-fe83d33278f4 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: 9c009cf0-99b6-4dc9-931e-b79ef4e2fc3a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23164633236646637', 'path': '/dev/sdb'} {{(pid=75226) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 17 01:42:30 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-42e8cb95-645e-4509-bc81-fe83d33278f4 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:42:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1366793931',display_name='tempest-TestVolumeBootPattern-server-1366793931',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1366793931',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='673620a69fba4a04af75baabe775dc8b',ramdisk_id='',reservation_id='r-fzwyqva5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-971654489',owner_user_name='tempest-TestVolumeBootPattern-971654489-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T01:42:18Z,user_data=None,user_id='7c8c8baa56884dcd9a90f0187c9fc06f',uuid=9c009cf0-99b6-4dc9-931e-b79ef4e2fc3a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fda4b1a7-6558-4658-ac36-502ac3f0ad6d", "address": "fa:16:3e:f3:ff:e0", "network": {"id": "81bbbdad-218b-4fcd-b7f5-427fd49361cb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1151874504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "673620a69fba4a04af75baabe775dc8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfda4b1a7-65", "ovs_interfaceid": "fda4b1a7-6558-4658-ac36-502ac3f0ad6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75226) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 01:42:30 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-42e8cb95-645e-4509-bc81-fe83d33278f4 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Converting VIF {"id": "fda4b1a7-6558-4658-ac36-502ac3f0ad6d", "address": "fa:16:3e:f3:ff:e0", "network": {"id": "81bbbdad-218b-4fcd-b7f5-427fd49361cb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1151874504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "673620a69fba4a04af75baabe775dc8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfda4b1a7-65", "ovs_interfaceid": "fda4b1a7-6558-4658-ac36-502ac3f0ad6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:42:30 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-42e8cb95-645e-4509-bc81-fe83d33278f4 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:ff:e0,bridge_name='br-int',has_traffic_filtering=True,id=fda4b1a7-6558-4658-ac36-502ac3f0ad6d,network=Network(81bbbdad-218b-4fcd-b7f5-427fd49361cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfda4b1a7-65') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:42:30 user nova-compute[75226]: DEBUG nova.objects.instance [None req-42e8cb95-645e-4509-bc81-fe83d33278f4 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Lazy-loading 'pci_devices' on Instance uuid 9c009cf0-99b6-4dc9-931e-b79ef4e2fc3a {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:42:30 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-42e8cb95-645e-4509-bc81-fe83d33278f4 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: 9c009cf0-99b6-4dc9-931e-b79ef4e2fc3a] End _get_guest_xml xml=<domain type="kvm">
Nov 17 01:42:30 user nova-compute[75226]:   <uuid>9c009cf0-99b6-4dc9-931e-b79ef4e2fc3a</uuid>
Nov 17 01:42:30 user nova-compute[75226]:   <name>instance-0000002a</name>
Nov 17 01:42:30 user nova-compute[75226]:   <memory>524288</memory>
Nov 17 01:42:30 user nova-compute[75226]:   <vcpu>1</vcpu>
Nov 17 01:42:30 user nova-compute[75226]:   <metadata>
Nov 17 01:42:30 user nova-compute[75226]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 17 01:42:30 user nova-compute[75226]:       <nova:package version="0.0.0"/>
Nov 17 01:42:30 user nova-compute[75226]:       <nova:name>tempest-TestVolumeBootPattern-server-1366793931</nova:name>
Nov 17 01:42:30 user nova-compute[75226]:       <nova:creationTime>2023-11-17 01:42:29</nova:creationTime>
Nov 17 01:42:30 user nova-compute[75226]:       <nova:flavor name="m1.tiny">
Nov 17 01:42:30 user nova-compute[75226]:         <nova:memory>512</nova:memory>
Nov 17 01:42:30 user nova-compute[75226]:         <nova:disk>1</nova:disk>
Nov 17 01:42:30 user nova-compute[75226]:         <nova:swap>0</nova:swap>
Nov 17 01:42:30 user nova-compute[75226]:         <nova:ephemeral>0</nova:ephemeral>
Nov 17 01:42:30 user nova-compute[75226]:         <nova:vcpus>1</nova:vcpus>
Nov 17 01:42:30 user nova-compute[75226]:       </nova:flavor>
Nov 17 01:42:30 user nova-compute[75226]:       <nova:owner>
Nov 17 01:42:30 user nova-compute[75226]:         <nova:user uuid="7c8c8baa56884dcd9a90f0187c9fc06f">tempest-TestVolumeBootPattern-971654489-project-member</nova:user>
Nov 17 01:42:30 user nova-compute[75226]:         <nova:project uuid="673620a69fba4a04af75baabe775dc8b">tempest-TestVolumeBootPattern-971654489</nova:project>
Nov 17 01:42:30 user nova-compute[75226]:       </nova:owner>
Nov 17 01:42:30 user nova-compute[75226]:       <nova:ports>
Nov 17 01:42:30 user nova-compute[75226]:         <nova:port uuid="fda4b1a7-6558-4658-ac36-502ac3f0ad6d">
Nov 17 01:42:30 user nova-compute[75226]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 17 01:42:30 user nova-compute[75226]:         </nova:port>
Nov 17 01:42:30 user nova-compute[75226]:       </nova:ports>
Nov 17 01:42:30 user nova-compute[75226]:     </nova:instance>
Nov 17 01:42:30 user nova-compute[75226]:   </metadata>
Nov 17 01:42:30 user nova-compute[75226]:   <sysinfo type="smbios">
Nov 17 01:42:30 user nova-compute[75226]:     <system>
Nov 17 01:42:30 user nova-compute[75226]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 17 01:42:30 user nova-compute[75226]:       <entry name="product">OpenStack Nova</entry>
Nov 17 01:42:30 user nova-compute[75226]:       <entry name="version">0.0.0</entry>
Nov 17 01:42:30 user nova-compute[75226]:       <entry name="serial">9c009cf0-99b6-4dc9-931e-b79ef4e2fc3a</entry>
Nov 17 01:42:30 user nova-compute[75226]:       <entry name="uuid">9c009cf0-99b6-4dc9-931e-b79ef4e2fc3a</entry>
Nov 17 01:42:30 user nova-compute[75226]:       <entry name="family">Virtual Machine</entry>
Nov 17 01:42:30 user nova-compute[75226]:     </system>
Nov 17 01:42:30 user nova-compute[75226]:   </sysinfo>
Nov 17 01:42:30 user nova-compute[75226]:   <os>
Nov 17 01:42:30 user nova-compute[75226]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 17 01:42:30 user nova-compute[75226]:     <boot dev="hd"/>
Nov 17 01:42:30 user nova-compute[75226]:     <smbios mode="sysinfo"/>
Nov 17 01:42:30 user nova-compute[75226]:   </os>
Nov 17 01:42:30 user nova-compute[75226]:   <features>
Nov 17 01:42:30 user nova-compute[75226]:     <acpi/>
Nov 17 01:42:30 user nova-compute[75226]:     <apic/>
Nov 17 01:42:30 user nova-compute[75226]:     <vmcoreinfo/>
Nov 17 01:42:30 user nova-compute[75226]:   </features>
Nov 17 01:42:30 user nova-compute[75226]:   <clock offset="utc">
Nov 17 01:42:30 user nova-compute[75226]:     <timer name="pit" tickpolicy="delay"/>
Nov 17 01:42:30 user nova-compute[75226]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 17 01:42:30 user nova-compute[75226]:     <timer name="hpet" present="no"/>
Nov 17 01:42:30 user nova-compute[75226]:   </clock>
Nov 17 01:42:30 user nova-compute[75226]:   <cpu mode="custom" match="exact">
Nov 17 01:42:30 user nova-compute[75226]:     <model>Nehalem</model>
Nov 17 01:42:30 user nova-compute[75226]:     <topology sockets="1" cores="1" threads="1"/>
Nov 17 01:42:30 user nova-compute[75226]:   </cpu>
Nov 17 01:42:30 user nova-compute[75226]:   <devices>
Nov 17 01:42:30 user nova-compute[75226]:     <disk type="block" device="disk">
Nov 17 01:42:30 user nova-compute[75226]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 01:42:30 user nova-compute[75226]:       <source dev="/dev/sdb"/>
Nov 17 01:42:30 user nova-compute[75226]:       <target dev="vda" bus="virtio"/>
Nov 17 01:42:30 user nova-compute[75226]:       <serial>3c8e2d11-ac6f-4568-b99e-9ad41a24e1bb</serial>
Nov 17 01:42:30 user nova-compute[75226]:     </disk>
Nov 17 01:42:30 user nova-compute[75226]:     <interface type="ethernet">
Nov 17 01:42:30 user nova-compute[75226]:       <mac address="fa:16:3e:f3:ff:e0"/>
Nov 17 01:42:30 user nova-compute[75226]:       <model type="virtio"/>
Nov 17 01:42:30 user nova-compute[75226]:       <mtu size="1442"/>
Nov 17 01:42:30 user nova-compute[75226]:       <target dev="tapfda4b1a7-65"/>
Nov 17 01:42:30 user nova-compute[75226]:     </interface>
Nov 17 01:42:30 user nova-compute[75226]:     <serial type="pty">
Nov 17 01:42:30 user nova-compute[75226]:       <log file="/opt/stack/data/nova/instances/9c009cf0-99b6-4dc9-931e-b79ef4e2fc3a/console.log" append="off"/>
Nov 17 01:42:30 user nova-compute[75226]:     </serial>
Nov 17 01:42:30 user nova-compute[75226]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 17 01:42:30 user nova-compute[75226]:     <video>
Nov 17 01:42:30 user nova-compute[75226]:       <model type="virtio"/>
Nov 17 01:42:30 user nova-compute[75226]:     </video>
Nov 17 01:42:30 user nova-compute[75226]:     <rng model="virtio">
Nov 17 01:42:30 user nova-compute[75226]:       <backend model="random">/dev/urandom</backend>
Nov 17 01:42:30 user nova-compute[75226]:     </rng>
Nov 17 01:42:30 user nova-compute[75226]:     <controller type="usb" index="0" model="none"/>
Nov 17 01:42:30 user nova-compute[75226]:     <memballoon model="virtio">
Nov 17 01:42:30 user nova-compute[75226]:       <stats period="10"/>
Nov 17 01:42:30 user nova-compute[75226]:     </memballoon>
Nov 17 01:42:30 user nova-compute[75226]:   </devices>
Nov 17 01:42:30 user nova-compute[75226]: </domain>
Nov 17 01:42:30 user nova-compute[75226]:  {{(pid=75226) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 17 01:42:30 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-42e8cb95-645e-4509-bc81-fe83d33278f4 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:42:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1366793931',display_name='tempest-TestVolumeBootPattern-server-1366793931',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1366793931',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='673620a69fba4a04af75baabe775dc8b',ramdisk_id='',reservation_id='r-fzwyqva5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-971654489',owner_user_name='tempest-TestVolumeBootPattern-971654489-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T01:42:18Z,user_data=None,user_id='7c8c8baa56884dcd9a90f0187c9fc06f',uuid=9c009cf0-99b6-4dc9-931e-b79ef4e2fc3a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fda4b1a7-6558-4658-ac36-502ac3f0ad6d", "address": "fa:16:3e:f3:ff:e0", "network": {"id": "81bbbdad-218b-4fcd-b7f5-427fd49361cb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1151874504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "673620a69fba4a04af75baabe775dc8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfda4b1a7-65", "ovs_interfaceid": "fda4b1a7-6558-4658-ac36-502ac3f0ad6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 17 01:42:30 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-42e8cb95-645e-4509-bc81-fe83d33278f4 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Converting VIF {"id": "fda4b1a7-6558-4658-ac36-502ac3f0ad6d", "address": "fa:16:3e:f3:ff:e0", "network": {"id": "81bbbdad-218b-4fcd-b7f5-427fd49361cb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1151874504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "673620a69fba4a04af75baabe775dc8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfda4b1a7-65", "ovs_interfaceid": "fda4b1a7-6558-4658-ac36-502ac3f0ad6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:42:30 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-42e8cb95-645e-4509-bc81-fe83d33278f4 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:ff:e0,bridge_name='br-int',has_traffic_filtering=True,id=fda4b1a7-6558-4658-ac36-502ac3f0ad6d,network=Network(81bbbdad-218b-4fcd-b7f5-427fd49361cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfda4b1a7-65') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:42:30 user nova-compute[75226]: DEBUG os_vif [None req-42e8cb95-645e-4509-bc81-fe83d33278f4 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:ff:e0,bridge_name='br-int',has_traffic_filtering=True,id=fda4b1a7-6558-4658-ac36-502ac3f0ad6d,network=Network(81bbbdad-218b-4fcd-b7f5-427fd49361cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfda4b1a7-65') {{(pid=75226) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 17 01:42:30 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:42:30 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:42:30 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 17 01:42:30 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:42:30 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a5ee77d2-c666-558f-8421-9659247a2453', '_type': 'linux-noop'}}, row=False) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:42:30 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:42:30 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:42:30 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:42:30 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfda4b1a7-65, may_exist=True, interface_attrs={}) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:42:30 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfda4b1a7-65, col_values=(('qos', UUID('85980740-38b3-40dd-b32e-272791d1158f')),), if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:42:30 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfda4b1a7-65, col_values=(('external_ids', {'iface-id': 'fda4b1a7-6558-4658-ac36-502ac3f0ad6d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f3:ff:e0', 'vm-uuid': '9c009cf0-99b6-4dc9-931e-b79ef4e2fc3a'}),), if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:42:30 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:42:30 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:42:30 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:42:30 user nova-compute[75226]: INFO os_vif [None req-42e8cb95-645e-4509-bc81-fe83d33278f4 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:ff:e0,bridge_name='br-int',has_traffic_filtering=True,id=fda4b1a7-6558-4658-ac36-502ac3f0ad6d,network=Network(81bbbdad-218b-4fcd-b7f5-427fd49361cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfda4b1a7-65')
Nov 17 01:42:30 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-42e8cb95-645e-4509-bc81-fe83d33278f4 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] No BDM found with device name vda, not building metadata. {{(pid=75226) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 01:42:30 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-42e8cb95-645e-4509-bc81-fe83d33278f4 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] No VIF found with MAC fa:16:3e:f3:ff:e0, not building metadata {{(pid=75226) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 01:42:31 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:42:31 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:42:31 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:42:31 user nova-compute[75226]: DEBUG nova.compute.manager [req-d68dc61d-18ce-4bc0-909a-001ffad1bcb1 req-7d35a0e4-0a48-4698-aa25-e09c7772a14a service nova] [instance: 9c009cf0-99b6-4dc9-931e-b79ef4e2fc3a] Received event network-vif-plugged-fda4b1a7-6558-4658-ac36-502ac3f0ad6d {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:42:31 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-d68dc61d-18ce-4bc0-909a-001ffad1bcb1 req-7d35a0e4-0a48-4698-aa25-e09c7772a14a service nova] Acquiring lock "9c009cf0-99b6-4dc9-931e-b79ef4e2fc3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:42:31 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-d68dc61d-18ce-4bc0-909a-001ffad1bcb1 req-7d35a0e4-0a48-4698-aa25-e09c7772a14a service nova] Lock "9c009cf0-99b6-4dc9-931e-b79ef4e2fc3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:42:31 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-d68dc61d-18ce-4bc0-909a-001ffad1bcb1 req-7d35a0e4-0a48-4698-aa25-e09c7772a14a service nova] Lock "9c009cf0-99b6-4dc9-931e-b79ef4e2fc3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:42:31 user nova-compute[75226]: DEBUG nova.compute.manager [req-d68dc61d-18ce-4bc0-909a-001ffad1bcb1 req-7d35a0e4-0a48-4698-aa25-e09c7772a14a service nova] [instance: 9c009cf0-99b6-4dc9-931e-b79ef4e2fc3a] No waiting events found dispatching network-vif-plugged-fda4b1a7-6558-4658-ac36-502ac3f0ad6d {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:42:31 user nova-compute[75226]: WARNING nova.compute.manager [req-d68dc61d-18ce-4bc0-909a-001ffad1bcb1 req-7d35a0e4-0a48-4698-aa25-e09c7772a14a service nova] [instance: 9c009cf0-99b6-4dc9-931e-b79ef4e2fc3a] Received unexpected event network-vif-plugged-fda4b1a7-6558-4658-ac36-502ac3f0ad6d for instance with vm_state building and task_state spawning.
Nov 17 01:42:32 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:42:32 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:42:32 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:42:32 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:42:33 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:42:33 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3672cdc-f598-40a7-acc9-ed4c8015bdf6 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] [instance: 6f3b54ce-4dc1-445a-9108-3f628713e6ec] Calling os-brick to attach iSCSI Volume {{(pid=75226) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 17 01:42:33 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3672cdc-f598-40a7-acc9-ed4c8015bdf6 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc4cc36b490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8ce6c4b7-0c02-41b0-8243-b884beb9ca50', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zknswycQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:42:33 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-d3672cdc-f598-40a7-acc9-ed4c8015bdf6 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:42:33 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-d3672cdc-f598-40a7-acc9-ed4c8015bdf6 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:42:33 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-d3672cdc-f598-40a7-acc9-ed4c8015bdf6 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:42:33 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-d3672cdc-f598-40a7-acc9-ed4c8015bdf6 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:42:33 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-d3672cdc-f598-40a7-acc9-ed4c8015bdf6 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8ce6c4b7-0c02-41b0-8243-b884beb9ca50" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:42:33 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-d3672cdc-f598-40a7-acc9-ed4c8015bdf6 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8ce6c4b7-0c02-41b0-8243-b884beb9ca50" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:42:33 user nova-compute[75226]: INFO os_brick.initiator.connectors.iscsi [None req-d3672cdc-f598-40a7-acc9-ed4c8015bdf6 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 17 01:42:33 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ce6c4b7-0c02-41b0-8243-b884beb9ca50 -p 172.16.0.220:3260 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:42:33 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ce6c4b7-0c02-41b0-8243-b884beb9ca50 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:42:33 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5ade93f-7b1b-4368-af14-8c8a8854bf39]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:42:33 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3672cdc-f598-40a7-acc9-ed4c8015bdf6 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 17 01:42:33 user nova-compute[75226]:  {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:42:33 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ce6c4b7-0c02-41b0-8243-b884beb9ca50 -p 172.16.0.220:3260 --interface default --op new {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:42:33 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ce6c4b7-0c02-41b0-8243-b884beb9ca50 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:42:33 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[5db43649-9487-424e-ad0f-cc54532e609c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8ce6c4b7-0c02-41b0-8243-b884beb9ca50] added\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:42:33 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3672cdc-f598-40a7-acc9-ed4c8015bdf6 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8ce6c4b7-0c02-41b0-8243-b884beb9ca50] added
Nov 17 01:42:33 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:42:33 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ce6c4b7-0c02-41b0-8243-b884beb9ca50 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:42:33 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ce6c4b7-0c02-41b0-8243-b884beb9ca50 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:42:33 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[209424f6-68a6-43d3-981a-6eb57e2f60a3]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:42:33 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3672cdc-f598-40a7-acc9-ed4c8015bdf6 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:42:33 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ce6c4b7-0c02-41b0-8243-b884beb9ca50 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:42:33 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ce6c4b7-0c02-41b0-8243-b884beb9ca50 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:42:33 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f8e25a9-7876-4f56-a11f-79a61efceea0]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:42:33 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3672cdc-f598-40a7-acc9-ed4c8015bdf6 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:42:33 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ce6c4b7-0c02-41b0-8243-b884beb9ca50 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zknswycQ {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:42:33 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ce6c4b7-0c02-41b0-8243-b884beb9ca50 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zknswycQ" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:42:33 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[86a4a224-9fa3-4f75-a741-04fcb8565efd]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:42:33 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3672cdc-f598-40a7-acc9-ed4c8015bdf6 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zknswycQ'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:42:33 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ce6c4b7-0c02-41b0-8243-b884beb9ca50 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:42:33 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ce6c4b7-0c02-41b0-8243-b884beb9ca50 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:42:33 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[977606e6-470f-4f49-ac6d-7e6f14fe9f6d]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:42:33 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3672cdc-f598-40a7-acc9-ed4c8015bdf6 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:42:33 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:42:33 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:42:33 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[feb15c9d-53f3-4eee-969c-acc04ad03dc1]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c8e2d11-ac6f-4568-b99e-9ad41a24e1bb (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:42:33 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3672cdc-f598-40a7-acc9-ed4c8015bdf6 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c8e2d11-ac6f-4568-b99e-9ad41a24e1bb (non-flash)
Nov 17 01:42:33 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:42:33 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3672cdc-f598-40a7-acc9-ed4c8015bdf6 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c8e2d11-ac6f-4568-b99e-9ad41a24e1bb (non-flash)
Nov 17 01:42:33 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:42:33 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ce6c4b7-0c02-41b0-8243-b884beb9ca50 -p 172.16.0.220:3260 --login {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:42:33 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ce6c4b7-0c02-41b0-8243-b884beb9ca50 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:42:33 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3c41f73-fbf9-47f3-a0c4-526fc8514c21]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8ce6c4b7-0c02-41b0-8243-b884beb9ca50, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8ce6c4b7-0c02-41b0-8243-b884beb9ca50, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:42:33 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3672cdc-f598-40a7-acc9-ed4c8015bdf6 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8ce6c4b7-0c02-41b0-8243-b884beb9ca50, portal: 172.16.0.220,3260]
Nov 17 01:42:33 user nova-compute[75226]: Login to [iface: default, target: iqn.2010-10.org.openstack:8ce6c4b7-0c02-41b0-8243-b884beb9ca50, portal: 172.16.0.220,3260] successful.
Nov 17 01:42:33 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:42:33 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ce6c4b7-0c02-41b0-8243-b884beb9ca50 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:42:33 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ce6c4b7-0c02-41b0-8243-b884beb9ca50 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:42:33 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[652d7614-6477-4db2-9127-9497a0701a90]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:42:33 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3672cdc-f598-40a7-acc9-ed4c8015bdf6 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:42:33 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:42:33 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:42:33 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[26fa7abe-db02-4664-ba0f-a56fb416fb72]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c8e2d11-ac6f-4568-b99e-9ad41a24e1bb (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ce6c4b7-0c02-41b0-8243-b884beb9ca50 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:42:33 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3672cdc-f598-40a7-acc9-ed4c8015bdf6 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c8e2d11-ac6f-4568-b99e-9ad41a24e1bb (non-flash)
Nov 17 01:42:33 user nova-compute[75226]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ce6c4b7-0c02-41b0-8243-b884beb9ca50 (non-flash)
Nov 17 01:42:33 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:42:33 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3672cdc-f598-40a7-acc9-ed4c8015bdf6 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c8e2d11-ac6f-4568-b99e-9ad41a24e1bb (non-flash)
Nov 17 01:42:33 user nova-compute[75226]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ce6c4b7-0c02-41b0-8243-b884beb9ca50 (non-flash)
Nov 17 01:42:33 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:42:33 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-d3672cdc-f598-40a7-acc9-ed4c8015bdf6 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8ce6c4b7-0c02-41b0-8243-b884beb9ca50" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.259s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:42:33 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3672cdc-f598-40a7-acc9-ed4c8015bdf6 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Connected to 172.16.0.220:3260 {{(pid=75226) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 17 01:42:33 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-d3672cdc-f598-40a7-acc9-ed4c8015bdf6 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] HCTL ('34', '-', '-', 0) found on session 50 with lun 0 {{(pid=75226) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 17 01:42:33 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-d3672cdc-f598-40a7-acc9-ed4c8015bdf6 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75226) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 17 01:42:33 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:42:33 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:42:33 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8964f82-2cf1-4d2d-b277-3ac07fb89f2a]: (4, ('- - 0', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:42:33 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-d3672cdc-f598-40a7-acc9-ed4c8015bdf6 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Searching for a device in session 50 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75226) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 01:42:33 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3672cdc-f598-40a7-acc9-ed4c8015bdf6 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:8ce6c4b7-0c02-41b0-8243-b884beb9ca50', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zknswycQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75226) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 17 01:42:33 user nova-compute[75226]: DEBUG nova.compute.manager [None req-42e8cb95-645e-4509-bc81-fe83d33278f4 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: 9c009cf0-99b6-4dc9-931e-b79ef4e2fc3a] Instance event wait completed in 0 seconds for  {{(pid=75226) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 17 01:42:33 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-42e8cb95-645e-4509-bc81-fe83d33278f4 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: 9c009cf0-99b6-4dc9-931e-b79ef4e2fc3a] Guest created on hypervisor {{(pid=75226) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 17 01:42:33 user nova-compute[75226]: INFO nova.virt.libvirt.driver [-] [instance: 9c009cf0-99b6-4dc9-931e-b79ef4e2fc3a] Instance spawned successfully.
Nov 17 01:42:33 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-42e8cb95-645e-4509-bc81-fe83d33278f4 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: 9c009cf0-99b6-4dc9-931e-b79ef4e2fc3a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 17 01:42:34 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-42e8cb95-645e-4509-bc81-fe83d33278f4 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: 9c009cf0-99b6-4dc9-931e-b79ef4e2fc3a] Found default for hw_cdrom_bus of ide {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:42:34 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-42e8cb95-645e-4509-bc81-fe83d33278f4 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: 9c009cf0-99b6-4dc9-931e-b79ef4e2fc3a] Found default for hw_disk_bus of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:42:34 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-42e8cb95-645e-4509-bc81-fe83d33278f4 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: 9c009cf0-99b6-4dc9-931e-b79ef4e2fc3a] Found default for hw_input_bus of None {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:42:34 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-42e8cb95-645e-4509-bc81-fe83d33278f4 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: 9c009cf0-99b6-4dc9-931e-b79ef4e2fc3a] Found default for hw_pointer_model of None {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:42:34 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-42e8cb95-645e-4509-bc81-fe83d33278f4 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: 9c009cf0-99b6-4dc9-931e-b79ef4e2fc3a] Found default for hw_video_model of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:42:34 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-42e8cb95-645e-4509-bc81-fe83d33278f4 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: 9c009cf0-99b6-4dc9-931e-b79ef4e2fc3a] Found default for hw_vif_model of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:42:34 user nova-compute[75226]: DEBUG nova.compute.manager [req-b92861e2-ad35-4c5d-baa1-67c0489091a4 req-f024f56a-9704-464f-a057-fda3a191eaf4 service nova] [instance: 9c009cf0-99b6-4dc9-931e-b79ef4e2fc3a] Received event network-vif-plugged-fda4b1a7-6558-4658-ac36-502ac3f0ad6d {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:42:34 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-b92861e2-ad35-4c5d-baa1-67c0489091a4 req-f024f56a-9704-464f-a057-fda3a191eaf4 service nova] Acquiring lock "9c009cf0-99b6-4dc9-931e-b79ef4e2fc3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:42:34 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-b92861e2-ad35-4c5d-baa1-67c0489091a4 req-f024f56a-9704-464f-a057-fda3a191eaf4 service nova] Lock "9c009cf0-99b6-4dc9-931e-b79ef4e2fc3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:42:34 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-b92861e2-ad35-4c5d-baa1-67c0489091a4 req-f024f56a-9704-464f-a057-fda3a191eaf4 service nova] Lock "9c009cf0-99b6-4dc9-931e-b79ef4e2fc3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:42:34 user nova-compute[75226]: DEBUG nova.compute.manager [req-b92861e2-ad35-4c5d-baa1-67c0489091a4 req-f024f56a-9704-464f-a057-fda3a191eaf4 service nova] [instance: 9c009cf0-99b6-4dc9-931e-b79ef4e2fc3a] No waiting events found dispatching network-vif-plugged-fda4b1a7-6558-4658-ac36-502ac3f0ad6d {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:42:34 user nova-compute[75226]: WARNING nova.compute.manager [req-b92861e2-ad35-4c5d-baa1-67c0489091a4 req-f024f56a-9704-464f-a057-fda3a191eaf4 service nova] [instance: 9c009cf0-99b6-4dc9-931e-b79ef4e2fc3a] Received unexpected event network-vif-plugged-fda4b1a7-6558-4658-ac36-502ac3f0ad6d for instance with vm_state building and task_state spawning.
Nov 17 01:42:34 user nova-compute[75226]: INFO nova.compute.manager [None req-42e8cb95-645e-4509-bc81-fe83d33278f4 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: 9c009cf0-99b6-4dc9-931e-b79ef4e2fc3a] Took 4.99 seconds to spawn the instance on the hypervisor.
Nov 17 01:42:34 user nova-compute[75226]: DEBUG nova.compute.manager [None req-42e8cb95-645e-4509-bc81-fe83d33278f4 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: 9c009cf0-99b6-4dc9-931e-b79ef4e2fc3a] Checking state {{(pid=75226) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 01:42:34 user nova-compute[75226]: INFO nova.compute.manager [None req-42e8cb95-645e-4509-bc81-fe83d33278f4 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: 9c009cf0-99b6-4dc9-931e-b79ef4e2fc3a] Took 17.04 seconds to build instance.
Nov 17 01:42:34 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-42e8cb95-645e-4509-bc81-fe83d33278f4 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Lock "9c009cf0-99b6-4dc9-931e-b79ef4e2fc3a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.143s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:42:34 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-d3672cdc-f598-40a7-acc9-ed4c8015bdf6 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.293s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:42:34 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3672cdc-f598-40a7-acc9-ed4c8015bdf6 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] <== connect_volume: return (1294ms) {'type': 'block', 'scsi_wwn': '26138346437626466', 'path': '/dev/sdc'} {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:42:34 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3672cdc-f598-40a7-acc9-ed4c8015bdf6 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] [instance: 6f3b54ce-4dc1-445a-9108-3f628713e6ec] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26138346437626466', 'path': '/dev/sdc'} {{(pid=75226) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 17 01:42:34 user nova-compute[75226]: DEBUG nova.objects.instance [None req-d3672cdc-f598-40a7-acc9-ed4c8015bdf6 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Lazy-loading 'flavor' on Instance uuid 6f3b54ce-4dc1-445a-9108-3f628713e6ec {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:42:34 user nova-compute[75226]: DEBUG nova.virt.libvirt.guest [None req-d3672cdc-f598-40a7-acc9-ed4c8015bdf6 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] attach device xml: <disk type="block" device="disk">
Nov 17 01:42:34 user nova-compute[75226]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 01:42:34 user nova-compute[75226]:   <source dev="/dev/sdc"/>
Nov 17 01:42:34 user nova-compute[75226]:   <target dev="vdb" bus="virtio"/>
Nov 17 01:42:34 user nova-compute[75226]:   <serial>8ce6c4b7-0c02-41b0-8243-b884beb9ca50</serial>
Nov 17 01:42:34 user nova-compute[75226]: </disk>
Nov 17 01:42:34 user nova-compute[75226]:  {{(pid=75226) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 17 01:42:35 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-d3672cdc-f598-40a7-acc9-ed4c8015bdf6 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] No BDM found with device name vda, not building metadata. {{(pid=75226) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 01:42:35 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-d3672cdc-f598-40a7-acc9-ed4c8015bdf6 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75226) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 01:42:35 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-d3672cdc-f598-40a7-acc9-ed4c8015bdf6 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] No VIF found with MAC fa:16:3e:8a:af:7c, not building metadata {{(pid=75226) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 01:42:35 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:42:35 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-d3672cdc-f598-40a7-acc9-ed4c8015bdf6 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Lock "6f3b54ce-4dc1-445a-9108-3f628713e6ec" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.374s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:42:36 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-6cec7175-02bb-4d7f-9d1b-147ee5e6585c tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Acquiring lock "d6555d72-6094-4ea9-b071-a3d3c8a300a9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:42:36 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-6cec7175-02bb-4d7f-9d1b-147ee5e6585c tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Lock "d6555d72-6094-4ea9-b071-a3d3c8a300a9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:42:36 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-6cec7175-02bb-4d7f-9d1b-147ee5e6585c tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Acquiring lock "d6555d72-6094-4ea9-b071-a3d3c8a300a9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:42:36 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-6cec7175-02bb-4d7f-9d1b-147ee5e6585c tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Lock "d6555d72-6094-4ea9-b071-a3d3c8a300a9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:42:36 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-6cec7175-02bb-4d7f-9d1b-147ee5e6585c tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Lock "d6555d72-6094-4ea9-b071-a3d3c8a300a9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:42:36 user nova-compute[75226]: INFO nova.compute.manager [None req-6cec7175-02bb-4d7f-9d1b-147ee5e6585c tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] [instance: d6555d72-6094-4ea9-b071-a3d3c8a300a9] Terminating instance
Nov 17 01:42:36 user nova-compute[75226]: DEBUG nova.compute.manager [None req-6cec7175-02bb-4d7f-9d1b-147ee5e6585c tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] [instance: d6555d72-6094-4ea9-b071-a3d3c8a300a9] Start destroying the instance on the hypervisor. {{(pid=75226) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 17 01:42:36 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:42:36 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:42:36 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:42:36 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-72a2bf3b-97b1-40f6-a693-e48fd21b7159 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Acquiring lock "6f3b54ce-4dc1-445a-9108-3f628713e6ec" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:42:36 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-72a2bf3b-97b1-40f6-a693-e48fd21b7159 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Lock "6f3b54ce-4dc1-445a-9108-3f628713e6ec" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:42:36 user nova-compute[75226]: INFO nova.compute.manager [None req-72a2bf3b-97b1-40f6-a693-e48fd21b7159 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] [instance: 6f3b54ce-4dc1-445a-9108-3f628713e6ec] Detaching volume 8ce6c4b7-0c02-41b0-8243-b884beb9ca50
Nov 17 01:42:36 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:42:37 user nova-compute[75226]: INFO nova.virt.block_device [None req-72a2bf3b-97b1-40f6-a693-e48fd21b7159 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] [instance: 6f3b54ce-4dc1-445a-9108-3f628713e6ec] Attempting to driver detach volume 8ce6c4b7-0c02-41b0-8243-b884beb9ca50 from mountpoint /dev/vdb
Nov 17 01:42:37 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-72a2bf3b-97b1-40f6-a693-e48fd21b7159 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Attempting to detach device vdb from instance 6f3b54ce-4dc1-445a-9108-3f628713e6ec from the persistent domain config. {{(pid=75226) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 17 01:42:37 user nova-compute[75226]: DEBUG nova.virt.libvirt.guest [None req-72a2bf3b-97b1-40f6-a693-e48fd21b7159 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] detach device xml: <disk type="block" device="disk">
Nov 17 01:42:37 user nova-compute[75226]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 01:42:37 user nova-compute[75226]:   <source dev="/dev/sdc"/>
Nov 17 01:42:37 user nova-compute[75226]:   <target dev="vdb" bus="virtio"/>
Nov 17 01:42:37 user nova-compute[75226]:   <serial>8ce6c4b7-0c02-41b0-8243-b884beb9ca50</serial>
Nov 17 01:42:37 user nova-compute[75226]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 17 01:42:37 user nova-compute[75226]: </disk>
Nov 17 01:42:37 user nova-compute[75226]:  {{(pid=75226) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 17 01:42:37 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-72a2bf3b-97b1-40f6-a693-e48fd21b7159 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Successfully detached device vdb from instance 6f3b54ce-4dc1-445a-9108-3f628713e6ec from the persistent domain config.
Nov 17 01:42:37 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-72a2bf3b-97b1-40f6-a693-e48fd21b7159 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6f3b54ce-4dc1-445a-9108-3f628713e6ec from the live domain config. {{(pid=75226) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 17 01:42:37 user nova-compute[75226]: DEBUG nova.virt.libvirt.guest [None req-72a2bf3b-97b1-40f6-a693-e48fd21b7159 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] detach device xml: <disk type="block" device="disk">
Nov 17 01:42:37 user nova-compute[75226]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 01:42:37 user nova-compute[75226]:   <source dev="/dev/sdc"/>
Nov 17 01:42:37 user nova-compute[75226]:   <target dev="vdb" bus="virtio"/>
Nov 17 01:42:37 user nova-compute[75226]:   <serial>8ce6c4b7-0c02-41b0-8243-b884beb9ca50</serial>
Nov 17 01:42:37 user nova-compute[75226]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 17 01:42:37 user nova-compute[75226]: </disk>
Nov 17 01:42:37 user nova-compute[75226]:  {{(pid=75226) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 17 01:42:37 user nova-compute[75226]: DEBUG nova.compute.manager [req-dafcac42-5f5e-475a-bbb6-715f86e2a393 req-a0315464-5e6b-4e27-87ed-c0b74285bcbd service nova] [instance: d6555d72-6094-4ea9-b071-a3d3c8a300a9] Received event network-vif-unplugged-1315a3d4-9d0a-4a65-8044-45959bf1f754 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:42:37 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-dafcac42-5f5e-475a-bbb6-715f86e2a393 req-a0315464-5e6b-4e27-87ed-c0b74285bcbd service nova] Acquiring lock "d6555d72-6094-4ea9-b071-a3d3c8a300a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:42:37 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-dafcac42-5f5e-475a-bbb6-715f86e2a393 req-a0315464-5e6b-4e27-87ed-c0b74285bcbd service nova] Lock "d6555d72-6094-4ea9-b071-a3d3c8a300a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:42:37 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-dafcac42-5f5e-475a-bbb6-715f86e2a393 req-a0315464-5e6b-4e27-87ed-c0b74285bcbd service nova] Lock "d6555d72-6094-4ea9-b071-a3d3c8a300a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:42:37 user nova-compute[75226]: DEBUG nova.compute.manager [req-dafcac42-5f5e-475a-bbb6-715f86e2a393 req-a0315464-5e6b-4e27-87ed-c0b74285bcbd service nova] [instance: d6555d72-6094-4ea9-b071-a3d3c8a300a9] No waiting events found dispatching network-vif-unplugged-1315a3d4-9d0a-4a65-8044-45959bf1f754 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:42:37 user nova-compute[75226]: DEBUG nova.compute.manager [req-dafcac42-5f5e-475a-bbb6-715f86e2a393 req-a0315464-5e6b-4e27-87ed-c0b74285bcbd service nova] [instance: d6555d72-6094-4ea9-b071-a3d3c8a300a9] Received event network-vif-unplugged-1315a3d4-9d0a-4a65-8044-45959bf1f754 for instance with task_state deleting. {{(pid=75226) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 17 01:42:37 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-72a2bf3b-97b1-40f6-a693-e48fd21b7159 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6f3b54ce-4dc1-445a-9108-3f628713e6ec {{(pid=75226) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 17 01:42:37 user nova-compute[75226]: INFO nova.virt.libvirt.driver [-] [instance: d6555d72-6094-4ea9-b071-a3d3c8a300a9] Instance destroyed successfully.
Nov 17 01:42:37 user nova-compute[75226]: DEBUG nova.objects.instance [None req-6cec7175-02bb-4d7f-9d1b-147ee5e6585c tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Lazy-loading 'resources' on Instance uuid d6555d72-6094-4ea9-b071-a3d3c8a300a9 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:42:37 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-6cec7175-02bb-4d7f-9d1b-147ee5e6585c tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:25:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1387314277',display_name='tempest-ServerRescueNegativeTestJSON-server-1387314277',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1387314277',id=25,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-17T01:30:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2052a37a068e4d948c57560c0f4445e4',ramdisk_id='',reservation_id='r-2jn9z0wx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-344970408',owner_user_name='tempest-ServerRescueNegativeTestJSON-344970408-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T01:32:21Z,user_data=None,user_id='12f405f1486a4f5187e628c60f223e98',uuid=d6555d72-6094-4ea9-b071-a3d3c8a300a9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1315a3d4-9d0a-4a65-8044-45959bf1f754", "address": "fa:16:3e:83:57:31", "network": {"id": "a9710b94-56f8-4cf6-9bb6-344b275e5bf2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-512340839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2052a37a068e4d948c57560c0f4445e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1315a3d4-9d", "ovs_interfaceid": "1315a3d4-9d0a-4a65-8044-45959bf1f754", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 17 01:42:37 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-6cec7175-02bb-4d7f-9d1b-147ee5e6585c tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Converting VIF {"id": "1315a3d4-9d0a-4a65-8044-45959bf1f754", "address": "fa:16:3e:83:57:31", "network": {"id": "a9710b94-56f8-4cf6-9bb6-344b275e5bf2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-512340839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2052a37a068e4d948c57560c0f4445e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1315a3d4-9d", "ovs_interfaceid": "1315a3d4-9d0a-4a65-8044-45959bf1f754", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:42:37 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-6cec7175-02bb-4d7f-9d1b-147ee5e6585c tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:83:57:31,bridge_name='br-int',has_traffic_filtering=True,id=1315a3d4-9d0a-4a65-8044-45959bf1f754,network=Network(a9710b94-56f8-4cf6-9bb6-344b275e5bf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1315a3d4-9d') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:42:37 user nova-compute[75226]: DEBUG os_vif [None req-6cec7175-02bb-4d7f-9d1b-147ee5e6585c tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:83:57:31,bridge_name='br-int',has_traffic_filtering=True,id=1315a3d4-9d0a-4a65-8044-45959bf1f754,network=Network(a9710b94-56f8-4cf6-9bb6-344b275e5bf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1315a3d4-9d') {{(pid=75226) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 17 01:42:37 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:42:37 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1315a3d4-9d, bridge=br-int, if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:42:37 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:42:37 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:42:37 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:42:37 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=50846ccd-7506-4407-b1c2-19885cbefbdd) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:42:37 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:42:37 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:42:37 user nova-compute[75226]: INFO os_vif [None req-6cec7175-02bb-4d7f-9d1b-147ee5e6585c tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:83:57:31,bridge_name='br-int',has_traffic_filtering=True,id=1315a3d4-9d0a-4a65-8044-45959bf1f754,network=Network(a9710b94-56f8-4cf6-9bb6-344b275e5bf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1315a3d4-9d')
Nov 17 01:42:37 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-6cec7175-02bb-4d7f-9d1b-147ee5e6585c tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] [instance: d6555d72-6094-4ea9-b071-a3d3c8a300a9] Deleting instance files /opt/stack/data/nova/instances/d6555d72-6094-4ea9-b071-a3d3c8a300a9_del
Nov 17 01:42:37 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-6cec7175-02bb-4d7f-9d1b-147ee5e6585c tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] [instance: d6555d72-6094-4ea9-b071-a3d3c8a300a9] Deletion of /opt/stack/data/nova/instances/d6555d72-6094-4ea9-b071-a3d3c8a300a9_del complete
Nov 17 01:42:37 user nova-compute[75226]: INFO nova.compute.manager [None req-6cec7175-02bb-4d7f-9d1b-147ee5e6585c tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] [instance: d6555d72-6094-4ea9-b071-a3d3c8a300a9] Took 1.18 seconds to destroy the instance on the hypervisor.
Nov 17 01:42:37 user nova-compute[75226]: DEBUG oslo.service.loopingcall [None req-6cec7175-02bb-4d7f-9d1b-147ee5e6585c tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75226) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 17 01:42:37 user nova-compute[75226]: DEBUG nova.compute.manager [-] [instance: d6555d72-6094-4ea9-b071-a3d3c8a300a9] Deallocating network for instance {{(pid=75226) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 17 01:42:37 user nova-compute[75226]: DEBUG nova.network.neutron [-] [instance: d6555d72-6094-4ea9-b071-a3d3c8a300a9] deallocate_for_instance() {{(pid=75226) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 17 01:42:38 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:42:38 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:42:38 user nova-compute[75226]: DEBUG nova.network.neutron [-] [instance: d6555d72-6094-4ea9-b071-a3d3c8a300a9] Updating instance_info_cache with network_info: [] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:42:38 user nova-compute[75226]: INFO nova.compute.manager [-] [instance: d6555d72-6094-4ea9-b071-a3d3c8a300a9] Took 0.75 seconds to deallocate network for instance.
Nov 17 01:42:38 user nova-compute[75226]: DEBUG nova.compute.manager [req-042509ae-d831-47b7-ad43-db73319f292b req-9fe1ac62-6a85-4b0a-9764-af0339ca6d11 service nova] [instance: d6555d72-6094-4ea9-b071-a3d3c8a300a9] Received event network-vif-deleted-1315a3d4-9d0a-4a65-8044-45959bf1f754 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:42:38 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-6cec7175-02bb-4d7f-9d1b-147ee5e6585c tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:42:38 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-6cec7175-02bb-4d7f-9d1b-147ee5e6585c tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:42:38 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-6cec7175-02bb-4d7f-9d1b-147ee5e6585c tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:42:38 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-6cec7175-02bb-4d7f-9d1b-147ee5e6585c tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:42:38 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-6cec7175-02bb-4d7f-9d1b-147ee5e6585c tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.216s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:42:39 user nova-compute[75226]: INFO nova.scheduler.client.report [None req-6cec7175-02bb-4d7f-9d1b-147ee5e6585c tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Deleted allocations for instance d6555d72-6094-4ea9-b071-a3d3c8a300a9
Nov 17 01:42:39 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-6cec7175-02bb-4d7f-9d1b-147ee5e6585c tempest-ServerRescueNegativeTestJSON-344970408 tempest-ServerRescueNegativeTestJSON-344970408-project-member] Lock "d6555d72-6094-4ea9-b071-a3d3c8a300a9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.341s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:42:39 user nova-compute[75226]: DEBUG nova.compute.manager [req-3632643a-9882-479c-979a-ae3f4a70bd90 req-dc95185c-ca80-43b0-bcf2-68fade434ab6 service nova] [instance: d6555d72-6094-4ea9-b071-a3d3c8a300a9] Received event network-vif-plugged-1315a3d4-9d0a-4a65-8044-45959bf1f754 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:42:39 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-3632643a-9882-479c-979a-ae3f4a70bd90 req-dc95185c-ca80-43b0-bcf2-68fade434ab6 service nova] Acquiring lock "d6555d72-6094-4ea9-b071-a3d3c8a300a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:42:39 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-3632643a-9882-479c-979a-ae3f4a70bd90 req-dc95185c-ca80-43b0-bcf2-68fade434ab6 service nova] Lock "d6555d72-6094-4ea9-b071-a3d3c8a300a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:42:39 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-3632643a-9882-479c-979a-ae3f4a70bd90 req-dc95185c-ca80-43b0-bcf2-68fade434ab6 service nova] Lock "d6555d72-6094-4ea9-b071-a3d3c8a300a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:42:39 user nova-compute[75226]: DEBUG nova.compute.manager [req-3632643a-9882-479c-979a-ae3f4a70bd90 req-dc95185c-ca80-43b0-bcf2-68fade434ab6 service nova] [instance: d6555d72-6094-4ea9-b071-a3d3c8a300a9] No waiting events found dispatching network-vif-plugged-1315a3d4-9d0a-4a65-8044-45959bf1f754 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:42:39 user nova-compute[75226]: WARNING nova.compute.manager [req-3632643a-9882-479c-979a-ae3f4a70bd90 req-dc95185c-ca80-43b0-bcf2-68fade434ab6 service nova] [instance: d6555d72-6094-4ea9-b071-a3d3c8a300a9] Received unexpected event network-vif-plugged-1315a3d4-9d0a-4a65-8044-45959bf1f754 for instance with vm_state deleted and task_state None.
Nov 17 01:42:42 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:42:43 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:42:47 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:42:48 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:42:52 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:42:53 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:42:57 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-72a2bf3b-97b1-40f6-a693-e48fd21b7159 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 6f3b54ce-4dc1-445a-9108-3f628713e6ec is timed out.
Nov 17 01:42:57 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-72a2bf3b-97b1-40f6-a693-e48fd21b7159 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Successfully detached device vdb from instance 6f3b54ce-4dc1-445a-9108-3f628713e6ec from the live domain config.
Nov 17 01:42:57 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-72a2bf3b-97b1-40f6-a693-e48fd21b7159 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] [instance: 6f3b54ce-4dc1-445a-9108-3f628713e6ec] calling os-brick to detach iSCSI Volume {{(pid=75226) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 17 01:42:57 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-72a2bf3b-97b1-40f6-a693-e48fd21b7159 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc4cc36b490>, {'target_iqn': 'iqn.2010-10.org.openstack:8ce6c4b7-0c02-41b0-8243-b884beb9ca50', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zknswycQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:42:57 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-72a2bf3b-97b1-40f6-a693-e48fd21b7159 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:42:57 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-72a2bf3b-97b1-40f6-a693-e48fd21b7159 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:42:57 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-72a2bf3b-97b1-40f6-a693-e48fd21b7159 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:42:57 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:42:57 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:42:57 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[37618ac0-dc63-4119-864d-96c16672d1da]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3c8e2d11-ac6f-4568-b99e-9ad41a24e1bb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8ce6c4b7-0c02-41b0-8243-b884beb9ca50\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:42:57 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-72a2bf3b-97b1-40f6-a693-e48fd21b7159 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 17 01:42:57 user nova-compute[75226]: No targets found.
Nov 17 01:42:57 user nova-compute[75226]: iSNS:
Nov 17 01:42:57 user nova-compute[75226]: No targets found.
Nov 17 01:42:57 user nova-compute[75226]: STATIC:
Nov 17 01:42:57 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:3c8e2d11-ac6f-4568-b99e-9ad41a24e1bb
Nov 17 01:42:57 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:42:57 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:42:57 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:8ce6c4b7-0c02-41b0-8243-b884beb9ca50
Nov 17 01:42:57 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:42:57 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:42:57 user nova-compute[75226]: FIRMWARE:
Nov 17 01:42:57 user nova-compute[75226]: No targets found.
Nov 17 01:42:57 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:42:57 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-72a2bf3b-97b1-40f6-a693-e48fd21b7159 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 17 01:42:57 user nova-compute[75226]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 17 01:42:57 user nova-compute[75226]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75226) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 17 01:42:57 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-72a2bf3b-97b1-40f6-a693-e48fd21b7159 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8ce6c4b7-0c02-41b0-8243-b884beb9ca50', 0)] {{(pid=75226) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 17 01:42:57 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:42:57 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:42:57 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:42:57 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[319a6c97-44b7-4bef-9cc5-50418cb777f9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3c8e2d11-ac6f-4568-b99e-9ad41a24e1bb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8ce6c4b7-0c02-41b0-8243-b884beb9ca50\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:42:57 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:42:57 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:42:57 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[467d96eb-449f-4e61-8339-485be19eb715]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c8e2d11-ac6f-4568-b99e-9ad41a24e1bb (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ce6c4b7-0c02-41b0-8243-b884beb9ca50 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:42:57 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-72a2bf3b-97b1-40f6-a693-e48fd21b7159 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c8e2d11-ac6f-4568-b99e-9ad41a24e1bb (non-flash)
Nov 17 01:42:57 user nova-compute[75226]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ce6c4b7-0c02-41b0-8243-b884beb9ca50 (non-flash)
Nov 17 01:42:57 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:42:57 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-72a2bf3b-97b1-40f6-a693-e48fd21b7159 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c8e2d11-ac6f-4568-b99e-9ad41a24e1bb (non-flash)
Nov 17 01:42:57 user nova-compute[75226]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ce6c4b7-0c02-41b0-8243-b884beb9ca50 (non-flash)
Nov 17 01:42:57 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:42:57 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-72a2bf3b-97b1-40f6-a693-e48fd21b7159 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc4b41ddfc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8ce6c4b7-0c02-41b0-8243-b884beb9ca50'): ({'sdc'}, set())}) {{(pid=75226) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 17 01:42:57 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-72a2bf3b-97b1-40f6-a693-e48fd21b7159 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Removing single pathed devices sdc {{(pid=75226) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 17 01:42:57 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:42:57 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:42:57 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[adc91531-ed64-4ff5-a5ac-e62758f4fe9e]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:42:57 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:42:57 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:42:57 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[efe1b879-499d-43e3-a41b-4c8e30b27b63]: (4, ('ok\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:42:57 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-72a2bf3b-97b1-40f6-a693-e48fd21b7159 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Flushing IO for device /dev/sdc {{(pid=75226) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 17 01:42:57 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:42:57 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:42:57 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f1265e5-bf00-4b27-a0aa-02ade57efca0]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:42:57 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-72a2bf3b-97b1-40f6-a693-e48fd21b7159 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75226) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 17 01:42:57 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:42:58 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.028s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:42:58 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7d100b3-c4e6-48af-8571-0df22dab5a00]: (4, ('1', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:42:58 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-72a2bf3b-97b1-40f6-a693-e48fd21b7159 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75226) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 17 01:42:58 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-72a2bf3b-97b1-40f6-a693-e48fd21b7159 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] SCSI volumes sdc have been removed. {{(pid=75226) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 17 01:42:58 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-72a2bf3b-97b1-40f6-a693-e48fd21b7159 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8ce6c4b7-0c02-41b0-8243-b884beb9ca50')] {{(pid=75226) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 17 01:42:58 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ce6c4b7-0c02-41b0-8243-b884beb9ca50 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:42:58 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ce6c4b7-0c02-41b0-8243-b884beb9ca50 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:42:58 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[66863da3-2bab-4b45-bec5-f3efbebf4932]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:42:58 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-72a2bf3b-97b1-40f6-a693-e48fd21b7159 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:42:58 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ce6c4b7-0c02-41b0-8243-b884beb9ca50 -p 172.16.0.220:3260 --logout {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:42:58 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ce6c4b7-0c02-41b0-8243-b884beb9ca50 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:42:58 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[9783f103-5d17-4945-8014-be163a6edf9a]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:8ce6c4b7-0c02-41b0-8243-b884beb9ca50, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:8ce6c4b7-0c02-41b0-8243-b884beb9ca50, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:42:58 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-72a2bf3b-97b1-40f6-a693-e48fd21b7159 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:8ce6c4b7-0c02-41b0-8243-b884beb9ca50, portal: 172.16.0.220,3260]
Nov 17 01:42:58 user nova-compute[75226]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:8ce6c4b7-0c02-41b0-8243-b884beb9ca50, portal: 172.16.0.220,3260] successful.
Nov 17 01:42:58 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:42:58 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ce6c4b7-0c02-41b0-8243-b884beb9ca50 -p 172.16.0.220:3260 --op delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:42:58 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ce6c4b7-0c02-41b0-8243-b884beb9ca50 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:42:58 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[e52181af-cc5e-4b40-9731-3ffdb91676fd]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:42:58 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-72a2bf3b-97b1-40f6-a693-e48fd21b7159 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:42:58 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-72a2bf3b-97b1-40f6-a693-e48fd21b7159 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.277s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:42:58 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-72a2bf3b-97b1-40f6-a693-e48fd21b7159 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] <== disconnect_volume: return (277ms) None {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:42:58 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-72a2bf3b-97b1-40f6-a693-e48fd21b7159 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] [instance: 6f3b54ce-4dc1-445a-9108-3f628713e6ec] Disconnected iSCSI Volume {{(pid=75226) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 17 01:42:58 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:42:58 user nova-compute[75226]: DEBUG nova.objects.instance [None req-72a2bf3b-97b1-40f6-a693-e48fd21b7159 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Lazy-loading 'flavor' on Instance uuid 6f3b54ce-4dc1-445a-9108-3f628713e6ec {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:42:58 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-72a2bf3b-97b1-40f6-a693-e48fd21b7159 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Lock "6f3b54ce-4dc1-445a-9108-3f628713e6ec" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.038s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:43:02 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:43:03 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:43:07 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:43:08 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:43:09 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-5579012c-43b3-45f4-b31a-58d1bfb20250 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Acquiring lock "8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:43:09 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-5579012c-43b3-45f4-b31a-58d1bfb20250 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Lock "8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:43:09 user nova-compute[75226]: DEBUG nova.compute.manager [None req-5579012c-43b3-45f4-b31a-58d1bfb20250 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] [instance: 8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02] Starting instance... {{(pid=75226) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 17 01:43:09 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-5579012c-43b3-45f4-b31a-58d1bfb20250 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:43:09 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-5579012c-43b3-45f4-b31a-58d1bfb20250 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:43:09 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-5579012c-43b3-45f4-b31a-58d1bfb20250 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75226) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 17 01:43:09 user nova-compute[75226]: INFO nova.compute.claims [None req-5579012c-43b3-45f4-b31a-58d1bfb20250 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] [instance: 8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02] Claim successful on node user
Nov 17 01:43:09 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-5579012c-43b3-45f4-b31a-58d1bfb20250 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:43:09 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-5579012c-43b3-45f4-b31a-58d1bfb20250 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:43:09 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-5579012c-43b3-45f4-b31a-58d1bfb20250 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.263s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:43:09 user nova-compute[75226]: DEBUG nova.compute.manager [None req-5579012c-43b3-45f4-b31a-58d1bfb20250 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] [instance: 8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02] Start building networks asynchronously for instance. {{(pid=75226) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 17 01:43:09 user nova-compute[75226]: DEBUG nova.compute.manager [None req-5579012c-43b3-45f4-b31a-58d1bfb20250 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] [instance: 8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02] Allocating IP information in the background. {{(pid=75226) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 17 01:43:09 user nova-compute[75226]: DEBUG nova.network.neutron [None req-5579012c-43b3-45f4-b31a-58d1bfb20250 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] [instance: 8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02] allocate_for_instance() {{(pid=75226) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 17 01:43:09 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-5579012c-43b3-45f4-b31a-58d1bfb20250 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] [instance: 8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 17 01:43:09 user nova-compute[75226]: DEBUG nova.compute.manager [None req-5579012c-43b3-45f4-b31a-58d1bfb20250 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] [instance: 8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02] Start building block device mappings for instance. {{(pid=75226) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 17 01:43:09 user nova-compute[75226]: DEBUG nova.policy [None req-5579012c-43b3-45f4-b31a-58d1bfb20250 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e7c57c13ff8a48f7b8b206d71e413646', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33699aa6c9db4815a1e79aff4685801e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75226) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 17 01:43:09 user nova-compute[75226]: DEBUG nova.compute.manager [None req-5579012c-43b3-45f4-b31a-58d1bfb20250 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] [instance: 8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02] Start spawning the instance on the hypervisor. {{(pid=75226) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 17 01:43:09 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-5579012c-43b3-45f4-b31a-58d1bfb20250 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] [instance: 8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02] Creating instance directory {{(pid=75226) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 17 01:43:09 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-5579012c-43b3-45f4-b31a-58d1bfb20250 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] [instance: 8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02] Creating image(s)
Nov 17 01:43:09 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-5579012c-43b3-45f4-b31a-58d1bfb20250 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Acquiring lock "/opt/stack/data/nova/instances/8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:43:09 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-5579012c-43b3-45f4-b31a-58d1bfb20250 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Lock "/opt/stack/data/nova/instances/8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:43:09 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-5579012c-43b3-45f4-b31a-58d1bfb20250 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Lock "/opt/stack/data/nova/instances/8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:43:09 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-5579012c-43b3-45f4-b31a-58d1bfb20250 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Acquiring lock "cdf30fec2ac4e026616c6c725d2f0fd91e521550" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:43:09 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-5579012c-43b3-45f4-b31a-58d1bfb20250 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Lock "cdf30fec2ac4e026616c6c725d2f0fd91e521550" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:43:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-5579012c-43b3-45f4-b31a-58d1bfb20250 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cdf30fec2ac4e026616c6c725d2f0fd91e521550.part --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:43:10 user nova-compute[75226]: DEBUG nova.network.neutron [None req-5579012c-43b3-45f4-b31a-58d1bfb20250 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] [instance: 8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02] Successfully created port: ab437de1-a5c2-48c9-b693-902fc4b05929 {{(pid=75226) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 17 01:43:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-5579012c-43b3-45f4-b31a-58d1bfb20250 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cdf30fec2ac4e026616c6c725d2f0fd91e521550.part --force-share --output=json" returned: 0 in 0.190s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:43:10 user nova-compute[75226]: DEBUG nova.virt.images [None req-5579012c-43b3-45f4-b31a-58d1bfb20250 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] 218241c1-772f-4437-81f3-4435b1382dd7 was qcow2, converting to raw {{(pid=75226) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 17 01:43:10 user nova-compute[75226]: DEBUG nova.privsep.utils [None req-5579012c-43b3-45f4-b31a-58d1bfb20250 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75226) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 17 01:43:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-5579012c-43b3-45f4-b31a-58d1bfb20250 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/cdf30fec2ac4e026616c6c725d2f0fd91e521550.part /opt/stack/data/nova/instances/_base/cdf30fec2ac4e026616c6c725d2f0fd91e521550.converted {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:43:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-5579012c-43b3-45f4-b31a-58d1bfb20250 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/cdf30fec2ac4e026616c6c725d2f0fd91e521550.part /opt/stack/data/nova/instances/_base/cdf30fec2ac4e026616c6c725d2f0fd91e521550.converted" returned: 0 in 0.184s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:43:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-5579012c-43b3-45f4-b31a-58d1bfb20250 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cdf30fec2ac4e026616c6c725d2f0fd91e521550.converted --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:43:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-5579012c-43b3-45f4-b31a-58d1bfb20250 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cdf30fec2ac4e026616c6c725d2f0fd91e521550.converted --force-share --output=json" returned: 0 in 0.238s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:43:10 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-5579012c-43b3-45f4-b31a-58d1bfb20250 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Lock "cdf30fec2ac4e026616c6c725d2f0fd91e521550" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.102s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:43:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-5579012c-43b3-45f4-b31a-58d1bfb20250 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cdf30fec2ac4e026616c6c725d2f0fd91e521550 --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:43:11 user nova-compute[75226]: DEBUG nova.network.neutron [None req-5579012c-43b3-45f4-b31a-58d1bfb20250 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] [instance: 8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02] Successfully updated port: ab437de1-a5c2-48c9-b693-902fc4b05929 {{(pid=75226) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 17 01:43:11 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-5579012c-43b3-45f4-b31a-58d1bfb20250 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cdf30fec2ac4e026616c6c725d2f0fd91e521550 --force-share --output=json" returned: 0 in 0.290s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:43:11 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-5579012c-43b3-45f4-b31a-58d1bfb20250 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Acquiring lock "cdf30fec2ac4e026616c6c725d2f0fd91e521550" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:43:11 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-5579012c-43b3-45f4-b31a-58d1bfb20250 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Lock "cdf30fec2ac4e026616c6c725d2f0fd91e521550" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:43:11 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-5579012c-43b3-45f4-b31a-58d1bfb20250 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cdf30fec2ac4e026616c6c725d2f0fd91e521550 --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:43:11 user nova-compute[75226]: DEBUG nova.compute.manager [req-55621d5f-1fd3-4427-99c4-4511aeee466d req-64a8bcf4-0965-4a9c-8583-eb01311e1c3a service nova] [instance: 8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02] Received event network-changed-ab437de1-a5c2-48c9-b693-902fc4b05929 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:43:11 user nova-compute[75226]: DEBUG nova.compute.manager [req-55621d5f-1fd3-4427-99c4-4511aeee466d req-64a8bcf4-0965-4a9c-8583-eb01311e1c3a service nova] [instance: 8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02] Refreshing instance network info cache due to event network-changed-ab437de1-a5c2-48c9-b693-902fc4b05929. {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 01:43:11 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-55621d5f-1fd3-4427-99c4-4511aeee466d req-64a8bcf4-0965-4a9c-8583-eb01311e1c3a service nova] Acquiring lock "refresh_cache-8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:43:11 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-55621d5f-1fd3-4427-99c4-4511aeee466d req-64a8bcf4-0965-4a9c-8583-eb01311e1c3a service nova] Acquired lock "refresh_cache-8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:43:11 user nova-compute[75226]: DEBUG nova.network.neutron [req-55621d5f-1fd3-4427-99c4-4511aeee466d req-64a8bcf4-0965-4a9c-8583-eb01311e1c3a service nova] [instance: 8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02] Refreshing network info cache for port ab437de1-a5c2-48c9-b693-902fc4b05929 {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 01:43:11 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-5579012c-43b3-45f4-b31a-58d1bfb20250 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Acquiring lock "refresh_cache-8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:43:11 user nova-compute[75226]: DEBUG nova.network.neutron [req-55621d5f-1fd3-4427-99c4-4511aeee466d req-64a8bcf4-0965-4a9c-8583-eb01311e1c3a service nova] [instance: 8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02] Instance cache missing network info. {{(pid=75226) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 17 01:43:11 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-5579012c-43b3-45f4-b31a-58d1bfb20250 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cdf30fec2ac4e026616c6c725d2f0fd91e521550 --force-share --output=json" returned: 0 in 0.180s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:43:11 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-5579012c-43b3-45f4-b31a-58d1bfb20250 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cdf30fec2ac4e026616c6c725d2f0fd91e521550,backing_fmt=raw /opt/stack/data/nova/instances/8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02/disk 1073741824 {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:43:11 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-5579012c-43b3-45f4-b31a-58d1bfb20250 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cdf30fec2ac4e026616c6c725d2f0fd91e521550,backing_fmt=raw /opt/stack/data/nova/instances/8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02/disk 1073741824" returned: 0 in 0.046s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:43:11 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-5579012c-43b3-45f4-b31a-58d1bfb20250 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Lock "cdf30fec2ac4e026616c6c725d2f0fd91e521550" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.230s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:43:11 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-5579012c-43b3-45f4-b31a-58d1bfb20250 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cdf30fec2ac4e026616c6c725d2f0fd91e521550 --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:43:11 user nova-compute[75226]: DEBUG nova.network.neutron [req-55621d5f-1fd3-4427-99c4-4511aeee466d req-64a8bcf4-0965-4a9c-8583-eb01311e1c3a service nova] [instance: 8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02] Updating instance_info_cache with network_info: [] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:43:11 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-55621d5f-1fd3-4427-99c4-4511aeee466d req-64a8bcf4-0965-4a9c-8583-eb01311e1c3a service nova] Releasing lock "refresh_cache-8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:43:11 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-5579012c-43b3-45f4-b31a-58d1bfb20250 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Acquired lock "refresh_cache-8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:43:11 user nova-compute[75226]: DEBUG nova.network.neutron [None req-5579012c-43b3-45f4-b31a-58d1bfb20250 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] [instance: 8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02] Building network info cache for instance {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 01:43:11 user nova-compute[75226]: DEBUG nova.network.neutron [None req-5579012c-43b3-45f4-b31a-58d1bfb20250 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] [instance: 8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02] Instance cache missing network info. {{(pid=75226) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 17 01:43:11 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-5579012c-43b3-45f4-b31a-58d1bfb20250 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cdf30fec2ac4e026616c6c725d2f0fd91e521550 --force-share --output=json" returned: 0 in 0.177s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:43:11 user nova-compute[75226]: DEBUG nova.virt.disk.api [None req-5579012c-43b3-45f4-b31a-58d1bfb20250 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02/disk. size=1073741824 {{(pid=75226) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 17 01:43:11 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-5579012c-43b3-45f4-b31a-58d1bfb20250 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:43:11 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-5579012c-43b3-45f4-b31a-58d1bfb20250 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:43:11 user nova-compute[75226]: DEBUG nova.virt.disk.api [None req-5579012c-43b3-45f4-b31a-58d1bfb20250 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Cannot resize image /opt/stack/data/nova/instances/8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02/disk to a smaller size. {{(pid=75226) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 17 01:43:11 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-5579012c-43b3-45f4-b31a-58d1bfb20250 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] [instance: 8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02] Created local disks {{(pid=75226) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 17 01:43:11 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-5579012c-43b3-45f4-b31a-58d1bfb20250 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] [instance: 8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02] Ensure instance console log exists: /opt/stack/data/nova/instances/8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02/console.log {{(pid=75226) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 17 01:43:11 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-5579012c-43b3-45f4-b31a-58d1bfb20250 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:43:11 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-5579012c-43b3-45f4-b31a-58d1bfb20250 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:43:11 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-5579012c-43b3-45f4-b31a-58d1bfb20250 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:43:11 user nova-compute[75226]: DEBUG nova.network.neutron [None req-5579012c-43b3-45f4-b31a-58d1bfb20250 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] [instance: 8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02] Updating instance_info_cache with network_info: [{"id": "ab437de1-a5c2-48c9-b693-902fc4b05929", "address": "fa:16:3e:2c:67:4c", "network": {"id": "44f50686-24e7-4e75-8269-4391a53286d0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1611114801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33699aa6c9db4815a1e79aff4685801e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab437de1-a5", "ovs_interfaceid": "ab437de1-a5c2-48c9-b693-902fc4b05929", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:43:11 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-5579012c-43b3-45f4-b31a-58d1bfb20250 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Releasing lock "refresh_cache-8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:43:11 user nova-compute[75226]: DEBUG nova.compute.manager [None req-5579012c-43b3-45f4-b31a-58d1bfb20250 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] [instance: 8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02] Instance network_info: |[{"id": "ab437de1-a5c2-48c9-b693-902fc4b05929", "address": "fa:16:3e:2c:67:4c", "network": {"id": "44f50686-24e7-4e75-8269-4391a53286d0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1611114801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33699aa6c9db4815a1e79aff4685801e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab437de1-a5", "ovs_interfaceid": "ab437de1-a5c2-48c9-b693-902fc4b05929", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75226) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 17 01:43:11 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-5579012c-43b3-45f4-b31a-58d1bfb20250 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] [instance: 8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02] Start _get_guest_xml network_info=[{"id": "ab437de1-a5c2-48c9-b693-902fc4b05929", "address": "fa:16:3e:2c:67:4c", "network": {"id": "44f50686-24e7-4e75-8269-4391a53286d0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1611114801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33699aa6c9db4815a1e79aff4685801e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab437de1-a5", "ovs_interfaceid": "ab437de1-a5c2-48c9-b693-902fc4b05929", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T01:43:07Z,direct_url=<?>,disk_format='qcow2',id=218241c1-772f-4437-81f3-4435b1382dd7,min_disk=0,min_ram=0,name='tempest-scenario-img--1431343804',owner='33699aa6c9db4815a1e79aff4685801e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T01:43:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '218241c1-772f-4437-81f3-4435b1382dd7'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75226) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 17 01:43:11 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-5579012c-43b3-45f4-b31a-58d1bfb20250 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:43:11 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-5579012c-43b3-45f4-b31a-58d1bfb20250 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:43:11 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-5579012c-43b3-45f4-b31a-58d1bfb20250 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75226) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 17 01:43:11 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-5579012c-43b3-45f4-b31a-58d1bfb20250 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] CPU controller missing on host. {{(pid=75226) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 17 01:43:11 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-5579012c-43b3-45f4-b31a-58d1bfb20250 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75226) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 17 01:43:11 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-5579012c-43b3-45f4-b31a-58d1bfb20250 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] CPU controller found on host. {{(pid=75226) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 17 01:43:11 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-5579012c-43b3-45f4-b31a-58d1bfb20250 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75226) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 17 01:43:11 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-5579012c-43b3-45f4-b31a-58d1bfb20250 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-17T01:13:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T01:43:07Z,direct_url=<?>,disk_format='qcow2',id=218241c1-772f-4437-81f3-4435b1382dd7,min_disk=0,min_ram=0,name='tempest-scenario-img--1431343804',owner='33699aa6c9db4815a1e79aff4685801e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T01:43:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 17 01:43:11 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-5579012c-43b3-45f4-b31a-58d1bfb20250 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Flavor limits 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 17 01:43:11 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-5579012c-43b3-45f4-b31a-58d1bfb20250 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Image limits 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 17 01:43:11 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-5579012c-43b3-45f4-b31a-58d1bfb20250 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Flavor pref 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 17 01:43:11 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-5579012c-43b3-45f4-b31a-58d1bfb20250 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Image pref 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 17 01:43:11 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-5579012c-43b3-45f4-b31a-58d1bfb20250 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 17 01:43:11 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-5579012c-43b3-45f4-b31a-58d1bfb20250 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 17 01:43:11 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-5579012c-43b3-45f4-b31a-58d1bfb20250 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75226) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 17 01:43:11 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-5579012c-43b3-45f4-b31a-58d1bfb20250 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Got 1 possible topologies {{(pid=75226) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 17 01:43:11 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-5579012c-43b3-45f4-b31a-58d1bfb20250 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 17 01:43:11 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-5579012c-43b3-45f4-b31a-58d1bfb20250 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 17 01:43:11 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-5579012c-43b3-45f4-b31a-58d1bfb20250 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:43:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-19049581',display_name='tempest-TestMinimumBasicScenario-server-19049581',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-19049581',id=43,image_ref='218241c1-772f-4437-81f3-4435b1382dd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBaM/0RWsFok9ojC6xdyZMKUgHv6UqDSb7moAaCX3tHSg2NxiGgdZ2kXzaKTv6YSEkXErnRxQwqAUAZy2IZPKDWv8v2nT3kM8RsB+C6KhGTyY7FHtl1BpNHwdCU7JVPsJw==',key_name='tempest-TestMinimumBasicScenario-1513477075',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='33699aa6c9db4815a1e79aff4685801e',ramdisk_id='',reservation_id='r-osdhj006',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='218241c1-772f-4437-81f3-4435b1382dd7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1224009744',owner_user_name='tempest-TestMinimumBasicScenario-1224009744-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T01:43:10Z,user_data=None,user_id='e7c57c13ff8a48f7b8b206d71e413646',uuid=8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ab437de1-a5c2-48c9-b693-902fc4b05929", "address": "fa:16:3e:2c:67:4c", "network": {"id": "44f50686-24e7-4e75-8269-4391a53286d0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1611114801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33699aa6c9db4815a1e79aff4685801e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab437de1-a5", "ovs_interfaceid": "ab437de1-a5c2-48c9-b693-902fc4b05929", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75226) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 01:43:11 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-5579012c-43b3-45f4-b31a-58d1bfb20250 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Converting VIF {"id": "ab437de1-a5c2-48c9-b693-902fc4b05929", "address": "fa:16:3e:2c:67:4c", "network": {"id": "44f50686-24e7-4e75-8269-4391a53286d0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1611114801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33699aa6c9db4815a1e79aff4685801e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab437de1-a5", "ovs_interfaceid": "ab437de1-a5c2-48c9-b693-902fc4b05929", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:43:11 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-5579012c-43b3-45f4-b31a-58d1bfb20250 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2c:67:4c,bridge_name='br-int',has_traffic_filtering=True,id=ab437de1-a5c2-48c9-b693-902fc4b05929,network=Network(44f50686-24e7-4e75-8269-4391a53286d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab437de1-a5') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:43:11 user nova-compute[75226]: DEBUG nova.objects.instance [None req-5579012c-43b3-45f4-b31a-58d1bfb20250 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Lazy-loading 'pci_devices' on Instance uuid 8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:43:11 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-5579012c-43b3-45f4-b31a-58d1bfb20250 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] [instance: 8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02] End _get_guest_xml xml=<domain type="kvm">
Nov 17 01:43:11 user nova-compute[75226]:   <uuid>8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02</uuid>
Nov 17 01:43:11 user nova-compute[75226]:   <name>instance-0000002b</name>
Nov 17 01:43:11 user nova-compute[75226]:   <memory>524288</memory>
Nov 17 01:43:11 user nova-compute[75226]:   <vcpu>1</vcpu>
Nov 17 01:43:11 user nova-compute[75226]:   <metadata>
Nov 17 01:43:11 user nova-compute[75226]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 17 01:43:11 user nova-compute[75226]:       <nova:package version="0.0.0"/>
Nov 17 01:43:11 user nova-compute[75226]:       <nova:name>tempest-TestMinimumBasicScenario-server-19049581</nova:name>
Nov 17 01:43:11 user nova-compute[75226]:       <nova:creationTime>2023-11-17 01:43:11</nova:creationTime>
Nov 17 01:43:11 user nova-compute[75226]:       <nova:flavor name="m1.tiny">
Nov 17 01:43:11 user nova-compute[75226]:         <nova:memory>512</nova:memory>
Nov 17 01:43:11 user nova-compute[75226]:         <nova:disk>1</nova:disk>
Nov 17 01:43:11 user nova-compute[75226]:         <nova:swap>0</nova:swap>
Nov 17 01:43:11 user nova-compute[75226]:         <nova:ephemeral>0</nova:ephemeral>
Nov 17 01:43:11 user nova-compute[75226]:         <nova:vcpus>1</nova:vcpus>
Nov 17 01:43:11 user nova-compute[75226]:       </nova:flavor>
Nov 17 01:43:11 user nova-compute[75226]:       <nova:owner>
Nov 17 01:43:11 user nova-compute[75226]:         <nova:user uuid="e7c57c13ff8a48f7b8b206d71e413646">tempest-TestMinimumBasicScenario-1224009744-project-member</nova:user>
Nov 17 01:43:11 user nova-compute[75226]:         <nova:project uuid="33699aa6c9db4815a1e79aff4685801e">tempest-TestMinimumBasicScenario-1224009744</nova:project>
Nov 17 01:43:11 user nova-compute[75226]:       </nova:owner>
Nov 17 01:43:11 user nova-compute[75226]:       <nova:root type="image" uuid="218241c1-772f-4437-81f3-4435b1382dd7"/>
Nov 17 01:43:11 user nova-compute[75226]:       <nova:ports>
Nov 17 01:43:11 user nova-compute[75226]:         <nova:port uuid="ab437de1-a5c2-48c9-b693-902fc4b05929">
Nov 17 01:43:11 user nova-compute[75226]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 17 01:43:11 user nova-compute[75226]:         </nova:port>
Nov 17 01:43:11 user nova-compute[75226]:       </nova:ports>
Nov 17 01:43:11 user nova-compute[75226]:     </nova:instance>
Nov 17 01:43:11 user nova-compute[75226]:   </metadata>
Nov 17 01:43:11 user nova-compute[75226]:   <sysinfo type="smbios">
Nov 17 01:43:11 user nova-compute[75226]:     <system>
Nov 17 01:43:11 user nova-compute[75226]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 17 01:43:11 user nova-compute[75226]:       <entry name="product">OpenStack Nova</entry>
Nov 17 01:43:11 user nova-compute[75226]:       <entry name="version">0.0.0</entry>
Nov 17 01:43:11 user nova-compute[75226]:       <entry name="serial">8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02</entry>
Nov 17 01:43:11 user nova-compute[75226]:       <entry name="uuid">8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02</entry>
Nov 17 01:43:11 user nova-compute[75226]:       <entry name="family">Virtual Machine</entry>
Nov 17 01:43:11 user nova-compute[75226]:     </system>
Nov 17 01:43:11 user nova-compute[75226]:   </sysinfo>
Nov 17 01:43:11 user nova-compute[75226]:   <os>
Nov 17 01:43:11 user nova-compute[75226]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 17 01:43:11 user nova-compute[75226]:     <boot dev="hd"/>
Nov 17 01:43:11 user nova-compute[75226]:     <smbios mode="sysinfo"/>
Nov 17 01:43:11 user nova-compute[75226]:   </os>
Nov 17 01:43:11 user nova-compute[75226]:   <features>
Nov 17 01:43:11 user nova-compute[75226]:     <acpi/>
Nov 17 01:43:11 user nova-compute[75226]:     <apic/>
Nov 17 01:43:11 user nova-compute[75226]:     <vmcoreinfo/>
Nov 17 01:43:11 user nova-compute[75226]:   </features>
Nov 17 01:43:11 user nova-compute[75226]:   <clock offset="utc">
Nov 17 01:43:11 user nova-compute[75226]:     <timer name="pit" tickpolicy="delay"/>
Nov 17 01:43:11 user nova-compute[75226]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 17 01:43:11 user nova-compute[75226]:     <timer name="hpet" present="no"/>
Nov 17 01:43:11 user nova-compute[75226]:   </clock>
Nov 17 01:43:11 user nova-compute[75226]:   <cpu mode="custom" match="exact">
Nov 17 01:43:11 user nova-compute[75226]:     <model>Nehalem</model>
Nov 17 01:43:11 user nova-compute[75226]:     <topology sockets="1" cores="1" threads="1"/>
Nov 17 01:43:11 user nova-compute[75226]:   </cpu>
Nov 17 01:43:11 user nova-compute[75226]:   <devices>
Nov 17 01:43:11 user nova-compute[75226]:     <disk type="file" device="disk">
Nov 17 01:43:11 user nova-compute[75226]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 17 01:43:11 user nova-compute[75226]:       <source file="/opt/stack/data/nova/instances/8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02/disk"/>
Nov 17 01:43:11 user nova-compute[75226]:       <target dev="vda" bus="virtio"/>
Nov 17 01:43:11 user nova-compute[75226]:     </disk>
Nov 17 01:43:11 user nova-compute[75226]:     <interface type="ethernet">
Nov 17 01:43:11 user nova-compute[75226]:       <mac address="fa:16:3e:2c:67:4c"/>
Nov 17 01:43:11 user nova-compute[75226]:       <model type="virtio"/>
Nov 17 01:43:11 user nova-compute[75226]:       <mtu size="1442"/>
Nov 17 01:43:11 user nova-compute[75226]:       <target dev="tapab437de1-a5"/>
Nov 17 01:43:11 user nova-compute[75226]:     </interface>
Nov 17 01:43:11 user nova-compute[75226]:     <serial type="pty">
Nov 17 01:43:11 user nova-compute[75226]:       <log file="/opt/stack/data/nova/instances/8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02/console.log" append="off"/>
Nov 17 01:43:11 user nova-compute[75226]:     </serial>
Nov 17 01:43:11 user nova-compute[75226]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 17 01:43:11 user nova-compute[75226]:     <video>
Nov 17 01:43:11 user nova-compute[75226]:       <model type="virtio"/>
Nov 17 01:43:11 user nova-compute[75226]:     </video>
Nov 17 01:43:11 user nova-compute[75226]:     <rng model="virtio">
Nov 17 01:43:11 user nova-compute[75226]:       <backend model="random">/dev/urandom</backend>
Nov 17 01:43:11 user nova-compute[75226]:     </rng>
Nov 17 01:43:11 user nova-compute[75226]:     <controller type="usb" index="0" model="none"/>
Nov 17 01:43:11 user nova-compute[75226]:     <memballoon model="virtio">
Nov 17 01:43:11 user nova-compute[75226]:       <stats period="10"/>
Nov 17 01:43:11 user nova-compute[75226]:     </memballoon>
Nov 17 01:43:11 user nova-compute[75226]:   </devices>
Nov 17 01:43:11 user nova-compute[75226]: </domain>
Nov 17 01:43:11 user nova-compute[75226]:  {{(pid=75226) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 17 01:43:11 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-5579012c-43b3-45f4-b31a-58d1bfb20250 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:43:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-19049581',display_name='tempest-TestMinimumBasicScenario-server-19049581',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-19049581',id=43,image_ref='218241c1-772f-4437-81f3-4435b1382dd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBaM/0RWsFok9ojC6xdyZMKUgHv6UqDSb7moAaCX3tHSg2NxiGgdZ2kXzaKTv6YSEkXErnRxQwqAUAZy2IZPKDWv8v2nT3kM8RsB+C6KhGTyY7FHtl1BpNHwdCU7JVPsJw==',key_name='tempest-TestMinimumBasicScenario-1513477075',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='33699aa6c9db4815a1e79aff4685801e',ramdisk_id='',reservation_id='r-osdhj006',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='218241c1-772f-4437-81f3-4435b1382dd7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1224009744',owner_user_name='tempest-TestMinimumBasicScenario-1224009744-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T01:43:10Z,user_data=None,user_id='e7c57c13ff8a48f7b8b206d71e413646',uuid=8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ab437de1-a5c2-48c9-b693-902fc4b05929", "address": "fa:16:3e:2c:67:4c", "network": {"id": "44f50686-24e7-4e75-8269-4391a53286d0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1611114801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33699aa6c9db4815a1e79aff4685801e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab437de1-a5", "ovs_interfaceid": "ab437de1-a5c2-48c9-b693-902fc4b05929", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 17 01:43:11 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-5579012c-43b3-45f4-b31a-58d1bfb20250 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Converting VIF {"id": "ab437de1-a5c2-48c9-b693-902fc4b05929", "address": "fa:16:3e:2c:67:4c", "network": {"id": "44f50686-24e7-4e75-8269-4391a53286d0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1611114801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33699aa6c9db4815a1e79aff4685801e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab437de1-a5", "ovs_interfaceid": "ab437de1-a5c2-48c9-b693-902fc4b05929", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:43:11 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-5579012c-43b3-45f4-b31a-58d1bfb20250 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2c:67:4c,bridge_name='br-int',has_traffic_filtering=True,id=ab437de1-a5c2-48c9-b693-902fc4b05929,network=Network(44f50686-24e7-4e75-8269-4391a53286d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab437de1-a5') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:43:11 user nova-compute[75226]: DEBUG os_vif [None req-5579012c-43b3-45f4-b31a-58d1bfb20250 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:67:4c,bridge_name='br-int',has_traffic_filtering=True,id=ab437de1-a5c2-48c9-b693-902fc4b05929,network=Network(44f50686-24e7-4e75-8269-4391a53286d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab437de1-a5') {{(pid=75226) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 17 01:43:11 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:43:11 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:43:11 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 17 01:43:11 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:43:11 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '72fb1083-af73-58a6-b9b5-97869a60e0dd', '_type': 'linux-noop'}}, row=False) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:43:11 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:43:11 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:43:11 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:43:11 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapab437de1-a5, may_exist=True, interface_attrs={}) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:43:11 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapab437de1-a5, col_values=(('qos', UUID('0df36086-bec3-4fad-ba92-82b22a48bfb8')),), if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:43:11 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapab437de1-a5, col_values=(('external_ids', {'iface-id': 'ab437de1-a5c2-48c9-b693-902fc4b05929', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2c:67:4c', 'vm-uuid': '8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02'}),), if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:43:11 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:43:11 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:43:11 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:43:11 user nova-compute[75226]: INFO os_vif [None req-5579012c-43b3-45f4-b31a-58d1bfb20250 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:67:4c,bridge_name='br-int',has_traffic_filtering=True,id=ab437de1-a5c2-48c9-b693-902fc4b05929,network=Network(44f50686-24e7-4e75-8269-4391a53286d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab437de1-a5')
Nov 17 01:43:11 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:43:11 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-5579012c-43b3-45f4-b31a-58d1bfb20250 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] No BDM found with device name vda, not building metadata. {{(pid=75226) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 01:43:11 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-5579012c-43b3-45f4-b31a-58d1bfb20250 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] No VIF found with MAC fa:16:3e:2c:67:4c, not building metadata {{(pid=75226) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 01:43:11 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:43:11 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:43:11 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:43:11 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75226) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 17 01:43:13 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:43:13 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:43:13 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:43:13 user nova-compute[75226]: DEBUG nova.compute.manager [req-de3e95a6-3b26-47b3-bb94-39d3b2a48a97 req-df788bd2-766c-4ef7-8eb4-f52c6736c077 service nova] [instance: 8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02] Received event network-vif-plugged-ab437de1-a5c2-48c9-b693-902fc4b05929 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:43:13 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-de3e95a6-3b26-47b3-bb94-39d3b2a48a97 req-df788bd2-766c-4ef7-8eb4-f52c6736c077 service nova] Acquiring lock "8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:43:13 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-de3e95a6-3b26-47b3-bb94-39d3b2a48a97 req-df788bd2-766c-4ef7-8eb4-f52c6736c077 service nova] Lock "8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:43:13 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-de3e95a6-3b26-47b3-bb94-39d3b2a48a97 req-df788bd2-766c-4ef7-8eb4-f52c6736c077 service nova] Lock "8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:43:13 user nova-compute[75226]: DEBUG nova.compute.manager [req-de3e95a6-3b26-47b3-bb94-39d3b2a48a97 req-df788bd2-766c-4ef7-8eb4-f52c6736c077 service nova] [instance: 8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02] No waiting events found dispatching network-vif-plugged-ab437de1-a5c2-48c9-b693-902fc4b05929 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:43:13 user nova-compute[75226]: WARNING nova.compute.manager [req-de3e95a6-3b26-47b3-bb94-39d3b2a48a97 req-df788bd2-766c-4ef7-8eb4-f52c6736c077 service nova] [instance: 8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02] Received unexpected event network-vif-plugged-ab437de1-a5c2-48c9-b693-902fc4b05929 for instance with vm_state building and task_state spawning.
Nov 17 01:43:13 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75226) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 01:43:13 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f3b54ce-4dc1-445a-9108-3f628713e6ec/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:43:13 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:43:13 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:43:13 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f3b54ce-4dc1-445a-9108-3f628713e6ec/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:43:13 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f3b54ce-4dc1-445a-9108-3f628713e6ec/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:43:14 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f3b54ce-4dc1-445a-9108-3f628713e6ec/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:43:14 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:43:14 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:43:14 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:43:14 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:43:14 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0597c05a-1049-4117-a8ae-8177d590e024/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:43:14 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0597c05a-1049-4117-a8ae-8177d590e024/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:43:14 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0597c05a-1049-4117-a8ae-8177d590e024/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:43:14 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0597c05a-1049-4117-a8ae-8177d590e024/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:43:14 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd76f92b-0181-4291-aee3-9d0ccc095129/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:43:14 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd76f92b-0181-4291-aee3-9d0ccc095129/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:43:14 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd76f92b-0181-4291-aee3-9d0ccc095129/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:43:15 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd76f92b-0181-4291-aee3-9d0ccc095129/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:43:15 user nova-compute[75226]: DEBUG nova.compute.manager [req-fb63bf26-79c8-4dc8-be05-afa998f63b39 req-ad2839b8-2c1f-44ad-a749-e849ef11f62f service nova] [instance: 8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02] Received event network-vif-plugged-ab437de1-a5c2-48c9-b693-902fc4b05929 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:43:15 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-fb63bf26-79c8-4dc8-be05-afa998f63b39 req-ad2839b8-2c1f-44ad-a749-e849ef11f62f service nova] Acquiring lock "8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:43:15 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-fb63bf26-79c8-4dc8-be05-afa998f63b39 req-ad2839b8-2c1f-44ad-a749-e849ef11f62f service nova] Lock "8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:43:15 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-fb63bf26-79c8-4dc8-be05-afa998f63b39 req-ad2839b8-2c1f-44ad-a749-e849ef11f62f service nova] Lock "8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:43:15 user nova-compute[75226]: DEBUG nova.compute.manager [req-fb63bf26-79c8-4dc8-be05-afa998f63b39 req-ad2839b8-2c1f-44ad-a749-e849ef11f62f service nova] [instance: 8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02] No waiting events found dispatching network-vif-plugged-ab437de1-a5c2-48c9-b693-902fc4b05929 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:43:15 user nova-compute[75226]: WARNING nova.compute.manager [req-fb63bf26-79c8-4dc8-be05-afa998f63b39 req-ad2839b8-2c1f-44ad-a749-e849ef11f62f service nova] [instance: 8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02] Received unexpected event network-vif-plugged-ab437de1-a5c2-48c9-b693-902fc4b05929 for instance with vm_state building and task_state spawning.
Nov 17 01:43:15 user nova-compute[75226]: DEBUG nova.compute.manager [None req-5579012c-43b3-45f4-b31a-58d1bfb20250 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] [instance: 8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02] Instance event wait completed in 0 seconds for  {{(pid=75226) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 17 01:43:15 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-5579012c-43b3-45f4-b31a-58d1bfb20250 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] [instance: 8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02] Guest created on hypervisor {{(pid=75226) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 17 01:43:15 user nova-compute[75226]: INFO nova.virt.libvirt.driver [-] [instance: 8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02] Instance spawned successfully.
Nov 17 01:43:15 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:43:15 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:43:15 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Hypervisor/Node resource view: name=user free_ram=8471MB free_disk=24.860462188720703GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75226) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 17 01:43:15 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:43:15 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:43:15 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-5579012c-43b3-45f4-b31a-58d1bfb20250 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] [instance: 8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 17 01:43:15 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-5579012c-43b3-45f4-b31a-58d1bfb20250 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] [instance: 8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02] Found default for hw_cdrom_bus of ide {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:43:15 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-5579012c-43b3-45f4-b31a-58d1bfb20250 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] [instance: 8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02] Found default for hw_disk_bus of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:43:15 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-5579012c-43b3-45f4-b31a-58d1bfb20250 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] [instance: 8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02] Found default for hw_input_bus of None {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:43:15 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-5579012c-43b3-45f4-b31a-58d1bfb20250 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] [instance: 8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02] Found default for hw_pointer_model of None {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:43:15 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-5579012c-43b3-45f4-b31a-58d1bfb20250 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] [instance: 8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02] Found default for hw_video_model of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:43:15 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-5579012c-43b3-45f4-b31a-58d1bfb20250 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] [instance: 8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02] Found default for hw_vif_model of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:43:15 user nova-compute[75226]: INFO nova.compute.manager [None req-5579012c-43b3-45f4-b31a-58d1bfb20250 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] [instance: 8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02] Took 5.94 seconds to spawn the instance on the hypervisor.
Nov 17 01:43:15 user nova-compute[75226]: DEBUG nova.compute.manager [None req-5579012c-43b3-45f4-b31a-58d1bfb20250 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] [instance: 8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02] Checking state {{(pid=75226) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 01:43:15 user nova-compute[75226]: INFO nova.compute.manager [None req-5579012c-43b3-45f4-b31a-58d1bfb20250 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] [instance: 8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02] Took 6.51 seconds to build instance.
Nov 17 01:43:15 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-5579012c-43b3-45f4-b31a-58d1bfb20250 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Lock "8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.604s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:43:15 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 0597c05a-1049-4117-a8ae-8177d590e024 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:43:15 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 6f3b54ce-4dc1-445a-9108-3f628713e6ec actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:43:15 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance bd76f92b-0181-4291-aee3-9d0ccc095129 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:43:15 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 9c009cf0-99b6-4dc9-931e-b79ef4e2fc3a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:43:15 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:43:15 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75226) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 17 01:43:15 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75226) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 17 01:43:15 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:43:15 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:43:16 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Compute_service record updated for user:user {{(pid=75226) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 17 01:43:16 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.456s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:43:16 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:43:18 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:43:19 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:43:19 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:43:19 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:43:20 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:43:21 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:43:21 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:43:23 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:43:23 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Starting heal instance info cache {{(pid=75226) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 17 01:43:23 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Rebuilding the list of instances to heal {{(pid=75226) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 17 01:43:24 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "refresh_cache-0597c05a-1049-4117-a8ae-8177d590e024" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:43:24 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquired lock "refresh_cache-0597c05a-1049-4117-a8ae-8177d590e024" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:43:24 user nova-compute[75226]: DEBUG nova.network.neutron [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] [instance: 0597c05a-1049-4117-a8ae-8177d590e024] Forcefully refreshing network info cache for instance {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 17 01:43:24 user nova-compute[75226]: DEBUG nova.objects.instance [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lazy-loading 'info_cache' on Instance uuid 0597c05a-1049-4117-a8ae-8177d590e024 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:43:24 user nova-compute[75226]: DEBUG nova.network.neutron [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] [instance: 0597c05a-1049-4117-a8ae-8177d590e024] Updating instance_info_cache with network_info: [{"id": "e8a7ded4-d849-40ce-a0a9-ecf66e146e56", "address": "fa:16:3e:6d:db:0b", "network": {"id": "b6c26fa5-eacc-41d3-b790-795e59c84966", "bridge": "br-int", "label": "tempest-TestStampPattern-2002555642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8046d4519e4b4f0b864f9ea10a4886fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8a7ded4-d8", "ovs_interfaceid": "e8a7ded4-d849-40ce-a0a9-ecf66e146e56", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:43:24 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Releasing lock "refresh_cache-0597c05a-1049-4117-a8ae-8177d590e024" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:43:24 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] [instance: 0597c05a-1049-4117-a8ae-8177d590e024] Updated the network info_cache for instance {{(pid=75226) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 17 01:43:24 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:43:26 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:43:27 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:43:27 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:43:28 user nova-compute[75226]: DEBUG nova.compute.manager [req-23796f62-c832-4506-99d6-9570ce1141d8 req-43d65d2b-3e5e-46f2-a604-4d986c8a4957 service nova] [instance: 6f3b54ce-4dc1-445a-9108-3f628713e6ec] Received event network-changed-eacf2a0d-87c7-49a0-bc53-5412b6c4a19c {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:43:28 user nova-compute[75226]: DEBUG nova.compute.manager [req-23796f62-c832-4506-99d6-9570ce1141d8 req-43d65d2b-3e5e-46f2-a604-4d986c8a4957 service nova] [instance: 6f3b54ce-4dc1-445a-9108-3f628713e6ec] Refreshing instance network info cache due to event network-changed-eacf2a0d-87c7-49a0-bc53-5412b6c4a19c. {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 01:43:28 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-23796f62-c832-4506-99d6-9570ce1141d8 req-43d65d2b-3e5e-46f2-a604-4d986c8a4957 service nova] Acquiring lock "refresh_cache-6f3b54ce-4dc1-445a-9108-3f628713e6ec" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:43:28 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-23796f62-c832-4506-99d6-9570ce1141d8 req-43d65d2b-3e5e-46f2-a604-4d986c8a4957 service nova] Acquired lock "refresh_cache-6f3b54ce-4dc1-445a-9108-3f628713e6ec" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:43:28 user nova-compute[75226]: DEBUG nova.network.neutron [req-23796f62-c832-4506-99d6-9570ce1141d8 req-43d65d2b-3e5e-46f2-a604-4d986c8a4957 service nova] [instance: 6f3b54ce-4dc1-445a-9108-3f628713e6ec] Refreshing network info cache for port eacf2a0d-87c7-49a0-bc53-5412b6c4a19c {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 01:43:28 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:43:28 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75226) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 17 01:43:28 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:43:28 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-1a753357-be7f-42e6-8cde-d55c86b3a031 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Acquiring lock "6f3b54ce-4dc1-445a-9108-3f628713e6ec" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:43:28 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-1a753357-be7f-42e6-8cde-d55c86b3a031 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Lock "6f3b54ce-4dc1-445a-9108-3f628713e6ec" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:43:28 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-1a753357-be7f-42e6-8cde-d55c86b3a031 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Acquiring lock "6f3b54ce-4dc1-445a-9108-3f628713e6ec-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:43:28 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-1a753357-be7f-42e6-8cde-d55c86b3a031 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Lock "6f3b54ce-4dc1-445a-9108-3f628713e6ec-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:43:28 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-1a753357-be7f-42e6-8cde-d55c86b3a031 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Lock "6f3b54ce-4dc1-445a-9108-3f628713e6ec-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:43:28 user nova-compute[75226]: INFO nova.compute.manager [None req-1a753357-be7f-42e6-8cde-d55c86b3a031 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] [instance: 6f3b54ce-4dc1-445a-9108-3f628713e6ec] Terminating instance
Nov 17 01:43:28 user nova-compute[75226]: DEBUG nova.compute.manager [None req-1a753357-be7f-42e6-8cde-d55c86b3a031 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] [instance: 6f3b54ce-4dc1-445a-9108-3f628713e6ec] Start destroying the instance on the hypervisor. {{(pid=75226) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 17 01:43:28 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:43:28 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:43:28 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:43:28 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:43:28 user nova-compute[75226]: DEBUG nova.network.neutron [req-23796f62-c832-4506-99d6-9570ce1141d8 req-43d65d2b-3e5e-46f2-a604-4d986c8a4957 service nova] [instance: 6f3b54ce-4dc1-445a-9108-3f628713e6ec] Updated VIF entry in instance network info cache for port eacf2a0d-87c7-49a0-bc53-5412b6c4a19c. {{(pid=75226) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 01:43:28 user nova-compute[75226]: DEBUG nova.network.neutron [req-23796f62-c832-4506-99d6-9570ce1141d8 req-43d65d2b-3e5e-46f2-a604-4d986c8a4957 service nova] [instance: 6f3b54ce-4dc1-445a-9108-3f628713e6ec] Updating instance_info_cache with network_info: [{"id": "eacf2a0d-87c7-49a0-bc53-5412b6c4a19c", "address": "fa:16:3e:8a:af:7c", "network": {"id": "b6c26fa5-eacc-41d3-b790-795e59c84966", "bridge": "br-int", "label": "tempest-TestStampPattern-2002555642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8046d4519e4b4f0b864f9ea10a4886fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeacf2a0d-87", "ovs_interfaceid": "eacf2a0d-87c7-49a0-bc53-5412b6c4a19c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:43:28 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-23796f62-c832-4506-99d6-9570ce1141d8 req-43d65d2b-3e5e-46f2-a604-4d986c8a4957 service nova] Releasing lock "refresh_cache-6f3b54ce-4dc1-445a-9108-3f628713e6ec" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:43:28 user nova-compute[75226]: INFO nova.virt.libvirt.driver [-] [instance: 6f3b54ce-4dc1-445a-9108-3f628713e6ec] Instance destroyed successfully.
Nov 17 01:43:28 user nova-compute[75226]: DEBUG nova.objects.instance [None req-1a753357-be7f-42e6-8cde-d55c86b3a031 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Lazy-loading 'resources' on Instance uuid 6f3b54ce-4dc1-445a-9108-3f628713e6ec {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:43:28 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-1a753357-be7f-42e6-8cde-d55c86b3a031 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:40:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-584158405',display_name='tempest-TestStampPattern-server-584158405',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-584158405',id=40,image_ref='a5779370-ca0e-4d81-9e6f-9f3e641698c8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJo/tAB5VbatxtFO3qcGvVQYO+DJCVCBnHzmF73L8NhWbPARofXbPE3d/rvN9G86C2CwqSw7WTEjMfEOGTjqYfRxtLwEwauLFrL7ndRptXBl9uTXrST97QU1m8g2Jvz0/g==',key_name='tempest-TestStampPattern-635437790',keypairs=<?>,launch_index=0,launched_at=2023-11-17T01:40:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8046d4519e4b4f0b864f9ea10a4886fa',ramdisk_id='',reservation_id='r-74yv4vnz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='0597c05a-1049-4117-a8ae-8177d590e024',image_min_disk='1',image_min_ram='0',image_owner_id='8046d4519e4b4f0b864f9ea10a4886fa',image_owner_project_name='tempest-TestStampPattern-266167712',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-266167712-project-member',image_user_id='0357cbff2e7f4a3ebf4ab02e717b451f',owner_project_name='tempest-TestStampPattern-266167712',owner_user_name='tempest-TestStampPattern-266167712-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T01:40:42Z,user_data=None,user_id='0357cbff2e7f4a3ebf4ab02e717b451f',uuid=6f3b54ce-4dc1-445a-9108-3f628713e6ec,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eacf2a0d-87c7-49a0-bc53-5412b6c4a19c", "address": "fa:16:3e:8a:af:7c", "network": {"id": "b6c26fa5-eacc-41d3-b790-795e59c84966", "bridge": "br-int", "label": "tempest-TestStampPattern-2002555642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8046d4519e4b4f0b864f9ea10a4886fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeacf2a0d-87", "ovs_interfaceid": "eacf2a0d-87c7-49a0-bc53-5412b6c4a19c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 17 01:43:28 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-1a753357-be7f-42e6-8cde-d55c86b3a031 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Converting VIF {"id": "eacf2a0d-87c7-49a0-bc53-5412b6c4a19c", "address": "fa:16:3e:8a:af:7c", "network": {"id": "b6c26fa5-eacc-41d3-b790-795e59c84966", "bridge": "br-int", "label": "tempest-TestStampPattern-2002555642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8046d4519e4b4f0b864f9ea10a4886fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeacf2a0d-87", "ovs_interfaceid": "eacf2a0d-87c7-49a0-bc53-5412b6c4a19c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:43:28 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-1a753357-be7f-42e6-8cde-d55c86b3a031 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8a:af:7c,bridge_name='br-int',has_traffic_filtering=True,id=eacf2a0d-87c7-49a0-bc53-5412b6c4a19c,network=Network(b6c26fa5-eacc-41d3-b790-795e59c84966),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeacf2a0d-87') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:43:28 user nova-compute[75226]: DEBUG os_vif [None req-1a753357-be7f-42e6-8cde-d55c86b3a031 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8a:af:7c,bridge_name='br-int',has_traffic_filtering=True,id=eacf2a0d-87c7-49a0-bc53-5412b6c4a19c,network=Network(b6c26fa5-eacc-41d3-b790-795e59c84966),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeacf2a0d-87') {{(pid=75226) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 17 01:43:28 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:43:28 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeacf2a0d-87, bridge=br-int, if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:43:28 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:43:28 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:43:28 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d7870e37-a5db-4353-8b6d-b4e457f12ee9) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:43:28 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:43:28 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:43:28 user nova-compute[75226]: INFO os_vif [None req-1a753357-be7f-42e6-8cde-d55c86b3a031 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8a:af:7c,bridge_name='br-int',has_traffic_filtering=True,id=eacf2a0d-87c7-49a0-bc53-5412b6c4a19c,network=Network(b6c26fa5-eacc-41d3-b790-795e59c84966),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeacf2a0d-87')
Nov 17 01:43:28 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-1a753357-be7f-42e6-8cde-d55c86b3a031 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] [instance: 6f3b54ce-4dc1-445a-9108-3f628713e6ec] Deleting instance files /opt/stack/data/nova/instances/6f3b54ce-4dc1-445a-9108-3f628713e6ec_del
Nov 17 01:43:28 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-1a753357-be7f-42e6-8cde-d55c86b3a031 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] [instance: 6f3b54ce-4dc1-445a-9108-3f628713e6ec] Deletion of /opt/stack/data/nova/instances/6f3b54ce-4dc1-445a-9108-3f628713e6ec_del complete
Nov 17 01:43:28 user nova-compute[75226]: INFO nova.compute.manager [None req-1a753357-be7f-42e6-8cde-d55c86b3a031 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] [instance: 6f3b54ce-4dc1-445a-9108-3f628713e6ec] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 17 01:43:28 user nova-compute[75226]: DEBUG oslo.service.loopingcall [None req-1a753357-be7f-42e6-8cde-d55c86b3a031 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75226) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 17 01:43:28 user nova-compute[75226]: DEBUG nova.compute.manager [-] [instance: 6f3b54ce-4dc1-445a-9108-3f628713e6ec] Deallocating network for instance {{(pid=75226) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 17 01:43:28 user nova-compute[75226]: DEBUG nova.network.neutron [-] [instance: 6f3b54ce-4dc1-445a-9108-3f628713e6ec] deallocate_for_instance() {{(pid=75226) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 17 01:43:29 user nova-compute[75226]: DEBUG nova.network.neutron [-] [instance: 6f3b54ce-4dc1-445a-9108-3f628713e6ec] Updating instance_info_cache with network_info: [] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:43:29 user nova-compute[75226]: INFO nova.compute.manager [-] [instance: 6f3b54ce-4dc1-445a-9108-3f628713e6ec] Took 0.43 seconds to deallocate network for instance.
Nov 17 01:43:29 user nova-compute[75226]: DEBUG nova.compute.manager [req-b4b66b96-d885-4295-a3bc-4cc351eccbb3 req-e1ef28b1-05aa-4905-8146-0478b1e5da87 service nova] [instance: 6f3b54ce-4dc1-445a-9108-3f628713e6ec] Received event network-vif-deleted-eacf2a0d-87c7-49a0-bc53-5412b6c4a19c {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:43:29 user nova-compute[75226]: INFO nova.compute.manager [req-b4b66b96-d885-4295-a3bc-4cc351eccbb3 req-e1ef28b1-05aa-4905-8146-0478b1e5da87 service nova] [instance: 6f3b54ce-4dc1-445a-9108-3f628713e6ec] Neutron deleted interface eacf2a0d-87c7-49a0-bc53-5412b6c4a19c; detaching it from the instance and deleting it from the info cache
Nov 17 01:43:29 user nova-compute[75226]: DEBUG nova.network.neutron [req-b4b66b96-d885-4295-a3bc-4cc351eccbb3 req-e1ef28b1-05aa-4905-8146-0478b1e5da87 service nova] [instance: 6f3b54ce-4dc1-445a-9108-3f628713e6ec] Updating instance_info_cache with network_info: [] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:43:29 user nova-compute[75226]: DEBUG nova.compute.manager [req-b4b66b96-d885-4295-a3bc-4cc351eccbb3 req-e1ef28b1-05aa-4905-8146-0478b1e5da87 service nova] [instance: 6f3b54ce-4dc1-445a-9108-3f628713e6ec] Detach interface failed, port_id=eacf2a0d-87c7-49a0-bc53-5412b6c4a19c, reason: Instance 6f3b54ce-4dc1-445a-9108-3f628713e6ec could not be found. {{(pid=75226) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 17 01:43:29 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-1a753357-be7f-42e6-8cde-d55c86b3a031 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:43:29 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-1a753357-be7f-42e6-8cde-d55c86b3a031 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:43:29 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-1a753357-be7f-42e6-8cde-d55c86b3a031 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:43:29 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-1a753357-be7f-42e6-8cde-d55c86b3a031 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:43:29 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-1a753357-be7f-42e6-8cde-d55c86b3a031 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.208s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:43:29 user nova-compute[75226]: INFO nova.scheduler.client.report [None req-1a753357-be7f-42e6-8cde-d55c86b3a031 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Deleted allocations for instance 6f3b54ce-4dc1-445a-9108-3f628713e6ec
Nov 17 01:43:29 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-1a753357-be7f-42e6-8cde-d55c86b3a031 tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Lock "6f3b54ce-4dc1-445a-9108-3f628713e6ec" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.673s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:43:29 user nova-compute[75226]: DEBUG nova.compute.manager [req-91b74117-d825-4486-b084-db9211126578 req-ed5e4118-f456-45a0-91d8-f5599763ac4d service nova] [instance: 6f3b54ce-4dc1-445a-9108-3f628713e6ec] Received event network-vif-unplugged-eacf2a0d-87c7-49a0-bc53-5412b6c4a19c {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:43:29 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-91b74117-d825-4486-b084-db9211126578 req-ed5e4118-f456-45a0-91d8-f5599763ac4d service nova] Acquiring lock "6f3b54ce-4dc1-445a-9108-3f628713e6ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:43:29 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-91b74117-d825-4486-b084-db9211126578 req-ed5e4118-f456-45a0-91d8-f5599763ac4d service nova] Lock "6f3b54ce-4dc1-445a-9108-3f628713e6ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:43:29 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-91b74117-d825-4486-b084-db9211126578 req-ed5e4118-f456-45a0-91d8-f5599763ac4d service nova] Lock "6f3b54ce-4dc1-445a-9108-3f628713e6ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:43:29 user nova-compute[75226]: DEBUG nova.compute.manager [req-91b74117-d825-4486-b084-db9211126578 req-ed5e4118-f456-45a0-91d8-f5599763ac4d service nova] [instance: 6f3b54ce-4dc1-445a-9108-3f628713e6ec] No waiting events found dispatching network-vif-unplugged-eacf2a0d-87c7-49a0-bc53-5412b6c4a19c {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:43:29 user nova-compute[75226]: WARNING nova.compute.manager [req-91b74117-d825-4486-b084-db9211126578 req-ed5e4118-f456-45a0-91d8-f5599763ac4d service nova] [instance: 6f3b54ce-4dc1-445a-9108-3f628713e6ec] Received unexpected event network-vif-unplugged-eacf2a0d-87c7-49a0-bc53-5412b6c4a19c for instance with vm_state deleted and task_state None.
Nov 17 01:43:29 user nova-compute[75226]: DEBUG nova.compute.manager [req-91b74117-d825-4486-b084-db9211126578 req-ed5e4118-f456-45a0-91d8-f5599763ac4d service nova] [instance: 6f3b54ce-4dc1-445a-9108-3f628713e6ec] Received event network-vif-plugged-eacf2a0d-87c7-49a0-bc53-5412b6c4a19c {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:43:29 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-91b74117-d825-4486-b084-db9211126578 req-ed5e4118-f456-45a0-91d8-f5599763ac4d service nova] Acquiring lock "6f3b54ce-4dc1-445a-9108-3f628713e6ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:43:29 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-91b74117-d825-4486-b084-db9211126578 req-ed5e4118-f456-45a0-91d8-f5599763ac4d service nova] Lock "6f3b54ce-4dc1-445a-9108-3f628713e6ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:43:29 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-91b74117-d825-4486-b084-db9211126578 req-ed5e4118-f456-45a0-91d8-f5599763ac4d service nova] Lock "6f3b54ce-4dc1-445a-9108-3f628713e6ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:43:29 user nova-compute[75226]: DEBUG nova.compute.manager [req-91b74117-d825-4486-b084-db9211126578 req-ed5e4118-f456-45a0-91d8-f5599763ac4d service nova] [instance: 6f3b54ce-4dc1-445a-9108-3f628713e6ec] No waiting events found dispatching network-vif-plugged-eacf2a0d-87c7-49a0-bc53-5412b6c4a19c {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:43:29 user nova-compute[75226]: WARNING nova.compute.manager [req-91b74117-d825-4486-b084-db9211126578 req-ed5e4118-f456-45a0-91d8-f5599763ac4d service nova] [instance: 6f3b54ce-4dc1-445a-9108-3f628713e6ec] Received unexpected event network-vif-plugged-eacf2a0d-87c7-49a0-bc53-5412b6c4a19c for instance with vm_state deleted and task_state None.
Nov 17 01:43:30 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:43:33 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:43:33 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:43:33 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:43:33 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75226) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 17 01:43:34 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:43:34 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Cleaning up deleted instances {{(pid=75226) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 17 01:43:35 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] There are 0 instances to clean {{(pid=75226) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 17 01:43:38 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:43:38 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:43:43 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:43:43 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:43:48 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:43:48 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:43:52 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:43:53 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-3464c9d9-f000-441d-b2be-8bfe958743bc tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] Acquiring lock "bd76f92b-0181-4291-aee3-9d0ccc095129" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:43:53 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-3464c9d9-f000-441d-b2be-8bfe958743bc tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] Lock "bd76f92b-0181-4291-aee3-9d0ccc095129" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:43:53 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-3464c9d9-f000-441d-b2be-8bfe958743bc tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] Acquiring lock "bd76f92b-0181-4291-aee3-9d0ccc095129-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:43:53 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-3464c9d9-f000-441d-b2be-8bfe958743bc tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] Lock "bd76f92b-0181-4291-aee3-9d0ccc095129-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:43:53 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-3464c9d9-f000-441d-b2be-8bfe958743bc tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] Lock "bd76f92b-0181-4291-aee3-9d0ccc095129-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:43:53 user nova-compute[75226]: INFO nova.compute.manager [None req-3464c9d9-f000-441d-b2be-8bfe958743bc tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] [instance: bd76f92b-0181-4291-aee3-9d0ccc095129] Terminating instance
Nov 17 01:43:53 user nova-compute[75226]: DEBUG nova.compute.manager [None req-3464c9d9-f000-441d-b2be-8bfe958743bc tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] [instance: bd76f92b-0181-4291-aee3-9d0ccc095129] Start destroying the instance on the hypervisor. {{(pid=75226) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 17 01:43:53 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:43:53 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:43:53 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:43:53 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:43:53 user nova-compute[75226]: DEBUG nova.compute.manager [req-0cb9e08a-2e95-4536-843b-e099a4409192 req-223c3f3a-87fc-4c6d-8fb7-cefe6d05be6a service nova] [instance: bd76f92b-0181-4291-aee3-9d0ccc095129] Received event network-vif-unplugged-0e9eda20-45e5-4acc-9343-366f0d5caccb {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:43:53 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-0cb9e08a-2e95-4536-843b-e099a4409192 req-223c3f3a-87fc-4c6d-8fb7-cefe6d05be6a service nova] Acquiring lock "bd76f92b-0181-4291-aee3-9d0ccc095129-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:43:53 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-0cb9e08a-2e95-4536-843b-e099a4409192 req-223c3f3a-87fc-4c6d-8fb7-cefe6d05be6a service nova] Lock "bd76f92b-0181-4291-aee3-9d0ccc095129-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:43:53 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-0cb9e08a-2e95-4536-843b-e099a4409192 req-223c3f3a-87fc-4c6d-8fb7-cefe6d05be6a service nova] Lock "bd76f92b-0181-4291-aee3-9d0ccc095129-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:43:53 user nova-compute[75226]: DEBUG nova.compute.manager [req-0cb9e08a-2e95-4536-843b-e099a4409192 req-223c3f3a-87fc-4c6d-8fb7-cefe6d05be6a service nova] [instance: bd76f92b-0181-4291-aee3-9d0ccc095129] No waiting events found dispatching network-vif-unplugged-0e9eda20-45e5-4acc-9343-366f0d5caccb {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:43:53 user nova-compute[75226]: DEBUG nova.compute.manager [req-0cb9e08a-2e95-4536-843b-e099a4409192 req-223c3f3a-87fc-4c6d-8fb7-cefe6d05be6a service nova] [instance: bd76f92b-0181-4291-aee3-9d0ccc095129] Received event network-vif-unplugged-0e9eda20-45e5-4acc-9343-366f0d5caccb for instance with task_state deleting. {{(pid=75226) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 17 01:43:53 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:43:53 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:43:53 user nova-compute[75226]: INFO nova.virt.libvirt.driver [-] [instance: bd76f92b-0181-4291-aee3-9d0ccc095129] Instance destroyed successfully.
Nov 17 01:43:53 user nova-compute[75226]: DEBUG nova.objects.instance [None req-3464c9d9-f000-441d-b2be-8bfe958743bc tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] Lazy-loading 'resources' on Instance uuid bd76f92b-0181-4291-aee3-9d0ccc095129 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:43:53 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-3464c9d9-f000-441d-b2be-8bfe958743bc tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:42:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1608543635',display_name='tempest-VolumesActionsTest-instance-1608543635',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1608543635',id=41,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-17T01:42:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='50f00bc826d34bbb8f2f93b550b7431a',ramdisk_id='',reservation_id='r-s0unyo31',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1397730864',owner_user_name='tempest-VolumesActionsTest-1397730864-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T01:42:09Z,user_data=None,user_id='2aa9906ec44847448446b6fb94339028',uuid=bd76f92b-0181-4291-aee3-9d0ccc095129,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0e9eda20-45e5-4acc-9343-366f0d5caccb", "address": "fa:16:3e:8b:74:bd", "network": {"id": "fe08b87c-6bf1-4842-a770-6522ba026ba4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1133747653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50f00bc826d34bbb8f2f93b550b7431a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e9eda20-45", "ovs_interfaceid": "0e9eda20-45e5-4acc-9343-366f0d5caccb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 17 01:43:53 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-3464c9d9-f000-441d-b2be-8bfe958743bc tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] Converting VIF {"id": "0e9eda20-45e5-4acc-9343-366f0d5caccb", "address": "fa:16:3e:8b:74:bd", "network": {"id": "fe08b87c-6bf1-4842-a770-6522ba026ba4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1133747653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50f00bc826d34bbb8f2f93b550b7431a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e9eda20-45", "ovs_interfaceid": "0e9eda20-45e5-4acc-9343-366f0d5caccb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:43:53 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-3464c9d9-f000-441d-b2be-8bfe958743bc tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:74:bd,bridge_name='br-int',has_traffic_filtering=True,id=0e9eda20-45e5-4acc-9343-366f0d5caccb,network=Network(fe08b87c-6bf1-4842-a770-6522ba026ba4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e9eda20-45') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:43:53 user nova-compute[75226]: DEBUG os_vif [None req-3464c9d9-f000-441d-b2be-8bfe958743bc tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:74:bd,bridge_name='br-int',has_traffic_filtering=True,id=0e9eda20-45e5-4acc-9343-366f0d5caccb,network=Network(fe08b87c-6bf1-4842-a770-6522ba026ba4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e9eda20-45') {{(pid=75226) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 17 01:43:53 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:43:53 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0e9eda20-45, bridge=br-int, if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:43:53 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:43:53 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:43:53 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9e42a536-d7d3-4be8-b873-05b9aefd3f85) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:43:53 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:43:53 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:43:53 user nova-compute[75226]: INFO os_vif [None req-3464c9d9-f000-441d-b2be-8bfe958743bc tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:74:bd,bridge_name='br-int',has_traffic_filtering=True,id=0e9eda20-45e5-4acc-9343-366f0d5caccb,network=Network(fe08b87c-6bf1-4842-a770-6522ba026ba4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e9eda20-45')
Nov 17 01:43:53 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-3464c9d9-f000-441d-b2be-8bfe958743bc tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] [instance: bd76f92b-0181-4291-aee3-9d0ccc095129] Deleting instance files /opt/stack/data/nova/instances/bd76f92b-0181-4291-aee3-9d0ccc095129_del
Nov 17 01:43:53 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-3464c9d9-f000-441d-b2be-8bfe958743bc tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] [instance: bd76f92b-0181-4291-aee3-9d0ccc095129] Deletion of /opt/stack/data/nova/instances/bd76f92b-0181-4291-aee3-9d0ccc095129_del complete
Nov 17 01:43:54 user nova-compute[75226]: INFO nova.compute.manager [None req-3464c9d9-f000-441d-b2be-8bfe958743bc tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] [instance: bd76f92b-0181-4291-aee3-9d0ccc095129] Took 0.97 seconds to destroy the instance on the hypervisor.
Nov 17 01:43:54 user nova-compute[75226]: DEBUG oslo.service.loopingcall [None req-3464c9d9-f000-441d-b2be-8bfe958743bc tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75226) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 17 01:43:54 user nova-compute[75226]: DEBUG nova.compute.manager [-] [instance: bd76f92b-0181-4291-aee3-9d0ccc095129] Deallocating network for instance {{(pid=75226) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 17 01:43:54 user nova-compute[75226]: DEBUG nova.network.neutron [-] [instance: bd76f92b-0181-4291-aee3-9d0ccc095129] deallocate_for_instance() {{(pid=75226) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 17 01:43:54 user nova-compute[75226]: DEBUG nova.network.neutron [-] [instance: bd76f92b-0181-4291-aee3-9d0ccc095129] Updating instance_info_cache with network_info: [] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:43:54 user nova-compute[75226]: INFO nova.compute.manager [-] [instance: bd76f92b-0181-4291-aee3-9d0ccc095129] Took 0.48 seconds to deallocate network for instance.
Nov 17 01:43:54 user nova-compute[75226]: DEBUG nova.compute.manager [req-be473694-b2ec-43a1-9947-ed43a9cf2c4b req-df7d6361-5621-4916-90ae-f3360154fa79 service nova] [instance: bd76f92b-0181-4291-aee3-9d0ccc095129] Received event network-vif-deleted-0e9eda20-45e5-4acc-9343-366f0d5caccb {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:43:54 user nova-compute[75226]: INFO nova.compute.manager [req-be473694-b2ec-43a1-9947-ed43a9cf2c4b req-df7d6361-5621-4916-90ae-f3360154fa79 service nova] [instance: bd76f92b-0181-4291-aee3-9d0ccc095129] Neutron deleted interface 0e9eda20-45e5-4acc-9343-366f0d5caccb; detaching it from the instance and deleting it from the info cache
Nov 17 01:43:54 user nova-compute[75226]: DEBUG nova.network.neutron [req-be473694-b2ec-43a1-9947-ed43a9cf2c4b req-df7d6361-5621-4916-90ae-f3360154fa79 service nova] [instance: bd76f92b-0181-4291-aee3-9d0ccc095129] Updating instance_info_cache with network_info: [] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:43:54 user nova-compute[75226]: DEBUG nova.compute.manager [req-be473694-b2ec-43a1-9947-ed43a9cf2c4b req-df7d6361-5621-4916-90ae-f3360154fa79 service nova] [instance: bd76f92b-0181-4291-aee3-9d0ccc095129] Detach interface failed, port_id=0e9eda20-45e5-4acc-9343-366f0d5caccb, reason: Instance bd76f92b-0181-4291-aee3-9d0ccc095129 could not be found. {{(pid=75226) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 17 01:43:54 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-3464c9d9-f000-441d-b2be-8bfe958743bc tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:43:54 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-3464c9d9-f000-441d-b2be-8bfe958743bc tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:43:54 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-3464c9d9-f000-441d-b2be-8bfe958743bc tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:43:54 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-3464c9d9-f000-441d-b2be-8bfe958743bc tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:43:54 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-3464c9d9-f000-441d-b2be-8bfe958743bc tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.248s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:43:54 user nova-compute[75226]: INFO nova.scheduler.client.report [None req-3464c9d9-f000-441d-b2be-8bfe958743bc tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] Deleted allocations for instance bd76f92b-0181-4291-aee3-9d0ccc095129
Nov 17 01:43:54 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-3464c9d9-f000-441d-b2be-8bfe958743bc tempest-VolumesActionsTest-1397730864 tempest-VolumesActionsTest-1397730864-project-member] Lock "bd76f92b-0181-4291-aee3-9d0ccc095129" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.883s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:43:55 user nova-compute[75226]: DEBUG nova.compute.manager [req-6c3e8598-2528-4347-b6e8-cc824a183284 req-442bc00d-8678-4e81-9c68-489154b6526d service nova] [instance: bd76f92b-0181-4291-aee3-9d0ccc095129] Received event network-vif-plugged-0e9eda20-45e5-4acc-9343-366f0d5caccb {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:43:55 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-6c3e8598-2528-4347-b6e8-cc824a183284 req-442bc00d-8678-4e81-9c68-489154b6526d service nova] Acquiring lock "bd76f92b-0181-4291-aee3-9d0ccc095129-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:43:55 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-6c3e8598-2528-4347-b6e8-cc824a183284 req-442bc00d-8678-4e81-9c68-489154b6526d service nova] Lock "bd76f92b-0181-4291-aee3-9d0ccc095129-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:43:55 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-6c3e8598-2528-4347-b6e8-cc824a183284 req-442bc00d-8678-4e81-9c68-489154b6526d service nova] Lock "bd76f92b-0181-4291-aee3-9d0ccc095129-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:43:55 user nova-compute[75226]: DEBUG nova.compute.manager [req-6c3e8598-2528-4347-b6e8-cc824a183284 req-442bc00d-8678-4e81-9c68-489154b6526d service nova] [instance: bd76f92b-0181-4291-aee3-9d0ccc095129] No waiting events found dispatching network-vif-plugged-0e9eda20-45e5-4acc-9343-366f0d5caccb {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:43:55 user nova-compute[75226]: WARNING nova.compute.manager [req-6c3e8598-2528-4347-b6e8-cc824a183284 req-442bc00d-8678-4e81-9c68-489154b6526d service nova] [instance: bd76f92b-0181-4291-aee3-9d0ccc095129] Received unexpected event network-vif-plugged-0e9eda20-45e5-4acc-9343-366f0d5caccb for instance with vm_state deleted and task_state None.
Nov 17 01:43:58 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:44:02 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:44:03 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:44:05 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:44:07 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-f2c70d95-ae87-46f6-89b6-0ea0de8c87db tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Acquiring lock "9c009cf0-99b6-4dc9-931e-b79ef4e2fc3a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:44:07 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-f2c70d95-ae87-46f6-89b6-0ea0de8c87db tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Lock "9c009cf0-99b6-4dc9-931e-b79ef4e2fc3a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:44:07 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-f2c70d95-ae87-46f6-89b6-0ea0de8c87db tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Acquiring lock "9c009cf0-99b6-4dc9-931e-b79ef4e2fc3a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:44:07 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-f2c70d95-ae87-46f6-89b6-0ea0de8c87db tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Lock "9c009cf0-99b6-4dc9-931e-b79ef4e2fc3a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:44:07 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-f2c70d95-ae87-46f6-89b6-0ea0de8c87db tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Lock "9c009cf0-99b6-4dc9-931e-b79ef4e2fc3a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:44:07 user nova-compute[75226]: INFO nova.compute.manager [None req-f2c70d95-ae87-46f6-89b6-0ea0de8c87db tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: 9c009cf0-99b6-4dc9-931e-b79ef4e2fc3a] Terminating instance
Nov 17 01:44:07 user nova-compute[75226]: DEBUG nova.compute.manager [None req-f2c70d95-ae87-46f6-89b6-0ea0de8c87db tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: 9c009cf0-99b6-4dc9-931e-b79ef4e2fc3a] Start destroying the instance on the hypervisor. {{(pid=75226) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 17 01:44:07 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:44:07 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:44:07 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:44:07 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:44:08 user nova-compute[75226]: DEBUG nova.compute.manager [req-923c8d3b-f0fc-4fd9-a65a-619c634971ba req-b6f65085-8856-43eb-b192-d99697e68839 service nova] [instance: 9c009cf0-99b6-4dc9-931e-b79ef4e2fc3a] Received event network-vif-unplugged-fda4b1a7-6558-4658-ac36-502ac3f0ad6d {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:44:08 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-923c8d3b-f0fc-4fd9-a65a-619c634971ba req-b6f65085-8856-43eb-b192-d99697e68839 service nova] Acquiring lock "9c009cf0-99b6-4dc9-931e-b79ef4e2fc3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:44:08 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-923c8d3b-f0fc-4fd9-a65a-619c634971ba req-b6f65085-8856-43eb-b192-d99697e68839 service nova] Lock "9c009cf0-99b6-4dc9-931e-b79ef4e2fc3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:44:08 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-923c8d3b-f0fc-4fd9-a65a-619c634971ba req-b6f65085-8856-43eb-b192-d99697e68839 service nova] Lock "9c009cf0-99b6-4dc9-931e-b79ef4e2fc3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:44:08 user nova-compute[75226]: DEBUG nova.compute.manager [req-923c8d3b-f0fc-4fd9-a65a-619c634971ba req-b6f65085-8856-43eb-b192-d99697e68839 service nova] [instance: 9c009cf0-99b6-4dc9-931e-b79ef4e2fc3a] No waiting events found dispatching network-vif-unplugged-fda4b1a7-6558-4658-ac36-502ac3f0ad6d {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:44:08 user nova-compute[75226]: DEBUG nova.compute.manager [req-923c8d3b-f0fc-4fd9-a65a-619c634971ba req-b6f65085-8856-43eb-b192-d99697e68839 service nova] [instance: 9c009cf0-99b6-4dc9-931e-b79ef4e2fc3a] Received event network-vif-unplugged-fda4b1a7-6558-4658-ac36-502ac3f0ad6d for instance with task_state deleting. {{(pid=75226) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 17 01:44:08 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:44:08 user nova-compute[75226]: INFO nova.virt.libvirt.driver [-] [instance: 9c009cf0-99b6-4dc9-931e-b79ef4e2fc3a] Instance destroyed successfully.
Nov 17 01:44:08 user nova-compute[75226]: DEBUG nova.objects.instance [None req-f2c70d95-ae87-46f6-89b6-0ea0de8c87db tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Lazy-loading 'resources' on Instance uuid 9c009cf0-99b6-4dc9-931e-b79ef4e2fc3a {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:44:08 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-f2c70d95-ae87-46f6-89b6-0ea0de8c87db tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:42:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1366793931',display_name='tempest-TestVolumeBootPattern-server-1366793931',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1366793931',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-17T01:42:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='673620a69fba4a04af75baabe775dc8b',ramdisk_id='',reservation_id='r-fzwyqva5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-971654489',owner_user_name='tempest-TestVolumeBootPattern-971654489-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T01:42:34Z,user_data=None,user_id='7c8c8baa56884dcd9a90f0187c9fc06f',uuid=9c009cf0-99b6-4dc9-931e-b79ef4e2fc3a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fda4b1a7-6558-4658-ac36-502ac3f0ad6d", "address": "fa:16:3e:f3:ff:e0", "network": {"id": "81bbbdad-218b-4fcd-b7f5-427fd49361cb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1151874504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "673620a69fba4a04af75baabe775dc8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfda4b1a7-65", "ovs_interfaceid": "fda4b1a7-6558-4658-ac36-502ac3f0ad6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 17 01:44:08 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-f2c70d95-ae87-46f6-89b6-0ea0de8c87db tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Converting VIF {"id": "fda4b1a7-6558-4658-ac36-502ac3f0ad6d", "address": "fa:16:3e:f3:ff:e0", "network": {"id": "81bbbdad-218b-4fcd-b7f5-427fd49361cb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1151874504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "673620a69fba4a04af75baabe775dc8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfda4b1a7-65", "ovs_interfaceid": "fda4b1a7-6558-4658-ac36-502ac3f0ad6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:44:08 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-f2c70d95-ae87-46f6-89b6-0ea0de8c87db tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:ff:e0,bridge_name='br-int',has_traffic_filtering=True,id=fda4b1a7-6558-4658-ac36-502ac3f0ad6d,network=Network(81bbbdad-218b-4fcd-b7f5-427fd49361cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfda4b1a7-65') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:44:08 user nova-compute[75226]: DEBUG os_vif [None req-f2c70d95-ae87-46f6-89b6-0ea0de8c87db tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:ff:e0,bridge_name='br-int',has_traffic_filtering=True,id=fda4b1a7-6558-4658-ac36-502ac3f0ad6d,network=Network(81bbbdad-218b-4fcd-b7f5-427fd49361cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfda4b1a7-65') {{(pid=75226) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 17 01:44:08 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:44:08 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfda4b1a7-65, bridge=br-int, if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:44:08 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:44:08 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:44:08 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:44:08 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=85980740-38b3-40dd-b32e-272791d1158f) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:44:08 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:44:08 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:44:08 user nova-compute[75226]: INFO os_vif [None req-f2c70d95-ae87-46f6-89b6-0ea0de8c87db tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:ff:e0,bridge_name='br-int',has_traffic_filtering=True,id=fda4b1a7-6558-4658-ac36-502ac3f0ad6d,network=Network(81bbbdad-218b-4fcd-b7f5-427fd49361cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfda4b1a7-65')
Nov 17 01:44:08 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f2c70d95-ae87-46f6-89b6-0ea0de8c87db tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: 9c009cf0-99b6-4dc9-931e-b79ef4e2fc3a] calling os-brick to detach iSCSI Volume {{(pid=75226) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 17 01:44:08 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2c70d95-ae87-46f6-89b6-0ea0de8c87db tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc4cc36b490>, {'target_iqn': 'iqn.2010-10.org.openstack:3c8e2d11-ac6f-4568-b99e-9ad41a24e1bb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XEHmaLpw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:44:08 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-f2c70d95-ae87-46f6-89b6-0ea0de8c87db tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:44:08 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-f2c70d95-ae87-46f6-89b6-0ea0de8c87db tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:44:08 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-f2c70d95-ae87-46f6-89b6-0ea0de8c87db tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:44:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:44:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:44:08 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[99773cce-d7f9-4fa7-9caa-c182aa77847d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3c8e2d11-ac6f-4568-b99e-9ad41a24e1bb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:44:08 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2c70d95-ae87-46f6-89b6-0ea0de8c87db tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 17 01:44:08 user nova-compute[75226]: No targets found.
Nov 17 01:44:08 user nova-compute[75226]: iSNS:
Nov 17 01:44:08 user nova-compute[75226]: No targets found.
Nov 17 01:44:08 user nova-compute[75226]: STATIC:
Nov 17 01:44:08 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:3c8e2d11-ac6f-4568-b99e-9ad41a24e1bb
Nov 17 01:44:08 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:44:08 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:44:08 user nova-compute[75226]: FIRMWARE:
Nov 17 01:44:08 user nova-compute[75226]: No targets found.
Nov 17 01:44:08 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:44:08 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2c70d95-ae87-46f6-89b6-0ea0de8c87db tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 17 01:44:08 user nova-compute[75226]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 17 01:44:08 user nova-compute[75226]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75226) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 17 01:44:08 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2c70d95-ae87-46f6-89b6-0ea0de8c87db tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3c8e2d11-ac6f-4568-b99e-9ad41a24e1bb', 0)] {{(pid=75226) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 17 01:44:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:44:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:44:08 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[7119efa1-78d6-49b8-9e3a-ee081d28eb4d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3c8e2d11-ac6f-4568-b99e-9ad41a24e1bb\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:44:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:44:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:44:08 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[d590f171-3961-4630-9cd4-4d2aa3464415]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c8e2d11-ac6f-4568-b99e-9ad41a24e1bb (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:44:08 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2c70d95-ae87-46f6-89b6-0ea0de8c87db tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c8e2d11-ac6f-4568-b99e-9ad41a24e1bb (non-flash)
Nov 17 01:44:08 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:44:08 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2c70d95-ae87-46f6-89b6-0ea0de8c87db tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c8e2d11-ac6f-4568-b99e-9ad41a24e1bb (non-flash)
Nov 17 01:44:08 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:44:08 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2c70d95-ae87-46f6-89b6-0ea0de8c87db tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc4b44589d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3c8e2d11-ac6f-4568-b99e-9ad41a24e1bb'): ({'sdb'}, set())}) {{(pid=75226) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 17 01:44:08 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-f2c70d95-ae87-46f6-89b6-0ea0de8c87db tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Removing single pathed devices sdb {{(pid=75226) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 17 01:44:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:44:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:44:08 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd3bf673-f8f9-476a-b83f-1f280cda97ec]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:44:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:44:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:44:08 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[d884aaa2-ce43-4e7c-8ce1-4eae686258e8]: (4, ('ok\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:44:08 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-f2c70d95-ae87-46f6-89b6-0ea0de8c87db tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Flushing IO for device /dev/sdb {{(pid=75226) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 17 01:44:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:44:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:44:08 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e311138-26f7-4240-ace1-a561b4418af3]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:44:08 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-f2c70d95-ae87-46f6-89b6-0ea0de8c87db tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75226) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 17 01:44:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:44:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:44:08 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f5e3d38-b0a8-4931-91a3-cf56a83e55a6]: (4, ('1', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:44:08 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-f2c70d95-ae87-46f6-89b6-0ea0de8c87db tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75226) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 17 01:44:08 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-f2c70d95-ae87-46f6-89b6-0ea0de8c87db tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] SCSI volumes sdb have been removed. {{(pid=75226) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 17 01:44:08 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2c70d95-ae87-46f6-89b6-0ea0de8c87db tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3c8e2d11-ac6f-4568-b99e-9ad41a24e1bb')] {{(pid=75226) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 17 01:44:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c8e2d11-ac6f-4568-b99e-9ad41a24e1bb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:44:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c8e2d11-ac6f-4568-b99e-9ad41a24e1bb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:44:08 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[12c1c02a-f8f5-4fa9-b325-e29d0c9c11e6]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:44:08 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2c70d95-ae87-46f6-89b6-0ea0de8c87db tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:44:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c8e2d11-ac6f-4568-b99e-9ad41a24e1bb -p 172.16.0.220:3260 --logout {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:44:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c8e2d11-ac6f-4568-b99e-9ad41a24e1bb -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:44:08 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[34056dd9-ec9a-4489-a0c9-bb0a6b915c37]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:3c8e2d11-ac6f-4568-b99e-9ad41a24e1bb, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:3c8e2d11-ac6f-4568-b99e-9ad41a24e1bb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:44:08 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2c70d95-ae87-46f6-89b6-0ea0de8c87db tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:3c8e2d11-ac6f-4568-b99e-9ad41a24e1bb, portal: 172.16.0.220,3260]
Nov 17 01:44:08 user nova-compute[75226]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:3c8e2d11-ac6f-4568-b99e-9ad41a24e1bb, portal: 172.16.0.220,3260] successful.
Nov 17 01:44:08 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:44:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c8e2d11-ac6f-4568-b99e-9ad41a24e1bb -p 172.16.0.220:3260 --op delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:44:08 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c8e2d11-ac6f-4568-b99e-9ad41a24e1bb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:44:08 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e6f9dd3-e2d0-4475-9201-050596ead0c9]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:44:08 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2c70d95-ae87-46f6-89b6-0ea0de8c87db tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:44:08 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-f2c70d95-ae87-46f6-89b6-0ea0de8c87db tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.285s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:44:08 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2c70d95-ae87-46f6-89b6-0ea0de8c87db tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] <== disconnect_volume: return (286ms) None {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:44:08 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f2c70d95-ae87-46f6-89b6-0ea0de8c87db tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: 9c009cf0-99b6-4dc9-931e-b79ef4e2fc3a] Disconnected iSCSI Volume {{(pid=75226) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 17 01:44:08 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-f2c70d95-ae87-46f6-89b6-0ea0de8c87db tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: 9c009cf0-99b6-4dc9-931e-b79ef4e2fc3a] Deleting instance files /opt/stack/data/nova/instances/9c009cf0-99b6-4dc9-931e-b79ef4e2fc3a_del
Nov 17 01:44:08 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-f2c70d95-ae87-46f6-89b6-0ea0de8c87db tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: 9c009cf0-99b6-4dc9-931e-b79ef4e2fc3a] Deletion of /opt/stack/data/nova/instances/9c009cf0-99b6-4dc9-931e-b79ef4e2fc3a_del complete
Nov 17 01:44:09 user nova-compute[75226]: INFO nova.compute.manager [None req-f2c70d95-ae87-46f6-89b6-0ea0de8c87db tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: 9c009cf0-99b6-4dc9-931e-b79ef4e2fc3a] Took 1.23 seconds to destroy the instance on the hypervisor.
Nov 17 01:44:09 user nova-compute[75226]: DEBUG oslo.service.loopingcall [None req-f2c70d95-ae87-46f6-89b6-0ea0de8c87db tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75226) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 17 01:44:09 user nova-compute[75226]: DEBUG nova.compute.manager [-] [instance: 9c009cf0-99b6-4dc9-931e-b79ef4e2fc3a] Deallocating network for instance {{(pid=75226) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 17 01:44:09 user nova-compute[75226]: DEBUG nova.network.neutron [-] [instance: 9c009cf0-99b6-4dc9-931e-b79ef4e2fc3a] deallocate_for_instance() {{(pid=75226) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 17 01:44:09 user nova-compute[75226]: DEBUG nova.network.neutron [-] [instance: 9c009cf0-99b6-4dc9-931e-b79ef4e2fc3a] Updating instance_info_cache with network_info: [] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:44:09 user nova-compute[75226]: INFO nova.compute.manager [-] [instance: 9c009cf0-99b6-4dc9-931e-b79ef4e2fc3a] Took 0.38 seconds to deallocate network for instance.
Nov 17 01:44:09 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:44:10 user nova-compute[75226]: INFO nova.compute.manager [None req-f2c70d95-ae87-46f6-89b6-0ea0de8c87db tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: 9c009cf0-99b6-4dc9-931e-b79ef4e2fc3a] Took 0.76 seconds to detach 1 volumes for instance.
Nov 17 01:44:10 user nova-compute[75226]: DEBUG nova.compute.manager [None req-f2c70d95-ae87-46f6-89b6-0ea0de8c87db tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: 9c009cf0-99b6-4dc9-931e-b79ef4e2fc3a] Deleting volume: 3c8e2d11-ac6f-4568-b99e-9ad41a24e1bb {{(pid=75226) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 17 01:44:10 user nova-compute[75226]: DEBUG nova.compute.manager [req-bfab7035-e3b4-4756-803d-433f25ca3934 req-b83d92c9-15af-4afa-96c7-50a76f66fd44 service nova] [instance: 9c009cf0-99b6-4dc9-931e-b79ef4e2fc3a] Received event network-vif-plugged-fda4b1a7-6558-4658-ac36-502ac3f0ad6d {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:44:10 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-bfab7035-e3b4-4756-803d-433f25ca3934 req-b83d92c9-15af-4afa-96c7-50a76f66fd44 service nova] Acquiring lock "9c009cf0-99b6-4dc9-931e-b79ef4e2fc3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:44:10 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-bfab7035-e3b4-4756-803d-433f25ca3934 req-b83d92c9-15af-4afa-96c7-50a76f66fd44 service nova] Lock "9c009cf0-99b6-4dc9-931e-b79ef4e2fc3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:44:10 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-bfab7035-e3b4-4756-803d-433f25ca3934 req-b83d92c9-15af-4afa-96c7-50a76f66fd44 service nova] Lock "9c009cf0-99b6-4dc9-931e-b79ef4e2fc3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:44:10 user nova-compute[75226]: DEBUG nova.compute.manager [req-bfab7035-e3b4-4756-803d-433f25ca3934 req-b83d92c9-15af-4afa-96c7-50a76f66fd44 service nova] [instance: 9c009cf0-99b6-4dc9-931e-b79ef4e2fc3a] No waiting events found dispatching network-vif-plugged-fda4b1a7-6558-4658-ac36-502ac3f0ad6d {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:44:10 user nova-compute[75226]: WARNING nova.compute.manager [req-bfab7035-e3b4-4756-803d-433f25ca3934 req-b83d92c9-15af-4afa-96c7-50a76f66fd44 service nova] [instance: 9c009cf0-99b6-4dc9-931e-b79ef4e2fc3a] Received unexpected event network-vif-plugged-fda4b1a7-6558-4658-ac36-502ac3f0ad6d for instance with vm_state active and task_state deleting.
Nov 17 01:44:10 user nova-compute[75226]: DEBUG nova.compute.manager [req-bfab7035-e3b4-4756-803d-433f25ca3934 req-b83d92c9-15af-4afa-96c7-50a76f66fd44 service nova] [instance: 9c009cf0-99b6-4dc9-931e-b79ef4e2fc3a] Received event network-vif-deleted-fda4b1a7-6558-4658-ac36-502ac3f0ad6d {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:44:10 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-f2c70d95-ae87-46f6-89b6-0ea0de8c87db tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:44:10 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-f2c70d95-ae87-46f6-89b6-0ea0de8c87db tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:44:10 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-f2c70d95-ae87-46f6-89b6-0ea0de8c87db tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:44:10 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-f2c70d95-ae87-46f6-89b6-0ea0de8c87db tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:44:10 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-f2c70d95-ae87-46f6-89b6-0ea0de8c87db tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.170s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:44:10 user nova-compute[75226]: INFO nova.scheduler.client.report [None req-f2c70d95-ae87-46f6-89b6-0ea0de8c87db tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Deleted allocations for instance 9c009cf0-99b6-4dc9-931e-b79ef4e2fc3a
Nov 17 01:44:10 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-f2c70d95-ae87-46f6-89b6-0ea0de8c87db tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Lock "9c009cf0-99b6-4dc9-931e-b79ef4e2fc3a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.864s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:44:11 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:44:12 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:44:13 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:44:13 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:44:13 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:44:13 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75226) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 17 01:44:13 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:44:13 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:44:13 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:44:13 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-7d17e4fd-93a2-489c-a5b9-9b0ee6f64036 tempest-VolumesActionsTest-1992288685 tempest-VolumesActionsTest-1992288685-project-member] Acquiring lock "6a1d76ca-5fd1-4ee6-81f2-b53d280ff585" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:44:13 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-7d17e4fd-93a2-489c-a5b9-9b0ee6f64036 tempest-VolumesActionsTest-1992288685 tempest-VolumesActionsTest-1992288685-project-member] Lock "6a1d76ca-5fd1-4ee6-81f2-b53d280ff585" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:44:13 user nova-compute[75226]: DEBUG nova.compute.manager [None req-7d17e4fd-93a2-489c-a5b9-9b0ee6f64036 tempest-VolumesActionsTest-1992288685 tempest-VolumesActionsTest-1992288685-project-member] [instance: 6a1d76ca-5fd1-4ee6-81f2-b53d280ff585] Starting instance... {{(pid=75226) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 17 01:44:13 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:44:13 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-7d17e4fd-93a2-489c-a5b9-9b0ee6f64036 tempest-VolumesActionsTest-1992288685 tempest-VolumesActionsTest-1992288685-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:44:13 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-7d17e4fd-93a2-489c-a5b9-9b0ee6f64036 tempest-VolumesActionsTest-1992288685 tempest-VolumesActionsTest-1992288685-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:44:13 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-7d17e4fd-93a2-489c-a5b9-9b0ee6f64036 tempest-VolumesActionsTest-1992288685 tempest-VolumesActionsTest-1992288685-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75226) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 17 01:44:13 user nova-compute[75226]: INFO nova.compute.claims [None req-7d17e4fd-93a2-489c-a5b9-9b0ee6f64036 tempest-VolumesActionsTest-1992288685 tempest-VolumesActionsTest-1992288685-project-member] [instance: 6a1d76ca-5fd1-4ee6-81f2-b53d280ff585] Claim successful on node user
Nov 17 01:44:13 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:44:13 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0597c05a-1049-4117-a8ae-8177d590e024/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:44:13 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:44:13 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-7d17e4fd-93a2-489c-a5b9-9b0ee6f64036 tempest-VolumesActionsTest-1992288685 tempest-VolumesActionsTest-1992288685-project-member] Refreshing inventories for resource provider f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 17 01:44:13 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-7d17e4fd-93a2-489c-a5b9-9b0ee6f64036 tempest-VolumesActionsTest-1992288685 tempest-VolumesActionsTest-1992288685-project-member] Updating ProviderTree inventory for provider f431122b-abb2-4ecb-9e21-e3ec333d823b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 17 01:44:13 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-7d17e4fd-93a2-489c-a5b9-9b0ee6f64036 tempest-VolumesActionsTest-1992288685 tempest-VolumesActionsTest-1992288685-project-member] Updating inventory in ProviderTree for provider f431122b-abb2-4ecb-9e21-e3ec333d823b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 17 01:44:13 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0597c05a-1049-4117-a8ae-8177d590e024/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:44:13 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0597c05a-1049-4117-a8ae-8177d590e024/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:44:13 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-7d17e4fd-93a2-489c-a5b9-9b0ee6f64036 tempest-VolumesActionsTest-1992288685 tempest-VolumesActionsTest-1992288685-project-member] Refreshing aggregate associations for resource provider f431122b-abb2-4ecb-9e21-e3ec333d823b, aggregates: None {{(pid=75226) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 17 01:44:13 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-7d17e4fd-93a2-489c-a5b9-9b0ee6f64036 tempest-VolumesActionsTest-1992288685 tempest-VolumesActionsTest-1992288685-project-member] Refreshing trait associations for resource provider f431122b-abb2-4ecb-9e21-e3ec333d823b, traits: COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE42,HW_CPU_X86_SSE,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSSE3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_SATA {{(pid=75226) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 17 01:44:13 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0597c05a-1049-4117-a8ae-8177d590e024/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:44:13 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-7d17e4fd-93a2-489c-a5b9-9b0ee6f64036 tempest-VolumesActionsTest-1992288685 tempest-VolumesActionsTest-1992288685-project-member] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:44:14 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-7d17e4fd-93a2-489c-a5b9-9b0ee6f64036 tempest-VolumesActionsTest-1992288685 tempest-VolumesActionsTest-1992288685-project-member] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:44:14 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:44:14 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:44:14 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Hypervisor/Node resource view: name=user free_ram=8696MB free_disk=24.84219741821289GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75226) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 17 01:44:14 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:44:14 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-7d17e4fd-93a2-489c-a5b9-9b0ee6f64036 tempest-VolumesActionsTest-1992288685 tempest-VolumesActionsTest-1992288685-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.795s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:44:14 user nova-compute[75226]: DEBUG nova.compute.manager [None req-7d17e4fd-93a2-489c-a5b9-9b0ee6f64036 tempest-VolumesActionsTest-1992288685 tempest-VolumesActionsTest-1992288685-project-member] [instance: 6a1d76ca-5fd1-4ee6-81f2-b53d280ff585] Start building networks asynchronously for instance. {{(pid=75226) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 17 01:44:14 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.024s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:44:14 user nova-compute[75226]: DEBUG nova.compute.manager [None req-7d17e4fd-93a2-489c-a5b9-9b0ee6f64036 tempest-VolumesActionsTest-1992288685 tempest-VolumesActionsTest-1992288685-project-member] [instance: 6a1d76ca-5fd1-4ee6-81f2-b53d280ff585] Allocating IP information in the background. {{(pid=75226) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 17 01:44:14 user nova-compute[75226]: DEBUG nova.network.neutron [None req-7d17e4fd-93a2-489c-a5b9-9b0ee6f64036 tempest-VolumesActionsTest-1992288685 tempest-VolumesActionsTest-1992288685-project-member] [instance: 6a1d76ca-5fd1-4ee6-81f2-b53d280ff585] allocate_for_instance() {{(pid=75226) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 17 01:44:14 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-7d17e4fd-93a2-489c-a5b9-9b0ee6f64036 tempest-VolumesActionsTest-1992288685 tempest-VolumesActionsTest-1992288685-project-member] [instance: 6a1d76ca-5fd1-4ee6-81f2-b53d280ff585] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 17 01:44:14 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 0597c05a-1049-4117-a8ae-8177d590e024 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:44:14 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:44:14 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 6a1d76ca-5fd1-4ee6-81f2-b53d280ff585 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:44:14 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75226) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 17 01:44:14 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75226) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 17 01:44:14 user nova-compute[75226]: DEBUG nova.compute.manager [None req-7d17e4fd-93a2-489c-a5b9-9b0ee6f64036 tempest-VolumesActionsTest-1992288685 tempest-VolumesActionsTest-1992288685-project-member] [instance: 6a1d76ca-5fd1-4ee6-81f2-b53d280ff585] Start building block device mappings for instance. {{(pid=75226) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 17 01:44:14 user nova-compute[75226]: DEBUG nova.policy [None req-7d17e4fd-93a2-489c-a5b9-9b0ee6f64036 tempest-VolumesActionsTest-1992288685 tempest-VolumesActionsTest-1992288685-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '69b47debb71a4d78b446d49e268510dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42506c594c046d798038309be22e08e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75226) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 17 01:44:14 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:44:14 user nova-compute[75226]: DEBUG nova.compute.manager [None req-7d17e4fd-93a2-489c-a5b9-9b0ee6f64036 tempest-VolumesActionsTest-1992288685 tempest-VolumesActionsTest-1992288685-project-member] [instance: 6a1d76ca-5fd1-4ee6-81f2-b53d280ff585] Start spawning the instance on the hypervisor. {{(pid=75226) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 17 01:44:14 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-7d17e4fd-93a2-489c-a5b9-9b0ee6f64036 tempest-VolumesActionsTest-1992288685 tempest-VolumesActionsTest-1992288685-project-member] [instance: 6a1d76ca-5fd1-4ee6-81f2-b53d280ff585] Creating instance directory {{(pid=75226) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 17 01:44:14 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-7d17e4fd-93a2-489c-a5b9-9b0ee6f64036 tempest-VolumesActionsTest-1992288685 tempest-VolumesActionsTest-1992288685-project-member] [instance: 6a1d76ca-5fd1-4ee6-81f2-b53d280ff585] Creating image(s)
Nov 17 01:44:14 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-7d17e4fd-93a2-489c-a5b9-9b0ee6f64036 tempest-VolumesActionsTest-1992288685 tempest-VolumesActionsTest-1992288685-project-member] Acquiring lock "/opt/stack/data/nova/instances/6a1d76ca-5fd1-4ee6-81f2-b53d280ff585/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:44:14 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-7d17e4fd-93a2-489c-a5b9-9b0ee6f64036 tempest-VolumesActionsTest-1992288685 tempest-VolumesActionsTest-1992288685-project-member] Lock "/opt/stack/data/nova/instances/6a1d76ca-5fd1-4ee6-81f2-b53d280ff585/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:44:14 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-7d17e4fd-93a2-489c-a5b9-9b0ee6f64036 tempest-VolumesActionsTest-1992288685 tempest-VolumesActionsTest-1992288685-project-member] Lock "/opt/stack/data/nova/instances/6a1d76ca-5fd1-4ee6-81f2-b53d280ff585/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:44:14 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:44:14 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-7d17e4fd-93a2-489c-a5b9-9b0ee6f64036 tempest-VolumesActionsTest-1992288685 tempest-VolumesActionsTest-1992288685-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:44:14 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Compute_service record updated for user:user {{(pid=75226) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 17 01:44:14 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.287s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:44:14 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-7d17e4fd-93a2-489c-a5b9-9b0ee6f64036 tempest-VolumesActionsTest-1992288685 tempest-VolumesActionsTest-1992288685-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json" returned: 0 in 0.190s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:44:14 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-7d17e4fd-93a2-489c-a5b9-9b0ee6f64036 tempest-VolumesActionsTest-1992288685 tempest-VolumesActionsTest-1992288685-project-member] Acquiring lock "a8a62c2546af3a2036b853250c5ac64d4c6b4371" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:44:14 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-7d17e4fd-93a2-489c-a5b9-9b0ee6f64036 tempest-VolumesActionsTest-1992288685 tempest-VolumesActionsTest-1992288685-project-member] Lock "a8a62c2546af3a2036b853250c5ac64d4c6b4371" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:44:14 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-7d17e4fd-93a2-489c-a5b9-9b0ee6f64036 tempest-VolumesActionsTest-1992288685 tempest-VolumesActionsTest-1992288685-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:44:14 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-7d17e4fd-93a2-489c-a5b9-9b0ee6f64036 tempest-VolumesActionsTest-1992288685 tempest-VolumesActionsTest-1992288685-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json" returned: 0 in 0.173s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:44:14 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-7d17e4fd-93a2-489c-a5b9-9b0ee6f64036 tempest-VolumesActionsTest-1992288685 tempest-VolumesActionsTest-1992288685-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371,backing_fmt=raw /opt/stack/data/nova/instances/6a1d76ca-5fd1-4ee6-81f2-b53d280ff585/disk 1073741824 {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:44:14 user nova-compute[75226]: DEBUG nova.network.neutron [None req-7d17e4fd-93a2-489c-a5b9-9b0ee6f64036 tempest-VolumesActionsTest-1992288685 tempest-VolumesActionsTest-1992288685-project-member] [instance: 6a1d76ca-5fd1-4ee6-81f2-b53d280ff585] Successfully created port: eca93def-9c12-4775-a4c6-b164bf978201 {{(pid=75226) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 17 01:44:14 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-7d17e4fd-93a2-489c-a5b9-9b0ee6f64036 tempest-VolumesActionsTest-1992288685 tempest-VolumesActionsTest-1992288685-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371,backing_fmt=raw /opt/stack/data/nova/instances/6a1d76ca-5fd1-4ee6-81f2-b53d280ff585/disk 1073741824" returned: 0 in 0.072s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:44:14 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-7d17e4fd-93a2-489c-a5b9-9b0ee6f64036 tempest-VolumesActionsTest-1992288685 tempest-VolumesActionsTest-1992288685-project-member] Lock "a8a62c2546af3a2036b853250c5ac64d4c6b4371" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:44:14 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-7d17e4fd-93a2-489c-a5b9-9b0ee6f64036 tempest-VolumesActionsTest-1992288685 tempest-VolumesActionsTest-1992288685-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:44:15 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-7d17e4fd-93a2-489c-a5b9-9b0ee6f64036 tempest-VolumesActionsTest-1992288685 tempest-VolumesActionsTest-1992288685-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json" returned: 0 in 0.174s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:44:15 user nova-compute[75226]: DEBUG nova.virt.disk.api [None req-7d17e4fd-93a2-489c-a5b9-9b0ee6f64036 tempest-VolumesActionsTest-1992288685 tempest-VolumesActionsTest-1992288685-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6a1d76ca-5fd1-4ee6-81f2-b53d280ff585/disk. size=1073741824 {{(pid=75226) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 17 01:44:15 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-7d17e4fd-93a2-489c-a5b9-9b0ee6f64036 tempest-VolumesActionsTest-1992288685 tempest-VolumesActionsTest-1992288685-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1d76ca-5fd1-4ee6-81f2-b53d280ff585/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:44:15 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-7d17e4fd-93a2-489c-a5b9-9b0ee6f64036 tempest-VolumesActionsTest-1992288685 tempest-VolumesActionsTest-1992288685-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1d76ca-5fd1-4ee6-81f2-b53d280ff585/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:44:15 user nova-compute[75226]: DEBUG nova.virt.disk.api [None req-7d17e4fd-93a2-489c-a5b9-9b0ee6f64036 tempest-VolumesActionsTest-1992288685 tempest-VolumesActionsTest-1992288685-project-member] Cannot resize image /opt/stack/data/nova/instances/6a1d76ca-5fd1-4ee6-81f2-b53d280ff585/disk to a smaller size. {{(pid=75226) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 17 01:44:15 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-7d17e4fd-93a2-489c-a5b9-9b0ee6f64036 tempest-VolumesActionsTest-1992288685 tempest-VolumesActionsTest-1992288685-project-member] [instance: 6a1d76ca-5fd1-4ee6-81f2-b53d280ff585] Created local disks {{(pid=75226) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 17 01:44:15 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-7d17e4fd-93a2-489c-a5b9-9b0ee6f64036 tempest-VolumesActionsTest-1992288685 tempest-VolumesActionsTest-1992288685-project-member] [instance: 6a1d76ca-5fd1-4ee6-81f2-b53d280ff585] Ensure instance console log exists: /opt/stack/data/nova/instances/6a1d76ca-5fd1-4ee6-81f2-b53d280ff585/console.log {{(pid=75226) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 17 01:44:15 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-7d17e4fd-93a2-489c-a5b9-9b0ee6f64036 tempest-VolumesActionsTest-1992288685 tempest-VolumesActionsTest-1992288685-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:44:15 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-7d17e4fd-93a2-489c-a5b9-9b0ee6f64036 tempest-VolumesActionsTest-1992288685 tempest-VolumesActionsTest-1992288685-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:44:15 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-7d17e4fd-93a2-489c-a5b9-9b0ee6f64036 tempest-VolumesActionsTest-1992288685 tempest-VolumesActionsTest-1992288685-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:44:15 user nova-compute[75226]: DEBUG nova.network.neutron [None req-7d17e4fd-93a2-489c-a5b9-9b0ee6f64036 tempest-VolumesActionsTest-1992288685 tempest-VolumesActionsTest-1992288685-project-member] [instance: 6a1d76ca-5fd1-4ee6-81f2-b53d280ff585] Successfully updated port: eca93def-9c12-4775-a4c6-b164bf978201 {{(pid=75226) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 17 01:44:15 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-7d17e4fd-93a2-489c-a5b9-9b0ee6f64036 tempest-VolumesActionsTest-1992288685 tempest-VolumesActionsTest-1992288685-project-member] Acquiring lock "refresh_cache-6a1d76ca-5fd1-4ee6-81f2-b53d280ff585" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:44:15 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-7d17e4fd-93a2-489c-a5b9-9b0ee6f64036 tempest-VolumesActionsTest-1992288685 tempest-VolumesActionsTest-1992288685-project-member] Acquired lock "refresh_cache-6a1d76ca-5fd1-4ee6-81f2-b53d280ff585" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:44:15 user nova-compute[75226]: DEBUG nova.network.neutron [None req-7d17e4fd-93a2-489c-a5b9-9b0ee6f64036 tempest-VolumesActionsTest-1992288685 tempest-VolumesActionsTest-1992288685-project-member] [instance: 6a1d76ca-5fd1-4ee6-81f2-b53d280ff585] Building network info cache for instance {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 01:44:15 user nova-compute[75226]: DEBUG nova.compute.manager [req-f2b69188-31e1-45b4-96e0-789d8907505b req-0d10dc8c-4aaa-41ef-aa50-735c45b65528 service nova] [instance: 6a1d76ca-5fd1-4ee6-81f2-b53d280ff585] Received event network-changed-eca93def-9c12-4775-a4c6-b164bf978201 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:44:15 user nova-compute[75226]: DEBUG nova.compute.manager [req-f2b69188-31e1-45b4-96e0-789d8907505b req-0d10dc8c-4aaa-41ef-aa50-735c45b65528 service nova] [instance: 6a1d76ca-5fd1-4ee6-81f2-b53d280ff585] Refreshing instance network info cache due to event network-changed-eca93def-9c12-4775-a4c6-b164bf978201. {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 01:44:15 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-f2b69188-31e1-45b4-96e0-789d8907505b req-0d10dc8c-4aaa-41ef-aa50-735c45b65528 service nova] Acquiring lock "refresh_cache-6a1d76ca-5fd1-4ee6-81f2-b53d280ff585" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:44:15 user nova-compute[75226]: DEBUG nova.network.neutron [None req-7d17e4fd-93a2-489c-a5b9-9b0ee6f64036 tempest-VolumesActionsTest-1992288685 tempest-VolumesActionsTest-1992288685-project-member] [instance: 6a1d76ca-5fd1-4ee6-81f2-b53d280ff585] Instance cache missing network info. {{(pid=75226) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 17 01:44:15 user nova-compute[75226]: DEBUG nova.network.neutron [None req-7d17e4fd-93a2-489c-a5b9-9b0ee6f64036 tempest-VolumesActionsTest-1992288685 tempest-VolumesActionsTest-1992288685-project-member] [instance: 6a1d76ca-5fd1-4ee6-81f2-b53d280ff585] Updating instance_info_cache with network_info: [{"id": "eca93def-9c12-4775-a4c6-b164bf978201", "address": "fa:16:3e:d4:0e:ae", "network": {"id": "dee2fba9-707e-414a-bb61-ecc82be66882", "bridge": "br-int", "label": "tempest-VolumesActionsTest-439671361-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c42506c594c046d798038309be22e08e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeca93def-9c", "ovs_interfaceid": "eca93def-9c12-4775-a4c6-b164bf978201", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:44:15 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-7d17e4fd-93a2-489c-a5b9-9b0ee6f64036 tempest-VolumesActionsTest-1992288685 tempest-VolumesActionsTest-1992288685-project-member] Releasing lock "refresh_cache-6a1d76ca-5fd1-4ee6-81f2-b53d280ff585" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:44:15 user nova-compute[75226]: DEBUG nova.compute.manager [None req-7d17e4fd-93a2-489c-a5b9-9b0ee6f64036 tempest-VolumesActionsTest-1992288685 tempest-VolumesActionsTest-1992288685-project-member] [instance: 6a1d76ca-5fd1-4ee6-81f2-b53d280ff585] Instance network_info: |[{"id": "eca93def-9c12-4775-a4c6-b164bf978201", "address": "fa:16:3e:d4:0e:ae", "network": {"id": "dee2fba9-707e-414a-bb61-ecc82be66882", "bridge": "br-int", "label": "tempest-VolumesActionsTest-439671361-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c42506c594c046d798038309be22e08e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeca93def-9c", "ovs_interfaceid": "eca93def-9c12-4775-a4c6-b164bf978201", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75226) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 17 01:44:15 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-f2b69188-31e1-45b4-96e0-789d8907505b req-0d10dc8c-4aaa-41ef-aa50-735c45b65528 service nova] Acquired lock "refresh_cache-6a1d76ca-5fd1-4ee6-81f2-b53d280ff585" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:44:15 user nova-compute[75226]: DEBUG nova.network.neutron [req-f2b69188-31e1-45b4-96e0-789d8907505b req-0d10dc8c-4aaa-41ef-aa50-735c45b65528 service nova] [instance: 6a1d76ca-5fd1-4ee6-81f2-b53d280ff585] Refreshing network info cache for port eca93def-9c12-4775-a4c6-b164bf978201 {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 01:44:15 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-7d17e4fd-93a2-489c-a5b9-9b0ee6f64036 tempest-VolumesActionsTest-1992288685 tempest-VolumesActionsTest-1992288685-project-member] [instance: 6a1d76ca-5fd1-4ee6-81f2-b53d280ff585] Start _get_guest_xml network_info=[{"id": "eca93def-9c12-4775-a4c6-b164bf978201", "address": "fa:16:3e:d4:0e:ae", "network": {"id": "dee2fba9-707e-414a-bb61-ecc82be66882", "bridge": "br-int", "label": "tempest-VolumesActionsTest-439671361-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c42506c594c046d798038309be22e08e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeca93def-9c", "ovs_interfaceid": "eca93def-9c12-4775-a4c6-b164bf978201", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T01:13:22Z,direct_url=<?>,disk_format='qcow2',id=0b369aea-6f3f-4690-9f01-229b90ab6310,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4e110cbf9a84362a6864a7732c435a1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T01:13:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '0b369aea-6f3f-4690-9f01-229b90ab6310'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75226) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 17 01:44:15 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-7d17e4fd-93a2-489c-a5b9-9b0ee6f64036 tempest-VolumesActionsTest-1992288685 tempest-VolumesActionsTest-1992288685-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:44:15 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-7d17e4fd-93a2-489c-a5b9-9b0ee6f64036 tempest-VolumesActionsTest-1992288685 tempest-VolumesActionsTest-1992288685-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:44:15 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-7d17e4fd-93a2-489c-a5b9-9b0ee6f64036 tempest-VolumesActionsTest-1992288685 tempest-VolumesActionsTest-1992288685-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75226) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 17 01:44:15 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-7d17e4fd-93a2-489c-a5b9-9b0ee6f64036 tempest-VolumesActionsTest-1992288685 tempest-VolumesActionsTest-1992288685-project-member] CPU controller missing on host. {{(pid=75226) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 17 01:44:15 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-7d17e4fd-93a2-489c-a5b9-9b0ee6f64036 tempest-VolumesActionsTest-1992288685 tempest-VolumesActionsTest-1992288685-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75226) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 17 01:44:15 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-7d17e4fd-93a2-489c-a5b9-9b0ee6f64036 tempest-VolumesActionsTest-1992288685 tempest-VolumesActionsTest-1992288685-project-member] CPU controller found on host. {{(pid=75226) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 17 01:44:15 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-7d17e4fd-93a2-489c-a5b9-9b0ee6f64036 tempest-VolumesActionsTest-1992288685 tempest-VolumesActionsTest-1992288685-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75226) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 17 01:44:15 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-7d17e4fd-93a2-489c-a5b9-9b0ee6f64036 tempest-VolumesActionsTest-1992288685 tempest-VolumesActionsTest-1992288685-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-17T01:13:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T01:13:22Z,direct_url=<?>,disk_format='qcow2',id=0b369aea-6f3f-4690-9f01-229b90ab6310,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4e110cbf9a84362a6864a7732c435a1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T01:13:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 17 01:44:15 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-7d17e4fd-93a2-489c-a5b9-9b0ee6f64036 tempest-VolumesActionsTest-1992288685 tempest-VolumesActionsTest-1992288685-project-member] Flavor limits 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 17 01:44:15 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-7d17e4fd-93a2-489c-a5b9-9b0ee6f64036 tempest-VolumesActionsTest-1992288685 tempest-VolumesActionsTest-1992288685-project-member] Image limits 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 17 01:44:15 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-7d17e4fd-93a2-489c-a5b9-9b0ee6f64036 tempest-VolumesActionsTest-1992288685 tempest-VolumesActionsTest-1992288685-project-member] Flavor pref 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 17 01:44:15 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-7d17e4fd-93a2-489c-a5b9-9b0ee6f64036 tempest-VolumesActionsTest-1992288685 tempest-VolumesActionsTest-1992288685-project-member] Image pref 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 17 01:44:15 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-7d17e4fd-93a2-489c-a5b9-9b0ee6f64036 tempest-VolumesActionsTest-1992288685 tempest-VolumesActionsTest-1992288685-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 17 01:44:15 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-7d17e4fd-93a2-489c-a5b9-9b0ee6f64036 tempest-VolumesActionsTest-1992288685 tempest-VolumesActionsTest-1992288685-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 17 01:44:15 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-7d17e4fd-93a2-489c-a5b9-9b0ee6f64036 tempest-VolumesActionsTest-1992288685 tempest-VolumesActionsTest-1992288685-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75226) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 17 01:44:15 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-7d17e4fd-93a2-489c-a5b9-9b0ee6f64036 tempest-VolumesActionsTest-1992288685 tempest-VolumesActionsTest-1992288685-project-member] Got 1 possible topologies {{(pid=75226) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 17 01:44:15 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-7d17e4fd-93a2-489c-a5b9-9b0ee6f64036 tempest-VolumesActionsTest-1992288685 tempest-VolumesActionsTest-1992288685-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 17 01:44:15 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-7d17e4fd-93a2-489c-a5b9-9b0ee6f64036 tempest-VolumesActionsTest-1992288685 tempest-VolumesActionsTest-1992288685-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 17 01:44:15 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-7d17e4fd-93a2-489c-a5b9-9b0ee6f64036 tempest-VolumesActionsTest-1992288685 tempest-VolumesActionsTest-1992288685-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:44:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1085221871',display_name='tempest-VolumesActionsTest-instance-1085221871',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1085221871',id=44,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c42506c594c046d798038309be22e08e',ramdisk_id='',reservation_id='r-kysfoovz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1992288685',owner_user_name='tempest-VolumesActionsTest-1992288685-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T01:44:14Z,user_data=None,user_id='69b47debb71a4d78b446d49e268510dc',uuid=6a1d76ca-5fd1-4ee6-81f2-b53d280ff585,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eca93def-9c12-4775-a4c6-b164bf978201", "address": "fa:16:3e:d4:0e:ae", "network": {"id": "dee2fba9-707e-414a-bb61-ecc82be66882", "bridge": "br-int", "label": "tempest-VolumesActionsTest-439671361-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c42506c594c046d798038309be22e08e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeca93def-9c", "ovs_interfaceid": "eca93def-9c12-4775-a4c6-b164bf978201", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75226) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 01:44:15 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-7d17e4fd-93a2-489c-a5b9-9b0ee6f64036 tempest-VolumesActionsTest-1992288685 tempest-VolumesActionsTest-1992288685-project-member] Converting VIF {"id": "eca93def-9c12-4775-a4c6-b164bf978201", "address": "fa:16:3e:d4:0e:ae", "network": {"id": "dee2fba9-707e-414a-bb61-ecc82be66882", "bridge": "br-int", "label": "tempest-VolumesActionsTest-439671361-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c42506c594c046d798038309be22e08e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeca93def-9c", "ovs_interfaceid": "eca93def-9c12-4775-a4c6-b164bf978201", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:44:15 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-7d17e4fd-93a2-489c-a5b9-9b0ee6f64036 tempest-VolumesActionsTest-1992288685 tempest-VolumesActionsTest-1992288685-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:0e:ae,bridge_name='br-int',has_traffic_filtering=True,id=eca93def-9c12-4775-a4c6-b164bf978201,network=Network(dee2fba9-707e-414a-bb61-ecc82be66882),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeca93def-9c') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:44:15 user nova-compute[75226]: DEBUG nova.objects.instance [None req-7d17e4fd-93a2-489c-a5b9-9b0ee6f64036 tempest-VolumesActionsTest-1992288685 tempest-VolumesActionsTest-1992288685-project-member] Lazy-loading 'pci_devices' on Instance uuid 6a1d76ca-5fd1-4ee6-81f2-b53d280ff585 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:44:15 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-7d17e4fd-93a2-489c-a5b9-9b0ee6f64036 tempest-VolumesActionsTest-1992288685 tempest-VolumesActionsTest-1992288685-project-member] [instance: 6a1d76ca-5fd1-4ee6-81f2-b53d280ff585] End _get_guest_xml xml=<domain type="kvm">
Nov 17 01:44:15 user nova-compute[75226]:   <uuid>6a1d76ca-5fd1-4ee6-81f2-b53d280ff585</uuid>
Nov 17 01:44:15 user nova-compute[75226]:   <name>instance-0000002c</name>
Nov 17 01:44:15 user nova-compute[75226]:   <memory>524288</memory>
Nov 17 01:44:15 user nova-compute[75226]:   <vcpu>1</vcpu>
Nov 17 01:44:15 user nova-compute[75226]:   <metadata>
Nov 17 01:44:15 user nova-compute[75226]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 17 01:44:15 user nova-compute[75226]:       <nova:package version="0.0.0"/>
Nov 17 01:44:15 user nova-compute[75226]:       <nova:name>tempest-VolumesActionsTest-instance-1085221871</nova:name>
Nov 17 01:44:15 user nova-compute[75226]:       <nova:creationTime>2023-11-17 01:44:15</nova:creationTime>
Nov 17 01:44:15 user nova-compute[75226]:       <nova:flavor name="m1.tiny">
Nov 17 01:44:15 user nova-compute[75226]:         <nova:memory>512</nova:memory>
Nov 17 01:44:15 user nova-compute[75226]:         <nova:disk>1</nova:disk>
Nov 17 01:44:15 user nova-compute[75226]:         <nova:swap>0</nova:swap>
Nov 17 01:44:15 user nova-compute[75226]:         <nova:ephemeral>0</nova:ephemeral>
Nov 17 01:44:15 user nova-compute[75226]:         <nova:vcpus>1</nova:vcpus>
Nov 17 01:44:15 user nova-compute[75226]:       </nova:flavor>
Nov 17 01:44:15 user nova-compute[75226]:       <nova:owner>
Nov 17 01:44:15 user nova-compute[75226]:         <nova:user uuid="69b47debb71a4d78b446d49e268510dc">tempest-VolumesActionsTest-1992288685-project-member</nova:user>
Nov 17 01:44:15 user nova-compute[75226]:         <nova:project uuid="c42506c594c046d798038309be22e08e">tempest-VolumesActionsTest-1992288685</nova:project>
Nov 17 01:44:15 user nova-compute[75226]:       </nova:owner>
Nov 17 01:44:15 user nova-compute[75226]:       <nova:root type="image" uuid="0b369aea-6f3f-4690-9f01-229b90ab6310"/>
Nov 17 01:44:15 user nova-compute[75226]:       <nova:ports>
Nov 17 01:44:15 user nova-compute[75226]:         <nova:port uuid="eca93def-9c12-4775-a4c6-b164bf978201">
Nov 17 01:44:15 user nova-compute[75226]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 17 01:44:15 user nova-compute[75226]:         </nova:port>
Nov 17 01:44:15 user nova-compute[75226]:       </nova:ports>
Nov 17 01:44:15 user nova-compute[75226]:     </nova:instance>
Nov 17 01:44:15 user nova-compute[75226]:   </metadata>
Nov 17 01:44:15 user nova-compute[75226]:   <sysinfo type="smbios">
Nov 17 01:44:15 user nova-compute[75226]:     <system>
Nov 17 01:44:15 user nova-compute[75226]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 17 01:44:15 user nova-compute[75226]:       <entry name="product">OpenStack Nova</entry>
Nov 17 01:44:15 user nova-compute[75226]:       <entry name="version">0.0.0</entry>
Nov 17 01:44:15 user nova-compute[75226]:       <entry name="serial">6a1d76ca-5fd1-4ee6-81f2-b53d280ff585</entry>
Nov 17 01:44:15 user nova-compute[75226]:       <entry name="uuid">6a1d76ca-5fd1-4ee6-81f2-b53d280ff585</entry>
Nov 17 01:44:15 user nova-compute[75226]:       <entry name="family">Virtual Machine</entry>
Nov 17 01:44:15 user nova-compute[75226]:     </system>
Nov 17 01:44:15 user nova-compute[75226]:   </sysinfo>
Nov 17 01:44:15 user nova-compute[75226]:   <os>
Nov 17 01:44:15 user nova-compute[75226]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 17 01:44:15 user nova-compute[75226]:     <boot dev="hd"/>
Nov 17 01:44:15 user nova-compute[75226]:     <smbios mode="sysinfo"/>
Nov 17 01:44:15 user nova-compute[75226]:   </os>
Nov 17 01:44:15 user nova-compute[75226]:   <features>
Nov 17 01:44:15 user nova-compute[75226]:     <acpi/>
Nov 17 01:44:15 user nova-compute[75226]:     <apic/>
Nov 17 01:44:15 user nova-compute[75226]:     <vmcoreinfo/>
Nov 17 01:44:15 user nova-compute[75226]:   </features>
Nov 17 01:44:15 user nova-compute[75226]:   <clock offset="utc">
Nov 17 01:44:15 user nova-compute[75226]:     <timer name="pit" tickpolicy="delay"/>
Nov 17 01:44:15 user nova-compute[75226]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 17 01:44:15 user nova-compute[75226]:     <timer name="hpet" present="no"/>
Nov 17 01:44:15 user nova-compute[75226]:   </clock>
Nov 17 01:44:15 user nova-compute[75226]:   <cpu mode="custom" match="exact">
Nov 17 01:44:15 user nova-compute[75226]:     <model>Nehalem</model>
Nov 17 01:44:15 user nova-compute[75226]:     <topology sockets="1" cores="1" threads="1"/>
Nov 17 01:44:15 user nova-compute[75226]:   </cpu>
Nov 17 01:44:15 user nova-compute[75226]:   <devices>
Nov 17 01:44:15 user nova-compute[75226]:     <disk type="file" device="disk">
Nov 17 01:44:15 user nova-compute[75226]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 17 01:44:15 user nova-compute[75226]:       <source file="/opt/stack/data/nova/instances/6a1d76ca-5fd1-4ee6-81f2-b53d280ff585/disk"/>
Nov 17 01:44:15 user nova-compute[75226]:       <target dev="vda" bus="virtio"/>
Nov 17 01:44:15 user nova-compute[75226]:     </disk>
Nov 17 01:44:15 user nova-compute[75226]:     <interface type="ethernet">
Nov 17 01:44:15 user nova-compute[75226]:       <mac address="fa:16:3e:d4:0e:ae"/>
Nov 17 01:44:15 user nova-compute[75226]:       <model type="virtio"/>
Nov 17 01:44:15 user nova-compute[75226]:       <mtu size="1442"/>
Nov 17 01:44:15 user nova-compute[75226]:       <target dev="tapeca93def-9c"/>
Nov 17 01:44:15 user nova-compute[75226]:     </interface>
Nov 17 01:44:15 user nova-compute[75226]:     <serial type="pty">
Nov 17 01:44:15 user nova-compute[75226]:       <log file="/opt/stack/data/nova/instances/6a1d76ca-5fd1-4ee6-81f2-b53d280ff585/console.log" append="off"/>
Nov 17 01:44:15 user nova-compute[75226]:     </serial>
Nov 17 01:44:15 user nova-compute[75226]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 17 01:44:15 user nova-compute[75226]:     <video>
Nov 17 01:44:15 user nova-compute[75226]:       <model type="virtio"/>
Nov 17 01:44:15 user nova-compute[75226]:     </video>
Nov 17 01:44:15 user nova-compute[75226]:     <rng model="virtio">
Nov 17 01:44:15 user nova-compute[75226]:       <backend model="random">/dev/urandom</backend>
Nov 17 01:44:15 user nova-compute[75226]:     </rng>
Nov 17 01:44:15 user nova-compute[75226]:     <controller type="usb" index="0" model="none"/>
Nov 17 01:44:15 user nova-compute[75226]:     <memballoon model="virtio">
Nov 17 01:44:15 user nova-compute[75226]:       <stats period="10"/>
Nov 17 01:44:15 user nova-compute[75226]:     </memballoon>
Nov 17 01:44:15 user nova-compute[75226]:   </devices>
Nov 17 01:44:15 user nova-compute[75226]: </domain>
Nov 17 01:44:15 user nova-compute[75226]:  {{(pid=75226) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 17 01:44:15 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-7d17e4fd-93a2-489c-a5b9-9b0ee6f64036 tempest-VolumesActionsTest-1992288685 tempest-VolumesActionsTest-1992288685-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:44:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1085221871',display_name='tempest-VolumesActionsTest-instance-1085221871',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1085221871',id=44,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c42506c594c046d798038309be22e08e',ramdisk_id='',reservation_id='r-kysfoovz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1992288685',owner_user_name='tempest-VolumesActionsTest-1992288685-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T01:44:14Z,user_data=None,user_id='69b47debb71a4d78b446d49e268510dc',uuid=6a1d76ca-5fd1-4ee6-81f2-b53d280ff585,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eca93def-9c12-4775-a4c6-b164bf978201", "address": "fa:16:3e:d4:0e:ae", "network": {"id": "dee2fba9-707e-414a-bb61-ecc82be66882", "bridge": "br-int", "label": "tempest-VolumesActionsTest-439671361-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c42506c594c046d798038309be22e08e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeca93def-9c", "ovs_interfaceid": "eca93def-9c12-4775-a4c6-b164bf978201", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 17 01:44:15 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-7d17e4fd-93a2-489c-a5b9-9b0ee6f64036 tempest-VolumesActionsTest-1992288685 tempest-VolumesActionsTest-1992288685-project-member] Converting VIF {"id": "eca93def-9c12-4775-a4c6-b164bf978201", "address": "fa:16:3e:d4:0e:ae", "network": {"id": "dee2fba9-707e-414a-bb61-ecc82be66882", "bridge": "br-int", "label": "tempest-VolumesActionsTest-439671361-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c42506c594c046d798038309be22e08e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeca93def-9c", "ovs_interfaceid": "eca93def-9c12-4775-a4c6-b164bf978201", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:44:15 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-7d17e4fd-93a2-489c-a5b9-9b0ee6f64036 tempest-VolumesActionsTest-1992288685 tempest-VolumesActionsTest-1992288685-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:0e:ae,bridge_name='br-int',has_traffic_filtering=True,id=eca93def-9c12-4775-a4c6-b164bf978201,network=Network(dee2fba9-707e-414a-bb61-ecc82be66882),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeca93def-9c') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:44:15 user nova-compute[75226]: DEBUG os_vif [None req-7d17e4fd-93a2-489c-a5b9-9b0ee6f64036 tempest-VolumesActionsTest-1992288685 tempest-VolumesActionsTest-1992288685-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:0e:ae,bridge_name='br-int',has_traffic_filtering=True,id=eca93def-9c12-4775-a4c6-b164bf978201,network=Network(dee2fba9-707e-414a-bb61-ecc82be66882),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeca93def-9c') {{(pid=75226) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 17 01:44:15 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:44:15 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:44:15 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 17 01:44:15 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:44:15 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd2ad511e-76c0-5a86-b19d-3fe6ec2a76af', '_type': 'linux-noop'}}, row=False) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:44:15 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:44:15 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:44:15 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:44:15 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeca93def-9c, may_exist=True, interface_attrs={}) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:44:15 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapeca93def-9c, col_values=(('qos', UUID('16559979-8b67-49d5-bb2d-73ccacc584b7')),), if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:44:15 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapeca93def-9c, col_values=(('external_ids', {'iface-id': 'eca93def-9c12-4775-a4c6-b164bf978201', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d4:0e:ae', 'vm-uuid': '6a1d76ca-5fd1-4ee6-81f2-b53d280ff585'}),), if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:44:15 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:44:15 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:44:15 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:44:15 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:44:15 user nova-compute[75226]: INFO os_vif [None req-7d17e4fd-93a2-489c-a5b9-9b0ee6f64036 tempest-VolumesActionsTest-1992288685 tempest-VolumesActionsTest-1992288685-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:0e:ae,bridge_name='br-int',has_traffic_filtering=True,id=eca93def-9c12-4775-a4c6-b164bf978201,network=Network(dee2fba9-707e-414a-bb61-ecc82be66882),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeca93def-9c')
Nov 17 01:44:15 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Triggering sync for uuid 0597c05a-1049-4117-a8ae-8177d590e024 {{(pid=75226) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 17 01:44:15 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Triggering sync for uuid 8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02 {{(pid=75226) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 17 01:44:15 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Triggering sync for uuid 6a1d76ca-5fd1-4ee6-81f2-b53d280ff585 {{(pid=75226) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 17 01:44:15 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "0597c05a-1049-4117-a8ae-8177d590e024" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:44:15 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "0597c05a-1049-4117-a8ae-8177d590e024" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:44:15 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:44:15 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:44:15 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "6a1d76ca-5fd1-4ee6-81f2-b53d280ff585" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:44:15 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-7d17e4fd-93a2-489c-a5b9-9b0ee6f64036 tempest-VolumesActionsTest-1992288685 tempest-VolumesActionsTest-1992288685-project-member] No BDM found with device name vda, not building metadata. {{(pid=75226) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 01:44:15 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-7d17e4fd-93a2-489c-a5b9-9b0ee6f64036 tempest-VolumesActionsTest-1992288685 tempest-VolumesActionsTest-1992288685-project-member] No VIF found with MAC fa:16:3e:d4:0e:ae, not building metadata {{(pid=75226) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 01:44:15 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:44:15 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.030s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:44:15 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "0597c05a-1049-4117-a8ae-8177d590e024" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.033s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:44:16 user nova-compute[75226]: DEBUG nova.network.neutron [req-f2b69188-31e1-45b4-96e0-789d8907505b req-0d10dc8c-4aaa-41ef-aa50-735c45b65528 service nova] [instance: 6a1d76ca-5fd1-4ee6-81f2-b53d280ff585] Updated VIF entry in instance network info cache for port eca93def-9c12-4775-a4c6-b164bf978201. {{(pid=75226) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 01:44:16 user nova-compute[75226]: DEBUG nova.network.neutron [req-f2b69188-31e1-45b4-96e0-789d8907505b req-0d10dc8c-4aaa-41ef-aa50-735c45b65528 service nova] [instance: 6a1d76ca-5fd1-4ee6-81f2-b53d280ff585] Updating instance_info_cache with network_info: [{"id": "eca93def-9c12-4775-a4c6-b164bf978201", "address": "fa:16:3e:d4:0e:ae", "network": {"id": "dee2fba9-707e-414a-bb61-ecc82be66882", "bridge": "br-int", "label": "tempest-VolumesActionsTest-439671361-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c42506c594c046d798038309be22e08e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeca93def-9c", "ovs_interfaceid": "eca93def-9c12-4775-a4c6-b164bf978201", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:44:16 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-f2b69188-31e1-45b4-96e0-789d8907505b req-0d10dc8c-4aaa-41ef-aa50-735c45b65528 service nova] Releasing lock "refresh_cache-6a1d76ca-5fd1-4ee6-81f2-b53d280ff585" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:44:17 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:44:17 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:44:17 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:44:17 user nova-compute[75226]: DEBUG nova.compute.manager [req-a0e90866-36e8-4993-9298-ea653f04ff1e req-a2e82059-b4dc-4540-9e3c-034822cd8c5e service nova] [instance: 6a1d76ca-5fd1-4ee6-81f2-b53d280ff585] Received event network-vif-plugged-eca93def-9c12-4775-a4c6-b164bf978201 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:44:17 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-a0e90866-36e8-4993-9298-ea653f04ff1e req-a2e82059-b4dc-4540-9e3c-034822cd8c5e service nova] Acquiring lock "6a1d76ca-5fd1-4ee6-81f2-b53d280ff585-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:44:17 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-a0e90866-36e8-4993-9298-ea653f04ff1e req-a2e82059-b4dc-4540-9e3c-034822cd8c5e service nova] Lock "6a1d76ca-5fd1-4ee6-81f2-b53d280ff585-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:44:17 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-a0e90866-36e8-4993-9298-ea653f04ff1e req-a2e82059-b4dc-4540-9e3c-034822cd8c5e service nova] Lock "6a1d76ca-5fd1-4ee6-81f2-b53d280ff585-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:44:17 user nova-compute[75226]: DEBUG nova.compute.manager [req-a0e90866-36e8-4993-9298-ea653f04ff1e req-a2e82059-b4dc-4540-9e3c-034822cd8c5e service nova] [instance: 6a1d76ca-5fd1-4ee6-81f2-b53d280ff585] No waiting events found dispatching network-vif-plugged-eca93def-9c12-4775-a4c6-b164bf978201 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:44:17 user nova-compute[75226]: WARNING nova.compute.manager [req-a0e90866-36e8-4993-9298-ea653f04ff1e req-a2e82059-b4dc-4540-9e3c-034822cd8c5e service nova] [instance: 6a1d76ca-5fd1-4ee6-81f2-b53d280ff585] Received unexpected event network-vif-plugged-eca93def-9c12-4775-a4c6-b164bf978201 for instance with vm_state building and task_state spawning.
Nov 17 01:44:17 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:44:17 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:44:17 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:44:17 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:44:17 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:44:18 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:44:19 user nova-compute[75226]: DEBUG nova.compute.manager [None req-7d17e4fd-93a2-489c-a5b9-9b0ee6f64036 tempest-VolumesActionsTest-1992288685 tempest-VolumesActionsTest-1992288685-project-member] [instance: 6a1d76ca-5fd1-4ee6-81f2-b53d280ff585] Instance event wait completed in 0 seconds for  {{(pid=75226) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 17 01:44:19 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-7d17e4fd-93a2-489c-a5b9-9b0ee6f64036 tempest-VolumesActionsTest-1992288685 tempest-VolumesActionsTest-1992288685-project-member] [instance: 6a1d76ca-5fd1-4ee6-81f2-b53d280ff585] Guest created on hypervisor {{(pid=75226) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 17 01:44:19 user nova-compute[75226]: INFO nova.virt.libvirt.driver [-] [instance: 6a1d76ca-5fd1-4ee6-81f2-b53d280ff585] Instance spawned successfully.
Nov 17 01:44:19 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-7d17e4fd-93a2-489c-a5b9-9b0ee6f64036 tempest-VolumesActionsTest-1992288685 tempest-VolumesActionsTest-1992288685-project-member] [instance: 6a1d76ca-5fd1-4ee6-81f2-b53d280ff585] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 17 01:44:19 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-7d17e4fd-93a2-489c-a5b9-9b0ee6f64036 tempest-VolumesActionsTest-1992288685 tempest-VolumesActionsTest-1992288685-project-member] [instance: 6a1d76ca-5fd1-4ee6-81f2-b53d280ff585] Found default for hw_cdrom_bus of ide {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:44:19 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-7d17e4fd-93a2-489c-a5b9-9b0ee6f64036 tempest-VolumesActionsTest-1992288685 tempest-VolumesActionsTest-1992288685-project-member] [instance: 6a1d76ca-5fd1-4ee6-81f2-b53d280ff585] Found default for hw_disk_bus of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:44:19 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-7d17e4fd-93a2-489c-a5b9-9b0ee6f64036 tempest-VolumesActionsTest-1992288685 tempest-VolumesActionsTest-1992288685-project-member] [instance: 6a1d76ca-5fd1-4ee6-81f2-b53d280ff585] Found default for hw_input_bus of None {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:44:19 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-7d17e4fd-93a2-489c-a5b9-9b0ee6f64036 tempest-VolumesActionsTest-1992288685 tempest-VolumesActionsTest-1992288685-project-member] [instance: 6a1d76ca-5fd1-4ee6-81f2-b53d280ff585] Found default for hw_pointer_model of None {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:44:19 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-7d17e4fd-93a2-489c-a5b9-9b0ee6f64036 tempest-VolumesActionsTest-1992288685 tempest-VolumesActionsTest-1992288685-project-member] [instance: 6a1d76ca-5fd1-4ee6-81f2-b53d280ff585] Found default for hw_video_model of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:44:19 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-7d17e4fd-93a2-489c-a5b9-9b0ee6f64036 tempest-VolumesActionsTest-1992288685 tempest-VolumesActionsTest-1992288685-project-member] [instance: 6a1d76ca-5fd1-4ee6-81f2-b53d280ff585] Found default for hw_vif_model of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:44:19 user nova-compute[75226]: INFO nova.compute.manager [None req-7d17e4fd-93a2-489c-a5b9-9b0ee6f64036 tempest-VolumesActionsTest-1992288685 tempest-VolumesActionsTest-1992288685-project-member] [instance: 6a1d76ca-5fd1-4ee6-81f2-b53d280ff585] Took 4.91 seconds to spawn the instance on the hypervisor.
Nov 17 01:44:19 user nova-compute[75226]: DEBUG nova.compute.manager [None req-7d17e4fd-93a2-489c-a5b9-9b0ee6f64036 tempest-VolumesActionsTest-1992288685 tempest-VolumesActionsTest-1992288685-project-member] [instance: 6a1d76ca-5fd1-4ee6-81f2-b53d280ff585] Checking state {{(pid=75226) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 01:44:19 user nova-compute[75226]: INFO nova.compute.manager [None req-7d17e4fd-93a2-489c-a5b9-9b0ee6f64036 tempest-VolumesActionsTest-1992288685 tempest-VolumesActionsTest-1992288685-project-member] [instance: 6a1d76ca-5fd1-4ee6-81f2-b53d280ff585] Took 6.04 seconds to build instance.
Nov 17 01:44:19 user nova-compute[75226]: DEBUG nova.compute.manager [req-e99f85d9-9a63-4a52-835a-445e55580a78 req-f49b1e61-a098-4d2b-a4f6-e05fc25ef88b service nova] [instance: 6a1d76ca-5fd1-4ee6-81f2-b53d280ff585] Received event network-vif-plugged-eca93def-9c12-4775-a4c6-b164bf978201 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:44:19 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-e99f85d9-9a63-4a52-835a-445e55580a78 req-f49b1e61-a098-4d2b-a4f6-e05fc25ef88b service nova] Acquiring lock "6a1d76ca-5fd1-4ee6-81f2-b53d280ff585-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:44:19 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-e99f85d9-9a63-4a52-835a-445e55580a78 req-f49b1e61-a098-4d2b-a4f6-e05fc25ef88b service nova] Lock "6a1d76ca-5fd1-4ee6-81f2-b53d280ff585-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:44:19 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-e99f85d9-9a63-4a52-835a-445e55580a78 req-f49b1e61-a098-4d2b-a4f6-e05fc25ef88b service nova] Lock "6a1d76ca-5fd1-4ee6-81f2-b53d280ff585-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:44:19 user nova-compute[75226]: DEBUG nova.compute.manager [req-e99f85d9-9a63-4a52-835a-445e55580a78 req-f49b1e61-a098-4d2b-a4f6-e05fc25ef88b service nova] [instance: 6a1d76ca-5fd1-4ee6-81f2-b53d280ff585] No waiting events found dispatching network-vif-plugged-eca93def-9c12-4775-a4c6-b164bf978201 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:44:19 user nova-compute[75226]: WARNING nova.compute.manager [req-e99f85d9-9a63-4a52-835a-445e55580a78 req-f49b1e61-a098-4d2b-a4f6-e05fc25ef88b service nova] [instance: 6a1d76ca-5fd1-4ee6-81f2-b53d280ff585] Received unexpected event network-vif-plugged-eca93def-9c12-4775-a4c6-b164bf978201 for instance with vm_state building and task_state spawning.
Nov 17 01:44:19 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-7d17e4fd-93a2-489c-a5b9-9b0ee6f64036 tempest-VolumesActionsTest-1992288685 tempest-VolumesActionsTest-1992288685-project-member] Lock "6a1d76ca-5fd1-4ee6-81f2-b53d280ff585" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.143s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:44:19 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "6a1d76ca-5fd1-4ee6-81f2-b53d280ff585" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 3.540s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:44:19 user nova-compute[75226]: INFO nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] [instance: 6a1d76ca-5fd1-4ee6-81f2-b53d280ff585] During sync_power_state the instance has a pending task (spawning). Skip.
Nov 17 01:44:19 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "6a1d76ca-5fd1-4ee6-81f2-b53d280ff585" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:44:20 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:44:20 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:44:20 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:44:20 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:44:23 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:44:23 user nova-compute[75226]: DEBUG nova.compute.manager [req-433a3d2d-9b46-484a-b878-3195bee7f0cf req-35c9548c-dd21-45ba-b5e4-ae209db451d6 service nova] [instance: 0597c05a-1049-4117-a8ae-8177d590e024] Received event network-changed-e8a7ded4-d849-40ce-a0a9-ecf66e146e56 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:44:23 user nova-compute[75226]: DEBUG nova.compute.manager [req-433a3d2d-9b46-484a-b878-3195bee7f0cf req-35c9548c-dd21-45ba-b5e4-ae209db451d6 service nova] [instance: 0597c05a-1049-4117-a8ae-8177d590e024] Refreshing instance network info cache due to event network-changed-e8a7ded4-d849-40ce-a0a9-ecf66e146e56. {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 01:44:23 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-433a3d2d-9b46-484a-b878-3195bee7f0cf req-35c9548c-dd21-45ba-b5e4-ae209db451d6 service nova] Acquiring lock "refresh_cache-0597c05a-1049-4117-a8ae-8177d590e024" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:44:23 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-433a3d2d-9b46-484a-b878-3195bee7f0cf req-35c9548c-dd21-45ba-b5e4-ae209db451d6 service nova] Acquired lock "refresh_cache-0597c05a-1049-4117-a8ae-8177d590e024" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:44:23 user nova-compute[75226]: DEBUG nova.network.neutron [req-433a3d2d-9b46-484a-b878-3195bee7f0cf req-35c9548c-dd21-45ba-b5e4-ae209db451d6 service nova] [instance: 0597c05a-1049-4117-a8ae-8177d590e024] Refreshing network info cache for port e8a7ded4-d849-40ce-a0a9-ecf66e146e56 {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 01:44:23 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-5194d9b0-bc18-44b6-9118-2d32d7be208f tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Acquiring lock "0597c05a-1049-4117-a8ae-8177d590e024" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:44:23 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-5194d9b0-bc18-44b6-9118-2d32d7be208f tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Lock "0597c05a-1049-4117-a8ae-8177d590e024" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:44:23 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-5194d9b0-bc18-44b6-9118-2d32d7be208f tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Acquiring lock "0597c05a-1049-4117-a8ae-8177d590e024-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:44:23 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-5194d9b0-bc18-44b6-9118-2d32d7be208f tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Lock "0597c05a-1049-4117-a8ae-8177d590e024-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:44:23 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-5194d9b0-bc18-44b6-9118-2d32d7be208f tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Lock "0597c05a-1049-4117-a8ae-8177d590e024-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:44:23 user nova-compute[75226]: INFO nova.compute.manager [None req-5194d9b0-bc18-44b6-9118-2d32d7be208f tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] [instance: 0597c05a-1049-4117-a8ae-8177d590e024] Terminating instance
Nov 17 01:44:23 user nova-compute[75226]: DEBUG nova.compute.manager [None req-5194d9b0-bc18-44b6-9118-2d32d7be208f tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] [instance: 0597c05a-1049-4117-a8ae-8177d590e024] Start destroying the instance on the hypervisor. {{(pid=75226) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 17 01:44:23 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:44:23 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:44:23 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:44:23 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:44:23 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:44:24 user nova-compute[75226]: DEBUG nova.network.neutron [req-433a3d2d-9b46-484a-b878-3195bee7f0cf req-35c9548c-dd21-45ba-b5e4-ae209db451d6 service nova] [instance: 0597c05a-1049-4117-a8ae-8177d590e024] Updated VIF entry in instance network info cache for port e8a7ded4-d849-40ce-a0a9-ecf66e146e56. {{(pid=75226) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 01:44:24 user nova-compute[75226]: DEBUG nova.network.neutron [req-433a3d2d-9b46-484a-b878-3195bee7f0cf req-35c9548c-dd21-45ba-b5e4-ae209db451d6 service nova] [instance: 0597c05a-1049-4117-a8ae-8177d590e024] Updating instance_info_cache with network_info: [{"id": "e8a7ded4-d849-40ce-a0a9-ecf66e146e56", "address": "fa:16:3e:6d:db:0b", "network": {"id": "b6c26fa5-eacc-41d3-b790-795e59c84966", "bridge": "br-int", "label": "tempest-TestStampPattern-2002555642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8046d4519e4b4f0b864f9ea10a4886fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8a7ded4-d8", "ovs_interfaceid": "e8a7ded4-d849-40ce-a0a9-ecf66e146e56", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:44:24 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-433a3d2d-9b46-484a-b878-3195bee7f0cf req-35c9548c-dd21-45ba-b5e4-ae209db451d6 service nova] Releasing lock "refresh_cache-0597c05a-1049-4117-a8ae-8177d590e024" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:44:24 user nova-compute[75226]: INFO nova.virt.libvirt.driver [-] [instance: 0597c05a-1049-4117-a8ae-8177d590e024] Instance destroyed successfully.
Nov 17 01:44:24 user nova-compute[75226]: DEBUG nova.objects.instance [None req-5194d9b0-bc18-44b6-9118-2d32d7be208f tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Lazy-loading 'resources' on Instance uuid 0597c05a-1049-4117-a8ae-8177d590e024 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:44:24 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-5194d9b0-bc18-44b6-9118-2d32d7be208f tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:37:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1423998118',display_name='tempest-TestStampPattern-server-1423998118',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1423998118',id=38,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJo/tAB5VbatxtFO3qcGvVQYO+DJCVCBnHzmF73L8NhWbPARofXbPE3d/rvN9G86C2CwqSw7WTEjMfEOGTjqYfRxtLwEwauLFrL7ndRptXBl9uTXrST97QU1m8g2Jvz0/g==',key_name='tempest-TestStampPattern-635437790',keypairs=<?>,launch_index=0,launched_at=2023-11-17T01:37:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8046d4519e4b4f0b864f9ea10a4886fa',ramdisk_id='',reservation_id='r-c6hggt8x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-266167712',owner_user_name='tempest-TestStampPattern-266167712-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T01:40:33Z,user_data=None,user_id='0357cbff2e7f4a3ebf4ab02e717b451f',uuid=0597c05a-1049-4117-a8ae-8177d590e024,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e8a7ded4-d849-40ce-a0a9-ecf66e146e56", "address": "fa:16:3e:6d:db:0b", "network": {"id": "b6c26fa5-eacc-41d3-b790-795e59c84966", "bridge": "br-int", "label": "tempest-TestStampPattern-2002555642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8046d4519e4b4f0b864f9ea10a4886fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8a7ded4-d8", "ovs_interfaceid": "e8a7ded4-d849-40ce-a0a9-ecf66e146e56", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 17 01:44:24 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-5194d9b0-bc18-44b6-9118-2d32d7be208f tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Converting VIF {"id": "e8a7ded4-d849-40ce-a0a9-ecf66e146e56", "address": "fa:16:3e:6d:db:0b", "network": {"id": "b6c26fa5-eacc-41d3-b790-795e59c84966", "bridge": "br-int", "label": "tempest-TestStampPattern-2002555642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8046d4519e4b4f0b864f9ea10a4886fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8a7ded4-d8", "ovs_interfaceid": "e8a7ded4-d849-40ce-a0a9-ecf66e146e56", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:44:24 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-5194d9b0-bc18-44b6-9118-2d32d7be208f tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6d:db:0b,bridge_name='br-int',has_traffic_filtering=True,id=e8a7ded4-d849-40ce-a0a9-ecf66e146e56,network=Network(b6c26fa5-eacc-41d3-b790-795e59c84966),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8a7ded4-d8') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:44:24 user nova-compute[75226]: DEBUG os_vif [None req-5194d9b0-bc18-44b6-9118-2d32d7be208f tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6d:db:0b,bridge_name='br-int',has_traffic_filtering=True,id=e8a7ded4-d849-40ce-a0a9-ecf66e146e56,network=Network(b6c26fa5-eacc-41d3-b790-795e59c84966),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8a7ded4-d8') {{(pid=75226) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 17 01:44:24 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:44:24 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape8a7ded4-d8, bridge=br-int, if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:44:24 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:44:24 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:44:24 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:44:24 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=53295858-fab4-4220-9eff-02b5f2a60e96) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:44:24 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:44:24 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:44:24 user nova-compute[75226]: INFO os_vif [None req-5194d9b0-bc18-44b6-9118-2d32d7be208f tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6d:db:0b,bridge_name='br-int',has_traffic_filtering=True,id=e8a7ded4-d849-40ce-a0a9-ecf66e146e56,network=Network(b6c26fa5-eacc-41d3-b790-795e59c84966),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8a7ded4-d8')
Nov 17 01:44:24 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-5194d9b0-bc18-44b6-9118-2d32d7be208f tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] [instance: 0597c05a-1049-4117-a8ae-8177d590e024] Deleting instance files /opt/stack/data/nova/instances/0597c05a-1049-4117-a8ae-8177d590e024_del
Nov 17 01:44:24 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-5194d9b0-bc18-44b6-9118-2d32d7be208f tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] [instance: 0597c05a-1049-4117-a8ae-8177d590e024] Deletion of /opt/stack/data/nova/instances/0597c05a-1049-4117-a8ae-8177d590e024_del complete
Nov 17 01:44:24 user nova-compute[75226]: INFO nova.compute.manager [None req-5194d9b0-bc18-44b6-9118-2d32d7be208f tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] [instance: 0597c05a-1049-4117-a8ae-8177d590e024] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 17 01:44:24 user nova-compute[75226]: DEBUG oslo.service.loopingcall [None req-5194d9b0-bc18-44b6-9118-2d32d7be208f tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75226) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 17 01:44:24 user nova-compute[75226]: DEBUG nova.compute.manager [-] [instance: 0597c05a-1049-4117-a8ae-8177d590e024] Deallocating network for instance {{(pid=75226) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 17 01:44:24 user nova-compute[75226]: DEBUG nova.network.neutron [-] [instance: 0597c05a-1049-4117-a8ae-8177d590e024] deallocate_for_instance() {{(pid=75226) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 17 01:44:25 user nova-compute[75226]: DEBUG nova.network.neutron [-] [instance: 0597c05a-1049-4117-a8ae-8177d590e024] Updating instance_info_cache with network_info: [] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:44:25 user nova-compute[75226]: INFO nova.compute.manager [-] [instance: 0597c05a-1049-4117-a8ae-8177d590e024] Took 0.52 seconds to deallocate network for instance.
Nov 17 01:44:25 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-5194d9b0-bc18-44b6-9118-2d32d7be208f tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:44:25 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-5194d9b0-bc18-44b6-9118-2d32d7be208f tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:44:25 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-5194d9b0-bc18-44b6-9118-2d32d7be208f tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:44:25 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-5194d9b0-bc18-44b6-9118-2d32d7be208f tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:44:25 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-5194d9b0-bc18-44b6-9118-2d32d7be208f tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.163s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:44:25 user nova-compute[75226]: INFO nova.scheduler.client.report [None req-5194d9b0-bc18-44b6-9118-2d32d7be208f tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Deleted allocations for instance 0597c05a-1049-4117-a8ae-8177d590e024
Nov 17 01:44:25 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-5194d9b0-bc18-44b6-9118-2d32d7be208f tempest-TestStampPattern-266167712 tempest-TestStampPattern-266167712-project-member] Lock "0597c05a-1049-4117-a8ae-8177d590e024" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.709s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:44:25 user nova-compute[75226]: DEBUG nova.compute.manager [req-fa00dbae-dab2-4521-986e-5ed006c83ad6 req-f57acf94-af08-4be9-9ba5-1e67dd8f4fe8 service nova] [instance: 0597c05a-1049-4117-a8ae-8177d590e024] Received event network-vif-unplugged-e8a7ded4-d849-40ce-a0a9-ecf66e146e56 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:44:25 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-fa00dbae-dab2-4521-986e-5ed006c83ad6 req-f57acf94-af08-4be9-9ba5-1e67dd8f4fe8 service nova] Acquiring lock "0597c05a-1049-4117-a8ae-8177d590e024-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:44:25 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-fa00dbae-dab2-4521-986e-5ed006c83ad6 req-f57acf94-af08-4be9-9ba5-1e67dd8f4fe8 service nova] Lock "0597c05a-1049-4117-a8ae-8177d590e024-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:44:25 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-fa00dbae-dab2-4521-986e-5ed006c83ad6 req-f57acf94-af08-4be9-9ba5-1e67dd8f4fe8 service nova] Lock "0597c05a-1049-4117-a8ae-8177d590e024-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:44:25 user nova-compute[75226]: DEBUG nova.compute.manager [req-fa00dbae-dab2-4521-986e-5ed006c83ad6 req-f57acf94-af08-4be9-9ba5-1e67dd8f4fe8 service nova] [instance: 0597c05a-1049-4117-a8ae-8177d590e024] No waiting events found dispatching network-vif-unplugged-e8a7ded4-d849-40ce-a0a9-ecf66e146e56 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:44:25 user nova-compute[75226]: WARNING nova.compute.manager [req-fa00dbae-dab2-4521-986e-5ed006c83ad6 req-f57acf94-af08-4be9-9ba5-1e67dd8f4fe8 service nova] [instance: 0597c05a-1049-4117-a8ae-8177d590e024] Received unexpected event network-vif-unplugged-e8a7ded4-d849-40ce-a0a9-ecf66e146e56 for instance with vm_state deleted and task_state None.
Nov 17 01:44:25 user nova-compute[75226]: DEBUG nova.compute.manager [req-fa00dbae-dab2-4521-986e-5ed006c83ad6 req-f57acf94-af08-4be9-9ba5-1e67dd8f4fe8 service nova] [instance: 0597c05a-1049-4117-a8ae-8177d590e024] Received event network-vif-plugged-e8a7ded4-d849-40ce-a0a9-ecf66e146e56 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:44:25 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-fa00dbae-dab2-4521-986e-5ed006c83ad6 req-f57acf94-af08-4be9-9ba5-1e67dd8f4fe8 service nova] Acquiring lock "0597c05a-1049-4117-a8ae-8177d590e024-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:44:25 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-fa00dbae-dab2-4521-986e-5ed006c83ad6 req-f57acf94-af08-4be9-9ba5-1e67dd8f4fe8 service nova] Lock "0597c05a-1049-4117-a8ae-8177d590e024-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:44:25 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-fa00dbae-dab2-4521-986e-5ed006c83ad6 req-f57acf94-af08-4be9-9ba5-1e67dd8f4fe8 service nova] Lock "0597c05a-1049-4117-a8ae-8177d590e024-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:44:25 user nova-compute[75226]: DEBUG nova.compute.manager [req-fa00dbae-dab2-4521-986e-5ed006c83ad6 req-f57acf94-af08-4be9-9ba5-1e67dd8f4fe8 service nova] [instance: 0597c05a-1049-4117-a8ae-8177d590e024] No waiting events found dispatching network-vif-plugged-e8a7ded4-d849-40ce-a0a9-ecf66e146e56 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:44:25 user nova-compute[75226]: WARNING nova.compute.manager [req-fa00dbae-dab2-4521-986e-5ed006c83ad6 req-f57acf94-af08-4be9-9ba5-1e67dd8f4fe8 service nova] [instance: 0597c05a-1049-4117-a8ae-8177d590e024] Received unexpected event network-vif-plugged-e8a7ded4-d849-40ce-a0a9-ecf66e146e56 for instance with vm_state deleted and task_state None.
Nov 17 01:44:25 user nova-compute[75226]: DEBUG nova.compute.manager [req-fa00dbae-dab2-4521-986e-5ed006c83ad6 req-f57acf94-af08-4be9-9ba5-1e67dd8f4fe8 service nova] [instance: 0597c05a-1049-4117-a8ae-8177d590e024] Received event network-vif-deleted-e8a7ded4-d849-40ce-a0a9-ecf66e146e56 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:44:25 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:44:25 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Starting heal instance info cache {{(pid=75226) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 17 01:44:26 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "refresh_cache-8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:44:26 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquired lock "refresh_cache-8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:44:26 user nova-compute[75226]: DEBUG nova.network.neutron [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] [instance: 8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02] Forcefully refreshing network info cache for instance {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 17 01:44:26 user nova-compute[75226]: DEBUG nova.network.neutron [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] [instance: 8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02] Updating instance_info_cache with network_info: [{"id": "ab437de1-a5c2-48c9-b693-902fc4b05929", "address": "fa:16:3e:2c:67:4c", "network": {"id": "44f50686-24e7-4e75-8269-4391a53286d0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1611114801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33699aa6c9db4815a1e79aff4685801e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab437de1-a5", "ovs_interfaceid": "ab437de1-a5c2-48c9-b693-902fc4b05929", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:44:26 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Releasing lock "refresh_cache-8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:44:26 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] [instance: 8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02] Updated the network info_cache for instance {{(pid=75226) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 17 01:44:26 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:44:27 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:44:27 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75226) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 17 01:44:28 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:44:29 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:44:34 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:44:38 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:44:39 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:44:43 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:44:44 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:44:48 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:44:49 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:44:53 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:44:54 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:44:59 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:45:02 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-403bfac3-ee35-49b8-b4c1-c4421df66648 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Acquiring lock "8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:45:02 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-403bfac3-ee35-49b8-b4c1-c4421df66648 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Lock "8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:45:02 user nova-compute[75226]: DEBUG nova.objects.instance [None req-403bfac3-ee35-49b8-b4c1-c4421df66648 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Lazy-loading 'flavor' on Instance uuid 8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:45:02 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-403bfac3-ee35-49b8-b4c1-c4421df66648 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Lock "8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:45:02 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-403bfac3-ee35-49b8-b4c1-c4421df66648 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Acquiring lock "8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:45:02 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-403bfac3-ee35-49b8-b4c1-c4421df66648 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Lock "8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:45:02 user nova-compute[75226]: INFO nova.compute.manager [None req-403bfac3-ee35-49b8-b4c1-c4421df66648 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] [instance: 8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02] Attaching volume 2e4c54a4-b25d-4164-8c77-6885e25ab238 to /dev/vdb
Nov 17 01:45:02 user nova-compute[75226]: DEBUG os_brick.utils [None req-403bfac3-ee35-49b8-b4c1-c4421df66648 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:45:02 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:45:02 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:45:02 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ca9e02c-be52-476b-8ea1-e0320207bed0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f62857db69\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:45:02 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:45:02 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:45:02 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[c424759d-db24-4f69-8761-ebc970a2303f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:45:02 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:45:02 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:45:02 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7f875a5-0311-413d-9b7b-27164a2b37e0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:45:02 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5a60674-9c54-411c-86d8-6677e1ab4cba]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:45:02 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-403bfac3-ee35-49b8-b4c1-c4421df66648 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Running cmd (subprocess): nvme version {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:45:02 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-403bfac3-ee35-49b8-b4c1-c4421df66648 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] 'nvme version' failed. Not Retrying. {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 01:45:02 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.nvmeof [None req-403bfac3-ee35-49b8-b4c1-c4421df66648 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] nvme not present on system {{(pid=75226) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 17 01:45:02 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:45:03 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 01:45:03 user nova-compute[75226]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 17 01:45:03 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[301df89a-8b65-45c3-ab42-2e4a7d785129]: (4, '') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:45:03 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-403bfac3-ee35-49b8-b4c1-c4421df66648 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75226) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 17 01:45:03 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-403bfac3-ee35-49b8-b4c1-c4421df66648 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75226) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 17 01:45:03 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-403bfac3-ee35-49b8-b4c1-c4421df66648 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] LIGHTOS: no hostnqn found. {{(pid=75226) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 17 01:45:03 user nova-compute[75226]: DEBUG os_brick.utils [None req-403bfac3-ee35-49b8-b4c1-c4421df66648 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f62857db69', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:45:03 user nova-compute[75226]: DEBUG nova.virt.block_device [None req-403bfac3-ee35-49b8-b4c1-c4421df66648 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] [instance: 8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02] Updating existing volume attachment record: 1ae63ba9-ce0b-4c85-91e2-50b5e02a557a {{(pid=75226) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 17 01:45:04 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:45:04 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:45:04 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=75226) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 17 01:45:04 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75226) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 01:45:04 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:45:04 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75226) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 01:45:09 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:45:10 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-403bfac3-ee35-49b8-b4c1-c4421df66648 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] [instance: 8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02] Calling os-brick to attach iSCSI Volume {{(pid=75226) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 17 01:45:10 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-403bfac3-ee35-49b8-b4c1-c4421df66648 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc4cc36b490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2e4c54a4-b25d-4164-8c77-6885e25ab238', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pQmDcizu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:45:10 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-403bfac3-ee35-49b8-b4c1-c4421df66648 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:45:10 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-403bfac3-ee35-49b8-b4c1-c4421df66648 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:45:10 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-403bfac3-ee35-49b8-b4c1-c4421df66648 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:45:10 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-403bfac3-ee35-49b8-b4c1-c4421df66648 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:45:10 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-403bfac3-ee35-49b8-b4c1-c4421df66648 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2e4c54a4-b25d-4164-8c77-6885e25ab238" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:45:10 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-403bfac3-ee35-49b8-b4c1-c4421df66648 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2e4c54a4-b25d-4164-8c77-6885e25ab238" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.133s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:45:10 user nova-compute[75226]: INFO os_brick.initiator.connectors.iscsi [None req-403bfac3-ee35-49b8-b4c1-c4421df66648 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 17 01:45:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e4c54a4-b25d-4164-8c77-6885e25ab238 -p 172.16.0.220:3260 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:45:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e4c54a4-b25d-4164-8c77-6885e25ab238 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:45:10 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[c88dbca8-258f-45be-872b-94654b78580c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:45:10 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-403bfac3-ee35-49b8-b4c1-c4421df66648 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 17 01:45:10 user nova-compute[75226]:  {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:45:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e4c54a4-b25d-4164-8c77-6885e25ab238 -p 172.16.0.220:3260 --interface default --op new {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:45:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e4c54a4-b25d-4164-8c77-6885e25ab238 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.088s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:45:10 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[64e88737-1e27-41ff-9ce9-744b70dc6b14]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2e4c54a4-b25d-4164-8c77-6885e25ab238] added\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:45:10 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-403bfac3-ee35-49b8-b4c1-c4421df66648 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2e4c54a4-b25d-4164-8c77-6885e25ab238] added
Nov 17 01:45:10 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:45:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e4c54a4-b25d-4164-8c77-6885e25ab238 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:45:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e4c54a4-b25d-4164-8c77-6885e25ab238 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.250s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:45:10 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a695875-563f-4f47-94c0-dc94eb7d11e3]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:45:10 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-403bfac3-ee35-49b8-b4c1-c4421df66648 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:45:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e4c54a4-b25d-4164-8c77-6885e25ab238 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:45:11 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e4c54a4-b25d-4164-8c77-6885e25ab238 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.181s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:45:11 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[3004ed96-b785-4dfb-bd6d-1bc4d701c654]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:45:11 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-403bfac3-ee35-49b8-b4c1-c4421df66648 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:45:11 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e4c54a4-b25d-4164-8c77-6885e25ab238 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pQmDcizu {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:45:11 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e4c54a4-b25d-4164-8c77-6885e25ab238 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pQmDcizu" returned: 0 in 0.051s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:45:11 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[df912880-3e80-49e6-bc99-c254404d6849]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:45:11 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-403bfac3-ee35-49b8-b4c1-c4421df66648 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pQmDcizu'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:45:11 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e4c54a4-b25d-4164-8c77-6885e25ab238 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:45:11 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e4c54a4-b25d-4164-8c77-6885e25ab238 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.187s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:45:11 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc31c5fb-141d-4643-8025-28b7f0cd2607]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:45:11 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-403bfac3-ee35-49b8-b4c1-c4421df66648 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:45:11 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:45:11 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:45:11 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[28217a65-6afa-4f00-a4b4-9283e466c00a]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:45:11 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-403bfac3-ee35-49b8-b4c1-c4421df66648 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 17 01:45:11 user nova-compute[75226]:  {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:45:11 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-403bfac3-ee35-49b8-b4c1-c4421df66648 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 17 01:45:11 user nova-compute[75226]:  {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:45:11 user nova-compute[75226]: WARNING os_brick.initiator.connectors.iscsi [None req-403bfac3-ee35-49b8-b4c1-c4421df66648 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 17 01:45:11 user nova-compute[75226]: 
Nov 17 01:45:11 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e4c54a4-b25d-4164-8c77-6885e25ab238 -p 172.16.0.220:3260 --login {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:45:11 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e4c54a4-b25d-4164-8c77-6885e25ab238 -p 172.16.0.220:3260 --login" returned: 0 in 0.120s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:45:11 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[24ac7b0e-dbf6-491c-84ad-fc44eb46653e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2e4c54a4-b25d-4164-8c77-6885e25ab238, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2e4c54a4-b25d-4164-8c77-6885e25ab238, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:45:11 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-403bfac3-ee35-49b8-b4c1-c4421df66648 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2e4c54a4-b25d-4164-8c77-6885e25ab238, portal: 172.16.0.220,3260]
Nov 17 01:45:11 user nova-compute[75226]: Login to [iface: default, target: iqn.2010-10.org.openstack:2e4c54a4-b25d-4164-8c77-6885e25ab238, portal: 172.16.0.220,3260] successful.
Nov 17 01:45:11 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:45:11 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e4c54a4-b25d-4164-8c77-6885e25ab238 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:45:11 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e4c54a4-b25d-4164-8c77-6885e25ab238 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:45:11 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[76ecc358-c150-43e2-a7e8-db2b3d5b766a]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:45:11 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-403bfac3-ee35-49b8-b4c1-c4421df66648 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:45:11 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:45:11 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:45:11 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d716dde-50ce-4783-8533-9391a490c6e5]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e4c54a4-b25d-4164-8c77-6885e25ab238 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:45:11 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-403bfac3-ee35-49b8-b4c1-c4421df66648 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e4c54a4-b25d-4164-8c77-6885e25ab238 (non-flash)
Nov 17 01:45:11 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:45:11 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-403bfac3-ee35-49b8-b4c1-c4421df66648 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e4c54a4-b25d-4164-8c77-6885e25ab238 (non-flash)
Nov 17 01:45:11 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:45:11 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-403bfac3-ee35-49b8-b4c1-c4421df66648 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2e4c54a4-b25d-4164-8c77-6885e25ab238" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.030s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:45:11 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-403bfac3-ee35-49b8-b4c1-c4421df66648 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Connected to 172.16.0.220:3260 {{(pid=75226) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 17 01:45:11 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-403bfac3-ee35-49b8-b4c1-c4421df66648 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] HCTL ('33', '-', '-', 0) found on session 52 with lun 0 {{(pid=75226) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 17 01:45:11 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-403bfac3-ee35-49b8-b4c1-c4421df66648 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75226) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 17 01:45:11 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:45:11 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:45:11 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[254a772f-3158-416c-a5b5-cc135ed82969]: (4, ('- - 0', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:45:11 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-403bfac3-ee35-49b8-b4c1-c4421df66648 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75226) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 01:45:11 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-403bfac3-ee35-49b8-b4c1-c4421df66648 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:2e4c54a4-b25d-4164-8c77-6885e25ab238', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pQmDcizu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75226) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 17 01:45:11 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:45:12 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-403bfac3-ee35-49b8-b4c1-c4421df66648 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.199s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:45:12 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-403bfac3-ee35-49b8-b4c1-c4421df66648 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] <== connect_volume: return (2201ms) {'type': 'block', 'scsi_wwn': '23165333632316636', 'path': '/dev/sdb'} {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:45:12 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-403bfac3-ee35-49b8-b4c1-c4421df66648 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] [instance: 8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23165333632316636', 'path': '/dev/sdb'} {{(pid=75226) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 17 01:45:12 user nova-compute[75226]: DEBUG nova.objects.instance [None req-403bfac3-ee35-49b8-b4c1-c4421df66648 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Lazy-loading 'flavor' on Instance uuid 8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:45:12 user nova-compute[75226]: DEBUG nova.virt.libvirt.guest [None req-403bfac3-ee35-49b8-b4c1-c4421df66648 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] attach device xml: <disk type="block" device="disk">
Nov 17 01:45:12 user nova-compute[75226]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 01:45:12 user nova-compute[75226]:   <source dev="/dev/sdb"/>
Nov 17 01:45:12 user nova-compute[75226]:   <target dev="vdb" bus="virtio"/>
Nov 17 01:45:12 user nova-compute[75226]:   <serial>2e4c54a4-b25d-4164-8c77-6885e25ab238</serial>
Nov 17 01:45:12 user nova-compute[75226]: </disk>
Nov 17 01:45:12 user nova-compute[75226]:  {{(pid=75226) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 17 01:45:13 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-403bfac3-ee35-49b8-b4c1-c4421df66648 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] No BDM found with device name vda, not building metadata. {{(pid=75226) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 01:45:13 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-403bfac3-ee35-49b8-b4c1-c4421df66648 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75226) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 01:45:13 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-403bfac3-ee35-49b8-b4c1-c4421df66648 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] No VIF found with MAC fa:16:3e:2c:67:4c, not building metadata {{(pid=75226) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 01:45:13 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-403bfac3-ee35-49b8-b4c1-c4421df66648 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Lock "8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.357s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:45:13 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:45:13 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:45:13 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:45:13 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:45:13 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75226) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 17 01:45:14 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:45:14 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-a8e90e19-cb83-4b96-95f0-7f8c200599a6 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Acquiring lock "d281f155-01b4-4141-8184-8c5111a7c663" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:45:14 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-a8e90e19-cb83-4b96-95f0-7f8c200599a6 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Lock "d281f155-01b4-4141-8184-8c5111a7c663" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:45:14 user nova-compute[75226]: DEBUG nova.compute.manager [None req-a8e90e19-cb83-4b96-95f0-7f8c200599a6 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: d281f155-01b4-4141-8184-8c5111a7c663] Starting instance... {{(pid=75226) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 17 01:45:14 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:45:14 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:45:14 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-a8e90e19-cb83-4b96-95f0-7f8c200599a6 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:45:14 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-a8e90e19-cb83-4b96-95f0-7f8c200599a6 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:45:14 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-a8e90e19-cb83-4b96-95f0-7f8c200599a6 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75226) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 17 01:45:14 user nova-compute[75226]: INFO nova.compute.claims [None req-a8e90e19-cb83-4b96-95f0-7f8c200599a6 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: d281f155-01b4-4141-8184-8c5111a7c663] Claim successful on node user
Nov 17 01:45:14 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:45:14 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:45:14 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75226) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 01:45:14 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1d76ca-5fd1-4ee6-81f2-b53d280ff585/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:45:14 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-a8e90e19-cb83-4b96-95f0-7f8c200599a6 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:45:14 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-a8e90e19-cb83-4b96-95f0-7f8c200599a6 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:45:14 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-a8e90e19-cb83-4b96-95f0-7f8c200599a6 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.330s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:45:14 user nova-compute[75226]: DEBUG nova.compute.manager [None req-a8e90e19-cb83-4b96-95f0-7f8c200599a6 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: d281f155-01b4-4141-8184-8c5111a7c663] Start building networks asynchronously for instance. {{(pid=75226) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 17 01:45:14 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1d76ca-5fd1-4ee6-81f2-b53d280ff585/disk --force-share --output=json" returned: 0 in 0.261s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:45:14 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1d76ca-5fd1-4ee6-81f2-b53d280ff585/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:45:14 user nova-compute[75226]: DEBUG nova.compute.manager [None req-a8e90e19-cb83-4b96-95f0-7f8c200599a6 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: d281f155-01b4-4141-8184-8c5111a7c663] Allocating IP information in the background. {{(pid=75226) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 17 01:45:14 user nova-compute[75226]: DEBUG nova.network.neutron [None req-a8e90e19-cb83-4b96-95f0-7f8c200599a6 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: d281f155-01b4-4141-8184-8c5111a7c663] allocate_for_instance() {{(pid=75226) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 17 01:45:14 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-a8e90e19-cb83-4b96-95f0-7f8c200599a6 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: d281f155-01b4-4141-8184-8c5111a7c663] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 17 01:45:14 user nova-compute[75226]: DEBUG nova.compute.manager [None req-a8e90e19-cb83-4b96-95f0-7f8c200599a6 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: d281f155-01b4-4141-8184-8c5111a7c663] Start building block device mappings for instance. {{(pid=75226) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 17 01:45:14 user nova-compute[75226]: DEBUG nova.policy [None req-a8e90e19-cb83-4b96-95f0-7f8c200599a6 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7c8c8baa56884dcd9a90f0187c9fc06f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673620a69fba4a04af75baabe775dc8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75226) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 17 01:45:14 user nova-compute[75226]: INFO nova.virt.block_device [None req-a8e90e19-cb83-4b96-95f0-7f8c200599a6 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: d281f155-01b4-4141-8184-8c5111a7c663] Booting with volume ea51d240-abac-484a-8d78-49c9f9990337 at /dev/vda
Nov 17 01:45:14 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1d76ca-5fd1-4ee6-81f2-b53d280ff585/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:45:15 user nova-compute[75226]: DEBUG os_brick.utils [None req-a8e90e19-cb83-4b96-95f0-7f8c200599a6 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:45:15 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:45:15 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:45:15 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:45:15 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Hypervisor/Node resource view: name=user free_ram=8713MB free_disk=24.928829193115234GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75226) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 17 01:45:15 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:45:15 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:45:15 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:45:15 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[9447198b-c573-4a6f-a032-c90cf560ffe7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f62857db69\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:45:15 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:45:15 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:45:15 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[bde0e14f-49c4-4710-a611-050ecb596763]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:45:15 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:45:15 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:45:15 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[77d352dc-88d0-44da-a4ce-643202d32270]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:45:15 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[1add0c7d-d16b-4a77-b791-e386c6421496]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:45:15 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-a8e90e19-cb83-4b96-95f0-7f8c200599a6 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Running cmd (subprocess): nvme version {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:45:15 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-a8e90e19-cb83-4b96-95f0-7f8c200599a6 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] 'nvme version' failed. Not Retrying. {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 01:45:15 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a8e90e19-cb83-4b96-95f0-7f8c200599a6 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] nvme not present on system {{(pid=75226) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 17 01:45:15 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:45:15 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 01:45:15 user nova-compute[75226]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 17 01:45:15 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfcc1021-c714-4b67-971d-dc8ce0c7fa44]: (4, '') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:45:15 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-a8e90e19-cb83-4b96-95f0-7f8c200599a6 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75226) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 17 01:45:15 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-a8e90e19-cb83-4b96-95f0-7f8c200599a6 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75226) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 17 01:45:15 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-a8e90e19-cb83-4b96-95f0-7f8c200599a6 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] LIGHTOS: no hostnqn found. {{(pid=75226) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 17 01:45:15 user nova-compute[75226]: DEBUG os_brick.utils [None req-a8e90e19-cb83-4b96-95f0-7f8c200599a6 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] <== get_connector_properties: return (149ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f62857db69', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:45:15 user nova-compute[75226]: DEBUG nova.virt.block_device [None req-a8e90e19-cb83-4b96-95f0-7f8c200599a6 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: d281f155-01b4-4141-8184-8c5111a7c663] Updating existing volume attachment record: c0393f64-f135-4e7a-a56a-8ee0327d3bf3 {{(pid=75226) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 17 01:45:15 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:45:15 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 6a1d76ca-5fd1-4ee6-81f2-b53d280ff585 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:45:15 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance d281f155-01b4-4141-8184-8c5111a7c663 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:45:15 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75226) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 17 01:45:15 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75226) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 17 01:45:15 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:45:15 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:45:15 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Compute_service record updated for user:user {{(pid=75226) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 17 01:45:15 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.416s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:45:16 user nova-compute[75226]: DEBUG nova.compute.manager [req-6781f6e4-96c0-4d8e-8e86-aeb42beb0500 req-9ff3c28f-bb7b-45e7-bbb7-d92f1d46b1d0 service nova] [instance: 8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02] Received event network-changed-ab437de1-a5c2-48c9-b693-902fc4b05929 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:45:16 user nova-compute[75226]: DEBUG nova.compute.manager [req-6781f6e4-96c0-4d8e-8e86-aeb42beb0500 req-9ff3c28f-bb7b-45e7-bbb7-d92f1d46b1d0 service nova] [instance: 8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02] Refreshing instance network info cache due to event network-changed-ab437de1-a5c2-48c9-b693-902fc4b05929. {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 01:45:16 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-6781f6e4-96c0-4d8e-8e86-aeb42beb0500 req-9ff3c28f-bb7b-45e7-bbb7-d92f1d46b1d0 service nova] Acquiring lock "refresh_cache-8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:45:16 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-6781f6e4-96c0-4d8e-8e86-aeb42beb0500 req-9ff3c28f-bb7b-45e7-bbb7-d92f1d46b1d0 service nova] Acquired lock "refresh_cache-8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:45:16 user nova-compute[75226]: DEBUG nova.network.neutron [req-6781f6e4-96c0-4d8e-8e86-aeb42beb0500 req-9ff3c28f-bb7b-45e7-bbb7-d92f1d46b1d0 service nova] [instance: 8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02] Refreshing network info cache for port ab437de1-a5c2-48c9-b693-902fc4b05929 {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 01:45:16 user nova-compute[75226]: DEBUG nova.network.neutron [None req-a8e90e19-cb83-4b96-95f0-7f8c200599a6 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: d281f155-01b4-4141-8184-8c5111a7c663] Successfully created port: b18b7636-d18b-4cce-8bea-b9a293b75952 {{(pid=75226) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 17 01:45:16 user nova-compute[75226]: DEBUG nova.network.neutron [req-6781f6e4-96c0-4d8e-8e86-aeb42beb0500 req-9ff3c28f-bb7b-45e7-bbb7-d92f1d46b1d0 service nova] [instance: 8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02] Updated VIF entry in instance network info cache for port ab437de1-a5c2-48c9-b693-902fc4b05929. {{(pid=75226) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 01:45:16 user nova-compute[75226]: DEBUG nova.network.neutron [req-6781f6e4-96c0-4d8e-8e86-aeb42beb0500 req-9ff3c28f-bb7b-45e7-bbb7-d92f1d46b1d0 service nova] [instance: 8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02] Updating instance_info_cache with network_info: [{"id": "ab437de1-a5c2-48c9-b693-902fc4b05929", "address": "fa:16:3e:2c:67:4c", "network": {"id": "44f50686-24e7-4e75-8269-4391a53286d0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1611114801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33699aa6c9db4815a1e79aff4685801e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab437de1-a5", "ovs_interfaceid": "ab437de1-a5c2-48c9-b693-902fc4b05929", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:45:16 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-6781f6e4-96c0-4d8e-8e86-aeb42beb0500 req-9ff3c28f-bb7b-45e7-bbb7-d92f1d46b1d0 service nova] Releasing lock "refresh_cache-8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:45:17 user nova-compute[75226]: DEBUG nova.network.neutron [None req-a8e90e19-cb83-4b96-95f0-7f8c200599a6 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: d281f155-01b4-4141-8184-8c5111a7c663] Successfully updated port: b18b7636-d18b-4cce-8bea-b9a293b75952 {{(pid=75226) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 17 01:45:17 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-a8e90e19-cb83-4b96-95f0-7f8c200599a6 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Acquiring lock "refresh_cache-d281f155-01b4-4141-8184-8c5111a7c663" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:45:17 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-a8e90e19-cb83-4b96-95f0-7f8c200599a6 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Acquired lock "refresh_cache-d281f155-01b4-4141-8184-8c5111a7c663" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:45:17 user nova-compute[75226]: DEBUG nova.network.neutron [None req-a8e90e19-cb83-4b96-95f0-7f8c200599a6 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: d281f155-01b4-4141-8184-8c5111a7c663] Building network info cache for instance {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 01:45:17 user nova-compute[75226]: DEBUG nova.compute.manager [req-2b3f1066-b7e8-41d1-b12b-9b1f2af9b20a req-27930bd3-0dd0-474a-9ae3-351b3ecaf499 service nova] [instance: d281f155-01b4-4141-8184-8c5111a7c663] Received event network-changed-b18b7636-d18b-4cce-8bea-b9a293b75952 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:45:17 user nova-compute[75226]: DEBUG nova.compute.manager [req-2b3f1066-b7e8-41d1-b12b-9b1f2af9b20a req-27930bd3-0dd0-474a-9ae3-351b3ecaf499 service nova] [instance: d281f155-01b4-4141-8184-8c5111a7c663] Refreshing instance network info cache due to event network-changed-b18b7636-d18b-4cce-8bea-b9a293b75952. {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 01:45:17 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-2b3f1066-b7e8-41d1-b12b-9b1f2af9b20a req-27930bd3-0dd0-474a-9ae3-351b3ecaf499 service nova] Acquiring lock "refresh_cache-d281f155-01b4-4141-8184-8c5111a7c663" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:45:17 user nova-compute[75226]: DEBUG nova.network.neutron [None req-a8e90e19-cb83-4b96-95f0-7f8c200599a6 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: d281f155-01b4-4141-8184-8c5111a7c663] Instance cache missing network info. {{(pid=75226) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 17 01:45:17 user nova-compute[75226]: DEBUG nova.network.neutron [None req-a8e90e19-cb83-4b96-95f0-7f8c200599a6 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: d281f155-01b4-4141-8184-8c5111a7c663] Updating instance_info_cache with network_info: [{"id": "b18b7636-d18b-4cce-8bea-b9a293b75952", "address": "fa:16:3e:51:76:4f", "network": {"id": "81bbbdad-218b-4fcd-b7f5-427fd49361cb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1151874504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "673620a69fba4a04af75baabe775dc8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb18b7636-d1", "ovs_interfaceid": "b18b7636-d18b-4cce-8bea-b9a293b75952", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:45:17 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-a8e90e19-cb83-4b96-95f0-7f8c200599a6 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Releasing lock "refresh_cache-d281f155-01b4-4141-8184-8c5111a7c663" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:45:17 user nova-compute[75226]: DEBUG nova.compute.manager [None req-a8e90e19-cb83-4b96-95f0-7f8c200599a6 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: d281f155-01b4-4141-8184-8c5111a7c663] Instance network_info: |[{"id": "b18b7636-d18b-4cce-8bea-b9a293b75952", "address": "fa:16:3e:51:76:4f", "network": {"id": "81bbbdad-218b-4fcd-b7f5-427fd49361cb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1151874504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "673620a69fba4a04af75baabe775dc8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb18b7636-d1", "ovs_interfaceid": "b18b7636-d18b-4cce-8bea-b9a293b75952", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75226) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 17 01:45:17 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-2b3f1066-b7e8-41d1-b12b-9b1f2af9b20a req-27930bd3-0dd0-474a-9ae3-351b3ecaf499 service nova] Acquired lock "refresh_cache-d281f155-01b4-4141-8184-8c5111a7c663" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:45:17 user nova-compute[75226]: DEBUG nova.network.neutron [req-2b3f1066-b7e8-41d1-b12b-9b1f2af9b20a req-27930bd3-0dd0-474a-9ae3-351b3ecaf499 service nova] [instance: d281f155-01b4-4141-8184-8c5111a7c663] Refreshing network info cache for port b18b7636-d18b-4cce-8bea-b9a293b75952 {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 01:45:18 user nova-compute[75226]: DEBUG nova.network.neutron [req-2b3f1066-b7e8-41d1-b12b-9b1f2af9b20a req-27930bd3-0dd0-474a-9ae3-351b3ecaf499 service nova] [instance: d281f155-01b4-4141-8184-8c5111a7c663] Updated VIF entry in instance network info cache for port b18b7636-d18b-4cce-8bea-b9a293b75952. {{(pid=75226) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 01:45:18 user nova-compute[75226]: DEBUG nova.network.neutron [req-2b3f1066-b7e8-41d1-b12b-9b1f2af9b20a req-27930bd3-0dd0-474a-9ae3-351b3ecaf499 service nova] [instance: d281f155-01b4-4141-8184-8c5111a7c663] Updating instance_info_cache with network_info: [{"id": "b18b7636-d18b-4cce-8bea-b9a293b75952", "address": "fa:16:3e:51:76:4f", "network": {"id": "81bbbdad-218b-4fcd-b7f5-427fd49361cb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1151874504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "673620a69fba4a04af75baabe775dc8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb18b7636-d1", "ovs_interfaceid": "b18b7636-d18b-4cce-8bea-b9a293b75952", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:45:18 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-2b3f1066-b7e8-41d1-b12b-9b1f2af9b20a req-27930bd3-0dd0-474a-9ae3-351b3ecaf499 service nova] Releasing lock "refresh_cache-d281f155-01b4-4141-8184-8c5111a7c663" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:45:18 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:45:18 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:45:19 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:45:19 user nova-compute[75226]: DEBUG nova.compute.manager [req-9a4a3c4f-c48d-479c-81c3-e5011814350a req-43acb563-c98d-4549-9949-21448427e050 service nova] [instance: 8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02] Received event network-changed-ab437de1-a5c2-48c9-b693-902fc4b05929 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:45:19 user nova-compute[75226]: DEBUG nova.compute.manager [req-9a4a3c4f-c48d-479c-81c3-e5011814350a req-43acb563-c98d-4549-9949-21448427e050 service nova] [instance: 8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02] Refreshing instance network info cache due to event network-changed-ab437de1-a5c2-48c9-b693-902fc4b05929. {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 01:45:19 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-9a4a3c4f-c48d-479c-81c3-e5011814350a req-43acb563-c98d-4549-9949-21448427e050 service nova] Acquiring lock "refresh_cache-8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:45:19 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-9a4a3c4f-c48d-479c-81c3-e5011814350a req-43acb563-c98d-4549-9949-21448427e050 service nova] Acquired lock "refresh_cache-8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:45:19 user nova-compute[75226]: DEBUG nova.network.neutron [req-9a4a3c4f-c48d-479c-81c3-e5011814350a req-43acb563-c98d-4549-9949-21448427e050 service nova] [instance: 8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02] Refreshing network info cache for port ab437de1-a5c2-48c9-b693-902fc4b05929 {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 01:45:19 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:45:20 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-f6eb20e1-9c96-4fa0-8d57-88751aca1577 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Acquiring lock "8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:45:20 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-f6eb20e1-9c96-4fa0-8d57-88751aca1577 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Lock "8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:45:20 user nova-compute[75226]: INFO nova.compute.manager [None req-f6eb20e1-9c96-4fa0-8d57-88751aca1577 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] [instance: 8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02] Rebooting instance
Nov 17 01:45:20 user nova-compute[75226]: DEBUG nova.network.neutron [req-9a4a3c4f-c48d-479c-81c3-e5011814350a req-43acb563-c98d-4549-9949-21448427e050 service nova] [instance: 8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02] Updated VIF entry in instance network info cache for port ab437de1-a5c2-48c9-b693-902fc4b05929. {{(pid=75226) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 01:45:20 user nova-compute[75226]: DEBUG nova.network.neutron [req-9a4a3c4f-c48d-479c-81c3-e5011814350a req-43acb563-c98d-4549-9949-21448427e050 service nova] [instance: 8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02] Updating instance_info_cache with network_info: [{"id": "ab437de1-a5c2-48c9-b693-902fc4b05929", "address": "fa:16:3e:2c:67:4c", "network": {"id": "44f50686-24e7-4e75-8269-4391a53286d0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1611114801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33699aa6c9db4815a1e79aff4685801e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab437de1-a5", "ovs_interfaceid": "ab437de1-a5c2-48c9-b693-902fc4b05929", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:45:20 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-9a4a3c4f-c48d-479c-81c3-e5011814350a req-43acb563-c98d-4549-9949-21448427e050 service nova] Releasing lock "refresh_cache-8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:45:20 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-f6eb20e1-9c96-4fa0-8d57-88751aca1577 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Acquiring lock "refresh_cache-8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:45:20 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-f6eb20e1-9c96-4fa0-8d57-88751aca1577 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Acquired lock "refresh_cache-8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:45:20 user nova-compute[75226]: DEBUG nova.network.neutron [None req-f6eb20e1-9c96-4fa0-8d57-88751aca1577 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] [instance: 8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02] Building network info cache for instance {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 01:45:20 user nova-compute[75226]: DEBUG nova.network.neutron [None req-f6eb20e1-9c96-4fa0-8d57-88751aca1577 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] [instance: 8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02] Updating instance_info_cache with network_info: [{"id": "ab437de1-a5c2-48c9-b693-902fc4b05929", "address": "fa:16:3e:2c:67:4c", "network": {"id": "44f50686-24e7-4e75-8269-4391a53286d0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1611114801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33699aa6c9db4815a1e79aff4685801e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab437de1-a5", "ovs_interfaceid": "ab437de1-a5c2-48c9-b693-902fc4b05929", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:45:20 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-f6eb20e1-9c96-4fa0-8d57-88751aca1577 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Releasing lock "refresh_cache-8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:45:20 user nova-compute[75226]: DEBUG nova.compute.manager [None req-f6eb20e1-9c96-4fa0-8d57-88751aca1577 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] [instance: 8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02] Checking state {{(pid=75226) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 01:45:20 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:45:21 user nova-compute[75226]: DEBUG nova.compute.manager [None req-a8e90e19-cb83-4b96-95f0-7f8c200599a6 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: d281f155-01b4-4141-8184-8c5111a7c663] Start spawning the instance on the hypervisor. {{(pid=75226) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 17 01:45:21 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-a8e90e19-cb83-4b96-95f0-7f8c200599a6 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: d281f155-01b4-4141-8184-8c5111a7c663] Creating instance directory {{(pid=75226) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 17 01:45:21 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-a8e90e19-cb83-4b96-95f0-7f8c200599a6 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: d281f155-01b4-4141-8184-8c5111a7c663] Creating image(s)
Nov 17 01:45:21 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-a8e90e19-cb83-4b96-95f0-7f8c200599a6 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: d281f155-01b4-4141-8184-8c5111a7c663] Did not create local disks {{(pid=75226) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 17 01:45:21 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-a8e90e19-cb83-4b96-95f0-7f8c200599a6 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: d281f155-01b4-4141-8184-8c5111a7c663] Ensure instance console log exists: /opt/stack/data/nova/instances/d281f155-01b4-4141-8184-8c5111a7c663/console.log {{(pid=75226) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 17 01:45:21 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-a8e90e19-cb83-4b96-95f0-7f8c200599a6 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:45:21 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-a8e90e19-cb83-4b96-95f0-7f8c200599a6 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:45:21 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-a8e90e19-cb83-4b96-95f0-7f8c200599a6 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:45:21 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-a8e90e19-cb83-4b96-95f0-7f8c200599a6 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: d281f155-01b4-4141-8184-8c5111a7c663] Start _get_guest_xml network_info=[{"id": "b18b7636-d18b-4cce-8bea-b9a293b75952", "address": "fa:16:3e:51:76:4f", "network": {"id": "81bbbdad-218b-4fcd-b7f5-427fd49361cb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1151874504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "673620a69fba4a04af75baabe775dc8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb18b7636-d1", "ovs_interfaceid": "b18b7636-d18b-4cce-8bea-b9a293b75952", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ea51d240-abac-484a-8d78-49c9f9990337', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WzilAJDH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd281f155-01b4-4141-8184-8c5111a7c663', 'attached_at': '', 'detached_at': '', 'volume_id': 'ea51d240-abac-484a-8d78-49c9f9990337', 'serial': 'ea51d240-abac-484a-8d78-49c9f9990337'}, 'attachment_id': 'c0393f64-f135-4e7a-a56a-8ee0327d3bf3', 'device_type': 'disk', 'volume_type': None} {{(pid=75226) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 17 01:45:21 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-a8e90e19-cb83-4b96-95f0-7f8c200599a6 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:45:21 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-a8e90e19-cb83-4b96-95f0-7f8c200599a6 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:45:21 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-a8e90e19-cb83-4b96-95f0-7f8c200599a6 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75226) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 17 01:45:21 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-a8e90e19-cb83-4b96-95f0-7f8c200599a6 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] CPU controller missing on host. {{(pid=75226) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 17 01:45:21 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-a8e90e19-cb83-4b96-95f0-7f8c200599a6 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75226) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 17 01:45:21 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-a8e90e19-cb83-4b96-95f0-7f8c200599a6 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] CPU controller found on host. {{(pid=75226) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 17 01:45:21 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-a8e90e19-cb83-4b96-95f0-7f8c200599a6 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75226) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 17 01:45:21 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-a8e90e19-cb83-4b96-95f0-7f8c200599a6 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-17T01:13:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 17 01:45:21 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-a8e90e19-cb83-4b96-95f0-7f8c200599a6 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Flavor limits 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 17 01:45:21 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-a8e90e19-cb83-4b96-95f0-7f8c200599a6 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Image limits 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 17 01:45:21 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-a8e90e19-cb83-4b96-95f0-7f8c200599a6 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Flavor pref 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 17 01:45:21 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-a8e90e19-cb83-4b96-95f0-7f8c200599a6 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Image pref 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 17 01:45:21 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-a8e90e19-cb83-4b96-95f0-7f8c200599a6 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 17 01:45:21 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-a8e90e19-cb83-4b96-95f0-7f8c200599a6 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 17 01:45:21 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-a8e90e19-cb83-4b96-95f0-7f8c200599a6 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75226) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 17 01:45:21 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-a8e90e19-cb83-4b96-95f0-7f8c200599a6 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Got 1 possible topologies {{(pid=75226) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 17 01:45:21 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-a8e90e19-cb83-4b96-95f0-7f8c200599a6 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 17 01:45:21 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-a8e90e19-cb83-4b96-95f0-7f8c200599a6 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 17 01:45:21 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a8e90e19-cb83-4b96-95f0-7f8c200599a6 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: d281f155-01b4-4141-8184-8c5111a7c663] Calling os-brick to attach iSCSI Volume {{(pid=75226) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 17 01:45:21 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8e90e19-cb83-4b96-95f0-7f8c200599a6 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc4cc36b490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ea51d240-abac-484a-8d78-49c9f9990337', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WzilAJDH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:45:21 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-a8e90e19-cb83-4b96-95f0-7f8c200599a6 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:45:21 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-a8e90e19-cb83-4b96-95f0-7f8c200599a6 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:45:21 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-a8e90e19-cb83-4b96-95f0-7f8c200599a6 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:45:21 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-a8e90e19-cb83-4b96-95f0-7f8c200599a6 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:45:21 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-a8e90e19-cb83-4b96-95f0-7f8c200599a6 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ea51d240-abac-484a-8d78-49c9f9990337" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:45:21 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-a8e90e19-cb83-4b96-95f0-7f8c200599a6 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ea51d240-abac-484a-8d78-49c9f9990337" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:45:21 user nova-compute[75226]: INFO os_brick.initiator.connectors.iscsi [None req-a8e90e19-cb83-4b96-95f0-7f8c200599a6 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 17 01:45:21 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea51d240-abac-484a-8d78-49c9f9990337 -p 172.16.0.220:3260 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:45:21 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea51d240-abac-484a-8d78-49c9f9990337 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:45:21 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3063666-3eb9-4d20-8b41-0c53daeac4f4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:45:21 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8e90e19-cb83-4b96-95f0-7f8c200599a6 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 17 01:45:21 user nova-compute[75226]:  {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:45:21 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea51d240-abac-484a-8d78-49c9f9990337 -p 172.16.0.220:3260 --interface default --op new {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:45:21 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea51d240-abac-484a-8d78-49c9f9990337 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:45:21 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[be4f8c96-bea3-4ada-8fc6-636d2e2d8a22]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ea51d240-abac-484a-8d78-49c9f9990337] added\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:45:21 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8e90e19-cb83-4b96-95f0-7f8c200599a6 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ea51d240-abac-484a-8d78-49c9f9990337] added
Nov 17 01:45:21 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:45:21 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea51d240-abac-484a-8d78-49c9f9990337 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:45:21 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea51d240-abac-484a-8d78-49c9f9990337 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:45:21 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[42a296af-0b44-4d9b-88a8-120d92909b45]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:45:21 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8e90e19-cb83-4b96-95f0-7f8c200599a6 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:45:21 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea51d240-abac-484a-8d78-49c9f9990337 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:45:21 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea51d240-abac-484a-8d78-49c9f9990337 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:45:21 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[f99a5ba9-336b-443d-9046-5e2848e5251c]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:45:21 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8e90e19-cb83-4b96-95f0-7f8c200599a6 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:45:21 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea51d240-abac-484a-8d78-49c9f9990337 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WzilAJDH {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:45:21 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea51d240-abac-484a-8d78-49c9f9990337 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WzilAJDH" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:45:21 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[beb9faad-8f92-40a1-87ee-ced55208fb73]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:45:21 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8e90e19-cb83-4b96-95f0-7f8c200599a6 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WzilAJDH'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:45:21 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea51d240-abac-484a-8d78-49c9f9990337 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:45:21 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea51d240-abac-484a-8d78-49c9f9990337 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:45:21 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1a3c314-d50d-4395-b4af-5b544f46afd9]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:45:21 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8e90e19-cb83-4b96-95f0-7f8c200599a6 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:45:21 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:45:21 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:45:21 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[44007cda-2175-4d31-bf5e-3e7d357ceb92]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e4c54a4-b25d-4164-8c77-6885e25ab238 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:45:21 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8e90e19-cb83-4b96-95f0-7f8c200599a6 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e4c54a4-b25d-4164-8c77-6885e25ab238 (non-flash)
Nov 17 01:45:21 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:45:21 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8e90e19-cb83-4b96-95f0-7f8c200599a6 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e4c54a4-b25d-4164-8c77-6885e25ab238 (non-flash)
Nov 17 01:45:21 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:45:21 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea51d240-abac-484a-8d78-49c9f9990337 -p 172.16.0.220:3260 --login {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:45:21 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea51d240-abac-484a-8d78-49c9f9990337 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:45:21 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae1b7e06-4a49-445f-ab97-c86f38ca8df0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ea51d240-abac-484a-8d78-49c9f9990337, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ea51d240-abac-484a-8d78-49c9f9990337, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:45:21 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8e90e19-cb83-4b96-95f0-7f8c200599a6 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ea51d240-abac-484a-8d78-49c9f9990337, portal: 172.16.0.220,3260]
Nov 17 01:45:21 user nova-compute[75226]: Login to [iface: default, target: iqn.2010-10.org.openstack:ea51d240-abac-484a-8d78-49c9f9990337, portal: 172.16.0.220,3260] successful.
Nov 17 01:45:21 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:45:21 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea51d240-abac-484a-8d78-49c9f9990337 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:45:21 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea51d240-abac-484a-8d78-49c9f9990337 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:45:21 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[9126d941-0c05-41a8-bc86-c4c55983a226]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:45:21 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8e90e19-cb83-4b96-95f0-7f8c200599a6 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:45:21 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:45:21 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:45:21 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[85e297ec-0eb4-4a24-8478-c0aa9f626bf3]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e4c54a4-b25d-4164-8c77-6885e25ab238 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea51d240-abac-484a-8d78-49c9f9990337 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:45:21 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8e90e19-cb83-4b96-95f0-7f8c200599a6 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e4c54a4-b25d-4164-8c77-6885e25ab238 (non-flash)
Nov 17 01:45:21 user nova-compute[75226]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea51d240-abac-484a-8d78-49c9f9990337 (non-flash)
Nov 17 01:45:21 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:45:21 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8e90e19-cb83-4b96-95f0-7f8c200599a6 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e4c54a4-b25d-4164-8c77-6885e25ab238 (non-flash)
Nov 17 01:45:21 user nova-compute[75226]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea51d240-abac-484a-8d78-49c9f9990337 (non-flash)
Nov 17 01:45:21 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:45:21 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-a8e90e19-cb83-4b96-95f0-7f8c200599a6 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ea51d240-abac-484a-8d78-49c9f9990337" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.283s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:45:21 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8e90e19-cb83-4b96-95f0-7f8c200599a6 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Connected to 172.16.0.220:3260 {{(pid=75226) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 17 01:45:21 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-a8e90e19-cb83-4b96-95f0-7f8c200599a6 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] HCTL ('34', '-', '-', 0) found on session 53 with lun 0 {{(pid=75226) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 17 01:45:21 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-a8e90e19-cb83-4b96-95f0-7f8c200599a6 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75226) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 17 01:45:21 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:45:21 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:45:21 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[a68a816c-b580-4f59-9e6b-7cb014d433bb]: (4, ('- - 0', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:45:21 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-a8e90e19-cb83-4b96-95f0-7f8c200599a6 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Searching for a device in session 53 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75226) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 01:45:21 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8e90e19-cb83-4b96-95f0-7f8c200599a6 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:ea51d240-abac-484a-8d78-49c9f9990337', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WzilAJDH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75226) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 17 01:45:21 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:45:21 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:45:22 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-a8e90e19-cb83-4b96-95f0-7f8c200599a6 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.318s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:45:22 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8e90e19-cb83-4b96-95f0-7f8c200599a6 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] <== connect_volume: return (1320ms) {'type': 'block', 'scsi_wwn': '23265613831333436', 'path': '/dev/sdc'} {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:45:22 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a8e90e19-cb83-4b96-95f0-7f8c200599a6 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: d281f155-01b4-4141-8184-8c5111a7c663] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23265613831333436', 'path': '/dev/sdc'} {{(pid=75226) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 17 01:45:22 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-a8e90e19-cb83-4b96-95f0-7f8c200599a6 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:45:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-281766136',display_name='tempest-TestVolumeBootPattern-volume-backed-server-281766136',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-281766136',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCZ4QoRbRqRgi3ki4KS6jh5lRby+ElQLxgditWATt0MQK+oWM9Cf7VN32NSllMdJ7ek98OXOQWEnwtK1MmjgBtLf/JIHzLlckTHPs8AUGH9I1h07dF8vVmqqPYyiTcNc4w==',key_name='tempest-keypair-414477458',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='673620a69fba4a04af75baabe775dc8b',ramdisk_id='',reservation_id='r-zu2ben1p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-971654489',owner_user_name='tempest-TestVolumeBootPattern-971654489-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T01:45:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c8c8baa56884dcd9a90f0187c9fc06f',uuid=d281f155-01b4-4141-8184-8c5111a7c663,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b18b7636-d18b-4cce-8bea-b9a293b75952", "address": "fa:16:3e:51:76:4f", "network": {"id": "81bbbdad-218b-4fcd-b7f5-427fd49361cb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1151874504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "673620a69fba4a04af75baabe775dc8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb18b7636-d1", "ovs_interfaceid": "b18b7636-d18b-4cce-8bea-b9a293b75952", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75226) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 01:45:22 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-a8e90e19-cb83-4b96-95f0-7f8c200599a6 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Converting VIF {"id": "b18b7636-d18b-4cce-8bea-b9a293b75952", "address": "fa:16:3e:51:76:4f", "network": {"id": "81bbbdad-218b-4fcd-b7f5-427fd49361cb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1151874504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "673620a69fba4a04af75baabe775dc8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb18b7636-d1", "ovs_interfaceid": "b18b7636-d18b-4cce-8bea-b9a293b75952", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:45:22 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-a8e90e19-cb83-4b96-95f0-7f8c200599a6 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:76:4f,bridge_name='br-int',has_traffic_filtering=True,id=b18b7636-d18b-4cce-8bea-b9a293b75952,network=Network(81bbbdad-218b-4fcd-b7f5-427fd49361cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb18b7636-d1') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:45:22 user nova-compute[75226]: DEBUG nova.objects.instance [None req-a8e90e19-cb83-4b96-95f0-7f8c200599a6 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Lazy-loading 'pci_devices' on Instance uuid d281f155-01b4-4141-8184-8c5111a7c663 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:45:22 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-a8e90e19-cb83-4b96-95f0-7f8c200599a6 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: d281f155-01b4-4141-8184-8c5111a7c663] End _get_guest_xml xml=<domain type="kvm">
Nov 17 01:45:22 user nova-compute[75226]:   <uuid>d281f155-01b4-4141-8184-8c5111a7c663</uuid>
Nov 17 01:45:22 user nova-compute[75226]:   <name>instance-0000002d</name>
Nov 17 01:45:22 user nova-compute[75226]:   <memory>524288</memory>
Nov 17 01:45:22 user nova-compute[75226]:   <vcpu>1</vcpu>
Nov 17 01:45:22 user nova-compute[75226]:   <metadata>
Nov 17 01:45:22 user nova-compute[75226]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 17 01:45:22 user nova-compute[75226]:       <nova:package version="0.0.0"/>
Nov 17 01:45:22 user nova-compute[75226]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-281766136</nova:name>
Nov 17 01:45:22 user nova-compute[75226]:       <nova:creationTime>2023-11-17 01:45:21</nova:creationTime>
Nov 17 01:45:22 user nova-compute[75226]:       <nova:flavor name="m1.tiny">
Nov 17 01:45:22 user nova-compute[75226]:         <nova:memory>512</nova:memory>
Nov 17 01:45:22 user nova-compute[75226]:         <nova:disk>1</nova:disk>
Nov 17 01:45:22 user nova-compute[75226]:         <nova:swap>0</nova:swap>
Nov 17 01:45:22 user nova-compute[75226]:         <nova:ephemeral>0</nova:ephemeral>
Nov 17 01:45:22 user nova-compute[75226]:         <nova:vcpus>1</nova:vcpus>
Nov 17 01:45:22 user nova-compute[75226]:       </nova:flavor>
Nov 17 01:45:22 user nova-compute[75226]:       <nova:owner>
Nov 17 01:45:22 user nova-compute[75226]:         <nova:user uuid="7c8c8baa56884dcd9a90f0187c9fc06f">tempest-TestVolumeBootPattern-971654489-project-member</nova:user>
Nov 17 01:45:22 user nova-compute[75226]:         <nova:project uuid="673620a69fba4a04af75baabe775dc8b">tempest-TestVolumeBootPattern-971654489</nova:project>
Nov 17 01:45:22 user nova-compute[75226]:       </nova:owner>
Nov 17 01:45:22 user nova-compute[75226]:       <nova:ports>
Nov 17 01:45:22 user nova-compute[75226]:         <nova:port uuid="b18b7636-d18b-4cce-8bea-b9a293b75952">
Nov 17 01:45:22 user nova-compute[75226]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 17 01:45:22 user nova-compute[75226]:         </nova:port>
Nov 17 01:45:22 user nova-compute[75226]:       </nova:ports>
Nov 17 01:45:22 user nova-compute[75226]:     </nova:instance>
Nov 17 01:45:22 user nova-compute[75226]:   </metadata>
Nov 17 01:45:22 user nova-compute[75226]:   <sysinfo type="smbios">
Nov 17 01:45:22 user nova-compute[75226]:     <system>
Nov 17 01:45:22 user nova-compute[75226]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 17 01:45:22 user nova-compute[75226]:       <entry name="product">OpenStack Nova</entry>
Nov 17 01:45:22 user nova-compute[75226]:       <entry name="version">0.0.0</entry>
Nov 17 01:45:22 user nova-compute[75226]:       <entry name="serial">d281f155-01b4-4141-8184-8c5111a7c663</entry>
Nov 17 01:45:22 user nova-compute[75226]:       <entry name="uuid">d281f155-01b4-4141-8184-8c5111a7c663</entry>
Nov 17 01:45:22 user nova-compute[75226]:       <entry name="family">Virtual Machine</entry>
Nov 17 01:45:22 user nova-compute[75226]:     </system>
Nov 17 01:45:22 user nova-compute[75226]:   </sysinfo>
Nov 17 01:45:22 user nova-compute[75226]:   <os>
Nov 17 01:45:22 user nova-compute[75226]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 17 01:45:22 user nova-compute[75226]:     <boot dev="hd"/>
Nov 17 01:45:22 user nova-compute[75226]:     <smbios mode="sysinfo"/>
Nov 17 01:45:22 user nova-compute[75226]:   </os>
Nov 17 01:45:22 user nova-compute[75226]:   <features>
Nov 17 01:45:22 user nova-compute[75226]:     <acpi/>
Nov 17 01:45:22 user nova-compute[75226]:     <apic/>
Nov 17 01:45:22 user nova-compute[75226]:     <vmcoreinfo/>
Nov 17 01:45:22 user nova-compute[75226]:   </features>
Nov 17 01:45:22 user nova-compute[75226]:   <clock offset="utc">
Nov 17 01:45:22 user nova-compute[75226]:     <timer name="pit" tickpolicy="delay"/>
Nov 17 01:45:22 user nova-compute[75226]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 17 01:45:22 user nova-compute[75226]:     <timer name="hpet" present="no"/>
Nov 17 01:45:22 user nova-compute[75226]:   </clock>
Nov 17 01:45:22 user nova-compute[75226]:   <cpu mode="custom" match="exact">
Nov 17 01:45:22 user nova-compute[75226]:     <model>Nehalem</model>
Nov 17 01:45:22 user nova-compute[75226]:     <topology sockets="1" cores="1" threads="1"/>
Nov 17 01:45:22 user nova-compute[75226]:   </cpu>
Nov 17 01:45:22 user nova-compute[75226]:   <devices>
Nov 17 01:45:22 user nova-compute[75226]:     <disk type="block" device="disk">
Nov 17 01:45:22 user nova-compute[75226]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 01:45:22 user nova-compute[75226]:       <source dev="/dev/sdc"/>
Nov 17 01:45:22 user nova-compute[75226]:       <target dev="vda" bus="virtio"/>
Nov 17 01:45:22 user nova-compute[75226]:       <serial>ea51d240-abac-484a-8d78-49c9f9990337</serial>
Nov 17 01:45:22 user nova-compute[75226]:     </disk>
Nov 17 01:45:22 user nova-compute[75226]:     <interface type="ethernet">
Nov 17 01:45:22 user nova-compute[75226]:       <mac address="fa:16:3e:51:76:4f"/>
Nov 17 01:45:22 user nova-compute[75226]:       <model type="virtio"/>
Nov 17 01:45:22 user nova-compute[75226]:       <mtu size="1442"/>
Nov 17 01:45:22 user nova-compute[75226]:       <target dev="tapb18b7636-d1"/>
Nov 17 01:45:22 user nova-compute[75226]:     </interface>
Nov 17 01:45:22 user nova-compute[75226]:     <serial type="pty">
Nov 17 01:45:22 user nova-compute[75226]:       <log file="/opt/stack/data/nova/instances/d281f155-01b4-4141-8184-8c5111a7c663/console.log" append="off"/>
Nov 17 01:45:22 user nova-compute[75226]:     </serial>
Nov 17 01:45:22 user nova-compute[75226]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 17 01:45:22 user nova-compute[75226]:     <video>
Nov 17 01:45:22 user nova-compute[75226]:       <model type="virtio"/>
Nov 17 01:45:22 user nova-compute[75226]:     </video>
Nov 17 01:45:22 user nova-compute[75226]:     <rng model="virtio">
Nov 17 01:45:22 user nova-compute[75226]:       <backend model="random">/dev/urandom</backend>
Nov 17 01:45:22 user nova-compute[75226]:     </rng>
Nov 17 01:45:22 user nova-compute[75226]:     <controller type="usb" index="0" model="none"/>
Nov 17 01:45:22 user nova-compute[75226]:     <memballoon model="virtio">
Nov 17 01:45:22 user nova-compute[75226]:       <stats period="10"/>
Nov 17 01:45:22 user nova-compute[75226]:     </memballoon>
Nov 17 01:45:22 user nova-compute[75226]:   </devices>
Nov 17 01:45:22 user nova-compute[75226]: </domain>
Nov 17 01:45:22 user nova-compute[75226]:  {{(pid=75226) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 17 01:45:22 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-a8e90e19-cb83-4b96-95f0-7f8c200599a6 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:45:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-281766136',display_name='tempest-TestVolumeBootPattern-volume-backed-server-281766136',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-281766136',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCZ4QoRbRqRgi3ki4KS6jh5lRby+ElQLxgditWATt0MQK+oWM9Cf7VN32NSllMdJ7ek98OXOQWEnwtK1MmjgBtLf/JIHzLlckTHPs8AUGH9I1h07dF8vVmqqPYyiTcNc4w==',key_name='tempest-keypair-414477458',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='673620a69fba4a04af75baabe775dc8b',ramdisk_id='',reservation_id='r-zu2ben1p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-971654489',owner_user_name='tempest-TestVolumeBootPattern-971654489-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T01:45:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c8c8baa56884dcd9a90f0187c9fc06f',uuid=d281f155-01b4-4141-8184-8c5111a7c663,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b18b7636-d18b-4cce-8bea-b9a293b75952", "address": "fa:16:3e:51:76:4f", "network": {"id": "81bbbdad-218b-4fcd-b7f5-427fd49361cb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1151874504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "673620a69fba4a04af75baabe775dc8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb18b7636-d1", "ovs_interfaceid": "b18b7636-d18b-4cce-8bea-b9a293b75952", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 17 01:45:22 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-a8e90e19-cb83-4b96-95f0-7f8c200599a6 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Converting VIF {"id": "b18b7636-d18b-4cce-8bea-b9a293b75952", "address": "fa:16:3e:51:76:4f", "network": {"id": "81bbbdad-218b-4fcd-b7f5-427fd49361cb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1151874504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "673620a69fba4a04af75baabe775dc8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb18b7636-d1", "ovs_interfaceid": "b18b7636-d18b-4cce-8bea-b9a293b75952", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:45:22 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-a8e90e19-cb83-4b96-95f0-7f8c200599a6 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:76:4f,bridge_name='br-int',has_traffic_filtering=True,id=b18b7636-d18b-4cce-8bea-b9a293b75952,network=Network(81bbbdad-218b-4fcd-b7f5-427fd49361cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb18b7636-d1') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:45:22 user nova-compute[75226]: DEBUG os_vif [None req-a8e90e19-cb83-4b96-95f0-7f8c200599a6 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:76:4f,bridge_name='br-int',has_traffic_filtering=True,id=b18b7636-d18b-4cce-8bea-b9a293b75952,network=Network(81bbbdad-218b-4fcd-b7f5-427fd49361cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb18b7636-d1') {{(pid=75226) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 17 01:45:22 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:45:22 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:45:22 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 17 01:45:22 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:45:22 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b7f05142-d01b-5dfc-8cdd-91e1476b9491', '_type': 'linux-noop'}}, row=False) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:45:22 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:45:22 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:45:22 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:45:22 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb18b7636-d1, may_exist=True, interface_attrs={}) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:45:22 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb18b7636-d1, col_values=(('qos', UUID('de385537-f2b2-4180-aa0c-a1d7d8feeb1f')),), if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:45:22 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb18b7636-d1, col_values=(('external_ids', {'iface-id': 'b18b7636-d18b-4cce-8bea-b9a293b75952', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:51:76:4f', 'vm-uuid': 'd281f155-01b4-4141-8184-8c5111a7c663'}),), if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:45:22 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:45:22 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:45:22 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:45:22 user nova-compute[75226]: INFO os_vif [None req-a8e90e19-cb83-4b96-95f0-7f8c200599a6 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:76:4f,bridge_name='br-int',has_traffic_filtering=True,id=b18b7636-d18b-4cce-8bea-b9a293b75952,network=Network(81bbbdad-218b-4fcd-b7f5-427fd49361cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb18b7636-d1')
Nov 17 01:45:22 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-a8e90e19-cb83-4b96-95f0-7f8c200599a6 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] No BDM found with device name vda, not building metadata. {{(pid=75226) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 01:45:22 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-a8e90e19-cb83-4b96-95f0-7f8c200599a6 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] No VIF found with MAC fa:16:3e:51:76:4f, not building metadata {{(pid=75226) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 01:45:22 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:45:23 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:45:23 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:45:23 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:45:23 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:45:23 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:45:23 user nova-compute[75226]: DEBUG nova.compute.manager [req-f242ff0c-9d17-4a38-ba74-274ba893a8bd req-5a4d327f-e759-4e25-8fd1-9e3fba699033 service nova] [instance: 8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02] Received event network-vif-unplugged-ab437de1-a5c2-48c9-b693-902fc4b05929 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:45:23 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-f242ff0c-9d17-4a38-ba74-274ba893a8bd req-5a4d327f-e759-4e25-8fd1-9e3fba699033 service nova] Acquiring lock "8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:45:23 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-f242ff0c-9d17-4a38-ba74-274ba893a8bd req-5a4d327f-e759-4e25-8fd1-9e3fba699033 service nova] Lock "8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:45:23 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-f242ff0c-9d17-4a38-ba74-274ba893a8bd req-5a4d327f-e759-4e25-8fd1-9e3fba699033 service nova] Lock "8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:45:23 user nova-compute[75226]: DEBUG nova.compute.manager [req-f242ff0c-9d17-4a38-ba74-274ba893a8bd req-5a4d327f-e759-4e25-8fd1-9e3fba699033 service nova] [instance: 8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02] No waiting events found dispatching network-vif-unplugged-ab437de1-a5c2-48c9-b693-902fc4b05929 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:45:23 user nova-compute[75226]: WARNING nova.compute.manager [req-f242ff0c-9d17-4a38-ba74-274ba893a8bd req-5a4d327f-e759-4e25-8fd1-9e3fba699033 service nova] [instance: 8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02] Received unexpected event network-vif-unplugged-ab437de1-a5c2-48c9-b693-902fc4b05929 for instance with vm_state active and task_state reboot_started.
Nov 17 01:45:23 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:45:23 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:45:23 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:45:23 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:45:24 user nova-compute[75226]: DEBUG nova.compute.manager [req-e5242a5d-5c34-4ce9-a8d5-030232c1a839 req-add1dbcd-6510-477a-9f5f-632dcba5d369 service nova] [instance: d281f155-01b4-4141-8184-8c5111a7c663] Received event network-vif-plugged-b18b7636-d18b-4cce-8bea-b9a293b75952 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:45:24 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-e5242a5d-5c34-4ce9-a8d5-030232c1a839 req-add1dbcd-6510-477a-9f5f-632dcba5d369 service nova] Acquiring lock "d281f155-01b4-4141-8184-8c5111a7c663-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:45:24 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-e5242a5d-5c34-4ce9-a8d5-030232c1a839 req-add1dbcd-6510-477a-9f5f-632dcba5d369 service nova] Lock "d281f155-01b4-4141-8184-8c5111a7c663-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:45:24 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-e5242a5d-5c34-4ce9-a8d5-030232c1a839 req-add1dbcd-6510-477a-9f5f-632dcba5d369 service nova] Lock "d281f155-01b4-4141-8184-8c5111a7c663-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:45:24 user nova-compute[75226]: DEBUG nova.compute.manager [req-e5242a5d-5c34-4ce9-a8d5-030232c1a839 req-add1dbcd-6510-477a-9f5f-632dcba5d369 service nova] [instance: d281f155-01b4-4141-8184-8c5111a7c663] No waiting events found dispatching network-vif-plugged-b18b7636-d18b-4cce-8bea-b9a293b75952 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:45:24 user nova-compute[75226]: WARNING nova.compute.manager [req-e5242a5d-5c34-4ce9-a8d5-030232c1a839 req-add1dbcd-6510-477a-9f5f-632dcba5d369 service nova] [instance: d281f155-01b4-4141-8184-8c5111a7c663] Received unexpected event network-vif-plugged-b18b7636-d18b-4cce-8bea-b9a293b75952 for instance with vm_state building and task_state spawning.
Nov 17 01:45:24 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-f6eb20e1-9c96-4fa0-8d57-88751aca1577 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] [instance: 8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02] Instance shutdown successfully.
Nov 17 01:45:24 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:45:24 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:45:24 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:45:24 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:45:24 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:45:25 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:45:25 user nova-compute[75226]: DEBUG nova.compute.manager [req-4560a8c2-b584-46ef-817a-e485a30685bd req-21e588f9-5322-4e21-9741-3f7326d2f4ad service nova] [instance: 8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02] Received event network-vif-plugged-ab437de1-a5c2-48c9-b693-902fc4b05929 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:45:25 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-4560a8c2-b584-46ef-817a-e485a30685bd req-21e588f9-5322-4e21-9741-3f7326d2f4ad service nova] Acquiring lock "8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:45:25 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-4560a8c2-b584-46ef-817a-e485a30685bd req-21e588f9-5322-4e21-9741-3f7326d2f4ad service nova] Lock "8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:45:25 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-4560a8c2-b584-46ef-817a-e485a30685bd req-21e588f9-5322-4e21-9741-3f7326d2f4ad service nova] Lock "8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:45:25 user nova-compute[75226]: DEBUG nova.compute.manager [req-4560a8c2-b584-46ef-817a-e485a30685bd req-21e588f9-5322-4e21-9741-3f7326d2f4ad service nova] [instance: 8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02] No waiting events found dispatching network-vif-plugged-ab437de1-a5c2-48c9-b693-902fc4b05929 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:45:25 user nova-compute[75226]: WARNING nova.compute.manager [req-4560a8c2-b584-46ef-817a-e485a30685bd req-21e588f9-5322-4e21-9741-3f7326d2f4ad service nova] [instance: 8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02] Received unexpected event network-vif-plugged-ab437de1-a5c2-48c9-b693-902fc4b05929 for instance with vm_state active and task_state reboot_started.
Nov 17 01:45:25 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:45:25 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:45:25 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:45:25 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:45:25 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:45:25 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Starting heal instance info cache {{(pid=75226) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 17 01:45:25 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Rebuilding the list of instances to heal {{(pid=75226) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 17 01:45:26 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] [instance: d281f155-01b4-4141-8184-8c5111a7c663] Skipping network cache update for instance because it is Building. {{(pid=75226) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 17 01:45:26 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "refresh_cache-8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:45:26 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquired lock "refresh_cache-8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:45:26 user nova-compute[75226]: DEBUG nova.network.neutron [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] [instance: 8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02] Forcefully refreshing network info cache for instance {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 17 01:45:26 user nova-compute[75226]: DEBUG nova.objects.instance [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lazy-loading 'info_cache' on Instance uuid 8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:45:26 user nova-compute[75226]: DEBUG nova.compute.manager [req-5054bc0d-0513-4b37-8899-017b7621857a req-b9a0dce9-774b-44bb-891e-9c5ea3005a39 service nova] [instance: d281f155-01b4-4141-8184-8c5111a7c663] Received event network-vif-plugged-b18b7636-d18b-4cce-8bea-b9a293b75952 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:45:26 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-5054bc0d-0513-4b37-8899-017b7621857a req-b9a0dce9-774b-44bb-891e-9c5ea3005a39 service nova] Acquiring lock "d281f155-01b4-4141-8184-8c5111a7c663-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:45:26 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-5054bc0d-0513-4b37-8899-017b7621857a req-b9a0dce9-774b-44bb-891e-9c5ea3005a39 service nova] Lock "d281f155-01b4-4141-8184-8c5111a7c663-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:45:26 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-5054bc0d-0513-4b37-8899-017b7621857a req-b9a0dce9-774b-44bb-891e-9c5ea3005a39 service nova] Lock "d281f155-01b4-4141-8184-8c5111a7c663-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:45:26 user nova-compute[75226]: DEBUG nova.compute.manager [req-5054bc0d-0513-4b37-8899-017b7621857a req-b9a0dce9-774b-44bb-891e-9c5ea3005a39 service nova] [instance: d281f155-01b4-4141-8184-8c5111a7c663] No waiting events found dispatching network-vif-plugged-b18b7636-d18b-4cce-8bea-b9a293b75952 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:45:26 user nova-compute[75226]: WARNING nova.compute.manager [req-5054bc0d-0513-4b37-8899-017b7621857a req-b9a0dce9-774b-44bb-891e-9c5ea3005a39 service nova] [instance: d281f155-01b4-4141-8184-8c5111a7c663] Received unexpected event network-vif-plugged-b18b7636-d18b-4cce-8bea-b9a293b75952 for instance with vm_state building and task_state spawning.
Nov 17 01:45:26 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:45:26 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:45:26 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:45:26 user nova-compute[75226]: DEBUG nova.network.neutron [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] [instance: 8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02] Updating instance_info_cache with network_info: [{"id": "ab437de1-a5c2-48c9-b693-902fc4b05929", "address": "fa:16:3e:2c:67:4c", "network": {"id": "44f50686-24e7-4e75-8269-4391a53286d0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1611114801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33699aa6c9db4815a1e79aff4685801e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab437de1-a5", "ovs_interfaceid": "ab437de1-a5c2-48c9-b693-902fc4b05929", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:45:26 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Releasing lock "refresh_cache-8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:45:26 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] [instance: 8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02] Updated the network info_cache for instance {{(pid=75226) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 17 01:45:27 user nova-compute[75226]: DEBUG nova.compute.manager [None req-a8e90e19-cb83-4b96-95f0-7f8c200599a6 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: d281f155-01b4-4141-8184-8c5111a7c663] Instance event wait completed in 0 seconds for  {{(pid=75226) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 17 01:45:27 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-a8e90e19-cb83-4b96-95f0-7f8c200599a6 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: d281f155-01b4-4141-8184-8c5111a7c663] Guest created on hypervisor {{(pid=75226) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 17 01:45:27 user nova-compute[75226]: INFO nova.virt.libvirt.driver [-] [instance: d281f155-01b4-4141-8184-8c5111a7c663] Instance spawned successfully.
Nov 17 01:45:27 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-a8e90e19-cb83-4b96-95f0-7f8c200599a6 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: d281f155-01b4-4141-8184-8c5111a7c663] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 17 01:45:27 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-a8e90e19-cb83-4b96-95f0-7f8c200599a6 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: d281f155-01b4-4141-8184-8c5111a7c663] Found default for hw_cdrom_bus of ide {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:45:27 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-a8e90e19-cb83-4b96-95f0-7f8c200599a6 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: d281f155-01b4-4141-8184-8c5111a7c663] Found default for hw_disk_bus of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:45:27 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-a8e90e19-cb83-4b96-95f0-7f8c200599a6 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: d281f155-01b4-4141-8184-8c5111a7c663] Found default for hw_input_bus of None {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:45:27 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-a8e90e19-cb83-4b96-95f0-7f8c200599a6 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: d281f155-01b4-4141-8184-8c5111a7c663] Found default for hw_pointer_model of None {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:45:27 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-a8e90e19-cb83-4b96-95f0-7f8c200599a6 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: d281f155-01b4-4141-8184-8c5111a7c663] Found default for hw_video_model of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:45:27 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-a8e90e19-cb83-4b96-95f0-7f8c200599a6 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: d281f155-01b4-4141-8184-8c5111a7c663] Found default for hw_vif_model of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:45:27 user nova-compute[75226]: INFO nova.compute.manager [None req-a8e90e19-cb83-4b96-95f0-7f8c200599a6 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: d281f155-01b4-4141-8184-8c5111a7c663] Took 6.31 seconds to spawn the instance on the hypervisor.
Nov 17 01:45:27 user nova-compute[75226]: DEBUG nova.compute.manager [None req-a8e90e19-cb83-4b96-95f0-7f8c200599a6 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: d281f155-01b4-4141-8184-8c5111a7c663] Checking state {{(pid=75226) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 01:45:27 user nova-compute[75226]: INFO nova.compute.manager [None req-a8e90e19-cb83-4b96-95f0-7f8c200599a6 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: d281f155-01b4-4141-8184-8c5111a7c663] Took 13.13 seconds to build instance.
Nov 17 01:45:27 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-a8e90e19-cb83-4b96-95f0-7f8c200599a6 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Lock "d281f155-01b4-4141-8184-8c5111a7c663" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.297s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:45:27 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:45:27 user nova-compute[75226]: DEBUG nova.compute.manager [req-0f07403f-1e1f-4c98-8f5f-16c1d2b7bde7 req-907da3a4-4375-44a9-9936-5d59b64b4e71 service nova] [instance: 8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02] Received event network-vif-plugged-ab437de1-a5c2-48c9-b693-902fc4b05929 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:45:27 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-0f07403f-1e1f-4c98-8f5f-16c1d2b7bde7 req-907da3a4-4375-44a9-9936-5d59b64b4e71 service nova] Acquiring lock "8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:45:27 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-0f07403f-1e1f-4c98-8f5f-16c1d2b7bde7 req-907da3a4-4375-44a9-9936-5d59b64b4e71 service nova] Lock "8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:45:27 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-0f07403f-1e1f-4c98-8f5f-16c1d2b7bde7 req-907da3a4-4375-44a9-9936-5d59b64b4e71 service nova] Lock "8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:45:27 user nova-compute[75226]: DEBUG nova.compute.manager [req-0f07403f-1e1f-4c98-8f5f-16c1d2b7bde7 req-907da3a4-4375-44a9-9936-5d59b64b4e71 service nova] [instance: 8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02] No waiting events found dispatching network-vif-plugged-ab437de1-a5c2-48c9-b693-902fc4b05929 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:45:27 user nova-compute[75226]: WARNING nova.compute.manager [req-0f07403f-1e1f-4c98-8f5f-16c1d2b7bde7 req-907da3a4-4375-44a9-9936-5d59b64b4e71 service nova] [instance: 8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02] Received unexpected event network-vif-plugged-ab437de1-a5c2-48c9-b693-902fc4b05929 for instance with vm_state active and task_state reboot_started.
Nov 17 01:45:27 user nova-compute[75226]: DEBUG nova.compute.manager [req-0f07403f-1e1f-4c98-8f5f-16c1d2b7bde7 req-907da3a4-4375-44a9-9936-5d59b64b4e71 service nova] [instance: 8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02] Received event network-vif-plugged-ab437de1-a5c2-48c9-b693-902fc4b05929 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:45:27 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-0f07403f-1e1f-4c98-8f5f-16c1d2b7bde7 req-907da3a4-4375-44a9-9936-5d59b64b4e71 service nova] Acquiring lock "8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:45:27 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-0f07403f-1e1f-4c98-8f5f-16c1d2b7bde7 req-907da3a4-4375-44a9-9936-5d59b64b4e71 service nova] Lock "8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:45:27 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-0f07403f-1e1f-4c98-8f5f-16c1d2b7bde7 req-907da3a4-4375-44a9-9936-5d59b64b4e71 service nova] Lock "8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:45:27 user nova-compute[75226]: DEBUG nova.compute.manager [req-0f07403f-1e1f-4c98-8f5f-16c1d2b7bde7 req-907da3a4-4375-44a9-9936-5d59b64b4e71 service nova] [instance: 8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02] No waiting events found dispatching network-vif-plugged-ab437de1-a5c2-48c9-b693-902fc4b05929 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:45:27 user nova-compute[75226]: WARNING nova.compute.manager [req-0f07403f-1e1f-4c98-8f5f-16c1d2b7bde7 req-907da3a4-4375-44a9-9936-5d59b64b4e71 service nova] [instance: 8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02] Received unexpected event network-vif-plugged-ab437de1-a5c2-48c9-b693-902fc4b05929 for instance with vm_state active and task_state reboot_started.
Nov 17 01:45:27 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:45:27 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:45:27 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75226) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 17 01:45:28 user nova-compute[75226]: INFO nova.virt.libvirt.driver [-] [instance: 8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02] Instance running successfully.
Nov 17 01:45:28 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-f6eb20e1-9c96-4fa0-8d57-88751aca1577 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] [instance: 8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02] Instance soft rebooted successfully.
Nov 17 01:45:28 user nova-compute[75226]: DEBUG nova.compute.manager [None req-f6eb20e1-9c96-4fa0-8d57-88751aca1577 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] [instance: 8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02] Checking state {{(pid=75226) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 01:45:28 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-f6eb20e1-9c96-4fa0-8d57-88751aca1577 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Lock "8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.016s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:45:28 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:45:28 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:45:32 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:45:33 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:45:33 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:45:35 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:45:37 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:45:38 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:45:42 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:45:43 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:45:44 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-6c759871-c913-4c6d-8c29-87eff30ae9e2 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Acquiring lock "b2a30d8f-1521-4d8a-b880-65f31ae1b704" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:45:44 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-6c759871-c913-4c6d-8c29-87eff30ae9e2 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Lock "b2a30d8f-1521-4d8a-b880-65f31ae1b704" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:45:44 user nova-compute[75226]: DEBUG nova.compute.manager [None req-6c759871-c913-4c6d-8c29-87eff30ae9e2 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] [instance: b2a30d8f-1521-4d8a-b880-65f31ae1b704] Starting instance... {{(pid=75226) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 17 01:45:44 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-6c759871-c913-4c6d-8c29-87eff30ae9e2 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:45:44 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-6c759871-c913-4c6d-8c29-87eff30ae9e2 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:45:44 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-6c759871-c913-4c6d-8c29-87eff30ae9e2 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75226) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 17 01:45:44 user nova-compute[75226]: INFO nova.compute.claims [None req-6c759871-c913-4c6d-8c29-87eff30ae9e2 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] [instance: b2a30d8f-1521-4d8a-b880-65f31ae1b704] Claim successful on node user
Nov 17 01:45:45 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-6c759871-c913-4c6d-8c29-87eff30ae9e2 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:45:45 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-6c759871-c913-4c6d-8c29-87eff30ae9e2 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:45:45 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-6c759871-c913-4c6d-8c29-87eff30ae9e2 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.257s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:45:45 user nova-compute[75226]: DEBUG nova.compute.manager [None req-6c759871-c913-4c6d-8c29-87eff30ae9e2 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] [instance: b2a30d8f-1521-4d8a-b880-65f31ae1b704] Start building networks asynchronously for instance. {{(pid=75226) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 17 01:45:45 user nova-compute[75226]: DEBUG nova.compute.manager [None req-6c759871-c913-4c6d-8c29-87eff30ae9e2 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] [instance: b2a30d8f-1521-4d8a-b880-65f31ae1b704] Allocating IP information in the background. {{(pid=75226) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 17 01:45:45 user nova-compute[75226]: DEBUG nova.network.neutron [None req-6c759871-c913-4c6d-8c29-87eff30ae9e2 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] [instance: b2a30d8f-1521-4d8a-b880-65f31ae1b704] allocate_for_instance() {{(pid=75226) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 17 01:45:45 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-6c759871-c913-4c6d-8c29-87eff30ae9e2 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] [instance: b2a30d8f-1521-4d8a-b880-65f31ae1b704] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 17 01:45:45 user nova-compute[75226]: DEBUG nova.compute.manager [None req-6c759871-c913-4c6d-8c29-87eff30ae9e2 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] [instance: b2a30d8f-1521-4d8a-b880-65f31ae1b704] Start building block device mappings for instance. {{(pid=75226) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 17 01:45:45 user nova-compute[75226]: DEBUG nova.policy [None req-6c759871-c913-4c6d-8c29-87eff30ae9e2 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '664817f1ee104181aa271179f9d8e0e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc65d32b52442aea872bf9f6025c4e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75226) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 17 01:45:45 user nova-compute[75226]: DEBUG nova.compute.manager [None req-6c759871-c913-4c6d-8c29-87eff30ae9e2 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] [instance: b2a30d8f-1521-4d8a-b880-65f31ae1b704] Start spawning the instance on the hypervisor. {{(pid=75226) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 17 01:45:45 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-6c759871-c913-4c6d-8c29-87eff30ae9e2 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] [instance: b2a30d8f-1521-4d8a-b880-65f31ae1b704] Creating instance directory {{(pid=75226) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 17 01:45:45 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-6c759871-c913-4c6d-8c29-87eff30ae9e2 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] [instance: b2a30d8f-1521-4d8a-b880-65f31ae1b704] Creating image(s)
Nov 17 01:45:45 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-6c759871-c913-4c6d-8c29-87eff30ae9e2 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Acquiring lock "/opt/stack/data/nova/instances/b2a30d8f-1521-4d8a-b880-65f31ae1b704/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:45:45 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-6c759871-c913-4c6d-8c29-87eff30ae9e2 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Lock "/opt/stack/data/nova/instances/b2a30d8f-1521-4d8a-b880-65f31ae1b704/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:45:45 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-6c759871-c913-4c6d-8c29-87eff30ae9e2 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Lock "/opt/stack/data/nova/instances/b2a30d8f-1521-4d8a-b880-65f31ae1b704/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:45:45 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-6c759871-c913-4c6d-8c29-87eff30ae9e2 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:45:45 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-6c759871-c913-4c6d-8c29-87eff30ae9e2 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json" returned: 0 in 0.180s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:45:45 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-6c759871-c913-4c6d-8c29-87eff30ae9e2 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Acquiring lock "a8a62c2546af3a2036b853250c5ac64d4c6b4371" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:45:45 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-6c759871-c913-4c6d-8c29-87eff30ae9e2 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Lock "a8a62c2546af3a2036b853250c5ac64d4c6b4371" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:45:45 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-6c759871-c913-4c6d-8c29-87eff30ae9e2 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:45:45 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-6c759871-c913-4c6d-8c29-87eff30ae9e2 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json" returned: 0 in 0.187s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:45:45 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-6c759871-c913-4c6d-8c29-87eff30ae9e2 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371,backing_fmt=raw /opt/stack/data/nova/instances/b2a30d8f-1521-4d8a-b880-65f31ae1b704/disk 1073741824 {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:45:45 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-6c759871-c913-4c6d-8c29-87eff30ae9e2 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371,backing_fmt=raw /opt/stack/data/nova/instances/b2a30d8f-1521-4d8a-b880-65f31ae1b704/disk 1073741824" returned: 0 in 0.055s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:45:45 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-6c759871-c913-4c6d-8c29-87eff30ae9e2 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Lock "a8a62c2546af3a2036b853250c5ac64d4c6b4371" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:45:45 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-6c759871-c913-4c6d-8c29-87eff30ae9e2 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:45:45 user nova-compute[75226]: DEBUG nova.network.neutron [None req-6c759871-c913-4c6d-8c29-87eff30ae9e2 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] [instance: b2a30d8f-1521-4d8a-b880-65f31ae1b704] Successfully created port: f56ebc06-b6d7-4708-ade5-7627a7e7599a {{(pid=75226) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 17 01:45:46 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-6c759871-c913-4c6d-8c29-87eff30ae9e2 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json" returned: 0 in 0.201s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:45:46 user nova-compute[75226]: DEBUG nova.virt.disk.api [None req-6c759871-c913-4c6d-8c29-87eff30ae9e2 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b2a30d8f-1521-4d8a-b880-65f31ae1b704/disk. size=1073741824 {{(pid=75226) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 17 01:45:46 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-6c759871-c913-4c6d-8c29-87eff30ae9e2 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2a30d8f-1521-4d8a-b880-65f31ae1b704/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:45:46 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-6c759871-c913-4c6d-8c29-87eff30ae9e2 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2a30d8f-1521-4d8a-b880-65f31ae1b704/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:45:46 user nova-compute[75226]: DEBUG nova.virt.disk.api [None req-6c759871-c913-4c6d-8c29-87eff30ae9e2 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Cannot resize image /opt/stack/data/nova/instances/b2a30d8f-1521-4d8a-b880-65f31ae1b704/disk to a smaller size. {{(pid=75226) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 17 01:45:46 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-6c759871-c913-4c6d-8c29-87eff30ae9e2 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] [instance: b2a30d8f-1521-4d8a-b880-65f31ae1b704] Created local disks {{(pid=75226) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 17 01:45:46 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-6c759871-c913-4c6d-8c29-87eff30ae9e2 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] [instance: b2a30d8f-1521-4d8a-b880-65f31ae1b704] Ensure instance console log exists: /opt/stack/data/nova/instances/b2a30d8f-1521-4d8a-b880-65f31ae1b704/console.log {{(pid=75226) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 17 01:45:46 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-6c759871-c913-4c6d-8c29-87eff30ae9e2 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:45:46 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-6c759871-c913-4c6d-8c29-87eff30ae9e2 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:45:46 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-6c759871-c913-4c6d-8c29-87eff30ae9e2 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:45:46 user nova-compute[75226]: DEBUG nova.network.neutron [None req-6c759871-c913-4c6d-8c29-87eff30ae9e2 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] [instance: b2a30d8f-1521-4d8a-b880-65f31ae1b704] Successfully updated port: f56ebc06-b6d7-4708-ade5-7627a7e7599a {{(pid=75226) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 17 01:45:46 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-6c759871-c913-4c6d-8c29-87eff30ae9e2 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Acquiring lock "refresh_cache-b2a30d8f-1521-4d8a-b880-65f31ae1b704" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:45:46 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-6c759871-c913-4c6d-8c29-87eff30ae9e2 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Acquired lock "refresh_cache-b2a30d8f-1521-4d8a-b880-65f31ae1b704" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:45:46 user nova-compute[75226]: DEBUG nova.network.neutron [None req-6c759871-c913-4c6d-8c29-87eff30ae9e2 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] [instance: b2a30d8f-1521-4d8a-b880-65f31ae1b704] Building network info cache for instance {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 01:45:46 user nova-compute[75226]: DEBUG nova.compute.manager [req-50270243-8e66-4619-bcbb-e07e396006c5 req-a7c503e6-3359-44ec-8f7a-6047a9ecc114 service nova] [instance: b2a30d8f-1521-4d8a-b880-65f31ae1b704] Received event network-changed-f56ebc06-b6d7-4708-ade5-7627a7e7599a {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:45:46 user nova-compute[75226]: DEBUG nova.compute.manager [req-50270243-8e66-4619-bcbb-e07e396006c5 req-a7c503e6-3359-44ec-8f7a-6047a9ecc114 service nova] [instance: b2a30d8f-1521-4d8a-b880-65f31ae1b704] Refreshing instance network info cache due to event network-changed-f56ebc06-b6d7-4708-ade5-7627a7e7599a. {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 01:45:46 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-50270243-8e66-4619-bcbb-e07e396006c5 req-a7c503e6-3359-44ec-8f7a-6047a9ecc114 service nova] Acquiring lock "refresh_cache-b2a30d8f-1521-4d8a-b880-65f31ae1b704" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:45:46 user nova-compute[75226]: DEBUG nova.network.neutron [None req-6c759871-c913-4c6d-8c29-87eff30ae9e2 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] [instance: b2a30d8f-1521-4d8a-b880-65f31ae1b704] Instance cache missing network info. {{(pid=75226) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 17 01:45:46 user nova-compute[75226]: DEBUG nova.network.neutron [None req-6c759871-c913-4c6d-8c29-87eff30ae9e2 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] [instance: b2a30d8f-1521-4d8a-b880-65f31ae1b704] Updating instance_info_cache with network_info: [{"id": "f56ebc06-b6d7-4708-ade5-7627a7e7599a", "address": "fa:16:3e:5f:3f:57", "network": {"id": "2d06b621-84a6-48dc-be05-92b6724810e3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1055056582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "acc65d32b52442aea872bf9f6025c4e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf56ebc06-b6", "ovs_interfaceid": "f56ebc06-b6d7-4708-ade5-7627a7e7599a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:45:46 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-6c759871-c913-4c6d-8c29-87eff30ae9e2 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Releasing lock "refresh_cache-b2a30d8f-1521-4d8a-b880-65f31ae1b704" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:45:46 user nova-compute[75226]: DEBUG nova.compute.manager [None req-6c759871-c913-4c6d-8c29-87eff30ae9e2 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] [instance: b2a30d8f-1521-4d8a-b880-65f31ae1b704] Instance network_info: |[{"id": "f56ebc06-b6d7-4708-ade5-7627a7e7599a", "address": "fa:16:3e:5f:3f:57", "network": {"id": "2d06b621-84a6-48dc-be05-92b6724810e3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1055056582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "acc65d32b52442aea872bf9f6025c4e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf56ebc06-b6", "ovs_interfaceid": "f56ebc06-b6d7-4708-ade5-7627a7e7599a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75226) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 17 01:45:46 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-50270243-8e66-4619-bcbb-e07e396006c5 req-a7c503e6-3359-44ec-8f7a-6047a9ecc114 service nova] Acquired lock "refresh_cache-b2a30d8f-1521-4d8a-b880-65f31ae1b704" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:45:46 user nova-compute[75226]: DEBUG nova.network.neutron [req-50270243-8e66-4619-bcbb-e07e396006c5 req-a7c503e6-3359-44ec-8f7a-6047a9ecc114 service nova] [instance: b2a30d8f-1521-4d8a-b880-65f31ae1b704] Refreshing network info cache for port f56ebc06-b6d7-4708-ade5-7627a7e7599a {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 01:45:46 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-6c759871-c913-4c6d-8c29-87eff30ae9e2 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] [instance: b2a30d8f-1521-4d8a-b880-65f31ae1b704] Start _get_guest_xml network_info=[{"id": "f56ebc06-b6d7-4708-ade5-7627a7e7599a", "address": "fa:16:3e:5f:3f:57", "network": {"id": "2d06b621-84a6-48dc-be05-92b6724810e3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1055056582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "acc65d32b52442aea872bf9f6025c4e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf56ebc06-b6", "ovs_interfaceid": "f56ebc06-b6d7-4708-ade5-7627a7e7599a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T01:13:22Z,direct_url=<?>,disk_format='qcow2',id=0b369aea-6f3f-4690-9f01-229b90ab6310,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4e110cbf9a84362a6864a7732c435a1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T01:13:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '0b369aea-6f3f-4690-9f01-229b90ab6310'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75226) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 17 01:45:46 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-6c759871-c913-4c6d-8c29-87eff30ae9e2 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:45:46 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-6c759871-c913-4c6d-8c29-87eff30ae9e2 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:45:46 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-6c759871-c913-4c6d-8c29-87eff30ae9e2 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75226) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 17 01:45:46 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-6c759871-c913-4c6d-8c29-87eff30ae9e2 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] CPU controller missing on host. {{(pid=75226) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 17 01:45:46 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-6c759871-c913-4c6d-8c29-87eff30ae9e2 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75226) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 17 01:45:46 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-6c759871-c913-4c6d-8c29-87eff30ae9e2 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] CPU controller found on host. {{(pid=75226) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 17 01:45:46 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-6c759871-c913-4c6d-8c29-87eff30ae9e2 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75226) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 17 01:45:46 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-6c759871-c913-4c6d-8c29-87eff30ae9e2 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-17T01:13:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T01:13:22Z,direct_url=<?>,disk_format='qcow2',id=0b369aea-6f3f-4690-9f01-229b90ab6310,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4e110cbf9a84362a6864a7732c435a1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T01:13:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 17 01:45:46 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-6c759871-c913-4c6d-8c29-87eff30ae9e2 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Flavor limits 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 17 01:45:46 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-6c759871-c913-4c6d-8c29-87eff30ae9e2 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Image limits 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 17 01:45:46 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-6c759871-c913-4c6d-8c29-87eff30ae9e2 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Flavor pref 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 17 01:45:46 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-6c759871-c913-4c6d-8c29-87eff30ae9e2 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Image pref 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 17 01:45:46 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-6c759871-c913-4c6d-8c29-87eff30ae9e2 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 17 01:45:46 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-6c759871-c913-4c6d-8c29-87eff30ae9e2 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 17 01:45:46 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-6c759871-c913-4c6d-8c29-87eff30ae9e2 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75226) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 17 01:45:46 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-6c759871-c913-4c6d-8c29-87eff30ae9e2 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Got 1 possible topologies {{(pid=75226) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 17 01:45:46 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-6c759871-c913-4c6d-8c29-87eff30ae9e2 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 17 01:45:46 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-6c759871-c913-4c6d-8c29-87eff30ae9e2 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 17 01:45:47 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-6c759871-c913-4c6d-8c29-87eff30ae9e2 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:45:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-382953492',display_name='tempest-VolumesSnapshotTestJSON-instance-382953492',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-382953492',id=46,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOy/FenRa1J0alFqxTriQ3DaYRj0Sl+v88wHHMZLcxNj4I+R2OhbSOqMTMoKEU1bK9IGxxUHT6BZiDC1NVPA+oFZAC2YD+T7taAP1SXJsw6XIoAUa9zouMCKyh5WnLzcRA==',key_name='tempest-keypair-139214307',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='acc65d32b52442aea872bf9f6025c4e4',ramdisk_id='',reservation_id='r-udd74sd5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1912813406',owner_user_name='tempest-VolumesSnapshotTestJSON-1912813406-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T01:45:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='664817f1ee104181aa271179f9d8e0e1',uuid=b2a30d8f-1521-4d8a-b880-65f31ae1b704,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f56ebc06-b6d7-4708-ade5-7627a7e7599a", "address": "fa:16:3e:5f:3f:57", "network": {"id": "2d06b621-84a6-48dc-be05-92b6724810e3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1055056582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "acc65d32b52442aea872bf9f6025c4e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf56ebc06-b6", "ovs_interfaceid": "f56ebc06-b6d7-4708-ade5-7627a7e7599a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75226) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 01:45:47 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-6c759871-c913-4c6d-8c29-87eff30ae9e2 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Converting VIF {"id": "f56ebc06-b6d7-4708-ade5-7627a7e7599a", "address": "fa:16:3e:5f:3f:57", "network": {"id": "2d06b621-84a6-48dc-be05-92b6724810e3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1055056582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "acc65d32b52442aea872bf9f6025c4e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf56ebc06-b6", "ovs_interfaceid": "f56ebc06-b6d7-4708-ade5-7627a7e7599a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:45:47 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-6c759871-c913-4c6d-8c29-87eff30ae9e2 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:3f:57,bridge_name='br-int',has_traffic_filtering=True,id=f56ebc06-b6d7-4708-ade5-7627a7e7599a,network=Network(2d06b621-84a6-48dc-be05-92b6724810e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf56ebc06-b6') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:45:47 user nova-compute[75226]: DEBUG nova.objects.instance [None req-6c759871-c913-4c6d-8c29-87eff30ae9e2 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Lazy-loading 'pci_devices' on Instance uuid b2a30d8f-1521-4d8a-b880-65f31ae1b704 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:45:47 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-6c759871-c913-4c6d-8c29-87eff30ae9e2 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] [instance: b2a30d8f-1521-4d8a-b880-65f31ae1b704] End _get_guest_xml xml=<domain type="kvm">
Nov 17 01:45:47 user nova-compute[75226]:   <uuid>b2a30d8f-1521-4d8a-b880-65f31ae1b704</uuid>
Nov 17 01:45:47 user nova-compute[75226]:   <name>instance-0000002e</name>
Nov 17 01:45:47 user nova-compute[75226]:   <memory>524288</memory>
Nov 17 01:45:47 user nova-compute[75226]:   <vcpu>1</vcpu>
Nov 17 01:45:47 user nova-compute[75226]:   <metadata>
Nov 17 01:45:47 user nova-compute[75226]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 17 01:45:47 user nova-compute[75226]:       <nova:package version="0.0.0"/>
Nov 17 01:45:47 user nova-compute[75226]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-382953492</nova:name>
Nov 17 01:45:47 user nova-compute[75226]:       <nova:creationTime>2023-11-17 01:45:46</nova:creationTime>
Nov 17 01:45:47 user nova-compute[75226]:       <nova:flavor name="m1.tiny">
Nov 17 01:45:47 user nova-compute[75226]:         <nova:memory>512</nova:memory>
Nov 17 01:45:47 user nova-compute[75226]:         <nova:disk>1</nova:disk>
Nov 17 01:45:47 user nova-compute[75226]:         <nova:swap>0</nova:swap>
Nov 17 01:45:47 user nova-compute[75226]:         <nova:ephemeral>0</nova:ephemeral>
Nov 17 01:45:47 user nova-compute[75226]:         <nova:vcpus>1</nova:vcpus>
Nov 17 01:45:47 user nova-compute[75226]:       </nova:flavor>
Nov 17 01:45:47 user nova-compute[75226]:       <nova:owner>
Nov 17 01:45:47 user nova-compute[75226]:         <nova:user uuid="664817f1ee104181aa271179f9d8e0e1">tempest-VolumesSnapshotTestJSON-1912813406-project-member</nova:user>
Nov 17 01:45:47 user nova-compute[75226]:         <nova:project uuid="acc65d32b52442aea872bf9f6025c4e4">tempest-VolumesSnapshotTestJSON-1912813406</nova:project>
Nov 17 01:45:47 user nova-compute[75226]:       </nova:owner>
Nov 17 01:45:47 user nova-compute[75226]:       <nova:root type="image" uuid="0b369aea-6f3f-4690-9f01-229b90ab6310"/>
Nov 17 01:45:47 user nova-compute[75226]:       <nova:ports>
Nov 17 01:45:47 user nova-compute[75226]:         <nova:port uuid="f56ebc06-b6d7-4708-ade5-7627a7e7599a">
Nov 17 01:45:47 user nova-compute[75226]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 17 01:45:47 user nova-compute[75226]:         </nova:port>
Nov 17 01:45:47 user nova-compute[75226]:       </nova:ports>
Nov 17 01:45:47 user nova-compute[75226]:     </nova:instance>
Nov 17 01:45:47 user nova-compute[75226]:   </metadata>
Nov 17 01:45:47 user nova-compute[75226]:   <sysinfo type="smbios">
Nov 17 01:45:47 user nova-compute[75226]:     <system>
Nov 17 01:45:47 user nova-compute[75226]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 17 01:45:47 user nova-compute[75226]:       <entry name="product">OpenStack Nova</entry>
Nov 17 01:45:47 user nova-compute[75226]:       <entry name="version">0.0.0</entry>
Nov 17 01:45:47 user nova-compute[75226]:       <entry name="serial">b2a30d8f-1521-4d8a-b880-65f31ae1b704</entry>
Nov 17 01:45:47 user nova-compute[75226]:       <entry name="uuid">b2a30d8f-1521-4d8a-b880-65f31ae1b704</entry>
Nov 17 01:45:47 user nova-compute[75226]:       <entry name="family">Virtual Machine</entry>
Nov 17 01:45:47 user nova-compute[75226]:     </system>
Nov 17 01:45:47 user nova-compute[75226]:   </sysinfo>
Nov 17 01:45:47 user nova-compute[75226]:   <os>
Nov 17 01:45:47 user nova-compute[75226]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 17 01:45:47 user nova-compute[75226]:     <boot dev="hd"/>
Nov 17 01:45:47 user nova-compute[75226]:     <smbios mode="sysinfo"/>
Nov 17 01:45:47 user nova-compute[75226]:   </os>
Nov 17 01:45:47 user nova-compute[75226]:   <features>
Nov 17 01:45:47 user nova-compute[75226]:     <acpi/>
Nov 17 01:45:47 user nova-compute[75226]:     <apic/>
Nov 17 01:45:47 user nova-compute[75226]:     <vmcoreinfo/>
Nov 17 01:45:47 user nova-compute[75226]:   </features>
Nov 17 01:45:47 user nova-compute[75226]:   <clock offset="utc">
Nov 17 01:45:47 user nova-compute[75226]:     <timer name="pit" tickpolicy="delay"/>
Nov 17 01:45:47 user nova-compute[75226]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 17 01:45:47 user nova-compute[75226]:     <timer name="hpet" present="no"/>
Nov 17 01:45:47 user nova-compute[75226]:   </clock>
Nov 17 01:45:47 user nova-compute[75226]:   <cpu mode="custom" match="exact">
Nov 17 01:45:47 user nova-compute[75226]:     <model>Nehalem</model>
Nov 17 01:45:47 user nova-compute[75226]:     <topology sockets="1" cores="1" threads="1"/>
Nov 17 01:45:47 user nova-compute[75226]:   </cpu>
Nov 17 01:45:47 user nova-compute[75226]:   <devices>
Nov 17 01:45:47 user nova-compute[75226]:     <disk type="file" device="disk">
Nov 17 01:45:47 user nova-compute[75226]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 17 01:45:47 user nova-compute[75226]:       <source file="/opt/stack/data/nova/instances/b2a30d8f-1521-4d8a-b880-65f31ae1b704/disk"/>
Nov 17 01:45:47 user nova-compute[75226]:       <target dev="vda" bus="virtio"/>
Nov 17 01:45:47 user nova-compute[75226]:     </disk>
Nov 17 01:45:47 user nova-compute[75226]:     <interface type="ethernet">
Nov 17 01:45:47 user nova-compute[75226]:       <mac address="fa:16:3e:5f:3f:57"/>
Nov 17 01:45:47 user nova-compute[75226]:       <model type="virtio"/>
Nov 17 01:45:47 user nova-compute[75226]:       <mtu size="1442"/>
Nov 17 01:45:47 user nova-compute[75226]:       <target dev="tapf56ebc06-b6"/>
Nov 17 01:45:47 user nova-compute[75226]:     </interface>
Nov 17 01:45:47 user nova-compute[75226]:     <serial type="pty">
Nov 17 01:45:47 user nova-compute[75226]:       <log file="/opt/stack/data/nova/instances/b2a30d8f-1521-4d8a-b880-65f31ae1b704/console.log" append="off"/>
Nov 17 01:45:47 user nova-compute[75226]:     </serial>
Nov 17 01:45:47 user nova-compute[75226]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 17 01:45:47 user nova-compute[75226]:     <video>
Nov 17 01:45:47 user nova-compute[75226]:       <model type="virtio"/>
Nov 17 01:45:47 user nova-compute[75226]:     </video>
Nov 17 01:45:47 user nova-compute[75226]:     <rng model="virtio">
Nov 17 01:45:47 user nova-compute[75226]:       <backend model="random">/dev/urandom</backend>
Nov 17 01:45:47 user nova-compute[75226]:     </rng>
Nov 17 01:45:47 user nova-compute[75226]:     <controller type="usb" index="0" model="none"/>
Nov 17 01:45:47 user nova-compute[75226]:     <memballoon model="virtio">
Nov 17 01:45:47 user nova-compute[75226]:       <stats period="10"/>
Nov 17 01:45:47 user nova-compute[75226]:     </memballoon>
Nov 17 01:45:47 user nova-compute[75226]:   </devices>
Nov 17 01:45:47 user nova-compute[75226]: </domain>
Nov 17 01:45:47 user nova-compute[75226]:  {{(pid=75226) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 17 01:45:47 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-6c759871-c913-4c6d-8c29-87eff30ae9e2 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:45:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-382953492',display_name='tempest-VolumesSnapshotTestJSON-instance-382953492',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-382953492',id=46,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOy/FenRa1J0alFqxTriQ3DaYRj0Sl+v88wHHMZLcxNj4I+R2OhbSOqMTMoKEU1bK9IGxxUHT6BZiDC1NVPA+oFZAC2YD+T7taAP1SXJsw6XIoAUa9zouMCKyh5WnLzcRA==',key_name='tempest-keypair-139214307',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='acc65d32b52442aea872bf9f6025c4e4',ramdisk_id='',reservation_id='r-udd74sd5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1912813406',owner_user_name='tempest-VolumesSnapshotTestJSON-1912813406-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T01:45:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='664817f1ee104181aa271179f9d8e0e1',uuid=b2a30d8f-1521-4d8a-b880-65f31ae1b704,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f56ebc06-b6d7-4708-ade5-7627a7e7599a", "address": "fa:16:3e:5f:3f:57", "network": {"id": "2d06b621-84a6-48dc-be05-92b6724810e3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1055056582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "acc65d32b52442aea872bf9f6025c4e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf56ebc06-b6", "ovs_interfaceid": "f56ebc06-b6d7-4708-ade5-7627a7e7599a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 17 01:45:47 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-6c759871-c913-4c6d-8c29-87eff30ae9e2 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Converting VIF {"id": "f56ebc06-b6d7-4708-ade5-7627a7e7599a", "address": "fa:16:3e:5f:3f:57", "network": {"id": "2d06b621-84a6-48dc-be05-92b6724810e3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1055056582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "acc65d32b52442aea872bf9f6025c4e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf56ebc06-b6", "ovs_interfaceid": "f56ebc06-b6d7-4708-ade5-7627a7e7599a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:45:47 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-6c759871-c913-4c6d-8c29-87eff30ae9e2 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:3f:57,bridge_name='br-int',has_traffic_filtering=True,id=f56ebc06-b6d7-4708-ade5-7627a7e7599a,network=Network(2d06b621-84a6-48dc-be05-92b6724810e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf56ebc06-b6') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:45:47 user nova-compute[75226]: DEBUG os_vif [None req-6c759871-c913-4c6d-8c29-87eff30ae9e2 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:3f:57,bridge_name='br-int',has_traffic_filtering=True,id=f56ebc06-b6d7-4708-ade5-7627a7e7599a,network=Network(2d06b621-84a6-48dc-be05-92b6724810e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf56ebc06-b6') {{(pid=75226) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 17 01:45:47 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:45:47 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:45:47 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 17 01:45:47 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:45:47 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'de1a6c87-e1e9-5033-8128-70f385d6695f', '_type': 'linux-noop'}}, row=False) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:45:47 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:45:47 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:45:47 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf56ebc06-b6, may_exist=True, interface_attrs={}) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:45:47 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf56ebc06-b6, col_values=(('qos', UUID('8a8fe561-7389-4fc7-aa56-e0aeb289faee')),), if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:45:47 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf56ebc06-b6, col_values=(('external_ids', {'iface-id': 'f56ebc06-b6d7-4708-ade5-7627a7e7599a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5f:3f:57', 'vm-uuid': 'b2a30d8f-1521-4d8a-b880-65f31ae1b704'}),), if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:45:47 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:45:47 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:45:47 user nova-compute[75226]: INFO os_vif [None req-6c759871-c913-4c6d-8c29-87eff30ae9e2 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:3f:57,bridge_name='br-int',has_traffic_filtering=True,id=f56ebc06-b6d7-4708-ade5-7627a7e7599a,network=Network(2d06b621-84a6-48dc-be05-92b6724810e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf56ebc06-b6')
Nov 17 01:45:47 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-6c759871-c913-4c6d-8c29-87eff30ae9e2 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] No BDM found with device name vda, not building metadata. {{(pid=75226) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 01:45:47 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-6c759871-c913-4c6d-8c29-87eff30ae9e2 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] No VIF found with MAC fa:16:3e:5f:3f:57, not building metadata {{(pid=75226) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 01:45:47 user nova-compute[75226]: DEBUG nova.network.neutron [req-50270243-8e66-4619-bcbb-e07e396006c5 req-a7c503e6-3359-44ec-8f7a-6047a9ecc114 service nova] [instance: b2a30d8f-1521-4d8a-b880-65f31ae1b704] Updated VIF entry in instance network info cache for port f56ebc06-b6d7-4708-ade5-7627a7e7599a. {{(pid=75226) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 01:45:47 user nova-compute[75226]: DEBUG nova.network.neutron [req-50270243-8e66-4619-bcbb-e07e396006c5 req-a7c503e6-3359-44ec-8f7a-6047a9ecc114 service nova] [instance: b2a30d8f-1521-4d8a-b880-65f31ae1b704] Updating instance_info_cache with network_info: [{"id": "f56ebc06-b6d7-4708-ade5-7627a7e7599a", "address": "fa:16:3e:5f:3f:57", "network": {"id": "2d06b621-84a6-48dc-be05-92b6724810e3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1055056582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "acc65d32b52442aea872bf9f6025c4e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf56ebc06-b6", "ovs_interfaceid": "f56ebc06-b6d7-4708-ade5-7627a7e7599a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:45:47 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-50270243-8e66-4619-bcbb-e07e396006c5 req-a7c503e6-3359-44ec-8f7a-6047a9ecc114 service nova] Releasing lock "refresh_cache-b2a30d8f-1521-4d8a-b880-65f31ae1b704" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:45:48 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:45:48 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:45:48 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:45:48 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:45:48 user nova-compute[75226]: DEBUG nova.compute.manager [req-7fc49f2a-73ca-4d63-b5c5-ea6e57b6c6bb req-287337d2-a73f-4692-a490-4f8b889bea1f service nova] [instance: b2a30d8f-1521-4d8a-b880-65f31ae1b704] Received event network-vif-plugged-f56ebc06-b6d7-4708-ade5-7627a7e7599a {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:45:48 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-7fc49f2a-73ca-4d63-b5c5-ea6e57b6c6bb req-287337d2-a73f-4692-a490-4f8b889bea1f service nova] Acquiring lock "b2a30d8f-1521-4d8a-b880-65f31ae1b704-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:45:48 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-7fc49f2a-73ca-4d63-b5c5-ea6e57b6c6bb req-287337d2-a73f-4692-a490-4f8b889bea1f service nova] Lock "b2a30d8f-1521-4d8a-b880-65f31ae1b704-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:45:48 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-7fc49f2a-73ca-4d63-b5c5-ea6e57b6c6bb req-287337d2-a73f-4692-a490-4f8b889bea1f service nova] Lock "b2a30d8f-1521-4d8a-b880-65f31ae1b704-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:45:48 user nova-compute[75226]: DEBUG nova.compute.manager [req-7fc49f2a-73ca-4d63-b5c5-ea6e57b6c6bb req-287337d2-a73f-4692-a490-4f8b889bea1f service nova] [instance: b2a30d8f-1521-4d8a-b880-65f31ae1b704] No waiting events found dispatching network-vif-plugged-f56ebc06-b6d7-4708-ade5-7627a7e7599a {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:45:48 user nova-compute[75226]: WARNING nova.compute.manager [req-7fc49f2a-73ca-4d63-b5c5-ea6e57b6c6bb req-287337d2-a73f-4692-a490-4f8b889bea1f service nova] [instance: b2a30d8f-1521-4d8a-b880-65f31ae1b704] Received unexpected event network-vif-plugged-f56ebc06-b6d7-4708-ade5-7627a7e7599a for instance with vm_state building and task_state spawning.
Nov 17 01:45:49 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:45:49 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:45:49 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:45:50 user nova-compute[75226]: DEBUG nova.compute.manager [None req-6c759871-c913-4c6d-8c29-87eff30ae9e2 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] [instance: b2a30d8f-1521-4d8a-b880-65f31ae1b704] Instance event wait completed in 0 seconds for  {{(pid=75226) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 17 01:45:50 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-6c759871-c913-4c6d-8c29-87eff30ae9e2 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] [instance: b2a30d8f-1521-4d8a-b880-65f31ae1b704] Guest created on hypervisor {{(pid=75226) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 17 01:45:50 user nova-compute[75226]: INFO nova.virt.libvirt.driver [-] [instance: b2a30d8f-1521-4d8a-b880-65f31ae1b704] Instance spawned successfully.
Nov 17 01:45:50 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-6c759871-c913-4c6d-8c29-87eff30ae9e2 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] [instance: b2a30d8f-1521-4d8a-b880-65f31ae1b704] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 17 01:45:50 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-6c759871-c913-4c6d-8c29-87eff30ae9e2 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] [instance: b2a30d8f-1521-4d8a-b880-65f31ae1b704] Found default for hw_cdrom_bus of ide {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:45:50 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-6c759871-c913-4c6d-8c29-87eff30ae9e2 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] [instance: b2a30d8f-1521-4d8a-b880-65f31ae1b704] Found default for hw_disk_bus of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:45:50 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-6c759871-c913-4c6d-8c29-87eff30ae9e2 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] [instance: b2a30d8f-1521-4d8a-b880-65f31ae1b704] Found default for hw_input_bus of None {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:45:50 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-6c759871-c913-4c6d-8c29-87eff30ae9e2 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] [instance: b2a30d8f-1521-4d8a-b880-65f31ae1b704] Found default for hw_pointer_model of None {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:45:50 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-6c759871-c913-4c6d-8c29-87eff30ae9e2 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] [instance: b2a30d8f-1521-4d8a-b880-65f31ae1b704] Found default for hw_video_model of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:45:50 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-6c759871-c913-4c6d-8c29-87eff30ae9e2 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] [instance: b2a30d8f-1521-4d8a-b880-65f31ae1b704] Found default for hw_vif_model of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:45:50 user nova-compute[75226]: DEBUG nova.compute.manager [req-8b07fc11-3b1b-4739-87bb-f93d1e06bb1c req-bf3951e3-de16-4758-be6e-bbc15eff65f7 service nova] [instance: b2a30d8f-1521-4d8a-b880-65f31ae1b704] Received event network-vif-plugged-f56ebc06-b6d7-4708-ade5-7627a7e7599a {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:45:50 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-8b07fc11-3b1b-4739-87bb-f93d1e06bb1c req-bf3951e3-de16-4758-be6e-bbc15eff65f7 service nova] Acquiring lock "b2a30d8f-1521-4d8a-b880-65f31ae1b704-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:45:50 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-8b07fc11-3b1b-4739-87bb-f93d1e06bb1c req-bf3951e3-de16-4758-be6e-bbc15eff65f7 service nova] Lock "b2a30d8f-1521-4d8a-b880-65f31ae1b704-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:45:50 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-8b07fc11-3b1b-4739-87bb-f93d1e06bb1c req-bf3951e3-de16-4758-be6e-bbc15eff65f7 service nova] Lock "b2a30d8f-1521-4d8a-b880-65f31ae1b704-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:45:50 user nova-compute[75226]: DEBUG nova.compute.manager [req-8b07fc11-3b1b-4739-87bb-f93d1e06bb1c req-bf3951e3-de16-4758-be6e-bbc15eff65f7 service nova] [instance: b2a30d8f-1521-4d8a-b880-65f31ae1b704] No waiting events found dispatching network-vif-plugged-f56ebc06-b6d7-4708-ade5-7627a7e7599a {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:45:50 user nova-compute[75226]: WARNING nova.compute.manager [req-8b07fc11-3b1b-4739-87bb-f93d1e06bb1c req-bf3951e3-de16-4758-be6e-bbc15eff65f7 service nova] [instance: b2a30d8f-1521-4d8a-b880-65f31ae1b704] Received unexpected event network-vif-plugged-f56ebc06-b6d7-4708-ade5-7627a7e7599a for instance with vm_state building and task_state spawning.
Nov 17 01:45:50 user nova-compute[75226]: INFO nova.compute.manager [None req-6c759871-c913-4c6d-8c29-87eff30ae9e2 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] [instance: b2a30d8f-1521-4d8a-b880-65f31ae1b704] Took 5.47 seconds to spawn the instance on the hypervisor.
Nov 17 01:45:50 user nova-compute[75226]: DEBUG nova.compute.manager [None req-6c759871-c913-4c6d-8c29-87eff30ae9e2 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] [instance: b2a30d8f-1521-4d8a-b880-65f31ae1b704] Checking state {{(pid=75226) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 01:45:50 user nova-compute[75226]: INFO nova.compute.manager [None req-6c759871-c913-4c6d-8c29-87eff30ae9e2 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] [instance: b2a30d8f-1521-4d8a-b880-65f31ae1b704] Took 6.07 seconds to build instance.
Nov 17 01:45:50 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-6c759871-c913-4c6d-8c29-87eff30ae9e2 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Lock "b2a30d8f-1521-4d8a-b880-65f31ae1b704" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.176s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:45:52 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:45:53 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:45:53 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:45:54 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:45:57 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:45:58 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:45:58 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:46:00 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:46:02 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:46:03 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:46:04 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-be5d6e86-ae9c-4782-9df6-58acd67550bc tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Acquiring lock "014533a1-a4c3-4c65-a121-f46486cc5998" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:46:04 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-be5d6e86-ae9c-4782-9df6-58acd67550bc tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Lock "014533a1-a4c3-4c65-a121-f46486cc5998" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:46:04 user nova-compute[75226]: DEBUG nova.compute.manager [None req-be5d6e86-ae9c-4782-9df6-58acd67550bc tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] [instance: 014533a1-a4c3-4c65-a121-f46486cc5998] Starting instance... {{(pid=75226) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 17 01:46:04 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-be5d6e86-ae9c-4782-9df6-58acd67550bc tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:46:04 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-be5d6e86-ae9c-4782-9df6-58acd67550bc tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:46:04 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-be5d6e86-ae9c-4782-9df6-58acd67550bc tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75226) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 17 01:46:04 user nova-compute[75226]: INFO nova.compute.claims [None req-be5d6e86-ae9c-4782-9df6-58acd67550bc tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] [instance: 014533a1-a4c3-4c65-a121-f46486cc5998] Claim successful on node user
Nov 17 01:46:05 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-be5d6e86-ae9c-4782-9df6-58acd67550bc tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:46:05 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-be5d6e86-ae9c-4782-9df6-58acd67550bc tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:46:05 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-be5d6e86-ae9c-4782-9df6-58acd67550bc tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.278s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:46:05 user nova-compute[75226]: DEBUG nova.compute.manager [None req-be5d6e86-ae9c-4782-9df6-58acd67550bc tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] [instance: 014533a1-a4c3-4c65-a121-f46486cc5998] Start building networks asynchronously for instance. {{(pid=75226) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 17 01:46:05 user nova-compute[75226]: DEBUG nova.compute.manager [None req-be5d6e86-ae9c-4782-9df6-58acd67550bc tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] [instance: 014533a1-a4c3-4c65-a121-f46486cc5998] Allocating IP information in the background. {{(pid=75226) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 17 01:46:05 user nova-compute[75226]: DEBUG nova.network.neutron [None req-be5d6e86-ae9c-4782-9df6-58acd67550bc tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] [instance: 014533a1-a4c3-4c65-a121-f46486cc5998] allocate_for_instance() {{(pid=75226) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 17 01:46:05 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-be5d6e86-ae9c-4782-9df6-58acd67550bc tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] [instance: 014533a1-a4c3-4c65-a121-f46486cc5998] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 17 01:46:05 user nova-compute[75226]: DEBUG nova.compute.manager [None req-be5d6e86-ae9c-4782-9df6-58acd67550bc tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] [instance: 014533a1-a4c3-4c65-a121-f46486cc5998] Start building block device mappings for instance. {{(pid=75226) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 17 01:46:05 user nova-compute[75226]: DEBUG nova.policy [None req-be5d6e86-ae9c-4782-9df6-58acd67550bc tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4532128d242b4121956e99fd8f7720d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c0b07ca915e4960b1e1998855e23e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75226) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 17 01:46:05 user nova-compute[75226]: DEBUG nova.compute.manager [None req-be5d6e86-ae9c-4782-9df6-58acd67550bc tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] [instance: 014533a1-a4c3-4c65-a121-f46486cc5998] Start spawning the instance on the hypervisor. {{(pid=75226) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 17 01:46:05 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-be5d6e86-ae9c-4782-9df6-58acd67550bc tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] [instance: 014533a1-a4c3-4c65-a121-f46486cc5998] Creating instance directory {{(pid=75226) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 17 01:46:05 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-be5d6e86-ae9c-4782-9df6-58acd67550bc tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] [instance: 014533a1-a4c3-4c65-a121-f46486cc5998] Creating image(s)
Nov 17 01:46:05 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-be5d6e86-ae9c-4782-9df6-58acd67550bc tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Acquiring lock "/opt/stack/data/nova/instances/014533a1-a4c3-4c65-a121-f46486cc5998/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:46:05 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-be5d6e86-ae9c-4782-9df6-58acd67550bc tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Lock "/opt/stack/data/nova/instances/014533a1-a4c3-4c65-a121-f46486cc5998/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:46:05 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-be5d6e86-ae9c-4782-9df6-58acd67550bc tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Lock "/opt/stack/data/nova/instances/014533a1-a4c3-4c65-a121-f46486cc5998/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:46:05 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-be5d6e86-ae9c-4782-9df6-58acd67550bc tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:46:05 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-be5d6e86-ae9c-4782-9df6-58acd67550bc tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json" returned: 0 in 0.168s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:46:05 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-be5d6e86-ae9c-4782-9df6-58acd67550bc tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Acquiring lock "a8a62c2546af3a2036b853250c5ac64d4c6b4371" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:46:05 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-be5d6e86-ae9c-4782-9df6-58acd67550bc tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Lock "a8a62c2546af3a2036b853250c5ac64d4c6b4371" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:46:05 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-be5d6e86-ae9c-4782-9df6-58acd67550bc tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:46:05 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-be5d6e86-ae9c-4782-9df6-58acd67550bc tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json" returned: 0 in 0.177s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:46:05 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-be5d6e86-ae9c-4782-9df6-58acd67550bc tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371,backing_fmt=raw /opt/stack/data/nova/instances/014533a1-a4c3-4c65-a121-f46486cc5998/disk 1073741824 {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:46:05 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-be5d6e86-ae9c-4782-9df6-58acd67550bc tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371,backing_fmt=raw /opt/stack/data/nova/instances/014533a1-a4c3-4c65-a121-f46486cc5998/disk 1073741824" returned: 0 in 0.077s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:46:05 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-be5d6e86-ae9c-4782-9df6-58acd67550bc tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Lock "a8a62c2546af3a2036b853250c5ac64d4c6b4371" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.262s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:46:05 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-be5d6e86-ae9c-4782-9df6-58acd67550bc tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:46:05 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-be5d6e86-ae9c-4782-9df6-58acd67550bc tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json" returned: 0 in 0.190s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:46:05 user nova-compute[75226]: DEBUG nova.virt.disk.api [None req-be5d6e86-ae9c-4782-9df6-58acd67550bc tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Checking if we can resize image /opt/stack/data/nova/instances/014533a1-a4c3-4c65-a121-f46486cc5998/disk. size=1073741824 {{(pid=75226) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 17 01:46:05 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-be5d6e86-ae9c-4782-9df6-58acd67550bc tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/014533a1-a4c3-4c65-a121-f46486cc5998/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:46:05 user nova-compute[75226]: DEBUG nova.network.neutron [None req-be5d6e86-ae9c-4782-9df6-58acd67550bc tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] [instance: 014533a1-a4c3-4c65-a121-f46486cc5998] Successfully created port: 151e4c1a-3552-45f8-a49d-049e1c629c5b {{(pid=75226) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 17 01:46:06 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-be5d6e86-ae9c-4782-9df6-58acd67550bc tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/014533a1-a4c3-4c65-a121-f46486cc5998/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:46:06 user nova-compute[75226]: DEBUG nova.virt.disk.api [None req-be5d6e86-ae9c-4782-9df6-58acd67550bc tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Cannot resize image /opt/stack/data/nova/instances/014533a1-a4c3-4c65-a121-f46486cc5998/disk to a smaller size. {{(pid=75226) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 17 01:46:06 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-be5d6e86-ae9c-4782-9df6-58acd67550bc tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] [instance: 014533a1-a4c3-4c65-a121-f46486cc5998] Created local disks {{(pid=75226) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 17 01:46:06 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-be5d6e86-ae9c-4782-9df6-58acd67550bc tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] [instance: 014533a1-a4c3-4c65-a121-f46486cc5998] Ensure instance console log exists: /opt/stack/data/nova/instances/014533a1-a4c3-4c65-a121-f46486cc5998/console.log {{(pid=75226) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 17 01:46:06 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-be5d6e86-ae9c-4782-9df6-58acd67550bc tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:46:06 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-be5d6e86-ae9c-4782-9df6-58acd67550bc tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:46:06 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-be5d6e86-ae9c-4782-9df6-58acd67550bc tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:46:06 user nova-compute[75226]: DEBUG nova.network.neutron [None req-be5d6e86-ae9c-4782-9df6-58acd67550bc tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] [instance: 014533a1-a4c3-4c65-a121-f46486cc5998] Successfully updated port: 151e4c1a-3552-45f8-a49d-049e1c629c5b {{(pid=75226) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 17 01:46:06 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-be5d6e86-ae9c-4782-9df6-58acd67550bc tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Acquiring lock "refresh_cache-014533a1-a4c3-4c65-a121-f46486cc5998" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:46:06 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-be5d6e86-ae9c-4782-9df6-58acd67550bc tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Acquired lock "refresh_cache-014533a1-a4c3-4c65-a121-f46486cc5998" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:46:06 user nova-compute[75226]: DEBUG nova.network.neutron [None req-be5d6e86-ae9c-4782-9df6-58acd67550bc tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] [instance: 014533a1-a4c3-4c65-a121-f46486cc5998] Building network info cache for instance {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 01:46:06 user nova-compute[75226]: DEBUG nova.compute.manager [req-b7e6a405-68e4-4819-b576-9e9431530ebc req-32409697-3a6a-4e86-bcf1-4af7ace70db1 service nova] [instance: 014533a1-a4c3-4c65-a121-f46486cc5998] Received event network-changed-151e4c1a-3552-45f8-a49d-049e1c629c5b {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:46:06 user nova-compute[75226]: DEBUG nova.compute.manager [req-b7e6a405-68e4-4819-b576-9e9431530ebc req-32409697-3a6a-4e86-bcf1-4af7ace70db1 service nova] [instance: 014533a1-a4c3-4c65-a121-f46486cc5998] Refreshing instance network info cache due to event network-changed-151e4c1a-3552-45f8-a49d-049e1c629c5b. {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 01:46:06 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-b7e6a405-68e4-4819-b576-9e9431530ebc req-32409697-3a6a-4e86-bcf1-4af7ace70db1 service nova] Acquiring lock "refresh_cache-014533a1-a4c3-4c65-a121-f46486cc5998" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:46:06 user nova-compute[75226]: DEBUG nova.network.neutron [None req-be5d6e86-ae9c-4782-9df6-58acd67550bc tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] [instance: 014533a1-a4c3-4c65-a121-f46486cc5998] Instance cache missing network info. {{(pid=75226) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 17 01:46:07 user nova-compute[75226]: DEBUG nova.network.neutron [None req-be5d6e86-ae9c-4782-9df6-58acd67550bc tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] [instance: 014533a1-a4c3-4c65-a121-f46486cc5998] Updating instance_info_cache with network_info: [{"id": "151e4c1a-3552-45f8-a49d-049e1c629c5b", "address": "fa:16:3e:35:6c:13", "network": {"id": "a1d04537-c0d6-46a4-bce4-de3bb5e89921", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-813941300-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c0b07ca915e4960b1e1998855e23e5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap151e4c1a-35", "ovs_interfaceid": "151e4c1a-3552-45f8-a49d-049e1c629c5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:46:07 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-be5d6e86-ae9c-4782-9df6-58acd67550bc tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Releasing lock "refresh_cache-014533a1-a4c3-4c65-a121-f46486cc5998" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:46:07 user nova-compute[75226]: DEBUG nova.compute.manager [None req-be5d6e86-ae9c-4782-9df6-58acd67550bc tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] [instance: 014533a1-a4c3-4c65-a121-f46486cc5998] Instance network_info: |[{"id": "151e4c1a-3552-45f8-a49d-049e1c629c5b", "address": "fa:16:3e:35:6c:13", "network": {"id": "a1d04537-c0d6-46a4-bce4-de3bb5e89921", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-813941300-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c0b07ca915e4960b1e1998855e23e5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap151e4c1a-35", "ovs_interfaceid": "151e4c1a-3552-45f8-a49d-049e1c629c5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75226) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 17 01:46:07 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-b7e6a405-68e4-4819-b576-9e9431530ebc req-32409697-3a6a-4e86-bcf1-4af7ace70db1 service nova] Acquired lock "refresh_cache-014533a1-a4c3-4c65-a121-f46486cc5998" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:46:07 user nova-compute[75226]: DEBUG nova.network.neutron [req-b7e6a405-68e4-4819-b576-9e9431530ebc req-32409697-3a6a-4e86-bcf1-4af7ace70db1 service nova] [instance: 014533a1-a4c3-4c65-a121-f46486cc5998] Refreshing network info cache for port 151e4c1a-3552-45f8-a49d-049e1c629c5b {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 01:46:07 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-be5d6e86-ae9c-4782-9df6-58acd67550bc tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] [instance: 014533a1-a4c3-4c65-a121-f46486cc5998] Start _get_guest_xml network_info=[{"id": "151e4c1a-3552-45f8-a49d-049e1c629c5b", "address": "fa:16:3e:35:6c:13", "network": {"id": "a1d04537-c0d6-46a4-bce4-de3bb5e89921", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-813941300-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c0b07ca915e4960b1e1998855e23e5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap151e4c1a-35", "ovs_interfaceid": "151e4c1a-3552-45f8-a49d-049e1c629c5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T01:13:22Z,direct_url=<?>,disk_format='qcow2',id=0b369aea-6f3f-4690-9f01-229b90ab6310,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4e110cbf9a84362a6864a7732c435a1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T01:13:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '0b369aea-6f3f-4690-9f01-229b90ab6310'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75226) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 17 01:46:07 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-be5d6e86-ae9c-4782-9df6-58acd67550bc tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:46:07 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-be5d6e86-ae9c-4782-9df6-58acd67550bc tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:46:07 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-be5d6e86-ae9c-4782-9df6-58acd67550bc tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75226) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 17 01:46:07 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-be5d6e86-ae9c-4782-9df6-58acd67550bc tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] CPU controller missing on host. {{(pid=75226) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 17 01:46:07 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-be5d6e86-ae9c-4782-9df6-58acd67550bc tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75226) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 17 01:46:07 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-be5d6e86-ae9c-4782-9df6-58acd67550bc tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] CPU controller found on host. {{(pid=75226) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 17 01:46:07 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-be5d6e86-ae9c-4782-9df6-58acd67550bc tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75226) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 17 01:46:07 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-be5d6e86-ae9c-4782-9df6-58acd67550bc tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-17T01:13:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T01:13:22Z,direct_url=<?>,disk_format='qcow2',id=0b369aea-6f3f-4690-9f01-229b90ab6310,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4e110cbf9a84362a6864a7732c435a1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T01:13:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 17 01:46:07 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-be5d6e86-ae9c-4782-9df6-58acd67550bc tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Flavor limits 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 17 01:46:07 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-be5d6e86-ae9c-4782-9df6-58acd67550bc tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Image limits 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 17 01:46:07 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-be5d6e86-ae9c-4782-9df6-58acd67550bc tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Flavor pref 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 17 01:46:07 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-be5d6e86-ae9c-4782-9df6-58acd67550bc tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Image pref 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 17 01:46:07 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-be5d6e86-ae9c-4782-9df6-58acd67550bc tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 17 01:46:07 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-be5d6e86-ae9c-4782-9df6-58acd67550bc tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 17 01:46:07 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-be5d6e86-ae9c-4782-9df6-58acd67550bc tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75226) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 17 01:46:07 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-be5d6e86-ae9c-4782-9df6-58acd67550bc tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Got 1 possible topologies {{(pid=75226) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 17 01:46:07 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-be5d6e86-ae9c-4782-9df6-58acd67550bc tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 17 01:46:07 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-be5d6e86-ae9c-4782-9df6-58acd67550bc tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 17 01:46:07 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-be5d6e86-ae9c-4782-9df6-58acd67550bc tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:46:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-278216686',display_name='tempest-SnapshotDataIntegrityTests-server-278216686',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-278216686',id=47,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFmnzljMhFPsBQuVT/xvyDJK9w7hCQb/H9UqU2lwq3tOjMTUcbue1yooGcjf/XjlwgVuHUG6igC8IPoeqWr95z6ERrjmn60cVjDp2gwXaXgxh11JBbWeVgc45y0vXxxtjg==',key_name='tempest-keypair-653694136',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5c0b07ca915e4960b1e1998855e23e5c',ramdisk_id='',reservation_id='r-4ia0l00d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1627794135',owner_user_name='tempest-SnapshotDataIntegrityTests-1627794135-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T01:46:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4532128d242b4121956e99fd8f7720d8',uuid=014533a1-a4c3-4c65-a121-f46486cc5998,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "151e4c1a-3552-45f8-a49d-049e1c629c5b", "address": "fa:16:3e:35:6c:13", "network": {"id": "a1d04537-c0d6-46a4-bce4-de3bb5e89921", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-813941300-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c0b07ca915e4960b1e1998855e23e5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap151e4c1a-35", "ovs_interfaceid": "151e4c1a-3552-45f8-a49d-049e1c629c5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75226) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 01:46:07 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-be5d6e86-ae9c-4782-9df6-58acd67550bc tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Converting VIF {"id": "151e4c1a-3552-45f8-a49d-049e1c629c5b", "address": "fa:16:3e:35:6c:13", "network": {"id": "a1d04537-c0d6-46a4-bce4-de3bb5e89921", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-813941300-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c0b07ca915e4960b1e1998855e23e5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap151e4c1a-35", "ovs_interfaceid": "151e4c1a-3552-45f8-a49d-049e1c629c5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:46:07 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-be5d6e86-ae9c-4782-9df6-58acd67550bc tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:6c:13,bridge_name='br-int',has_traffic_filtering=True,id=151e4c1a-3552-45f8-a49d-049e1c629c5b,network=Network(a1d04537-c0d6-46a4-bce4-de3bb5e89921),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap151e4c1a-35') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:46:07 user nova-compute[75226]: DEBUG nova.objects.instance [None req-be5d6e86-ae9c-4782-9df6-58acd67550bc tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Lazy-loading 'pci_devices' on Instance uuid 014533a1-a4c3-4c65-a121-f46486cc5998 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:46:07 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:46:07 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-be5d6e86-ae9c-4782-9df6-58acd67550bc tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] [instance: 014533a1-a4c3-4c65-a121-f46486cc5998] End _get_guest_xml xml=<domain type="kvm">
Nov 17 01:46:07 user nova-compute[75226]:   <uuid>014533a1-a4c3-4c65-a121-f46486cc5998</uuid>
Nov 17 01:46:07 user nova-compute[75226]:   <name>instance-0000002f</name>
Nov 17 01:46:07 user nova-compute[75226]:   <memory>524288</memory>
Nov 17 01:46:07 user nova-compute[75226]:   <vcpu>1</vcpu>
Nov 17 01:46:07 user nova-compute[75226]:   <metadata>
Nov 17 01:46:07 user nova-compute[75226]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 17 01:46:07 user nova-compute[75226]:       <nova:package version="0.0.0"/>
Nov 17 01:46:07 user nova-compute[75226]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-278216686</nova:name>
Nov 17 01:46:07 user nova-compute[75226]:       <nova:creationTime>2023-11-17 01:46:07</nova:creationTime>
Nov 17 01:46:07 user nova-compute[75226]:       <nova:flavor name="m1.tiny">
Nov 17 01:46:07 user nova-compute[75226]:         <nova:memory>512</nova:memory>
Nov 17 01:46:07 user nova-compute[75226]:         <nova:disk>1</nova:disk>
Nov 17 01:46:07 user nova-compute[75226]:         <nova:swap>0</nova:swap>
Nov 17 01:46:07 user nova-compute[75226]:         <nova:ephemeral>0</nova:ephemeral>
Nov 17 01:46:07 user nova-compute[75226]:         <nova:vcpus>1</nova:vcpus>
Nov 17 01:46:07 user nova-compute[75226]:       </nova:flavor>
Nov 17 01:46:07 user nova-compute[75226]:       <nova:owner>
Nov 17 01:46:07 user nova-compute[75226]:         <nova:user uuid="4532128d242b4121956e99fd8f7720d8">tempest-SnapshotDataIntegrityTests-1627794135-project-member</nova:user>
Nov 17 01:46:07 user nova-compute[75226]:         <nova:project uuid="5c0b07ca915e4960b1e1998855e23e5c">tempest-SnapshotDataIntegrityTests-1627794135</nova:project>
Nov 17 01:46:07 user nova-compute[75226]:       </nova:owner>
Nov 17 01:46:07 user nova-compute[75226]:       <nova:root type="image" uuid="0b369aea-6f3f-4690-9f01-229b90ab6310"/>
Nov 17 01:46:07 user nova-compute[75226]:       <nova:ports>
Nov 17 01:46:07 user nova-compute[75226]:         <nova:port uuid="151e4c1a-3552-45f8-a49d-049e1c629c5b">
Nov 17 01:46:07 user nova-compute[75226]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 17 01:46:07 user nova-compute[75226]:         </nova:port>
Nov 17 01:46:07 user nova-compute[75226]:       </nova:ports>
Nov 17 01:46:07 user nova-compute[75226]:     </nova:instance>
Nov 17 01:46:07 user nova-compute[75226]:   </metadata>
Nov 17 01:46:07 user nova-compute[75226]:   <sysinfo type="smbios">
Nov 17 01:46:07 user nova-compute[75226]:     <system>
Nov 17 01:46:07 user nova-compute[75226]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 17 01:46:07 user nova-compute[75226]:       <entry name="product">OpenStack Nova</entry>
Nov 17 01:46:07 user nova-compute[75226]:       <entry name="version">0.0.0</entry>
Nov 17 01:46:07 user nova-compute[75226]:       <entry name="serial">014533a1-a4c3-4c65-a121-f46486cc5998</entry>
Nov 17 01:46:07 user nova-compute[75226]:       <entry name="uuid">014533a1-a4c3-4c65-a121-f46486cc5998</entry>
Nov 17 01:46:07 user nova-compute[75226]:       <entry name="family">Virtual Machine</entry>
Nov 17 01:46:07 user nova-compute[75226]:     </system>
Nov 17 01:46:07 user nova-compute[75226]:   </sysinfo>
Nov 17 01:46:07 user nova-compute[75226]:   <os>
Nov 17 01:46:07 user nova-compute[75226]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 17 01:46:07 user nova-compute[75226]:     <boot dev="hd"/>
Nov 17 01:46:07 user nova-compute[75226]:     <smbios mode="sysinfo"/>
Nov 17 01:46:07 user nova-compute[75226]:   </os>
Nov 17 01:46:07 user nova-compute[75226]:   <features>
Nov 17 01:46:07 user nova-compute[75226]:     <acpi/>
Nov 17 01:46:07 user nova-compute[75226]:     <apic/>
Nov 17 01:46:07 user nova-compute[75226]:     <vmcoreinfo/>
Nov 17 01:46:07 user nova-compute[75226]:   </features>
Nov 17 01:46:07 user nova-compute[75226]:   <clock offset="utc">
Nov 17 01:46:07 user nova-compute[75226]:     <timer name="pit" tickpolicy="delay"/>
Nov 17 01:46:07 user nova-compute[75226]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 17 01:46:07 user nova-compute[75226]:     <timer name="hpet" present="no"/>
Nov 17 01:46:07 user nova-compute[75226]:   </clock>
Nov 17 01:46:07 user nova-compute[75226]:   <cpu mode="custom" match="exact">
Nov 17 01:46:07 user nova-compute[75226]:     <model>Nehalem</model>
Nov 17 01:46:07 user nova-compute[75226]:     <topology sockets="1" cores="1" threads="1"/>
Nov 17 01:46:07 user nova-compute[75226]:   </cpu>
Nov 17 01:46:07 user nova-compute[75226]:   <devices>
Nov 17 01:46:07 user nova-compute[75226]:     <disk type="file" device="disk">
Nov 17 01:46:07 user nova-compute[75226]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 17 01:46:07 user nova-compute[75226]:       <source file="/opt/stack/data/nova/instances/014533a1-a4c3-4c65-a121-f46486cc5998/disk"/>
Nov 17 01:46:07 user nova-compute[75226]:       <target dev="vda" bus="virtio"/>
Nov 17 01:46:07 user nova-compute[75226]:     </disk>
Nov 17 01:46:07 user nova-compute[75226]:     <interface type="ethernet">
Nov 17 01:46:07 user nova-compute[75226]:       <mac address="fa:16:3e:35:6c:13"/>
Nov 17 01:46:07 user nova-compute[75226]:       <model type="virtio"/>
Nov 17 01:46:07 user nova-compute[75226]:       <mtu size="1442"/>
Nov 17 01:46:07 user nova-compute[75226]:       <target dev="tap151e4c1a-35"/>
Nov 17 01:46:07 user nova-compute[75226]:     </interface>
Nov 17 01:46:07 user nova-compute[75226]:     <serial type="pty">
Nov 17 01:46:07 user nova-compute[75226]:       <log file="/opt/stack/data/nova/instances/014533a1-a4c3-4c65-a121-f46486cc5998/console.log" append="off"/>
Nov 17 01:46:07 user nova-compute[75226]:     </serial>
Nov 17 01:46:07 user nova-compute[75226]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 17 01:46:07 user nova-compute[75226]:     <video>
Nov 17 01:46:07 user nova-compute[75226]:       <model type="virtio"/>
Nov 17 01:46:07 user nova-compute[75226]:     </video>
Nov 17 01:46:07 user nova-compute[75226]:     <rng model="virtio">
Nov 17 01:46:07 user nova-compute[75226]:       <backend model="random">/dev/urandom</backend>
Nov 17 01:46:07 user nova-compute[75226]:     </rng>
Nov 17 01:46:07 user nova-compute[75226]:     <controller type="usb" index="0" model="none"/>
Nov 17 01:46:07 user nova-compute[75226]:     <memballoon model="virtio">
Nov 17 01:46:07 user nova-compute[75226]:       <stats period="10"/>
Nov 17 01:46:07 user nova-compute[75226]:     </memballoon>
Nov 17 01:46:07 user nova-compute[75226]:   </devices>
Nov 17 01:46:07 user nova-compute[75226]: </domain>
Nov 17 01:46:07 user nova-compute[75226]:  {{(pid=75226) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 17 01:46:07 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-be5d6e86-ae9c-4782-9df6-58acd67550bc tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:46:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-278216686',display_name='tempest-SnapshotDataIntegrityTests-server-278216686',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-278216686',id=47,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFmnzljMhFPsBQuVT/xvyDJK9w7hCQb/H9UqU2lwq3tOjMTUcbue1yooGcjf/XjlwgVuHUG6igC8IPoeqWr95z6ERrjmn60cVjDp2gwXaXgxh11JBbWeVgc45y0vXxxtjg==',key_name='tempest-keypair-653694136',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5c0b07ca915e4960b1e1998855e23e5c',ramdisk_id='',reservation_id='r-4ia0l00d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1627794135',owner_user_name='tempest-SnapshotDataIntegrityTests-1627794135-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T01:46:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4532128d242b4121956e99fd8f7720d8',uuid=014533a1-a4c3-4c65-a121-f46486cc5998,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "151e4c1a-3552-45f8-a49d-049e1c629c5b", "address": "fa:16:3e:35:6c:13", "network": {"id": "a1d04537-c0d6-46a4-bce4-de3bb5e89921", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-813941300-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c0b07ca915e4960b1e1998855e23e5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap151e4c1a-35", "ovs_interfaceid": "151e4c1a-3552-45f8-a49d-049e1c629c5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 17 01:46:07 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-be5d6e86-ae9c-4782-9df6-58acd67550bc tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Converting VIF {"id": "151e4c1a-3552-45f8-a49d-049e1c629c5b", "address": "fa:16:3e:35:6c:13", "network": {"id": "a1d04537-c0d6-46a4-bce4-de3bb5e89921", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-813941300-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c0b07ca915e4960b1e1998855e23e5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap151e4c1a-35", "ovs_interfaceid": "151e4c1a-3552-45f8-a49d-049e1c629c5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:46:07 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-be5d6e86-ae9c-4782-9df6-58acd67550bc tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:6c:13,bridge_name='br-int',has_traffic_filtering=True,id=151e4c1a-3552-45f8-a49d-049e1c629c5b,network=Network(a1d04537-c0d6-46a4-bce4-de3bb5e89921),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap151e4c1a-35') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:46:07 user nova-compute[75226]: DEBUG os_vif [None req-be5d6e86-ae9c-4782-9df6-58acd67550bc tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:6c:13,bridge_name='br-int',has_traffic_filtering=True,id=151e4c1a-3552-45f8-a49d-049e1c629c5b,network=Network(a1d04537-c0d6-46a4-bce4-de3bb5e89921),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap151e4c1a-35') {{(pid=75226) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 17 01:46:07 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:46:07 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:46:07 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 17 01:46:07 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:46:07 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0b23859b-76ce-5e40-aba6-89e7a64d8b74', '_type': 'linux-noop'}}, row=False) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:46:07 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:46:07 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:46:07 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:46:07 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap151e4c1a-35, may_exist=True, interface_attrs={}) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:46:07 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap151e4c1a-35, col_values=(('qos', UUID('6ad5d16f-fb66-4604-80ed-b45ba5f6cb3b')),), if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:46:07 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap151e4c1a-35, col_values=(('external_ids', {'iface-id': '151e4c1a-3552-45f8-a49d-049e1c629c5b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:35:6c:13', 'vm-uuid': '014533a1-a4c3-4c65-a121-f46486cc5998'}),), if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:46:07 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:46:07 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:46:07 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:46:07 user nova-compute[75226]: INFO os_vif [None req-be5d6e86-ae9c-4782-9df6-58acd67550bc tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:6c:13,bridge_name='br-int',has_traffic_filtering=True,id=151e4c1a-3552-45f8-a49d-049e1c629c5b,network=Network(a1d04537-c0d6-46a4-bce4-de3bb5e89921),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap151e4c1a-35')
Nov 17 01:46:07 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-be5d6e86-ae9c-4782-9df6-58acd67550bc tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] No BDM found with device name vda, not building metadata. {{(pid=75226) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 01:46:07 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-be5d6e86-ae9c-4782-9df6-58acd67550bc tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] No VIF found with MAC fa:16:3e:35:6c:13, not building metadata {{(pid=75226) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 01:46:07 user nova-compute[75226]: DEBUG nova.network.neutron [req-b7e6a405-68e4-4819-b576-9e9431530ebc req-32409697-3a6a-4e86-bcf1-4af7ace70db1 service nova] [instance: 014533a1-a4c3-4c65-a121-f46486cc5998] Updated VIF entry in instance network info cache for port 151e4c1a-3552-45f8-a49d-049e1c629c5b. {{(pid=75226) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 01:46:07 user nova-compute[75226]: DEBUG nova.network.neutron [req-b7e6a405-68e4-4819-b576-9e9431530ebc req-32409697-3a6a-4e86-bcf1-4af7ace70db1 service nova] [instance: 014533a1-a4c3-4c65-a121-f46486cc5998] Updating instance_info_cache with network_info: [{"id": "151e4c1a-3552-45f8-a49d-049e1c629c5b", "address": "fa:16:3e:35:6c:13", "network": {"id": "a1d04537-c0d6-46a4-bce4-de3bb5e89921", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-813941300-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c0b07ca915e4960b1e1998855e23e5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap151e4c1a-35", "ovs_interfaceid": "151e4c1a-3552-45f8-a49d-049e1c629c5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:46:07 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-b7e6a405-68e4-4819-b576-9e9431530ebc req-32409697-3a6a-4e86-bcf1-4af7ace70db1 service nova] Releasing lock "refresh_cache-014533a1-a4c3-4c65-a121-f46486cc5998" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:46:08 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:46:08 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:46:08 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:46:08 user nova-compute[75226]: DEBUG nova.compute.manager [req-adc62eda-ff02-45fb-b791-84e7f9cf2c67 req-864a84dc-c949-41d4-87eb-9618ab383c0b service nova] [instance: 014533a1-a4c3-4c65-a121-f46486cc5998] Received event network-vif-plugged-151e4c1a-3552-45f8-a49d-049e1c629c5b {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:46:08 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-adc62eda-ff02-45fb-b791-84e7f9cf2c67 req-864a84dc-c949-41d4-87eb-9618ab383c0b service nova] Acquiring lock "014533a1-a4c3-4c65-a121-f46486cc5998-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:46:08 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-adc62eda-ff02-45fb-b791-84e7f9cf2c67 req-864a84dc-c949-41d4-87eb-9618ab383c0b service nova] Lock "014533a1-a4c3-4c65-a121-f46486cc5998-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:46:08 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-adc62eda-ff02-45fb-b791-84e7f9cf2c67 req-864a84dc-c949-41d4-87eb-9618ab383c0b service nova] Lock "014533a1-a4c3-4c65-a121-f46486cc5998-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:46:08 user nova-compute[75226]: DEBUG nova.compute.manager [req-adc62eda-ff02-45fb-b791-84e7f9cf2c67 req-864a84dc-c949-41d4-87eb-9618ab383c0b service nova] [instance: 014533a1-a4c3-4c65-a121-f46486cc5998] No waiting events found dispatching network-vif-plugged-151e4c1a-3552-45f8-a49d-049e1c629c5b {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:46:08 user nova-compute[75226]: WARNING nova.compute.manager [req-adc62eda-ff02-45fb-b791-84e7f9cf2c67 req-864a84dc-c949-41d4-87eb-9618ab383c0b service nova] [instance: 014533a1-a4c3-4c65-a121-f46486cc5998] Received unexpected event network-vif-plugged-151e4c1a-3552-45f8-a49d-049e1c629c5b for instance with vm_state building and task_state spawning.
Nov 17 01:46:09 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:46:09 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:46:09 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:46:09 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:46:10 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-97afeed5-b165-46e0-8a4f-3d320f8ece7b tempest-VolumesActionsTest-1992288685 tempest-VolumesActionsTest-1992288685-project-member] Acquiring lock "6a1d76ca-5fd1-4ee6-81f2-b53d280ff585" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:46:10 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-97afeed5-b165-46e0-8a4f-3d320f8ece7b tempest-VolumesActionsTest-1992288685 tempest-VolumesActionsTest-1992288685-project-member] Lock "6a1d76ca-5fd1-4ee6-81f2-b53d280ff585" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:46:10 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-97afeed5-b165-46e0-8a4f-3d320f8ece7b tempest-VolumesActionsTest-1992288685 tempest-VolumesActionsTest-1992288685-project-member] Acquiring lock "6a1d76ca-5fd1-4ee6-81f2-b53d280ff585-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:46:10 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-97afeed5-b165-46e0-8a4f-3d320f8ece7b tempest-VolumesActionsTest-1992288685 tempest-VolumesActionsTest-1992288685-project-member] Lock "6a1d76ca-5fd1-4ee6-81f2-b53d280ff585-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:46:10 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-97afeed5-b165-46e0-8a4f-3d320f8ece7b tempest-VolumesActionsTest-1992288685 tempest-VolumesActionsTest-1992288685-project-member] Lock "6a1d76ca-5fd1-4ee6-81f2-b53d280ff585-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:46:10 user nova-compute[75226]: INFO nova.compute.manager [None req-97afeed5-b165-46e0-8a4f-3d320f8ece7b tempest-VolumesActionsTest-1992288685 tempest-VolumesActionsTest-1992288685-project-member] [instance: 6a1d76ca-5fd1-4ee6-81f2-b53d280ff585] Terminating instance
Nov 17 01:46:10 user nova-compute[75226]: DEBUG nova.compute.manager [None req-97afeed5-b165-46e0-8a4f-3d320f8ece7b tempest-VolumesActionsTest-1992288685 tempest-VolumesActionsTest-1992288685-project-member] [instance: 6a1d76ca-5fd1-4ee6-81f2-b53d280ff585] Start destroying the instance on the hypervisor. {{(pid=75226) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 17 01:46:10 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:46:10 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:46:10 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:46:10 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:46:10 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:46:10 user nova-compute[75226]: DEBUG nova.compute.manager [req-a17a46dd-a7b2-4a20-9562-73342793bdbc req-b66a189b-c384-46db-9c2a-ac0dd6e7fdd0 service nova] [instance: 6a1d76ca-5fd1-4ee6-81f2-b53d280ff585] Received event network-vif-unplugged-eca93def-9c12-4775-a4c6-b164bf978201 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:46:10 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-a17a46dd-a7b2-4a20-9562-73342793bdbc req-b66a189b-c384-46db-9c2a-ac0dd6e7fdd0 service nova] Acquiring lock "6a1d76ca-5fd1-4ee6-81f2-b53d280ff585-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:46:10 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-a17a46dd-a7b2-4a20-9562-73342793bdbc req-b66a189b-c384-46db-9c2a-ac0dd6e7fdd0 service nova] Lock "6a1d76ca-5fd1-4ee6-81f2-b53d280ff585-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:46:10 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-a17a46dd-a7b2-4a20-9562-73342793bdbc req-b66a189b-c384-46db-9c2a-ac0dd6e7fdd0 service nova] Lock "6a1d76ca-5fd1-4ee6-81f2-b53d280ff585-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:46:10 user nova-compute[75226]: DEBUG nova.compute.manager [req-a17a46dd-a7b2-4a20-9562-73342793bdbc req-b66a189b-c384-46db-9c2a-ac0dd6e7fdd0 service nova] [instance: 6a1d76ca-5fd1-4ee6-81f2-b53d280ff585] No waiting events found dispatching network-vif-unplugged-eca93def-9c12-4775-a4c6-b164bf978201 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:46:10 user nova-compute[75226]: DEBUG nova.compute.manager [req-a17a46dd-a7b2-4a20-9562-73342793bdbc req-b66a189b-c384-46db-9c2a-ac0dd6e7fdd0 service nova] [instance: 6a1d76ca-5fd1-4ee6-81f2-b53d280ff585] Received event network-vif-unplugged-eca93def-9c12-4775-a4c6-b164bf978201 for instance with task_state deleting. {{(pid=75226) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 17 01:46:10 user nova-compute[75226]: DEBUG nova.compute.manager [None req-be5d6e86-ae9c-4782-9df6-58acd67550bc tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] [instance: 014533a1-a4c3-4c65-a121-f46486cc5998] Instance event wait completed in 0 seconds for  {{(pid=75226) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 17 01:46:10 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-be5d6e86-ae9c-4782-9df6-58acd67550bc tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] [instance: 014533a1-a4c3-4c65-a121-f46486cc5998] Guest created on hypervisor {{(pid=75226) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 17 01:46:10 user nova-compute[75226]: INFO nova.virt.libvirt.driver [-] [instance: 014533a1-a4c3-4c65-a121-f46486cc5998] Instance spawned successfully.
Nov 17 01:46:10 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-be5d6e86-ae9c-4782-9df6-58acd67550bc tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] [instance: 014533a1-a4c3-4c65-a121-f46486cc5998] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 17 01:46:10 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-be5d6e86-ae9c-4782-9df6-58acd67550bc tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] [instance: 014533a1-a4c3-4c65-a121-f46486cc5998] Found default for hw_cdrom_bus of ide {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:46:10 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-be5d6e86-ae9c-4782-9df6-58acd67550bc tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] [instance: 014533a1-a4c3-4c65-a121-f46486cc5998] Found default for hw_disk_bus of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:46:10 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-be5d6e86-ae9c-4782-9df6-58acd67550bc tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] [instance: 014533a1-a4c3-4c65-a121-f46486cc5998] Found default for hw_input_bus of None {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:46:10 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-be5d6e86-ae9c-4782-9df6-58acd67550bc tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] [instance: 014533a1-a4c3-4c65-a121-f46486cc5998] Found default for hw_pointer_model of None {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:46:10 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-be5d6e86-ae9c-4782-9df6-58acd67550bc tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] [instance: 014533a1-a4c3-4c65-a121-f46486cc5998] Found default for hw_video_model of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:46:10 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-be5d6e86-ae9c-4782-9df6-58acd67550bc tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] [instance: 014533a1-a4c3-4c65-a121-f46486cc5998] Found default for hw_vif_model of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:46:10 user nova-compute[75226]: DEBUG nova.compute.manager [req-bbb6c8be-489d-4f89-804c-0c501a8fe6b9 req-88e230e0-8ceb-4d4b-846a-39b624cd8c0f service nova] [instance: 014533a1-a4c3-4c65-a121-f46486cc5998] Received event network-vif-plugged-151e4c1a-3552-45f8-a49d-049e1c629c5b {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:46:10 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-bbb6c8be-489d-4f89-804c-0c501a8fe6b9 req-88e230e0-8ceb-4d4b-846a-39b624cd8c0f service nova] Acquiring lock "014533a1-a4c3-4c65-a121-f46486cc5998-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:46:10 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-bbb6c8be-489d-4f89-804c-0c501a8fe6b9 req-88e230e0-8ceb-4d4b-846a-39b624cd8c0f service nova] Lock "014533a1-a4c3-4c65-a121-f46486cc5998-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:46:10 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-bbb6c8be-489d-4f89-804c-0c501a8fe6b9 req-88e230e0-8ceb-4d4b-846a-39b624cd8c0f service nova] Lock "014533a1-a4c3-4c65-a121-f46486cc5998-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:46:10 user nova-compute[75226]: DEBUG nova.compute.manager [req-bbb6c8be-489d-4f89-804c-0c501a8fe6b9 req-88e230e0-8ceb-4d4b-846a-39b624cd8c0f service nova] [instance: 014533a1-a4c3-4c65-a121-f46486cc5998] No waiting events found dispatching network-vif-plugged-151e4c1a-3552-45f8-a49d-049e1c629c5b {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:46:10 user nova-compute[75226]: WARNING nova.compute.manager [req-bbb6c8be-489d-4f89-804c-0c501a8fe6b9 req-88e230e0-8ceb-4d4b-846a-39b624cd8c0f service nova] [instance: 014533a1-a4c3-4c65-a121-f46486cc5998] Received unexpected event network-vif-plugged-151e4c1a-3552-45f8-a49d-049e1c629c5b for instance with vm_state building and task_state spawning.
Nov 17 01:46:10 user nova-compute[75226]: INFO nova.compute.manager [None req-be5d6e86-ae9c-4782-9df6-58acd67550bc tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] [instance: 014533a1-a4c3-4c65-a121-f46486cc5998] Took 5.55 seconds to spawn the instance on the hypervisor.
Nov 17 01:46:10 user nova-compute[75226]: DEBUG nova.compute.manager [None req-be5d6e86-ae9c-4782-9df6-58acd67550bc tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] [instance: 014533a1-a4c3-4c65-a121-f46486cc5998] Checking state {{(pid=75226) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 01:46:10 user nova-compute[75226]: INFO nova.compute.manager [None req-be5d6e86-ae9c-4782-9df6-58acd67550bc tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] [instance: 014533a1-a4c3-4c65-a121-f46486cc5998] Took 6.17 seconds to build instance.
Nov 17 01:46:11 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-be5d6e86-ae9c-4782-9df6-58acd67550bc tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Lock "014533a1-a4c3-4c65-a121-f46486cc5998" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.288s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:46:11 user nova-compute[75226]: INFO nova.virt.libvirt.driver [-] [instance: 6a1d76ca-5fd1-4ee6-81f2-b53d280ff585] Instance destroyed successfully.
Nov 17 01:46:11 user nova-compute[75226]: DEBUG nova.objects.instance [None req-97afeed5-b165-46e0-8a4f-3d320f8ece7b tempest-VolumesActionsTest-1992288685 tempest-VolumesActionsTest-1992288685-project-member] Lazy-loading 'resources' on Instance uuid 6a1d76ca-5fd1-4ee6-81f2-b53d280ff585 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:46:11 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-97afeed5-b165-46e0-8a4f-3d320f8ece7b tempest-VolumesActionsTest-1992288685 tempest-VolumesActionsTest-1992288685-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:44:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1085221871',display_name='tempest-VolumesActionsTest-instance-1085221871',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1085221871',id=44,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-17T01:44:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c42506c594c046d798038309be22e08e',ramdisk_id='',reservation_id='r-kysfoovz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1992288685',owner_user_name='tempest-VolumesActionsTest-1992288685-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T01:44:19Z,user_data=None,user_id='69b47debb71a4d78b446d49e268510dc',uuid=6a1d76ca-5fd1-4ee6-81f2-b53d280ff585,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eca93def-9c12-4775-a4c6-b164bf978201", "address": "fa:16:3e:d4:0e:ae", "network": {"id": "dee2fba9-707e-414a-bb61-ecc82be66882", "bridge": "br-int", "label": "tempest-VolumesActionsTest-439671361-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c42506c594c046d798038309be22e08e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeca93def-9c", "ovs_interfaceid": "eca93def-9c12-4775-a4c6-b164bf978201", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 17 01:46:11 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-97afeed5-b165-46e0-8a4f-3d320f8ece7b tempest-VolumesActionsTest-1992288685 tempest-VolumesActionsTest-1992288685-project-member] Converting VIF {"id": "eca93def-9c12-4775-a4c6-b164bf978201", "address": "fa:16:3e:d4:0e:ae", "network": {"id": "dee2fba9-707e-414a-bb61-ecc82be66882", "bridge": "br-int", "label": "tempest-VolumesActionsTest-439671361-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c42506c594c046d798038309be22e08e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeca93def-9c", "ovs_interfaceid": "eca93def-9c12-4775-a4c6-b164bf978201", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:46:11 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-97afeed5-b165-46e0-8a4f-3d320f8ece7b tempest-VolumesActionsTest-1992288685 tempest-VolumesActionsTest-1992288685-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:0e:ae,bridge_name='br-int',has_traffic_filtering=True,id=eca93def-9c12-4775-a4c6-b164bf978201,network=Network(dee2fba9-707e-414a-bb61-ecc82be66882),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeca93def-9c') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:46:11 user nova-compute[75226]: DEBUG os_vif [None req-97afeed5-b165-46e0-8a4f-3d320f8ece7b tempest-VolumesActionsTest-1992288685 tempest-VolumesActionsTest-1992288685-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:0e:ae,bridge_name='br-int',has_traffic_filtering=True,id=eca93def-9c12-4775-a4c6-b164bf978201,network=Network(dee2fba9-707e-414a-bb61-ecc82be66882),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeca93def-9c') {{(pid=75226) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 17 01:46:11 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:46:11 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeca93def-9c, bridge=br-int, if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:46:11 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:46:11 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:46:11 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:46:11 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=16559979-8b67-49d5-bb2d-73ccacc584b7) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:46:11 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:46:11 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:46:11 user nova-compute[75226]: INFO os_vif [None req-97afeed5-b165-46e0-8a4f-3d320f8ece7b tempest-VolumesActionsTest-1992288685 tempest-VolumesActionsTest-1992288685-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:0e:ae,bridge_name='br-int',has_traffic_filtering=True,id=eca93def-9c12-4775-a4c6-b164bf978201,network=Network(dee2fba9-707e-414a-bb61-ecc82be66882),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeca93def-9c')
Nov 17 01:46:11 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-97afeed5-b165-46e0-8a4f-3d320f8ece7b tempest-VolumesActionsTest-1992288685 tempest-VolumesActionsTest-1992288685-project-member] [instance: 6a1d76ca-5fd1-4ee6-81f2-b53d280ff585] Deleting instance files /opt/stack/data/nova/instances/6a1d76ca-5fd1-4ee6-81f2-b53d280ff585_del
Nov 17 01:46:11 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-97afeed5-b165-46e0-8a4f-3d320f8ece7b tempest-VolumesActionsTest-1992288685 tempest-VolumesActionsTest-1992288685-project-member] [instance: 6a1d76ca-5fd1-4ee6-81f2-b53d280ff585] Deletion of /opt/stack/data/nova/instances/6a1d76ca-5fd1-4ee6-81f2-b53d280ff585_del complete
Nov 17 01:46:11 user nova-compute[75226]: INFO nova.compute.manager [None req-97afeed5-b165-46e0-8a4f-3d320f8ece7b tempest-VolumesActionsTest-1992288685 tempest-VolumesActionsTest-1992288685-project-member] [instance: 6a1d76ca-5fd1-4ee6-81f2-b53d280ff585] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 17 01:46:11 user nova-compute[75226]: DEBUG oslo.service.loopingcall [None req-97afeed5-b165-46e0-8a4f-3d320f8ece7b tempest-VolumesActionsTest-1992288685 tempest-VolumesActionsTest-1992288685-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75226) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 17 01:46:11 user nova-compute[75226]: DEBUG nova.compute.manager [-] [instance: 6a1d76ca-5fd1-4ee6-81f2-b53d280ff585] Deallocating network for instance {{(pid=75226) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 17 01:46:11 user nova-compute[75226]: DEBUG nova.network.neutron [-] [instance: 6a1d76ca-5fd1-4ee6-81f2-b53d280ff585] deallocate_for_instance() {{(pid=75226) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 17 01:46:11 user nova-compute[75226]: DEBUG nova.network.neutron [-] [instance: 6a1d76ca-5fd1-4ee6-81f2-b53d280ff585] Updating instance_info_cache with network_info: [] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:46:11 user nova-compute[75226]: DEBUG nova.compute.manager [req-e6ff5530-0a62-483b-8083-c1d9de4ee66e req-9f5af663-b77d-4095-980d-c88828240f0f service nova] [instance: 6a1d76ca-5fd1-4ee6-81f2-b53d280ff585] Received event network-vif-deleted-eca93def-9c12-4775-a4c6-b164bf978201 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:46:11 user nova-compute[75226]: INFO nova.compute.manager [req-e6ff5530-0a62-483b-8083-c1d9de4ee66e req-9f5af663-b77d-4095-980d-c88828240f0f service nova] [instance: 6a1d76ca-5fd1-4ee6-81f2-b53d280ff585] Neutron deleted interface eca93def-9c12-4775-a4c6-b164bf978201; detaching it from the instance and deleting it from the info cache
Nov 17 01:46:11 user nova-compute[75226]: DEBUG nova.network.neutron [req-e6ff5530-0a62-483b-8083-c1d9de4ee66e req-9f5af663-b77d-4095-980d-c88828240f0f service nova] [instance: 6a1d76ca-5fd1-4ee6-81f2-b53d280ff585] Updating instance_info_cache with network_info: [] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:46:11 user nova-compute[75226]: INFO nova.compute.manager [-] [instance: 6a1d76ca-5fd1-4ee6-81f2-b53d280ff585] Took 0.49 seconds to deallocate network for instance.
Nov 17 01:46:11 user nova-compute[75226]: DEBUG nova.compute.manager [req-e6ff5530-0a62-483b-8083-c1d9de4ee66e req-9f5af663-b77d-4095-980d-c88828240f0f service nova] [instance: 6a1d76ca-5fd1-4ee6-81f2-b53d280ff585] Detach interface failed, port_id=eca93def-9c12-4775-a4c6-b164bf978201, reason: Instance 6a1d76ca-5fd1-4ee6-81f2-b53d280ff585 could not be found. {{(pid=75226) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 17 01:46:11 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-97afeed5-b165-46e0-8a4f-3d320f8ece7b tempest-VolumesActionsTest-1992288685 tempest-VolumesActionsTest-1992288685-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:46:11 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-97afeed5-b165-46e0-8a4f-3d320f8ece7b tempest-VolumesActionsTest-1992288685 tempest-VolumesActionsTest-1992288685-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:46:11 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-97afeed5-b165-46e0-8a4f-3d320f8ece7b tempest-VolumesActionsTest-1992288685 tempest-VolumesActionsTest-1992288685-project-member] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:46:11 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-97afeed5-b165-46e0-8a4f-3d320f8ece7b tempest-VolumesActionsTest-1992288685 tempest-VolumesActionsTest-1992288685-project-member] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:46:11 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-97afeed5-b165-46e0-8a4f-3d320f8ece7b tempest-VolumesActionsTest-1992288685 tempest-VolumesActionsTest-1992288685-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.216s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:46:11 user nova-compute[75226]: INFO nova.scheduler.client.report [None req-97afeed5-b165-46e0-8a4f-3d320f8ece7b tempest-VolumesActionsTest-1992288685 tempest-VolumesActionsTest-1992288685-project-member] Deleted allocations for instance 6a1d76ca-5fd1-4ee6-81f2-b53d280ff585
Nov 17 01:46:12 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-97afeed5-b165-46e0-8a4f-3d320f8ece7b tempest-VolumesActionsTest-1992288685 tempest-VolumesActionsTest-1992288685-project-member] Lock "6a1d76ca-5fd1-4ee6-81f2-b53d280ff585" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.796s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:46:12 user nova-compute[75226]: DEBUG nova.compute.manager [req-bf8264a2-b386-4d8d-b8b1-630e6c752b37 req-35a51b11-280f-4f2a-998d-a8b535caa44b service nova] [instance: 6a1d76ca-5fd1-4ee6-81f2-b53d280ff585] Received event network-vif-plugged-eca93def-9c12-4775-a4c6-b164bf978201 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:46:12 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-bf8264a2-b386-4d8d-b8b1-630e6c752b37 req-35a51b11-280f-4f2a-998d-a8b535caa44b service nova] Acquiring lock "6a1d76ca-5fd1-4ee6-81f2-b53d280ff585-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:46:12 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-bf8264a2-b386-4d8d-b8b1-630e6c752b37 req-35a51b11-280f-4f2a-998d-a8b535caa44b service nova] Lock "6a1d76ca-5fd1-4ee6-81f2-b53d280ff585-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:46:12 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-bf8264a2-b386-4d8d-b8b1-630e6c752b37 req-35a51b11-280f-4f2a-998d-a8b535caa44b service nova] Lock "6a1d76ca-5fd1-4ee6-81f2-b53d280ff585-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:46:12 user nova-compute[75226]: DEBUG nova.compute.manager [req-bf8264a2-b386-4d8d-b8b1-630e6c752b37 req-35a51b11-280f-4f2a-998d-a8b535caa44b service nova] [instance: 6a1d76ca-5fd1-4ee6-81f2-b53d280ff585] No waiting events found dispatching network-vif-plugged-eca93def-9c12-4775-a4c6-b164bf978201 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:46:12 user nova-compute[75226]: WARNING nova.compute.manager [req-bf8264a2-b386-4d8d-b8b1-630e6c752b37 req-35a51b11-280f-4f2a-998d-a8b535caa44b service nova] [instance: 6a1d76ca-5fd1-4ee6-81f2-b53d280ff585] Received unexpected event network-vif-plugged-eca93def-9c12-4775-a4c6-b164bf978201 for instance with vm_state deleted and task_state None.
Nov 17 01:46:13 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:46:14 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:46:14 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:46:14 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:46:14 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:46:14 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75226) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 17 01:46:15 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/014533a1-a4c3-4c65-a121-f46486cc5998/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:46:15 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/014533a1-a4c3-4c65-a121-f46486cc5998/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:46:15 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/014533a1-a4c3-4c65-a121-f46486cc5998/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:46:15 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/014533a1-a4c3-4c65-a121-f46486cc5998/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:46:15 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:46:15 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:46:15 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:46:15 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:46:15 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75226) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 01:46:15 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75226) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 01:46:15 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2a30d8f-1521-4d8a-b880-65f31ae1b704/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:46:16 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2a30d8f-1521-4d8a-b880-65f31ae1b704/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:46:16 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2a30d8f-1521-4d8a-b880-65f31ae1b704/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:46:16 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:46:16 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2a30d8f-1521-4d8a-b880-65f31ae1b704/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:46:16 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:46:16 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:46:16 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Hypervisor/Node resource view: name=user free_ram=8389MB free_disk=24.91250991821289GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75226) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 17 01:46:16 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:46:16 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:46:16 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:46:16 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance d281f155-01b4-4141-8184-8c5111a7c663 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:46:16 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance b2a30d8f-1521-4d8a-b880-65f31ae1b704 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:46:16 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 014533a1-a4c3-4c65-a121-f46486cc5998 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:46:16 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75226) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 17 01:46:16 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75226) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 17 01:46:16 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:46:16 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:46:16 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Compute_service record updated for user:user {{(pid=75226) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 17 01:46:16 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.268s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:46:18 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:46:21 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:46:21 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:46:21 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:46:22 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:46:24 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:46:26 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:46:26 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:46:27 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:46:27 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Starting heal instance info cache {{(pid=75226) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 17 01:46:27 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Didn't find any instances for network info cache update. {{(pid=75226) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 17 01:46:27 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:46:27 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75226) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 17 01:46:28 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:46:29 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:46:31 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:46:33 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:46:36 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:46:38 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:46:41 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:46:46 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:46:51 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:46:56 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:47:01 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:47:05 user nova-compute[75226]: DEBUG nova.compute.manager [req-d40f5679-6c5a-48ab-a7ed-477c1e2e0641 req-623a28b3-2a84-4678-bd8b-5b36f6e80df8 service nova] [instance: d281f155-01b4-4141-8184-8c5111a7c663] Received event network-changed-b18b7636-d18b-4cce-8bea-b9a293b75952 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:47:05 user nova-compute[75226]: DEBUG nova.compute.manager [req-d40f5679-6c5a-48ab-a7ed-477c1e2e0641 req-623a28b3-2a84-4678-bd8b-5b36f6e80df8 service nova] [instance: d281f155-01b4-4141-8184-8c5111a7c663] Refreshing instance network info cache due to event network-changed-b18b7636-d18b-4cce-8bea-b9a293b75952. {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 01:47:05 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-d40f5679-6c5a-48ab-a7ed-477c1e2e0641 req-623a28b3-2a84-4678-bd8b-5b36f6e80df8 service nova] Acquiring lock "refresh_cache-d281f155-01b4-4141-8184-8c5111a7c663" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:47:05 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-d40f5679-6c5a-48ab-a7ed-477c1e2e0641 req-623a28b3-2a84-4678-bd8b-5b36f6e80df8 service nova] Acquired lock "refresh_cache-d281f155-01b4-4141-8184-8c5111a7c663" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:47:05 user nova-compute[75226]: DEBUG nova.network.neutron [req-d40f5679-6c5a-48ab-a7ed-477c1e2e0641 req-623a28b3-2a84-4678-bd8b-5b36f6e80df8 service nova] [instance: d281f155-01b4-4141-8184-8c5111a7c663] Refreshing network info cache for port b18b7636-d18b-4cce-8bea-b9a293b75952 {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 01:47:05 user nova-compute[75226]: DEBUG nova.network.neutron [req-d40f5679-6c5a-48ab-a7ed-477c1e2e0641 req-623a28b3-2a84-4678-bd8b-5b36f6e80df8 service nova] [instance: d281f155-01b4-4141-8184-8c5111a7c663] Updated VIF entry in instance network info cache for port b18b7636-d18b-4cce-8bea-b9a293b75952. {{(pid=75226) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 01:47:05 user nova-compute[75226]: DEBUG nova.network.neutron [req-d40f5679-6c5a-48ab-a7ed-477c1e2e0641 req-623a28b3-2a84-4678-bd8b-5b36f6e80df8 service nova] [instance: d281f155-01b4-4141-8184-8c5111a7c663] Updating instance_info_cache with network_info: [{"id": "b18b7636-d18b-4cce-8bea-b9a293b75952", "address": "fa:16:3e:51:76:4f", "network": {"id": "81bbbdad-218b-4fcd-b7f5-427fd49361cb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1151874504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "673620a69fba4a04af75baabe775dc8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb18b7636-d1", "ovs_interfaceid": "b18b7636-d18b-4cce-8bea-b9a293b75952", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:47:05 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-d40f5679-6c5a-48ab-a7ed-477c1e2e0641 req-623a28b3-2a84-4678-bd8b-5b36f6e80df8 service nova] Releasing lock "refresh_cache-d281f155-01b4-4141-8184-8c5111a7c663" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:47:06 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:47:08 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:47:09 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:47:11 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:47:12 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-86b060ed-efdf-4235-9fb5-997603b1413a tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Acquiring lock "b74709d7-5cbe-4542-a052-1e9b93ebe305" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:47:12 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-86b060ed-efdf-4235-9fb5-997603b1413a tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Lock "b74709d7-5cbe-4542-a052-1e9b93ebe305" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:47:12 user nova-compute[75226]: DEBUG nova.compute.manager [None req-86b060ed-efdf-4235-9fb5-997603b1413a tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: b74709d7-5cbe-4542-a052-1e9b93ebe305] Starting instance... {{(pid=75226) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 17 01:47:12 user nova-compute[75226]: DEBUG nova.compute.manager [req-6a13b03b-7bad-4d26-8cfe-e486e8254609 req-1829df68-f135-4e5d-b9cd-06f4bb9002d5 service nova] [instance: 8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02] Received event network-changed-ab437de1-a5c2-48c9-b693-902fc4b05929 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:47:12 user nova-compute[75226]: DEBUG nova.compute.manager [req-6a13b03b-7bad-4d26-8cfe-e486e8254609 req-1829df68-f135-4e5d-b9cd-06f4bb9002d5 service nova] [instance: 8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02] Refreshing instance network info cache due to event network-changed-ab437de1-a5c2-48c9-b693-902fc4b05929. {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 01:47:12 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-6a13b03b-7bad-4d26-8cfe-e486e8254609 req-1829df68-f135-4e5d-b9cd-06f4bb9002d5 service nova] Acquiring lock "refresh_cache-8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:47:12 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-6a13b03b-7bad-4d26-8cfe-e486e8254609 req-1829df68-f135-4e5d-b9cd-06f4bb9002d5 service nova] Acquired lock "refresh_cache-8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:47:12 user nova-compute[75226]: DEBUG nova.network.neutron [req-6a13b03b-7bad-4d26-8cfe-e486e8254609 req-1829df68-f135-4e5d-b9cd-06f4bb9002d5 service nova] [instance: 8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02] Refreshing network info cache for port ab437de1-a5c2-48c9-b693-902fc4b05929 {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 01:47:12 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-86b060ed-efdf-4235-9fb5-997603b1413a tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:47:12 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-86b060ed-efdf-4235-9fb5-997603b1413a tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:47:12 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-86b060ed-efdf-4235-9fb5-997603b1413a tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75226) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 17 01:47:12 user nova-compute[75226]: INFO nova.compute.claims [None req-86b060ed-efdf-4235-9fb5-997603b1413a tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: b74709d7-5cbe-4542-a052-1e9b93ebe305] Claim successful on node user
Nov 17 01:47:12 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-86b060ed-efdf-4235-9fb5-997603b1413a tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:47:12 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-86b060ed-efdf-4235-9fb5-997603b1413a tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:47:12 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-86b060ed-efdf-4235-9fb5-997603b1413a tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.295s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:47:12 user nova-compute[75226]: DEBUG nova.compute.manager [None req-86b060ed-efdf-4235-9fb5-997603b1413a tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: b74709d7-5cbe-4542-a052-1e9b93ebe305] Start building networks asynchronously for instance. {{(pid=75226) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 17 01:47:12 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-86b060ed-efdf-4235-9fb5-997603b1413a tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: b74709d7-5cbe-4542-a052-1e9b93ebe305] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 17 01:47:12 user nova-compute[75226]: DEBUG nova.compute.manager [None req-86b060ed-efdf-4235-9fb5-997603b1413a tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: b74709d7-5cbe-4542-a052-1e9b93ebe305] Allocating IP information in the background. {{(pid=75226) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 17 01:47:12 user nova-compute[75226]: DEBUG nova.network.neutron [None req-86b060ed-efdf-4235-9fb5-997603b1413a tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: b74709d7-5cbe-4542-a052-1e9b93ebe305] allocate_for_instance() {{(pid=75226) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 17 01:47:12 user nova-compute[75226]: DEBUG nova.compute.manager [None req-86b060ed-efdf-4235-9fb5-997603b1413a tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: b74709d7-5cbe-4542-a052-1e9b93ebe305] Start building block device mappings for instance. {{(pid=75226) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 17 01:47:12 user nova-compute[75226]: INFO nova.virt.block_device [None req-86b060ed-efdf-4235-9fb5-997603b1413a tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: b74709d7-5cbe-4542-a052-1e9b93ebe305] Booting with volume snapshot aeab73d9-9336-4268-bcba-a2a0a4c5a834 at /dev/vda
Nov 17 01:47:12 user nova-compute[75226]: DEBUG nova.network.neutron [req-6a13b03b-7bad-4d26-8cfe-e486e8254609 req-1829df68-f135-4e5d-b9cd-06f4bb9002d5 service nova] [instance: 8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02] Updated VIF entry in instance network info cache for port ab437de1-a5c2-48c9-b693-902fc4b05929. {{(pid=75226) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 01:47:12 user nova-compute[75226]: DEBUG nova.network.neutron [req-6a13b03b-7bad-4d26-8cfe-e486e8254609 req-1829df68-f135-4e5d-b9cd-06f4bb9002d5 service nova] [instance: 8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02] Updating instance_info_cache with network_info: [{"id": "ab437de1-a5c2-48c9-b693-902fc4b05929", "address": "fa:16:3e:2c:67:4c", "network": {"id": "44f50686-24e7-4e75-8269-4391a53286d0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1611114801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33699aa6c9db4815a1e79aff4685801e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab437de1-a5", "ovs_interfaceid": "ab437de1-a5c2-48c9-b693-902fc4b05929", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:47:12 user nova-compute[75226]: DEBUG nova.policy [None req-86b060ed-efdf-4235-9fb5-997603b1413a tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7c8c8baa56884dcd9a90f0187c9fc06f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673620a69fba4a04af75baabe775dc8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75226) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 17 01:47:12 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-6a13b03b-7bad-4d26-8cfe-e486e8254609 req-1829df68-f135-4e5d-b9cd-06f4bb9002d5 service nova] Releasing lock "refresh_cache-8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:47:13 user nova-compute[75226]: DEBUG nova.network.neutron [None req-86b060ed-efdf-4235-9fb5-997603b1413a tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: b74709d7-5cbe-4542-a052-1e9b93ebe305] Successfully created port: cafd7924-2152-401e-9888-519446bfa93f {{(pid=75226) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 17 01:47:13 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:47:13 user nova-compute[75226]: DEBUG nova.compute.manager [req-8509907a-baee-4f15-97a3-de6f965696a1 req-56341620-4ff7-4f32-ba32-4340802fb37e service nova] [instance: 8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02] Received event network-changed-ab437de1-a5c2-48c9-b693-902fc4b05929 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:47:13 user nova-compute[75226]: DEBUG nova.compute.manager [req-8509907a-baee-4f15-97a3-de6f965696a1 req-56341620-4ff7-4f32-ba32-4340802fb37e service nova] [instance: 8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02] Refreshing instance network info cache due to event network-changed-ab437de1-a5c2-48c9-b693-902fc4b05929. {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 01:47:13 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-8509907a-baee-4f15-97a3-de6f965696a1 req-56341620-4ff7-4f32-ba32-4340802fb37e service nova] Acquiring lock "refresh_cache-8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:47:13 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-8509907a-baee-4f15-97a3-de6f965696a1 req-56341620-4ff7-4f32-ba32-4340802fb37e service nova] Acquired lock "refresh_cache-8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:47:13 user nova-compute[75226]: DEBUG nova.network.neutron [req-8509907a-baee-4f15-97a3-de6f965696a1 req-56341620-4ff7-4f32-ba32-4340802fb37e service nova] [instance: 8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02] Refreshing network info cache for port ab437de1-a5c2-48c9-b693-902fc4b05929 {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 01:47:13 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-ba98b4b3-a497-4fee-8db7-0964a25e0072 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Acquiring lock "8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:47:13 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-ba98b4b3-a497-4fee-8db7-0964a25e0072 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Lock "8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:47:13 user nova-compute[75226]: INFO nova.compute.manager [None req-ba98b4b3-a497-4fee-8db7-0964a25e0072 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] [instance: 8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02] Detaching volume 2e4c54a4-b25d-4164-8c77-6885e25ab238
Nov 17 01:47:13 user nova-compute[75226]: INFO nova.virt.block_device [None req-ba98b4b3-a497-4fee-8db7-0964a25e0072 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] [instance: 8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02] Attempting to driver detach volume 2e4c54a4-b25d-4164-8c77-6885e25ab238 from mountpoint /dev/vdb
Nov 17 01:47:13 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-ba98b4b3-a497-4fee-8db7-0964a25e0072 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Attempting to detach device vdb from instance 8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02 from the persistent domain config. {{(pid=75226) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 17 01:47:13 user nova-compute[75226]: DEBUG nova.virt.libvirt.guest [None req-ba98b4b3-a497-4fee-8db7-0964a25e0072 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] detach device xml: <disk type="block" device="disk">
Nov 17 01:47:13 user nova-compute[75226]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 01:47:13 user nova-compute[75226]:   <source dev="/dev/sdb"/>
Nov 17 01:47:13 user nova-compute[75226]:   <target dev="vdb" bus="virtio"/>
Nov 17 01:47:13 user nova-compute[75226]:   <serial>2e4c54a4-b25d-4164-8c77-6885e25ab238</serial>
Nov 17 01:47:13 user nova-compute[75226]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 17 01:47:13 user nova-compute[75226]: </disk>
Nov 17 01:47:13 user nova-compute[75226]:  {{(pid=75226) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 17 01:47:13 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-ba98b4b3-a497-4fee-8db7-0964a25e0072 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Successfully detached device vdb from instance 8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02 from the persistent domain config.
Nov 17 01:47:13 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-ba98b4b3-a497-4fee-8db7-0964a25e0072 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02 from the live domain config. {{(pid=75226) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 17 01:47:13 user nova-compute[75226]: DEBUG nova.virt.libvirt.guest [None req-ba98b4b3-a497-4fee-8db7-0964a25e0072 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] detach device xml: <disk type="block" device="disk">
Nov 17 01:47:13 user nova-compute[75226]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 01:47:13 user nova-compute[75226]:   <source dev="/dev/sdb"/>
Nov 17 01:47:13 user nova-compute[75226]:   <target dev="vdb" bus="virtio"/>
Nov 17 01:47:13 user nova-compute[75226]:   <serial>2e4c54a4-b25d-4164-8c77-6885e25ab238</serial>
Nov 17 01:47:13 user nova-compute[75226]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 17 01:47:13 user nova-compute[75226]: </disk>
Nov 17 01:47:13 user nova-compute[75226]:  {{(pid=75226) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 17 01:47:14 user nova-compute[75226]: DEBUG nova.network.neutron [None req-86b060ed-efdf-4235-9fb5-997603b1413a tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: b74709d7-5cbe-4542-a052-1e9b93ebe305] Successfully updated port: cafd7924-2152-401e-9888-519446bfa93f {{(pid=75226) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 17 01:47:14 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-86b060ed-efdf-4235-9fb5-997603b1413a tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Acquiring lock "refresh_cache-b74709d7-5cbe-4542-a052-1e9b93ebe305" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:47:14 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-86b060ed-efdf-4235-9fb5-997603b1413a tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Acquired lock "refresh_cache-b74709d7-5cbe-4542-a052-1e9b93ebe305" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:47:14 user nova-compute[75226]: DEBUG nova.network.neutron [None req-86b060ed-efdf-4235-9fb5-997603b1413a tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: b74709d7-5cbe-4542-a052-1e9b93ebe305] Building network info cache for instance {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 01:47:14 user nova-compute[75226]: DEBUG nova.network.neutron [req-8509907a-baee-4f15-97a3-de6f965696a1 req-56341620-4ff7-4f32-ba32-4340802fb37e service nova] [instance: 8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02] Updated VIF entry in instance network info cache for port ab437de1-a5c2-48c9-b693-902fc4b05929. {{(pid=75226) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 01:47:14 user nova-compute[75226]: DEBUG nova.network.neutron [req-8509907a-baee-4f15-97a3-de6f965696a1 req-56341620-4ff7-4f32-ba32-4340802fb37e service nova] [instance: 8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02] Updating instance_info_cache with network_info: [{"id": "ab437de1-a5c2-48c9-b693-902fc4b05929", "address": "fa:16:3e:2c:67:4c", "network": {"id": "44f50686-24e7-4e75-8269-4391a53286d0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1611114801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33699aa6c9db4815a1e79aff4685801e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab437de1-a5", "ovs_interfaceid": "ab437de1-a5c2-48c9-b693-902fc4b05929", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:47:14 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-8509907a-baee-4f15-97a3-de6f965696a1 req-56341620-4ff7-4f32-ba32-4340802fb37e service nova] Releasing lock "refresh_cache-8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:47:14 user nova-compute[75226]: DEBUG nova.network.neutron [None req-86b060ed-efdf-4235-9fb5-997603b1413a tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: b74709d7-5cbe-4542-a052-1e9b93ebe305] Instance cache missing network info. {{(pid=75226) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 17 01:47:14 user nova-compute[75226]: DEBUG nova.compute.manager [req-6c2946cb-0168-447d-b0e9-6b2be532e5f1 req-c9bf512f-3ad9-41e9-941e-d167f52d30e1 service nova] [instance: b74709d7-5cbe-4542-a052-1e9b93ebe305] Received event network-changed-cafd7924-2152-401e-9888-519446bfa93f {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:47:14 user nova-compute[75226]: DEBUG nova.compute.manager [req-6c2946cb-0168-447d-b0e9-6b2be532e5f1 req-c9bf512f-3ad9-41e9-941e-d167f52d30e1 service nova] [instance: b74709d7-5cbe-4542-a052-1e9b93ebe305] Refreshing instance network info cache due to event network-changed-cafd7924-2152-401e-9888-519446bfa93f. {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 01:47:14 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-6c2946cb-0168-447d-b0e9-6b2be532e5f1 req-c9bf512f-3ad9-41e9-941e-d167f52d30e1 service nova] Acquiring lock "refresh_cache-b74709d7-5cbe-4542-a052-1e9b93ebe305" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:47:14 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-ba98b4b3-a497-4fee-8db7-0964a25e0072 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02 {{(pid=75226) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 17 01:47:14 user nova-compute[75226]: DEBUG nova.network.neutron [None req-86b060ed-efdf-4235-9fb5-997603b1413a tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: b74709d7-5cbe-4542-a052-1e9b93ebe305] Updating instance_info_cache with network_info: [{"id": "cafd7924-2152-401e-9888-519446bfa93f", "address": "fa:16:3e:de:58:9e", "network": {"id": "81bbbdad-218b-4fcd-b7f5-427fd49361cb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1151874504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "673620a69fba4a04af75baabe775dc8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcafd7924-21", "ovs_interfaceid": "cafd7924-2152-401e-9888-519446bfa93f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:47:14 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-86b060ed-efdf-4235-9fb5-997603b1413a tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Releasing lock "refresh_cache-b74709d7-5cbe-4542-a052-1e9b93ebe305" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:47:14 user nova-compute[75226]: DEBUG nova.compute.manager [None req-86b060ed-efdf-4235-9fb5-997603b1413a tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: b74709d7-5cbe-4542-a052-1e9b93ebe305] Instance network_info: |[{"id": "cafd7924-2152-401e-9888-519446bfa93f", "address": "fa:16:3e:de:58:9e", "network": {"id": "81bbbdad-218b-4fcd-b7f5-427fd49361cb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1151874504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "673620a69fba4a04af75baabe775dc8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcafd7924-21", "ovs_interfaceid": "cafd7924-2152-401e-9888-519446bfa93f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75226) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 17 01:47:14 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-6c2946cb-0168-447d-b0e9-6b2be532e5f1 req-c9bf512f-3ad9-41e9-941e-d167f52d30e1 service nova] Acquired lock "refresh_cache-b74709d7-5cbe-4542-a052-1e9b93ebe305" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:47:14 user nova-compute[75226]: DEBUG nova.network.neutron [req-6c2946cb-0168-447d-b0e9-6b2be532e5f1 req-c9bf512f-3ad9-41e9-941e-d167f52d30e1 service nova] [instance: b74709d7-5cbe-4542-a052-1e9b93ebe305] Refreshing network info cache for port cafd7924-2152-401e-9888-519446bfa93f {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 01:47:14 user nova-compute[75226]: DEBUG nova.network.neutron [req-6c2946cb-0168-447d-b0e9-6b2be532e5f1 req-c9bf512f-3ad9-41e9-941e-d167f52d30e1 service nova] [instance: b74709d7-5cbe-4542-a052-1e9b93ebe305] Updated VIF entry in instance network info cache for port cafd7924-2152-401e-9888-519446bfa93f. {{(pid=75226) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 01:47:14 user nova-compute[75226]: DEBUG nova.network.neutron [req-6c2946cb-0168-447d-b0e9-6b2be532e5f1 req-c9bf512f-3ad9-41e9-941e-d167f52d30e1 service nova] [instance: b74709d7-5cbe-4542-a052-1e9b93ebe305] Updating instance_info_cache with network_info: [{"id": "cafd7924-2152-401e-9888-519446bfa93f", "address": "fa:16:3e:de:58:9e", "network": {"id": "81bbbdad-218b-4fcd-b7f5-427fd49361cb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1151874504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "673620a69fba4a04af75baabe775dc8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcafd7924-21", "ovs_interfaceid": "cafd7924-2152-401e-9888-519446bfa93f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:47:14 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-6c2946cb-0168-447d-b0e9-6b2be532e5f1 req-c9bf512f-3ad9-41e9-941e-d167f52d30e1 service nova] Releasing lock "refresh_cache-b74709d7-5cbe-4542-a052-1e9b93ebe305" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:47:15 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:47:15 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:47:15 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:47:15 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:47:15 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75226) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 17 01:47:16 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/014533a1-a4c3-4c65-a121-f46486cc5998/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:47:16 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:47:16 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/014533a1-a4c3-4c65-a121-f46486cc5998/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:47:16 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/014533a1-a4c3-4c65-a121-f46486cc5998/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:47:16 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/014533a1-a4c3-4c65-a121-f46486cc5998/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:47:16 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:47:16 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:47:16 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:47:16 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:47:16 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75226) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 01:47:16 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2a30d8f-1521-4d8a-b880-65f31ae1b704/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:47:17 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2a30d8f-1521-4d8a-b880-65f31ae1b704/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:47:17 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2a30d8f-1521-4d8a-b880-65f31ae1b704/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:47:17 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2a30d8f-1521-4d8a-b880-65f31ae1b704/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:47:17 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:47:17 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:47:17 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Hypervisor/Node resource view: name=user free_ram=8508MB free_disk=24.882526397705078GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75226) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 17 01:47:17 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:47:17 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:47:17 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:47:17 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance d281f155-01b4-4141-8184-8c5111a7c663 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:47:17 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance b2a30d8f-1521-4d8a-b880-65f31ae1b704 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:47:17 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 014533a1-a4c3-4c65-a121-f46486cc5998 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:47:17 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance b74709d7-5cbe-4542-a052-1e9b93ebe305 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:47:17 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75226) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 17 01:47:17 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75226) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 17 01:47:17 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:47:17 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:47:17 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Compute_service record updated for user:user {{(pid=75226) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 17 01:47:17 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.317s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:47:18 user nova-compute[75226]: DEBUG os_brick.utils [None req-86b060ed-efdf-4235-9fb5-997603b1413a tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:47:18 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:47:18 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:47:18 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2efa929-a808-4167-a338-79e572dcccdf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f62857db69\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:47:18 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:47:18 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:47:18 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[00754b6c-c790-4161-9585-5037663722b9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:47:18 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:47:18 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:47:18 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc886407-6986-4b66-aebe-4979b069d099]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:47:18 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7ec0376-83fa-4b2a-b720-0a41a4e3999f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:47:18 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-86b060ed-efdf-4235-9fb5-997603b1413a tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Running cmd (subprocess): nvme version {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:47:18 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-86b060ed-efdf-4235-9fb5-997603b1413a tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] 'nvme version' failed. Not Retrying. {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 01:47:18 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.nvmeof [None req-86b060ed-efdf-4235-9fb5-997603b1413a tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] nvme not present on system {{(pid=75226) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 17 01:47:18 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:47:18 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 01:47:18 user nova-compute[75226]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 17 01:47:18 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[be3dcef1-4db9-41b9-9da0-5fad20a9569b]: (4, '') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:47:18 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-86b060ed-efdf-4235-9fb5-997603b1413a tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75226) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 17 01:47:18 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-86b060ed-efdf-4235-9fb5-997603b1413a tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75226) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 17 01:47:18 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-86b060ed-efdf-4235-9fb5-997603b1413a tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] LIGHTOS: no hostnqn found. {{(pid=75226) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 17 01:47:18 user nova-compute[75226]: DEBUG os_brick.utils [None req-86b060ed-efdf-4235-9fb5-997603b1413a tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f62857db69', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:47:18 user nova-compute[75226]: DEBUG nova.virt.block_device [None req-86b060ed-efdf-4235-9fb5-997603b1413a tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: b74709d7-5cbe-4542-a052-1e9b93ebe305] Updating existing volume attachment record: 477d08ae-2849-4176-b62c-4f30659b9c8c {{(pid=75226) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 17 01:47:21 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:47:22 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:47:22 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:47:22 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:47:23 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:47:24 user nova-compute[75226]: DEBUG nova.compute.manager [None req-86b060ed-efdf-4235-9fb5-997603b1413a tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: b74709d7-5cbe-4542-a052-1e9b93ebe305] Start spawning the instance on the hypervisor. {{(pid=75226) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 17 01:47:24 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-86b060ed-efdf-4235-9fb5-997603b1413a tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: b74709d7-5cbe-4542-a052-1e9b93ebe305] Creating instance directory {{(pid=75226) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 17 01:47:24 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-86b060ed-efdf-4235-9fb5-997603b1413a tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: b74709d7-5cbe-4542-a052-1e9b93ebe305] Creating image(s)
Nov 17 01:47:24 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-86b060ed-efdf-4235-9fb5-997603b1413a tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: b74709d7-5cbe-4542-a052-1e9b93ebe305] Did not create local disks {{(pid=75226) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 17 01:47:24 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-86b060ed-efdf-4235-9fb5-997603b1413a tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: b74709d7-5cbe-4542-a052-1e9b93ebe305] Ensure instance console log exists: /opt/stack/data/nova/instances/b74709d7-5cbe-4542-a052-1e9b93ebe305/console.log {{(pid=75226) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 17 01:47:24 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-86b060ed-efdf-4235-9fb5-997603b1413a tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:47:24 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-86b060ed-efdf-4235-9fb5-997603b1413a tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:47:24 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-86b060ed-efdf-4235-9fb5-997603b1413a tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:47:24 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-86b060ed-efdf-4235-9fb5-997603b1413a tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: b74709d7-5cbe-4542-a052-1e9b93ebe305] Start _get_guest_xml network_info=[{"id": "cafd7924-2152-401e-9888-519446bfa93f", "address": "fa:16:3e:de:58:9e", "network": {"id": "81bbbdad-218b-4fcd-b7f5-427fd49361cb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1151874504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "673620a69fba4a04af75baabe775dc8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcafd7924-21", "ovs_interfaceid": "cafd7924-2152-401e-9888-519446bfa93f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-17T01:47:07Z,direct_url=<?>,disk_format='qcow2',id=0b8da27e-0e77-4e45-aa08-2db14f1bcfad,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-167175898',owner='673620a69fba4a04af75baabe775dc8b',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-17T01:47:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d53822e7-4aff-4a77-9789-8759b4988dca', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jCzQvsoE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b74709d7-5cbe-4542-a052-1e9b93ebe305', 'attached_at': '', 'detached_at': '', 'volume_id': 'd53822e7-4aff-4a77-9789-8759b4988dca', 'serial': 'd53822e7-4aff-4a77-9789-8759b4988dca'}, 'attachment_id': '477d08ae-2849-4176-b62c-4f30659b9c8c', 'device_type': 'disk', 'volume_type': None} {{(pid=75226) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 17 01:47:24 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-86b060ed-efdf-4235-9fb5-997603b1413a tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:47:24 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-86b060ed-efdf-4235-9fb5-997603b1413a tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:47:24 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-86b060ed-efdf-4235-9fb5-997603b1413a tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75226) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 17 01:47:24 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-86b060ed-efdf-4235-9fb5-997603b1413a tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] CPU controller missing on host. {{(pid=75226) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 17 01:47:24 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-86b060ed-efdf-4235-9fb5-997603b1413a tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75226) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 17 01:47:24 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-86b060ed-efdf-4235-9fb5-997603b1413a tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] CPU controller found on host. {{(pid=75226) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 17 01:47:24 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-86b060ed-efdf-4235-9fb5-997603b1413a tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75226) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 17 01:47:24 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-86b060ed-efdf-4235-9fb5-997603b1413a tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-17T01:13:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-17T01:47:07Z,direct_url=<?>,disk_format='qcow2',id=0b8da27e-0e77-4e45-aa08-2db14f1bcfad,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-167175898',owner='673620a69fba4a04af75baabe775dc8b',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-17T01:47:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 17 01:47:24 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-86b060ed-efdf-4235-9fb5-997603b1413a tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Flavor limits 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 17 01:47:24 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-86b060ed-efdf-4235-9fb5-997603b1413a tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Image limits 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 17 01:47:24 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-86b060ed-efdf-4235-9fb5-997603b1413a tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Flavor pref 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 17 01:47:24 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-86b060ed-efdf-4235-9fb5-997603b1413a tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Image pref 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 17 01:47:24 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-86b060ed-efdf-4235-9fb5-997603b1413a tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 17 01:47:24 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-86b060ed-efdf-4235-9fb5-997603b1413a tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 17 01:47:24 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-86b060ed-efdf-4235-9fb5-997603b1413a tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75226) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 17 01:47:24 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-86b060ed-efdf-4235-9fb5-997603b1413a tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Got 1 possible topologies {{(pid=75226) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 17 01:47:24 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-86b060ed-efdf-4235-9fb5-997603b1413a tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 17 01:47:24 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-86b060ed-efdf-4235-9fb5-997603b1413a tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 17 01:47:24 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86b060ed-efdf-4235-9fb5-997603b1413a tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: b74709d7-5cbe-4542-a052-1e9b93ebe305] Calling os-brick to attach iSCSI Volume {{(pid=75226) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 17 01:47:24 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-86b060ed-efdf-4235-9fb5-997603b1413a tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc4cc36b490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d53822e7-4aff-4a77-9789-8759b4988dca', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jCzQvsoE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:47:24 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-86b060ed-efdf-4235-9fb5-997603b1413a tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:47:24 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-86b060ed-efdf-4235-9fb5-997603b1413a tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:47:24 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-86b060ed-efdf-4235-9fb5-997603b1413a tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:47:24 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-86b060ed-efdf-4235-9fb5-997603b1413a tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:47:24 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-86b060ed-efdf-4235-9fb5-997603b1413a tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d53822e7-4aff-4a77-9789-8759b4988dca" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:47:24 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-86b060ed-efdf-4235-9fb5-997603b1413a tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d53822e7-4aff-4a77-9789-8759b4988dca" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:47:24 user nova-compute[75226]: INFO os_brick.initiator.connectors.iscsi [None req-86b060ed-efdf-4235-9fb5-997603b1413a tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 17 01:47:24 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d53822e7-4aff-4a77-9789-8759b4988dca -p 172.16.0.220:3260 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:47:24 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d53822e7-4aff-4a77-9789-8759b4988dca -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:47:24 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[c60cc75b-cc7a-40cd-b01f-1d6c87f82523]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:47:24 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-86b060ed-efdf-4235-9fb5-997603b1413a tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 17 01:47:24 user nova-compute[75226]:  {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:47:24 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d53822e7-4aff-4a77-9789-8759b4988dca -p 172.16.0.220:3260 --interface default --op new {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:47:24 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d53822e7-4aff-4a77-9789-8759b4988dca -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:47:24 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cb222c6-ee92-4053-8d0e-76aa7dbb5ded]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d53822e7-4aff-4a77-9789-8759b4988dca] added\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:47:24 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-86b060ed-efdf-4235-9fb5-997603b1413a tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d53822e7-4aff-4a77-9789-8759b4988dca] added
Nov 17 01:47:24 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:47:24 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d53822e7-4aff-4a77-9789-8759b4988dca -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:47:24 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d53822e7-4aff-4a77-9789-8759b4988dca -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:47:24 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[55e975ae-c28d-4f05-9517-57ef158f81a5]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:47:24 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-86b060ed-efdf-4235-9fb5-997603b1413a tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:47:24 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d53822e7-4aff-4a77-9789-8759b4988dca -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:47:24 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d53822e7-4aff-4a77-9789-8759b4988dca -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:47:24 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[f959c4fd-fdc0-4027-b384-093dabcd66d0]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:47:24 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-86b060ed-efdf-4235-9fb5-997603b1413a tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:47:24 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d53822e7-4aff-4a77-9789-8759b4988dca -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jCzQvsoE {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:47:24 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d53822e7-4aff-4a77-9789-8759b4988dca -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jCzQvsoE" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:47:24 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6278587-90c6-467e-8a1b-4628e57fa8fc]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:47:24 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-86b060ed-efdf-4235-9fb5-997603b1413a tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jCzQvsoE'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:47:24 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d53822e7-4aff-4a77-9789-8759b4988dca -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:47:24 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d53822e7-4aff-4a77-9789-8759b4988dca -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:47:24 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[bce16e2e-3026-45cf-a34c-5d7279b59ce1]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:47:24 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-86b060ed-efdf-4235-9fb5-997603b1413a tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:47:24 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:47:24 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:47:24 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f6d16a8-6886-4e92-9672-9dadc3911519]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e4c54a4-b25d-4164-8c77-6885e25ab238 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea51d240-abac-484a-8d78-49c9f9990337 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:47:24 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-86b060ed-efdf-4235-9fb5-997603b1413a tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e4c54a4-b25d-4164-8c77-6885e25ab238 (non-flash)
Nov 17 01:47:24 user nova-compute[75226]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea51d240-abac-484a-8d78-49c9f9990337 (non-flash)
Nov 17 01:47:24 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:47:24 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-86b060ed-efdf-4235-9fb5-997603b1413a tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e4c54a4-b25d-4164-8c77-6885e25ab238 (non-flash)
Nov 17 01:47:24 user nova-compute[75226]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea51d240-abac-484a-8d78-49c9f9990337 (non-flash)
Nov 17 01:47:24 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:47:24 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d53822e7-4aff-4a77-9789-8759b4988dca -p 172.16.0.220:3260 --login {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:47:24 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d53822e7-4aff-4a77-9789-8759b4988dca -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:47:24 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9aac110-a752-4e1c-a300-ac04237aff0c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d53822e7-4aff-4a77-9789-8759b4988dca, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d53822e7-4aff-4a77-9789-8759b4988dca, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:47:24 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-86b060ed-efdf-4235-9fb5-997603b1413a tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d53822e7-4aff-4a77-9789-8759b4988dca, portal: 172.16.0.220,3260]
Nov 17 01:47:24 user nova-compute[75226]: Login to [iface: default, target: iqn.2010-10.org.openstack:d53822e7-4aff-4a77-9789-8759b4988dca, portal: 172.16.0.220,3260] successful.
Nov 17 01:47:24 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:47:24 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d53822e7-4aff-4a77-9789-8759b4988dca -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:47:24 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d53822e7-4aff-4a77-9789-8759b4988dca -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:47:24 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7c605de-1483-47ee-9de0-b7544f86f5c1]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:47:24 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-86b060ed-efdf-4235-9fb5-997603b1413a tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:47:24 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:47:24 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:47:24 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[c29d6b33-78f4-4d77-996d-77c99d1afa8b]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e4c54a4-b25d-4164-8c77-6885e25ab238 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea51d240-abac-484a-8d78-49c9f9990337 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53822e7-4aff-4a77-9789-8759b4988dca (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:47:24 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-86b060ed-efdf-4235-9fb5-997603b1413a tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e4c54a4-b25d-4164-8c77-6885e25ab238 (non-flash)
Nov 17 01:47:24 user nova-compute[75226]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea51d240-abac-484a-8d78-49c9f9990337 (non-flash)
Nov 17 01:47:24 user nova-compute[75226]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53822e7-4aff-4a77-9789-8759b4988dca (non-flash)
Nov 17 01:47:24 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:47:24 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-86b060ed-efdf-4235-9fb5-997603b1413a tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e4c54a4-b25d-4164-8c77-6885e25ab238 (non-flash)
Nov 17 01:47:24 user nova-compute[75226]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea51d240-abac-484a-8d78-49c9f9990337 (non-flash)
Nov 17 01:47:24 user nova-compute[75226]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53822e7-4aff-4a77-9789-8759b4988dca (non-flash)
Nov 17 01:47:24 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:47:24 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-86b060ed-efdf-4235-9fb5-997603b1413a tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d53822e7-4aff-4a77-9789-8759b4988dca" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.275s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:47:24 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-86b060ed-efdf-4235-9fb5-997603b1413a tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Connected to 172.16.0.220:3260 {{(pid=75226) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 17 01:47:24 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-86b060ed-efdf-4235-9fb5-997603b1413a tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] HCTL ('35', '-', '-', 0) found on session 54 with lun 0 {{(pid=75226) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 17 01:47:24 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-86b060ed-efdf-4235-9fb5-997603b1413a tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75226) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 17 01:47:24 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:47:24 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:47:24 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee6effbd-67c7-4565-bc10-7cb87f432631]: (4, ('- - 0', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:47:24 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-86b060ed-efdf-4235-9fb5-997603b1413a tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Searching for a device in session 54 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75226) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 01:47:24 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-86b060ed-efdf-4235-9fb5-997603b1413a tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:d53822e7-4aff-4a77-9789-8759b4988dca', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jCzQvsoE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75226) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 17 01:47:25 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-86b060ed-efdf-4235-9fb5-997603b1413a tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.310s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:47:25 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-86b060ed-efdf-4235-9fb5-997603b1413a tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] <== connect_volume: return (1311ms) {'type': 'block', 'scsi_wwn': '26637633632306666', 'path': '/dev/sdd'} {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:47:25 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86b060ed-efdf-4235-9fb5-997603b1413a tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: b74709d7-5cbe-4542-a052-1e9b93ebe305] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26637633632306666', 'path': '/dev/sdd'} {{(pid=75226) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 17 01:47:25 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-86b060ed-efdf-4235-9fb5-997603b1413a tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:47:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-2025467327',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-2025467327',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-2025467327',id=48,image_ref='0b8da27e-0e77-4e45-aa08-2db14f1bcfad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFtBPanumi0zkDDEVk91gfcH5YdI1iaznxhcvveMGFqJFd36aIecIAPwZM2h+y+6FEad+bHMPMbpaATGqwz4GJYukTPp/y4ueLYLElo4kg7Ce6IZZOKDE7Kve5K5fV7+Ww==',key_name='tempest-keypair-412422918',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='673620a69fba4a04af75baabe775dc8b',ramdisk_id='',reservation_id='r-9bezfld0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-971654489',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-971654489-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-971654489',owner_user_name='tempest-TestVolumeBootPattern-971654489-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T01:47:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c8c8baa56884dcd9a90f0187c9fc06f',uuid=b74709d7-5cbe-4542-a052-1e9b93ebe305,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cafd7924-2152-401e-9888-519446bfa93f", "address": "fa:16:3e:de:58:9e", "network": {"id": "81bbbdad-218b-4fcd-b7f5-427fd49361cb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1151874504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "673620a69fba4a04af75baabe775dc8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcafd7924-21", "ovs_interfaceid": "cafd7924-2152-401e-9888-519446bfa93f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75226) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 01:47:25 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-86b060ed-efdf-4235-9fb5-997603b1413a tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Converting VIF {"id": "cafd7924-2152-401e-9888-519446bfa93f", "address": "fa:16:3e:de:58:9e", "network": {"id": "81bbbdad-218b-4fcd-b7f5-427fd49361cb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1151874504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "673620a69fba4a04af75baabe775dc8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcafd7924-21", "ovs_interfaceid": "cafd7924-2152-401e-9888-519446bfa93f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:47:25 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-86b060ed-efdf-4235-9fb5-997603b1413a tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:58:9e,bridge_name='br-int',has_traffic_filtering=True,id=cafd7924-2152-401e-9888-519446bfa93f,network=Network(81bbbdad-218b-4fcd-b7f5-427fd49361cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcafd7924-21') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:47:25 user nova-compute[75226]: DEBUG nova.objects.instance [None req-86b060ed-efdf-4235-9fb5-997603b1413a tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Lazy-loading 'pci_devices' on Instance uuid b74709d7-5cbe-4542-a052-1e9b93ebe305 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:47:25 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-86b060ed-efdf-4235-9fb5-997603b1413a tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: b74709d7-5cbe-4542-a052-1e9b93ebe305] End _get_guest_xml xml=<domain type="kvm">
Nov 17 01:47:25 user nova-compute[75226]:   <uuid>b74709d7-5cbe-4542-a052-1e9b93ebe305</uuid>
Nov 17 01:47:25 user nova-compute[75226]:   <name>instance-00000030</name>
Nov 17 01:47:25 user nova-compute[75226]:   <memory>524288</memory>
Nov 17 01:47:25 user nova-compute[75226]:   <vcpu>1</vcpu>
Nov 17 01:47:25 user nova-compute[75226]:   <metadata>
Nov 17 01:47:25 user nova-compute[75226]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 17 01:47:25 user nova-compute[75226]:       <nova:package version="0.0.0"/>
Nov 17 01:47:25 user nova-compute[75226]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-2025467327</nova:name>
Nov 17 01:47:25 user nova-compute[75226]:       <nova:creationTime>2023-11-17 01:47:24</nova:creationTime>
Nov 17 01:47:25 user nova-compute[75226]:       <nova:flavor name="m1.tiny">
Nov 17 01:47:25 user nova-compute[75226]:         <nova:memory>512</nova:memory>
Nov 17 01:47:25 user nova-compute[75226]:         <nova:disk>1</nova:disk>
Nov 17 01:47:25 user nova-compute[75226]:         <nova:swap>0</nova:swap>
Nov 17 01:47:25 user nova-compute[75226]:         <nova:ephemeral>0</nova:ephemeral>
Nov 17 01:47:25 user nova-compute[75226]:         <nova:vcpus>1</nova:vcpus>
Nov 17 01:47:25 user nova-compute[75226]:       </nova:flavor>
Nov 17 01:47:25 user nova-compute[75226]:       <nova:owner>
Nov 17 01:47:25 user nova-compute[75226]:         <nova:user uuid="7c8c8baa56884dcd9a90f0187c9fc06f">tempest-TestVolumeBootPattern-971654489-project-member</nova:user>
Nov 17 01:47:25 user nova-compute[75226]:         <nova:project uuid="673620a69fba4a04af75baabe775dc8b">tempest-TestVolumeBootPattern-971654489</nova:project>
Nov 17 01:47:25 user nova-compute[75226]:       </nova:owner>
Nov 17 01:47:25 user nova-compute[75226]:       <nova:root type="image" uuid="0b8da27e-0e77-4e45-aa08-2db14f1bcfad"/>
Nov 17 01:47:25 user nova-compute[75226]:       <nova:ports>
Nov 17 01:47:25 user nova-compute[75226]:         <nova:port uuid="cafd7924-2152-401e-9888-519446bfa93f">
Nov 17 01:47:25 user nova-compute[75226]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 17 01:47:25 user nova-compute[75226]:         </nova:port>
Nov 17 01:47:25 user nova-compute[75226]:       </nova:ports>
Nov 17 01:47:25 user nova-compute[75226]:     </nova:instance>
Nov 17 01:47:25 user nova-compute[75226]:   </metadata>
Nov 17 01:47:25 user nova-compute[75226]:   <sysinfo type="smbios">
Nov 17 01:47:25 user nova-compute[75226]:     <system>
Nov 17 01:47:25 user nova-compute[75226]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 17 01:47:25 user nova-compute[75226]:       <entry name="product">OpenStack Nova</entry>
Nov 17 01:47:25 user nova-compute[75226]:       <entry name="version">0.0.0</entry>
Nov 17 01:47:25 user nova-compute[75226]:       <entry name="serial">b74709d7-5cbe-4542-a052-1e9b93ebe305</entry>
Nov 17 01:47:25 user nova-compute[75226]:       <entry name="uuid">b74709d7-5cbe-4542-a052-1e9b93ebe305</entry>
Nov 17 01:47:25 user nova-compute[75226]:       <entry name="family">Virtual Machine</entry>
Nov 17 01:47:25 user nova-compute[75226]:     </system>
Nov 17 01:47:25 user nova-compute[75226]:   </sysinfo>
Nov 17 01:47:25 user nova-compute[75226]:   <os>
Nov 17 01:47:25 user nova-compute[75226]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 17 01:47:25 user nova-compute[75226]:     <boot dev="hd"/>
Nov 17 01:47:25 user nova-compute[75226]:     <smbios mode="sysinfo"/>
Nov 17 01:47:25 user nova-compute[75226]:   </os>
Nov 17 01:47:25 user nova-compute[75226]:   <features>
Nov 17 01:47:25 user nova-compute[75226]:     <acpi/>
Nov 17 01:47:25 user nova-compute[75226]:     <apic/>
Nov 17 01:47:25 user nova-compute[75226]:     <vmcoreinfo/>
Nov 17 01:47:25 user nova-compute[75226]:   </features>
Nov 17 01:47:25 user nova-compute[75226]:   <clock offset="utc">
Nov 17 01:47:25 user nova-compute[75226]:     <timer name="pit" tickpolicy="delay"/>
Nov 17 01:47:25 user nova-compute[75226]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 17 01:47:25 user nova-compute[75226]:     <timer name="hpet" present="no"/>
Nov 17 01:47:25 user nova-compute[75226]:   </clock>
Nov 17 01:47:25 user nova-compute[75226]:   <cpu mode="custom" match="exact">
Nov 17 01:47:25 user nova-compute[75226]:     <model>Nehalem</model>
Nov 17 01:47:25 user nova-compute[75226]:     <topology sockets="1" cores="1" threads="1"/>
Nov 17 01:47:25 user nova-compute[75226]:   </cpu>
Nov 17 01:47:25 user nova-compute[75226]:   <devices>
Nov 17 01:47:25 user nova-compute[75226]:     <disk type="block" device="disk">
Nov 17 01:47:25 user nova-compute[75226]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 01:47:25 user nova-compute[75226]:       <source dev="/dev/sdd"/>
Nov 17 01:47:25 user nova-compute[75226]:       <target dev="vda" bus="virtio"/>
Nov 17 01:47:25 user nova-compute[75226]:       <serial>d53822e7-4aff-4a77-9789-8759b4988dca</serial>
Nov 17 01:47:25 user nova-compute[75226]:     </disk>
Nov 17 01:47:25 user nova-compute[75226]:     <interface type="ethernet">
Nov 17 01:47:25 user nova-compute[75226]:       <mac address="fa:16:3e:de:58:9e"/>
Nov 17 01:47:25 user nova-compute[75226]:       <model type="virtio"/>
Nov 17 01:47:25 user nova-compute[75226]:       <mtu size="1442"/>
Nov 17 01:47:25 user nova-compute[75226]:       <target dev="tapcafd7924-21"/>
Nov 17 01:47:25 user nova-compute[75226]:     </interface>
Nov 17 01:47:25 user nova-compute[75226]:     <serial type="pty">
Nov 17 01:47:25 user nova-compute[75226]:       <log file="/opt/stack/data/nova/instances/b74709d7-5cbe-4542-a052-1e9b93ebe305/console.log" append="off"/>
Nov 17 01:47:25 user nova-compute[75226]:     </serial>
Nov 17 01:47:25 user nova-compute[75226]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 17 01:47:25 user nova-compute[75226]:     <video>
Nov 17 01:47:25 user nova-compute[75226]:       <model type="virtio"/>
Nov 17 01:47:25 user nova-compute[75226]:     </video>
Nov 17 01:47:25 user nova-compute[75226]:     <rng model="virtio">
Nov 17 01:47:25 user nova-compute[75226]:       <backend model="random">/dev/urandom</backend>
Nov 17 01:47:25 user nova-compute[75226]:     </rng>
Nov 17 01:47:25 user nova-compute[75226]:     <controller type="usb" index="0" model="none"/>
Nov 17 01:47:25 user nova-compute[75226]:     <memballoon model="virtio">
Nov 17 01:47:25 user nova-compute[75226]:       <stats period="10"/>
Nov 17 01:47:25 user nova-compute[75226]:     </memballoon>
Nov 17 01:47:25 user nova-compute[75226]:   </devices>
Nov 17 01:47:25 user nova-compute[75226]: </domain>
Nov 17 01:47:25 user nova-compute[75226]:  {{(pid=75226) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 17 01:47:25 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-86b060ed-efdf-4235-9fb5-997603b1413a tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:47:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-2025467327',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-2025467327',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-2025467327',id=48,image_ref='0b8da27e-0e77-4e45-aa08-2db14f1bcfad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFtBPanumi0zkDDEVk91gfcH5YdI1iaznxhcvveMGFqJFd36aIecIAPwZM2h+y+6FEad+bHMPMbpaATGqwz4GJYukTPp/y4ueLYLElo4kg7Ce6IZZOKDE7Kve5K5fV7+Ww==',key_name='tempest-keypair-412422918',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='673620a69fba4a04af75baabe775dc8b',ramdisk_id='',reservation_id='r-9bezfld0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-971654489',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-971654489-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-971654489',owner_user_name='tempest-TestVolumeBootPattern-971654489-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T01:47:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c8c8baa56884dcd9a90f0187c9fc06f',uuid=b74709d7-5cbe-4542-a052-1e9b93ebe305,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cafd7924-2152-401e-9888-519446bfa93f", "address": "fa:16:3e:de:58:9e", "network": {"id": "81bbbdad-218b-4fcd-b7f5-427fd49361cb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1151874504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "673620a69fba4a04af75baabe775dc8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcafd7924-21", "ovs_interfaceid": "cafd7924-2152-401e-9888-519446bfa93f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 17 01:47:25 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-86b060ed-efdf-4235-9fb5-997603b1413a tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Converting VIF {"id": "cafd7924-2152-401e-9888-519446bfa93f", "address": "fa:16:3e:de:58:9e", "network": {"id": "81bbbdad-218b-4fcd-b7f5-427fd49361cb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1151874504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "673620a69fba4a04af75baabe775dc8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcafd7924-21", "ovs_interfaceid": "cafd7924-2152-401e-9888-519446bfa93f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:47:25 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-86b060ed-efdf-4235-9fb5-997603b1413a tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:58:9e,bridge_name='br-int',has_traffic_filtering=True,id=cafd7924-2152-401e-9888-519446bfa93f,network=Network(81bbbdad-218b-4fcd-b7f5-427fd49361cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcafd7924-21') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:47:25 user nova-compute[75226]: DEBUG os_vif [None req-86b060ed-efdf-4235-9fb5-997603b1413a tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:58:9e,bridge_name='br-int',has_traffic_filtering=True,id=cafd7924-2152-401e-9888-519446bfa93f,network=Network(81bbbdad-218b-4fcd-b7f5-427fd49361cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcafd7924-21') {{(pid=75226) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 17 01:47:25 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:47:25 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:47:25 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 17 01:47:25 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:47:25 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '919a78f6-06f6-5e1d-9e4f-152948b0d34a', '_type': 'linux-noop'}}, row=False) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:47:25 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:47:25 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:47:25 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:47:25 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcafd7924-21, may_exist=True, interface_attrs={}) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:47:25 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcafd7924-21, col_values=(('qos', UUID('e9691f9a-24dd-4882-9f07-e9476e7c5cb1')),), if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:47:25 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcafd7924-21, col_values=(('external_ids', {'iface-id': 'cafd7924-2152-401e-9888-519446bfa93f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:de:58:9e', 'vm-uuid': 'b74709d7-5cbe-4542-a052-1e9b93ebe305'}),), if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:47:25 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:47:25 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:47:25 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:47:25 user nova-compute[75226]: INFO os_vif [None req-86b060ed-efdf-4235-9fb5-997603b1413a tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:58:9e,bridge_name='br-int',has_traffic_filtering=True,id=cafd7924-2152-401e-9888-519446bfa93f,network=Network(81bbbdad-218b-4fcd-b7f5-427fd49361cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcafd7924-21')
Nov 17 01:47:25 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-86b060ed-efdf-4235-9fb5-997603b1413a tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] No BDM found with device name vda, not building metadata. {{(pid=75226) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 01:47:25 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-86b060ed-efdf-4235-9fb5-997603b1413a tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] No VIF found with MAC fa:16:3e:de:58:9e, not building metadata {{(pid=75226) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 01:47:25 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:47:26 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:47:26 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:47:26 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:47:27 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:47:27 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:47:27 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:47:27 user nova-compute[75226]: DEBUG nova.compute.manager [req-b6a53670-79dd-413b-ad62-898d6732a3d1 req-d5523b02-2a77-432f-877f-531f5b1f0655 service nova] [instance: b74709d7-5cbe-4542-a052-1e9b93ebe305] Received event network-vif-plugged-cafd7924-2152-401e-9888-519446bfa93f {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:47:27 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-b6a53670-79dd-413b-ad62-898d6732a3d1 req-d5523b02-2a77-432f-877f-531f5b1f0655 service nova] Acquiring lock "b74709d7-5cbe-4542-a052-1e9b93ebe305-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:47:27 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-b6a53670-79dd-413b-ad62-898d6732a3d1 req-d5523b02-2a77-432f-877f-531f5b1f0655 service nova] Lock "b74709d7-5cbe-4542-a052-1e9b93ebe305-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:47:27 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-b6a53670-79dd-413b-ad62-898d6732a3d1 req-d5523b02-2a77-432f-877f-531f5b1f0655 service nova] Lock "b74709d7-5cbe-4542-a052-1e9b93ebe305-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:47:27 user nova-compute[75226]: DEBUG nova.compute.manager [req-b6a53670-79dd-413b-ad62-898d6732a3d1 req-d5523b02-2a77-432f-877f-531f5b1f0655 service nova] [instance: b74709d7-5cbe-4542-a052-1e9b93ebe305] No waiting events found dispatching network-vif-plugged-cafd7924-2152-401e-9888-519446bfa93f {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:47:27 user nova-compute[75226]: WARNING nova.compute.manager [req-b6a53670-79dd-413b-ad62-898d6732a3d1 req-d5523b02-2a77-432f-877f-531f5b1f0655 service nova] [instance: b74709d7-5cbe-4542-a052-1e9b93ebe305] Received unexpected event network-vif-plugged-cafd7924-2152-401e-9888-519446bfa93f for instance with vm_state building and task_state spawning.
Nov 17 01:47:28 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:47:28 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:47:28 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:47:28 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:47:28 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Starting heal instance info cache {{(pid=75226) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 17 01:47:28 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Rebuilding the list of instances to heal {{(pid=75226) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 17 01:47:28 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] [instance: b74709d7-5cbe-4542-a052-1e9b93ebe305] Skipping network cache update for instance because it is Building. {{(pid=75226) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 17 01:47:29 user nova-compute[75226]: DEBUG nova.compute.manager [None req-86b060ed-efdf-4235-9fb5-997603b1413a tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: b74709d7-5cbe-4542-a052-1e9b93ebe305] Instance event wait completed in 0 seconds for  {{(pid=75226) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 17 01:47:29 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-86b060ed-efdf-4235-9fb5-997603b1413a tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: b74709d7-5cbe-4542-a052-1e9b93ebe305] Guest created on hypervisor {{(pid=75226) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 17 01:47:29 user nova-compute[75226]: INFO nova.virt.libvirt.driver [-] [instance: b74709d7-5cbe-4542-a052-1e9b93ebe305] Instance spawned successfully.
Nov 17 01:47:29 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-86b060ed-efdf-4235-9fb5-997603b1413a tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: b74709d7-5cbe-4542-a052-1e9b93ebe305] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 17 01:47:29 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-86b060ed-efdf-4235-9fb5-997603b1413a tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: b74709d7-5cbe-4542-a052-1e9b93ebe305] Found default for hw_input_bus of None {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:47:29 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-86b060ed-efdf-4235-9fb5-997603b1413a tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: b74709d7-5cbe-4542-a052-1e9b93ebe305] Found default for hw_pointer_model of None {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:47:29 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "refresh_cache-8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:47:29 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquired lock "refresh_cache-8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:47:29 user nova-compute[75226]: DEBUG nova.network.neutron [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] [instance: 8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02] Forcefully refreshing network info cache for instance {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 17 01:47:29 user nova-compute[75226]: DEBUG nova.objects.instance [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lazy-loading 'info_cache' on Instance uuid 8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:47:29 user nova-compute[75226]: INFO nova.compute.manager [None req-86b060ed-efdf-4235-9fb5-997603b1413a tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: b74709d7-5cbe-4542-a052-1e9b93ebe305] Took 4.94 seconds to spawn the instance on the hypervisor.
Nov 17 01:47:29 user nova-compute[75226]: DEBUG nova.compute.manager [None req-86b060ed-efdf-4235-9fb5-997603b1413a tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: b74709d7-5cbe-4542-a052-1e9b93ebe305] Checking state {{(pid=75226) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 01:47:29 user nova-compute[75226]: INFO nova.compute.manager [None req-86b060ed-efdf-4235-9fb5-997603b1413a tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: b74709d7-5cbe-4542-a052-1e9b93ebe305] Took 16.95 seconds to build instance.
Nov 17 01:47:29 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-86b060ed-efdf-4235-9fb5-997603b1413a tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Lock "b74709d7-5cbe-4542-a052-1e9b93ebe305" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.066s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:47:29 user nova-compute[75226]: DEBUG nova.compute.manager [req-d88d90d3-de26-4425-9d8e-591c668a4c51 req-6905157d-98b6-46d1-8937-a92d76b54274 service nova] [instance: b74709d7-5cbe-4542-a052-1e9b93ebe305] Received event network-vif-plugged-cafd7924-2152-401e-9888-519446bfa93f {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:47:29 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-d88d90d3-de26-4425-9d8e-591c668a4c51 req-6905157d-98b6-46d1-8937-a92d76b54274 service nova] Acquiring lock "b74709d7-5cbe-4542-a052-1e9b93ebe305-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:47:29 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-d88d90d3-de26-4425-9d8e-591c668a4c51 req-6905157d-98b6-46d1-8937-a92d76b54274 service nova] Lock "b74709d7-5cbe-4542-a052-1e9b93ebe305-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:47:29 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-d88d90d3-de26-4425-9d8e-591c668a4c51 req-6905157d-98b6-46d1-8937-a92d76b54274 service nova] Lock "b74709d7-5cbe-4542-a052-1e9b93ebe305-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:47:29 user nova-compute[75226]: DEBUG nova.compute.manager [req-d88d90d3-de26-4425-9d8e-591c668a4c51 req-6905157d-98b6-46d1-8937-a92d76b54274 service nova] [instance: b74709d7-5cbe-4542-a052-1e9b93ebe305] No waiting events found dispatching network-vif-plugged-cafd7924-2152-401e-9888-519446bfa93f {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:47:29 user nova-compute[75226]: WARNING nova.compute.manager [req-d88d90d3-de26-4425-9d8e-591c668a4c51 req-6905157d-98b6-46d1-8937-a92d76b54274 service nova] [instance: b74709d7-5cbe-4542-a052-1e9b93ebe305] Received unexpected event network-vif-plugged-cafd7924-2152-401e-9888-519446bfa93f for instance with vm_state active and task_state None.
Nov 17 01:47:29 user nova-compute[75226]: DEBUG nova.network.neutron [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] [instance: 8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02] Updating instance_info_cache with network_info: [{"id": "ab437de1-a5c2-48c9-b693-902fc4b05929", "address": "fa:16:3e:2c:67:4c", "network": {"id": "44f50686-24e7-4e75-8269-4391a53286d0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1611114801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33699aa6c9db4815a1e79aff4685801e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab437de1-a5", "ovs_interfaceid": "ab437de1-a5c2-48c9-b693-902fc4b05929", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:47:29 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Releasing lock "refresh_cache-8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:47:29 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] [instance: 8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02] Updated the network info_cache for instance {{(pid=75226) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 17 01:47:29 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:47:29 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75226) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 17 01:47:30 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:47:30 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:47:32 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:47:33 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:47:34 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-ba98b4b3-a497-4fee-8db7-0964a25e0072 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02 is timed out.
Nov 17 01:47:34 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-ba98b4b3-a497-4fee-8db7-0964a25e0072 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Successfully detached device vdb from instance 8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02 from the live domain config.
Nov 17 01:47:34 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba98b4b3-a497-4fee-8db7-0964a25e0072 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] [instance: 8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02] calling os-brick to detach iSCSI Volume {{(pid=75226) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 17 01:47:34 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba98b4b3-a497-4fee-8db7-0964a25e0072 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc4cc36b490>, {'target_iqn': 'iqn.2010-10.org.openstack:2e4c54a4-b25d-4164-8c77-6885e25ab238', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pQmDcizu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:47:34 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-ba98b4b3-a497-4fee-8db7-0964a25e0072 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:47:34 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-ba98b4b3-a497-4fee-8db7-0964a25e0072 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:47:34 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-ba98b4b3-a497-4fee-8db7-0964a25e0072 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:47:34 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:47:34 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:47:34 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bd7ab1e-d880-4fc2-8acc-5675881b216b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d53822e7-4aff-4a77-9789-8759b4988dca\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2e4c54a4-b25d-4164-8c77-6885e25ab238\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ea51d240-abac-484a-8d78-49c9f9990337\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:47:34 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba98b4b3-a497-4fee-8db7-0964a25e0072 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 17 01:47:34 user nova-compute[75226]: No targets found.
Nov 17 01:47:34 user nova-compute[75226]: iSNS:
Nov 17 01:47:34 user nova-compute[75226]: No targets found.
Nov 17 01:47:34 user nova-compute[75226]: STATIC:
Nov 17 01:47:34 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:d53822e7-4aff-4a77-9789-8759b4988dca
Nov 17 01:47:34 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:47:34 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:47:34 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:2e4c54a4-b25d-4164-8c77-6885e25ab238
Nov 17 01:47:34 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:47:34 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:47:34 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:ea51d240-abac-484a-8d78-49c9f9990337
Nov 17 01:47:34 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:47:34 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:47:34 user nova-compute[75226]: FIRMWARE:
Nov 17 01:47:34 user nova-compute[75226]: No targets found.
Nov 17 01:47:34 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:47:34 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba98b4b3-a497-4fee-8db7-0964a25e0072 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 17 01:47:34 user nova-compute[75226]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 17 01:47:34 user nova-compute[75226]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75226) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 17 01:47:34 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba98b4b3-a497-4fee-8db7-0964a25e0072 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2e4c54a4-b25d-4164-8c77-6885e25ab238', 0)] {{(pid=75226) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 17 01:47:34 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:47:34 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:47:34 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[43a7d95d-8296-43e0-890a-79d3781c9ce5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e4c54a4-b25d-4164-8c77-6885e25ab238\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d53822e7-4aff-4a77-9789-8759b4988dca\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ea51d240-abac-484a-8d78-49c9f9990337\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:47:34 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:47:34 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:47:34 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[87d69137-dd8c-4df4-88ff-8d50c0405e19]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e4c54a4-b25d-4164-8c77-6885e25ab238 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea51d240-abac-484a-8d78-49c9f9990337 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53822e7-4aff-4a77-9789-8759b4988dca (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:47:34 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba98b4b3-a497-4fee-8db7-0964a25e0072 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e4c54a4-b25d-4164-8c77-6885e25ab238 (non-flash)
Nov 17 01:47:34 user nova-compute[75226]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea51d240-abac-484a-8d78-49c9f9990337 (non-flash)
Nov 17 01:47:34 user nova-compute[75226]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53822e7-4aff-4a77-9789-8759b4988dca (non-flash)
Nov 17 01:47:34 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:47:34 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba98b4b3-a497-4fee-8db7-0964a25e0072 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e4c54a4-b25d-4164-8c77-6885e25ab238 (non-flash)
Nov 17 01:47:34 user nova-compute[75226]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea51d240-abac-484a-8d78-49c9f9990337 (non-flash)
Nov 17 01:47:34 user nova-compute[75226]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53822e7-4aff-4a77-9789-8759b4988dca (non-flash)
Nov 17 01:47:34 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:47:34 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba98b4b3-a497-4fee-8db7-0964a25e0072 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc4b41fdfc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2e4c54a4-b25d-4164-8c77-6885e25ab238'): ({'sdb'}, set())}) {{(pid=75226) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 17 01:47:34 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-ba98b4b3-a497-4fee-8db7-0964a25e0072 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Removing single pathed devices sdb {{(pid=75226) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 17 01:47:34 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:47:34 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:47:34 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[5769002e-ac18-4744-b4ca-01717aa806b2]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:47:34 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:47:34 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:47:34 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[aba5add2-4473-492d-bff3-27db63012c56]: (4, ('ok\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:47:34 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-ba98b4b3-a497-4fee-8db7-0964a25e0072 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Flushing IO for device /dev/sdb {{(pid=75226) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 17 01:47:34 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:47:34 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:47:34 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[78f2e05e-6f33-4b33-9a9d-ba344f24e40b]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:47:34 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-ba98b4b3-a497-4fee-8db7-0964a25e0072 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75226) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 17 01:47:34 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:47:34 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.052s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:47:34 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[acae42e7-d2a1-4845-81c3-d6d93c72185b]: (4, ('1', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:47:34 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-ba98b4b3-a497-4fee-8db7-0964a25e0072 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75226) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 17 01:47:34 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-ba98b4b3-a497-4fee-8db7-0964a25e0072 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] SCSI volumes sdb have been removed. {{(pid=75226) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 17 01:47:34 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba98b4b3-a497-4fee-8db7-0964a25e0072 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2e4c54a4-b25d-4164-8c77-6885e25ab238')] {{(pid=75226) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 17 01:47:34 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e4c54a4-b25d-4164-8c77-6885e25ab238 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:47:34 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e4c54a4-b25d-4164-8c77-6885e25ab238 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:47:34 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[b61927bf-32bf-4d24-bc71-863077fe1238]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:47:34 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba98b4b3-a497-4fee-8db7-0964a25e0072 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:47:34 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e4c54a4-b25d-4164-8c77-6885e25ab238 -p 172.16.0.220:3260 --logout {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:47:34 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e4c54a4-b25d-4164-8c77-6885e25ab238 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:47:34 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb26e503-f1a0-49b3-967e-16db7d6c7418]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:2e4c54a4-b25d-4164-8c77-6885e25ab238, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:2e4c54a4-b25d-4164-8c77-6885e25ab238, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:47:34 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba98b4b3-a497-4fee-8db7-0964a25e0072 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:2e4c54a4-b25d-4164-8c77-6885e25ab238, portal: 172.16.0.220,3260]
Nov 17 01:47:34 user nova-compute[75226]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:2e4c54a4-b25d-4164-8c77-6885e25ab238, portal: 172.16.0.220,3260] successful.
Nov 17 01:47:34 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:47:34 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e4c54a4-b25d-4164-8c77-6885e25ab238 -p 172.16.0.220:3260 --op delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:47:34 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e4c54a4-b25d-4164-8c77-6885e25ab238 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:47:34 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd93aaee-08f3-4156-93eb-6f80cca39a58]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:47:34 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba98b4b3-a497-4fee-8db7-0964a25e0072 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:47:34 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-ba98b4b3-a497-4fee-8db7-0964a25e0072 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.328s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:47:34 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba98b4b3-a497-4fee-8db7-0964a25e0072 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] <== disconnect_volume: return (329ms) None {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:47:34 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba98b4b3-a497-4fee-8db7-0964a25e0072 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] [instance: 8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02] Disconnected iSCSI Volume {{(pid=75226) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 17 01:47:35 user nova-compute[75226]: DEBUG nova.objects.instance [None req-ba98b4b3-a497-4fee-8db7-0964a25e0072 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Lazy-loading 'flavor' on Instance uuid 8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:47:35 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-ba98b4b3-a497-4fee-8db7-0964a25e0072 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Lock "8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.726s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:47:35 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:47:36 user nova-compute[75226]: DEBUG nova.compute.manager [req-27c1e347-26ca-4b7c-8ec7-061fde939ebf req-54e350e2-9d7f-42a5-a463-0a0ebab5a366 service nova] [instance: b2a30d8f-1521-4d8a-b880-65f31ae1b704] Received event network-changed-f56ebc06-b6d7-4708-ade5-7627a7e7599a {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:47:36 user nova-compute[75226]: DEBUG nova.compute.manager [req-27c1e347-26ca-4b7c-8ec7-061fde939ebf req-54e350e2-9d7f-42a5-a463-0a0ebab5a366 service nova] [instance: b2a30d8f-1521-4d8a-b880-65f31ae1b704] Refreshing instance network info cache due to event network-changed-f56ebc06-b6d7-4708-ade5-7627a7e7599a. {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 01:47:36 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-27c1e347-26ca-4b7c-8ec7-061fde939ebf req-54e350e2-9d7f-42a5-a463-0a0ebab5a366 service nova] Acquiring lock "refresh_cache-b2a30d8f-1521-4d8a-b880-65f31ae1b704" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:47:36 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-27c1e347-26ca-4b7c-8ec7-061fde939ebf req-54e350e2-9d7f-42a5-a463-0a0ebab5a366 service nova] Acquired lock "refresh_cache-b2a30d8f-1521-4d8a-b880-65f31ae1b704" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:47:36 user nova-compute[75226]: DEBUG nova.network.neutron [req-27c1e347-26ca-4b7c-8ec7-061fde939ebf req-54e350e2-9d7f-42a5-a463-0a0ebab5a366 service nova] [instance: b2a30d8f-1521-4d8a-b880-65f31ae1b704] Refreshing network info cache for port f56ebc06-b6d7-4708-ade5-7627a7e7599a {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 01:47:36 user nova-compute[75226]: DEBUG nova.network.neutron [req-27c1e347-26ca-4b7c-8ec7-061fde939ebf req-54e350e2-9d7f-42a5-a463-0a0ebab5a366 service nova] [instance: b2a30d8f-1521-4d8a-b880-65f31ae1b704] Updated VIF entry in instance network info cache for port f56ebc06-b6d7-4708-ade5-7627a7e7599a. {{(pid=75226) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 01:47:36 user nova-compute[75226]: DEBUG nova.network.neutron [req-27c1e347-26ca-4b7c-8ec7-061fde939ebf req-54e350e2-9d7f-42a5-a463-0a0ebab5a366 service nova] [instance: b2a30d8f-1521-4d8a-b880-65f31ae1b704] Updating instance_info_cache with network_info: [{"id": "f56ebc06-b6d7-4708-ade5-7627a7e7599a", "address": "fa:16:3e:5f:3f:57", "network": {"id": "2d06b621-84a6-48dc-be05-92b6724810e3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1055056582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "acc65d32b52442aea872bf9f6025c4e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf56ebc06-b6", "ovs_interfaceid": "f56ebc06-b6d7-4708-ade5-7627a7e7599a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:47:36 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-27c1e347-26ca-4b7c-8ec7-061fde939ebf req-54e350e2-9d7f-42a5-a463-0a0ebab5a366 service nova] Releasing lock "refresh_cache-b2a30d8f-1521-4d8a-b880-65f31ae1b704" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:47:37 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-269dc478-2313-4df1-a59a-a2ef251f58c2 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Acquiring lock "b2a30d8f-1521-4d8a-b880-65f31ae1b704" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:47:37 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-269dc478-2313-4df1-a59a-a2ef251f58c2 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Lock "b2a30d8f-1521-4d8a-b880-65f31ae1b704" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:47:37 user nova-compute[75226]: DEBUG nova.objects.instance [None req-269dc478-2313-4df1-a59a-a2ef251f58c2 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Lazy-loading 'flavor' on Instance uuid b2a30d8f-1521-4d8a-b880-65f31ae1b704 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:47:37 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-269dc478-2313-4df1-a59a-a2ef251f58c2 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] [instance: b2a30d8f-1521-4d8a-b880-65f31ae1b704] Ignoring supplied device name: /dev/vdb
Nov 17 01:47:37 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-269dc478-2313-4df1-a59a-a2ef251f58c2 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Lock "b2a30d8f-1521-4d8a-b880-65f31ae1b704" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:47:37 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-269dc478-2313-4df1-a59a-a2ef251f58c2 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Acquiring lock "b2a30d8f-1521-4d8a-b880-65f31ae1b704" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:47:37 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-269dc478-2313-4df1-a59a-a2ef251f58c2 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Lock "b2a30d8f-1521-4d8a-b880-65f31ae1b704" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:47:37 user nova-compute[75226]: INFO nova.compute.manager [None req-269dc478-2313-4df1-a59a-a2ef251f58c2 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] [instance: b2a30d8f-1521-4d8a-b880-65f31ae1b704] Attaching volume 08dec5d1-19fe-4280-8587-db33eecf55b2 to /dev/vdb
Nov 17 01:47:37 user nova-compute[75226]: DEBUG os_brick.utils [None req-269dc478-2313-4df1-a59a-a2ef251f58c2 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:47:37 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:47:38 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:47:38 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[36923c94-5af6-46d9-9e12-cec0ac88d161]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f62857db69\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:47:38 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:47:38 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:47:38 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1021821-1683-4144-8cf4-a38707231307]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:47:38 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:47:38 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:47:38 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6b6ad51-a888-4280-bc4b-3b5c3130c899]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:47:38 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[b799ca89-b8bb-45d8-aa71-6c2434dcd3da]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:47:38 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-269dc478-2313-4df1-a59a-a2ef251f58c2 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Running cmd (subprocess): nvme version {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:47:38 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-269dc478-2313-4df1-a59a-a2ef251f58c2 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] 'nvme version' failed. Not Retrying. {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 01:47:38 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.nvmeof [None req-269dc478-2313-4df1-a59a-a2ef251f58c2 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] nvme not present on system {{(pid=75226) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 17 01:47:38 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:47:38 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 01:47:38 user nova-compute[75226]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 17 01:47:38 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c92ae36-de88-4d7a-8090-b45a3c0ebdcf]: (4, '') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:47:38 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-269dc478-2313-4df1-a59a-a2ef251f58c2 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75226) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 17 01:47:38 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-269dc478-2313-4df1-a59a-a2ef251f58c2 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75226) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 17 01:47:38 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-269dc478-2313-4df1-a59a-a2ef251f58c2 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] LIGHTOS: no hostnqn found. {{(pid=75226) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 17 01:47:38 user nova-compute[75226]: DEBUG os_brick.utils [None req-269dc478-2313-4df1-a59a-a2ef251f58c2 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f62857db69', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:47:38 user nova-compute[75226]: DEBUG nova.virt.block_device [None req-269dc478-2313-4df1-a59a-a2ef251f58c2 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] [instance: b2a30d8f-1521-4d8a-b880-65f31ae1b704] Updating existing volume attachment record: c5901741-dab1-4cea-a13b-c536d91efbee {{(pid=75226) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 17 01:47:38 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:47:40 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:47:43 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-269dc478-2313-4df1-a59a-a2ef251f58c2 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] [instance: b2a30d8f-1521-4d8a-b880-65f31ae1b704] Calling os-brick to attach iSCSI Volume {{(pid=75226) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 17 01:47:43 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-269dc478-2313-4df1-a59a-a2ef251f58c2 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc4cc36b490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:08dec5d1-19fe-4280-8587-db33eecf55b2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fxCbzRQA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:47:43 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-269dc478-2313-4df1-a59a-a2ef251f58c2 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:47:43 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-269dc478-2313-4df1-a59a-a2ef251f58c2 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:47:43 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-269dc478-2313-4df1-a59a-a2ef251f58c2 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:47:43 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-269dc478-2313-4df1-a59a-a2ef251f58c2 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:47:43 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-269dc478-2313-4df1-a59a-a2ef251f58c2 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:08dec5d1-19fe-4280-8587-db33eecf55b2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:47:43 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-269dc478-2313-4df1-a59a-a2ef251f58c2 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:08dec5d1-19fe-4280-8587-db33eecf55b2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:47:43 user nova-compute[75226]: INFO os_brick.initiator.connectors.iscsi [None req-269dc478-2313-4df1-a59a-a2ef251f58c2 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 17 01:47:43 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08dec5d1-19fe-4280-8587-db33eecf55b2 -p 172.16.0.220:3260 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:47:43 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08dec5d1-19fe-4280-8587-db33eecf55b2 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:47:43 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c91e0b5-c175-4530-b4e7-fe9e0d476362]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:47:43 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-269dc478-2313-4df1-a59a-a2ef251f58c2 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 17 01:47:43 user nova-compute[75226]:  {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:47:43 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08dec5d1-19fe-4280-8587-db33eecf55b2 -p 172.16.0.220:3260 --interface default --op new {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:47:43 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08dec5d1-19fe-4280-8587-db33eecf55b2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:47:43 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8da2bd3-8f7b-46f4-87f9-63fb20a5a02b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:08dec5d1-19fe-4280-8587-db33eecf55b2] added\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:47:43 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-269dc478-2313-4df1-a59a-a2ef251f58c2 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:08dec5d1-19fe-4280-8587-db33eecf55b2] added
Nov 17 01:47:43 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:47:43 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08dec5d1-19fe-4280-8587-db33eecf55b2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:47:43 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08dec5d1-19fe-4280-8587-db33eecf55b2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.033s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:47:43 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[7abd2ec5-c275-4d01-ade6-60a8fece043e]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:47:43 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-269dc478-2313-4df1-a59a-a2ef251f58c2 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:47:43 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08dec5d1-19fe-4280-8587-db33eecf55b2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:47:43 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08dec5d1-19fe-4280-8587-db33eecf55b2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:47:43 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b2e5d15-2b0d-4782-b1e6-ac85dcf7b275]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:47:43 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-269dc478-2313-4df1-a59a-a2ef251f58c2 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:47:43 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08dec5d1-19fe-4280-8587-db33eecf55b2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fxCbzRQA {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:47:43 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08dec5d1-19fe-4280-8587-db33eecf55b2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fxCbzRQA" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:47:43 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[252b6765-7860-46a2-b56b-ed82ed75f8c7]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:47:43 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-269dc478-2313-4df1-a59a-a2ef251f58c2 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fxCbzRQA'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:47:43 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08dec5d1-19fe-4280-8587-db33eecf55b2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:47:43 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08dec5d1-19fe-4280-8587-db33eecf55b2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:47:43 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[df691dff-c58e-49bf-b9a3-4360c1f75e8c]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:47:43 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-269dc478-2313-4df1-a59a-a2ef251f58c2 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:47:43 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:47:43 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:47:43 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbfee3c9-a684-4737-88f5-3332bb3d2dfc]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea51d240-abac-484a-8d78-49c9f9990337 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53822e7-4aff-4a77-9789-8759b4988dca (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:47:43 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-269dc478-2313-4df1-a59a-a2ef251f58c2 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea51d240-abac-484a-8d78-49c9f9990337 (non-flash)
Nov 17 01:47:43 user nova-compute[75226]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53822e7-4aff-4a77-9789-8759b4988dca (non-flash)
Nov 17 01:47:43 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:47:43 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-269dc478-2313-4df1-a59a-a2ef251f58c2 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea51d240-abac-484a-8d78-49c9f9990337 (non-flash)
Nov 17 01:47:43 user nova-compute[75226]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53822e7-4aff-4a77-9789-8759b4988dca (non-flash)
Nov 17 01:47:43 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:47:43 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08dec5d1-19fe-4280-8587-db33eecf55b2 -p 172.16.0.220:3260 --login {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:47:43 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:47:43 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08dec5d1-19fe-4280-8587-db33eecf55b2 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:47:43 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc06e3fb-957f-4d6d-a0c7-f1928637b53f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:08dec5d1-19fe-4280-8587-db33eecf55b2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:08dec5d1-19fe-4280-8587-db33eecf55b2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:47:43 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-269dc478-2313-4df1-a59a-a2ef251f58c2 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:08dec5d1-19fe-4280-8587-db33eecf55b2, portal: 172.16.0.220,3260]
Nov 17 01:47:43 user nova-compute[75226]: Login to [iface: default, target: iqn.2010-10.org.openstack:08dec5d1-19fe-4280-8587-db33eecf55b2, portal: 172.16.0.220,3260] successful.
Nov 17 01:47:43 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:47:43 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08dec5d1-19fe-4280-8587-db33eecf55b2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:47:43 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08dec5d1-19fe-4280-8587-db33eecf55b2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:47:43 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e9a9ee3-09b3-4f8b-b81a-46b47832925d]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:47:43 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-269dc478-2313-4df1-a59a-a2ef251f58c2 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:47:43 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:47:43 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:47:43 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[e96ff233-a3da-4d52-8eb3-af0319719445]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea51d240-abac-484a-8d78-49c9f9990337 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53822e7-4aff-4a77-9789-8759b4988dca (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08dec5d1-19fe-4280-8587-db33eecf55b2 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:47:43 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-269dc478-2313-4df1-a59a-a2ef251f58c2 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea51d240-abac-484a-8d78-49c9f9990337 (non-flash)
Nov 17 01:47:43 user nova-compute[75226]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53822e7-4aff-4a77-9789-8759b4988dca (non-flash)
Nov 17 01:47:43 user nova-compute[75226]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08dec5d1-19fe-4280-8587-db33eecf55b2 (non-flash)
Nov 17 01:47:43 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:47:43 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-269dc478-2313-4df1-a59a-a2ef251f58c2 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea51d240-abac-484a-8d78-49c9f9990337 (non-flash)
Nov 17 01:47:43 user nova-compute[75226]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53822e7-4aff-4a77-9789-8759b4988dca (non-flash)
Nov 17 01:47:43 user nova-compute[75226]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08dec5d1-19fe-4280-8587-db33eecf55b2 (non-flash)
Nov 17 01:47:43 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:47:43 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-269dc478-2313-4df1-a59a-a2ef251f58c2 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:08dec5d1-19fe-4280-8587-db33eecf55b2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.298s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:47:43 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-269dc478-2313-4df1-a59a-a2ef251f58c2 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Connected to 172.16.0.220:3260 {{(pid=75226) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 17 01:47:43 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-269dc478-2313-4df1-a59a-a2ef251f58c2 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] HCTL ('33', '-', '-', 0) found on session 55 with lun 0 {{(pid=75226) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 17 01:47:43 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-269dc478-2313-4df1-a59a-a2ef251f58c2 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75226) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 17 01:47:43 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:47:43 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:47:43 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[f88421a4-5e44-4eec-b5c1-96a1dca4e6d9]: (4, ('- - 0', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:47:43 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-269dc478-2313-4df1-a59a-a2ef251f58c2 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Searching for a device in session 55 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75226) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 01:47:43 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-269dc478-2313-4df1-a59a-a2ef251f58c2 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:08dec5d1-19fe-4280-8587-db33eecf55b2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fxCbzRQA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75226) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 17 01:47:44 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-269dc478-2313-4df1-a59a-a2ef251f58c2 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.333s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:47:44 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-269dc478-2313-4df1-a59a-a2ef251f58c2 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] <== connect_volume: return (1334ms) {'type': 'block', 'scsi_wwn': '26139333730663031', 'path': '/dev/sdb'} {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:47:44 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-269dc478-2313-4df1-a59a-a2ef251f58c2 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] [instance: b2a30d8f-1521-4d8a-b880-65f31ae1b704] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26139333730663031', 'path': '/dev/sdb'} {{(pid=75226) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 17 01:47:44 user nova-compute[75226]: DEBUG nova.objects.instance [None req-269dc478-2313-4df1-a59a-a2ef251f58c2 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Lazy-loading 'flavor' on Instance uuid b2a30d8f-1521-4d8a-b880-65f31ae1b704 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:47:44 user nova-compute[75226]: DEBUG nova.virt.libvirt.guest [None req-269dc478-2313-4df1-a59a-a2ef251f58c2 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] attach device xml: <disk type="block" device="disk">
Nov 17 01:47:44 user nova-compute[75226]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 01:47:44 user nova-compute[75226]:   <source dev="/dev/sdb"/>
Nov 17 01:47:44 user nova-compute[75226]:   <target dev="vdb" bus="virtio"/>
Nov 17 01:47:44 user nova-compute[75226]:   <serial>08dec5d1-19fe-4280-8587-db33eecf55b2</serial>
Nov 17 01:47:44 user nova-compute[75226]: </disk>
Nov 17 01:47:44 user nova-compute[75226]:  {{(pid=75226) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 17 01:47:45 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-269dc478-2313-4df1-a59a-a2ef251f58c2 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] No BDM found with device name vda, not building metadata. {{(pid=75226) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 01:47:45 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-269dc478-2313-4df1-a59a-a2ef251f58c2 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75226) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 01:47:45 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-269dc478-2313-4df1-a59a-a2ef251f58c2 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] No VIF found with MAC fa:16:3e:5f:3f:57, not building metadata {{(pid=75226) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 01:47:45 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-269dc478-2313-4df1-a59a-a2ef251f58c2 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Lock "b2a30d8f-1521-4d8a-b880-65f31ae1b704" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.349s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:47:45 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:47:48 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:47:50 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:47:53 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:47:55 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:47:55 user nova-compute[75226]: DEBUG nova.compute.manager [req-bb13f1ee-a5ad-45a6-b31a-ec076b05aadc req-91e1eab5-26f1-4268-91ad-a210603e9d2d service nova] [instance: 014533a1-a4c3-4c65-a121-f46486cc5998] Received event network-changed-151e4c1a-3552-45f8-a49d-049e1c629c5b {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:47:55 user nova-compute[75226]: DEBUG nova.compute.manager [req-bb13f1ee-a5ad-45a6-b31a-ec076b05aadc req-91e1eab5-26f1-4268-91ad-a210603e9d2d service nova] [instance: 014533a1-a4c3-4c65-a121-f46486cc5998] Refreshing instance network info cache due to event network-changed-151e4c1a-3552-45f8-a49d-049e1c629c5b. {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 01:47:55 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-bb13f1ee-a5ad-45a6-b31a-ec076b05aadc req-91e1eab5-26f1-4268-91ad-a210603e9d2d service nova] Acquiring lock "refresh_cache-014533a1-a4c3-4c65-a121-f46486cc5998" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:47:55 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-bb13f1ee-a5ad-45a6-b31a-ec076b05aadc req-91e1eab5-26f1-4268-91ad-a210603e9d2d service nova] Acquired lock "refresh_cache-014533a1-a4c3-4c65-a121-f46486cc5998" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:47:55 user nova-compute[75226]: DEBUG nova.network.neutron [req-bb13f1ee-a5ad-45a6-b31a-ec076b05aadc req-91e1eab5-26f1-4268-91ad-a210603e9d2d service nova] [instance: 014533a1-a4c3-4c65-a121-f46486cc5998] Refreshing network info cache for port 151e4c1a-3552-45f8-a49d-049e1c629c5b {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 01:47:56 user nova-compute[75226]: DEBUG nova.network.neutron [req-bb13f1ee-a5ad-45a6-b31a-ec076b05aadc req-91e1eab5-26f1-4268-91ad-a210603e9d2d service nova] [instance: 014533a1-a4c3-4c65-a121-f46486cc5998] Updated VIF entry in instance network info cache for port 151e4c1a-3552-45f8-a49d-049e1c629c5b. {{(pid=75226) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 01:47:56 user nova-compute[75226]: DEBUG nova.network.neutron [req-bb13f1ee-a5ad-45a6-b31a-ec076b05aadc req-91e1eab5-26f1-4268-91ad-a210603e9d2d service nova] [instance: 014533a1-a4c3-4c65-a121-f46486cc5998] Updating instance_info_cache with network_info: [{"id": "151e4c1a-3552-45f8-a49d-049e1c629c5b", "address": "fa:16:3e:35:6c:13", "network": {"id": "a1d04537-c0d6-46a4-bce4-de3bb5e89921", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-813941300-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c0b07ca915e4960b1e1998855e23e5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap151e4c1a-35", "ovs_interfaceid": "151e4c1a-3552-45f8-a49d-049e1c629c5b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:47:56 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-bb13f1ee-a5ad-45a6-b31a-ec076b05aadc req-91e1eab5-26f1-4268-91ad-a210603e9d2d service nova] Releasing lock "refresh_cache-014533a1-a4c3-4c65-a121-f46486cc5998" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:47:58 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:47:59 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-666ee534-3c5b-419a-89df-95ff7110d1c9 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Acquiring lock "b2a30d8f-1521-4d8a-b880-65f31ae1b704" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:47:59 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-666ee534-3c5b-419a-89df-95ff7110d1c9 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Lock "b2a30d8f-1521-4d8a-b880-65f31ae1b704" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:47:59 user nova-compute[75226]: INFO nova.compute.manager [None req-666ee534-3c5b-419a-89df-95ff7110d1c9 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] [instance: b2a30d8f-1521-4d8a-b880-65f31ae1b704] Detaching volume 08dec5d1-19fe-4280-8587-db33eecf55b2
Nov 17 01:47:59 user nova-compute[75226]: INFO nova.virt.block_device [None req-666ee534-3c5b-419a-89df-95ff7110d1c9 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] [instance: b2a30d8f-1521-4d8a-b880-65f31ae1b704] Attempting to driver detach volume 08dec5d1-19fe-4280-8587-db33eecf55b2 from mountpoint /dev/vdb
Nov 17 01:47:59 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-666ee534-3c5b-419a-89df-95ff7110d1c9 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Attempting to detach device vdb from instance b2a30d8f-1521-4d8a-b880-65f31ae1b704 from the persistent domain config. {{(pid=75226) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 17 01:47:59 user nova-compute[75226]: DEBUG nova.virt.libvirt.guest [None req-666ee534-3c5b-419a-89df-95ff7110d1c9 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] detach device xml: <disk type="block" device="disk">
Nov 17 01:47:59 user nova-compute[75226]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 01:47:59 user nova-compute[75226]:   <source dev="/dev/sdb"/>
Nov 17 01:47:59 user nova-compute[75226]:   <target dev="vdb" bus="virtio"/>
Nov 17 01:47:59 user nova-compute[75226]:   <serial>08dec5d1-19fe-4280-8587-db33eecf55b2</serial>
Nov 17 01:47:59 user nova-compute[75226]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 17 01:47:59 user nova-compute[75226]: </disk>
Nov 17 01:47:59 user nova-compute[75226]:  {{(pid=75226) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 17 01:47:59 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-666ee534-3c5b-419a-89df-95ff7110d1c9 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Successfully detached device vdb from instance b2a30d8f-1521-4d8a-b880-65f31ae1b704 from the persistent domain config.
Nov 17 01:47:59 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-666ee534-3c5b-419a-89df-95ff7110d1c9 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b2a30d8f-1521-4d8a-b880-65f31ae1b704 from the live domain config. {{(pid=75226) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 17 01:47:59 user nova-compute[75226]: DEBUG nova.virt.libvirt.guest [None req-666ee534-3c5b-419a-89df-95ff7110d1c9 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] detach device xml: <disk type="block" device="disk">
Nov 17 01:47:59 user nova-compute[75226]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 01:47:59 user nova-compute[75226]:   <source dev="/dev/sdb"/>
Nov 17 01:47:59 user nova-compute[75226]:   <target dev="vdb" bus="virtio"/>
Nov 17 01:47:59 user nova-compute[75226]:   <serial>08dec5d1-19fe-4280-8587-db33eecf55b2</serial>
Nov 17 01:47:59 user nova-compute[75226]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 17 01:47:59 user nova-compute[75226]: </disk>
Nov 17 01:47:59 user nova-compute[75226]:  {{(pid=75226) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 17 01:47:59 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-5013073e-72bd-4900-9b22-254d5f556635 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Acquiring lock "014533a1-a4c3-4c65-a121-f46486cc5998" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:47:59 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-5013073e-72bd-4900-9b22-254d5f556635 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Lock "014533a1-a4c3-4c65-a121-f46486cc5998" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:47:59 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-f3eda472-932c-4dab-8f0a-69485538192f tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Acquiring lock "b2a30d8f-1521-4d8a-b880-65f31ae1b704" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:47:59 user nova-compute[75226]: DEBUG nova.objects.instance [None req-5013073e-72bd-4900-9b22-254d5f556635 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Lazy-loading 'flavor' on Instance uuid 014533a1-a4c3-4c65-a121-f46486cc5998 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:47:59 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-5013073e-72bd-4900-9b22-254d5f556635 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Lock "014533a1-a4c3-4c65-a121-f46486cc5998" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:47:59 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-5013073e-72bd-4900-9b22-254d5f556635 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Acquiring lock "014533a1-a4c3-4c65-a121-f46486cc5998" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:47:59 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-5013073e-72bd-4900-9b22-254d5f556635 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Lock "014533a1-a4c3-4c65-a121-f46486cc5998" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:47:59 user nova-compute[75226]: INFO nova.compute.manager [None req-5013073e-72bd-4900-9b22-254d5f556635 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] [instance: 014533a1-a4c3-4c65-a121-f46486cc5998] Attaching volume a7833efd-b3b8-4430-9e49-f81a694d1718 to /dev/vdb
Nov 17 01:47:59 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-666ee534-3c5b-419a-89df-95ff7110d1c9 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b2a30d8f-1521-4d8a-b880-65f31ae1b704 {{(pid=75226) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 17 01:47:59 user nova-compute[75226]: DEBUG os_brick.utils [None req-5013073e-72bd-4900-9b22-254d5f556635 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:47:59 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:47:59 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:47:59 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[abb47275-3924-42e2-9816-a084413905db]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f62857db69\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:47:59 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:47:59 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:47:59 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1e5c19d-6266-4ca2-bd39-88eeb2451468]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:47:59 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:47:59 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:47:59 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[221a6326-b5dd-44dc-8d34-f3176d3de230]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:47:59 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2cdc683-fe9f-46e5-ac41-04147ba86588]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:47:59 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-5013073e-72bd-4900-9b22-254d5f556635 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Running cmd (subprocess): nvme version {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:48:00 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-5013073e-72bd-4900-9b22-254d5f556635 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] 'nvme version' failed. Not Retrying. {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 01:48:00 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5013073e-72bd-4900-9b22-254d5f556635 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] nvme not present on system {{(pid=75226) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 17 01:48:00 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:48:00 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 01:48:00 user nova-compute[75226]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 17 01:48:00 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[b98f3c65-73a5-44cd-ab26-894e93b83829]: (4, '') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:48:00 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-5013073e-72bd-4900-9b22-254d5f556635 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75226) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 17 01:48:00 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-5013073e-72bd-4900-9b22-254d5f556635 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75226) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 17 01:48:00 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-5013073e-72bd-4900-9b22-254d5f556635 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] LIGHTOS: no hostnqn found. {{(pid=75226) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 17 01:48:00 user nova-compute[75226]: DEBUG os_brick.utils [None req-5013073e-72bd-4900-9b22-254d5f556635 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f62857db69', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:48:00 user nova-compute[75226]: DEBUG nova.virt.block_device [None req-5013073e-72bd-4900-9b22-254d5f556635 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] [instance: 014533a1-a4c3-4c65-a121-f46486cc5998] Updating existing volume attachment record: 1feab11d-8920-46b9-85d8-4569c3cd6c19 {{(pid=75226) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 17 01:48:00 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:48:03 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:48:05 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5013073e-72bd-4900-9b22-254d5f556635 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] [instance: 014533a1-a4c3-4c65-a121-f46486cc5998] Calling os-brick to attach iSCSI Volume {{(pid=75226) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 17 01:48:05 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-5013073e-72bd-4900-9b22-254d5f556635 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc4cc36b490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a7833efd-b3b8-4430-9e49-f81a694d1718', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dstKSaBM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:48:05 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-5013073e-72bd-4900-9b22-254d5f556635 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:48:05 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-5013073e-72bd-4900-9b22-254d5f556635 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:48:05 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-5013073e-72bd-4900-9b22-254d5f556635 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:48:05 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-5013073e-72bd-4900-9b22-254d5f556635 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:48:05 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-5013073e-72bd-4900-9b22-254d5f556635 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a7833efd-b3b8-4430-9e49-f81a694d1718" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:48:05 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-5013073e-72bd-4900-9b22-254d5f556635 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a7833efd-b3b8-4430-9e49-f81a694d1718" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:48:05 user nova-compute[75226]: INFO os_brick.initiator.connectors.iscsi [None req-5013073e-72bd-4900-9b22-254d5f556635 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 17 01:48:05 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7833efd-b3b8-4430-9e49-f81a694d1718 -p 172.16.0.220:3260 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:48:05 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7833efd-b3b8-4430-9e49-f81a694d1718 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:48:05 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8e0d318-765d-4bb9-8743-bfc8919c7622]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:48:05 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-5013073e-72bd-4900-9b22-254d5f556635 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 17 01:48:05 user nova-compute[75226]:  {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:48:05 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7833efd-b3b8-4430-9e49-f81a694d1718 -p 172.16.0.220:3260 --interface default --op new {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:48:05 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7833efd-b3b8-4430-9e49-f81a694d1718 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:48:05 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d1dd83e-a0e1-48c7-8a52-8a32e9ea6bf6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a7833efd-b3b8-4430-9e49-f81a694d1718] added\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:48:05 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-5013073e-72bd-4900-9b22-254d5f556635 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a7833efd-b3b8-4430-9e49-f81a694d1718] added
Nov 17 01:48:05 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:48:05 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7833efd-b3b8-4430-9e49-f81a694d1718 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:48:05 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7833efd-b3b8-4430-9e49-f81a694d1718 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:48:05 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[21491c15-3cad-4757-a3a4-25636c4d6c91]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:48:05 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-5013073e-72bd-4900-9b22-254d5f556635 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:48:05 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7833efd-b3b8-4430-9e49-f81a694d1718 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:48:05 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7833efd-b3b8-4430-9e49-f81a694d1718 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:48:05 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[107d0303-7636-457c-a654-0c9ba5002872]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:48:05 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-5013073e-72bd-4900-9b22-254d5f556635 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:48:05 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7833efd-b3b8-4430-9e49-f81a694d1718 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dstKSaBM {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:48:05 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7833efd-b3b8-4430-9e49-f81a694d1718 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dstKSaBM" returned: 0 in 0.023s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:48:05 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[2caa60e2-31a9-4b9f-af55-11c1e01f7ba6]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:48:05 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-5013073e-72bd-4900-9b22-254d5f556635 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dstKSaBM'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:48:05 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7833efd-b3b8-4430-9e49-f81a694d1718 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:48:05 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7833efd-b3b8-4430-9e49-f81a694d1718 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:48:05 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[61cb1e60-166c-4841-8423-38c7ac2c8808]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:48:05 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-5013073e-72bd-4900-9b22-254d5f556635 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:48:05 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:48:05 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:48:05 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed370ebc-efdc-4806-8717-69f1b4d4ad51]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea51d240-abac-484a-8d78-49c9f9990337 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53822e7-4aff-4a77-9789-8759b4988dca (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08dec5d1-19fe-4280-8587-db33eecf55b2 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:48:05 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-5013073e-72bd-4900-9b22-254d5f556635 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea51d240-abac-484a-8d78-49c9f9990337 (non-flash)
Nov 17 01:48:05 user nova-compute[75226]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53822e7-4aff-4a77-9789-8759b4988dca (non-flash)
Nov 17 01:48:05 user nova-compute[75226]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08dec5d1-19fe-4280-8587-db33eecf55b2 (non-flash)
Nov 17 01:48:05 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:48:05 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-5013073e-72bd-4900-9b22-254d5f556635 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea51d240-abac-484a-8d78-49c9f9990337 (non-flash)
Nov 17 01:48:05 user nova-compute[75226]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53822e7-4aff-4a77-9789-8759b4988dca (non-flash)
Nov 17 01:48:05 user nova-compute[75226]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08dec5d1-19fe-4280-8587-db33eecf55b2 (non-flash)
Nov 17 01:48:05 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:48:05 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7833efd-b3b8-4430-9e49-f81a694d1718 -p 172.16.0.220:3260 --login {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:48:05 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7833efd-b3b8-4430-9e49-f81a694d1718 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:48:05 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[3456359e-2d21-4f6a-81b2-5fc8e6ef3d47]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a7833efd-b3b8-4430-9e49-f81a694d1718, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a7833efd-b3b8-4430-9e49-f81a694d1718, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:48:05 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-5013073e-72bd-4900-9b22-254d5f556635 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a7833efd-b3b8-4430-9e49-f81a694d1718, portal: 172.16.0.220,3260]
Nov 17 01:48:05 user nova-compute[75226]: Login to [iface: default, target: iqn.2010-10.org.openstack:a7833efd-b3b8-4430-9e49-f81a694d1718, portal: 172.16.0.220,3260] successful.
Nov 17 01:48:05 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:48:05 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7833efd-b3b8-4430-9e49-f81a694d1718 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:48:05 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7833efd-b3b8-4430-9e49-f81a694d1718 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:48:05 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ac31680-dc93-49d5-af36-197f165443fb]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:48:05 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-5013073e-72bd-4900-9b22-254d5f556635 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:48:05 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:48:05 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:48:05 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:48:05 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[86dd59c4-8a2c-498f-b228-cd1f3ce3d69d]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea51d240-abac-484a-8d78-49c9f9990337 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53822e7-4aff-4a77-9789-8759b4988dca (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08dec5d1-19fe-4280-8587-db33eecf55b2 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7833efd-b3b8-4430-9e49-f81a694d1718 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:48:05 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-5013073e-72bd-4900-9b22-254d5f556635 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea51d240-abac-484a-8d78-49c9f9990337 (non-flash)
Nov 17 01:48:05 user nova-compute[75226]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53822e7-4aff-4a77-9789-8759b4988dca (non-flash)
Nov 17 01:48:05 user nova-compute[75226]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08dec5d1-19fe-4280-8587-db33eecf55b2 (non-flash)
Nov 17 01:48:05 user nova-compute[75226]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7833efd-b3b8-4430-9e49-f81a694d1718 (non-flash)
Nov 17 01:48:05 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:48:05 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-5013073e-72bd-4900-9b22-254d5f556635 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea51d240-abac-484a-8d78-49c9f9990337 (non-flash)
Nov 17 01:48:05 user nova-compute[75226]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53822e7-4aff-4a77-9789-8759b4988dca (non-flash)
Nov 17 01:48:05 user nova-compute[75226]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08dec5d1-19fe-4280-8587-db33eecf55b2 (non-flash)
Nov 17 01:48:05 user nova-compute[75226]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7833efd-b3b8-4430-9e49-f81a694d1718 (non-flash)
Nov 17 01:48:05 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:48:05 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-5013073e-72bd-4900-9b22-254d5f556635 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a7833efd-b3b8-4430-9e49-f81a694d1718" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.310s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:48:05 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-5013073e-72bd-4900-9b22-254d5f556635 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Connected to 172.16.0.220:3260 {{(pid=75226) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 17 01:48:05 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-5013073e-72bd-4900-9b22-254d5f556635 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] HCTL ('36', '-', '-', 0) found on session 56 with lun 0 {{(pid=75226) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 17 01:48:05 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-5013073e-72bd-4900-9b22-254d5f556635 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75226) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 17 01:48:05 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:48:05 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:48:05 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[6effd396-3ce6-441f-91b1-c80368ae3acb]: (4, ('- - 0', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:48:05 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-5013073e-72bd-4900-9b22-254d5f556635 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Searching for a device in session 56 and hctl ['36', '*', '*', 0] yield: None {{(pid=75226) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 01:48:06 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-dc22cf57-e8f7-42f1-a8be-26233b923352 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Acquiring lock "8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:48:06 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-dc22cf57-e8f7-42f1-a8be-26233b923352 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Lock "8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:48:06 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-dc22cf57-e8f7-42f1-a8be-26233b923352 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Acquiring lock "8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:48:06 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-dc22cf57-e8f7-42f1-a8be-26233b923352 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Lock "8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:48:06 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-dc22cf57-e8f7-42f1-a8be-26233b923352 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Lock "8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:48:06 user nova-compute[75226]: INFO nova.compute.manager [None req-dc22cf57-e8f7-42f1-a8be-26233b923352 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] [instance: 8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02] Terminating instance
Nov 17 01:48:06 user nova-compute[75226]: DEBUG nova.compute.manager [None req-dc22cf57-e8f7-42f1-a8be-26233b923352 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] [instance: 8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02] Start destroying the instance on the hypervisor. {{(pid=75226) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 17 01:48:06 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:48:06 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:48:06 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:48:06 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:48:06 user nova-compute[75226]: DEBUG nova.compute.manager [req-f7fad6a1-34c8-4d2a-8b8a-3c329d5e71e5 req-104519e7-f5a1-44bc-9c19-24c1ad92ea7e service nova] [instance: 8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02] Received event network-vif-unplugged-ab437de1-a5c2-48c9-b693-902fc4b05929 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:48:06 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-f7fad6a1-34c8-4d2a-8b8a-3c329d5e71e5 req-104519e7-f5a1-44bc-9c19-24c1ad92ea7e service nova] Acquiring lock "8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:48:06 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-f7fad6a1-34c8-4d2a-8b8a-3c329d5e71e5 req-104519e7-f5a1-44bc-9c19-24c1ad92ea7e service nova] Lock "8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:48:06 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-f7fad6a1-34c8-4d2a-8b8a-3c329d5e71e5 req-104519e7-f5a1-44bc-9c19-24c1ad92ea7e service nova] Lock "8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:48:06 user nova-compute[75226]: DEBUG nova.compute.manager [req-f7fad6a1-34c8-4d2a-8b8a-3c329d5e71e5 req-104519e7-f5a1-44bc-9c19-24c1ad92ea7e service nova] [instance: 8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02] No waiting events found dispatching network-vif-unplugged-ab437de1-a5c2-48c9-b693-902fc4b05929 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:48:06 user nova-compute[75226]: DEBUG nova.compute.manager [req-f7fad6a1-34c8-4d2a-8b8a-3c329d5e71e5 req-104519e7-f5a1-44bc-9c19-24c1ad92ea7e service nova] [instance: 8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02] Received event network-vif-unplugged-ab437de1-a5c2-48c9-b693-902fc4b05929 for instance with task_state deleting. {{(pid=75226) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 17 01:48:06 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-5013073e-72bd-4900-9b22-254d5f556635 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Searching for a device in session 56 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75226) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 01:48:06 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-5013073e-72bd-4900-9b22-254d5f556635 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:a7833efd-b3b8-4430-9e49-f81a694d1718', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dstKSaBM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75226) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 17 01:48:06 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-5013073e-72bd-4900-9b22-254d5f556635 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.340s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:48:06 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-5013073e-72bd-4900-9b22-254d5f556635 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] <== connect_volume: return (1344ms) {'type': 'block', 'scsi_wwn': '23930386434366533', 'path': '/dev/sde'} {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:48:06 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5013073e-72bd-4900-9b22-254d5f556635 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] [instance: 014533a1-a4c3-4c65-a121-f46486cc5998] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23930386434366533', 'path': '/dev/sde'} {{(pid=75226) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 17 01:48:06 user nova-compute[75226]: DEBUG nova.objects.instance [None req-5013073e-72bd-4900-9b22-254d5f556635 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Lazy-loading 'flavor' on Instance uuid 014533a1-a4c3-4c65-a121-f46486cc5998 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:48:06 user nova-compute[75226]: DEBUG nova.virt.libvirt.guest [None req-5013073e-72bd-4900-9b22-254d5f556635 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] attach device xml: <disk type="block" device="disk">
Nov 17 01:48:06 user nova-compute[75226]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 01:48:06 user nova-compute[75226]:   <source dev="/dev/sde"/>
Nov 17 01:48:06 user nova-compute[75226]:   <target dev="vdb" bus="virtio"/>
Nov 17 01:48:06 user nova-compute[75226]:   <serial>a7833efd-b3b8-4430-9e49-f81a694d1718</serial>
Nov 17 01:48:06 user nova-compute[75226]: </disk>
Nov 17 01:48:06 user nova-compute[75226]:  {{(pid=75226) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 17 01:48:07 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-5013073e-72bd-4900-9b22-254d5f556635 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] No BDM found with device name vda, not building metadata. {{(pid=75226) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 01:48:07 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-5013073e-72bd-4900-9b22-254d5f556635 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75226) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 01:48:07 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-5013073e-72bd-4900-9b22-254d5f556635 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] No VIF found with MAC fa:16:3e:35:6c:13, not building metadata {{(pid=75226) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 01:48:07 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-5013073e-72bd-4900-9b22-254d5f556635 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Lock "014533a1-a4c3-4c65-a121-f46486cc5998" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.495s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:48:07 user nova-compute[75226]: INFO nova.virt.libvirt.driver [-] [instance: 8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02] Instance destroyed successfully.
Nov 17 01:48:07 user nova-compute[75226]: DEBUG nova.objects.instance [None req-dc22cf57-e8f7-42f1-a8be-26233b923352 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Lazy-loading 'resources' on Instance uuid 8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:48:07 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-dc22cf57-e8f7-42f1-a8be-26233b923352 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:43:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-19049581',display_name='tempest-TestMinimumBasicScenario-server-19049581',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-19049581',id=43,image_ref='218241c1-772f-4437-81f3-4435b1382dd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBaM/0RWsFok9ojC6xdyZMKUgHv6UqDSb7moAaCX3tHSg2NxiGgdZ2kXzaKTv6YSEkXErnRxQwqAUAZy2IZPKDWv8v2nT3kM8RsB+C6KhGTyY7FHtl1BpNHwdCU7JVPsJw==',key_name='tempest-TestMinimumBasicScenario-1513477075',keypairs=<?>,launch_index=0,launched_at=2023-11-17T01:43:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='33699aa6c9db4815a1e79aff4685801e',ramdisk_id='',reservation_id='r-osdhj006',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='218241c1-772f-4437-81f3-4435b1382dd7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1224009744',owner_user_name='tempest-TestMinimumBasicScenario-1224009744-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T01:45:28Z,user_data=None,user_id='e7c57c13ff8a48f7b8b206d71e413646',uuid=8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ab437de1-a5c2-48c9-b693-902fc4b05929", "address": "fa:16:3e:2c:67:4c", "network": {"id": "44f50686-24e7-4e75-8269-4391a53286d0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1611114801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33699aa6c9db4815a1e79aff4685801e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab437de1-a5", "ovs_interfaceid": "ab437de1-a5c2-48c9-b693-902fc4b05929", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 17 01:48:07 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-dc22cf57-e8f7-42f1-a8be-26233b923352 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Converting VIF {"id": "ab437de1-a5c2-48c9-b693-902fc4b05929", "address": "fa:16:3e:2c:67:4c", "network": {"id": "44f50686-24e7-4e75-8269-4391a53286d0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1611114801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33699aa6c9db4815a1e79aff4685801e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab437de1-a5", "ovs_interfaceid": "ab437de1-a5c2-48c9-b693-902fc4b05929", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:48:07 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-dc22cf57-e8f7-42f1-a8be-26233b923352 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2c:67:4c,bridge_name='br-int',has_traffic_filtering=True,id=ab437de1-a5c2-48c9-b693-902fc4b05929,network=Network(44f50686-24e7-4e75-8269-4391a53286d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab437de1-a5') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:48:07 user nova-compute[75226]: DEBUG os_vif [None req-dc22cf57-e8f7-42f1-a8be-26233b923352 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2c:67:4c,bridge_name='br-int',has_traffic_filtering=True,id=ab437de1-a5c2-48c9-b693-902fc4b05929,network=Network(44f50686-24e7-4e75-8269-4391a53286d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab437de1-a5') {{(pid=75226) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 17 01:48:07 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:48:07 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapab437de1-a5, bridge=br-int, if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:48:07 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:48:07 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:48:07 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:48:07 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0df36086-bec3-4fad-ba92-82b22a48bfb8) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:48:07 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:48:07 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:48:07 user nova-compute[75226]: INFO os_vif [None req-dc22cf57-e8f7-42f1-a8be-26233b923352 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2c:67:4c,bridge_name='br-int',has_traffic_filtering=True,id=ab437de1-a5c2-48c9-b693-902fc4b05929,network=Network(44f50686-24e7-4e75-8269-4391a53286d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab437de1-a5')
Nov 17 01:48:07 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-dc22cf57-e8f7-42f1-a8be-26233b923352 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] [instance: 8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02] Deleting instance files /opt/stack/data/nova/instances/8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02_del
Nov 17 01:48:07 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-dc22cf57-e8f7-42f1-a8be-26233b923352 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] [instance: 8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02] Deletion of /opt/stack/data/nova/instances/8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02_del complete
Nov 17 01:48:07 user nova-compute[75226]: INFO nova.compute.manager [None req-dc22cf57-e8f7-42f1-a8be-26233b923352 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] [instance: 8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02] Took 1.14 seconds to destroy the instance on the hypervisor.
Nov 17 01:48:07 user nova-compute[75226]: DEBUG oslo.service.loopingcall [None req-dc22cf57-e8f7-42f1-a8be-26233b923352 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75226) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 17 01:48:07 user nova-compute[75226]: DEBUG nova.compute.manager [-] [instance: 8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02] Deallocating network for instance {{(pid=75226) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 17 01:48:07 user nova-compute[75226]: DEBUG nova.network.neutron [-] [instance: 8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02] deallocate_for_instance() {{(pid=75226) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 17 01:48:08 user nova-compute[75226]: DEBUG nova.network.neutron [-] [instance: 8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02] Updating instance_info_cache with network_info: [] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:48:08 user nova-compute[75226]: INFO nova.compute.manager [-] [instance: 8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02] Took 0.50 seconds to deallocate network for instance.
Nov 17 01:48:08 user nova-compute[75226]: DEBUG nova.compute.manager [req-bf97fb63-fd30-4ec7-854a-90df721373fc req-8c224913-cde1-46e4-ac28-222a6e80a56f service nova] [instance: 8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02] Received event network-vif-deleted-ab437de1-a5c2-48c9-b693-902fc4b05929 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:48:08 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-dc22cf57-e8f7-42f1-a8be-26233b923352 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:48:08 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-dc22cf57-e8f7-42f1-a8be-26233b923352 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:48:08 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-dc22cf57-e8f7-42f1-a8be-26233b923352 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:48:08 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-dc22cf57-e8f7-42f1-a8be-26233b923352 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:48:08 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-dc22cf57-e8f7-42f1-a8be-26233b923352 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.219s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:48:08 user nova-compute[75226]: INFO nova.scheduler.client.report [None req-dc22cf57-e8f7-42f1-a8be-26233b923352 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Deleted allocations for instance 8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02
Nov 17 01:48:08 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-dc22cf57-e8f7-42f1-a8be-26233b923352 tempest-TestMinimumBasicScenario-1224009744 tempest-TestMinimumBasicScenario-1224009744-project-member] Lock "8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.051s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:48:08 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:48:08 user nova-compute[75226]: DEBUG nova.compute.manager [req-dbfe96fb-6c9f-403b-bf99-69b9fea99c9f req-0627dced-cb57-44cf-8ae6-a287033b0e81 service nova] [instance: 8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02] Received event network-vif-plugged-ab437de1-a5c2-48c9-b693-902fc4b05929 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:48:08 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-dbfe96fb-6c9f-403b-bf99-69b9fea99c9f req-0627dced-cb57-44cf-8ae6-a287033b0e81 service nova] Acquiring lock "8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:48:08 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-dbfe96fb-6c9f-403b-bf99-69b9fea99c9f req-0627dced-cb57-44cf-8ae6-a287033b0e81 service nova] Lock "8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:48:08 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-dbfe96fb-6c9f-403b-bf99-69b9fea99c9f req-0627dced-cb57-44cf-8ae6-a287033b0e81 service nova] Lock "8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:48:08 user nova-compute[75226]: DEBUG nova.compute.manager [req-dbfe96fb-6c9f-403b-bf99-69b9fea99c9f req-0627dced-cb57-44cf-8ae6-a287033b0e81 service nova] [instance: 8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02] No waiting events found dispatching network-vif-plugged-ab437de1-a5c2-48c9-b693-902fc4b05929 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:48:08 user nova-compute[75226]: WARNING nova.compute.manager [req-dbfe96fb-6c9f-403b-bf99-69b9fea99c9f req-0627dced-cb57-44cf-8ae6-a287033b0e81 service nova] [instance: 8e1b3cff-a562-4ef1-8ce2-f5029e8b1d02] Received unexpected event network-vif-plugged-ab437de1-a5c2-48c9-b693-902fc4b05929 for instance with vm_state deleted and task_state None.
Nov 17 01:48:12 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:48:13 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:48:15 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:48:15 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:48:15 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:48:15 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:48:15 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75226) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 17 01:48:16 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/014533a1-a4c3-4c65-a121-f46486cc5998/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:48:16 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/014533a1-a4c3-4c65-a121-f46486cc5998/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:48:16 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/014533a1-a4c3-4c65-a121-f46486cc5998/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:48:16 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/014533a1-a4c3-4c65-a121-f46486cc5998/disk --force-share --output=json" returned: 0 in 0.417s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:48:16 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75226) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 01:48:16 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75226) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 01:48:16 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75226) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 01:48:16 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2a30d8f-1521-4d8a-b880-65f31ae1b704/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:48:16 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2a30d8f-1521-4d8a-b880-65f31ae1b704/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:48:16 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2a30d8f-1521-4d8a-b880-65f31ae1b704/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:48:17 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2a30d8f-1521-4d8a-b880-65f31ae1b704/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:48:17 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:48:17 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:48:17 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Hypervisor/Node resource view: name=user free_ram=8538MB free_disk=24.89828872680664GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75226) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 17 01:48:17 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:48:17 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:48:17 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:48:17 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance d281f155-01b4-4141-8184-8c5111a7c663 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:48:17 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance b2a30d8f-1521-4d8a-b880-65f31ae1b704 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:48:17 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 014533a1-a4c3-4c65-a121-f46486cc5998 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:48:17 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance b74709d7-5cbe-4542-a052-1e9b93ebe305 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:48:17 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75226) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 17 01:48:17 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75226) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 17 01:48:17 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:48:17 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:48:17 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Compute_service record updated for user:user {{(pid=75226) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 17 01:48:17 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.450s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:48:18 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:48:19 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-d0063f9e-2015-4f7b-8fb8-c4d9179c04e3 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Acquiring lock "014533a1-a4c3-4c65-a121-f46486cc5998" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:48:19 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-d0063f9e-2015-4f7b-8fb8-c4d9179c04e3 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Lock "014533a1-a4c3-4c65-a121-f46486cc5998" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:48:19 user nova-compute[75226]: INFO nova.compute.manager [None req-d0063f9e-2015-4f7b-8fb8-c4d9179c04e3 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] [instance: 014533a1-a4c3-4c65-a121-f46486cc5998] Detaching volume a7833efd-b3b8-4430-9e49-f81a694d1718
Nov 17 01:48:19 user nova-compute[75226]: INFO nova.virt.block_device [None req-d0063f9e-2015-4f7b-8fb8-c4d9179c04e3 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] [instance: 014533a1-a4c3-4c65-a121-f46486cc5998] Attempting to driver detach volume a7833efd-b3b8-4430-9e49-f81a694d1718 from mountpoint /dev/vdb
Nov 17 01:48:19 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-d0063f9e-2015-4f7b-8fb8-c4d9179c04e3 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Attempting to detach device vdb from instance 014533a1-a4c3-4c65-a121-f46486cc5998 from the persistent domain config. {{(pid=75226) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 17 01:48:19 user nova-compute[75226]: DEBUG nova.virt.libvirt.guest [None req-d0063f9e-2015-4f7b-8fb8-c4d9179c04e3 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] detach device xml: <disk type="block" device="disk">
Nov 17 01:48:19 user nova-compute[75226]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 01:48:19 user nova-compute[75226]:   <source dev="/dev/sde"/>
Nov 17 01:48:19 user nova-compute[75226]:   <target dev="vdb" bus="virtio"/>
Nov 17 01:48:19 user nova-compute[75226]:   <serial>a7833efd-b3b8-4430-9e49-f81a694d1718</serial>
Nov 17 01:48:19 user nova-compute[75226]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 17 01:48:19 user nova-compute[75226]: </disk>
Nov 17 01:48:19 user nova-compute[75226]:  {{(pid=75226) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 17 01:48:19 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-d0063f9e-2015-4f7b-8fb8-c4d9179c04e3 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Successfully detached device vdb from instance 014533a1-a4c3-4c65-a121-f46486cc5998 from the persistent domain config.
Nov 17 01:48:19 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-d0063f9e-2015-4f7b-8fb8-c4d9179c04e3 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 014533a1-a4c3-4c65-a121-f46486cc5998 from the live domain config. {{(pid=75226) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 17 01:48:19 user nova-compute[75226]: DEBUG nova.virt.libvirt.guest [None req-d0063f9e-2015-4f7b-8fb8-c4d9179c04e3 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] detach device xml: <disk type="block" device="disk">
Nov 17 01:48:19 user nova-compute[75226]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 01:48:19 user nova-compute[75226]:   <source dev="/dev/sde"/>
Nov 17 01:48:19 user nova-compute[75226]:   <target dev="vdb" bus="virtio"/>
Nov 17 01:48:19 user nova-compute[75226]:   <serial>a7833efd-b3b8-4430-9e49-f81a694d1718</serial>
Nov 17 01:48:19 user nova-compute[75226]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 17 01:48:19 user nova-compute[75226]: </disk>
Nov 17 01:48:19 user nova-compute[75226]:  {{(pid=75226) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 17 01:48:19 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-666ee534-3c5b-419a-89df-95ff7110d1c9 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b2a30d8f-1521-4d8a-b880-65f31ae1b704 is timed out.
Nov 17 01:48:19 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-666ee534-3c5b-419a-89df-95ff7110d1c9 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Successfully detached device vdb from instance b2a30d8f-1521-4d8a-b880-65f31ae1b704 from the live domain config.
Nov 17 01:48:19 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-666ee534-3c5b-419a-89df-95ff7110d1c9 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] [instance: b2a30d8f-1521-4d8a-b880-65f31ae1b704] calling os-brick to detach iSCSI Volume {{(pid=75226) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 17 01:48:19 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-666ee534-3c5b-419a-89df-95ff7110d1c9 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc4cc36b490>, {'target_iqn': 'iqn.2010-10.org.openstack:08dec5d1-19fe-4280-8587-db33eecf55b2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fxCbzRQA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:48:19 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-666ee534-3c5b-419a-89df-95ff7110d1c9 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:48:19 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-666ee534-3c5b-419a-89df-95ff7110d1c9 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:48:19 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-666ee534-3c5b-419a-89df-95ff7110d1c9 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:48:19 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:48:19 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:48:19 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[e38eb1b9-6738-4771-9c36-bb7584cf6f72]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d53822e7-4aff-4a77-9789-8759b4988dca\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:08dec5d1-19fe-4280-8587-db33eecf55b2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ea51d240-abac-484a-8d78-49c9f9990337\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a7833efd-b3b8-4430-9e49-f81a694d1718\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:48:19 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-666ee534-3c5b-419a-89df-95ff7110d1c9 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 17 01:48:19 user nova-compute[75226]: No targets found.
Nov 17 01:48:19 user nova-compute[75226]: iSNS:
Nov 17 01:48:19 user nova-compute[75226]: No targets found.
Nov 17 01:48:19 user nova-compute[75226]: STATIC:
Nov 17 01:48:19 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:d53822e7-4aff-4a77-9789-8759b4988dca
Nov 17 01:48:19 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:48:19 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:48:19 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:08dec5d1-19fe-4280-8587-db33eecf55b2
Nov 17 01:48:19 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:48:19 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:48:19 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:ea51d240-abac-484a-8d78-49c9f9990337
Nov 17 01:48:19 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:48:19 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:48:19 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:a7833efd-b3b8-4430-9e49-f81a694d1718
Nov 17 01:48:19 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:48:19 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:48:19 user nova-compute[75226]: FIRMWARE:
Nov 17 01:48:19 user nova-compute[75226]: No targets found.
Nov 17 01:48:19 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:48:19 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-666ee534-3c5b-419a-89df-95ff7110d1c9 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 17 01:48:19 user nova-compute[75226]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 17 01:48:19 user nova-compute[75226]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75226) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 17 01:48:19 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-666ee534-3c5b-419a-89df-95ff7110d1c9 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:08dec5d1-19fe-4280-8587-db33eecf55b2', 0)] {{(pid=75226) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 17 01:48:19 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:48:19 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:48:19 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1bc5915-c52a-4918-a9f0-0349812b69db]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:08dec5d1-19fe-4280-8587-db33eecf55b2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7833efd-b3b8-4430-9e49-f81a694d1718\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d53822e7-4aff-4a77-9789-8759b4988dca\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ea51d240-abac-484a-8d78-49c9f9990337\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:48:19 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:48:20 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:48:20 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[71b16680-f1e7-440e-a158-c4d98d0e622a]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea51d240-abac-484a-8d78-49c9f9990337 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53822e7-4aff-4a77-9789-8759b4988dca (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08dec5d1-19fe-4280-8587-db33eecf55b2 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7833efd-b3b8-4430-9e49-f81a694d1718 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:48:20 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-666ee534-3c5b-419a-89df-95ff7110d1c9 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea51d240-abac-484a-8d78-49c9f9990337 (non-flash)
Nov 17 01:48:20 user nova-compute[75226]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53822e7-4aff-4a77-9789-8759b4988dca (non-flash)
Nov 17 01:48:20 user nova-compute[75226]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08dec5d1-19fe-4280-8587-db33eecf55b2 (non-flash)
Nov 17 01:48:20 user nova-compute[75226]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7833efd-b3b8-4430-9e49-f81a694d1718 (non-flash)
Nov 17 01:48:20 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:48:20 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-666ee534-3c5b-419a-89df-95ff7110d1c9 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea51d240-abac-484a-8d78-49c9f9990337 (non-flash)
Nov 17 01:48:20 user nova-compute[75226]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53822e7-4aff-4a77-9789-8759b4988dca (non-flash)
Nov 17 01:48:20 user nova-compute[75226]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08dec5d1-19fe-4280-8587-db33eecf55b2 (non-flash)
Nov 17 01:48:20 user nova-compute[75226]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7833efd-b3b8-4430-9e49-f81a694d1718 (non-flash)
Nov 17 01:48:20 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:48:20 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-666ee534-3c5b-419a-89df-95ff7110d1c9 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc4b41fc160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:08dec5d1-19fe-4280-8587-db33eecf55b2'): ({'sdb'}, set())}) {{(pid=75226) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 17 01:48:20 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-666ee534-3c5b-419a-89df-95ff7110d1c9 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Removing single pathed devices sdb {{(pid=75226) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 17 01:48:20 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:48:20 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:48:20 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff3c91e0-ddf0-4b6e-8f8a-57cea3200b5f]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:48:20 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:48:20 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:48:20 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2a076a0-f301-44be-a002-5e7f4b5974ca]: (4, ('ok\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:48:20 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-666ee534-3c5b-419a-89df-95ff7110d1c9 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Flushing IO for device /dev/sdb {{(pid=75226) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 17 01:48:20 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:48:20 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:48:20 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa7a6cc3-fcec-46ca-a1f2-d707a40eebcb]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:48:20 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-666ee534-3c5b-419a-89df-95ff7110d1c9 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75226) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 17 01:48:20 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:48:20 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-d0063f9e-2015-4f7b-8fb8-c4d9179c04e3 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 014533a1-a4c3-4c65-a121-f46486cc5998 {{(pid=75226) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 17 01:48:20 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:48:20 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4fe9dfa-e86b-4de5-a4d0-c85eab739ebf]: (4, ('1', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:48:20 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-666ee534-3c5b-419a-89df-95ff7110d1c9 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75226) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 17 01:48:20 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-666ee534-3c5b-419a-89df-95ff7110d1c9 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] SCSI volumes sdb have been removed. {{(pid=75226) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 17 01:48:20 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-666ee534-3c5b-419a-89df-95ff7110d1c9 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:08dec5d1-19fe-4280-8587-db33eecf55b2')] {{(pid=75226) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 17 01:48:20 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08dec5d1-19fe-4280-8587-db33eecf55b2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:48:20 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08dec5d1-19fe-4280-8587-db33eecf55b2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:48:20 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[8716e9bd-6697-4636-bffc-e95d45a917f1]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:48:20 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-666ee534-3c5b-419a-89df-95ff7110d1c9 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:48:20 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08dec5d1-19fe-4280-8587-db33eecf55b2 -p 172.16.0.220:3260 --logout {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:48:20 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08dec5d1-19fe-4280-8587-db33eecf55b2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:48:20 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9808b72-1033-4e54-938f-8b94e8f0167a]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:08dec5d1-19fe-4280-8587-db33eecf55b2, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:08dec5d1-19fe-4280-8587-db33eecf55b2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:48:20 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-666ee534-3c5b-419a-89df-95ff7110d1c9 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:08dec5d1-19fe-4280-8587-db33eecf55b2, portal: 172.16.0.220,3260]
Nov 17 01:48:20 user nova-compute[75226]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:08dec5d1-19fe-4280-8587-db33eecf55b2, portal: 172.16.0.220,3260] successful.
Nov 17 01:48:20 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:48:20 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08dec5d1-19fe-4280-8587-db33eecf55b2 -p 172.16.0.220:3260 --op delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:48:20 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08dec5d1-19fe-4280-8587-db33eecf55b2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:48:20 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c995088-45bb-41d1-92ef-1e91189d5d99]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:48:20 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-666ee534-3c5b-419a-89df-95ff7110d1c9 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:48:20 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-666ee534-3c5b-419a-89df-95ff7110d1c9 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.297s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:48:20 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-666ee534-3c5b-419a-89df-95ff7110d1c9 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] <== disconnect_volume: return (299ms) None {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:48:20 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-666ee534-3c5b-419a-89df-95ff7110d1c9 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] [instance: b2a30d8f-1521-4d8a-b880-65f31ae1b704] Disconnected iSCSI Volume {{(pid=75226) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 17 01:48:20 user nova-compute[75226]: DEBUG nova.objects.instance [None req-666ee534-3c5b-419a-89df-95ff7110d1c9 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Lazy-loading 'flavor' on Instance uuid b2a30d8f-1521-4d8a-b880-65f31ae1b704 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:48:20 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-666ee534-3c5b-419a-89df-95ff7110d1c9 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Lock "b2a30d8f-1521-4d8a-b880-65f31ae1b704" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.614s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:48:20 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-f3eda472-932c-4dab-8f0a-69485538192f tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Lock "b2a30d8f-1521-4d8a-b880-65f31ae1b704" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.480s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:48:20 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-f3eda472-932c-4dab-8f0a-69485538192f tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Acquiring lock "b2a30d8f-1521-4d8a-b880-65f31ae1b704-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:48:20 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-f3eda472-932c-4dab-8f0a-69485538192f tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Lock "b2a30d8f-1521-4d8a-b880-65f31ae1b704-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:48:20 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-f3eda472-932c-4dab-8f0a-69485538192f tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Lock "b2a30d8f-1521-4d8a-b880-65f31ae1b704-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:48:20 user nova-compute[75226]: INFO nova.compute.manager [None req-f3eda472-932c-4dab-8f0a-69485538192f tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] [instance: b2a30d8f-1521-4d8a-b880-65f31ae1b704] Terminating instance
Nov 17 01:48:20 user nova-compute[75226]: DEBUG nova.compute.manager [None req-f3eda472-932c-4dab-8f0a-69485538192f tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] [instance: b2a30d8f-1521-4d8a-b880-65f31ae1b704] Start destroying the instance on the hypervisor. {{(pid=75226) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 17 01:48:21 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:48:21 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:48:21 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:48:21 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:48:21 user nova-compute[75226]: DEBUG nova.compute.manager [req-de768f24-68d9-4ea8-8948-8b9ee8bbbb40 req-8dcabfe1-8b38-42d6-9e2f-974df2a6f875 service nova] [instance: b2a30d8f-1521-4d8a-b880-65f31ae1b704] Received event network-vif-unplugged-f56ebc06-b6d7-4708-ade5-7627a7e7599a {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:48:21 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-de768f24-68d9-4ea8-8948-8b9ee8bbbb40 req-8dcabfe1-8b38-42d6-9e2f-974df2a6f875 service nova] Acquiring lock "b2a30d8f-1521-4d8a-b880-65f31ae1b704-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:48:21 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-de768f24-68d9-4ea8-8948-8b9ee8bbbb40 req-8dcabfe1-8b38-42d6-9e2f-974df2a6f875 service nova] Lock "b2a30d8f-1521-4d8a-b880-65f31ae1b704-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:48:21 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-de768f24-68d9-4ea8-8948-8b9ee8bbbb40 req-8dcabfe1-8b38-42d6-9e2f-974df2a6f875 service nova] Lock "b2a30d8f-1521-4d8a-b880-65f31ae1b704-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:48:21 user nova-compute[75226]: DEBUG nova.compute.manager [req-de768f24-68d9-4ea8-8948-8b9ee8bbbb40 req-8dcabfe1-8b38-42d6-9e2f-974df2a6f875 service nova] [instance: b2a30d8f-1521-4d8a-b880-65f31ae1b704] No waiting events found dispatching network-vif-unplugged-f56ebc06-b6d7-4708-ade5-7627a7e7599a {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:48:21 user nova-compute[75226]: DEBUG nova.compute.manager [req-de768f24-68d9-4ea8-8948-8b9ee8bbbb40 req-8dcabfe1-8b38-42d6-9e2f-974df2a6f875 service nova] [instance: b2a30d8f-1521-4d8a-b880-65f31ae1b704] Received event network-vif-unplugged-f56ebc06-b6d7-4708-ade5-7627a7e7599a for instance with task_state deleting. {{(pid=75226) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 17 01:48:21 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:48:21 user nova-compute[75226]: INFO nova.virt.libvirt.driver [-] [instance: b2a30d8f-1521-4d8a-b880-65f31ae1b704] Instance destroyed successfully.
Nov 17 01:48:21 user nova-compute[75226]: DEBUG nova.objects.instance [None req-f3eda472-932c-4dab-8f0a-69485538192f tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Lazy-loading 'resources' on Instance uuid b2a30d8f-1521-4d8a-b880-65f31ae1b704 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:48:21 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-f3eda472-932c-4dab-8f0a-69485538192f tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:45:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-382953492',display_name='tempest-VolumesSnapshotTestJSON-instance-382953492',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-382953492',id=46,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOy/FenRa1J0alFqxTriQ3DaYRj0Sl+v88wHHMZLcxNj4I+R2OhbSOqMTMoKEU1bK9IGxxUHT6BZiDC1NVPA+oFZAC2YD+T7taAP1SXJsw6XIoAUa9zouMCKyh5WnLzcRA==',key_name='tempest-keypair-139214307',keypairs=<?>,launch_index=0,launched_at=2023-11-17T01:45:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='acc65d32b52442aea872bf9f6025c4e4',ramdisk_id='',reservation_id='r-udd74sd5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1912813406',owner_user_name='tempest-VolumesSnapshotTestJSON-1912813406-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T01:45:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='664817f1ee104181aa271179f9d8e0e1',uuid=b2a30d8f-1521-4d8a-b880-65f31ae1b704,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f56ebc06-b6d7-4708-ade5-7627a7e7599a", "address": "fa:16:3e:5f:3f:57", "network": {"id": "2d06b621-84a6-48dc-be05-92b6724810e3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1055056582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "acc65d32b52442aea872bf9f6025c4e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf56ebc06-b6", "ovs_interfaceid": "f56ebc06-b6d7-4708-ade5-7627a7e7599a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 17 01:48:21 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-f3eda472-932c-4dab-8f0a-69485538192f tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Converting VIF {"id": "f56ebc06-b6d7-4708-ade5-7627a7e7599a", "address": "fa:16:3e:5f:3f:57", "network": {"id": "2d06b621-84a6-48dc-be05-92b6724810e3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1055056582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "acc65d32b52442aea872bf9f6025c4e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf56ebc06-b6", "ovs_interfaceid": "f56ebc06-b6d7-4708-ade5-7627a7e7599a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:48:21 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-f3eda472-932c-4dab-8f0a-69485538192f tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5f:3f:57,bridge_name='br-int',has_traffic_filtering=True,id=f56ebc06-b6d7-4708-ade5-7627a7e7599a,network=Network(2d06b621-84a6-48dc-be05-92b6724810e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf56ebc06-b6') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:48:21 user nova-compute[75226]: DEBUG os_vif [None req-f3eda472-932c-4dab-8f0a-69485538192f tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5f:3f:57,bridge_name='br-int',has_traffic_filtering=True,id=f56ebc06-b6d7-4708-ade5-7627a7e7599a,network=Network(2d06b621-84a6-48dc-be05-92b6724810e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf56ebc06-b6') {{(pid=75226) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 17 01:48:21 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:48:21 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf56ebc06-b6, bridge=br-int, if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:48:21 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:48:21 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:48:21 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:48:21 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8a8fe561-7389-4fc7-aa56-e0aeb289faee) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:48:21 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:48:21 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:48:21 user nova-compute[75226]: INFO os_vif [None req-f3eda472-932c-4dab-8f0a-69485538192f tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5f:3f:57,bridge_name='br-int',has_traffic_filtering=True,id=f56ebc06-b6d7-4708-ade5-7627a7e7599a,network=Network(2d06b621-84a6-48dc-be05-92b6724810e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf56ebc06-b6')
Nov 17 01:48:21 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3eda472-932c-4dab-8f0a-69485538192f tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] [instance: b2a30d8f-1521-4d8a-b880-65f31ae1b704] calling os-brick to detach iSCSI Volume {{(pid=75226) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 17 01:48:21 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3eda472-932c-4dab-8f0a-69485538192f tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc4cc36b490>, {'target_iqn': 'iqn.2010-10.org.openstack:08dec5d1-19fe-4280-8587-db33eecf55b2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fxCbzRQA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:48:21 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-f3eda472-932c-4dab-8f0a-69485538192f tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:48:21 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-f3eda472-932c-4dab-8f0a-69485538192f tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:48:21 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-f3eda472-932c-4dab-8f0a-69485538192f tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:48:21 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:48:21 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:48:21 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[65a9f45f-2ef1-4392-9688-cce3a674aa57]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d53822e7-4aff-4a77-9789-8759b4988dca\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ea51d240-abac-484a-8d78-49c9f9990337\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a7833efd-b3b8-4430-9e49-f81a694d1718\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:48:21 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3eda472-932c-4dab-8f0a-69485538192f tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 17 01:48:21 user nova-compute[75226]: No targets found.
Nov 17 01:48:21 user nova-compute[75226]: iSNS:
Nov 17 01:48:21 user nova-compute[75226]: No targets found.
Nov 17 01:48:21 user nova-compute[75226]: STATIC:
Nov 17 01:48:21 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:d53822e7-4aff-4a77-9789-8759b4988dca
Nov 17 01:48:21 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:48:21 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:48:21 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:ea51d240-abac-484a-8d78-49c9f9990337
Nov 17 01:48:21 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:48:21 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:48:21 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:a7833efd-b3b8-4430-9e49-f81a694d1718
Nov 17 01:48:21 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:48:21 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:48:21 user nova-compute[75226]: FIRMWARE:
Nov 17 01:48:21 user nova-compute[75226]: No targets found.
Nov 17 01:48:21 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:48:21 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3eda472-932c-4dab-8f0a-69485538192f tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 17 01:48:21 user nova-compute[75226]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 17 01:48:21 user nova-compute[75226]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75226) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 17 01:48:21 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3eda472-932c-4dab-8f0a-69485538192f tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:08dec5d1-19fe-4280-8587-db33eecf55b2', 0)] {{(pid=75226) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 17 01:48:21 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:48:21 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:48:21 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[65310b97-438e-434f-8487-72ab1cee39a7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7833efd-b3b8-4430-9e49-f81a694d1718\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d53822e7-4aff-4a77-9789-8759b4988dca\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ea51d240-abac-484a-8d78-49c9f9990337\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:48:21 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:48:21 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:48:21 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[efdf9988-f6b5-4dc2-95e5-6b10777e7c61]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea51d240-abac-484a-8d78-49c9f9990337 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53822e7-4aff-4a77-9789-8759b4988dca (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7833efd-b3b8-4430-9e49-f81a694d1718 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:48:21 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3eda472-932c-4dab-8f0a-69485538192f tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea51d240-abac-484a-8d78-49c9f9990337 (non-flash)
Nov 17 01:48:21 user nova-compute[75226]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53822e7-4aff-4a77-9789-8759b4988dca (non-flash)
Nov 17 01:48:21 user nova-compute[75226]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7833efd-b3b8-4430-9e49-f81a694d1718 (non-flash)
Nov 17 01:48:21 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:48:21 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3eda472-932c-4dab-8f0a-69485538192f tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea51d240-abac-484a-8d78-49c9f9990337 (non-flash)
Nov 17 01:48:21 user nova-compute[75226]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53822e7-4aff-4a77-9789-8759b4988dca (non-flash)
Nov 17 01:48:21 user nova-compute[75226]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7833efd-b3b8-4430-9e49-f81a694d1718 (non-flash)
Nov 17 01:48:21 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:48:21 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3eda472-932c-4dab-8f0a-69485538192f tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc4b45d3a30>, {}) {{(pid=75226) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 17 01:48:21 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3eda472-932c-4dab-8f0a-69485538192f tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Disconnecting from: [] {{(pid=75226) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 17 01:48:21 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-f3eda472-932c-4dab-8f0a-69485538192f tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.084s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:48:21 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3eda472-932c-4dab-8f0a-69485538192f tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] <== disconnect_volume: return (86ms) None {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:48:21 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3eda472-932c-4dab-8f0a-69485538192f tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] [instance: b2a30d8f-1521-4d8a-b880-65f31ae1b704] Disconnected iSCSI Volume {{(pid=75226) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 17 01:48:21 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-f3eda472-932c-4dab-8f0a-69485538192f tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] [instance: b2a30d8f-1521-4d8a-b880-65f31ae1b704] Deleting instance files /opt/stack/data/nova/instances/b2a30d8f-1521-4d8a-b880-65f31ae1b704_del
Nov 17 01:48:21 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-f3eda472-932c-4dab-8f0a-69485538192f tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] [instance: b2a30d8f-1521-4d8a-b880-65f31ae1b704] Deletion of /opt/stack/data/nova/instances/b2a30d8f-1521-4d8a-b880-65f31ae1b704_del complete
Nov 17 01:48:21 user nova-compute[75226]: INFO nova.compute.manager [None req-f3eda472-932c-4dab-8f0a-69485538192f tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] [instance: b2a30d8f-1521-4d8a-b880-65f31ae1b704] Took 0.93 seconds to destroy the instance on the hypervisor.
Nov 17 01:48:21 user nova-compute[75226]: DEBUG oslo.service.loopingcall [None req-f3eda472-932c-4dab-8f0a-69485538192f tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75226) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 17 01:48:21 user nova-compute[75226]: DEBUG nova.compute.manager [-] [instance: b2a30d8f-1521-4d8a-b880-65f31ae1b704] Deallocating network for instance {{(pid=75226) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 17 01:48:21 user nova-compute[75226]: DEBUG nova.network.neutron [-] [instance: b2a30d8f-1521-4d8a-b880-65f31ae1b704] deallocate_for_instance() {{(pid=75226) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 17 01:48:22 user nova-compute[75226]: DEBUG nova.network.neutron [-] [instance: b2a30d8f-1521-4d8a-b880-65f31ae1b704] Updating instance_info_cache with network_info: [] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:48:22 user nova-compute[75226]: INFO nova.compute.manager [-] [instance: b2a30d8f-1521-4d8a-b880-65f31ae1b704] Took 0.67 seconds to deallocate network for instance.
Nov 17 01:48:22 user nova-compute[75226]: DEBUG nova.compute.manager [req-715b339c-2ef4-421d-80ac-ab3fd760d264 req-b94f9c87-b7f1-4ba7-bfc1-7f6be208bb64 service nova] [instance: b2a30d8f-1521-4d8a-b880-65f31ae1b704] Received event network-vif-deleted-f56ebc06-b6d7-4708-ade5-7627a7e7599a {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:48:22 user nova-compute[75226]: INFO nova.compute.manager [req-715b339c-2ef4-421d-80ac-ab3fd760d264 req-b94f9c87-b7f1-4ba7-bfc1-7f6be208bb64 service nova] [instance: b2a30d8f-1521-4d8a-b880-65f31ae1b704] Neutron deleted interface f56ebc06-b6d7-4708-ade5-7627a7e7599a; detaching it from the instance and deleting it from the info cache
Nov 17 01:48:22 user nova-compute[75226]: DEBUG nova.network.neutron [req-715b339c-2ef4-421d-80ac-ab3fd760d264 req-b94f9c87-b7f1-4ba7-bfc1-7f6be208bb64 service nova] [instance: b2a30d8f-1521-4d8a-b880-65f31ae1b704] Updating instance_info_cache with network_info: [] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:48:22 user nova-compute[75226]: WARNING nova.volume.cinder [None req-f3eda472-932c-4dab-8f0a-69485538192f tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Attachment c5901741-dab1-4cea-a13b-c536d91efbee does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = c5901741-dab1-4cea-a13b-c536d91efbee. (HTTP 404) (Request-ID: req-df65c220-71b1-4d7d-97e5-7ebe8f817f58)
Nov 17 01:48:22 user nova-compute[75226]: INFO nova.compute.manager [None req-f3eda472-932c-4dab-8f0a-69485538192f tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] [instance: b2a30d8f-1521-4d8a-b880-65f31ae1b704] Took 0.02 seconds to detach 1 volumes for instance.
Nov 17 01:48:22 user nova-compute[75226]: DEBUG nova.compute.manager [req-715b339c-2ef4-421d-80ac-ab3fd760d264 req-b94f9c87-b7f1-4ba7-bfc1-7f6be208bb64 service nova] [instance: b2a30d8f-1521-4d8a-b880-65f31ae1b704] Detach interface failed, port_id=f56ebc06-b6d7-4708-ade5-7627a7e7599a, reason: Instance b2a30d8f-1521-4d8a-b880-65f31ae1b704 could not be found. {{(pid=75226) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 17 01:48:22 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-f3eda472-932c-4dab-8f0a-69485538192f tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:48:22 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-f3eda472-932c-4dab-8f0a-69485538192f tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:48:22 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-f3eda472-932c-4dab-8f0a-69485538192f tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:48:22 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-f3eda472-932c-4dab-8f0a-69485538192f tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:48:22 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-f3eda472-932c-4dab-8f0a-69485538192f tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.189s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:48:22 user nova-compute[75226]: INFO nova.scheduler.client.report [None req-f3eda472-932c-4dab-8f0a-69485538192f tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Deleted allocations for instance b2a30d8f-1521-4d8a-b880-65f31ae1b704
Nov 17 01:48:23 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-f3eda472-932c-4dab-8f0a-69485538192f tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Lock "b2a30d8f-1521-4d8a-b880-65f31ae1b704" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.009s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:48:23 user nova-compute[75226]: DEBUG nova.compute.manager [req-d427133c-5280-4804-bdd6-c64622119bf8 req-c5db2cb9-f0ba-4724-a6e7-19622f20b4ad service nova] [instance: b2a30d8f-1521-4d8a-b880-65f31ae1b704] Received event network-vif-plugged-f56ebc06-b6d7-4708-ade5-7627a7e7599a {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:48:23 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-d427133c-5280-4804-bdd6-c64622119bf8 req-c5db2cb9-f0ba-4724-a6e7-19622f20b4ad service nova] Acquiring lock "b2a30d8f-1521-4d8a-b880-65f31ae1b704-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:48:23 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-d427133c-5280-4804-bdd6-c64622119bf8 req-c5db2cb9-f0ba-4724-a6e7-19622f20b4ad service nova] Lock "b2a30d8f-1521-4d8a-b880-65f31ae1b704-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:48:23 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-d427133c-5280-4804-bdd6-c64622119bf8 req-c5db2cb9-f0ba-4724-a6e7-19622f20b4ad service nova] Lock "b2a30d8f-1521-4d8a-b880-65f31ae1b704-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:48:23 user nova-compute[75226]: DEBUG nova.compute.manager [req-d427133c-5280-4804-bdd6-c64622119bf8 req-c5db2cb9-f0ba-4724-a6e7-19622f20b4ad service nova] [instance: b2a30d8f-1521-4d8a-b880-65f31ae1b704] No waiting events found dispatching network-vif-plugged-f56ebc06-b6d7-4708-ade5-7627a7e7599a {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:48:23 user nova-compute[75226]: WARNING nova.compute.manager [req-d427133c-5280-4804-bdd6-c64622119bf8 req-c5db2cb9-f0ba-4724-a6e7-19622f20b4ad service nova] [instance: b2a30d8f-1521-4d8a-b880-65f31ae1b704] Received unexpected event network-vif-plugged-f56ebc06-b6d7-4708-ade5-7627a7e7599a for instance with vm_state deleted and task_state None.
Nov 17 01:48:23 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:48:23 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:48:23 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:48:26 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:48:27 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:48:28 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:48:29 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:48:29 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Starting heal instance info cache {{(pid=75226) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 17 01:48:30 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "refresh_cache-d281f155-01b4-4141-8184-8c5111a7c663" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:48:30 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquired lock "refresh_cache-d281f155-01b4-4141-8184-8c5111a7c663" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:48:30 user nova-compute[75226]: DEBUG nova.network.neutron [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] [instance: d281f155-01b4-4141-8184-8c5111a7c663] Forcefully refreshing network info cache for instance {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 17 01:48:30 user nova-compute[75226]: DEBUG nova.network.neutron [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] [instance: d281f155-01b4-4141-8184-8c5111a7c663] Updating instance_info_cache with network_info: [{"id": "b18b7636-d18b-4cce-8bea-b9a293b75952", "address": "fa:16:3e:51:76:4f", "network": {"id": "81bbbdad-218b-4fcd-b7f5-427fd49361cb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1151874504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "673620a69fba4a04af75baabe775dc8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb18b7636-d1", "ovs_interfaceid": "b18b7636-d18b-4cce-8bea-b9a293b75952", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:48:30 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Releasing lock "refresh_cache-d281f155-01b4-4141-8184-8c5111a7c663" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:48:30 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] [instance: d281f155-01b4-4141-8184-8c5111a7c663] Updated the network info_cache for instance {{(pid=75226) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 17 01:48:30 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:48:30 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75226) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 17 01:48:30 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:48:30 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:48:31 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:48:31 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:48:36 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:48:36 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:48:36 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Cleaning up deleted instances {{(pid=75226) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 17 01:48:36 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] There are 0 instances to clean {{(pid=75226) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 17 01:48:36 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:48:36 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75226) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 17 01:48:40 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-d0063f9e-2015-4f7b-8fb8-c4d9179c04e3 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 014533a1-a4c3-4c65-a121-f46486cc5998 is timed out.
Nov 17 01:48:40 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-d0063f9e-2015-4f7b-8fb8-c4d9179c04e3 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Successfully detached device vdb from instance 014533a1-a4c3-4c65-a121-f46486cc5998 from the live domain config.
Nov 17 01:48:40 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d0063f9e-2015-4f7b-8fb8-c4d9179c04e3 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] [instance: 014533a1-a4c3-4c65-a121-f46486cc5998] calling os-brick to detach iSCSI Volume {{(pid=75226) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 17 01:48:40 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0063f9e-2015-4f7b-8fb8-c4d9179c04e3 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc4cc36b490>, {'target_iqn': 'iqn.2010-10.org.openstack:a7833efd-b3b8-4430-9e49-f81a694d1718', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dstKSaBM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:48:40 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-d0063f9e-2015-4f7b-8fb8-c4d9179c04e3 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:48:40 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-d0063f9e-2015-4f7b-8fb8-c4d9179c04e3 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:48:40 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-d0063f9e-2015-4f7b-8fb8-c4d9179c04e3 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:48:40 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:48:40 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:48:40 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cbc6db1-61ca-4174-87ca-fb9eb25f0a18]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d53822e7-4aff-4a77-9789-8759b4988dca\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ea51d240-abac-484a-8d78-49c9f9990337\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a7833efd-b3b8-4430-9e49-f81a694d1718\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:48:40 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0063f9e-2015-4f7b-8fb8-c4d9179c04e3 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 17 01:48:40 user nova-compute[75226]: No targets found.
Nov 17 01:48:40 user nova-compute[75226]: iSNS:
Nov 17 01:48:40 user nova-compute[75226]: No targets found.
Nov 17 01:48:40 user nova-compute[75226]: STATIC:
Nov 17 01:48:40 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:d53822e7-4aff-4a77-9789-8759b4988dca
Nov 17 01:48:40 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:48:40 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:48:40 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:ea51d240-abac-484a-8d78-49c9f9990337
Nov 17 01:48:40 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:48:40 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:48:40 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:a7833efd-b3b8-4430-9e49-f81a694d1718
Nov 17 01:48:40 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:48:40 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:48:40 user nova-compute[75226]: FIRMWARE:
Nov 17 01:48:40 user nova-compute[75226]: No targets found.
Nov 17 01:48:40 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:48:40 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0063f9e-2015-4f7b-8fb8-c4d9179c04e3 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 17 01:48:40 user nova-compute[75226]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 17 01:48:40 user nova-compute[75226]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75226) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 17 01:48:40 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0063f9e-2015-4f7b-8fb8-c4d9179c04e3 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a7833efd-b3b8-4430-9e49-f81a694d1718', 0)] {{(pid=75226) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 17 01:48:40 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:48:40 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:48:40 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b87f695-f067-4a52-9189-99750fdb796d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7833efd-b3b8-4430-9e49-f81a694d1718\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d53822e7-4aff-4a77-9789-8759b4988dca\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ea51d240-abac-484a-8d78-49c9f9990337\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:48:40 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:48:40 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:48:40 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[1087c852-5cad-4618-b899-38a1cb7de100]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea51d240-abac-484a-8d78-49c9f9990337 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53822e7-4aff-4a77-9789-8759b4988dca (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7833efd-b3b8-4430-9e49-f81a694d1718 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:48:40 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0063f9e-2015-4f7b-8fb8-c4d9179c04e3 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea51d240-abac-484a-8d78-49c9f9990337 (non-flash)
Nov 17 01:48:40 user nova-compute[75226]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53822e7-4aff-4a77-9789-8759b4988dca (non-flash)
Nov 17 01:48:40 user nova-compute[75226]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7833efd-b3b8-4430-9e49-f81a694d1718 (non-flash)
Nov 17 01:48:40 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:48:40 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0063f9e-2015-4f7b-8fb8-c4d9179c04e3 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea51d240-abac-484a-8d78-49c9f9990337 (non-flash)
Nov 17 01:48:40 user nova-compute[75226]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53822e7-4aff-4a77-9789-8759b4988dca (non-flash)
Nov 17 01:48:40 user nova-compute[75226]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7833efd-b3b8-4430-9e49-f81a694d1718 (non-flash)
Nov 17 01:48:40 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:48:40 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0063f9e-2015-4f7b-8fb8-c4d9179c04e3 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc4d42ed7e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a7833efd-b3b8-4430-9e49-f81a694d1718'): ({'sde'}, set())}) {{(pid=75226) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 17 01:48:40 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-d0063f9e-2015-4f7b-8fb8-c4d9179c04e3 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Removing single pathed devices sde {{(pid=75226) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 17 01:48:40 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:48:40 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:48:40 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1d9f96c-97f8-4782-936a-fbdb4c912cdf]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:48:40 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:48:40 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:48:40 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eebe4ce-fe19-4848-b8ab-cb155143504d]: (4, ('ok\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:48:40 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-d0063f9e-2015-4f7b-8fb8-c4d9179c04e3 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Flushing IO for device /dev/sde {{(pid=75226) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 17 01:48:40 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:48:40 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:48:40 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6bd8ec0-2c8b-4e58-a0b1-79acd3b96aae]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:48:40 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-d0063f9e-2015-4f7b-8fb8-c4d9179c04e3 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75226) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 17 01:48:40 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:48:40 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.043s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:48:40 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d01a99c-a1a2-405b-bdc2-86d39b194a1c]: (4, ('1', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:48:40 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-d0063f9e-2015-4f7b-8fb8-c4d9179c04e3 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75226) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 17 01:48:40 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-d0063f9e-2015-4f7b-8fb8-c4d9179c04e3 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] SCSI volumes sde have been removed. {{(pid=75226) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 17 01:48:40 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0063f9e-2015-4f7b-8fb8-c4d9179c04e3 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a7833efd-b3b8-4430-9e49-f81a694d1718')] {{(pid=75226) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 17 01:48:40 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7833efd-b3b8-4430-9e49-f81a694d1718 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:48:40 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7833efd-b3b8-4430-9e49-f81a694d1718 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:48:40 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[127b9c5e-eac0-4f3b-a29f-ffc86146ab8e]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:48:40 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0063f9e-2015-4f7b-8fb8-c4d9179c04e3 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:48:40 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7833efd-b3b8-4430-9e49-f81a694d1718 -p 172.16.0.220:3260 --logout {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:48:40 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7833efd-b3b8-4430-9e49-f81a694d1718 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:48:40 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ad67133-f446-4ec9-a0cd-c52d1cad5d81]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:a7833efd-b3b8-4430-9e49-f81a694d1718, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:a7833efd-b3b8-4430-9e49-f81a694d1718, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:48:40 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0063f9e-2015-4f7b-8fb8-c4d9179c04e3 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:a7833efd-b3b8-4430-9e49-f81a694d1718, portal: 172.16.0.220,3260]
Nov 17 01:48:40 user nova-compute[75226]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:a7833efd-b3b8-4430-9e49-f81a694d1718, portal: 172.16.0.220,3260] successful.
Nov 17 01:48:40 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:48:40 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7833efd-b3b8-4430-9e49-f81a694d1718 -p 172.16.0.220:3260 --op delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:48:40 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7833efd-b3b8-4430-9e49-f81a694d1718 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:48:40 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[13300f57-6682-44b6-9700-1aa6bbe7a18e]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:48:40 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0063f9e-2015-4f7b-8fb8-c4d9179c04e3 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:48:40 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-d0063f9e-2015-4f7b-8fb8-c4d9179c04e3 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.326s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:48:40 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0063f9e-2015-4f7b-8fb8-c4d9179c04e3 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] <== disconnect_volume: return (328ms) None {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:48:40 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d0063f9e-2015-4f7b-8fb8-c4d9179c04e3 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] [instance: 014533a1-a4c3-4c65-a121-f46486cc5998] Disconnected iSCSI Volume {{(pid=75226) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 17 01:48:41 user nova-compute[75226]: DEBUG nova.objects.instance [None req-d0063f9e-2015-4f7b-8fb8-c4d9179c04e3 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Lazy-loading 'flavor' on Instance uuid 014533a1-a4c3-4c65-a121-f46486cc5998 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:48:41 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-d0063f9e-2015-4f7b-8fb8-c4d9179c04e3 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Lock "014533a1-a4c3-4c65-a121-f46486cc5998" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.625s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:48:41 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:48:46 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:48:51 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:48:56 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:48:58 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:48:59 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:49:01 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:49:02 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:49:03 user nova-compute[75226]: DEBUG nova.compute.manager [req-90d223ce-2bb1-44d8-8e74-f6fbdc665182 req-dcee8822-8cc8-4d73-bf28-254fb2c15d2c service nova] [instance: b74709d7-5cbe-4542-a052-1e9b93ebe305] Received event network-changed-cafd7924-2152-401e-9888-519446bfa93f {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:49:03 user nova-compute[75226]: DEBUG nova.compute.manager [req-90d223ce-2bb1-44d8-8e74-f6fbdc665182 req-dcee8822-8cc8-4d73-bf28-254fb2c15d2c service nova] [instance: b74709d7-5cbe-4542-a052-1e9b93ebe305] Refreshing instance network info cache due to event network-changed-cafd7924-2152-401e-9888-519446bfa93f. {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 01:49:03 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-90d223ce-2bb1-44d8-8e74-f6fbdc665182 req-dcee8822-8cc8-4d73-bf28-254fb2c15d2c service nova] Acquiring lock "refresh_cache-b74709d7-5cbe-4542-a052-1e9b93ebe305" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:49:03 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-90d223ce-2bb1-44d8-8e74-f6fbdc665182 req-dcee8822-8cc8-4d73-bf28-254fb2c15d2c service nova] Acquired lock "refresh_cache-b74709d7-5cbe-4542-a052-1e9b93ebe305" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:49:03 user nova-compute[75226]: DEBUG nova.network.neutron [req-90d223ce-2bb1-44d8-8e74-f6fbdc665182 req-dcee8822-8cc8-4d73-bf28-254fb2c15d2c service nova] [instance: b74709d7-5cbe-4542-a052-1e9b93ebe305] Refreshing network info cache for port cafd7924-2152-401e-9888-519446bfa93f {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 01:49:03 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:49:03 user nova-compute[75226]: DEBUG nova.network.neutron [req-90d223ce-2bb1-44d8-8e74-f6fbdc665182 req-dcee8822-8cc8-4d73-bf28-254fb2c15d2c service nova] [instance: b74709d7-5cbe-4542-a052-1e9b93ebe305] Updated VIF entry in instance network info cache for port cafd7924-2152-401e-9888-519446bfa93f. {{(pid=75226) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 01:49:03 user nova-compute[75226]: DEBUG nova.network.neutron [req-90d223ce-2bb1-44d8-8e74-f6fbdc665182 req-dcee8822-8cc8-4d73-bf28-254fb2c15d2c service nova] [instance: b74709d7-5cbe-4542-a052-1e9b93ebe305] Updating instance_info_cache with network_info: [{"id": "cafd7924-2152-401e-9888-519446bfa93f", "address": "fa:16:3e:de:58:9e", "network": {"id": "81bbbdad-218b-4fcd-b7f5-427fd49361cb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1151874504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "673620a69fba4a04af75baabe775dc8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcafd7924-21", "ovs_interfaceid": "cafd7924-2152-401e-9888-519446bfa93f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:49:03 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-90d223ce-2bb1-44d8-8e74-f6fbdc665182 req-dcee8822-8cc8-4d73-bf28-254fb2c15d2c service nova] Releasing lock "refresh_cache-b74709d7-5cbe-4542-a052-1e9b93ebe305" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:49:03 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-4b6b51cd-6bdd-4c86-9f4f-2d39b62c1177 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Acquiring lock "b74709d7-5cbe-4542-a052-1e9b93ebe305" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:49:03 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-4b6b51cd-6bdd-4c86-9f4f-2d39b62c1177 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Lock "b74709d7-5cbe-4542-a052-1e9b93ebe305" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:49:03 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-4b6b51cd-6bdd-4c86-9f4f-2d39b62c1177 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Acquiring lock "b74709d7-5cbe-4542-a052-1e9b93ebe305-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:49:03 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-4b6b51cd-6bdd-4c86-9f4f-2d39b62c1177 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Lock "b74709d7-5cbe-4542-a052-1e9b93ebe305-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:49:03 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-4b6b51cd-6bdd-4c86-9f4f-2d39b62c1177 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Lock "b74709d7-5cbe-4542-a052-1e9b93ebe305-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:49:03 user nova-compute[75226]: INFO nova.compute.manager [None req-4b6b51cd-6bdd-4c86-9f4f-2d39b62c1177 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: b74709d7-5cbe-4542-a052-1e9b93ebe305] Terminating instance
Nov 17 01:49:03 user nova-compute[75226]: DEBUG nova.compute.manager [None req-4b6b51cd-6bdd-4c86-9f4f-2d39b62c1177 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: b74709d7-5cbe-4542-a052-1e9b93ebe305] Start destroying the instance on the hypervisor. {{(pid=75226) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 17 01:49:04 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:49:04 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:49:04 user nova-compute[75226]: DEBUG nova.compute.manager [req-8df24543-c101-4131-81e5-ffab95c72b6b req-b1d1d4ac-5bbf-4e93-89a7-d207bd962b17 service nova] [instance: b74709d7-5cbe-4542-a052-1e9b93ebe305] Received event network-vif-unplugged-cafd7924-2152-401e-9888-519446bfa93f {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:49:04 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-8df24543-c101-4131-81e5-ffab95c72b6b req-b1d1d4ac-5bbf-4e93-89a7-d207bd962b17 service nova] Acquiring lock "b74709d7-5cbe-4542-a052-1e9b93ebe305-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:49:04 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-8df24543-c101-4131-81e5-ffab95c72b6b req-b1d1d4ac-5bbf-4e93-89a7-d207bd962b17 service nova] Lock "b74709d7-5cbe-4542-a052-1e9b93ebe305-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:49:04 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-8df24543-c101-4131-81e5-ffab95c72b6b req-b1d1d4ac-5bbf-4e93-89a7-d207bd962b17 service nova] Lock "b74709d7-5cbe-4542-a052-1e9b93ebe305-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:49:04 user nova-compute[75226]: DEBUG nova.compute.manager [req-8df24543-c101-4131-81e5-ffab95c72b6b req-b1d1d4ac-5bbf-4e93-89a7-d207bd962b17 service nova] [instance: b74709d7-5cbe-4542-a052-1e9b93ebe305] No waiting events found dispatching network-vif-unplugged-cafd7924-2152-401e-9888-519446bfa93f {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:49:04 user nova-compute[75226]: DEBUG nova.compute.manager [req-8df24543-c101-4131-81e5-ffab95c72b6b req-b1d1d4ac-5bbf-4e93-89a7-d207bd962b17 service nova] [instance: b74709d7-5cbe-4542-a052-1e9b93ebe305] Received event network-vif-unplugged-cafd7924-2152-401e-9888-519446bfa93f for instance with task_state deleting. {{(pid=75226) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 17 01:49:04 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:49:04 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:49:04 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-3b9431d1-1ef7-4991-8b56-3843f0edc105 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Acquiring lock "4bb19560-6149-4c39-8596-3c4c11c4247d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:49:04 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-3b9431d1-1ef7-4991-8b56-3843f0edc105 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Lock "4bb19560-6149-4c39-8596-3c4c11c4247d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:49:04 user nova-compute[75226]: DEBUG nova.compute.manager [None req-3b9431d1-1ef7-4991-8b56-3843f0edc105 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] [instance: 4bb19560-6149-4c39-8596-3c4c11c4247d] Starting instance... {{(pid=75226) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 17 01:49:04 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-3b9431d1-1ef7-4991-8b56-3843f0edc105 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:49:04 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-3b9431d1-1ef7-4991-8b56-3843f0edc105 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:49:04 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-3b9431d1-1ef7-4991-8b56-3843f0edc105 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75226) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 17 01:49:04 user nova-compute[75226]: INFO nova.compute.claims [None req-3b9431d1-1ef7-4991-8b56-3843f0edc105 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] [instance: 4bb19560-6149-4c39-8596-3c4c11c4247d] Claim successful on node user
Nov 17 01:49:04 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:49:04 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:49:04 user nova-compute[75226]: INFO nova.virt.libvirt.driver [-] [instance: b74709d7-5cbe-4542-a052-1e9b93ebe305] Instance destroyed successfully.
Nov 17 01:49:04 user nova-compute[75226]: DEBUG nova.objects.instance [None req-4b6b51cd-6bdd-4c86-9f4f-2d39b62c1177 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Lazy-loading 'resources' on Instance uuid b74709d7-5cbe-4542-a052-1e9b93ebe305 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:49:04 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-4b6b51cd-6bdd-4c86-9f4f-2d39b62c1177 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:47:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-2025467327',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-2025467327',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-2025467327',id=48,image_ref='0b8da27e-0e77-4e45-aa08-2db14f1bcfad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFtBPanumi0zkDDEVk91gfcH5YdI1iaznxhcvveMGFqJFd36aIecIAPwZM2h+y+6FEad+bHMPMbpaATGqwz4GJYukTPp/y4ueLYLElo4kg7Ce6IZZOKDE7Kve5K5fV7+Ww==',key_name='tempest-keypair-412422918',keypairs=<?>,launch_index=0,launched_at=2023-11-17T01:47:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='673620a69fba4a04af75baabe775dc8b',ramdisk_id='',reservation_id='r-9bezfld0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-971654489',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-971654489-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-971654489',owner_user_name='tempest-TestVolumeBootPattern-971654489-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T01:47:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c8c8baa56884dcd9a90f0187c9fc06f',uuid=b74709d7-5cbe-4542-a052-1e9b93ebe305,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cafd7924-2152-401e-9888-519446bfa93f", "address": "fa:16:3e:de:58:9e", "network": {"id": "81bbbdad-218b-4fcd-b7f5-427fd49361cb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1151874504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "673620a69fba4a04af75baabe775dc8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcafd7924-21", "ovs_interfaceid": "cafd7924-2152-401e-9888-519446bfa93f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 17 01:49:04 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-4b6b51cd-6bdd-4c86-9f4f-2d39b62c1177 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Converting VIF {"id": "cafd7924-2152-401e-9888-519446bfa93f", "address": "fa:16:3e:de:58:9e", "network": {"id": "81bbbdad-218b-4fcd-b7f5-427fd49361cb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1151874504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "673620a69fba4a04af75baabe775dc8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcafd7924-21", "ovs_interfaceid": "cafd7924-2152-401e-9888-519446bfa93f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:49:04 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-4b6b51cd-6bdd-4c86-9f4f-2d39b62c1177 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:58:9e,bridge_name='br-int',has_traffic_filtering=True,id=cafd7924-2152-401e-9888-519446bfa93f,network=Network(81bbbdad-218b-4fcd-b7f5-427fd49361cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcafd7924-21') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:49:04 user nova-compute[75226]: DEBUG os_vif [None req-4b6b51cd-6bdd-4c86-9f4f-2d39b62c1177 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:58:9e,bridge_name='br-int',has_traffic_filtering=True,id=cafd7924-2152-401e-9888-519446bfa93f,network=Network(81bbbdad-218b-4fcd-b7f5-427fd49361cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcafd7924-21') {{(pid=75226) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 17 01:49:04 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:49:04 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcafd7924-21, bridge=br-int, if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:49:04 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:49:04 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:49:04 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:49:04 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e9691f9a-24dd-4882-9f07-e9476e7c5cb1) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:49:04 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:49:04 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:49:04 user nova-compute[75226]: INFO os_vif [None req-4b6b51cd-6bdd-4c86-9f4f-2d39b62c1177 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:58:9e,bridge_name='br-int',has_traffic_filtering=True,id=cafd7924-2152-401e-9888-519446bfa93f,network=Network(81bbbdad-218b-4fcd-b7f5-427fd49361cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcafd7924-21')
Nov 17 01:49:04 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b6b51cd-6bdd-4c86-9f4f-2d39b62c1177 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: b74709d7-5cbe-4542-a052-1e9b93ebe305] calling os-brick to detach iSCSI Volume {{(pid=75226) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 17 01:49:04 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b6b51cd-6bdd-4c86-9f4f-2d39b62c1177 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc4cc36b490>, {'target_iqn': 'iqn.2010-10.org.openstack:d53822e7-4aff-4a77-9789-8759b4988dca', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jCzQvsoE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:49:04 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-4b6b51cd-6bdd-4c86-9f4f-2d39b62c1177 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:49:04 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-4b6b51cd-6bdd-4c86-9f4f-2d39b62c1177 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:49:04 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-4b6b51cd-6bdd-4c86-9f4f-2d39b62c1177 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:49:04 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:49:04 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-3b9431d1-1ef7-4991-8b56-3843f0edc105 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:49:04 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:49:04 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[15e1f5db-28ea-45a0-960a-b6ad871b04dd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d53822e7-4aff-4a77-9789-8759b4988dca\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ea51d240-abac-484a-8d78-49c9f9990337\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:49:04 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b6b51cd-6bdd-4c86-9f4f-2d39b62c1177 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 17 01:49:04 user nova-compute[75226]: No targets found.
Nov 17 01:49:04 user nova-compute[75226]: iSNS:
Nov 17 01:49:04 user nova-compute[75226]: No targets found.
Nov 17 01:49:04 user nova-compute[75226]: STATIC:
Nov 17 01:49:04 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:d53822e7-4aff-4a77-9789-8759b4988dca
Nov 17 01:49:04 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:49:04 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:49:04 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:ea51d240-abac-484a-8d78-49c9f9990337
Nov 17 01:49:04 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:49:04 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:49:04 user nova-compute[75226]: FIRMWARE:
Nov 17 01:49:04 user nova-compute[75226]: No targets found.
Nov 17 01:49:04 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:49:04 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b6b51cd-6bdd-4c86-9f4f-2d39b62c1177 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 17 01:49:04 user nova-compute[75226]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 17 01:49:04 user nova-compute[75226]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75226) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 17 01:49:04 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b6b51cd-6bdd-4c86-9f4f-2d39b62c1177 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d53822e7-4aff-4a77-9789-8759b4988dca', 0)] {{(pid=75226) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 17 01:49:04 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:49:04 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-3b9431d1-1ef7-4991-8b56-3843f0edc105 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:49:04 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:49:04 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b98ce6b-284b-4249-b0a5-3769a6a26dd1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d53822e7-4aff-4a77-9789-8759b4988dca\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ea51d240-abac-484a-8d78-49c9f9990337\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:49:04 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:49:04 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-3b9431d1-1ef7-4991-8b56-3843f0edc105 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.385s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:49:04 user nova-compute[75226]: DEBUG nova.compute.manager [None req-3b9431d1-1ef7-4991-8b56-3843f0edc105 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] [instance: 4bb19560-6149-4c39-8596-3c4c11c4247d] Start building networks asynchronously for instance. {{(pid=75226) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 17 01:49:04 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:49:04 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[e72fe3b3-216e-4e0c-9b04-d9b330869fd5]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea51d240-abac-484a-8d78-49c9f9990337 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53822e7-4aff-4a77-9789-8759b4988dca (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:49:04 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b6b51cd-6bdd-4c86-9f4f-2d39b62c1177 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea51d240-abac-484a-8d78-49c9f9990337 (non-flash)
Nov 17 01:49:04 user nova-compute[75226]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53822e7-4aff-4a77-9789-8759b4988dca (non-flash)
Nov 17 01:49:04 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:49:04 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b6b51cd-6bdd-4c86-9f4f-2d39b62c1177 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea51d240-abac-484a-8d78-49c9f9990337 (non-flash)
Nov 17 01:49:04 user nova-compute[75226]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53822e7-4aff-4a77-9789-8759b4988dca (non-flash)
Nov 17 01:49:04 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:49:04 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b6b51cd-6bdd-4c86-9f4f-2d39b62c1177 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc4b4383400>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d53822e7-4aff-4a77-9789-8759b4988dca'): ({'sdd'}, set())}) {{(pid=75226) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 17 01:49:04 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-4b6b51cd-6bdd-4c86-9f4f-2d39b62c1177 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Removing single pathed devices sdd {{(pid=75226) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 17 01:49:04 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:49:04 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:49:04 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e522151-a118-4673-8b2d-34c621ecb31f]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:49:04 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:49:05 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:49:05 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[3564d32b-04d7-45a3-b254-c76a2a4080df]: (4, ('ok\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:49:05 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-4b6b51cd-6bdd-4c86-9f4f-2d39b62c1177 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Flushing IO for device /dev/sdd {{(pid=75226) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 17 01:49:05 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:49:05 user nova-compute[75226]: DEBUG nova.compute.manager [None req-3b9431d1-1ef7-4991-8b56-3843f0edc105 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] [instance: 4bb19560-6149-4c39-8596-3c4c11c4247d] Allocating IP information in the background. {{(pid=75226) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 17 01:49:05 user nova-compute[75226]: DEBUG nova.network.neutron [None req-3b9431d1-1ef7-4991-8b56-3843f0edc105 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] [instance: 4bb19560-6149-4c39-8596-3c4c11c4247d] allocate_for_instance() {{(pid=75226) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 17 01:49:05 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:49:05 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dfc39b3-cc2d-4d5e-a506-ddbf99969fe9]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:49:05 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-4b6b51cd-6bdd-4c86-9f4f-2d39b62c1177 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75226) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 17 01:49:05 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:49:05 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-3b9431d1-1ef7-4991-8b56-3843f0edc105 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] [instance: 4bb19560-6149-4c39-8596-3c4c11c4247d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 17 01:49:05 user nova-compute[75226]: DEBUG nova.compute.manager [None req-3b9431d1-1ef7-4991-8b56-3843f0edc105 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] [instance: 4bb19560-6149-4c39-8596-3c4c11c4247d] Start building block device mappings for instance. {{(pid=75226) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 17 01:49:05 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.052s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:49:05 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c1d62bb-c0fb-4aeb-bc50-f418cff04fbb]: (4, ('1', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:49:05 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-4b6b51cd-6bdd-4c86-9f4f-2d39b62c1177 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75226) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 17 01:49:05 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-4b6b51cd-6bdd-4c86-9f4f-2d39b62c1177 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] SCSI volumes sdd have been removed. {{(pid=75226) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 17 01:49:05 user nova-compute[75226]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOd85c6aa3-f7c620ff56f1b6b8', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_d85c6aa3', '/dev/disk/by-id/scsi-26637633632306666') {{(pid=85818) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 17 01:49:05 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[decc2b16-ab1e-449d-8038-14bb7ffb40c1]: (4, None) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:49:05 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b6b51cd-6bdd-4c86-9f4f-2d39b62c1177 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d53822e7-4aff-4a77-9789-8759b4988dca')] {{(pid=75226) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 17 01:49:05 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d53822e7-4aff-4a77-9789-8759b4988dca -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:49:05 user nova-compute[75226]: DEBUG nova.policy [None req-3b9431d1-1ef7-4991-8b56-3843f0edc105 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '664817f1ee104181aa271179f9d8e0e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc65d32b52442aea872bf9f6025c4e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75226) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 17 01:49:05 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d53822e7-4aff-4a77-9789-8759b4988dca -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:49:05 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ecf1a1c-2ec8-4c1c-a353-7ee291c75e01]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:49:05 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b6b51cd-6bdd-4c86-9f4f-2d39b62c1177 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:49:05 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d53822e7-4aff-4a77-9789-8759b4988dca -p 172.16.0.220:3260 --logout {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:49:05 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d53822e7-4aff-4a77-9789-8759b4988dca -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:49:05 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[de60e37f-7a44-4fe7-94bb-efa4adaaa5ea]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:d53822e7-4aff-4a77-9789-8759b4988dca, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:d53822e7-4aff-4a77-9789-8759b4988dca, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:49:05 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b6b51cd-6bdd-4c86-9f4f-2d39b62c1177 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:d53822e7-4aff-4a77-9789-8759b4988dca, portal: 172.16.0.220,3260]
Nov 17 01:49:05 user nova-compute[75226]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:d53822e7-4aff-4a77-9789-8759b4988dca, portal: 172.16.0.220,3260] successful.
Nov 17 01:49:05 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:49:05 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d53822e7-4aff-4a77-9789-8759b4988dca -p 172.16.0.220:3260 --op delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:49:05 user nova-compute[75226]: DEBUG nova.compute.manager [None req-3b9431d1-1ef7-4991-8b56-3843f0edc105 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] [instance: 4bb19560-6149-4c39-8596-3c4c11c4247d] Start spawning the instance on the hypervisor. {{(pid=75226) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 17 01:49:05 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-3b9431d1-1ef7-4991-8b56-3843f0edc105 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] [instance: 4bb19560-6149-4c39-8596-3c4c11c4247d] Creating instance directory {{(pid=75226) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 17 01:49:05 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-3b9431d1-1ef7-4991-8b56-3843f0edc105 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] [instance: 4bb19560-6149-4c39-8596-3c4c11c4247d] Creating image(s)
Nov 17 01:49:05 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-3b9431d1-1ef7-4991-8b56-3843f0edc105 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Acquiring lock "/opt/stack/data/nova/instances/4bb19560-6149-4c39-8596-3c4c11c4247d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:49:05 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-3b9431d1-1ef7-4991-8b56-3843f0edc105 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Lock "/opt/stack/data/nova/instances/4bb19560-6149-4c39-8596-3c4c11c4247d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:49:05 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-3b9431d1-1ef7-4991-8b56-3843f0edc105 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Lock "/opt/stack/data/nova/instances/4bb19560-6149-4c39-8596-3c4c11c4247d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:49:05 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-3b9431d1-1ef7-4991-8b56-3843f0edc105 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:49:05 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d53822e7-4aff-4a77-9789-8759b4988dca -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:49:05 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[064a3c5b-a93a-44f1-b1b1-c228be530bbe]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:49:05 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b6b51cd-6bdd-4c86-9f4f-2d39b62c1177 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:49:05 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-4b6b51cd-6bdd-4c86-9f4f-2d39b62c1177 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.387s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:49:05 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b6b51cd-6bdd-4c86-9f4f-2d39b62c1177 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] <== disconnect_volume: return (389ms) None {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:49:05 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b6b51cd-6bdd-4c86-9f4f-2d39b62c1177 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: b74709d7-5cbe-4542-a052-1e9b93ebe305] Disconnected iSCSI Volume {{(pid=75226) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 17 01:49:05 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-4b6b51cd-6bdd-4c86-9f4f-2d39b62c1177 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: b74709d7-5cbe-4542-a052-1e9b93ebe305] Deleting instance files /opt/stack/data/nova/instances/b74709d7-5cbe-4542-a052-1e9b93ebe305_del
Nov 17 01:49:05 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-4b6b51cd-6bdd-4c86-9f4f-2d39b62c1177 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: b74709d7-5cbe-4542-a052-1e9b93ebe305] Deletion of /opt/stack/data/nova/instances/b74709d7-5cbe-4542-a052-1e9b93ebe305_del complete
Nov 17 01:49:05 user nova-compute[75226]: INFO nova.compute.manager [None req-4b6b51cd-6bdd-4c86-9f4f-2d39b62c1177 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: b74709d7-5cbe-4542-a052-1e9b93ebe305] Took 1.33 seconds to destroy the instance on the hypervisor.
Nov 17 01:49:05 user nova-compute[75226]: DEBUG oslo.service.loopingcall [None req-4b6b51cd-6bdd-4c86-9f4f-2d39b62c1177 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75226) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 17 01:49:05 user nova-compute[75226]: DEBUG nova.compute.manager [-] [instance: b74709d7-5cbe-4542-a052-1e9b93ebe305] Deallocating network for instance {{(pid=75226) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 17 01:49:05 user nova-compute[75226]: DEBUG nova.network.neutron [-] [instance: b74709d7-5cbe-4542-a052-1e9b93ebe305] deallocate_for_instance() {{(pid=75226) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 17 01:49:05 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-3b9431d1-1ef7-4991-8b56-3843f0edc105 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json" returned: 0 in 0.185s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:49:05 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-3b9431d1-1ef7-4991-8b56-3843f0edc105 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Acquiring lock "a8a62c2546af3a2036b853250c5ac64d4c6b4371" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:49:05 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-3b9431d1-1ef7-4991-8b56-3843f0edc105 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Lock "a8a62c2546af3a2036b853250c5ac64d4c6b4371" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:49:05 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-3b9431d1-1ef7-4991-8b56-3843f0edc105 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:49:05 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-3b9431d1-1ef7-4991-8b56-3843f0edc105 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json" returned: 0 in 0.179s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:49:05 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-3b9431d1-1ef7-4991-8b56-3843f0edc105 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371,backing_fmt=raw /opt/stack/data/nova/instances/4bb19560-6149-4c39-8596-3c4c11c4247d/disk 1073741824 {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:49:05 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-3b9431d1-1ef7-4991-8b56-3843f0edc105 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371,backing_fmt=raw /opt/stack/data/nova/instances/4bb19560-6149-4c39-8596-3c4c11c4247d/disk 1073741824" returned: 0 in 0.159s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:49:05 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-3b9431d1-1ef7-4991-8b56-3843f0edc105 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Lock "a8a62c2546af3a2036b853250c5ac64d4c6b4371" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.344s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:49:05 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-3b9431d1-1ef7-4991-8b56-3843f0edc105 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:49:05 user nova-compute[75226]: DEBUG nova.network.neutron [None req-3b9431d1-1ef7-4991-8b56-3843f0edc105 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] [instance: 4bb19560-6149-4c39-8596-3c4c11c4247d] Successfully created port: 8a3e1ef1-37aa-4d8f-9484-143213c68bf1 {{(pid=75226) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 17 01:49:05 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-3b9431d1-1ef7-4991-8b56-3843f0edc105 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json" returned: 0 in 0.173s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:49:05 user nova-compute[75226]: DEBUG nova.virt.disk.api [None req-3b9431d1-1ef7-4991-8b56-3843f0edc105 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4bb19560-6149-4c39-8596-3c4c11c4247d/disk. size=1073741824 {{(pid=75226) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 17 01:49:05 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-3b9431d1-1ef7-4991-8b56-3843f0edc105 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bb19560-6149-4c39-8596-3c4c11c4247d/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:49:05 user nova-compute[75226]: DEBUG nova.network.neutron [-] [instance: b74709d7-5cbe-4542-a052-1e9b93ebe305] Updating instance_info_cache with network_info: [] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:49:06 user nova-compute[75226]: DEBUG nova.compute.manager [req-f27e452c-3a6f-4a14-accb-e815eaae96ca req-99c1bfe2-2984-4174-8a21-20b386323fbc service nova] [instance: b74709d7-5cbe-4542-a052-1e9b93ebe305] Received event network-vif-deleted-cafd7924-2152-401e-9888-519446bfa93f {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:49:06 user nova-compute[75226]: INFO nova.compute.manager [req-f27e452c-3a6f-4a14-accb-e815eaae96ca req-99c1bfe2-2984-4174-8a21-20b386323fbc service nova] [instance: b74709d7-5cbe-4542-a052-1e9b93ebe305] Neutron deleted interface cafd7924-2152-401e-9888-519446bfa93f; detaching it from the instance and deleting it from the info cache
Nov 17 01:49:06 user nova-compute[75226]: DEBUG nova.network.neutron [req-f27e452c-3a6f-4a14-accb-e815eaae96ca req-99c1bfe2-2984-4174-8a21-20b386323fbc service nova] [instance: b74709d7-5cbe-4542-a052-1e9b93ebe305] Updating instance_info_cache with network_info: [] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:49:06 user nova-compute[75226]: INFO nova.compute.manager [-] [instance: b74709d7-5cbe-4542-a052-1e9b93ebe305] Took 0.69 seconds to deallocate network for instance.
Nov 17 01:49:06 user nova-compute[75226]: DEBUG nova.compute.manager [req-f27e452c-3a6f-4a14-accb-e815eaae96ca req-99c1bfe2-2984-4174-8a21-20b386323fbc service nova] [instance: b74709d7-5cbe-4542-a052-1e9b93ebe305] Detach interface failed, port_id=cafd7924-2152-401e-9888-519446bfa93f, reason: Instance b74709d7-5cbe-4542-a052-1e9b93ebe305 could not be found. {{(pid=75226) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 17 01:49:06 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-3b9431d1-1ef7-4991-8b56-3843f0edc105 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bb19560-6149-4c39-8596-3c4c11c4247d/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:49:06 user nova-compute[75226]: DEBUG nova.virt.disk.api [None req-3b9431d1-1ef7-4991-8b56-3843f0edc105 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Cannot resize image /opt/stack/data/nova/instances/4bb19560-6149-4c39-8596-3c4c11c4247d/disk to a smaller size. {{(pid=75226) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 17 01:49:06 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-3b9431d1-1ef7-4991-8b56-3843f0edc105 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] [instance: 4bb19560-6149-4c39-8596-3c4c11c4247d] Created local disks {{(pid=75226) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 17 01:49:06 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-3b9431d1-1ef7-4991-8b56-3843f0edc105 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] [instance: 4bb19560-6149-4c39-8596-3c4c11c4247d] Ensure instance console log exists: /opt/stack/data/nova/instances/4bb19560-6149-4c39-8596-3c4c11c4247d/console.log {{(pid=75226) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 17 01:49:06 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-3b9431d1-1ef7-4991-8b56-3843f0edc105 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:49:06 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-3b9431d1-1ef7-4991-8b56-3843f0edc105 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:49:06 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-3b9431d1-1ef7-4991-8b56-3843f0edc105 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:49:06 user nova-compute[75226]: DEBUG nova.compute.manager [req-4089d72c-78c7-414f-8f4f-4ff62c6a7845 req-019296c8-db1a-4a39-b300-8d80b6aa69ea service nova] [instance: b74709d7-5cbe-4542-a052-1e9b93ebe305] Received event network-vif-plugged-cafd7924-2152-401e-9888-519446bfa93f {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:49:06 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-4089d72c-78c7-414f-8f4f-4ff62c6a7845 req-019296c8-db1a-4a39-b300-8d80b6aa69ea service nova] Acquiring lock "b74709d7-5cbe-4542-a052-1e9b93ebe305-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:49:06 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-4089d72c-78c7-414f-8f4f-4ff62c6a7845 req-019296c8-db1a-4a39-b300-8d80b6aa69ea service nova] Lock "b74709d7-5cbe-4542-a052-1e9b93ebe305-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:49:06 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-4089d72c-78c7-414f-8f4f-4ff62c6a7845 req-019296c8-db1a-4a39-b300-8d80b6aa69ea service nova] Lock "b74709d7-5cbe-4542-a052-1e9b93ebe305-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:49:06 user nova-compute[75226]: DEBUG nova.compute.manager [req-4089d72c-78c7-414f-8f4f-4ff62c6a7845 req-019296c8-db1a-4a39-b300-8d80b6aa69ea service nova] [instance: b74709d7-5cbe-4542-a052-1e9b93ebe305] No waiting events found dispatching network-vif-plugged-cafd7924-2152-401e-9888-519446bfa93f {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:49:06 user nova-compute[75226]: WARNING nova.compute.manager [req-4089d72c-78c7-414f-8f4f-4ff62c6a7845 req-019296c8-db1a-4a39-b300-8d80b6aa69ea service nova] [instance: b74709d7-5cbe-4542-a052-1e9b93ebe305] Received unexpected event network-vif-plugged-cafd7924-2152-401e-9888-519446bfa93f for instance with vm_state active and task_state deleting.
Nov 17 01:49:06 user nova-compute[75226]: DEBUG nova.network.neutron [None req-3b9431d1-1ef7-4991-8b56-3843f0edc105 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] [instance: 4bb19560-6149-4c39-8596-3c4c11c4247d] Successfully updated port: 8a3e1ef1-37aa-4d8f-9484-143213c68bf1 {{(pid=75226) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 17 01:49:06 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-3b9431d1-1ef7-4991-8b56-3843f0edc105 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Acquiring lock "refresh_cache-4bb19560-6149-4c39-8596-3c4c11c4247d" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:49:06 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-3b9431d1-1ef7-4991-8b56-3843f0edc105 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Acquired lock "refresh_cache-4bb19560-6149-4c39-8596-3c4c11c4247d" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:49:06 user nova-compute[75226]: DEBUG nova.network.neutron [None req-3b9431d1-1ef7-4991-8b56-3843f0edc105 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] [instance: 4bb19560-6149-4c39-8596-3c4c11c4247d] Building network info cache for instance {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 01:49:06 user nova-compute[75226]: DEBUG nova.compute.manager [req-2d9238c5-1454-4d0b-9be2-bbe4a723c8cc req-e9329180-1edf-48e1-896f-262e21859748 service nova] [instance: 4bb19560-6149-4c39-8596-3c4c11c4247d] Received event network-changed-8a3e1ef1-37aa-4d8f-9484-143213c68bf1 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:49:06 user nova-compute[75226]: DEBUG nova.compute.manager [req-2d9238c5-1454-4d0b-9be2-bbe4a723c8cc req-e9329180-1edf-48e1-896f-262e21859748 service nova] [instance: 4bb19560-6149-4c39-8596-3c4c11c4247d] Refreshing instance network info cache due to event network-changed-8a3e1ef1-37aa-4d8f-9484-143213c68bf1. {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 01:49:06 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-2d9238c5-1454-4d0b-9be2-bbe4a723c8cc req-e9329180-1edf-48e1-896f-262e21859748 service nova] Acquiring lock "refresh_cache-4bb19560-6149-4c39-8596-3c4c11c4247d" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:49:06 user nova-compute[75226]: DEBUG nova.network.neutron [None req-3b9431d1-1ef7-4991-8b56-3843f0edc105 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] [instance: 4bb19560-6149-4c39-8596-3c4c11c4247d] Instance cache missing network info. {{(pid=75226) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 17 01:49:06 user nova-compute[75226]: INFO nova.compute.manager [None req-4b6b51cd-6bdd-4c86-9f4f-2d39b62c1177 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: b74709d7-5cbe-4542-a052-1e9b93ebe305] Took 0.81 seconds to detach 1 volumes for instance.
Nov 17 01:49:06 user nova-compute[75226]: DEBUG nova.compute.manager [None req-4b6b51cd-6bdd-4c86-9f4f-2d39b62c1177 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: b74709d7-5cbe-4542-a052-1e9b93ebe305] Deleting volume: d53822e7-4aff-4a77-9789-8759b4988dca {{(pid=75226) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 17 01:49:06 user nova-compute[75226]: DEBUG nova.network.neutron [None req-3b9431d1-1ef7-4991-8b56-3843f0edc105 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] [instance: 4bb19560-6149-4c39-8596-3c4c11c4247d] Updating instance_info_cache with network_info: [{"id": "8a3e1ef1-37aa-4d8f-9484-143213c68bf1", "address": "fa:16:3e:16:03:37", "network": {"id": "2d06b621-84a6-48dc-be05-92b6724810e3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1055056582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "acc65d32b52442aea872bf9f6025c4e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a3e1ef1-37", "ovs_interfaceid": "8a3e1ef1-37aa-4d8f-9484-143213c68bf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:49:06 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-3b9431d1-1ef7-4991-8b56-3843f0edc105 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Releasing lock "refresh_cache-4bb19560-6149-4c39-8596-3c4c11c4247d" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:49:06 user nova-compute[75226]: DEBUG nova.compute.manager [None req-3b9431d1-1ef7-4991-8b56-3843f0edc105 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] [instance: 4bb19560-6149-4c39-8596-3c4c11c4247d] Instance network_info: |[{"id": "8a3e1ef1-37aa-4d8f-9484-143213c68bf1", "address": "fa:16:3e:16:03:37", "network": {"id": "2d06b621-84a6-48dc-be05-92b6724810e3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1055056582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "acc65d32b52442aea872bf9f6025c4e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a3e1ef1-37", "ovs_interfaceid": "8a3e1ef1-37aa-4d8f-9484-143213c68bf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75226) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 17 01:49:06 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-2d9238c5-1454-4d0b-9be2-bbe4a723c8cc req-e9329180-1edf-48e1-896f-262e21859748 service nova] Acquired lock "refresh_cache-4bb19560-6149-4c39-8596-3c4c11c4247d" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:49:06 user nova-compute[75226]: DEBUG nova.network.neutron [req-2d9238c5-1454-4d0b-9be2-bbe4a723c8cc req-e9329180-1edf-48e1-896f-262e21859748 service nova] [instance: 4bb19560-6149-4c39-8596-3c4c11c4247d] Refreshing network info cache for port 8a3e1ef1-37aa-4d8f-9484-143213c68bf1 {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 01:49:06 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-3b9431d1-1ef7-4991-8b56-3843f0edc105 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] [instance: 4bb19560-6149-4c39-8596-3c4c11c4247d] Start _get_guest_xml network_info=[{"id": "8a3e1ef1-37aa-4d8f-9484-143213c68bf1", "address": "fa:16:3e:16:03:37", "network": {"id": "2d06b621-84a6-48dc-be05-92b6724810e3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1055056582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "acc65d32b52442aea872bf9f6025c4e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a3e1ef1-37", "ovs_interfaceid": "8a3e1ef1-37aa-4d8f-9484-143213c68bf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T01:13:22Z,direct_url=<?>,disk_format='qcow2',id=0b369aea-6f3f-4690-9f01-229b90ab6310,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4e110cbf9a84362a6864a7732c435a1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T01:13:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '0b369aea-6f3f-4690-9f01-229b90ab6310'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75226) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 17 01:49:06 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-3b9431d1-1ef7-4991-8b56-3843f0edc105 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:49:06 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-3b9431d1-1ef7-4991-8b56-3843f0edc105 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:49:06 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-3b9431d1-1ef7-4991-8b56-3843f0edc105 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75226) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 17 01:49:06 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-3b9431d1-1ef7-4991-8b56-3843f0edc105 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] CPU controller missing on host. {{(pid=75226) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 17 01:49:06 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-3b9431d1-1ef7-4991-8b56-3843f0edc105 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75226) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 17 01:49:06 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-3b9431d1-1ef7-4991-8b56-3843f0edc105 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] CPU controller found on host. {{(pid=75226) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 17 01:49:06 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-3b9431d1-1ef7-4991-8b56-3843f0edc105 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75226) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 17 01:49:06 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-3b9431d1-1ef7-4991-8b56-3843f0edc105 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-17T01:13:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T01:13:22Z,direct_url=<?>,disk_format='qcow2',id=0b369aea-6f3f-4690-9f01-229b90ab6310,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4e110cbf9a84362a6864a7732c435a1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T01:13:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 17 01:49:06 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-3b9431d1-1ef7-4991-8b56-3843f0edc105 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Flavor limits 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 17 01:49:06 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-3b9431d1-1ef7-4991-8b56-3843f0edc105 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Image limits 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 17 01:49:06 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-3b9431d1-1ef7-4991-8b56-3843f0edc105 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Flavor pref 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 17 01:49:06 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-3b9431d1-1ef7-4991-8b56-3843f0edc105 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Image pref 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 17 01:49:06 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-3b9431d1-1ef7-4991-8b56-3843f0edc105 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 17 01:49:06 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-3b9431d1-1ef7-4991-8b56-3843f0edc105 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 17 01:49:06 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-3b9431d1-1ef7-4991-8b56-3843f0edc105 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75226) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 17 01:49:06 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-3b9431d1-1ef7-4991-8b56-3843f0edc105 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Got 1 possible topologies {{(pid=75226) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 17 01:49:06 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-3b9431d1-1ef7-4991-8b56-3843f0edc105 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 17 01:49:06 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-3b9431d1-1ef7-4991-8b56-3843f0edc105 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 17 01:49:06 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-3b9431d1-1ef7-4991-8b56-3843f0edc105 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:49:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1266956347',display_name='tempest-VolumesSnapshotTestJSON-instance-1266956347',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1266956347',id=49,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKgO3p7F+R/bYiQkE6wuxyJuaD0kp/IXfGArsTHYwP6PM3DTC7G9o+hu35TmU+6EYNJmCCIdKDhdQ9SjKQbQgYgr8LtZgwqL/h4upRuf+EL0Dl+mTCcm1MKOtuixJZn7zQ==',key_name='tempest-keypair-582749377',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='acc65d32b52442aea872bf9f6025c4e4',ramdisk_id='',reservation_id='r-nbuyxhm7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1912813406',owner_user_name='tempest-VolumesSnapshotTestJSON-1912813406-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T01:49:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='664817f1ee104181aa271179f9d8e0e1',uuid=4bb19560-6149-4c39-8596-3c4c11c4247d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8a3e1ef1-37aa-4d8f-9484-143213c68bf1", "address": "fa:16:3e:16:03:37", "network": {"id": "2d06b621-84a6-48dc-be05-92b6724810e3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1055056582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "acc65d32b52442aea872bf9f6025c4e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a3e1ef1-37", "ovs_interfaceid": "8a3e1ef1-37aa-4d8f-9484-143213c68bf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75226) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 01:49:06 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-3b9431d1-1ef7-4991-8b56-3843f0edc105 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Converting VIF {"id": "8a3e1ef1-37aa-4d8f-9484-143213c68bf1", "address": "fa:16:3e:16:03:37", "network": {"id": "2d06b621-84a6-48dc-be05-92b6724810e3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1055056582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "acc65d32b52442aea872bf9f6025c4e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a3e1ef1-37", "ovs_interfaceid": "8a3e1ef1-37aa-4d8f-9484-143213c68bf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:49:06 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-3b9431d1-1ef7-4991-8b56-3843f0edc105 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:03:37,bridge_name='br-int',has_traffic_filtering=True,id=8a3e1ef1-37aa-4d8f-9484-143213c68bf1,network=Network(2d06b621-84a6-48dc-be05-92b6724810e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a3e1ef1-37') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:49:06 user nova-compute[75226]: DEBUG nova.objects.instance [None req-3b9431d1-1ef7-4991-8b56-3843f0edc105 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Lazy-loading 'pci_devices' on Instance uuid 4bb19560-6149-4c39-8596-3c4c11c4247d {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:49:06 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-3b9431d1-1ef7-4991-8b56-3843f0edc105 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] [instance: 4bb19560-6149-4c39-8596-3c4c11c4247d] End _get_guest_xml xml=<domain type="kvm">
Nov 17 01:49:06 user nova-compute[75226]:   <uuid>4bb19560-6149-4c39-8596-3c4c11c4247d</uuid>
Nov 17 01:49:06 user nova-compute[75226]:   <name>instance-00000031</name>
Nov 17 01:49:06 user nova-compute[75226]:   <memory>524288</memory>
Nov 17 01:49:06 user nova-compute[75226]:   <vcpu>1</vcpu>
Nov 17 01:49:06 user nova-compute[75226]:   <metadata>
Nov 17 01:49:06 user nova-compute[75226]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 17 01:49:06 user nova-compute[75226]:       <nova:package version="0.0.0"/>
Nov 17 01:49:06 user nova-compute[75226]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1266956347</nova:name>
Nov 17 01:49:06 user nova-compute[75226]:       <nova:creationTime>2023-11-17 01:49:06</nova:creationTime>
Nov 17 01:49:06 user nova-compute[75226]:       <nova:flavor name="m1.tiny">
Nov 17 01:49:06 user nova-compute[75226]:         <nova:memory>512</nova:memory>
Nov 17 01:49:06 user nova-compute[75226]:         <nova:disk>1</nova:disk>
Nov 17 01:49:06 user nova-compute[75226]:         <nova:swap>0</nova:swap>
Nov 17 01:49:06 user nova-compute[75226]:         <nova:ephemeral>0</nova:ephemeral>
Nov 17 01:49:06 user nova-compute[75226]:         <nova:vcpus>1</nova:vcpus>
Nov 17 01:49:06 user nova-compute[75226]:       </nova:flavor>
Nov 17 01:49:06 user nova-compute[75226]:       <nova:owner>
Nov 17 01:49:06 user nova-compute[75226]:         <nova:user uuid="664817f1ee104181aa271179f9d8e0e1">tempest-VolumesSnapshotTestJSON-1912813406-project-member</nova:user>
Nov 17 01:49:06 user nova-compute[75226]:         <nova:project uuid="acc65d32b52442aea872bf9f6025c4e4">tempest-VolumesSnapshotTestJSON-1912813406</nova:project>
Nov 17 01:49:06 user nova-compute[75226]:       </nova:owner>
Nov 17 01:49:06 user nova-compute[75226]:       <nova:root type="image" uuid="0b369aea-6f3f-4690-9f01-229b90ab6310"/>
Nov 17 01:49:06 user nova-compute[75226]:       <nova:ports>
Nov 17 01:49:06 user nova-compute[75226]:         <nova:port uuid="8a3e1ef1-37aa-4d8f-9484-143213c68bf1">
Nov 17 01:49:06 user nova-compute[75226]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 17 01:49:06 user nova-compute[75226]:         </nova:port>
Nov 17 01:49:06 user nova-compute[75226]:       </nova:ports>
Nov 17 01:49:06 user nova-compute[75226]:     </nova:instance>
Nov 17 01:49:06 user nova-compute[75226]:   </metadata>
Nov 17 01:49:06 user nova-compute[75226]:   <sysinfo type="smbios">
Nov 17 01:49:06 user nova-compute[75226]:     <system>
Nov 17 01:49:06 user nova-compute[75226]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 17 01:49:06 user nova-compute[75226]:       <entry name="product">OpenStack Nova</entry>
Nov 17 01:49:06 user nova-compute[75226]:       <entry name="version">0.0.0</entry>
Nov 17 01:49:06 user nova-compute[75226]:       <entry name="serial">4bb19560-6149-4c39-8596-3c4c11c4247d</entry>
Nov 17 01:49:06 user nova-compute[75226]:       <entry name="uuid">4bb19560-6149-4c39-8596-3c4c11c4247d</entry>
Nov 17 01:49:06 user nova-compute[75226]:       <entry name="family">Virtual Machine</entry>
Nov 17 01:49:06 user nova-compute[75226]:     </system>
Nov 17 01:49:06 user nova-compute[75226]:   </sysinfo>
Nov 17 01:49:06 user nova-compute[75226]:   <os>
Nov 17 01:49:06 user nova-compute[75226]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 17 01:49:06 user nova-compute[75226]:     <boot dev="hd"/>
Nov 17 01:49:06 user nova-compute[75226]:     <smbios mode="sysinfo"/>
Nov 17 01:49:06 user nova-compute[75226]:   </os>
Nov 17 01:49:06 user nova-compute[75226]:   <features>
Nov 17 01:49:06 user nova-compute[75226]:     <acpi/>
Nov 17 01:49:06 user nova-compute[75226]:     <apic/>
Nov 17 01:49:06 user nova-compute[75226]:     <vmcoreinfo/>
Nov 17 01:49:06 user nova-compute[75226]:   </features>
Nov 17 01:49:06 user nova-compute[75226]:   <clock offset="utc">
Nov 17 01:49:06 user nova-compute[75226]:     <timer name="pit" tickpolicy="delay"/>
Nov 17 01:49:06 user nova-compute[75226]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 17 01:49:06 user nova-compute[75226]:     <timer name="hpet" present="no"/>
Nov 17 01:49:06 user nova-compute[75226]:   </clock>
Nov 17 01:49:06 user nova-compute[75226]:   <cpu mode="custom" match="exact">
Nov 17 01:49:06 user nova-compute[75226]:     <model>Nehalem</model>
Nov 17 01:49:06 user nova-compute[75226]:     <topology sockets="1" cores="1" threads="1"/>
Nov 17 01:49:06 user nova-compute[75226]:   </cpu>
Nov 17 01:49:06 user nova-compute[75226]:   <devices>
Nov 17 01:49:06 user nova-compute[75226]:     <disk type="file" device="disk">
Nov 17 01:49:06 user nova-compute[75226]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 17 01:49:06 user nova-compute[75226]:       <source file="/opt/stack/data/nova/instances/4bb19560-6149-4c39-8596-3c4c11c4247d/disk"/>
Nov 17 01:49:06 user nova-compute[75226]:       <target dev="vda" bus="virtio"/>
Nov 17 01:49:06 user nova-compute[75226]:     </disk>
Nov 17 01:49:06 user nova-compute[75226]:     <interface type="ethernet">
Nov 17 01:49:06 user nova-compute[75226]:       <mac address="fa:16:3e:16:03:37"/>
Nov 17 01:49:06 user nova-compute[75226]:       <model type="virtio"/>
Nov 17 01:49:06 user nova-compute[75226]:       <mtu size="1442"/>
Nov 17 01:49:06 user nova-compute[75226]:       <target dev="tap8a3e1ef1-37"/>
Nov 17 01:49:06 user nova-compute[75226]:     </interface>
Nov 17 01:49:06 user nova-compute[75226]:     <serial type="pty">
Nov 17 01:49:06 user nova-compute[75226]:       <log file="/opt/stack/data/nova/instances/4bb19560-6149-4c39-8596-3c4c11c4247d/console.log" append="off"/>
Nov 17 01:49:06 user nova-compute[75226]:     </serial>
Nov 17 01:49:06 user nova-compute[75226]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 17 01:49:06 user nova-compute[75226]:     <video>
Nov 17 01:49:06 user nova-compute[75226]:       <model type="virtio"/>
Nov 17 01:49:06 user nova-compute[75226]:     </video>
Nov 17 01:49:06 user nova-compute[75226]:     <rng model="virtio">
Nov 17 01:49:06 user nova-compute[75226]:       <backend model="random">/dev/urandom</backend>
Nov 17 01:49:06 user nova-compute[75226]:     </rng>
Nov 17 01:49:06 user nova-compute[75226]:     <controller type="usb" index="0" model="none"/>
Nov 17 01:49:06 user nova-compute[75226]:     <memballoon model="virtio">
Nov 17 01:49:06 user nova-compute[75226]:       <stats period="10"/>
Nov 17 01:49:06 user nova-compute[75226]:     </memballoon>
Nov 17 01:49:06 user nova-compute[75226]:   </devices>
Nov 17 01:49:06 user nova-compute[75226]: </domain>
Nov 17 01:49:06 user nova-compute[75226]:  {{(pid=75226) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 17 01:49:06 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-3b9431d1-1ef7-4991-8b56-3843f0edc105 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:49:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1266956347',display_name='tempest-VolumesSnapshotTestJSON-instance-1266956347',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1266956347',id=49,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKgO3p7F+R/bYiQkE6wuxyJuaD0kp/IXfGArsTHYwP6PM3DTC7G9o+hu35TmU+6EYNJmCCIdKDhdQ9SjKQbQgYgr8LtZgwqL/h4upRuf+EL0Dl+mTCcm1MKOtuixJZn7zQ==',key_name='tempest-keypair-582749377',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='acc65d32b52442aea872bf9f6025c4e4',ramdisk_id='',reservation_id='r-nbuyxhm7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1912813406',owner_user_name='tempest-VolumesSnapshotTestJSON-1912813406-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T01:49:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='664817f1ee104181aa271179f9d8e0e1',uuid=4bb19560-6149-4c39-8596-3c4c11c4247d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8a3e1ef1-37aa-4d8f-9484-143213c68bf1", "address": "fa:16:3e:16:03:37", "network": {"id": "2d06b621-84a6-48dc-be05-92b6724810e3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1055056582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "acc65d32b52442aea872bf9f6025c4e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a3e1ef1-37", "ovs_interfaceid": "8a3e1ef1-37aa-4d8f-9484-143213c68bf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 17 01:49:06 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-3b9431d1-1ef7-4991-8b56-3843f0edc105 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Converting VIF {"id": "8a3e1ef1-37aa-4d8f-9484-143213c68bf1", "address": "fa:16:3e:16:03:37", "network": {"id": "2d06b621-84a6-48dc-be05-92b6724810e3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1055056582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "acc65d32b52442aea872bf9f6025c4e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a3e1ef1-37", "ovs_interfaceid": "8a3e1ef1-37aa-4d8f-9484-143213c68bf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:49:06 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-3b9431d1-1ef7-4991-8b56-3843f0edc105 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:03:37,bridge_name='br-int',has_traffic_filtering=True,id=8a3e1ef1-37aa-4d8f-9484-143213c68bf1,network=Network(2d06b621-84a6-48dc-be05-92b6724810e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a3e1ef1-37') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:49:06 user nova-compute[75226]: DEBUG os_vif [None req-3b9431d1-1ef7-4991-8b56-3843f0edc105 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:03:37,bridge_name='br-int',has_traffic_filtering=True,id=8a3e1ef1-37aa-4d8f-9484-143213c68bf1,network=Network(2d06b621-84a6-48dc-be05-92b6724810e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a3e1ef1-37') {{(pid=75226) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 17 01:49:06 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:49:06 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:49:06 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 17 01:49:06 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:49:06 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '78a39bed-e347-5fdb-bc65-14a605c66d8d', '_type': 'linux-noop'}}, row=False) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:49:06 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:49:06 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:49:06 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:49:06 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8a3e1ef1-37, may_exist=True, interface_attrs={}) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:49:06 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8a3e1ef1-37, col_values=(('qos', UUID('85aa4711-9eb2-4b29-8ff7-a3b50ca8ed10')),), if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:49:06 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8a3e1ef1-37, col_values=(('external_ids', {'iface-id': '8a3e1ef1-37aa-4d8f-9484-143213c68bf1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:16:03:37', 'vm-uuid': '4bb19560-6149-4c39-8596-3c4c11c4247d'}),), if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:49:06 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:49:06 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:49:06 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:49:06 user nova-compute[75226]: INFO os_vif [None req-3b9431d1-1ef7-4991-8b56-3843f0edc105 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:03:37,bridge_name='br-int',has_traffic_filtering=True,id=8a3e1ef1-37aa-4d8f-9484-143213c68bf1,network=Network(2d06b621-84a6-48dc-be05-92b6724810e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a3e1ef1-37')
Nov 17 01:49:06 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-4b6b51cd-6bdd-4c86-9f4f-2d39b62c1177 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:49:06 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-4b6b51cd-6bdd-4c86-9f4f-2d39b62c1177 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:49:07 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-3b9431d1-1ef7-4991-8b56-3843f0edc105 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] No BDM found with device name vda, not building metadata. {{(pid=75226) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 01:49:07 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-3b9431d1-1ef7-4991-8b56-3843f0edc105 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] No VIF found with MAC fa:16:3e:16:03:37, not building metadata {{(pid=75226) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 01:49:07 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-4b6b51cd-6bdd-4c86-9f4f-2d39b62c1177 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:49:07 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-4b6b51cd-6bdd-4c86-9f4f-2d39b62c1177 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:49:07 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-4b6b51cd-6bdd-4c86-9f4f-2d39b62c1177 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.223s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:49:07 user nova-compute[75226]: INFO nova.scheduler.client.report [None req-4b6b51cd-6bdd-4c86-9f4f-2d39b62c1177 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Deleted allocations for instance b74709d7-5cbe-4542-a052-1e9b93ebe305
Nov 17 01:49:07 user nova-compute[75226]: DEBUG nova.network.neutron [req-2d9238c5-1454-4d0b-9be2-bbe4a723c8cc req-e9329180-1edf-48e1-896f-262e21859748 service nova] [instance: 4bb19560-6149-4c39-8596-3c4c11c4247d] Updated VIF entry in instance network info cache for port 8a3e1ef1-37aa-4d8f-9484-143213c68bf1. {{(pid=75226) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 01:49:07 user nova-compute[75226]: DEBUG nova.network.neutron [req-2d9238c5-1454-4d0b-9be2-bbe4a723c8cc req-e9329180-1edf-48e1-896f-262e21859748 service nova] [instance: 4bb19560-6149-4c39-8596-3c4c11c4247d] Updating instance_info_cache with network_info: [{"id": "8a3e1ef1-37aa-4d8f-9484-143213c68bf1", "address": "fa:16:3e:16:03:37", "network": {"id": "2d06b621-84a6-48dc-be05-92b6724810e3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1055056582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "acc65d32b52442aea872bf9f6025c4e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a3e1ef1-37", "ovs_interfaceid": "8a3e1ef1-37aa-4d8f-9484-143213c68bf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:49:07 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-2d9238c5-1454-4d0b-9be2-bbe4a723c8cc req-e9329180-1edf-48e1-896f-262e21859748 service nova] Releasing lock "refresh_cache-4bb19560-6149-4c39-8596-3c4c11c4247d" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:49:07 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-4b6b51cd-6bdd-4c86-9f4f-2d39b62c1177 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Lock "b74709d7-5cbe-4542-a052-1e9b93ebe305" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.332s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:49:08 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:49:08 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:49:08 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:49:08 user nova-compute[75226]: DEBUG nova.compute.manager [req-1a5fbd59-5478-4122-8119-8527eef3b703 req-e1539776-3eb6-410d-aa8b-5620aa9c926c service nova] [instance: 4bb19560-6149-4c39-8596-3c4c11c4247d] Received event network-vif-plugged-8a3e1ef1-37aa-4d8f-9484-143213c68bf1 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:49:08 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-1a5fbd59-5478-4122-8119-8527eef3b703 req-e1539776-3eb6-410d-aa8b-5620aa9c926c service nova] Acquiring lock "4bb19560-6149-4c39-8596-3c4c11c4247d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:49:08 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-1a5fbd59-5478-4122-8119-8527eef3b703 req-e1539776-3eb6-410d-aa8b-5620aa9c926c service nova] Lock "4bb19560-6149-4c39-8596-3c4c11c4247d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:49:08 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-1a5fbd59-5478-4122-8119-8527eef3b703 req-e1539776-3eb6-410d-aa8b-5620aa9c926c service nova] Lock "4bb19560-6149-4c39-8596-3c4c11c4247d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:49:08 user nova-compute[75226]: DEBUG nova.compute.manager [req-1a5fbd59-5478-4122-8119-8527eef3b703 req-e1539776-3eb6-410d-aa8b-5620aa9c926c service nova] [instance: 4bb19560-6149-4c39-8596-3c4c11c4247d] No waiting events found dispatching network-vif-plugged-8a3e1ef1-37aa-4d8f-9484-143213c68bf1 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:49:08 user nova-compute[75226]: WARNING nova.compute.manager [req-1a5fbd59-5478-4122-8119-8527eef3b703 req-e1539776-3eb6-410d-aa8b-5620aa9c926c service nova] [instance: 4bb19560-6149-4c39-8596-3c4c11c4247d] Received unexpected event network-vif-plugged-8a3e1ef1-37aa-4d8f-9484-143213c68bf1 for instance with vm_state building and task_state spawning.
Nov 17 01:49:08 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:49:08 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:49:08 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:49:08 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:49:08 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:49:10 user nova-compute[75226]: DEBUG nova.compute.manager [req-caee37fa-39db-48c0-9edf-3ae97234e2ea req-3208cc80-66a3-421d-97ae-dbd5cac18f00 service nova] [instance: 4bb19560-6149-4c39-8596-3c4c11c4247d] Received event network-vif-plugged-8a3e1ef1-37aa-4d8f-9484-143213c68bf1 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:49:10 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-caee37fa-39db-48c0-9edf-3ae97234e2ea req-3208cc80-66a3-421d-97ae-dbd5cac18f00 service nova] Acquiring lock "4bb19560-6149-4c39-8596-3c4c11c4247d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:49:10 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-caee37fa-39db-48c0-9edf-3ae97234e2ea req-3208cc80-66a3-421d-97ae-dbd5cac18f00 service nova] Lock "4bb19560-6149-4c39-8596-3c4c11c4247d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:49:10 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-caee37fa-39db-48c0-9edf-3ae97234e2ea req-3208cc80-66a3-421d-97ae-dbd5cac18f00 service nova] Lock "4bb19560-6149-4c39-8596-3c4c11c4247d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:49:10 user nova-compute[75226]: DEBUG nova.compute.manager [req-caee37fa-39db-48c0-9edf-3ae97234e2ea req-3208cc80-66a3-421d-97ae-dbd5cac18f00 service nova] [instance: 4bb19560-6149-4c39-8596-3c4c11c4247d] No waiting events found dispatching network-vif-plugged-8a3e1ef1-37aa-4d8f-9484-143213c68bf1 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:49:10 user nova-compute[75226]: WARNING nova.compute.manager [req-caee37fa-39db-48c0-9edf-3ae97234e2ea req-3208cc80-66a3-421d-97ae-dbd5cac18f00 service nova] [instance: 4bb19560-6149-4c39-8596-3c4c11c4247d] Received unexpected event network-vif-plugged-8a3e1ef1-37aa-4d8f-9484-143213c68bf1 for instance with vm_state building and task_state spawning.
Nov 17 01:49:10 user nova-compute[75226]: DEBUG nova.compute.manager [None req-3b9431d1-1ef7-4991-8b56-3843f0edc105 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] [instance: 4bb19560-6149-4c39-8596-3c4c11c4247d] Instance event wait completed in 0 seconds for  {{(pid=75226) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 17 01:49:10 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-3b9431d1-1ef7-4991-8b56-3843f0edc105 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] [instance: 4bb19560-6149-4c39-8596-3c4c11c4247d] Guest created on hypervisor {{(pid=75226) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 17 01:49:10 user nova-compute[75226]: INFO nova.virt.libvirt.driver [-] [instance: 4bb19560-6149-4c39-8596-3c4c11c4247d] Instance spawned successfully.
Nov 17 01:49:10 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-3b9431d1-1ef7-4991-8b56-3843f0edc105 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] [instance: 4bb19560-6149-4c39-8596-3c4c11c4247d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 17 01:49:10 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-3b9431d1-1ef7-4991-8b56-3843f0edc105 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] [instance: 4bb19560-6149-4c39-8596-3c4c11c4247d] Found default for hw_cdrom_bus of ide {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:49:10 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-3b9431d1-1ef7-4991-8b56-3843f0edc105 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] [instance: 4bb19560-6149-4c39-8596-3c4c11c4247d] Found default for hw_disk_bus of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:49:10 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-3b9431d1-1ef7-4991-8b56-3843f0edc105 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] [instance: 4bb19560-6149-4c39-8596-3c4c11c4247d] Found default for hw_input_bus of None {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:49:10 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-3b9431d1-1ef7-4991-8b56-3843f0edc105 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] [instance: 4bb19560-6149-4c39-8596-3c4c11c4247d] Found default for hw_pointer_model of None {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:49:10 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-3b9431d1-1ef7-4991-8b56-3843f0edc105 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] [instance: 4bb19560-6149-4c39-8596-3c4c11c4247d] Found default for hw_video_model of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:49:10 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-3b9431d1-1ef7-4991-8b56-3843f0edc105 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] [instance: 4bb19560-6149-4c39-8596-3c4c11c4247d] Found default for hw_vif_model of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:49:10 user nova-compute[75226]: INFO nova.compute.manager [None req-3b9431d1-1ef7-4991-8b56-3843f0edc105 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] [instance: 4bb19560-6149-4c39-8596-3c4c11c4247d] Took 5.68 seconds to spawn the instance on the hypervisor.
Nov 17 01:49:10 user nova-compute[75226]: DEBUG nova.compute.manager [None req-3b9431d1-1ef7-4991-8b56-3843f0edc105 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] [instance: 4bb19560-6149-4c39-8596-3c4c11c4247d] Checking state {{(pid=75226) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 01:49:10 user nova-compute[75226]: INFO nova.compute.manager [None req-3b9431d1-1ef7-4991-8b56-3843f0edc105 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] [instance: 4bb19560-6149-4c39-8596-3c4c11c4247d] Took 6.43 seconds to build instance.
Nov 17 01:49:10 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-3b9431d1-1ef7-4991-8b56-3843f0edc105 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Lock "4bb19560-6149-4c39-8596-3c4c11c4247d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.528s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:49:11 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-93baac0f-6e36-43b4-8251-55019eefed4a tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Acquiring lock "014533a1-a4c3-4c65-a121-f46486cc5998" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:49:11 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-93baac0f-6e36-43b4-8251-55019eefed4a tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Lock "014533a1-a4c3-4c65-a121-f46486cc5998" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:49:11 user nova-compute[75226]: DEBUG nova.objects.instance [None req-93baac0f-6e36-43b4-8251-55019eefed4a tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Lazy-loading 'flavor' on Instance uuid 014533a1-a4c3-4c65-a121-f46486cc5998 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:49:11 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-93baac0f-6e36-43b4-8251-55019eefed4a tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Lock "014533a1-a4c3-4c65-a121-f46486cc5998" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:49:11 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-93baac0f-6e36-43b4-8251-55019eefed4a tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Acquiring lock "014533a1-a4c3-4c65-a121-f46486cc5998" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:49:11 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-93baac0f-6e36-43b4-8251-55019eefed4a tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Lock "014533a1-a4c3-4c65-a121-f46486cc5998" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:49:11 user nova-compute[75226]: INFO nova.compute.manager [None req-93baac0f-6e36-43b4-8251-55019eefed4a tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] [instance: 014533a1-a4c3-4c65-a121-f46486cc5998] Attaching volume 71cf6b5b-9b82-4529-83d0-a655dca8e796 to /dev/vdb
Nov 17 01:49:11 user nova-compute[75226]: DEBUG os_brick.utils [None req-93baac0f-6e36-43b4-8251-55019eefed4a tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:49:11 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:49:11 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:49:11 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d0867a6-6772-41ed-9ca1-58c91803ae2a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f62857db69\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:49:11 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:49:11 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:49:11 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dda1c1a-4c0a-4693-b366-cee0dcc61563]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:49:11 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:49:11 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:49:11 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[f97a6535-1e85-4340-bd46-34675c4845ab]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:49:11 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6262196-7339-4975-b380-2b2373817221]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:49:11 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-93baac0f-6e36-43b4-8251-55019eefed4a tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Running cmd (subprocess): nvme version {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:49:11 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-93baac0f-6e36-43b4-8251-55019eefed4a tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] 'nvme version' failed. Not Retrying. {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 01:49:11 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.nvmeof [None req-93baac0f-6e36-43b4-8251-55019eefed4a tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] nvme not present on system {{(pid=75226) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 17 01:49:11 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:49:11 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 01:49:11 user nova-compute[75226]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 17 01:49:11 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8036478-f862-41b7-b878-a50c25d073a1]: (4, '') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:49:11 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-93baac0f-6e36-43b4-8251-55019eefed4a tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75226) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 17 01:49:11 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-93baac0f-6e36-43b4-8251-55019eefed4a tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75226) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 17 01:49:11 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-93baac0f-6e36-43b4-8251-55019eefed4a tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] LIGHTOS: no hostnqn found. {{(pid=75226) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 17 01:49:11 user nova-compute[75226]: DEBUG os_brick.utils [None req-93baac0f-6e36-43b4-8251-55019eefed4a tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f62857db69', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:49:11 user nova-compute[75226]: DEBUG nova.virt.block_device [None req-93baac0f-6e36-43b4-8251-55019eefed4a tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] [instance: 014533a1-a4c3-4c65-a121-f46486cc5998] Updating existing volume attachment record: eafbe651-62fe-4ac2-9b3f-48f9c5319f4d {{(pid=75226) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 17 01:49:11 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:49:13 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:49:15 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:49:16 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:49:16 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:49:16 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:49:16 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75226) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 17 01:49:16 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/014533a1-a4c3-4c65-a121-f46486cc5998/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:49:16 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/014533a1-a4c3-4c65-a121-f46486cc5998/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:49:16 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/014533a1-a4c3-4c65-a121-f46486cc5998/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:49:16 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/014533a1-a4c3-4c65-a121-f46486cc5998/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:49:16 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75226) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 01:49:16 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bb19560-6149-4c39-8596-3c4c11c4247d/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:49:16 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bb19560-6149-4c39-8596-3c4c11c4247d/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:49:16 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bb19560-6149-4c39-8596-3c4c11c4247d/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:49:16 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bb19560-6149-4c39-8596-3c4c11c4247d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:49:17 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:49:17 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:49:17 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:49:17 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Hypervisor/Node resource view: name=user free_ram=8756MB free_disk=24.962642669677734GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75226) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 17 01:49:17 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:49:17 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:49:17 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-93baac0f-6e36-43b4-8251-55019eefed4a tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] [instance: 014533a1-a4c3-4c65-a121-f46486cc5998] Calling os-brick to attach iSCSI Volume {{(pid=75226) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 17 01:49:17 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-93baac0f-6e36-43b4-8251-55019eefed4a tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc4cc36b490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:71cf6b5b-9b82-4529-83d0-a655dca8e796', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lxyPOegq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:49:17 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-93baac0f-6e36-43b4-8251-55019eefed4a tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:49:17 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-93baac0f-6e36-43b4-8251-55019eefed4a tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:49:17 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-93baac0f-6e36-43b4-8251-55019eefed4a tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:49:17 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-93baac0f-6e36-43b4-8251-55019eefed4a tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:49:17 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-93baac0f-6e36-43b4-8251-55019eefed4a tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:71cf6b5b-9b82-4529-83d0-a655dca8e796" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:49:17 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-93baac0f-6e36-43b4-8251-55019eefed4a tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:71cf6b5b-9b82-4529-83d0-a655dca8e796" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:49:17 user nova-compute[75226]: INFO os_brick.initiator.connectors.iscsi [None req-93baac0f-6e36-43b4-8251-55019eefed4a tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 17 01:49:17 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71cf6b5b-9b82-4529-83d0-a655dca8e796 -p 172.16.0.220:3260 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:49:17 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance d281f155-01b4-4141-8184-8c5111a7c663 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:49:17 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 014533a1-a4c3-4c65-a121-f46486cc5998 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:49:17 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 4bb19560-6149-4c39-8596-3c4c11c4247d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:49:17 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75226) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 17 01:49:17 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75226) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 17 01:49:17 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71cf6b5b-9b82-4529-83d0-a655dca8e796 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:49:17 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[3091811f-b7b4-4e09-a92b-51a059f59f9d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:49:17 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-93baac0f-6e36-43b4-8251-55019eefed4a tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 17 01:49:17 user nova-compute[75226]:  {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:49:17 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71cf6b5b-9b82-4529-83d0-a655dca8e796 -p 172.16.0.220:3260 --interface default --op new {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:49:17 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71cf6b5b-9b82-4529-83d0-a655dca8e796 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:49:17 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce8a2a40-6c90-4c77-9426-1ef671dc59a3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:71cf6b5b-9b82-4529-83d0-a655dca8e796] added\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:49:17 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-93baac0f-6e36-43b4-8251-55019eefed4a tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:71cf6b5b-9b82-4529-83d0-a655dca8e796] added
Nov 17 01:49:17 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:49:17 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71cf6b5b-9b82-4529-83d0-a655dca8e796 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:49:17 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Refreshing inventories for resource provider f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 17 01:49:17 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71cf6b5b-9b82-4529-83d0-a655dca8e796 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:49:17 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[12212620-5413-4d67-949f-ad878531c11a]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:49:17 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-93baac0f-6e36-43b4-8251-55019eefed4a tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:49:17 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71cf6b5b-9b82-4529-83d0-a655dca8e796 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:49:17 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Updating ProviderTree inventory for provider f431122b-abb2-4ecb-9e21-e3ec333d823b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 17 01:49:17 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Updating inventory in ProviderTree for provider f431122b-abb2-4ecb-9e21-e3ec333d823b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 17 01:49:17 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71cf6b5b-9b82-4529-83d0-a655dca8e796 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:49:17 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7e6e789-7211-496d-8e97-869bdd12c50a]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:49:17 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-93baac0f-6e36-43b4-8251-55019eefed4a tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:49:17 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71cf6b5b-9b82-4529-83d0-a655dca8e796 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lxyPOegq {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:49:17 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Refreshing aggregate associations for resource provider f431122b-abb2-4ecb-9e21-e3ec333d823b, aggregates: None {{(pid=75226) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 17 01:49:17 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71cf6b5b-9b82-4529-83d0-a655dca8e796 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lxyPOegq" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:49:17 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfa2a0ee-a417-4c88-894d-e991d75d2eb3]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:49:17 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-93baac0f-6e36-43b4-8251-55019eefed4a tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lxyPOegq'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:49:17 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71cf6b5b-9b82-4529-83d0-a655dca8e796 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:49:17 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Refreshing trait associations for resource provider f431122b-abb2-4ecb-9e21-e3ec333d823b, traits: COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE42,HW_CPU_X86_SSE,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSSE3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_SATA {{(pid=75226) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 17 01:49:17 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71cf6b5b-9b82-4529-83d0-a655dca8e796 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:49:17 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[d771636a-9a37-4480-9944-4337ba60e786]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:49:17 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-93baac0f-6e36-43b4-8251-55019eefed4a tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:49:17 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:49:17 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:49:17 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2dcddac-6125-42ea-8137-feabb975d5de]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea51d240-abac-484a-8d78-49c9f9990337 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:49:17 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-93baac0f-6e36-43b4-8251-55019eefed4a tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea51d240-abac-484a-8d78-49c9f9990337 (non-flash)
Nov 17 01:49:17 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:49:17 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-93baac0f-6e36-43b4-8251-55019eefed4a tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea51d240-abac-484a-8d78-49c9f9990337 (non-flash)
Nov 17 01:49:17 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:49:17 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71cf6b5b-9b82-4529-83d0-a655dca8e796 -p 172.16.0.220:3260 --login {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:49:17 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71cf6b5b-9b82-4529-83d0-a655dca8e796 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:49:17 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b231ab4-861f-4932-a615-138123ab48a9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:71cf6b5b-9b82-4529-83d0-a655dca8e796, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:71cf6b5b-9b82-4529-83d0-a655dca8e796, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:49:17 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-93baac0f-6e36-43b4-8251-55019eefed4a tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:71cf6b5b-9b82-4529-83d0-a655dca8e796, portal: 172.16.0.220,3260]
Nov 17 01:49:17 user nova-compute[75226]: Login to [iface: default, target: iqn.2010-10.org.openstack:71cf6b5b-9b82-4529-83d0-a655dca8e796, portal: 172.16.0.220,3260] successful.
Nov 17 01:49:17 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:49:17 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71cf6b5b-9b82-4529-83d0-a655dca8e796 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:49:17 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:49:17 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71cf6b5b-9b82-4529-83d0-a655dca8e796 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:49:17 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4e5038d-44a6-472b-b4a6-12805b5ff162]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:49:17 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-93baac0f-6e36-43b4-8251-55019eefed4a tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:49:17 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:49:17 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:49:17 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:49:17 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[4938a670-40b8-4b01-8922-8bbe8d33d72a]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea51d240-abac-484a-8d78-49c9f9990337 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71cf6b5b-9b82-4529-83d0-a655dca8e796 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:49:17 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-93baac0f-6e36-43b4-8251-55019eefed4a tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea51d240-abac-484a-8d78-49c9f9990337 (non-flash)
Nov 17 01:49:17 user nova-compute[75226]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71cf6b5b-9b82-4529-83d0-a655dca8e796 (non-flash)
Nov 17 01:49:17 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:49:17 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-93baac0f-6e36-43b4-8251-55019eefed4a tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea51d240-abac-484a-8d78-49c9f9990337 (non-flash)
Nov 17 01:49:17 user nova-compute[75226]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71cf6b5b-9b82-4529-83d0-a655dca8e796 (non-flash)
Nov 17 01:49:17 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:49:17 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-93baac0f-6e36-43b4-8251-55019eefed4a tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:71cf6b5b-9b82-4529-83d0-a655dca8e796" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.298s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:49:17 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-93baac0f-6e36-43b4-8251-55019eefed4a tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Connected to 172.16.0.220:3260 {{(pid=75226) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 17 01:49:17 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-93baac0f-6e36-43b4-8251-55019eefed4a tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] HCTL ('33', '-', '-', 0) found on session 57 with lun 0 {{(pid=75226) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 17 01:49:17 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-93baac0f-6e36-43b4-8251-55019eefed4a tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75226) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 17 01:49:17 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:49:17 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Compute_service record updated for user:user {{(pid=75226) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 17 01:49:17 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.421s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:49:17 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:49:17 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0492875-7791-41e8-8079-c3ff0fdb2735]: (4, ('- - 0', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:49:17 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-93baac0f-6e36-43b4-8251-55019eefed4a tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Searching for a device in session 57 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75226) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 01:49:17 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-93baac0f-6e36-43b4-8251-55019eefed4a tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:71cf6b5b-9b82-4529-83d0-a655dca8e796', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lxyPOegq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75226) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 17 01:49:18 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-93baac0f-6e36-43b4-8251-55019eefed4a tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.335s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:49:18 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-93baac0f-6e36-43b4-8251-55019eefed4a tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] <== connect_volume: return (1336ms) {'type': 'block', 'scsi_wwn': '23534636239643932', 'path': '/dev/sdb'} {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:49:18 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-93baac0f-6e36-43b4-8251-55019eefed4a tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] [instance: 014533a1-a4c3-4c65-a121-f46486cc5998] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23534636239643932', 'path': '/dev/sdb'} {{(pid=75226) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 17 01:49:18 user nova-compute[75226]: DEBUG nova.objects.instance [None req-93baac0f-6e36-43b4-8251-55019eefed4a tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Lazy-loading 'flavor' on Instance uuid 014533a1-a4c3-4c65-a121-f46486cc5998 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:49:18 user nova-compute[75226]: DEBUG nova.virt.libvirt.guest [None req-93baac0f-6e36-43b4-8251-55019eefed4a tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] attach device xml: <disk type="block" device="disk">
Nov 17 01:49:18 user nova-compute[75226]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 01:49:18 user nova-compute[75226]:   <source dev="/dev/sdb"/>
Nov 17 01:49:18 user nova-compute[75226]:   <target dev="vdb" bus="virtio"/>
Nov 17 01:49:18 user nova-compute[75226]:   <serial>71cf6b5b-9b82-4529-83d0-a655dca8e796</serial>
Nov 17 01:49:18 user nova-compute[75226]: </disk>
Nov 17 01:49:18 user nova-compute[75226]:  {{(pid=75226) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 17 01:49:19 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-93baac0f-6e36-43b4-8251-55019eefed4a tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] No BDM found with device name vda, not building metadata. {{(pid=75226) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 01:49:19 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-93baac0f-6e36-43b4-8251-55019eefed4a tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75226) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 01:49:19 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-93baac0f-6e36-43b4-8251-55019eefed4a tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] No VIF found with MAC fa:16:3e:35:6c:13, not building metadata {{(pid=75226) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 01:49:19 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-93baac0f-6e36-43b4-8251-55019eefed4a tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Lock "014533a1-a4c3-4c65-a121-f46486cc5998" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.571s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:49:21 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-2b9e5849-dcbf-4cc2-b633-ef2f599314fa tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Acquiring lock "014533a1-a4c3-4c65-a121-f46486cc5998" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:49:21 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-2b9e5849-dcbf-4cc2-b633-ef2f599314fa tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Lock "014533a1-a4c3-4c65-a121-f46486cc5998" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:49:21 user nova-compute[75226]: INFO nova.compute.manager [None req-2b9e5849-dcbf-4cc2-b633-ef2f599314fa tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] [instance: 014533a1-a4c3-4c65-a121-f46486cc5998] Detaching volume 71cf6b5b-9b82-4529-83d0-a655dca8e796
Nov 17 01:49:22 user nova-compute[75226]: INFO nova.virt.block_device [None req-2b9e5849-dcbf-4cc2-b633-ef2f599314fa tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] [instance: 014533a1-a4c3-4c65-a121-f46486cc5998] Attempting to driver detach volume 71cf6b5b-9b82-4529-83d0-a655dca8e796 from mountpoint /dev/vdb
Nov 17 01:49:22 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-2b9e5849-dcbf-4cc2-b633-ef2f599314fa tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Attempting to detach device vdb from instance 014533a1-a4c3-4c65-a121-f46486cc5998 from the persistent domain config. {{(pid=75226) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 17 01:49:22 user nova-compute[75226]: DEBUG nova.virt.libvirt.guest [None req-2b9e5849-dcbf-4cc2-b633-ef2f599314fa tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] detach device xml: <disk type="block" device="disk">
Nov 17 01:49:22 user nova-compute[75226]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 01:49:22 user nova-compute[75226]:   <source dev="/dev/sdb"/>
Nov 17 01:49:22 user nova-compute[75226]:   <target dev="vdb" bus="virtio"/>
Nov 17 01:49:22 user nova-compute[75226]:   <serial>71cf6b5b-9b82-4529-83d0-a655dca8e796</serial>
Nov 17 01:49:22 user nova-compute[75226]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 17 01:49:22 user nova-compute[75226]: </disk>
Nov 17 01:49:22 user nova-compute[75226]:  {{(pid=75226) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 17 01:49:22 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-2b9e5849-dcbf-4cc2-b633-ef2f599314fa tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Successfully detached device vdb from instance 014533a1-a4c3-4c65-a121-f46486cc5998 from the persistent domain config.
Nov 17 01:49:22 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-2b9e5849-dcbf-4cc2-b633-ef2f599314fa tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 014533a1-a4c3-4c65-a121-f46486cc5998 from the live domain config. {{(pid=75226) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 17 01:49:22 user nova-compute[75226]: DEBUG nova.virt.libvirt.guest [None req-2b9e5849-dcbf-4cc2-b633-ef2f599314fa tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] detach device xml: <disk type="block" device="disk">
Nov 17 01:49:22 user nova-compute[75226]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 01:49:22 user nova-compute[75226]:   <source dev="/dev/sdb"/>
Nov 17 01:49:22 user nova-compute[75226]:   <target dev="vdb" bus="virtio"/>
Nov 17 01:49:22 user nova-compute[75226]:   <serial>71cf6b5b-9b82-4529-83d0-a655dca8e796</serial>
Nov 17 01:49:22 user nova-compute[75226]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 17 01:49:22 user nova-compute[75226]: </disk>
Nov 17 01:49:22 user nova-compute[75226]:  {{(pid=75226) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 17 01:49:22 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:49:22 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-2b9e5849-dcbf-4cc2-b633-ef2f599314fa tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 014533a1-a4c3-4c65-a121-f46486cc5998 {{(pid=75226) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 17 01:49:23 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:49:24 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:49:24 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:49:24 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:49:27 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:49:28 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:49:29 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:49:29 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Starting heal instance info cache {{(pid=75226) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 17 01:49:30 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "refresh_cache-014533a1-a4c3-4c65-a121-f46486cc5998" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:49:30 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquired lock "refresh_cache-014533a1-a4c3-4c65-a121-f46486cc5998" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:49:30 user nova-compute[75226]: DEBUG nova.network.neutron [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] [instance: 014533a1-a4c3-4c65-a121-f46486cc5998] Forcefully refreshing network info cache for instance {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 17 01:49:30 user nova-compute[75226]: DEBUG nova.network.neutron [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] [instance: 014533a1-a4c3-4c65-a121-f46486cc5998] Updating instance_info_cache with network_info: [{"id": "151e4c1a-3552-45f8-a49d-049e1c629c5b", "address": "fa:16:3e:35:6c:13", "network": {"id": "a1d04537-c0d6-46a4-bce4-de3bb5e89921", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-813941300-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c0b07ca915e4960b1e1998855e23e5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap151e4c1a-35", "ovs_interfaceid": "151e4c1a-3552-45f8-a49d-049e1c629c5b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:49:30 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Releasing lock "refresh_cache-014533a1-a4c3-4c65-a121-f46486cc5998" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:49:30 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] [instance: 014533a1-a4c3-4c65-a121-f46486cc5998] Updated the network info_cache for instance {{(pid=75226) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 17 01:49:30 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:49:30 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:49:30 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75226) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 17 01:49:31 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:49:32 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:49:33 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:49:33 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:49:37 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:49:37 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:49:38 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:49:42 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:49:42 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-2b9e5849-dcbf-4cc2-b633-ef2f599314fa tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 014533a1-a4c3-4c65-a121-f46486cc5998 is timed out.
Nov 17 01:49:42 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-2b9e5849-dcbf-4cc2-b633-ef2f599314fa tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Successfully detached device vdb from instance 014533a1-a4c3-4c65-a121-f46486cc5998 from the live domain config.
Nov 17 01:49:42 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b9e5849-dcbf-4cc2-b633-ef2f599314fa tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] [instance: 014533a1-a4c3-4c65-a121-f46486cc5998] calling os-brick to detach iSCSI Volume {{(pid=75226) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 17 01:49:42 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b9e5849-dcbf-4cc2-b633-ef2f599314fa tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc4cc36b490>, {'target_iqn': 'iqn.2010-10.org.openstack:71cf6b5b-9b82-4529-83d0-a655dca8e796', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lxyPOegq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:49:42 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-2b9e5849-dcbf-4cc2-b633-ef2f599314fa tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:49:42 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-2b9e5849-dcbf-4cc2-b633-ef2f599314fa tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:49:42 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-2b9e5849-dcbf-4cc2-b633-ef2f599314fa tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:49:42 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:49:42 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:49:42 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7a722a4-3c56-4054-8dfa-693fd22ac966]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:71cf6b5b-9b82-4529-83d0-a655dca8e796\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ea51d240-abac-484a-8d78-49c9f9990337\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:49:42 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b9e5849-dcbf-4cc2-b633-ef2f599314fa tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 17 01:49:42 user nova-compute[75226]: No targets found.
Nov 17 01:49:42 user nova-compute[75226]: iSNS:
Nov 17 01:49:42 user nova-compute[75226]: No targets found.
Nov 17 01:49:42 user nova-compute[75226]: STATIC:
Nov 17 01:49:42 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:71cf6b5b-9b82-4529-83d0-a655dca8e796
Nov 17 01:49:42 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:49:42 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:49:42 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:ea51d240-abac-484a-8d78-49c9f9990337
Nov 17 01:49:42 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:49:42 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:49:42 user nova-compute[75226]: FIRMWARE:
Nov 17 01:49:42 user nova-compute[75226]: No targets found.
Nov 17 01:49:42 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:49:42 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b9e5849-dcbf-4cc2-b633-ef2f599314fa tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 17 01:49:42 user nova-compute[75226]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 17 01:49:42 user nova-compute[75226]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75226) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 17 01:49:42 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b9e5849-dcbf-4cc2-b633-ef2f599314fa tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:71cf6b5b-9b82-4529-83d0-a655dca8e796', 0)] {{(pid=75226) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 17 01:49:42 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:49:42 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:49:42 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffd96f41-c2bd-4c9e-a808-f80b34cae5e3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:71cf6b5b-9b82-4529-83d0-a655dca8e796\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ea51d240-abac-484a-8d78-49c9f9990337\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:49:42 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:49:42 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:49:42 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[c135c11d-2e05-4f72-b3f4-fffdc3eb8444]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea51d240-abac-484a-8d78-49c9f9990337 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71cf6b5b-9b82-4529-83d0-a655dca8e796 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:49:42 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b9e5849-dcbf-4cc2-b633-ef2f599314fa tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea51d240-abac-484a-8d78-49c9f9990337 (non-flash)
Nov 17 01:49:42 user nova-compute[75226]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71cf6b5b-9b82-4529-83d0-a655dca8e796 (non-flash)
Nov 17 01:49:42 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:49:42 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b9e5849-dcbf-4cc2-b633-ef2f599314fa tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea51d240-abac-484a-8d78-49c9f9990337 (non-flash)
Nov 17 01:49:42 user nova-compute[75226]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71cf6b5b-9b82-4529-83d0-a655dca8e796 (non-flash)
Nov 17 01:49:42 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:49:42 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b9e5849-dcbf-4cc2-b633-ef2f599314fa tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc4d41f4820>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:71cf6b5b-9b82-4529-83d0-a655dca8e796'): ({'sdb'}, set())}) {{(pid=75226) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 17 01:49:42 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-2b9e5849-dcbf-4cc2-b633-ef2f599314fa tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Removing single pathed devices sdb {{(pid=75226) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 17 01:49:42 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:49:42 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:49:42 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4b3da90-9b5c-4ef9-b77d-0ca3fa1d34af]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:49:42 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:49:42 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:49:42 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[24552b17-12fe-46dd-930b-6f987fd34c03]: (4, ('ok\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:49:42 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-2b9e5849-dcbf-4cc2-b633-ef2f599314fa tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Flushing IO for device /dev/sdb {{(pid=75226) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 17 01:49:42 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:49:42 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:49:42 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[616caa82-ca41-4b98-a120-21600c89eda6]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:49:42 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-2b9e5849-dcbf-4cc2-b633-ef2f599314fa tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75226) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 17 01:49:42 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:49:42 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.035s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:49:42 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[a36aff42-4747-4039-86b6-330d8f7059a1]: (4, ('1', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:49:42 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-2b9e5849-dcbf-4cc2-b633-ef2f599314fa tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75226) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 17 01:49:42 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-2b9e5849-dcbf-4cc2-b633-ef2f599314fa tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] SCSI volumes sdb have been removed. {{(pid=75226) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 17 01:49:42 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b9e5849-dcbf-4cc2-b633-ef2f599314fa tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:71cf6b5b-9b82-4529-83d0-a655dca8e796')] {{(pid=75226) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 17 01:49:42 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71cf6b5b-9b82-4529-83d0-a655dca8e796 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:49:42 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71cf6b5b-9b82-4529-83d0-a655dca8e796 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:49:42 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef30f60e-ae49-44a2-abfd-aa9451297f56]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:49:42 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b9e5849-dcbf-4cc2-b633-ef2f599314fa tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:49:42 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71cf6b5b-9b82-4529-83d0-a655dca8e796 -p 172.16.0.220:3260 --logout {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:49:42 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71cf6b5b-9b82-4529-83d0-a655dca8e796 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:49:42 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[9efa6fc2-7b6a-47b2-a553-b600d60ababe]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:71cf6b5b-9b82-4529-83d0-a655dca8e796, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:71cf6b5b-9b82-4529-83d0-a655dca8e796, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:49:42 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b9e5849-dcbf-4cc2-b633-ef2f599314fa tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:71cf6b5b-9b82-4529-83d0-a655dca8e796, portal: 172.16.0.220,3260]
Nov 17 01:49:42 user nova-compute[75226]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:71cf6b5b-9b82-4529-83d0-a655dca8e796, portal: 172.16.0.220,3260] successful.
Nov 17 01:49:42 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:49:42 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71cf6b5b-9b82-4529-83d0-a655dca8e796 -p 172.16.0.220:3260 --op delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:49:42 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71cf6b5b-9b82-4529-83d0-a655dca8e796 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:49:42 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[32235ed4-5149-4c81-a617-3cc02fab27fd]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:49:42 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b9e5849-dcbf-4cc2-b633-ef2f599314fa tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:49:42 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-2b9e5849-dcbf-4cc2-b633-ef2f599314fa tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.286s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:49:42 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b9e5849-dcbf-4cc2-b633-ef2f599314fa tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] <== disconnect_volume: return (287ms) None {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:49:42 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b9e5849-dcbf-4cc2-b633-ef2f599314fa tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] [instance: 014533a1-a4c3-4c65-a121-f46486cc5998] Disconnected iSCSI Volume {{(pid=75226) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 17 01:49:43 user nova-compute[75226]: DEBUG nova.objects.instance [None req-2b9e5849-dcbf-4cc2-b633-ef2f599314fa tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Lazy-loading 'flavor' on Instance uuid 014533a1-a4c3-4c65-a121-f46486cc5998 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:49:43 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-2b9e5849-dcbf-4cc2-b633-ef2f599314fa tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Lock "014533a1-a4c3-4c65-a121-f46486cc5998" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.589s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:49:47 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:49:52 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:49:56 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-6173308c-cd2b-46c5-9fbf-a54852e15935 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Acquiring lock "d281f155-01b4-4141-8184-8c5111a7c663" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:49:56 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-6173308c-cd2b-46c5-9fbf-a54852e15935 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Lock "d281f155-01b4-4141-8184-8c5111a7c663" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:49:56 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-6173308c-cd2b-46c5-9fbf-a54852e15935 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Acquiring lock "d281f155-01b4-4141-8184-8c5111a7c663-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:49:56 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-6173308c-cd2b-46c5-9fbf-a54852e15935 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Lock "d281f155-01b4-4141-8184-8c5111a7c663-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:49:56 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-6173308c-cd2b-46c5-9fbf-a54852e15935 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Lock "d281f155-01b4-4141-8184-8c5111a7c663-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:49:56 user nova-compute[75226]: INFO nova.compute.manager [None req-6173308c-cd2b-46c5-9fbf-a54852e15935 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: d281f155-01b4-4141-8184-8c5111a7c663] Terminating instance
Nov 17 01:49:56 user nova-compute[75226]: DEBUG nova.compute.manager [None req-6173308c-cd2b-46c5-9fbf-a54852e15935 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: d281f155-01b4-4141-8184-8c5111a7c663] Start destroying the instance on the hypervisor. {{(pid=75226) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 17 01:49:56 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:49:56 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:49:56 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:49:56 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:49:57 user nova-compute[75226]: DEBUG nova.compute.manager [req-b9d379c1-3e66-4dcb-9c48-0b93f688ca4c req-e6d950b7-8331-4875-a7e0-c3bc8da770f2 service nova] [instance: d281f155-01b4-4141-8184-8c5111a7c663] Received event network-vif-unplugged-b18b7636-d18b-4cce-8bea-b9a293b75952 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:49:57 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-b9d379c1-3e66-4dcb-9c48-0b93f688ca4c req-e6d950b7-8331-4875-a7e0-c3bc8da770f2 service nova] Acquiring lock "d281f155-01b4-4141-8184-8c5111a7c663-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:49:57 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-b9d379c1-3e66-4dcb-9c48-0b93f688ca4c req-e6d950b7-8331-4875-a7e0-c3bc8da770f2 service nova] Lock "d281f155-01b4-4141-8184-8c5111a7c663-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:49:57 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-b9d379c1-3e66-4dcb-9c48-0b93f688ca4c req-e6d950b7-8331-4875-a7e0-c3bc8da770f2 service nova] Lock "d281f155-01b4-4141-8184-8c5111a7c663-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:49:57 user nova-compute[75226]: DEBUG nova.compute.manager [req-b9d379c1-3e66-4dcb-9c48-0b93f688ca4c req-e6d950b7-8331-4875-a7e0-c3bc8da770f2 service nova] [instance: d281f155-01b4-4141-8184-8c5111a7c663] No waiting events found dispatching network-vif-unplugged-b18b7636-d18b-4cce-8bea-b9a293b75952 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:49:57 user nova-compute[75226]: DEBUG nova.compute.manager [req-b9d379c1-3e66-4dcb-9c48-0b93f688ca4c req-e6d950b7-8331-4875-a7e0-c3bc8da770f2 service nova] [instance: d281f155-01b4-4141-8184-8c5111a7c663] Received event network-vif-unplugged-b18b7636-d18b-4cce-8bea-b9a293b75952 for instance with task_state deleting. {{(pid=75226) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 17 01:49:57 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:49:57 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:49:57 user nova-compute[75226]: INFO nova.virt.libvirt.driver [-] [instance: d281f155-01b4-4141-8184-8c5111a7c663] Instance destroyed successfully.
Nov 17 01:49:57 user nova-compute[75226]: DEBUG nova.objects.instance [None req-6173308c-cd2b-46c5-9fbf-a54852e15935 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Lazy-loading 'resources' on Instance uuid d281f155-01b4-4141-8184-8c5111a7c663 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:49:57 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-6173308c-cd2b-46c5-9fbf-a54852e15935 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:45:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-281766136',display_name='tempest-TestVolumeBootPattern-volume-backed-server-281766136',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-281766136',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCZ4QoRbRqRgi3ki4KS6jh5lRby+ElQLxgditWATt0MQK+oWM9Cf7VN32NSllMdJ7ek98OXOQWEnwtK1MmjgBtLf/JIHzLlckTHPs8AUGH9I1h07dF8vVmqqPYyiTcNc4w==',key_name='tempest-keypair-414477458',keypairs=<?>,launch_index=0,launched_at=2023-11-17T01:45:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='673620a69fba4a04af75baabe775dc8b',ramdisk_id='',reservation_id='r-zu2ben1p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-971654489',owner_user_name='tempest-TestVolumeBootPattern-971654489-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T01:45:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c8c8baa56884dcd9a90f0187c9fc06f',uuid=d281f155-01b4-4141-8184-8c5111a7c663,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b18b7636-d18b-4cce-8bea-b9a293b75952", "address": "fa:16:3e:51:76:4f", "network": {"id": "81bbbdad-218b-4fcd-b7f5-427fd49361cb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1151874504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "673620a69fba4a04af75baabe775dc8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb18b7636-d1", "ovs_interfaceid": "b18b7636-d18b-4cce-8bea-b9a293b75952", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 17 01:49:57 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-6173308c-cd2b-46c5-9fbf-a54852e15935 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Converting VIF {"id": "b18b7636-d18b-4cce-8bea-b9a293b75952", "address": "fa:16:3e:51:76:4f", "network": {"id": "81bbbdad-218b-4fcd-b7f5-427fd49361cb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1151874504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "673620a69fba4a04af75baabe775dc8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb18b7636-d1", "ovs_interfaceid": "b18b7636-d18b-4cce-8bea-b9a293b75952", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:49:57 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-6173308c-cd2b-46c5-9fbf-a54852e15935 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:51:76:4f,bridge_name='br-int',has_traffic_filtering=True,id=b18b7636-d18b-4cce-8bea-b9a293b75952,network=Network(81bbbdad-218b-4fcd-b7f5-427fd49361cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb18b7636-d1') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:49:57 user nova-compute[75226]: DEBUG os_vif [None req-6173308c-cd2b-46c5-9fbf-a54852e15935 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:51:76:4f,bridge_name='br-int',has_traffic_filtering=True,id=b18b7636-d18b-4cce-8bea-b9a293b75952,network=Network(81bbbdad-218b-4fcd-b7f5-427fd49361cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb18b7636-d1') {{(pid=75226) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 17 01:49:57 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:49:57 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb18b7636-d1, bridge=br-int, if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:49:57 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:49:57 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:49:57 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:49:57 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=de385537-f2b2-4180-aa0c-a1d7d8feeb1f) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:49:57 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:49:57 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:49:57 user nova-compute[75226]: INFO os_vif [None req-6173308c-cd2b-46c5-9fbf-a54852e15935 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:51:76:4f,bridge_name='br-int',has_traffic_filtering=True,id=b18b7636-d18b-4cce-8bea-b9a293b75952,network=Network(81bbbdad-218b-4fcd-b7f5-427fd49361cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb18b7636-d1')
Nov 17 01:49:57 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6173308c-cd2b-46c5-9fbf-a54852e15935 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: d281f155-01b4-4141-8184-8c5111a7c663] calling os-brick to detach iSCSI Volume {{(pid=75226) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 17 01:49:57 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-6173308c-cd2b-46c5-9fbf-a54852e15935 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc4cc36b490>, {'target_iqn': 'iqn.2010-10.org.openstack:ea51d240-abac-484a-8d78-49c9f9990337', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WzilAJDH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:49:57 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-6173308c-cd2b-46c5-9fbf-a54852e15935 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:49:57 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-6173308c-cd2b-46c5-9fbf-a54852e15935 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:49:57 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-6173308c-cd2b-46c5-9fbf-a54852e15935 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:49:57 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:49:57 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:49:57 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[144433aa-ade6-4fd0-91ca-18c4fb3a3bc2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ea51d240-abac-484a-8d78-49c9f9990337\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:49:57 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-6173308c-cd2b-46c5-9fbf-a54852e15935 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 17 01:49:57 user nova-compute[75226]: No targets found.
Nov 17 01:49:57 user nova-compute[75226]: iSNS:
Nov 17 01:49:57 user nova-compute[75226]: No targets found.
Nov 17 01:49:57 user nova-compute[75226]: STATIC:
Nov 17 01:49:57 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:ea51d240-abac-484a-8d78-49c9f9990337
Nov 17 01:49:57 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:49:57 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:49:57 user nova-compute[75226]: FIRMWARE:
Nov 17 01:49:57 user nova-compute[75226]: No targets found.
Nov 17 01:49:57 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:49:57 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-6173308c-cd2b-46c5-9fbf-a54852e15935 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 17 01:49:57 user nova-compute[75226]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 17 01:49:57 user nova-compute[75226]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75226) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 17 01:49:57 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-6173308c-cd2b-46c5-9fbf-a54852e15935 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ea51d240-abac-484a-8d78-49c9f9990337', 0)] {{(pid=75226) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 17 01:49:57 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:49:57 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:49:57 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[861c5d3c-95d8-4b48-9d6c-eba562ed6263]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ea51d240-abac-484a-8d78-49c9f9990337\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:49:57 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:49:57 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:49:57 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a778c2d-ef45-438f-befe-497e88f09b1d]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea51d240-abac-484a-8d78-49c9f9990337 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:49:57 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-6173308c-cd2b-46c5-9fbf-a54852e15935 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea51d240-abac-484a-8d78-49c9f9990337 (non-flash)
Nov 17 01:49:57 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:49:57 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-6173308c-cd2b-46c5-9fbf-a54852e15935 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea51d240-abac-484a-8d78-49c9f9990337 (non-flash)
Nov 17 01:49:57 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:49:57 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-6173308c-cd2b-46c5-9fbf-a54852e15935 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc4cc36cca0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ea51d240-abac-484a-8d78-49c9f9990337'): ({'sdc'}, set())}) {{(pid=75226) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 17 01:49:57 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-6173308c-cd2b-46c5-9fbf-a54852e15935 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Removing single pathed devices sdc {{(pid=75226) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 17 01:49:57 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:49:57 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:49:57 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7ee0906-d7d5-42e1-be24-dab027791668]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:49:57 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:49:57 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:49:57 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d73d24f-654c-450a-9866-93e99f8aefb4]: (4, ('ok\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:49:57 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-6173308c-cd2b-46c5-9fbf-a54852e15935 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Flushing IO for device /dev/sdc {{(pid=75226) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 17 01:49:57 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:49:57 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:49:57 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0a632c2-f0ca-4670-aa82-cb26ef6c4652]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:49:57 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-6173308c-cd2b-46c5-9fbf-a54852e15935 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75226) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 17 01:49:57 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:49:57 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.045s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:49:57 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f04408a-75d2-41ed-a0db-1ee0555d6b52]: (4, ('1', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:49:57 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-6173308c-cd2b-46c5-9fbf-a54852e15935 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75226) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 17 01:49:57 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-6173308c-cd2b-46c5-9fbf-a54852e15935 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] SCSI volumes sdc have been removed. {{(pid=75226) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 17 01:49:57 user nova-compute[75226]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_bd7c0bce', '/dev/disk/by-id/scsi-1SCST_BIObd7c0bce-2ea81346e0ccfd23', '/dev/disk/by-id/scsi-23265613831333436') {{(pid=85818) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 17 01:49:57 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[650b01c8-4d84-45d6-835f-5ac4c443aff3]: (4, None) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:49:57 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-6173308c-cd2b-46c5-9fbf-a54852e15935 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ea51d240-abac-484a-8d78-49c9f9990337')] {{(pid=75226) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 17 01:49:57 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea51d240-abac-484a-8d78-49c9f9990337 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:49:57 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea51d240-abac-484a-8d78-49c9f9990337 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:49:57 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb7656fc-7f9f-4763-977f-6e8e75483391]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:49:57 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-6173308c-cd2b-46c5-9fbf-a54852e15935 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:49:57 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea51d240-abac-484a-8d78-49c9f9990337 -p 172.16.0.220:3260 --logout {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:49:57 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea51d240-abac-484a-8d78-49c9f9990337 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:49:57 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[b76430c7-665f-457f-9127-e8b248377475]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:ea51d240-abac-484a-8d78-49c9f9990337, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:ea51d240-abac-484a-8d78-49c9f9990337, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:49:57 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-6173308c-cd2b-46c5-9fbf-a54852e15935 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:ea51d240-abac-484a-8d78-49c9f9990337, portal: 172.16.0.220,3260]
Nov 17 01:49:57 user nova-compute[75226]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:ea51d240-abac-484a-8d78-49c9f9990337, portal: 172.16.0.220,3260] successful.
Nov 17 01:49:57 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:49:57 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea51d240-abac-484a-8d78-49c9f9990337 -p 172.16.0.220:3260 --op delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:49:57 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea51d240-abac-484a-8d78-49c9f9990337 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.016s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:49:57 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b25913c-0ab5-46b1-b71d-f1dbd507a19f]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:49:57 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-6173308c-cd2b-46c5-9fbf-a54852e15935 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:49:57 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-6173308c-cd2b-46c5-9fbf-a54852e15935 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.278s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:49:57 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-6173308c-cd2b-46c5-9fbf-a54852e15935 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] <== disconnect_volume: return (279ms) None {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:49:57 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6173308c-cd2b-46c5-9fbf-a54852e15935 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: d281f155-01b4-4141-8184-8c5111a7c663] Disconnected iSCSI Volume {{(pid=75226) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 17 01:49:57 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-6173308c-cd2b-46c5-9fbf-a54852e15935 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: d281f155-01b4-4141-8184-8c5111a7c663] Deleting instance files /opt/stack/data/nova/instances/d281f155-01b4-4141-8184-8c5111a7c663_del
Nov 17 01:49:57 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-6173308c-cd2b-46c5-9fbf-a54852e15935 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: d281f155-01b4-4141-8184-8c5111a7c663] Deletion of /opt/stack/data/nova/instances/d281f155-01b4-4141-8184-8c5111a7c663_del complete
Nov 17 01:49:58 user nova-compute[75226]: INFO nova.compute.manager [None req-6173308c-cd2b-46c5-9fbf-a54852e15935 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: d281f155-01b4-4141-8184-8c5111a7c663] Took 1.19 seconds to destroy the instance on the hypervisor.
Nov 17 01:49:58 user nova-compute[75226]: DEBUG oslo.service.loopingcall [None req-6173308c-cd2b-46c5-9fbf-a54852e15935 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75226) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 17 01:49:58 user nova-compute[75226]: DEBUG nova.compute.manager [-] [instance: d281f155-01b4-4141-8184-8c5111a7c663] Deallocating network for instance {{(pid=75226) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 17 01:49:58 user nova-compute[75226]: DEBUG nova.network.neutron [-] [instance: d281f155-01b4-4141-8184-8c5111a7c663] deallocate_for_instance() {{(pid=75226) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 17 01:49:58 user nova-compute[75226]: DEBUG nova.network.neutron [-] [instance: d281f155-01b4-4141-8184-8c5111a7c663] Updating instance_info_cache with network_info: [] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:49:58 user nova-compute[75226]: INFO nova.compute.manager [-] [instance: d281f155-01b4-4141-8184-8c5111a7c663] Took 0.69 seconds to deallocate network for instance.
Nov 17 01:49:59 user nova-compute[75226]: DEBUG nova.compute.manager [req-04593a83-8ca2-4aac-84a5-400fbf9f5585 req-18942213-4ff1-49f6-835a-03f56f8f3de3 service nova] [instance: d281f155-01b4-4141-8184-8c5111a7c663] Received event network-vif-plugged-b18b7636-d18b-4cce-8bea-b9a293b75952 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:49:59 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-04593a83-8ca2-4aac-84a5-400fbf9f5585 req-18942213-4ff1-49f6-835a-03f56f8f3de3 service nova] Acquiring lock "d281f155-01b4-4141-8184-8c5111a7c663-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:49:59 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-04593a83-8ca2-4aac-84a5-400fbf9f5585 req-18942213-4ff1-49f6-835a-03f56f8f3de3 service nova] Lock "d281f155-01b4-4141-8184-8c5111a7c663-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:49:59 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-04593a83-8ca2-4aac-84a5-400fbf9f5585 req-18942213-4ff1-49f6-835a-03f56f8f3de3 service nova] Lock "d281f155-01b4-4141-8184-8c5111a7c663-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:49:59 user nova-compute[75226]: DEBUG nova.compute.manager [req-04593a83-8ca2-4aac-84a5-400fbf9f5585 req-18942213-4ff1-49f6-835a-03f56f8f3de3 service nova] [instance: d281f155-01b4-4141-8184-8c5111a7c663] No waiting events found dispatching network-vif-plugged-b18b7636-d18b-4cce-8bea-b9a293b75952 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:49:59 user nova-compute[75226]: WARNING nova.compute.manager [req-04593a83-8ca2-4aac-84a5-400fbf9f5585 req-18942213-4ff1-49f6-835a-03f56f8f3de3 service nova] [instance: d281f155-01b4-4141-8184-8c5111a7c663] Received unexpected event network-vif-plugged-b18b7636-d18b-4cce-8bea-b9a293b75952 for instance with vm_state active and task_state deleting.
Nov 17 01:49:59 user nova-compute[75226]: DEBUG nova.compute.manager [req-04593a83-8ca2-4aac-84a5-400fbf9f5585 req-18942213-4ff1-49f6-835a-03f56f8f3de3 service nova] [instance: d281f155-01b4-4141-8184-8c5111a7c663] Received event network-vif-deleted-b18b7636-d18b-4cce-8bea-b9a293b75952 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:49:59 user nova-compute[75226]: INFO nova.compute.manager [None req-6173308c-cd2b-46c5-9fbf-a54852e15935 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: d281f155-01b4-4141-8184-8c5111a7c663] Took 0.80 seconds to detach 1 volumes for instance.
Nov 17 01:49:59 user nova-compute[75226]: DEBUG nova.compute.manager [None req-6173308c-cd2b-46c5-9fbf-a54852e15935 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: d281f155-01b4-4141-8184-8c5111a7c663] Deleting volume: ea51d240-abac-484a-8d78-49c9f9990337 {{(pid=75226) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 17 01:49:59 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-6173308c-cd2b-46c5-9fbf-a54852e15935 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:49:59 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-6173308c-cd2b-46c5-9fbf-a54852e15935 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:49:59 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-6173308c-cd2b-46c5-9fbf-a54852e15935 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:49:59 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-6173308c-cd2b-46c5-9fbf-a54852e15935 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:49:59 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-6173308c-cd2b-46c5-9fbf-a54852e15935 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.231s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:49:59 user nova-compute[75226]: INFO nova.scheduler.client.report [None req-6173308c-cd2b-46c5-9fbf-a54852e15935 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Deleted allocations for instance d281f155-01b4-4141-8184-8c5111a7c663
Nov 17 01:49:59 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-6173308c-cd2b-46c5-9fbf-a54852e15935 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Lock "d281f155-01b4-4141-8184-8c5111a7c663" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.162s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:50:02 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:50:07 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:50:12 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:50:12 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:50:12 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75226) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 17 01:50:12 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75226) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 01:50:12 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75226) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 01:50:12 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:50:14 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-39668bc0-b6a7-4e55-8032-60392c18e0e5 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Acquiring lock "014533a1-a4c3-4c65-a121-f46486cc5998" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:50:14 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-39668bc0-b6a7-4e55-8032-60392c18e0e5 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Lock "014533a1-a4c3-4c65-a121-f46486cc5998" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:50:14 user nova-compute[75226]: DEBUG nova.objects.instance [None req-39668bc0-b6a7-4e55-8032-60392c18e0e5 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Lazy-loading 'flavor' on Instance uuid 014533a1-a4c3-4c65-a121-f46486cc5998 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:50:14 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-39668bc0-b6a7-4e55-8032-60392c18e0e5 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Lock "014533a1-a4c3-4c65-a121-f46486cc5998" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:50:14 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-39668bc0-b6a7-4e55-8032-60392c18e0e5 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Acquiring lock "014533a1-a4c3-4c65-a121-f46486cc5998" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:50:14 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-39668bc0-b6a7-4e55-8032-60392c18e0e5 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Lock "014533a1-a4c3-4c65-a121-f46486cc5998" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:50:14 user nova-compute[75226]: INFO nova.compute.manager [None req-39668bc0-b6a7-4e55-8032-60392c18e0e5 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] [instance: 014533a1-a4c3-4c65-a121-f46486cc5998] Attaching volume 2e09af57-b56b-4be8-aaad-ee6071a694f3 to /dev/vdb
Nov 17 01:50:14 user nova-compute[75226]: DEBUG os_brick.utils [None req-39668bc0-b6a7-4e55-8032-60392c18e0e5 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:50:14 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:50:14 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:50:14 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdddf840-9b82-4935-8b74-e0f51ac9fc0a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f62857db69\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:50:14 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:50:14 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:50:14 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[38932653-91e5-4227-97cd-fb7ee44d7116]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:50:14 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:50:14 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:50:14 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[edef4277-376c-46db-97f2-dd7c1049b6e0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:50:14 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[67997db5-8ed7-45aa-9688-f613d2129a4e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:50:14 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-39668bc0-b6a7-4e55-8032-60392c18e0e5 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Running cmd (subprocess): nvme version {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:50:14 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-39668bc0-b6a7-4e55-8032-60392c18e0e5 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] 'nvme version' failed. Not Retrying. {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 01:50:14 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.nvmeof [None req-39668bc0-b6a7-4e55-8032-60392c18e0e5 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] nvme not present on system {{(pid=75226) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 17 01:50:14 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:50:14 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 01:50:14 user nova-compute[75226]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 17 01:50:14 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[753aa7b5-47f8-4d55-97d8-15b7f9da6380]: (4, '') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:50:14 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-39668bc0-b6a7-4e55-8032-60392c18e0e5 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75226) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 17 01:50:14 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-39668bc0-b6a7-4e55-8032-60392c18e0e5 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75226) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 17 01:50:14 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-39668bc0-b6a7-4e55-8032-60392c18e0e5 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] LIGHTOS: no hostnqn found. {{(pid=75226) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 17 01:50:14 user nova-compute[75226]: DEBUG os_brick.utils [None req-39668bc0-b6a7-4e55-8032-60392c18e0e5 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f62857db69', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:50:14 user nova-compute[75226]: DEBUG nova.virt.block_device [None req-39668bc0-b6a7-4e55-8032-60392c18e0e5 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] [instance: 014533a1-a4c3-4c65-a121-f46486cc5998] Updating existing volume attachment record: fa750f97-c94b-4440-90ae-34839b8c4b6e {{(pid=75226) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 17 01:50:15 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:50:15 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:50:15 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:50:15 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:50:15 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75226) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 17 01:50:16 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/014533a1-a4c3-4c65-a121-f46486cc5998/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:50:16 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/014533a1-a4c3-4c65-a121-f46486cc5998/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:50:16 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/014533a1-a4c3-4c65-a121-f46486cc5998/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:50:16 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/014533a1-a4c3-4c65-a121-f46486cc5998/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:50:16 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bb19560-6149-4c39-8596-3c4c11c4247d/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:50:16 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bb19560-6149-4c39-8596-3c4c11c4247d/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:50:16 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bb19560-6149-4c39-8596-3c4c11c4247d/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:50:16 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bb19560-6149-4c39-8596-3c4c11c4247d/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:50:17 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:50:17 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:50:17 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Hypervisor/Node resource view: name=user free_ram=8825MB free_disk=24.925785064697266GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75226) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 17 01:50:17 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:50:17 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:50:17 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 014533a1-a4c3-4c65-a121-f46486cc5998 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:50:17 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 4bb19560-6149-4c39-8596-3c4c11c4247d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:50:17 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75226) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 17 01:50:17 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75226) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 17 01:50:17 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:50:17 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:50:17 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Compute_service record updated for user:user {{(pid=75226) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 17 01:50:17 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.251s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:50:17 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:50:18 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:50:19 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-39668bc0-b6a7-4e55-8032-60392c18e0e5 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] [instance: 014533a1-a4c3-4c65-a121-f46486cc5998] Calling os-brick to attach iSCSI Volume {{(pid=75226) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 17 01:50:19 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-39668bc0-b6a7-4e55-8032-60392c18e0e5 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc4cc36b490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2e09af57-b56b-4be8-aaad-ee6071a694f3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NXdhFupY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:50:19 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-39668bc0-b6a7-4e55-8032-60392c18e0e5 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:50:19 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-39668bc0-b6a7-4e55-8032-60392c18e0e5 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:50:19 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-39668bc0-b6a7-4e55-8032-60392c18e0e5 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:50:19 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-39668bc0-b6a7-4e55-8032-60392c18e0e5 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:50:19 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-39668bc0-b6a7-4e55-8032-60392c18e0e5 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2e09af57-b56b-4be8-aaad-ee6071a694f3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:50:19 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-39668bc0-b6a7-4e55-8032-60392c18e0e5 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2e09af57-b56b-4be8-aaad-ee6071a694f3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:50:19 user nova-compute[75226]: INFO os_brick.initiator.connectors.iscsi [None req-39668bc0-b6a7-4e55-8032-60392c18e0e5 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 17 01:50:19 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e09af57-b56b-4be8-aaad-ee6071a694f3 -p 172.16.0.220:3260 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:50:19 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e09af57-b56b-4be8-aaad-ee6071a694f3 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:50:19 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c6e6437-0ffc-4e4e-bede-687dda9bdf17]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:50:19 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-39668bc0-b6a7-4e55-8032-60392c18e0e5 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 17 01:50:19 user nova-compute[75226]:  {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:50:19 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e09af57-b56b-4be8-aaad-ee6071a694f3 -p 172.16.0.220:3260 --interface default --op new {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:50:19 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e09af57-b56b-4be8-aaad-ee6071a694f3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:50:19 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[689cbf60-cced-4511-a8ee-1c35ce2e6e06]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2e09af57-b56b-4be8-aaad-ee6071a694f3] added\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:50:19 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-39668bc0-b6a7-4e55-8032-60392c18e0e5 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2e09af57-b56b-4be8-aaad-ee6071a694f3] added
Nov 17 01:50:19 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:50:19 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e09af57-b56b-4be8-aaad-ee6071a694f3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:50:19 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e09af57-b56b-4be8-aaad-ee6071a694f3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:50:19 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d3c2307-dd69-4148-a77d-42c7c0b47f5f]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:50:19 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-39668bc0-b6a7-4e55-8032-60392c18e0e5 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:50:19 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e09af57-b56b-4be8-aaad-ee6071a694f3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:50:19 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e09af57-b56b-4be8-aaad-ee6071a694f3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:50:19 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ee84cd3-4da6-4aea-8d49-277550104c00]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:50:19 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-39668bc0-b6a7-4e55-8032-60392c18e0e5 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:50:19 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e09af57-b56b-4be8-aaad-ee6071a694f3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NXdhFupY {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:50:19 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e09af57-b56b-4be8-aaad-ee6071a694f3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NXdhFupY" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:50:19 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[77b1b45b-ef6a-4daa-9db6-f74da169143d]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:50:19 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-39668bc0-b6a7-4e55-8032-60392c18e0e5 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NXdhFupY'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:50:19 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e09af57-b56b-4be8-aaad-ee6071a694f3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:50:19 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e09af57-b56b-4be8-aaad-ee6071a694f3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:50:19 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[a08f4478-fb51-4340-ad88-615dafab4799]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:50:19 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-39668bc0-b6a7-4e55-8032-60392c18e0e5 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:50:19 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:50:19 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:50:19 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[87852377-c42e-4662-bd46-8093686b3c63]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:50:19 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-39668bc0-b6a7-4e55-8032-60392c18e0e5 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 17 01:50:19 user nova-compute[75226]:  {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:50:19 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-39668bc0-b6a7-4e55-8032-60392c18e0e5 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 17 01:50:19 user nova-compute[75226]:  {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:50:19 user nova-compute[75226]: WARNING os_brick.initiator.connectors.iscsi [None req-39668bc0-b6a7-4e55-8032-60392c18e0e5 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 17 01:50:19 user nova-compute[75226]: 
Nov 17 01:50:19 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e09af57-b56b-4be8-aaad-ee6071a694f3 -p 172.16.0.220:3260 --login {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:50:19 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e09af57-b56b-4be8-aaad-ee6071a694f3 -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:50:19 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[508eb556-0604-4fb2-bd91-73562e9a4b11]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2e09af57-b56b-4be8-aaad-ee6071a694f3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2e09af57-b56b-4be8-aaad-ee6071a694f3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:50:19 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-39668bc0-b6a7-4e55-8032-60392c18e0e5 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2e09af57-b56b-4be8-aaad-ee6071a694f3, portal: 172.16.0.220,3260]
Nov 17 01:50:19 user nova-compute[75226]: Login to [iface: default, target: iqn.2010-10.org.openstack:2e09af57-b56b-4be8-aaad-ee6071a694f3, portal: 172.16.0.220,3260] successful.
Nov 17 01:50:19 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:50:19 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e09af57-b56b-4be8-aaad-ee6071a694f3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:50:19 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e09af57-b56b-4be8-aaad-ee6071a694f3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:50:19 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f340574-7b17-4e45-bd23-7c456ade9779]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:50:19 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-39668bc0-b6a7-4e55-8032-60392c18e0e5 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:50:19 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:50:19 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:50:19 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7338941-171f-449b-8118-cc9f6ef8165e]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e09af57-b56b-4be8-aaad-ee6071a694f3 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:50:19 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-39668bc0-b6a7-4e55-8032-60392c18e0e5 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e09af57-b56b-4be8-aaad-ee6071a694f3 (non-flash)
Nov 17 01:50:19 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:50:19 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-39668bc0-b6a7-4e55-8032-60392c18e0e5 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e09af57-b56b-4be8-aaad-ee6071a694f3 (non-flash)
Nov 17 01:50:19 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:50:19 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-39668bc0-b6a7-4e55-8032-60392c18e0e5 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2e09af57-b56b-4be8-aaad-ee6071a694f3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.249s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:50:19 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-39668bc0-b6a7-4e55-8032-60392c18e0e5 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Connected to 172.16.0.220:3260 {{(pid=75226) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 17 01:50:19 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-39668bc0-b6a7-4e55-8032-60392c18e0e5 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] HCTL ('33', '-', '-', 0) found on session 58 with lun 0 {{(pid=75226) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 17 01:50:19 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-39668bc0-b6a7-4e55-8032-60392c18e0e5 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75226) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 17 01:50:19 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:50:19 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:50:19 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[cff17ce5-5a2e-4596-a881-21f4fce26e83]: (4, ('- - 0', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:50:19 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-39668bc0-b6a7-4e55-8032-60392c18e0e5 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: None {{(pid=75226) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 01:50:20 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-39668bc0-b6a7-4e55-8032-60392c18e0e5 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75226) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 01:50:20 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-39668bc0-b6a7-4e55-8032-60392c18e0e5 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:2e09af57-b56b-4be8-aaad-ee6071a694f3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NXdhFupY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75226) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 17 01:50:20 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-39668bc0-b6a7-4e55-8032-60392c18e0e5 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.278s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:50:20 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-39668bc0-b6a7-4e55-8032-60392c18e0e5 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] <== connect_volume: return (1280ms) {'type': 'block', 'scsi_wwn': '26538366333346332', 'path': '/dev/sdb'} {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:50:20 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-39668bc0-b6a7-4e55-8032-60392c18e0e5 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] [instance: 014533a1-a4c3-4c65-a121-f46486cc5998] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26538366333346332', 'path': '/dev/sdb'} {{(pid=75226) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 17 01:50:20 user nova-compute[75226]: DEBUG nova.objects.instance [None req-39668bc0-b6a7-4e55-8032-60392c18e0e5 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Lazy-loading 'flavor' on Instance uuid 014533a1-a4c3-4c65-a121-f46486cc5998 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:50:20 user nova-compute[75226]: DEBUG nova.virt.libvirt.guest [None req-39668bc0-b6a7-4e55-8032-60392c18e0e5 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] attach device xml: <disk type="block" device="disk">
Nov 17 01:50:20 user nova-compute[75226]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 01:50:20 user nova-compute[75226]:   <source dev="/dev/sdb"/>
Nov 17 01:50:20 user nova-compute[75226]:   <target dev="vdb" bus="virtio"/>
Nov 17 01:50:20 user nova-compute[75226]:   <serial>2e09af57-b56b-4be8-aaad-ee6071a694f3</serial>
Nov 17 01:50:20 user nova-compute[75226]: </disk>
Nov 17 01:50:20 user nova-compute[75226]:  {{(pid=75226) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 17 01:50:21 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-39668bc0-b6a7-4e55-8032-60392c18e0e5 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] No BDM found with device name vda, not building metadata. {{(pid=75226) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 01:50:21 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-39668bc0-b6a7-4e55-8032-60392c18e0e5 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75226) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 01:50:21 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-39668bc0-b6a7-4e55-8032-60392c18e0e5 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] No VIF found with MAC fa:16:3e:35:6c:13, not building metadata {{(pid=75226) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 01:50:21 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-39668bc0-b6a7-4e55-8032-60392c18e0e5 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Lock "014533a1-a4c3-4c65-a121-f46486cc5998" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.198s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:50:22 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:50:23 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-27b8af64-2b83-4a4d-84c4-973f24ffe655 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Acquiring lock "014533a1-a4c3-4c65-a121-f46486cc5998" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:50:23 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-27b8af64-2b83-4a4d-84c4-973f24ffe655 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Lock "014533a1-a4c3-4c65-a121-f46486cc5998" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:50:23 user nova-compute[75226]: INFO nova.compute.manager [None req-27b8af64-2b83-4a4d-84c4-973f24ffe655 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] [instance: 014533a1-a4c3-4c65-a121-f46486cc5998] Detaching volume 2e09af57-b56b-4be8-aaad-ee6071a694f3
Nov 17 01:50:23 user nova-compute[75226]: INFO nova.virt.block_device [None req-27b8af64-2b83-4a4d-84c4-973f24ffe655 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] [instance: 014533a1-a4c3-4c65-a121-f46486cc5998] Attempting to driver detach volume 2e09af57-b56b-4be8-aaad-ee6071a694f3 from mountpoint /dev/vdb
Nov 17 01:50:23 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-27b8af64-2b83-4a4d-84c4-973f24ffe655 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Attempting to detach device vdb from instance 014533a1-a4c3-4c65-a121-f46486cc5998 from the persistent domain config. {{(pid=75226) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 17 01:50:23 user nova-compute[75226]: DEBUG nova.virt.libvirt.guest [None req-27b8af64-2b83-4a4d-84c4-973f24ffe655 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] detach device xml: <disk type="block" device="disk">
Nov 17 01:50:23 user nova-compute[75226]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 01:50:23 user nova-compute[75226]:   <source dev="/dev/sdb"/>
Nov 17 01:50:23 user nova-compute[75226]:   <target dev="vdb" bus="virtio"/>
Nov 17 01:50:23 user nova-compute[75226]:   <serial>2e09af57-b56b-4be8-aaad-ee6071a694f3</serial>
Nov 17 01:50:23 user nova-compute[75226]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 17 01:50:23 user nova-compute[75226]: </disk>
Nov 17 01:50:23 user nova-compute[75226]:  {{(pid=75226) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 17 01:50:23 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-27b8af64-2b83-4a4d-84c4-973f24ffe655 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Successfully detached device vdb from instance 014533a1-a4c3-4c65-a121-f46486cc5998 from the persistent domain config.
Nov 17 01:50:23 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-27b8af64-2b83-4a4d-84c4-973f24ffe655 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 014533a1-a4c3-4c65-a121-f46486cc5998 from the live domain config. {{(pid=75226) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 17 01:50:23 user nova-compute[75226]: DEBUG nova.virt.libvirt.guest [None req-27b8af64-2b83-4a4d-84c4-973f24ffe655 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] detach device xml: <disk type="block" device="disk">
Nov 17 01:50:23 user nova-compute[75226]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 01:50:23 user nova-compute[75226]:   <source dev="/dev/sdb"/>
Nov 17 01:50:23 user nova-compute[75226]:   <target dev="vdb" bus="virtio"/>
Nov 17 01:50:23 user nova-compute[75226]:   <serial>2e09af57-b56b-4be8-aaad-ee6071a694f3</serial>
Nov 17 01:50:23 user nova-compute[75226]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 17 01:50:23 user nova-compute[75226]: </disk>
Nov 17 01:50:23 user nova-compute[75226]:  {{(pid=75226) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 17 01:50:23 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:50:23 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-27b8af64-2b83-4a4d-84c4-973f24ffe655 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 014533a1-a4c3-4c65-a121-f46486cc5998 {{(pid=75226) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 17 01:50:25 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:50:25 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:50:25 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:50:27 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:50:29 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:50:29 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75226) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 17 01:50:30 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:50:31 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:50:31 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Starting heal instance info cache {{(pid=75226) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 17 01:50:31 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Rebuilding the list of instances to heal {{(pid=75226) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 17 01:50:32 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "refresh_cache-014533a1-a4c3-4c65-a121-f46486cc5998" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:50:32 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquired lock "refresh_cache-014533a1-a4c3-4c65-a121-f46486cc5998" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:50:32 user nova-compute[75226]: DEBUG nova.network.neutron [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] [instance: 014533a1-a4c3-4c65-a121-f46486cc5998] Forcefully refreshing network info cache for instance {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 17 01:50:32 user nova-compute[75226]: DEBUG nova.objects.instance [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lazy-loading 'info_cache' on Instance uuid 014533a1-a4c3-4c65-a121-f46486cc5998 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:50:32 user nova-compute[75226]: DEBUG nova.network.neutron [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] [instance: 014533a1-a4c3-4c65-a121-f46486cc5998] Updating instance_info_cache with network_info: [{"id": "151e4c1a-3552-45f8-a49d-049e1c629c5b", "address": "fa:16:3e:35:6c:13", "network": {"id": "a1d04537-c0d6-46a4-bce4-de3bb5e89921", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-813941300-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c0b07ca915e4960b1e1998855e23e5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap151e4c1a-35", "ovs_interfaceid": "151e4c1a-3552-45f8-a49d-049e1c629c5b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:50:32 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Releasing lock "refresh_cache-014533a1-a4c3-4c65-a121-f46486cc5998" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:50:32 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] [instance: 014533a1-a4c3-4c65-a121-f46486cc5998] Updated the network info_cache for instance {{(pid=75226) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 17 01:50:32 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:50:33 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:50:33 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:50:37 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:50:42 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:50:43 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-27b8af64-2b83-4a4d-84c4-973f24ffe655 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 014533a1-a4c3-4c65-a121-f46486cc5998 is timed out.
Nov 17 01:50:43 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-27b8af64-2b83-4a4d-84c4-973f24ffe655 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Successfully detached device vdb from instance 014533a1-a4c3-4c65-a121-f46486cc5998 from the live domain config.
Nov 17 01:50:43 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27b8af64-2b83-4a4d-84c4-973f24ffe655 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] [instance: 014533a1-a4c3-4c65-a121-f46486cc5998] calling os-brick to detach iSCSI Volume {{(pid=75226) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 17 01:50:43 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-27b8af64-2b83-4a4d-84c4-973f24ffe655 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc4cc36b490>, {'target_iqn': 'iqn.2010-10.org.openstack:2e09af57-b56b-4be8-aaad-ee6071a694f3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NXdhFupY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:50:43 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-27b8af64-2b83-4a4d-84c4-973f24ffe655 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:50:43 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-27b8af64-2b83-4a4d-84c4-973f24ffe655 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:50:43 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-27b8af64-2b83-4a4d-84c4-973f24ffe655 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:50:43 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:50:43 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:50:43 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[28a74d90-5115-4a8f-9e73-075075aa77e8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2e09af57-b56b-4be8-aaad-ee6071a694f3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:50:43 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-27b8af64-2b83-4a4d-84c4-973f24ffe655 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 17 01:50:43 user nova-compute[75226]: No targets found.
Nov 17 01:50:43 user nova-compute[75226]: iSNS:
Nov 17 01:50:43 user nova-compute[75226]: No targets found.
Nov 17 01:50:43 user nova-compute[75226]: STATIC:
Nov 17 01:50:43 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:2e09af57-b56b-4be8-aaad-ee6071a694f3
Nov 17 01:50:43 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:50:43 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:50:43 user nova-compute[75226]: FIRMWARE:
Nov 17 01:50:43 user nova-compute[75226]: No targets found.
Nov 17 01:50:43 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:50:43 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-27b8af64-2b83-4a4d-84c4-973f24ffe655 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 17 01:50:43 user nova-compute[75226]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 17 01:50:43 user nova-compute[75226]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75226) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 17 01:50:43 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-27b8af64-2b83-4a4d-84c4-973f24ffe655 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2e09af57-b56b-4be8-aaad-ee6071a694f3', 0)] {{(pid=75226) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 17 01:50:43 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:50:43 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:50:43 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[62406733-8bf3-42d2-baac-423dc99cb542]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e09af57-b56b-4be8-aaad-ee6071a694f3\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:50:43 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:50:43 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:50:43 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[41fb3af1-9970-4fcb-9f0b-035148b96d89]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e09af57-b56b-4be8-aaad-ee6071a694f3 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:50:43 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-27b8af64-2b83-4a4d-84c4-973f24ffe655 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e09af57-b56b-4be8-aaad-ee6071a694f3 (non-flash)
Nov 17 01:50:43 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:50:43 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-27b8af64-2b83-4a4d-84c4-973f24ffe655 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e09af57-b56b-4be8-aaad-ee6071a694f3 (non-flash)
Nov 17 01:50:43 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:50:43 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-27b8af64-2b83-4a4d-84c4-973f24ffe655 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc4d4163d00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2e09af57-b56b-4be8-aaad-ee6071a694f3'): ({'sdb'}, set())}) {{(pid=75226) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 17 01:50:43 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-27b8af64-2b83-4a4d-84c4-973f24ffe655 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Removing single pathed devices sdb {{(pid=75226) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 17 01:50:43 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:50:43 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:50:43 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7bcb01e-7e2e-46ab-844f-308e46f2f8fa]: (4, ('path checker states:\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:50:43 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:50:43 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:50:43 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[4280e48f-935f-437c-a72e-60e6d80a4fd2]: (4, ('ok\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:50:43 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-27b8af64-2b83-4a4d-84c4-973f24ffe655 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Flushing IO for device /dev/sdb {{(pid=75226) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 17 01:50:43 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:50:43 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:50:43 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[490382cb-08b8-4dad-b1ca-91d3194f8e0f]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:50:43 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-27b8af64-2b83-4a4d-84c4-973f24ffe655 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75226) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 17 01:50:43 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:50:43 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:50:43 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[0da2b4be-53bb-4401-b7ac-c0079a730f1d]: (4, ('1', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:50:43 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-27b8af64-2b83-4a4d-84c4-973f24ffe655 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75226) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 17 01:50:43 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-27b8af64-2b83-4a4d-84c4-973f24ffe655 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] SCSI volumes sdb have been removed. {{(pid=75226) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 17 01:50:43 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-27b8af64-2b83-4a4d-84c4-973f24ffe655 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2e09af57-b56b-4be8-aaad-ee6071a694f3')] {{(pid=75226) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 17 01:50:43 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e09af57-b56b-4be8-aaad-ee6071a694f3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:50:43 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e09af57-b56b-4be8-aaad-ee6071a694f3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:50:43 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[337f3540-cead-4da0-a43d-45d8b7ae7a2b]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:50:43 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-27b8af64-2b83-4a4d-84c4-973f24ffe655 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:50:43 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e09af57-b56b-4be8-aaad-ee6071a694f3 -p 172.16.0.220:3260 --logout {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:50:43 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e09af57-b56b-4be8-aaad-ee6071a694f3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.043s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:50:43 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[2086e8c3-1127-41ff-ab56-7236c9204f24]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:2e09af57-b56b-4be8-aaad-ee6071a694f3, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:2e09af57-b56b-4be8-aaad-ee6071a694f3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:50:43 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-27b8af64-2b83-4a4d-84c4-973f24ffe655 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:2e09af57-b56b-4be8-aaad-ee6071a694f3, portal: 172.16.0.220,3260]
Nov 17 01:50:43 user nova-compute[75226]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:2e09af57-b56b-4be8-aaad-ee6071a694f3, portal: 172.16.0.220,3260] successful.
Nov 17 01:50:43 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:50:43 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e09af57-b56b-4be8-aaad-ee6071a694f3 -p 172.16.0.220:3260 --op delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:50:43 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e09af57-b56b-4be8-aaad-ee6071a694f3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:50:43 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[635b6dc5-c07c-41be-a7ed-a98365965fbc]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:50:43 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-27b8af64-2b83-4a4d-84c4-973f24ffe655 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:50:43 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-27b8af64-2b83-4a4d-84c4-973f24ffe655 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.262s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:50:43 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-27b8af64-2b83-4a4d-84c4-973f24ffe655 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] <== disconnect_volume: return (263ms) None {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:50:43 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27b8af64-2b83-4a4d-84c4-973f24ffe655 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] [instance: 014533a1-a4c3-4c65-a121-f46486cc5998] Disconnected iSCSI Volume {{(pid=75226) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 17 01:50:44 user nova-compute[75226]: DEBUG nova.objects.instance [None req-27b8af64-2b83-4a4d-84c4-973f24ffe655 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Lazy-loading 'flavor' on Instance uuid 014533a1-a4c3-4c65-a121-f46486cc5998 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:50:44 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-27b8af64-2b83-4a4d-84c4-973f24ffe655 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Lock "014533a1-a4c3-4c65-a121-f46486cc5998" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.540s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:50:47 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:50:47 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:50:52 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:50:55 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-aec5e1a2-504f-4d49-8d3e-a757fd5babab tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Acquiring lock "19ff5421-3e67-4ac7-8021-bc4a4528d992" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:50:55 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-aec5e1a2-504f-4d49-8d3e-a757fd5babab tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Lock "19ff5421-3e67-4ac7-8021-bc4a4528d992" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:50:55 user nova-compute[75226]: DEBUG nova.compute.manager [req-3532bf68-207e-46ac-812f-1831c5551c9f req-bf247ef2-1739-4330-9df4-daab59be8525 service nova] [instance: 4bb19560-6149-4c39-8596-3c4c11c4247d] Received event network-changed-8a3e1ef1-37aa-4d8f-9484-143213c68bf1 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:50:55 user nova-compute[75226]: DEBUG nova.compute.manager [req-3532bf68-207e-46ac-812f-1831c5551c9f req-bf247ef2-1739-4330-9df4-daab59be8525 service nova] [instance: 4bb19560-6149-4c39-8596-3c4c11c4247d] Refreshing instance network info cache due to event network-changed-8a3e1ef1-37aa-4d8f-9484-143213c68bf1. {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 01:50:55 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-3532bf68-207e-46ac-812f-1831c5551c9f req-bf247ef2-1739-4330-9df4-daab59be8525 service nova] Acquiring lock "refresh_cache-4bb19560-6149-4c39-8596-3c4c11c4247d" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:50:55 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-3532bf68-207e-46ac-812f-1831c5551c9f req-bf247ef2-1739-4330-9df4-daab59be8525 service nova] Acquired lock "refresh_cache-4bb19560-6149-4c39-8596-3c4c11c4247d" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:50:55 user nova-compute[75226]: DEBUG nova.network.neutron [req-3532bf68-207e-46ac-812f-1831c5551c9f req-bf247ef2-1739-4330-9df4-daab59be8525 service nova] [instance: 4bb19560-6149-4c39-8596-3c4c11c4247d] Refreshing network info cache for port 8a3e1ef1-37aa-4d8f-9484-143213c68bf1 {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 01:50:55 user nova-compute[75226]: DEBUG nova.compute.manager [None req-aec5e1a2-504f-4d49-8d3e-a757fd5babab tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: 19ff5421-3e67-4ac7-8021-bc4a4528d992] Starting instance... {{(pid=75226) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 17 01:50:55 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-aec5e1a2-504f-4d49-8d3e-a757fd5babab tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:50:55 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-aec5e1a2-504f-4d49-8d3e-a757fd5babab tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:50:55 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-aec5e1a2-504f-4d49-8d3e-a757fd5babab tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75226) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 17 01:50:55 user nova-compute[75226]: INFO nova.compute.claims [None req-aec5e1a2-504f-4d49-8d3e-a757fd5babab tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: 19ff5421-3e67-4ac7-8021-bc4a4528d992] Claim successful on node user
Nov 17 01:50:55 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-cf36ff4b-4167-4baa-996e-e11472cbdddf tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Acquiring lock "4bb19560-6149-4c39-8596-3c4c11c4247d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:50:55 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-cf36ff4b-4167-4baa-996e-e11472cbdddf tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Lock "4bb19560-6149-4c39-8596-3c4c11c4247d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:50:55 user nova-compute[75226]: DEBUG nova.objects.instance [None req-cf36ff4b-4167-4baa-996e-e11472cbdddf tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Lazy-loading 'flavor' on Instance uuid 4bb19560-6149-4c39-8596-3c4c11c4247d {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:50:55 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-cf36ff4b-4167-4baa-996e-e11472cbdddf tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] [instance: 4bb19560-6149-4c39-8596-3c4c11c4247d] Ignoring supplied device name: /dev/vdb
Nov 17 01:50:55 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-cf36ff4b-4167-4baa-996e-e11472cbdddf tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Lock "4bb19560-6149-4c39-8596-3c4c11c4247d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.075s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:50:55 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-cf36ff4b-4167-4baa-996e-e11472cbdddf tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Acquiring lock "4bb19560-6149-4c39-8596-3c4c11c4247d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:50:55 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-cf36ff4b-4167-4baa-996e-e11472cbdddf tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Lock "4bb19560-6149-4c39-8596-3c4c11c4247d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:50:55 user nova-compute[75226]: INFO nova.compute.manager [None req-cf36ff4b-4167-4baa-996e-e11472cbdddf tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] [instance: 4bb19560-6149-4c39-8596-3c4c11c4247d] Attaching volume e4a54f08-130d-4550-bc7e-62a965ae4c3f to /dev/vdb
Nov 17 01:50:56 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-aec5e1a2-504f-4d49-8d3e-a757fd5babab tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:50:56 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-aec5e1a2-504f-4d49-8d3e-a757fd5babab tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:50:56 user nova-compute[75226]: DEBUG os_brick.utils [None req-cf36ff4b-4167-4baa-996e-e11472cbdddf tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:50:56 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:50:56 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:50:56 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac5389ee-27e3-4a86-b93d-432b3b0819e6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f62857db69\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:50:56 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:50:56 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-aec5e1a2-504f-4d49-8d3e-a757fd5babab tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.335s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:50:56 user nova-compute[75226]: DEBUG nova.compute.manager [None req-aec5e1a2-504f-4d49-8d3e-a757fd5babab tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: 19ff5421-3e67-4ac7-8021-bc4a4528d992] Start building networks asynchronously for instance. {{(pid=75226) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 17 01:50:56 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:50:56 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[d191c331-a452-4813-86c9-aa1b35c9a2ac]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:50:56 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:50:56 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:50:56 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[54a583e2-3db5-4de7-9af9-d31768b40122]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:50:56 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[b00b4115-8ad1-492a-96a7-ef4f4de13279]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:50:56 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-cf36ff4b-4167-4baa-996e-e11472cbdddf tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Running cmd (subprocess): nvme version {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:50:56 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-cf36ff4b-4167-4baa-996e-e11472cbdddf tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] 'nvme version' failed. Not Retrying. {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 01:50:56 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cf36ff4b-4167-4baa-996e-e11472cbdddf tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] nvme not present on system {{(pid=75226) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 17 01:50:56 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:50:56 user nova-compute[75226]: DEBUG nova.compute.manager [None req-aec5e1a2-504f-4d49-8d3e-a757fd5babab tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: 19ff5421-3e67-4ac7-8021-bc4a4528d992] Allocating IP information in the background. {{(pid=75226) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 17 01:50:56 user nova-compute[75226]: DEBUG nova.network.neutron [None req-aec5e1a2-504f-4d49-8d3e-a757fd5babab tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: 19ff5421-3e67-4ac7-8021-bc4a4528d992] allocate_for_instance() {{(pid=75226) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 17 01:50:56 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 01:50:56 user nova-compute[75226]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 17 01:50:56 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebebedd1-010d-4eb4-8e61-7d85137d424b]: (4, '') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:50:56 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-cf36ff4b-4167-4baa-996e-e11472cbdddf tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75226) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 17 01:50:56 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-cf36ff4b-4167-4baa-996e-e11472cbdddf tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75226) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 17 01:50:56 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-cf36ff4b-4167-4baa-996e-e11472cbdddf tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] LIGHTOS: no hostnqn found. {{(pid=75226) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 17 01:50:56 user nova-compute[75226]: DEBUG os_brick.utils [None req-cf36ff4b-4167-4baa-996e-e11472cbdddf tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f62857db69', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:50:56 user nova-compute[75226]: DEBUG nova.virt.block_device [None req-cf36ff4b-4167-4baa-996e-e11472cbdddf tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] [instance: 4bb19560-6149-4c39-8596-3c4c11c4247d] Updating existing volume attachment record: 189187da-27ea-4a2d-8dca-b05371d8363f {{(pid=75226) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 17 01:50:56 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-aec5e1a2-504f-4d49-8d3e-a757fd5babab tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: 19ff5421-3e67-4ac7-8021-bc4a4528d992] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 17 01:50:56 user nova-compute[75226]: DEBUG nova.compute.manager [None req-aec5e1a2-504f-4d49-8d3e-a757fd5babab tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: 19ff5421-3e67-4ac7-8021-bc4a4528d992] Start building block device mappings for instance. {{(pid=75226) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 17 01:50:56 user nova-compute[75226]: INFO nova.virt.block_device [None req-aec5e1a2-504f-4d49-8d3e-a757fd5babab tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: 19ff5421-3e67-4ac7-8021-bc4a4528d992] Booting with volume 875a05e9-5133-418e-a210-0b01076d92a8 at /dev/vda
Nov 17 01:50:56 user nova-compute[75226]: DEBUG nova.policy [None req-aec5e1a2-504f-4d49-8d3e-a757fd5babab tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7c8c8baa56884dcd9a90f0187c9fc06f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673620a69fba4a04af75baabe775dc8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75226) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 17 01:50:56 user nova-compute[75226]: DEBUG os_brick.utils [None req-aec5e1a2-504f-4d49-8d3e-a757fd5babab tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:50:56 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:50:56 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:50:56 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6ef9a04-f81a-40d0-9c98-b04597d917d6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f62857db69\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:50:56 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:50:56 user nova-compute[75226]: DEBUG nova.network.neutron [req-3532bf68-207e-46ac-812f-1831c5551c9f req-bf247ef2-1739-4330-9df4-daab59be8525 service nova] [instance: 4bb19560-6149-4c39-8596-3c4c11c4247d] Updated VIF entry in instance network info cache for port 8a3e1ef1-37aa-4d8f-9484-143213c68bf1. {{(pid=75226) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 01:50:56 user nova-compute[75226]: DEBUG nova.network.neutron [req-3532bf68-207e-46ac-812f-1831c5551c9f req-bf247ef2-1739-4330-9df4-daab59be8525 service nova] [instance: 4bb19560-6149-4c39-8596-3c4c11c4247d] Updating instance_info_cache with network_info: [{"id": "8a3e1ef1-37aa-4d8f-9484-143213c68bf1", "address": "fa:16:3e:16:03:37", "network": {"id": "2d06b621-84a6-48dc-be05-92b6724810e3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1055056582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "acc65d32b52442aea872bf9f6025c4e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a3e1ef1-37", "ovs_interfaceid": "8a3e1ef1-37aa-4d8f-9484-143213c68bf1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:50:56 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:50:56 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[88d8593c-5bb1-4334-aff9-36e8e02ee525]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:50:56 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:50:56 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-3532bf68-207e-46ac-812f-1831c5551c9f req-bf247ef2-1739-4330-9df4-daab59be8525 service nova] Releasing lock "refresh_cache-4bb19560-6149-4c39-8596-3c4c11c4247d" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:50:56 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:50:56 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[0008eb21-e074-4d10-89a8-752dce408736]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:50:56 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[2321fcff-efce-43d7-8454-ee60f04ba5d8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:50:56 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-aec5e1a2-504f-4d49-8d3e-a757fd5babab tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Running cmd (subprocess): nvme version {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:50:56 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-aec5e1a2-504f-4d49-8d3e-a757fd5babab tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] 'nvme version' failed. Not Retrying. {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 01:50:56 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.nvmeof [None req-aec5e1a2-504f-4d49-8d3e-a757fd5babab tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] nvme not present on system {{(pid=75226) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 17 01:50:56 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:50:56 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 01:50:56 user nova-compute[75226]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 17 01:50:56 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[13a433fa-9adc-4fb3-a972-5802ec58c493]: (4, '') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:50:56 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-aec5e1a2-504f-4d49-8d3e-a757fd5babab tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75226) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 17 01:50:56 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-aec5e1a2-504f-4d49-8d3e-a757fd5babab tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75226) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 17 01:50:56 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-aec5e1a2-504f-4d49-8d3e-a757fd5babab tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] LIGHTOS: no hostnqn found. {{(pid=75226) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 17 01:50:56 user nova-compute[75226]: DEBUG os_brick.utils [None req-aec5e1a2-504f-4d49-8d3e-a757fd5babab tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f62857db69', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:50:56 user nova-compute[75226]: DEBUG nova.virt.block_device [None req-aec5e1a2-504f-4d49-8d3e-a757fd5babab tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: 19ff5421-3e67-4ac7-8021-bc4a4528d992] Updating existing volume attachment record: 032a44f0-41bf-473f-a3c6-a1a4cb9ac94f {{(pid=75226) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 17 01:50:57 user nova-compute[75226]: DEBUG nova.network.neutron [None req-aec5e1a2-504f-4d49-8d3e-a757fd5babab tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: 19ff5421-3e67-4ac7-8021-bc4a4528d992] Successfully created port: af3d3ad1-b936-4f8b-a16c-09f44988ba7b {{(pid=75226) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 17 01:50:57 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:50:57 user nova-compute[75226]: DEBUG nova.network.neutron [None req-aec5e1a2-504f-4d49-8d3e-a757fd5babab tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: 19ff5421-3e67-4ac7-8021-bc4a4528d992] Successfully updated port: af3d3ad1-b936-4f8b-a16c-09f44988ba7b {{(pid=75226) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 17 01:50:57 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-aec5e1a2-504f-4d49-8d3e-a757fd5babab tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Acquiring lock "refresh_cache-19ff5421-3e67-4ac7-8021-bc4a4528d992" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:50:57 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-aec5e1a2-504f-4d49-8d3e-a757fd5babab tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Acquired lock "refresh_cache-19ff5421-3e67-4ac7-8021-bc4a4528d992" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:50:57 user nova-compute[75226]: DEBUG nova.network.neutron [None req-aec5e1a2-504f-4d49-8d3e-a757fd5babab tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: 19ff5421-3e67-4ac7-8021-bc4a4528d992] Building network info cache for instance {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 01:50:57 user nova-compute[75226]: DEBUG nova.network.neutron [None req-aec5e1a2-504f-4d49-8d3e-a757fd5babab tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: 19ff5421-3e67-4ac7-8021-bc4a4528d992] Instance cache missing network info. {{(pid=75226) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 17 01:50:57 user nova-compute[75226]: DEBUG nova.compute.manager [req-bd148b78-c258-4fc1-ad53-a45e744949ab req-e53d66f1-9a2d-4a5e-90db-0fc8eff066d8 service nova] [instance: 19ff5421-3e67-4ac7-8021-bc4a4528d992] Received event network-changed-af3d3ad1-b936-4f8b-a16c-09f44988ba7b {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:50:57 user nova-compute[75226]: DEBUG nova.compute.manager [req-bd148b78-c258-4fc1-ad53-a45e744949ab req-e53d66f1-9a2d-4a5e-90db-0fc8eff066d8 service nova] [instance: 19ff5421-3e67-4ac7-8021-bc4a4528d992] Refreshing instance network info cache due to event network-changed-af3d3ad1-b936-4f8b-a16c-09f44988ba7b. {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 01:50:57 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-bd148b78-c258-4fc1-ad53-a45e744949ab req-e53d66f1-9a2d-4a5e-90db-0fc8eff066d8 service nova] Acquiring lock "refresh_cache-19ff5421-3e67-4ac7-8021-bc4a4528d992" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:50:58 user nova-compute[75226]: DEBUG nova.network.neutron [None req-aec5e1a2-504f-4d49-8d3e-a757fd5babab tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: 19ff5421-3e67-4ac7-8021-bc4a4528d992] Updating instance_info_cache with network_info: [{"id": "af3d3ad1-b936-4f8b-a16c-09f44988ba7b", "address": "fa:16:3e:6c:79:d6", "network": {"id": "81bbbdad-218b-4fcd-b7f5-427fd49361cb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1151874504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "673620a69fba4a04af75baabe775dc8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf3d3ad1-b9", "ovs_interfaceid": "af3d3ad1-b936-4f8b-a16c-09f44988ba7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:50:58 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-aec5e1a2-504f-4d49-8d3e-a757fd5babab tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Releasing lock "refresh_cache-19ff5421-3e67-4ac7-8021-bc4a4528d992" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:50:58 user nova-compute[75226]: DEBUG nova.compute.manager [None req-aec5e1a2-504f-4d49-8d3e-a757fd5babab tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: 19ff5421-3e67-4ac7-8021-bc4a4528d992] Instance network_info: |[{"id": "af3d3ad1-b936-4f8b-a16c-09f44988ba7b", "address": "fa:16:3e:6c:79:d6", "network": {"id": "81bbbdad-218b-4fcd-b7f5-427fd49361cb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1151874504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "673620a69fba4a04af75baabe775dc8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf3d3ad1-b9", "ovs_interfaceid": "af3d3ad1-b936-4f8b-a16c-09f44988ba7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75226) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 17 01:50:58 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-bd148b78-c258-4fc1-ad53-a45e744949ab req-e53d66f1-9a2d-4a5e-90db-0fc8eff066d8 service nova] Acquired lock "refresh_cache-19ff5421-3e67-4ac7-8021-bc4a4528d992" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:50:58 user nova-compute[75226]: DEBUG nova.network.neutron [req-bd148b78-c258-4fc1-ad53-a45e744949ab req-e53d66f1-9a2d-4a5e-90db-0fc8eff066d8 service nova] [instance: 19ff5421-3e67-4ac7-8021-bc4a4528d992] Refreshing network info cache for port af3d3ad1-b936-4f8b-a16c-09f44988ba7b {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 01:50:58 user nova-compute[75226]: DEBUG nova.network.neutron [req-bd148b78-c258-4fc1-ad53-a45e744949ab req-e53d66f1-9a2d-4a5e-90db-0fc8eff066d8 service nova] [instance: 19ff5421-3e67-4ac7-8021-bc4a4528d992] Updated VIF entry in instance network info cache for port af3d3ad1-b936-4f8b-a16c-09f44988ba7b. {{(pid=75226) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 01:50:58 user nova-compute[75226]: DEBUG nova.network.neutron [req-bd148b78-c258-4fc1-ad53-a45e744949ab req-e53d66f1-9a2d-4a5e-90db-0fc8eff066d8 service nova] [instance: 19ff5421-3e67-4ac7-8021-bc4a4528d992] Updating instance_info_cache with network_info: [{"id": "af3d3ad1-b936-4f8b-a16c-09f44988ba7b", "address": "fa:16:3e:6c:79:d6", "network": {"id": "81bbbdad-218b-4fcd-b7f5-427fd49361cb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1151874504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "673620a69fba4a04af75baabe775dc8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf3d3ad1-b9", "ovs_interfaceid": "af3d3ad1-b936-4f8b-a16c-09f44988ba7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:50:58 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-bd148b78-c258-4fc1-ad53-a45e744949ab req-e53d66f1-9a2d-4a5e-90db-0fc8eff066d8 service nova] Releasing lock "refresh_cache-19ff5421-3e67-4ac7-8021-bc4a4528d992" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:50:58 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:51:01 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf36ff4b-4167-4baa-996e-e11472cbdddf tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] [instance: 4bb19560-6149-4c39-8596-3c4c11c4247d] Calling os-brick to attach iSCSI Volume {{(pid=75226) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 17 01:51:01 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf36ff4b-4167-4baa-996e-e11472cbdddf tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc4cc36b490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e4a54f08-130d-4550-bc7e-62a965ae4c3f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MtkENYwG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:51:01 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-cf36ff4b-4167-4baa-996e-e11472cbdddf tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:51:01 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-cf36ff4b-4167-4baa-996e-e11472cbdddf tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:51:01 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-cf36ff4b-4167-4baa-996e-e11472cbdddf tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:51:01 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-cf36ff4b-4167-4baa-996e-e11472cbdddf tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:51:01 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-cf36ff4b-4167-4baa-996e-e11472cbdddf tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e4a54f08-130d-4550-bc7e-62a965ae4c3f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:51:01 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-cf36ff4b-4167-4baa-996e-e11472cbdddf tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e4a54f08-130d-4550-bc7e-62a965ae4c3f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:51:01 user nova-compute[75226]: INFO os_brick.initiator.connectors.iscsi [None req-cf36ff4b-4167-4baa-996e-e11472cbdddf tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 17 01:51:01 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4a54f08-130d-4550-bc7e-62a965ae4c3f -p 172.16.0.220:3260 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:51:01 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4a54f08-130d-4550-bc7e-62a965ae4c3f -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:51:01 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[83f94470-44a7-4934-9f81-a09c39fe2973]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:51:01 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf36ff4b-4167-4baa-996e-e11472cbdddf tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 17 01:51:01 user nova-compute[75226]:  {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:51:01 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4a54f08-130d-4550-bc7e-62a965ae4c3f -p 172.16.0.220:3260 --interface default --op new {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:51:01 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4a54f08-130d-4550-bc7e-62a965ae4c3f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:51:01 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b510f42-8e22-44a6-8f3c-3665ef8bd06e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e4a54f08-130d-4550-bc7e-62a965ae4c3f] added\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:51:01 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf36ff4b-4167-4baa-996e-e11472cbdddf tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e4a54f08-130d-4550-bc7e-62a965ae4c3f] added
Nov 17 01:51:01 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:51:01 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4a54f08-130d-4550-bc7e-62a965ae4c3f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:51:01 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4a54f08-130d-4550-bc7e-62a965ae4c3f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:51:01 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[841a0cfc-3a7b-47e1-ad11-099f05facd84]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:51:01 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf36ff4b-4167-4baa-996e-e11472cbdddf tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:51:01 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4a54f08-130d-4550-bc7e-62a965ae4c3f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:51:01 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4a54f08-130d-4550-bc7e-62a965ae4c3f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:51:01 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e66e747-e664-493a-9147-a50f6d9276ab]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:51:01 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf36ff4b-4167-4baa-996e-e11472cbdddf tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:51:01 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4a54f08-130d-4550-bc7e-62a965ae4c3f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MtkENYwG {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:51:01 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4a54f08-130d-4550-bc7e-62a965ae4c3f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MtkENYwG" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:51:01 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[91255344-b279-4cb3-b256-a3cfcc5adc10]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:51:01 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf36ff4b-4167-4baa-996e-e11472cbdddf tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MtkENYwG'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:51:01 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4a54f08-130d-4550-bc7e-62a965ae4c3f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:51:01 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4a54f08-130d-4550-bc7e-62a965ae4c3f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:51:01 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[664054f6-27cc-4fa6-a065-90f8565fea5f]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:51:01 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf36ff4b-4167-4baa-996e-e11472cbdddf tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:51:01 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:51:01 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:51:01 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eead7ce-77fd-467f-83ee-ee40d4379d8f]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:51:01 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf36ff4b-4167-4baa-996e-e11472cbdddf tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 17 01:51:01 user nova-compute[75226]:  {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:51:01 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf36ff4b-4167-4baa-996e-e11472cbdddf tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 17 01:51:01 user nova-compute[75226]:  {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:51:01 user nova-compute[75226]: WARNING os_brick.initiator.connectors.iscsi [None req-cf36ff4b-4167-4baa-996e-e11472cbdddf tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 17 01:51:01 user nova-compute[75226]: 
Nov 17 01:51:01 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4a54f08-130d-4550-bc7e-62a965ae4c3f -p 172.16.0.220:3260 --login {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:51:01 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4a54f08-130d-4550-bc7e-62a965ae4c3f -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:51:01 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[c38bd8e0-17a9-450b-8dbc-e712665dae74]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e4a54f08-130d-4550-bc7e-62a965ae4c3f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e4a54f08-130d-4550-bc7e-62a965ae4c3f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:51:01 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf36ff4b-4167-4baa-996e-e11472cbdddf tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e4a54f08-130d-4550-bc7e-62a965ae4c3f, portal: 172.16.0.220,3260]
Nov 17 01:51:01 user nova-compute[75226]: Login to [iface: default, target: iqn.2010-10.org.openstack:e4a54f08-130d-4550-bc7e-62a965ae4c3f, portal: 172.16.0.220,3260] successful.
Nov 17 01:51:01 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:51:01 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4a54f08-130d-4550-bc7e-62a965ae4c3f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:51:01 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4a54f08-130d-4550-bc7e-62a965ae4c3f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:51:01 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[027644f1-a24f-4c08-a95c-6b33737c7626]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:51:01 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf36ff4b-4167-4baa-996e-e11472cbdddf tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:51:01 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:51:01 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:51:01 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[b88af95a-3554-4f12-9bc5-c1ad719a2534]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4a54f08-130d-4550-bc7e-62a965ae4c3f (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:51:01 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf36ff4b-4167-4baa-996e-e11472cbdddf tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4a54f08-130d-4550-bc7e-62a965ae4c3f (non-flash)
Nov 17 01:51:01 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:51:01 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf36ff4b-4167-4baa-996e-e11472cbdddf tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4a54f08-130d-4550-bc7e-62a965ae4c3f (non-flash)
Nov 17 01:51:01 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:51:01 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-cf36ff4b-4167-4baa-996e-e11472cbdddf tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e4a54f08-130d-4550-bc7e-62a965ae4c3f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:51:01 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf36ff4b-4167-4baa-996e-e11472cbdddf tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Connected to 172.16.0.220:3260 {{(pid=75226) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 17 01:51:01 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-cf36ff4b-4167-4baa-996e-e11472cbdddf tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] HCTL ('33', '-', '-', 0) found on session 59 with lun 0 {{(pid=75226) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 17 01:51:01 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-cf36ff4b-4167-4baa-996e-e11472cbdddf tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75226) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 17 01:51:01 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:51:01 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:51:01 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e44b3ef-2fe5-47b4-b64d-61e5af6e48f6]: (4, ('- - 0', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:51:01 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-cf36ff4b-4167-4baa-996e-e11472cbdddf tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75226) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 01:51:01 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf36ff4b-4167-4baa-996e-e11472cbdddf tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:e4a54f08-130d-4550-bc7e-62a965ae4c3f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MtkENYwG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75226) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 17 01:51:01 user nova-compute[75226]: DEBUG nova.compute.manager [None req-aec5e1a2-504f-4d49-8d3e-a757fd5babab tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: 19ff5421-3e67-4ac7-8021-bc4a4528d992] Start spawning the instance on the hypervisor. {{(pid=75226) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 17 01:51:01 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-aec5e1a2-504f-4d49-8d3e-a757fd5babab tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: 19ff5421-3e67-4ac7-8021-bc4a4528d992] Creating instance directory {{(pid=75226) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 17 01:51:01 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-aec5e1a2-504f-4d49-8d3e-a757fd5babab tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: 19ff5421-3e67-4ac7-8021-bc4a4528d992] Creating image(s)
Nov 17 01:51:01 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-aec5e1a2-504f-4d49-8d3e-a757fd5babab tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: 19ff5421-3e67-4ac7-8021-bc4a4528d992] Did not create local disks {{(pid=75226) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 17 01:51:01 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-aec5e1a2-504f-4d49-8d3e-a757fd5babab tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: 19ff5421-3e67-4ac7-8021-bc4a4528d992] Ensure instance console log exists: /opt/stack/data/nova/instances/19ff5421-3e67-4ac7-8021-bc4a4528d992/console.log {{(pid=75226) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 17 01:51:01 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-aec5e1a2-504f-4d49-8d3e-a757fd5babab tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:51:01 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-aec5e1a2-504f-4d49-8d3e-a757fd5babab tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:51:01 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-aec5e1a2-504f-4d49-8d3e-a757fd5babab tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:51:01 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-aec5e1a2-504f-4d49-8d3e-a757fd5babab tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: 19ff5421-3e67-4ac7-8021-bc4a4528d992] Start _get_guest_xml network_info=[{"id": "af3d3ad1-b936-4f8b-a16c-09f44988ba7b", "address": "fa:16:3e:6c:79:d6", "network": {"id": "81bbbdad-218b-4fcd-b7f5-427fd49361cb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1151874504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "673620a69fba4a04af75baabe775dc8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf3d3ad1-b9", "ovs_interfaceid": "af3d3ad1-b936-4f8b-a16c-09f44988ba7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:875a05e9-5133-418e-a210-0b01076d92a8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DMmFhyko', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '19ff5421-3e67-4ac7-8021-bc4a4528d992', 'attached_at': '', 'detached_at': '', 'volume_id': '875a05e9-5133-418e-a210-0b01076d92a8', 'serial': '875a05e9-5133-418e-a210-0b01076d92a8'}, 'attachment_id': '032a44f0-41bf-473f-a3c6-a1a4cb9ac94f', 'device_type': 'disk', 'volume_type': None} {{(pid=75226) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 17 01:51:01 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-aec5e1a2-504f-4d49-8d3e-a757fd5babab tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:51:01 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-aec5e1a2-504f-4d49-8d3e-a757fd5babab tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:51:01 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-aec5e1a2-504f-4d49-8d3e-a757fd5babab tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75226) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 17 01:51:01 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-aec5e1a2-504f-4d49-8d3e-a757fd5babab tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] CPU controller missing on host. {{(pid=75226) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 17 01:51:01 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-aec5e1a2-504f-4d49-8d3e-a757fd5babab tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75226) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 17 01:51:01 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-aec5e1a2-504f-4d49-8d3e-a757fd5babab tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] CPU controller found on host. {{(pid=75226) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 17 01:51:01 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-aec5e1a2-504f-4d49-8d3e-a757fd5babab tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75226) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 17 01:51:01 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-aec5e1a2-504f-4d49-8d3e-a757fd5babab tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-17T01:13:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 17 01:51:01 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-aec5e1a2-504f-4d49-8d3e-a757fd5babab tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Flavor limits 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 17 01:51:01 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-aec5e1a2-504f-4d49-8d3e-a757fd5babab tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Image limits 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 17 01:51:01 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-aec5e1a2-504f-4d49-8d3e-a757fd5babab tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Flavor pref 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 17 01:51:01 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-aec5e1a2-504f-4d49-8d3e-a757fd5babab tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Image pref 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 17 01:51:01 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-aec5e1a2-504f-4d49-8d3e-a757fd5babab tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 17 01:51:01 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-aec5e1a2-504f-4d49-8d3e-a757fd5babab tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 17 01:51:01 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-aec5e1a2-504f-4d49-8d3e-a757fd5babab tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75226) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 17 01:51:01 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-aec5e1a2-504f-4d49-8d3e-a757fd5babab tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Got 1 possible topologies {{(pid=75226) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 17 01:51:01 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-aec5e1a2-504f-4d49-8d3e-a757fd5babab tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 17 01:51:01 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-aec5e1a2-504f-4d49-8d3e-a757fd5babab tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 17 01:51:01 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aec5e1a2-504f-4d49-8d3e-a757fd5babab tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: 19ff5421-3e67-4ac7-8021-bc4a4528d992] Calling os-brick to attach iSCSI Volume {{(pid=75226) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 17 01:51:01 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-aec5e1a2-504f-4d49-8d3e-a757fd5babab tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc4cc36b490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:875a05e9-5133-418e-a210-0b01076d92a8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DMmFhyko', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:51:01 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-aec5e1a2-504f-4d49-8d3e-a757fd5babab tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:51:01 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-aec5e1a2-504f-4d49-8d3e-a757fd5babab tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:51:02 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-cf36ff4b-4167-4baa-996e-e11472cbdddf tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.309s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:51:02 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf36ff4b-4167-4baa-996e-e11472cbdddf tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] <== connect_volume: return (1311ms) {'type': 'block', 'scsi_wwn': '23634363139313064', 'path': '/dev/sdb'} {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:51:02 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf36ff4b-4167-4baa-996e-e11472cbdddf tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] [instance: 4bb19560-6149-4c39-8596-3c4c11c4247d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23634363139313064', 'path': '/dev/sdb'} {{(pid=75226) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 17 01:51:02 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-aec5e1a2-504f-4d49-8d3e-a757fd5babab tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.718s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:51:02 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-aec5e1a2-504f-4d49-8d3e-a757fd5babab tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:51:02 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-aec5e1a2-504f-4d49-8d3e-a757fd5babab tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:875a05e9-5133-418e-a210-0b01076d92a8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:51:02 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-aec5e1a2-504f-4d49-8d3e-a757fd5babab tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:875a05e9-5133-418e-a210-0b01076d92a8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:51:02 user nova-compute[75226]: INFO os_brick.initiator.connectors.iscsi [None req-aec5e1a2-504f-4d49-8d3e-a757fd5babab tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 17 01:51:02 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:875a05e9-5133-418e-a210-0b01076d92a8 -p 172.16.0.220:3260 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:51:02 user nova-compute[75226]: DEBUG nova.objects.instance [None req-cf36ff4b-4167-4baa-996e-e11472cbdddf tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Lazy-loading 'flavor' on Instance uuid 4bb19560-6149-4c39-8596-3c4c11c4247d {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:51:02 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:875a05e9-5133-418e-a210-0b01076d92a8 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:51:02 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a9b72f0-0f88-4470-8670-1a66c1ba4d19]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:51:02 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-aec5e1a2-504f-4d49-8d3e-a757fd5babab tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 17 01:51:02 user nova-compute[75226]:  {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:51:02 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:875a05e9-5133-418e-a210-0b01076d92a8 -p 172.16.0.220:3260 --interface default --op new {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:51:02 user nova-compute[75226]: DEBUG nova.virt.libvirt.guest [None req-cf36ff4b-4167-4baa-996e-e11472cbdddf tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] attach device xml: <disk type="block" device="disk">
Nov 17 01:51:02 user nova-compute[75226]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 01:51:02 user nova-compute[75226]:   <source dev="/dev/sdb"/>
Nov 17 01:51:02 user nova-compute[75226]:   <target dev="vdb" bus="virtio"/>
Nov 17 01:51:02 user nova-compute[75226]:   <serial>e4a54f08-130d-4550-bc7e-62a965ae4c3f</serial>
Nov 17 01:51:02 user nova-compute[75226]: </disk>
Nov 17 01:51:02 user nova-compute[75226]:  {{(pid=75226) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 17 01:51:02 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:875a05e9-5133-418e-a210-0b01076d92a8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:51:02 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[512bd876-a522-4551-92b0-95fcfe302374]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:875a05e9-5133-418e-a210-0b01076d92a8] added\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:51:02 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-aec5e1a2-504f-4d49-8d3e-a757fd5babab tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:875a05e9-5133-418e-a210-0b01076d92a8] added
Nov 17 01:51:02 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:51:02 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:875a05e9-5133-418e-a210-0b01076d92a8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:51:02 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:875a05e9-5133-418e-a210-0b01076d92a8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:51:02 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[82d5cd37-9c29-4fd5-839b-5b91b9ad2297]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:51:02 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-aec5e1a2-504f-4d49-8d3e-a757fd5babab tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:51:02 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:875a05e9-5133-418e-a210-0b01076d92a8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:51:02 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:875a05e9-5133-418e-a210-0b01076d92a8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:51:02 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[857f8384-48b7-4d4e-9896-208b0db6909e]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:51:02 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-aec5e1a2-504f-4d49-8d3e-a757fd5babab tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:51:02 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:875a05e9-5133-418e-a210-0b01076d92a8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DMmFhyko {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:51:02 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:875a05e9-5133-418e-a210-0b01076d92a8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DMmFhyko" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:51:02 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f24de11-92f6-4f6f-8417-05fc8e53803f]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:51:02 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-aec5e1a2-504f-4d49-8d3e-a757fd5babab tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DMmFhyko'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:51:02 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:875a05e9-5133-418e-a210-0b01076d92a8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:51:02 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:51:02 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:875a05e9-5133-418e-a210-0b01076d92a8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:51:02 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa805e63-488c-42b6-b731-b572ece8e419]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:51:02 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-aec5e1a2-504f-4d49-8d3e-a757fd5babab tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:51:02 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:51:02 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:51:02 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[04bf744b-2428-4766-8f4a-25807a56b8f8]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4a54f08-130d-4550-bc7e-62a965ae4c3f (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:51:02 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-aec5e1a2-504f-4d49-8d3e-a757fd5babab tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4a54f08-130d-4550-bc7e-62a965ae4c3f (non-flash)
Nov 17 01:51:02 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:51:02 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-aec5e1a2-504f-4d49-8d3e-a757fd5babab tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4a54f08-130d-4550-bc7e-62a965ae4c3f (non-flash)
Nov 17 01:51:02 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:51:02 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:875a05e9-5133-418e-a210-0b01076d92a8 -p 172.16.0.220:3260 --login {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:51:02 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:875a05e9-5133-418e-a210-0b01076d92a8 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:51:02 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[657b38ba-e6a6-4af6-afff-8b757094908d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:875a05e9-5133-418e-a210-0b01076d92a8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:875a05e9-5133-418e-a210-0b01076d92a8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:51:02 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-aec5e1a2-504f-4d49-8d3e-a757fd5babab tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:875a05e9-5133-418e-a210-0b01076d92a8, portal: 172.16.0.220,3260]
Nov 17 01:51:02 user nova-compute[75226]: Login to [iface: default, target: iqn.2010-10.org.openstack:875a05e9-5133-418e-a210-0b01076d92a8, portal: 172.16.0.220,3260] successful.
Nov 17 01:51:02 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:51:02 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:875a05e9-5133-418e-a210-0b01076d92a8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:51:02 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:875a05e9-5133-418e-a210-0b01076d92a8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:51:02 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e2890f6-0d47-42d6-b863-7e328d48299d]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:51:02 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-aec5e1a2-504f-4d49-8d3e-a757fd5babab tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:51:02 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:51:02 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:51:02 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab6b5601-636f-4f9b-bc87-855a36fd028d]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4a54f08-130d-4550-bc7e-62a965ae4c3f (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:875a05e9-5133-418e-a210-0b01076d92a8 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:51:02 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-aec5e1a2-504f-4d49-8d3e-a757fd5babab tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4a54f08-130d-4550-bc7e-62a965ae4c3f (non-flash)
Nov 17 01:51:02 user nova-compute[75226]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:875a05e9-5133-418e-a210-0b01076d92a8 (non-flash)
Nov 17 01:51:02 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:51:02 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-aec5e1a2-504f-4d49-8d3e-a757fd5babab tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4a54f08-130d-4550-bc7e-62a965ae4c3f (non-flash)
Nov 17 01:51:02 user nova-compute[75226]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:875a05e9-5133-418e-a210-0b01076d92a8 (non-flash)
Nov 17 01:51:02 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:51:02 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-aec5e1a2-504f-4d49-8d3e-a757fd5babab tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:875a05e9-5133-418e-a210-0b01076d92a8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.256s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:51:02 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-aec5e1a2-504f-4d49-8d3e-a757fd5babab tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Connected to 172.16.0.220:3260 {{(pid=75226) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 17 01:51:02 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-aec5e1a2-504f-4d49-8d3e-a757fd5babab tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] HCTL ('34', '-', '-', 0) found on session 60 with lun 0 {{(pid=75226) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 17 01:51:02 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-aec5e1a2-504f-4d49-8d3e-a757fd5babab tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75226) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 17 01:51:02 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:51:02 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:51:02 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[39328ca1-ced9-4496-b4cc-4b7b87f1269d]: (4, ('- - 0', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:51:02 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-aec5e1a2-504f-4d49-8d3e-a757fd5babab tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Searching for a device in session 60 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75226) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 01:51:02 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-aec5e1a2-504f-4d49-8d3e-a757fd5babab tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:875a05e9-5133-418e-a210-0b01076d92a8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DMmFhyko', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75226) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 17 01:51:02 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-cf36ff4b-4167-4baa-996e-e11472cbdddf tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] No BDM found with device name vda, not building metadata. {{(pid=75226) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 01:51:02 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-cf36ff4b-4167-4baa-996e-e11472cbdddf tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75226) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 01:51:02 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-cf36ff4b-4167-4baa-996e-e11472cbdddf tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] No VIF found with MAC fa:16:3e:16:03:37, not building metadata {{(pid=75226) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 01:51:03 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-cf36ff4b-4167-4baa-996e-e11472cbdddf tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Lock "4bb19560-6149-4c39-8596-3c4c11c4247d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.087s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:51:03 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:51:03 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-aec5e1a2-504f-4d49-8d3e-a757fd5babab tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.289s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:51:03 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-aec5e1a2-504f-4d49-8d3e-a757fd5babab tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] <== connect_volume: return (2008ms) {'type': 'block', 'scsi_wwn': '23232616434323239', 'path': '/dev/sdc'} {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:51:03 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aec5e1a2-504f-4d49-8d3e-a757fd5babab tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: 19ff5421-3e67-4ac7-8021-bc4a4528d992] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23232616434323239', 'path': '/dev/sdc'} {{(pid=75226) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 17 01:51:03 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-aec5e1a2-504f-4d49-8d3e-a757fd5babab tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:50:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1731373839',display_name='tempest-TestVolumeBootPattern-server-1731373839',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1731373839',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIOTXvx1rt0huiJMkCirjSAkUEIOTUxZuP5hnGbb4TZayM1DPwV+2un52eKf78XfXFJdTcPGOcA7AeRAFw+1gTwHIAhQ08B/zT7NrklMaP31fH3B8tWT2/QeOIfwk/TlfQ==',key_name='tempest-TestVolumeBootPattern-346525006',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='673620a69fba4a04af75baabe775dc8b',ramdisk_id='',reservation_id='r-t0oxvdod',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-971654489',owner_user_name='tempest-TestVolumeBootPattern-971654489-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T01:50:56Z,user_data=None,user_id='7c8c8baa56884dcd9a90f0187c9fc06f',uuid=19ff5421-3e67-4ac7-8021-bc4a4528d992,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "af3d3ad1-b936-4f8b-a16c-09f44988ba7b", "address": "fa:16:3e:6c:79:d6", "network": {"id": "81bbbdad-218b-4fcd-b7f5-427fd49361cb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1151874504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "673620a69fba4a04af75baabe775dc8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf3d3ad1-b9", "ovs_interfaceid": "af3d3ad1-b936-4f8b-a16c-09f44988ba7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75226) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 01:51:03 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-aec5e1a2-504f-4d49-8d3e-a757fd5babab tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Converting VIF {"id": "af3d3ad1-b936-4f8b-a16c-09f44988ba7b", "address": "fa:16:3e:6c:79:d6", "network": {"id": "81bbbdad-218b-4fcd-b7f5-427fd49361cb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1151874504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "673620a69fba4a04af75baabe775dc8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf3d3ad1-b9", "ovs_interfaceid": "af3d3ad1-b936-4f8b-a16c-09f44988ba7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:51:03 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-aec5e1a2-504f-4d49-8d3e-a757fd5babab tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:79:d6,bridge_name='br-int',has_traffic_filtering=True,id=af3d3ad1-b936-4f8b-a16c-09f44988ba7b,network=Network(81bbbdad-218b-4fcd-b7f5-427fd49361cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf3d3ad1-b9') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:51:03 user nova-compute[75226]: DEBUG nova.objects.instance [None req-aec5e1a2-504f-4d49-8d3e-a757fd5babab tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Lazy-loading 'pci_devices' on Instance uuid 19ff5421-3e67-4ac7-8021-bc4a4528d992 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:51:03 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-aec5e1a2-504f-4d49-8d3e-a757fd5babab tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: 19ff5421-3e67-4ac7-8021-bc4a4528d992] End _get_guest_xml xml=<domain type="kvm">
Nov 17 01:51:03 user nova-compute[75226]:   <uuid>19ff5421-3e67-4ac7-8021-bc4a4528d992</uuid>
Nov 17 01:51:03 user nova-compute[75226]:   <name>instance-00000032</name>
Nov 17 01:51:03 user nova-compute[75226]:   <memory>524288</memory>
Nov 17 01:51:03 user nova-compute[75226]:   <vcpu>1</vcpu>
Nov 17 01:51:03 user nova-compute[75226]:   <metadata>
Nov 17 01:51:03 user nova-compute[75226]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 17 01:51:03 user nova-compute[75226]:       <nova:package version="0.0.0"/>
Nov 17 01:51:03 user nova-compute[75226]:       <nova:name>tempest-TestVolumeBootPattern-server-1731373839</nova:name>
Nov 17 01:51:03 user nova-compute[75226]:       <nova:creationTime>2023-11-17 01:51:01</nova:creationTime>
Nov 17 01:51:03 user nova-compute[75226]:       <nova:flavor name="m1.tiny">
Nov 17 01:51:03 user nova-compute[75226]:         <nova:memory>512</nova:memory>
Nov 17 01:51:03 user nova-compute[75226]:         <nova:disk>1</nova:disk>
Nov 17 01:51:03 user nova-compute[75226]:         <nova:swap>0</nova:swap>
Nov 17 01:51:03 user nova-compute[75226]:         <nova:ephemeral>0</nova:ephemeral>
Nov 17 01:51:03 user nova-compute[75226]:         <nova:vcpus>1</nova:vcpus>
Nov 17 01:51:03 user nova-compute[75226]:       </nova:flavor>
Nov 17 01:51:03 user nova-compute[75226]:       <nova:owner>
Nov 17 01:51:03 user nova-compute[75226]:         <nova:user uuid="7c8c8baa56884dcd9a90f0187c9fc06f">tempest-TestVolumeBootPattern-971654489-project-member</nova:user>
Nov 17 01:51:03 user nova-compute[75226]:         <nova:project uuid="673620a69fba4a04af75baabe775dc8b">tempest-TestVolumeBootPattern-971654489</nova:project>
Nov 17 01:51:03 user nova-compute[75226]:       </nova:owner>
Nov 17 01:51:03 user nova-compute[75226]:       <nova:ports>
Nov 17 01:51:03 user nova-compute[75226]:         <nova:port uuid="af3d3ad1-b936-4f8b-a16c-09f44988ba7b">
Nov 17 01:51:03 user nova-compute[75226]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 17 01:51:03 user nova-compute[75226]:         </nova:port>
Nov 17 01:51:03 user nova-compute[75226]:       </nova:ports>
Nov 17 01:51:03 user nova-compute[75226]:     </nova:instance>
Nov 17 01:51:03 user nova-compute[75226]:   </metadata>
Nov 17 01:51:03 user nova-compute[75226]:   <sysinfo type="smbios">
Nov 17 01:51:03 user nova-compute[75226]:     <system>
Nov 17 01:51:03 user nova-compute[75226]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 17 01:51:03 user nova-compute[75226]:       <entry name="product">OpenStack Nova</entry>
Nov 17 01:51:03 user nova-compute[75226]:       <entry name="version">0.0.0</entry>
Nov 17 01:51:03 user nova-compute[75226]:       <entry name="serial">19ff5421-3e67-4ac7-8021-bc4a4528d992</entry>
Nov 17 01:51:03 user nova-compute[75226]:       <entry name="uuid">19ff5421-3e67-4ac7-8021-bc4a4528d992</entry>
Nov 17 01:51:03 user nova-compute[75226]:       <entry name="family">Virtual Machine</entry>
Nov 17 01:51:03 user nova-compute[75226]:     </system>
Nov 17 01:51:03 user nova-compute[75226]:   </sysinfo>
Nov 17 01:51:03 user nova-compute[75226]:   <os>
Nov 17 01:51:03 user nova-compute[75226]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 17 01:51:03 user nova-compute[75226]:     <boot dev="hd"/>
Nov 17 01:51:03 user nova-compute[75226]:     <smbios mode="sysinfo"/>
Nov 17 01:51:03 user nova-compute[75226]:   </os>
Nov 17 01:51:03 user nova-compute[75226]:   <features>
Nov 17 01:51:03 user nova-compute[75226]:     <acpi/>
Nov 17 01:51:03 user nova-compute[75226]:     <apic/>
Nov 17 01:51:03 user nova-compute[75226]:     <vmcoreinfo/>
Nov 17 01:51:03 user nova-compute[75226]:   </features>
Nov 17 01:51:03 user nova-compute[75226]:   <clock offset="utc">
Nov 17 01:51:03 user nova-compute[75226]:     <timer name="pit" tickpolicy="delay"/>
Nov 17 01:51:03 user nova-compute[75226]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 17 01:51:03 user nova-compute[75226]:     <timer name="hpet" present="no"/>
Nov 17 01:51:03 user nova-compute[75226]:   </clock>
Nov 17 01:51:03 user nova-compute[75226]:   <cpu mode="custom" match="exact">
Nov 17 01:51:03 user nova-compute[75226]:     <model>Nehalem</model>
Nov 17 01:51:03 user nova-compute[75226]:     <topology sockets="1" cores="1" threads="1"/>
Nov 17 01:51:03 user nova-compute[75226]:   </cpu>
Nov 17 01:51:03 user nova-compute[75226]:   <devices>
Nov 17 01:51:03 user nova-compute[75226]:     <disk type="block" device="disk">
Nov 17 01:51:03 user nova-compute[75226]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 01:51:03 user nova-compute[75226]:       <source dev="/dev/sdc"/>
Nov 17 01:51:03 user nova-compute[75226]:       <target dev="vda" bus="virtio"/>
Nov 17 01:51:03 user nova-compute[75226]:       <serial>875a05e9-5133-418e-a210-0b01076d92a8</serial>
Nov 17 01:51:03 user nova-compute[75226]:     </disk>
Nov 17 01:51:03 user nova-compute[75226]:     <interface type="ethernet">
Nov 17 01:51:03 user nova-compute[75226]:       <mac address="fa:16:3e:6c:79:d6"/>
Nov 17 01:51:03 user nova-compute[75226]:       <model type="virtio"/>
Nov 17 01:51:03 user nova-compute[75226]:       <mtu size="1442"/>
Nov 17 01:51:03 user nova-compute[75226]:       <target dev="tapaf3d3ad1-b9"/>
Nov 17 01:51:03 user nova-compute[75226]:     </interface>
Nov 17 01:51:03 user nova-compute[75226]:     <serial type="pty">
Nov 17 01:51:03 user nova-compute[75226]:       <log file="/opt/stack/data/nova/instances/19ff5421-3e67-4ac7-8021-bc4a4528d992/console.log" append="off"/>
Nov 17 01:51:03 user nova-compute[75226]:     </serial>
Nov 17 01:51:03 user nova-compute[75226]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 17 01:51:03 user nova-compute[75226]:     <video>
Nov 17 01:51:03 user nova-compute[75226]:       <model type="virtio"/>
Nov 17 01:51:03 user nova-compute[75226]:     </video>
Nov 17 01:51:03 user nova-compute[75226]:     <rng model="virtio">
Nov 17 01:51:03 user nova-compute[75226]:       <backend model="random">/dev/urandom</backend>
Nov 17 01:51:03 user nova-compute[75226]:     </rng>
Nov 17 01:51:03 user nova-compute[75226]:     <controller type="usb" index="0" model="none"/>
Nov 17 01:51:03 user nova-compute[75226]:     <memballoon model="virtio">
Nov 17 01:51:03 user nova-compute[75226]:       <stats period="10"/>
Nov 17 01:51:03 user nova-compute[75226]:     </memballoon>
Nov 17 01:51:03 user nova-compute[75226]:   </devices>
Nov 17 01:51:03 user nova-compute[75226]: </domain>
Nov 17 01:51:03 user nova-compute[75226]:  {{(pid=75226) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 17 01:51:04 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-aec5e1a2-504f-4d49-8d3e-a757fd5babab tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:50:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1731373839',display_name='tempest-TestVolumeBootPattern-server-1731373839',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1731373839',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIOTXvx1rt0huiJMkCirjSAkUEIOTUxZuP5hnGbb4TZayM1DPwV+2un52eKf78XfXFJdTcPGOcA7AeRAFw+1gTwHIAhQ08B/zT7NrklMaP31fH3B8tWT2/QeOIfwk/TlfQ==',key_name='tempest-TestVolumeBootPattern-346525006',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='673620a69fba4a04af75baabe775dc8b',ramdisk_id='',reservation_id='r-t0oxvdod',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-971654489',owner_user_name='tempest-TestVolumeBootPattern-971654489-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T01:50:56Z,user_data=None,user_id='7c8c8baa56884dcd9a90f0187c9fc06f',uuid=19ff5421-3e67-4ac7-8021-bc4a4528d992,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "af3d3ad1-b936-4f8b-a16c-09f44988ba7b", "address": "fa:16:3e:6c:79:d6", "network": {"id": "81bbbdad-218b-4fcd-b7f5-427fd49361cb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1151874504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "673620a69fba4a04af75baabe775dc8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf3d3ad1-b9", "ovs_interfaceid": "af3d3ad1-b936-4f8b-a16c-09f44988ba7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 17 01:51:04 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-aec5e1a2-504f-4d49-8d3e-a757fd5babab tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Converting VIF {"id": "af3d3ad1-b936-4f8b-a16c-09f44988ba7b", "address": "fa:16:3e:6c:79:d6", "network": {"id": "81bbbdad-218b-4fcd-b7f5-427fd49361cb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1151874504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "673620a69fba4a04af75baabe775dc8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf3d3ad1-b9", "ovs_interfaceid": "af3d3ad1-b936-4f8b-a16c-09f44988ba7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:51:04 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-aec5e1a2-504f-4d49-8d3e-a757fd5babab tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:79:d6,bridge_name='br-int',has_traffic_filtering=True,id=af3d3ad1-b936-4f8b-a16c-09f44988ba7b,network=Network(81bbbdad-218b-4fcd-b7f5-427fd49361cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf3d3ad1-b9') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:51:04 user nova-compute[75226]: DEBUG os_vif [None req-aec5e1a2-504f-4d49-8d3e-a757fd5babab tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:79:d6,bridge_name='br-int',has_traffic_filtering=True,id=af3d3ad1-b936-4f8b-a16c-09f44988ba7b,network=Network(81bbbdad-218b-4fcd-b7f5-427fd49361cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf3d3ad1-b9') {{(pid=75226) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 17 01:51:04 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:51:04 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:51:04 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 17 01:51:04 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:51:04 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b085b108-93c0-5f43-ab09-0c1983934fe4', '_type': 'linux-noop'}}, row=False) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:51:04 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:51:04 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:51:04 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:51:04 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaf3d3ad1-b9, may_exist=True, interface_attrs={}) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:51:04 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapaf3d3ad1-b9, col_values=(('qos', UUID('4cd022b3-0ba7-4661-9bf1-92d93a0256a6')),), if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:51:04 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapaf3d3ad1-b9, col_values=(('external_ids', {'iface-id': 'af3d3ad1-b936-4f8b-a16c-09f44988ba7b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6c:79:d6', 'vm-uuid': '19ff5421-3e67-4ac7-8021-bc4a4528d992'}),), if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:51:04 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:51:04 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:51:04 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:51:04 user nova-compute[75226]: INFO os_vif [None req-aec5e1a2-504f-4d49-8d3e-a757fd5babab tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:79:d6,bridge_name='br-int',has_traffic_filtering=True,id=af3d3ad1-b936-4f8b-a16c-09f44988ba7b,network=Network(81bbbdad-218b-4fcd-b7f5-427fd49361cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf3d3ad1-b9')
Nov 17 01:51:04 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-aec5e1a2-504f-4d49-8d3e-a757fd5babab tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] No BDM found with device name vda, not building metadata. {{(pid=75226) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 01:51:04 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-aec5e1a2-504f-4d49-8d3e-a757fd5babab tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] No VIF found with MAC fa:16:3e:6c:79:d6, not building metadata {{(pid=75226) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 01:51:05 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:51:05 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:51:05 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:51:05 user nova-compute[75226]: DEBUG nova.compute.manager [req-40a3ab3a-01d9-492e-92ef-182b1e237d44 req-8a53fafd-4c0b-4f2f-8b65-d74f5aabcf9f service nova] [instance: 19ff5421-3e67-4ac7-8021-bc4a4528d992] Received event network-vif-plugged-af3d3ad1-b936-4f8b-a16c-09f44988ba7b {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:51:05 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-40a3ab3a-01d9-492e-92ef-182b1e237d44 req-8a53fafd-4c0b-4f2f-8b65-d74f5aabcf9f service nova] Acquiring lock "19ff5421-3e67-4ac7-8021-bc4a4528d992-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:51:05 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-40a3ab3a-01d9-492e-92ef-182b1e237d44 req-8a53fafd-4c0b-4f2f-8b65-d74f5aabcf9f service nova] Lock "19ff5421-3e67-4ac7-8021-bc4a4528d992-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:51:05 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-40a3ab3a-01d9-492e-92ef-182b1e237d44 req-8a53fafd-4c0b-4f2f-8b65-d74f5aabcf9f service nova] Lock "19ff5421-3e67-4ac7-8021-bc4a4528d992-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:51:05 user nova-compute[75226]: DEBUG nova.compute.manager [req-40a3ab3a-01d9-492e-92ef-182b1e237d44 req-8a53fafd-4c0b-4f2f-8b65-d74f5aabcf9f service nova] [instance: 19ff5421-3e67-4ac7-8021-bc4a4528d992] No waiting events found dispatching network-vif-plugged-af3d3ad1-b936-4f8b-a16c-09f44988ba7b {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:51:05 user nova-compute[75226]: WARNING nova.compute.manager [req-40a3ab3a-01d9-492e-92ef-182b1e237d44 req-8a53fafd-4c0b-4f2f-8b65-d74f5aabcf9f service nova] [instance: 19ff5421-3e67-4ac7-8021-bc4a4528d992] Received unexpected event network-vif-plugged-af3d3ad1-b936-4f8b-a16c-09f44988ba7b for instance with vm_state building and task_state spawning.
Nov 17 01:51:05 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:51:05 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:51:05 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:51:07 user nova-compute[75226]: DEBUG nova.compute.manager [None req-aec5e1a2-504f-4d49-8d3e-a757fd5babab tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: 19ff5421-3e67-4ac7-8021-bc4a4528d992] Instance event wait completed in 0 seconds for  {{(pid=75226) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 17 01:51:07 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-aec5e1a2-504f-4d49-8d3e-a757fd5babab tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: 19ff5421-3e67-4ac7-8021-bc4a4528d992] Guest created on hypervisor {{(pid=75226) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 17 01:51:07 user nova-compute[75226]: INFO nova.virt.libvirt.driver [-] [instance: 19ff5421-3e67-4ac7-8021-bc4a4528d992] Instance spawned successfully.
Nov 17 01:51:07 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-aec5e1a2-504f-4d49-8d3e-a757fd5babab tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: 19ff5421-3e67-4ac7-8021-bc4a4528d992] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 17 01:51:07 user nova-compute[75226]: DEBUG nova.compute.manager [req-5b1a7c2b-7263-45f1-ba18-462571a2e636 req-dab8ca16-3f77-48b1-8c05-2f42d2513e88 service nova] [instance: 19ff5421-3e67-4ac7-8021-bc4a4528d992] Received event network-vif-plugged-af3d3ad1-b936-4f8b-a16c-09f44988ba7b {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:51:07 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-5b1a7c2b-7263-45f1-ba18-462571a2e636 req-dab8ca16-3f77-48b1-8c05-2f42d2513e88 service nova] Acquiring lock "19ff5421-3e67-4ac7-8021-bc4a4528d992-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:51:07 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-5b1a7c2b-7263-45f1-ba18-462571a2e636 req-dab8ca16-3f77-48b1-8c05-2f42d2513e88 service nova] Lock "19ff5421-3e67-4ac7-8021-bc4a4528d992-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:51:07 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-5b1a7c2b-7263-45f1-ba18-462571a2e636 req-dab8ca16-3f77-48b1-8c05-2f42d2513e88 service nova] Lock "19ff5421-3e67-4ac7-8021-bc4a4528d992-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:51:07 user nova-compute[75226]: DEBUG nova.compute.manager [req-5b1a7c2b-7263-45f1-ba18-462571a2e636 req-dab8ca16-3f77-48b1-8c05-2f42d2513e88 service nova] [instance: 19ff5421-3e67-4ac7-8021-bc4a4528d992] No waiting events found dispatching network-vif-plugged-af3d3ad1-b936-4f8b-a16c-09f44988ba7b {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:51:07 user nova-compute[75226]: WARNING nova.compute.manager [req-5b1a7c2b-7263-45f1-ba18-462571a2e636 req-dab8ca16-3f77-48b1-8c05-2f42d2513e88 service nova] [instance: 19ff5421-3e67-4ac7-8021-bc4a4528d992] Received unexpected event network-vif-plugged-af3d3ad1-b936-4f8b-a16c-09f44988ba7b for instance with vm_state building and task_state spawning.
Nov 17 01:51:07 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-aec5e1a2-504f-4d49-8d3e-a757fd5babab tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: 19ff5421-3e67-4ac7-8021-bc4a4528d992] Found default for hw_cdrom_bus of ide {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:51:07 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-aec5e1a2-504f-4d49-8d3e-a757fd5babab tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: 19ff5421-3e67-4ac7-8021-bc4a4528d992] Found default for hw_disk_bus of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:51:07 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-aec5e1a2-504f-4d49-8d3e-a757fd5babab tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: 19ff5421-3e67-4ac7-8021-bc4a4528d992] Found default for hw_input_bus of None {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:51:07 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-aec5e1a2-504f-4d49-8d3e-a757fd5babab tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: 19ff5421-3e67-4ac7-8021-bc4a4528d992] Found default for hw_pointer_model of None {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:51:07 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-aec5e1a2-504f-4d49-8d3e-a757fd5babab tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: 19ff5421-3e67-4ac7-8021-bc4a4528d992] Found default for hw_video_model of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:51:07 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-aec5e1a2-504f-4d49-8d3e-a757fd5babab tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: 19ff5421-3e67-4ac7-8021-bc4a4528d992] Found default for hw_vif_model of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:51:07 user nova-compute[75226]: INFO nova.compute.manager [None req-aec5e1a2-504f-4d49-8d3e-a757fd5babab tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: 19ff5421-3e67-4ac7-8021-bc4a4528d992] Took 5.91 seconds to spawn the instance on the hypervisor.
Nov 17 01:51:07 user nova-compute[75226]: DEBUG nova.compute.manager [None req-aec5e1a2-504f-4d49-8d3e-a757fd5babab tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: 19ff5421-3e67-4ac7-8021-bc4a4528d992] Checking state {{(pid=75226) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 01:51:07 user nova-compute[75226]: INFO nova.compute.manager [None req-aec5e1a2-504f-4d49-8d3e-a757fd5babab tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: 19ff5421-3e67-4ac7-8021-bc4a4528d992] Took 12.01 seconds to build instance.
Nov 17 01:51:07 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-aec5e1a2-504f-4d49-8d3e-a757fd5babab tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Lock "19ff5421-3e67-4ac7-8021-bc4a4528d992" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.135s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:51:08 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:51:09 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:51:13 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:51:14 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:51:14 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-924074a8-0a07-4619-a19d-bbaf35e8bc15 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Acquiring lock "4bb19560-6149-4c39-8596-3c4c11c4247d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:51:14 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-924074a8-0a07-4619-a19d-bbaf35e8bc15 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Lock "4bb19560-6149-4c39-8596-3c4c11c4247d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:51:14 user nova-compute[75226]: INFO nova.compute.manager [None req-924074a8-0a07-4619-a19d-bbaf35e8bc15 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] [instance: 4bb19560-6149-4c39-8596-3c4c11c4247d] Detaching volume e4a54f08-130d-4550-bc7e-62a965ae4c3f
Nov 17 01:51:14 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-fe4958d9-f72a-4907-a3ab-f15ad9fa445c tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Acquiring lock "4bb19560-6149-4c39-8596-3c4c11c4247d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:51:14 user nova-compute[75226]: INFO nova.virt.block_device [None req-924074a8-0a07-4619-a19d-bbaf35e8bc15 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] [instance: 4bb19560-6149-4c39-8596-3c4c11c4247d] Attempting to driver detach volume e4a54f08-130d-4550-bc7e-62a965ae4c3f from mountpoint /dev/vdb
Nov 17 01:51:14 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-924074a8-0a07-4619-a19d-bbaf35e8bc15 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Attempting to detach device vdb from instance 4bb19560-6149-4c39-8596-3c4c11c4247d from the persistent domain config. {{(pid=75226) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 17 01:51:14 user nova-compute[75226]: DEBUG nova.virt.libvirt.guest [None req-924074a8-0a07-4619-a19d-bbaf35e8bc15 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] detach device xml: <disk type="block" device="disk">
Nov 17 01:51:14 user nova-compute[75226]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 01:51:14 user nova-compute[75226]:   <source dev="/dev/sdb"/>
Nov 17 01:51:14 user nova-compute[75226]:   <target dev="vdb" bus="virtio"/>
Nov 17 01:51:14 user nova-compute[75226]:   <serial>e4a54f08-130d-4550-bc7e-62a965ae4c3f</serial>
Nov 17 01:51:14 user nova-compute[75226]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 17 01:51:14 user nova-compute[75226]: </disk>
Nov 17 01:51:14 user nova-compute[75226]:  {{(pid=75226) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 17 01:51:14 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-924074a8-0a07-4619-a19d-bbaf35e8bc15 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Successfully detached device vdb from instance 4bb19560-6149-4c39-8596-3c4c11c4247d from the persistent domain config.
Nov 17 01:51:14 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-924074a8-0a07-4619-a19d-bbaf35e8bc15 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4bb19560-6149-4c39-8596-3c4c11c4247d from the live domain config. {{(pid=75226) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 17 01:51:14 user nova-compute[75226]: DEBUG nova.virt.libvirt.guest [None req-924074a8-0a07-4619-a19d-bbaf35e8bc15 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] detach device xml: <disk type="block" device="disk">
Nov 17 01:51:14 user nova-compute[75226]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 01:51:14 user nova-compute[75226]:   <source dev="/dev/sdb"/>
Nov 17 01:51:14 user nova-compute[75226]:   <target dev="vdb" bus="virtio"/>
Nov 17 01:51:14 user nova-compute[75226]:   <serial>e4a54f08-130d-4550-bc7e-62a965ae4c3f</serial>
Nov 17 01:51:14 user nova-compute[75226]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 17 01:51:14 user nova-compute[75226]: </disk>
Nov 17 01:51:14 user nova-compute[75226]:  {{(pid=75226) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 17 01:51:15 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-d2464d50-644b-4120-80b2-620b06786def tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Acquiring lock "014533a1-a4c3-4c65-a121-f46486cc5998" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:51:15 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-d2464d50-644b-4120-80b2-620b06786def tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Lock "014533a1-a4c3-4c65-a121-f46486cc5998" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:51:15 user nova-compute[75226]: DEBUG nova.objects.instance [None req-d2464d50-644b-4120-80b2-620b06786def tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Lazy-loading 'flavor' on Instance uuid 014533a1-a4c3-4c65-a121-f46486cc5998 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:51:15 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-d2464d50-644b-4120-80b2-620b06786def tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Lock "014533a1-a4c3-4c65-a121-f46486cc5998" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:51:15 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-924074a8-0a07-4619-a19d-bbaf35e8bc15 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4bb19560-6149-4c39-8596-3c4c11c4247d {{(pid=75226) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 17 01:51:15 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-d2464d50-644b-4120-80b2-620b06786def tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Acquiring lock "014533a1-a4c3-4c65-a121-f46486cc5998" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:51:15 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-d2464d50-644b-4120-80b2-620b06786def tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Lock "014533a1-a4c3-4c65-a121-f46486cc5998" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:51:15 user nova-compute[75226]: INFO nova.compute.manager [None req-d2464d50-644b-4120-80b2-620b06786def tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] [instance: 014533a1-a4c3-4c65-a121-f46486cc5998] Attaching volume e5085893-4d9b-44fb-964e-b32da5fbf44d to /dev/vdb
Nov 17 01:51:15 user nova-compute[75226]: DEBUG os_brick.utils [None req-d2464d50-644b-4120-80b2-620b06786def tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:51:15 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:51:15 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:51:15 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[77a6d75b-1ee1-4ac2-95a7-9d4e0094ddee]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f62857db69\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:51:15 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:51:15 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:51:15 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[86155bd5-63df-4667-8056-27d9ad6b14a6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:51:15 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:51:15 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:51:15 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[b885f5c8-d502-45f5-b187-710dbf6a0360]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:51:15 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[417011eb-65e0-4ebd-a43d-a12eb73e7be6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:51:15 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-d2464d50-644b-4120-80b2-620b06786def tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Running cmd (subprocess): nvme version {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:51:15 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-d2464d50-644b-4120-80b2-620b06786def tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] 'nvme version' failed. Not Retrying. {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 01:51:15 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d2464d50-644b-4120-80b2-620b06786def tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] nvme not present on system {{(pid=75226) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 17 01:51:15 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:51:15 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 01:51:15 user nova-compute[75226]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 17 01:51:15 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7e304e4-9d75-4d50-a662-cdaab57dae67]: (4, '') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:51:15 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-d2464d50-644b-4120-80b2-620b06786def tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75226) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 17 01:51:15 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-d2464d50-644b-4120-80b2-620b06786def tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75226) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 17 01:51:15 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-d2464d50-644b-4120-80b2-620b06786def tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] LIGHTOS: no hostnqn found. {{(pid=75226) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 17 01:51:15 user nova-compute[75226]: DEBUG os_brick.utils [None req-d2464d50-644b-4120-80b2-620b06786def tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f62857db69', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:51:15 user nova-compute[75226]: DEBUG nova.virt.block_device [None req-d2464d50-644b-4120-80b2-620b06786def tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] [instance: 014533a1-a4c3-4c65-a121-f46486cc5998] Updating existing volume attachment record: b8d823f0-cbe4-40ae-949d-5704394dbb11 {{(pid=75226) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 17 01:51:16 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:51:16 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:51:16 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:51:16 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:51:16 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75226) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 17 01:51:17 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/014533a1-a4c3-4c65-a121-f46486cc5998/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:51:17 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/014533a1-a4c3-4c65-a121-f46486cc5998/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:51:17 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/014533a1-a4c3-4c65-a121-f46486cc5998/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:51:17 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/014533a1-a4c3-4c65-a121-f46486cc5998/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:51:17 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bb19560-6149-4c39-8596-3c4c11c4247d/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:51:17 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bb19560-6149-4c39-8596-3c4c11c4247d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:51:17 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bb19560-6149-4c39-8596-3c4c11c4247d/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:51:17 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bb19560-6149-4c39-8596-3c4c11c4247d/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:51:17 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75226) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 01:51:18 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:51:18 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:51:18 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Hypervisor/Node resource view: name=user free_ram=8685MB free_disk=24.922622680664062GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75226) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 17 01:51:18 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:51:18 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:51:18 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 014533a1-a4c3-4c65-a121-f46486cc5998 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:51:18 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 4bb19560-6149-4c39-8596-3c4c11c4247d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:51:18 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 19ff5421-3e67-4ac7-8021-bc4a4528d992 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:51:18 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75226) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 17 01:51:18 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75226) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 17 01:51:18 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:51:18 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:51:18 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Compute_service record updated for user:user {{(pid=75226) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 17 01:51:18 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.251s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:51:18 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:51:19 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:51:20 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d2464d50-644b-4120-80b2-620b06786def tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] [instance: 014533a1-a4c3-4c65-a121-f46486cc5998] Calling os-brick to attach iSCSI Volume {{(pid=75226) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 17 01:51:20 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2464d50-644b-4120-80b2-620b06786def tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc4cc36b490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e5085893-4d9b-44fb-964e-b32da5fbf44d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nqjWSUND', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:51:20 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-d2464d50-644b-4120-80b2-620b06786def tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:51:20 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-d2464d50-644b-4120-80b2-620b06786def tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:51:20 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-d2464d50-644b-4120-80b2-620b06786def tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:51:20 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-d2464d50-644b-4120-80b2-620b06786def tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:51:20 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-d2464d50-644b-4120-80b2-620b06786def tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e5085893-4d9b-44fb-964e-b32da5fbf44d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:51:20 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-d2464d50-644b-4120-80b2-620b06786def tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e5085893-4d9b-44fb-964e-b32da5fbf44d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:51:20 user nova-compute[75226]: INFO os_brick.initiator.connectors.iscsi [None req-d2464d50-644b-4120-80b2-620b06786def tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 17 01:51:20 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5085893-4d9b-44fb-964e-b32da5fbf44d -p 172.16.0.220:3260 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:51:20 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5085893-4d9b-44fb-964e-b32da5fbf44d -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:51:20 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[87461b74-c7dc-4015-abd9-297720c74dc9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:51:20 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2464d50-644b-4120-80b2-620b06786def tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 17 01:51:20 user nova-compute[75226]:  {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:51:20 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5085893-4d9b-44fb-964e-b32da5fbf44d -p 172.16.0.220:3260 --interface default --op new {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:51:20 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5085893-4d9b-44fb-964e-b32da5fbf44d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:51:20 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[3db9177e-43fb-4d57-b424-3aedb740c36d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e5085893-4d9b-44fb-964e-b32da5fbf44d] added\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:51:20 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2464d50-644b-4120-80b2-620b06786def tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e5085893-4d9b-44fb-964e-b32da5fbf44d] added
Nov 17 01:51:20 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:51:20 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5085893-4d9b-44fb-964e-b32da5fbf44d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:51:20 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5085893-4d9b-44fb-964e-b32da5fbf44d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:51:20 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ef0ae4e-c92c-4f57-8dde-ce51e306bdfe]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:51:20 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2464d50-644b-4120-80b2-620b06786def tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:51:20 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5085893-4d9b-44fb-964e-b32da5fbf44d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:51:20 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5085893-4d9b-44fb-964e-b32da5fbf44d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:51:20 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[0102ef05-f949-4d9b-b0af-c225ec0995e3]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:51:20 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2464d50-644b-4120-80b2-620b06786def tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:51:20 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5085893-4d9b-44fb-964e-b32da5fbf44d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nqjWSUND {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:51:20 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5085893-4d9b-44fb-964e-b32da5fbf44d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nqjWSUND" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:51:20 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f8ae5b0-1881-4b86-82c2-d0f473f4637c]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:51:20 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2464d50-644b-4120-80b2-620b06786def tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nqjWSUND'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:51:20 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5085893-4d9b-44fb-964e-b32da5fbf44d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:51:21 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5085893-4d9b-44fb-964e-b32da5fbf44d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:51:21 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e253421-441a-4433-8dd2-ea3362b68053]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:51:21 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2464d50-644b-4120-80b2-620b06786def tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:51:21 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:51:21 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:51:21 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ba9593b-9ee8-419c-b533-2c3aa1eeb303]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4a54f08-130d-4550-bc7e-62a965ae4c3f (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:875a05e9-5133-418e-a210-0b01076d92a8 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:51:21 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2464d50-644b-4120-80b2-620b06786def tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4a54f08-130d-4550-bc7e-62a965ae4c3f (non-flash)
Nov 17 01:51:21 user nova-compute[75226]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:875a05e9-5133-418e-a210-0b01076d92a8 (non-flash)
Nov 17 01:51:21 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:51:21 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2464d50-644b-4120-80b2-620b06786def tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4a54f08-130d-4550-bc7e-62a965ae4c3f (non-flash)
Nov 17 01:51:21 user nova-compute[75226]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:875a05e9-5133-418e-a210-0b01076d92a8 (non-flash)
Nov 17 01:51:21 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:51:21 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5085893-4d9b-44fb-964e-b32da5fbf44d -p 172.16.0.220:3260 --login {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:51:22 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5085893-4d9b-44fb-964e-b32da5fbf44d -p 172.16.0.220:3260 --login" returned: 0 in 1.059s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:51:22 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd63be98-ea20-4ace-a78d-a07ee3eb6f43]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e5085893-4d9b-44fb-964e-b32da5fbf44d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e5085893-4d9b-44fb-964e-b32da5fbf44d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:51:22 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2464d50-644b-4120-80b2-620b06786def tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e5085893-4d9b-44fb-964e-b32da5fbf44d, portal: 172.16.0.220,3260]
Nov 17 01:51:22 user nova-compute[75226]: Login to [iface: default, target: iqn.2010-10.org.openstack:e5085893-4d9b-44fb-964e-b32da5fbf44d, portal: 172.16.0.220,3260] successful.
Nov 17 01:51:22 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:51:22 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5085893-4d9b-44fb-964e-b32da5fbf44d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:51:22 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5085893-4d9b-44fb-964e-b32da5fbf44d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:51:22 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a633ee9-ee26-409e-a031-8378e0c06f58]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:51:22 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2464d50-644b-4120-80b2-620b06786def tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:51:22 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:51:22 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:51:22 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[2247bf47-ceee-4557-ac69-53fcd9d5cd3e]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4a54f08-130d-4550-bc7e-62a965ae4c3f (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:875a05e9-5133-418e-a210-0b01076d92a8 (non-flash)\ntcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5085893-4d9b-44fb-964e-b32da5fbf44d (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:51:22 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2464d50-644b-4120-80b2-620b06786def tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4a54f08-130d-4550-bc7e-62a965ae4c3f (non-flash)
Nov 17 01:51:22 user nova-compute[75226]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:875a05e9-5133-418e-a210-0b01076d92a8 (non-flash)
Nov 17 01:51:22 user nova-compute[75226]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5085893-4d9b-44fb-964e-b32da5fbf44d (non-flash)
Nov 17 01:51:22 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:51:22 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2464d50-644b-4120-80b2-620b06786def tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4a54f08-130d-4550-bc7e-62a965ae4c3f (non-flash)
Nov 17 01:51:22 user nova-compute[75226]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:875a05e9-5133-418e-a210-0b01076d92a8 (non-flash)
Nov 17 01:51:22 user nova-compute[75226]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5085893-4d9b-44fb-964e-b32da5fbf44d (non-flash)
Nov 17 01:51:22 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:51:22 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-d2464d50-644b-4120-80b2-620b06786def tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e5085893-4d9b-44fb-964e-b32da5fbf44d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.267s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:51:22 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2464d50-644b-4120-80b2-620b06786def tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Connected to 172.16.0.220:3260 {{(pid=75226) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 17 01:51:22 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-d2464d50-644b-4120-80b2-620b06786def tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] HCTL ('35', '-', '-', 0) found on session 61 with lun 0 {{(pid=75226) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 17 01:51:22 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-d2464d50-644b-4120-80b2-620b06786def tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75226) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 17 01:51:22 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:51:22 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:51:22 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2889f15-10f6-4147-93ff-cfd68bd18551]: (4, ('- - 0', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:51:22 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-d2464d50-644b-4120-80b2-620b06786def tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Searching for a device in session 61 and hctl ['35', '*', '*', 0] yield: None {{(pid=75226) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 01:51:23 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-d2464d50-644b-4120-80b2-620b06786def tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Searching for a device in session 61 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75226) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 01:51:23 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2464d50-644b-4120-80b2-620b06786def tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:e5085893-4d9b-44fb-964e-b32da5fbf44d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nqjWSUND', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75226) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 17 01:51:23 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-d2464d50-644b-4120-80b2-620b06786def tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.297s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:51:23 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2464d50-644b-4120-80b2-620b06786def tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] <== connect_volume: return (2300ms) {'type': 'block', 'scsi_wwn': '23835653332333439', 'path': '/dev/sdd'} {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:51:23 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d2464d50-644b-4120-80b2-620b06786def tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] [instance: 014533a1-a4c3-4c65-a121-f46486cc5998] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23835653332333439', 'path': '/dev/sdd'} {{(pid=75226) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 17 01:51:23 user nova-compute[75226]: DEBUG nova.objects.instance [None req-d2464d50-644b-4120-80b2-620b06786def tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Lazy-loading 'flavor' on Instance uuid 014533a1-a4c3-4c65-a121-f46486cc5998 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:51:23 user nova-compute[75226]: DEBUG nova.virt.libvirt.guest [None req-d2464d50-644b-4120-80b2-620b06786def tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] attach device xml: <disk type="block" device="disk">
Nov 17 01:51:23 user nova-compute[75226]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 01:51:23 user nova-compute[75226]:   <source dev="/dev/sdd"/>
Nov 17 01:51:23 user nova-compute[75226]:   <target dev="vdb" bus="virtio"/>
Nov 17 01:51:23 user nova-compute[75226]:   <serial>e5085893-4d9b-44fb-964e-b32da5fbf44d</serial>
Nov 17 01:51:23 user nova-compute[75226]: </disk>
Nov 17 01:51:23 user nova-compute[75226]:  {{(pid=75226) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 17 01:51:23 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-d2464d50-644b-4120-80b2-620b06786def tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] No BDM found with device name vda, not building metadata. {{(pid=75226) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 01:51:23 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-d2464d50-644b-4120-80b2-620b06786def tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75226) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 01:51:23 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-d2464d50-644b-4120-80b2-620b06786def tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] No VIF found with MAC fa:16:3e:35:6c:13, not building metadata {{(pid=75226) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 01:51:23 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:51:23 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-d2464d50-644b-4120-80b2-620b06786def tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Lock "014533a1-a4c3-4c65-a121-f46486cc5998" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.528s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:51:24 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:51:25 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:51:25 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:51:26 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-6644cbf8-5ce4-4341-a92c-405cc1285d34 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Acquiring lock "014533a1-a4c3-4c65-a121-f46486cc5998" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:51:26 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-6644cbf8-5ce4-4341-a92c-405cc1285d34 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Lock "014533a1-a4c3-4c65-a121-f46486cc5998" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:51:26 user nova-compute[75226]: INFO nova.compute.manager [None req-6644cbf8-5ce4-4341-a92c-405cc1285d34 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] [instance: 014533a1-a4c3-4c65-a121-f46486cc5998] Detaching volume e5085893-4d9b-44fb-964e-b32da5fbf44d
Nov 17 01:51:26 user nova-compute[75226]: INFO nova.virt.block_device [None req-6644cbf8-5ce4-4341-a92c-405cc1285d34 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] [instance: 014533a1-a4c3-4c65-a121-f46486cc5998] Attempting to driver detach volume e5085893-4d9b-44fb-964e-b32da5fbf44d from mountpoint /dev/vdb
Nov 17 01:51:26 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-6644cbf8-5ce4-4341-a92c-405cc1285d34 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Attempting to detach device vdb from instance 014533a1-a4c3-4c65-a121-f46486cc5998 from the persistent domain config. {{(pid=75226) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 17 01:51:26 user nova-compute[75226]: DEBUG nova.virt.libvirt.guest [None req-6644cbf8-5ce4-4341-a92c-405cc1285d34 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] detach device xml: <disk type="block" device="disk">
Nov 17 01:51:26 user nova-compute[75226]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 01:51:26 user nova-compute[75226]:   <source dev="/dev/sdd"/>
Nov 17 01:51:26 user nova-compute[75226]:   <target dev="vdb" bus="virtio"/>
Nov 17 01:51:26 user nova-compute[75226]:   <serial>e5085893-4d9b-44fb-964e-b32da5fbf44d</serial>
Nov 17 01:51:26 user nova-compute[75226]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 17 01:51:26 user nova-compute[75226]: </disk>
Nov 17 01:51:26 user nova-compute[75226]:  {{(pid=75226) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 17 01:51:26 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:51:26 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-6644cbf8-5ce4-4341-a92c-405cc1285d34 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Successfully detached device vdb from instance 014533a1-a4c3-4c65-a121-f46486cc5998 from the persistent domain config.
Nov 17 01:51:26 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-6644cbf8-5ce4-4341-a92c-405cc1285d34 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 014533a1-a4c3-4c65-a121-f46486cc5998 from the live domain config. {{(pid=75226) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 17 01:51:26 user nova-compute[75226]: DEBUG nova.virt.libvirt.guest [None req-6644cbf8-5ce4-4341-a92c-405cc1285d34 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] detach device xml: <disk type="block" device="disk">
Nov 17 01:51:26 user nova-compute[75226]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 01:51:26 user nova-compute[75226]:   <source dev="/dev/sdd"/>
Nov 17 01:51:26 user nova-compute[75226]:   <target dev="vdb" bus="virtio"/>
Nov 17 01:51:26 user nova-compute[75226]:   <serial>e5085893-4d9b-44fb-964e-b32da5fbf44d</serial>
Nov 17 01:51:26 user nova-compute[75226]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 17 01:51:26 user nova-compute[75226]: </disk>
Nov 17 01:51:26 user nova-compute[75226]:  {{(pid=75226) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 17 01:51:27 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-6644cbf8-5ce4-4341-a92c-405cc1285d34 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 014533a1-a4c3-4c65-a121-f46486cc5998 {{(pid=75226) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 17 01:51:28 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:51:29 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:51:29 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:51:29 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75226) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 17 01:51:31 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:51:32 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:51:32 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:51:32 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Starting heal instance info cache {{(pid=75226) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 17 01:51:32 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] [instance: 4bb19560-6149-4c39-8596-3c4c11c4247d] Skipping network cache update for instance because it is being deleted. {{(pid=75226) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9971}}
Nov 17 01:51:32 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Didn't find any instances for network info cache update. {{(pid=75226) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 17 01:51:33 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:51:33 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:51:34 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:51:35 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-924074a8-0a07-4619-a19d-bbaf35e8bc15 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 4bb19560-6149-4c39-8596-3c4c11c4247d is timed out.
Nov 17 01:51:35 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-924074a8-0a07-4619-a19d-bbaf35e8bc15 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Successfully detached device vdb from instance 4bb19560-6149-4c39-8596-3c4c11c4247d from the live domain config.
Nov 17 01:51:35 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-924074a8-0a07-4619-a19d-bbaf35e8bc15 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] [instance: 4bb19560-6149-4c39-8596-3c4c11c4247d] calling os-brick to detach iSCSI Volume {{(pid=75226) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 17 01:51:35 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-924074a8-0a07-4619-a19d-bbaf35e8bc15 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc4cc36b490>, {'target_iqn': 'iqn.2010-10.org.openstack:e4a54f08-130d-4550-bc7e-62a965ae4c3f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MtkENYwG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:51:35 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-924074a8-0a07-4619-a19d-bbaf35e8bc15 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:51:35 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-924074a8-0a07-4619-a19d-bbaf35e8bc15 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:51:35 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-924074a8-0a07-4619-a19d-bbaf35e8bc15 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:51:35 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:51:35 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:51:35 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7c42505-80d3-4fe2-b37d-0f1621d5ddd8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e5085893-4d9b-44fb-964e-b32da5fbf44d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e4a54f08-130d-4550-bc7e-62a965ae4c3f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:875a05e9-5133-418e-a210-0b01076d92a8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:51:35 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-924074a8-0a07-4619-a19d-bbaf35e8bc15 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 17 01:51:35 user nova-compute[75226]: No targets found.
Nov 17 01:51:35 user nova-compute[75226]: iSNS:
Nov 17 01:51:35 user nova-compute[75226]: No targets found.
Nov 17 01:51:35 user nova-compute[75226]: STATIC:
Nov 17 01:51:35 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:e5085893-4d9b-44fb-964e-b32da5fbf44d
Nov 17 01:51:35 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:51:35 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:51:35 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:e4a54f08-130d-4550-bc7e-62a965ae4c3f
Nov 17 01:51:35 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:51:35 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:51:35 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:875a05e9-5133-418e-a210-0b01076d92a8
Nov 17 01:51:35 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:51:35 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:51:35 user nova-compute[75226]: FIRMWARE:
Nov 17 01:51:35 user nova-compute[75226]: No targets found.
Nov 17 01:51:35 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:51:35 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-924074a8-0a07-4619-a19d-bbaf35e8bc15 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 17 01:51:35 user nova-compute[75226]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 17 01:51:35 user nova-compute[75226]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75226) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 17 01:51:35 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-924074a8-0a07-4619-a19d-bbaf35e8bc15 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e4a54f08-130d-4550-bc7e-62a965ae4c3f', 0)] {{(pid=75226) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 17 01:51:35 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:51:35 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:51:35 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc3398cd-fe9f-4a37-a5e8-aae47f386a93]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:875a05e9-5133-418e-a210-0b01076d92a8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e4a54f08-130d-4550-bc7e-62a965ae4c3f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5085893-4d9b-44fb-964e-b32da5fbf44d\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:51:35 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:51:35 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:51:35 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[ead584c1-4db5-44f2-a10a-4cda325824d6]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4a54f08-130d-4550-bc7e-62a965ae4c3f (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:875a05e9-5133-418e-a210-0b01076d92a8 (non-flash)\ntcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5085893-4d9b-44fb-964e-b32da5fbf44d (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:51:35 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-924074a8-0a07-4619-a19d-bbaf35e8bc15 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4a54f08-130d-4550-bc7e-62a965ae4c3f (non-flash)
Nov 17 01:51:35 user nova-compute[75226]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:875a05e9-5133-418e-a210-0b01076d92a8 (non-flash)
Nov 17 01:51:35 user nova-compute[75226]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5085893-4d9b-44fb-964e-b32da5fbf44d (non-flash)
Nov 17 01:51:35 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:51:35 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-924074a8-0a07-4619-a19d-bbaf35e8bc15 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4a54f08-130d-4550-bc7e-62a965ae4c3f (non-flash)
Nov 17 01:51:35 user nova-compute[75226]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:875a05e9-5133-418e-a210-0b01076d92a8 (non-flash)
Nov 17 01:51:35 user nova-compute[75226]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5085893-4d9b-44fb-964e-b32da5fbf44d (non-flash)
Nov 17 01:51:35 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:51:35 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-924074a8-0a07-4619-a19d-bbaf35e8bc15 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc4cc36c940>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e4a54f08-130d-4550-bc7e-62a965ae4c3f'): ({'sdb'}, set())}) {{(pid=75226) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 17 01:51:35 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-924074a8-0a07-4619-a19d-bbaf35e8bc15 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Removing single pathed devices sdb {{(pid=75226) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 17 01:51:35 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:51:35 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:51:35 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[46033e1c-9c3c-4728-819f-8ab55b4a6b3c]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:51:35 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:51:35 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:51:35 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[2954d0b0-3eae-4d2f-b871-fc1aecb4d3d4]: (4, ('ok\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:51:35 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-924074a8-0a07-4619-a19d-bbaf35e8bc15 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Flushing IO for device /dev/sdb {{(pid=75226) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 17 01:51:35 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:51:35 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:51:35 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[7daebbea-a743-47cf-a8b5-2047c4187982]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:51:35 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-924074a8-0a07-4619-a19d-bbaf35e8bc15 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75226) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 17 01:51:35 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:51:35 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.032s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:51:35 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6e96b53-32d9-4391-89db-7cae4b5b015d]: (4, ('1', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:51:35 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-924074a8-0a07-4619-a19d-bbaf35e8bc15 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75226) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 17 01:51:35 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-924074a8-0a07-4619-a19d-bbaf35e8bc15 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] SCSI volumes sdb have been removed. {{(pid=75226) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 17 01:51:35 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-924074a8-0a07-4619-a19d-bbaf35e8bc15 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e4a54f08-130d-4550-bc7e-62a965ae4c3f')] {{(pid=75226) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 17 01:51:35 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4a54f08-130d-4550-bc7e-62a965ae4c3f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:51:35 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4a54f08-130d-4550-bc7e-62a965ae4c3f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:51:35 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[28edaf7f-1f8a-4d97-ab8f-df69a549de07]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:51:35 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-924074a8-0a07-4619-a19d-bbaf35e8bc15 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:51:35 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4a54f08-130d-4550-bc7e-62a965ae4c3f -p 172.16.0.220:3260 --logout {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:51:35 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4a54f08-130d-4550-bc7e-62a965ae4c3f -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:51:35 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[586c8e9b-b5ed-4eda-a481-ea87b1647449]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:e4a54f08-130d-4550-bc7e-62a965ae4c3f, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:e4a54f08-130d-4550-bc7e-62a965ae4c3f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:51:35 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-924074a8-0a07-4619-a19d-bbaf35e8bc15 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:e4a54f08-130d-4550-bc7e-62a965ae4c3f, portal: 172.16.0.220,3260]
Nov 17 01:51:35 user nova-compute[75226]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:e4a54f08-130d-4550-bc7e-62a965ae4c3f, portal: 172.16.0.220,3260] successful.
Nov 17 01:51:35 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:51:35 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4a54f08-130d-4550-bc7e-62a965ae4c3f -p 172.16.0.220:3260 --op delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:51:35 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4a54f08-130d-4550-bc7e-62a965ae4c3f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:51:35 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9f6d5b8-2a05-4591-9e18-c1b9b7f59f1e]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:51:35 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-924074a8-0a07-4619-a19d-bbaf35e8bc15 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:51:35 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-924074a8-0a07-4619-a19d-bbaf35e8bc15 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.322s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:51:35 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-924074a8-0a07-4619-a19d-bbaf35e8bc15 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] <== disconnect_volume: return (322ms) None {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:51:35 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-924074a8-0a07-4619-a19d-bbaf35e8bc15 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] [instance: 4bb19560-6149-4c39-8596-3c4c11c4247d] Disconnected iSCSI Volume {{(pid=75226) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 17 01:51:36 user nova-compute[75226]: DEBUG nova.objects.instance [None req-924074a8-0a07-4619-a19d-bbaf35e8bc15 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Lazy-loading 'flavor' on Instance uuid 4bb19560-6149-4c39-8596-3c4c11c4247d {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:51:36 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-924074a8-0a07-4619-a19d-bbaf35e8bc15 tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Lock "4bb19560-6149-4c39-8596-3c4c11c4247d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.672s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:51:36 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-fe4958d9-f72a-4907-a3ab-f15ad9fa445c tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Lock "4bb19560-6149-4c39-8596-3c4c11c4247d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.623s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:51:36 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-fe4958d9-f72a-4907-a3ab-f15ad9fa445c tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Acquiring lock "4bb19560-6149-4c39-8596-3c4c11c4247d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:51:36 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-fe4958d9-f72a-4907-a3ab-f15ad9fa445c tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Lock "4bb19560-6149-4c39-8596-3c4c11c4247d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:51:36 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-fe4958d9-f72a-4907-a3ab-f15ad9fa445c tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Lock "4bb19560-6149-4c39-8596-3c4c11c4247d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:51:36 user nova-compute[75226]: INFO nova.compute.manager [None req-fe4958d9-f72a-4907-a3ab-f15ad9fa445c tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] [instance: 4bb19560-6149-4c39-8596-3c4c11c4247d] Terminating instance
Nov 17 01:51:36 user nova-compute[75226]: DEBUG nova.compute.manager [None req-fe4958d9-f72a-4907-a3ab-f15ad9fa445c tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] [instance: 4bb19560-6149-4c39-8596-3c4c11c4247d] Start destroying the instance on the hypervisor. {{(pid=75226) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 17 01:51:36 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:51:36 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:51:36 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:51:36 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:51:36 user nova-compute[75226]: DEBUG nova.compute.manager [req-6fa0b7a0-68cc-4a37-b59c-46d834b9fc42 req-d6a06097-3bf4-43f3-bb0f-346e63b25f44 service nova] [instance: 4bb19560-6149-4c39-8596-3c4c11c4247d] Received event network-vif-unplugged-8a3e1ef1-37aa-4d8f-9484-143213c68bf1 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:51:36 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-6fa0b7a0-68cc-4a37-b59c-46d834b9fc42 req-d6a06097-3bf4-43f3-bb0f-346e63b25f44 service nova] Acquiring lock "4bb19560-6149-4c39-8596-3c4c11c4247d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:51:36 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-6fa0b7a0-68cc-4a37-b59c-46d834b9fc42 req-d6a06097-3bf4-43f3-bb0f-346e63b25f44 service nova] Lock "4bb19560-6149-4c39-8596-3c4c11c4247d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:51:36 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-6fa0b7a0-68cc-4a37-b59c-46d834b9fc42 req-d6a06097-3bf4-43f3-bb0f-346e63b25f44 service nova] Lock "4bb19560-6149-4c39-8596-3c4c11c4247d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:51:36 user nova-compute[75226]: DEBUG nova.compute.manager [req-6fa0b7a0-68cc-4a37-b59c-46d834b9fc42 req-d6a06097-3bf4-43f3-bb0f-346e63b25f44 service nova] [instance: 4bb19560-6149-4c39-8596-3c4c11c4247d] No waiting events found dispatching network-vif-unplugged-8a3e1ef1-37aa-4d8f-9484-143213c68bf1 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:51:36 user nova-compute[75226]: DEBUG nova.compute.manager [req-6fa0b7a0-68cc-4a37-b59c-46d834b9fc42 req-d6a06097-3bf4-43f3-bb0f-346e63b25f44 service nova] [instance: 4bb19560-6149-4c39-8596-3c4c11c4247d] Received event network-vif-unplugged-8a3e1ef1-37aa-4d8f-9484-143213c68bf1 for instance with task_state deleting. {{(pid=75226) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 17 01:51:36 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:51:37 user nova-compute[75226]: INFO nova.virt.libvirt.driver [-] [instance: 4bb19560-6149-4c39-8596-3c4c11c4247d] Instance destroyed successfully.
Nov 17 01:51:37 user nova-compute[75226]: DEBUG nova.objects.instance [None req-fe4958d9-f72a-4907-a3ab-f15ad9fa445c tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Lazy-loading 'resources' on Instance uuid 4bb19560-6149-4c39-8596-3c4c11c4247d {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:51:37 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-fe4958d9-f72a-4907-a3ab-f15ad9fa445c tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:49:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1266956347',display_name='tempest-VolumesSnapshotTestJSON-instance-1266956347',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1266956347',id=49,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKgO3p7F+R/bYiQkE6wuxyJuaD0kp/IXfGArsTHYwP6PM3DTC7G9o+hu35TmU+6EYNJmCCIdKDhdQ9SjKQbQgYgr8LtZgwqL/h4upRuf+EL0Dl+mTCcm1MKOtuixJZn7zQ==',key_name='tempest-keypair-582749377',keypairs=<?>,launch_index=0,launched_at=2023-11-17T01:49:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='acc65d32b52442aea872bf9f6025c4e4',ramdisk_id='',reservation_id='r-nbuyxhm7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1912813406',owner_user_name='tempest-VolumesSnapshotTestJSON-1912813406-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T01:49:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='664817f1ee104181aa271179f9d8e0e1',uuid=4bb19560-6149-4c39-8596-3c4c11c4247d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8a3e1ef1-37aa-4d8f-9484-143213c68bf1", "address": "fa:16:3e:16:03:37", "network": {"id": "2d06b621-84a6-48dc-be05-92b6724810e3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1055056582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "acc65d32b52442aea872bf9f6025c4e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a3e1ef1-37", "ovs_interfaceid": "8a3e1ef1-37aa-4d8f-9484-143213c68bf1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 17 01:51:37 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-fe4958d9-f72a-4907-a3ab-f15ad9fa445c tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Converting VIF {"id": "8a3e1ef1-37aa-4d8f-9484-143213c68bf1", "address": "fa:16:3e:16:03:37", "network": {"id": "2d06b621-84a6-48dc-be05-92b6724810e3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1055056582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "acc65d32b52442aea872bf9f6025c4e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a3e1ef1-37", "ovs_interfaceid": "8a3e1ef1-37aa-4d8f-9484-143213c68bf1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:51:37 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-fe4958d9-f72a-4907-a3ab-f15ad9fa445c tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:16:03:37,bridge_name='br-int',has_traffic_filtering=True,id=8a3e1ef1-37aa-4d8f-9484-143213c68bf1,network=Network(2d06b621-84a6-48dc-be05-92b6724810e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a3e1ef1-37') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:51:37 user nova-compute[75226]: DEBUG os_vif [None req-fe4958d9-f72a-4907-a3ab-f15ad9fa445c tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:16:03:37,bridge_name='br-int',has_traffic_filtering=True,id=8a3e1ef1-37aa-4d8f-9484-143213c68bf1,network=Network(2d06b621-84a6-48dc-be05-92b6724810e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a3e1ef1-37') {{(pid=75226) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 17 01:51:37 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:51:37 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8a3e1ef1-37, bridge=br-int, if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:51:37 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:51:37 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:51:37 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:51:37 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=85aa4711-9eb2-4b29-8ff7-a3b50ca8ed10) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:51:37 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:51:37 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:51:37 user nova-compute[75226]: INFO os_vif [None req-fe4958d9-f72a-4907-a3ab-f15ad9fa445c tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:16:03:37,bridge_name='br-int',has_traffic_filtering=True,id=8a3e1ef1-37aa-4d8f-9484-143213c68bf1,network=Network(2d06b621-84a6-48dc-be05-92b6724810e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a3e1ef1-37')
Nov 17 01:51:37 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe4958d9-f72a-4907-a3ab-f15ad9fa445c tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] [instance: 4bb19560-6149-4c39-8596-3c4c11c4247d] calling os-brick to detach iSCSI Volume {{(pid=75226) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 17 01:51:37 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe4958d9-f72a-4907-a3ab-f15ad9fa445c tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc4cc36b490>, {'target_iqn': 'iqn.2010-10.org.openstack:e4a54f08-130d-4550-bc7e-62a965ae4c3f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MtkENYwG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:51:37 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-fe4958d9-f72a-4907-a3ab-f15ad9fa445c tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:51:37 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-fe4958d9-f72a-4907-a3ab-f15ad9fa445c tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:51:37 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-fe4958d9-f72a-4907-a3ab-f15ad9fa445c tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:51:37 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:51:37 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:51:37 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca040ddb-dcd1-4118-83aa-4e6afcbb7d95]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e5085893-4d9b-44fb-964e-b32da5fbf44d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:875a05e9-5133-418e-a210-0b01076d92a8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:51:37 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe4958d9-f72a-4907-a3ab-f15ad9fa445c tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 17 01:51:37 user nova-compute[75226]: No targets found.
Nov 17 01:51:37 user nova-compute[75226]: iSNS:
Nov 17 01:51:37 user nova-compute[75226]: No targets found.
Nov 17 01:51:37 user nova-compute[75226]: STATIC:
Nov 17 01:51:37 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:e5085893-4d9b-44fb-964e-b32da5fbf44d
Nov 17 01:51:37 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:51:37 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:51:37 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:875a05e9-5133-418e-a210-0b01076d92a8
Nov 17 01:51:37 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:51:37 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:51:37 user nova-compute[75226]: FIRMWARE:
Nov 17 01:51:37 user nova-compute[75226]: No targets found.
Nov 17 01:51:37 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:51:37 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe4958d9-f72a-4907-a3ab-f15ad9fa445c tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 17 01:51:37 user nova-compute[75226]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 17 01:51:37 user nova-compute[75226]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75226) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 17 01:51:37 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe4958d9-f72a-4907-a3ab-f15ad9fa445c tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e4a54f08-130d-4550-bc7e-62a965ae4c3f', 0)] {{(pid=75226) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 17 01:51:37 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:51:37 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:51:37 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[89dac8a5-e316-4d92-98dd-577c2123d6da]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:875a05e9-5133-418e-a210-0b01076d92a8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5085893-4d9b-44fb-964e-b32da5fbf44d\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:51:37 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:51:37 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:51:37 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8f76da4-5845-4e8b-90d1-a72a808f3efe]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:875a05e9-5133-418e-a210-0b01076d92a8 (non-flash)\ntcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5085893-4d9b-44fb-964e-b32da5fbf44d (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:51:37 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe4958d9-f72a-4907-a3ab-f15ad9fa445c tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:875a05e9-5133-418e-a210-0b01076d92a8 (non-flash)
Nov 17 01:51:37 user nova-compute[75226]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5085893-4d9b-44fb-964e-b32da5fbf44d (non-flash)
Nov 17 01:51:37 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:51:37 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe4958d9-f72a-4907-a3ab-f15ad9fa445c tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:875a05e9-5133-418e-a210-0b01076d92a8 (non-flash)
Nov 17 01:51:37 user nova-compute[75226]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5085893-4d9b-44fb-964e-b32da5fbf44d (non-flash)
Nov 17 01:51:37 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:51:37 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe4958d9-f72a-4907-a3ab-f15ad9fa445c tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc4cc36c5e0>, {}) {{(pid=75226) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 17 01:51:37 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe4958d9-f72a-4907-a3ab-f15ad9fa445c tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Disconnecting from: [] {{(pid=75226) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 17 01:51:37 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-fe4958d9-f72a-4907-a3ab-f15ad9fa445c tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.079s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:51:37 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe4958d9-f72a-4907-a3ab-f15ad9fa445c tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] <== disconnect_volume: return (81ms) None {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:51:37 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe4958d9-f72a-4907-a3ab-f15ad9fa445c tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] [instance: 4bb19560-6149-4c39-8596-3c4c11c4247d] Disconnected iSCSI Volume {{(pid=75226) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 17 01:51:37 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-fe4958d9-f72a-4907-a3ab-f15ad9fa445c tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] [instance: 4bb19560-6149-4c39-8596-3c4c11c4247d] Deleting instance files /opt/stack/data/nova/instances/4bb19560-6149-4c39-8596-3c4c11c4247d_del
Nov 17 01:51:37 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-fe4958d9-f72a-4907-a3ab-f15ad9fa445c tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] [instance: 4bb19560-6149-4c39-8596-3c4c11c4247d] Deletion of /opt/stack/data/nova/instances/4bb19560-6149-4c39-8596-3c4c11c4247d_del complete
Nov 17 01:51:37 user nova-compute[75226]: INFO nova.compute.manager [None req-fe4958d9-f72a-4907-a3ab-f15ad9fa445c tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] [instance: 4bb19560-6149-4c39-8596-3c4c11c4247d] Took 0.97 seconds to destroy the instance on the hypervisor.
Nov 17 01:51:37 user nova-compute[75226]: DEBUG oslo.service.loopingcall [None req-fe4958d9-f72a-4907-a3ab-f15ad9fa445c tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75226) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 17 01:51:37 user nova-compute[75226]: DEBUG nova.compute.manager [-] [instance: 4bb19560-6149-4c39-8596-3c4c11c4247d] Deallocating network for instance {{(pid=75226) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 17 01:51:37 user nova-compute[75226]: DEBUG nova.network.neutron [-] [instance: 4bb19560-6149-4c39-8596-3c4c11c4247d] deallocate_for_instance() {{(pid=75226) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 17 01:51:38 user nova-compute[75226]: DEBUG nova.network.neutron [-] [instance: 4bb19560-6149-4c39-8596-3c4c11c4247d] Updating instance_info_cache with network_info: [] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:51:38 user nova-compute[75226]: INFO nova.compute.manager [-] [instance: 4bb19560-6149-4c39-8596-3c4c11c4247d] Took 0.79 seconds to deallocate network for instance.
Nov 17 01:51:38 user nova-compute[75226]: DEBUG nova.compute.manager [req-3c5298a4-dc9c-4286-b77f-eddb351e3a1e req-84a78c67-0084-4917-983f-a70f13a67342 service nova] [instance: 4bb19560-6149-4c39-8596-3c4c11c4247d] Received event network-vif-deleted-8a3e1ef1-37aa-4d8f-9484-143213c68bf1 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:51:38 user nova-compute[75226]: WARNING nova.volume.cinder [None req-fe4958d9-f72a-4907-a3ab-f15ad9fa445c tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Attachment 189187da-27ea-4a2d-8dca-b05371d8363f does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 189187da-27ea-4a2d-8dca-b05371d8363f. (HTTP 404) (Request-ID: req-c9e943d0-0027-410a-9e3d-d5095afb4e04)
Nov 17 01:51:38 user nova-compute[75226]: INFO nova.compute.manager [None req-fe4958d9-f72a-4907-a3ab-f15ad9fa445c tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] [instance: 4bb19560-6149-4c39-8596-3c4c11c4247d] Took 0.03 seconds to detach 1 volumes for instance.
Nov 17 01:51:38 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-fe4958d9-f72a-4907-a3ab-f15ad9fa445c tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:51:38 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-fe4958d9-f72a-4907-a3ab-f15ad9fa445c tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:51:38 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-fe4958d9-f72a-4907-a3ab-f15ad9fa445c tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:51:38 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-fe4958d9-f72a-4907-a3ab-f15ad9fa445c tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:51:38 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-fe4958d9-f72a-4907-a3ab-f15ad9fa445c tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.180s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:51:38 user nova-compute[75226]: INFO nova.scheduler.client.report [None req-fe4958d9-f72a-4907-a3ab-f15ad9fa445c tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Deleted allocations for instance 4bb19560-6149-4c39-8596-3c4c11c4247d
Nov 17 01:51:38 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-fe4958d9-f72a-4907-a3ab-f15ad9fa445c tempest-VolumesSnapshotTestJSON-1912813406 tempest-VolumesSnapshotTestJSON-1912813406-project-member] Lock "4bb19560-6149-4c39-8596-3c4c11c4247d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.149s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:51:38 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:51:38 user nova-compute[75226]: DEBUG nova.compute.manager [req-2a408136-533c-40e9-b338-2ac2e81042d4 req-9eb7f590-8c60-48ae-adc2-5aa165aca757 service nova] [instance: 4bb19560-6149-4c39-8596-3c4c11c4247d] Received event network-vif-plugged-8a3e1ef1-37aa-4d8f-9484-143213c68bf1 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:51:38 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-2a408136-533c-40e9-b338-2ac2e81042d4 req-9eb7f590-8c60-48ae-adc2-5aa165aca757 service nova] Acquiring lock "4bb19560-6149-4c39-8596-3c4c11c4247d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:51:38 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-2a408136-533c-40e9-b338-2ac2e81042d4 req-9eb7f590-8c60-48ae-adc2-5aa165aca757 service nova] Lock "4bb19560-6149-4c39-8596-3c4c11c4247d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:51:38 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-2a408136-533c-40e9-b338-2ac2e81042d4 req-9eb7f590-8c60-48ae-adc2-5aa165aca757 service nova] Lock "4bb19560-6149-4c39-8596-3c4c11c4247d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:51:38 user nova-compute[75226]: DEBUG nova.compute.manager [req-2a408136-533c-40e9-b338-2ac2e81042d4 req-9eb7f590-8c60-48ae-adc2-5aa165aca757 service nova] [instance: 4bb19560-6149-4c39-8596-3c4c11c4247d] No waiting events found dispatching network-vif-plugged-8a3e1ef1-37aa-4d8f-9484-143213c68bf1 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:51:38 user nova-compute[75226]: WARNING nova.compute.manager [req-2a408136-533c-40e9-b338-2ac2e81042d4 req-9eb7f590-8c60-48ae-adc2-5aa165aca757 service nova] [instance: 4bb19560-6149-4c39-8596-3c4c11c4247d] Received unexpected event network-vif-plugged-8a3e1ef1-37aa-4d8f-9484-143213c68bf1 for instance with vm_state deleted and task_state None.
Nov 17 01:51:42 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:51:42 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:51:47 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:51:47 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-6644cbf8-5ce4-4341-a92c-405cc1285d34 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 014533a1-a4c3-4c65-a121-f46486cc5998 is timed out.
Nov 17 01:51:47 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-6644cbf8-5ce4-4341-a92c-405cc1285d34 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Successfully detached device vdb from instance 014533a1-a4c3-4c65-a121-f46486cc5998 from the live domain config.
Nov 17 01:51:47 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6644cbf8-5ce4-4341-a92c-405cc1285d34 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] [instance: 014533a1-a4c3-4c65-a121-f46486cc5998] calling os-brick to detach iSCSI Volume {{(pid=75226) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 17 01:51:47 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-6644cbf8-5ce4-4341-a92c-405cc1285d34 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc4cc36b490>, {'target_iqn': 'iqn.2010-10.org.openstack:e5085893-4d9b-44fb-964e-b32da5fbf44d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nqjWSUND', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:51:47 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-6644cbf8-5ce4-4341-a92c-405cc1285d34 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:51:47 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-6644cbf8-5ce4-4341-a92c-405cc1285d34 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:51:47 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-6644cbf8-5ce4-4341-a92c-405cc1285d34 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:51:47 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:51:47 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:51:47 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[229a617e-8904-4679-bd80-3a97dcdc80ba]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e5085893-4d9b-44fb-964e-b32da5fbf44d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:875a05e9-5133-418e-a210-0b01076d92a8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:51:47 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-6644cbf8-5ce4-4341-a92c-405cc1285d34 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 17 01:51:47 user nova-compute[75226]: No targets found.
Nov 17 01:51:47 user nova-compute[75226]: iSNS:
Nov 17 01:51:47 user nova-compute[75226]: No targets found.
Nov 17 01:51:47 user nova-compute[75226]: STATIC:
Nov 17 01:51:47 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:e5085893-4d9b-44fb-964e-b32da5fbf44d
Nov 17 01:51:47 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:51:47 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:51:47 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:875a05e9-5133-418e-a210-0b01076d92a8
Nov 17 01:51:47 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:51:47 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:51:47 user nova-compute[75226]: FIRMWARE:
Nov 17 01:51:47 user nova-compute[75226]: No targets found.
Nov 17 01:51:47 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:51:47 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-6644cbf8-5ce4-4341-a92c-405cc1285d34 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 17 01:51:47 user nova-compute[75226]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 17 01:51:47 user nova-compute[75226]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75226) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 17 01:51:47 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-6644cbf8-5ce4-4341-a92c-405cc1285d34 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e5085893-4d9b-44fb-964e-b32da5fbf44d', 0)] {{(pid=75226) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 17 01:51:47 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:51:47 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:51:47 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b97f529-1ed0-4e34-81ea-bf7ee7d44f53]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:875a05e9-5133-418e-a210-0b01076d92a8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5085893-4d9b-44fb-964e-b32da5fbf44d\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:51:47 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:51:47 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:51:47 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1a1efa9-fc31-481d-90fa-455a7d5f9126]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:875a05e9-5133-418e-a210-0b01076d92a8 (non-flash)\ntcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5085893-4d9b-44fb-964e-b32da5fbf44d (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:51:47 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-6644cbf8-5ce4-4341-a92c-405cc1285d34 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:875a05e9-5133-418e-a210-0b01076d92a8 (non-flash)
Nov 17 01:51:47 user nova-compute[75226]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5085893-4d9b-44fb-964e-b32da5fbf44d (non-flash)
Nov 17 01:51:47 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:51:47 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-6644cbf8-5ce4-4341-a92c-405cc1285d34 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:875a05e9-5133-418e-a210-0b01076d92a8 (non-flash)
Nov 17 01:51:47 user nova-compute[75226]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5085893-4d9b-44fb-964e-b32da5fbf44d (non-flash)
Nov 17 01:51:47 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:51:47 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-6644cbf8-5ce4-4341-a92c-405cc1285d34 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc4cc1bf400>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e5085893-4d9b-44fb-964e-b32da5fbf44d'): ({'sdd'}, set())}) {{(pid=75226) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 17 01:51:47 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-6644cbf8-5ce4-4341-a92c-405cc1285d34 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Removing single pathed devices sdd {{(pid=75226) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 17 01:51:47 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:51:47 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:51:47 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[45ae79d9-9da2-45a0-9662-56a0a05c0da8]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:51:47 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:51:47 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:51:47 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fc0110e-fc0e-4484-a02d-6e5ed187a460]: (4, ('ok\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:51:47 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-6644cbf8-5ce4-4341-a92c-405cc1285d34 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Flushing IO for device /dev/sdd {{(pid=75226) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 17 01:51:47 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:51:47 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:51:47 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b42472e-7254-4e9b-be1b-cf6591d89356]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:51:47 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-6644cbf8-5ce4-4341-a92c-405cc1285d34 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75226) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 17 01:51:47 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:51:47 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.038s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:51:47 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[c02b1bfa-1c08-4a8f-bd82-471f5ad4e169]: (4, ('1', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:51:47 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-6644cbf8-5ce4-4341-a92c-405cc1285d34 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75226) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 17 01:51:47 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-6644cbf8-5ce4-4341-a92c-405cc1285d34 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] SCSI volumes sdd have been removed. {{(pid=75226) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 17 01:51:47 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-6644cbf8-5ce4-4341-a92c-405cc1285d34 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e5085893-4d9b-44fb-964e-b32da5fbf44d')] {{(pid=75226) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 17 01:51:47 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5085893-4d9b-44fb-964e-b32da5fbf44d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:51:47 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5085893-4d9b-44fb-964e-b32da5fbf44d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:51:47 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f01195c-e8a5-413b-ad19-bc6669b7f952]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:51:47 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-6644cbf8-5ce4-4341-a92c-405cc1285d34 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:51:47 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5085893-4d9b-44fb-964e-b32da5fbf44d -p 172.16.0.220:3260 --logout {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:51:47 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5085893-4d9b-44fb-964e-b32da5fbf44d -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:51:47 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec42d53c-6c12-4146-9b90-125f691b7c9b]: (4, ('Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:e5085893-4d9b-44fb-964e-b32da5fbf44d, portal: 172.16.0.220,3260]\nLogout of [sid: 61, target: iqn.2010-10.org.openstack:e5085893-4d9b-44fb-964e-b32da5fbf44d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:51:47 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-6644cbf8-5ce4-4341-a92c-405cc1285d34 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:e5085893-4d9b-44fb-964e-b32da5fbf44d, portal: 172.16.0.220,3260]
Nov 17 01:51:47 user nova-compute[75226]: Logout of [sid: 61, target: iqn.2010-10.org.openstack:e5085893-4d9b-44fb-964e-b32da5fbf44d, portal: 172.16.0.220,3260] successful.
Nov 17 01:51:47 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:51:47 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5085893-4d9b-44fb-964e-b32da5fbf44d -p 172.16.0.220:3260 --op delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:51:47 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5085893-4d9b-44fb-964e-b32da5fbf44d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:51:47 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c32b990-7db1-4cd5-88d7-78f32a117957]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:51:47 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-6644cbf8-5ce4-4341-a92c-405cc1285d34 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:51:47 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-6644cbf8-5ce4-4341-a92c-405cc1285d34 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.267s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:51:47 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-6644cbf8-5ce4-4341-a92c-405cc1285d34 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] <== disconnect_volume: return (268ms) None {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:51:47 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6644cbf8-5ce4-4341-a92c-405cc1285d34 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] [instance: 014533a1-a4c3-4c65-a121-f46486cc5998] Disconnected iSCSI Volume {{(pid=75226) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 17 01:51:48 user nova-compute[75226]: DEBUG nova.objects.instance [None req-6644cbf8-5ce4-4341-a92c-405cc1285d34 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Lazy-loading 'flavor' on Instance uuid 014533a1-a4c3-4c65-a121-f46486cc5998 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:51:48 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-6644cbf8-5ce4-4341-a92c-405cc1285d34 tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Lock "014533a1-a4c3-4c65-a121-f46486cc5998" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.560s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:51:52 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:51:57 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:52:02 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:52:07 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:52:12 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:52:17 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:52:17 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:52:17 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:52:17 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:52:17 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:52:17 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75226) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 17 01:52:18 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/014533a1-a4c3-4c65-a121-f46486cc5998/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:52:18 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/014533a1-a4c3-4c65-a121-f46486cc5998/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:52:18 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/014533a1-a4c3-4c65-a121-f46486cc5998/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:52:18 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/014533a1-a4c3-4c65-a121-f46486cc5998/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:52:18 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75226) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 01:52:18 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:52:18 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:52:18 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Hypervisor/Node resource view: name=user free_ram=8842MB free_disk=24.948898315429688GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75226) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 17 01:52:18 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:52:18 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:52:19 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 014533a1-a4c3-4c65-a121-f46486cc5998 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:52:19 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 19ff5421-3e67-4ac7-8021-bc4a4528d992 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:52:19 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75226) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 17 01:52:19 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75226) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 17 01:52:19 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:52:19 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:52:19 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Compute_service record updated for user:user {{(pid=75226) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 17 01:52:19 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.230s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:52:22 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:52:27 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:52:27 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:52:27 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:52:28 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:52:29 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:52:29 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75226) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 17 01:52:31 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:52:32 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:52:32 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:52:32 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:52:32 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Starting heal instance info cache {{(pid=75226) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 17 01:52:32 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Rebuilding the list of instances to heal {{(pid=75226) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 17 01:52:33 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "refresh_cache-014533a1-a4c3-4c65-a121-f46486cc5998" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:52:33 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquired lock "refresh_cache-014533a1-a4c3-4c65-a121-f46486cc5998" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:52:33 user nova-compute[75226]: DEBUG nova.network.neutron [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] [instance: 014533a1-a4c3-4c65-a121-f46486cc5998] Forcefully refreshing network info cache for instance {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 17 01:52:33 user nova-compute[75226]: DEBUG nova.objects.instance [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lazy-loading 'info_cache' on Instance uuid 014533a1-a4c3-4c65-a121-f46486cc5998 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:52:33 user nova-compute[75226]: DEBUG nova.network.neutron [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] [instance: 014533a1-a4c3-4c65-a121-f46486cc5998] Updating instance_info_cache with network_info: [{"id": "151e4c1a-3552-45f8-a49d-049e1c629c5b", "address": "fa:16:3e:35:6c:13", "network": {"id": "a1d04537-c0d6-46a4-bce4-de3bb5e89921", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-813941300-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c0b07ca915e4960b1e1998855e23e5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap151e4c1a-35", "ovs_interfaceid": "151e4c1a-3552-45f8-a49d-049e1c629c5b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:52:33 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Releasing lock "refresh_cache-014533a1-a4c3-4c65-a121-f46486cc5998" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:52:33 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] [instance: 014533a1-a4c3-4c65-a121-f46486cc5998] Updated the network info_cache for instance {{(pid=75226) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 17 01:52:34 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:52:37 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:52:37 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:52:37 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75226) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 17 01:52:37 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75226) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 01:52:37 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75226) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 01:52:37 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:52:38 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-beb1a5c9-dae5-4f7c-8ed3-186fe74970de tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Acquiring lock "014533a1-a4c3-4c65-a121-f46486cc5998" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:52:38 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-beb1a5c9-dae5-4f7c-8ed3-186fe74970de tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Lock "014533a1-a4c3-4c65-a121-f46486cc5998" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:52:38 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-beb1a5c9-dae5-4f7c-8ed3-186fe74970de tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Acquiring lock "014533a1-a4c3-4c65-a121-f46486cc5998-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:52:38 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-beb1a5c9-dae5-4f7c-8ed3-186fe74970de tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Lock "014533a1-a4c3-4c65-a121-f46486cc5998-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:52:38 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-beb1a5c9-dae5-4f7c-8ed3-186fe74970de tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Lock "014533a1-a4c3-4c65-a121-f46486cc5998-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:52:38 user nova-compute[75226]: INFO nova.compute.manager [None req-beb1a5c9-dae5-4f7c-8ed3-186fe74970de tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] [instance: 014533a1-a4c3-4c65-a121-f46486cc5998] Terminating instance
Nov 17 01:52:38 user nova-compute[75226]: DEBUG nova.compute.manager [None req-beb1a5c9-dae5-4f7c-8ed3-186fe74970de tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] [instance: 014533a1-a4c3-4c65-a121-f46486cc5998] Start destroying the instance on the hypervisor. {{(pid=75226) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 17 01:52:38 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:52:38 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:52:38 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:52:38 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:52:38 user nova-compute[75226]: DEBUG nova.compute.manager [req-11041252-fa20-4411-86da-afe27ae7759f req-06c65c2f-f078-4b8d-b7f1-d08d84c0a5b9 service nova] [instance: 014533a1-a4c3-4c65-a121-f46486cc5998] Received event network-vif-unplugged-151e4c1a-3552-45f8-a49d-049e1c629c5b {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:52:38 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-11041252-fa20-4411-86da-afe27ae7759f req-06c65c2f-f078-4b8d-b7f1-d08d84c0a5b9 service nova] Acquiring lock "014533a1-a4c3-4c65-a121-f46486cc5998-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:52:38 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-11041252-fa20-4411-86da-afe27ae7759f req-06c65c2f-f078-4b8d-b7f1-d08d84c0a5b9 service nova] Lock "014533a1-a4c3-4c65-a121-f46486cc5998-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:52:38 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-11041252-fa20-4411-86da-afe27ae7759f req-06c65c2f-f078-4b8d-b7f1-d08d84c0a5b9 service nova] Lock "014533a1-a4c3-4c65-a121-f46486cc5998-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:52:38 user nova-compute[75226]: DEBUG nova.compute.manager [req-11041252-fa20-4411-86da-afe27ae7759f req-06c65c2f-f078-4b8d-b7f1-d08d84c0a5b9 service nova] [instance: 014533a1-a4c3-4c65-a121-f46486cc5998] No waiting events found dispatching network-vif-unplugged-151e4c1a-3552-45f8-a49d-049e1c629c5b {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:52:38 user nova-compute[75226]: DEBUG nova.compute.manager [req-11041252-fa20-4411-86da-afe27ae7759f req-06c65c2f-f078-4b8d-b7f1-d08d84c0a5b9 service nova] [instance: 014533a1-a4c3-4c65-a121-f46486cc5998] Received event network-vif-unplugged-151e4c1a-3552-45f8-a49d-049e1c629c5b for instance with task_state deleting. {{(pid=75226) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 17 01:52:38 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:52:38 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:52:38 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:52:38 user nova-compute[75226]: INFO nova.virt.libvirt.driver [-] [instance: 014533a1-a4c3-4c65-a121-f46486cc5998] Instance destroyed successfully.
Nov 17 01:52:38 user nova-compute[75226]: DEBUG nova.objects.instance [None req-beb1a5c9-dae5-4f7c-8ed3-186fe74970de tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Lazy-loading 'resources' on Instance uuid 014533a1-a4c3-4c65-a121-f46486cc5998 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:52:38 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-beb1a5c9-dae5-4f7c-8ed3-186fe74970de tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:46:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-278216686',display_name='tempest-SnapshotDataIntegrityTests-server-278216686',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-278216686',id=47,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFmnzljMhFPsBQuVT/xvyDJK9w7hCQb/H9UqU2lwq3tOjMTUcbue1yooGcjf/XjlwgVuHUG6igC8IPoeqWr95z6ERrjmn60cVjDp2gwXaXgxh11JBbWeVgc45y0vXxxtjg==',key_name='tempest-keypair-653694136',keypairs=<?>,launch_index=0,launched_at=2023-11-17T01:46:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5c0b07ca915e4960b1e1998855e23e5c',ramdisk_id='',reservation_id='r-4ia0l00d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1627794135',owner_user_name='tempest-SnapshotDataIntegrityTests-1627794135-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T01:46:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4532128d242b4121956e99fd8f7720d8',uuid=014533a1-a4c3-4c65-a121-f46486cc5998,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "151e4c1a-3552-45f8-a49d-049e1c629c5b", "address": "fa:16:3e:35:6c:13", "network": {"id": "a1d04537-c0d6-46a4-bce4-de3bb5e89921", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-813941300-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c0b07ca915e4960b1e1998855e23e5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap151e4c1a-35", "ovs_interfaceid": "151e4c1a-3552-45f8-a49d-049e1c629c5b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 17 01:52:38 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-beb1a5c9-dae5-4f7c-8ed3-186fe74970de tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Converting VIF {"id": "151e4c1a-3552-45f8-a49d-049e1c629c5b", "address": "fa:16:3e:35:6c:13", "network": {"id": "a1d04537-c0d6-46a4-bce4-de3bb5e89921", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-813941300-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c0b07ca915e4960b1e1998855e23e5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap151e4c1a-35", "ovs_interfaceid": "151e4c1a-3552-45f8-a49d-049e1c629c5b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:52:38 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-beb1a5c9-dae5-4f7c-8ed3-186fe74970de tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:35:6c:13,bridge_name='br-int',has_traffic_filtering=True,id=151e4c1a-3552-45f8-a49d-049e1c629c5b,network=Network(a1d04537-c0d6-46a4-bce4-de3bb5e89921),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap151e4c1a-35') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:52:38 user nova-compute[75226]: DEBUG os_vif [None req-beb1a5c9-dae5-4f7c-8ed3-186fe74970de tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:35:6c:13,bridge_name='br-int',has_traffic_filtering=True,id=151e4c1a-3552-45f8-a49d-049e1c629c5b,network=Network(a1d04537-c0d6-46a4-bce4-de3bb5e89921),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap151e4c1a-35') {{(pid=75226) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 17 01:52:38 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:52:38 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap151e4c1a-35, bridge=br-int, if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:52:38 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:52:38 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:52:38 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6ad5d16f-fb66-4604-80ed-b45ba5f6cb3b) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:52:38 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:52:38 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:52:38 user nova-compute[75226]: INFO os_vif [None req-beb1a5c9-dae5-4f7c-8ed3-186fe74970de tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:35:6c:13,bridge_name='br-int',has_traffic_filtering=True,id=151e4c1a-3552-45f8-a49d-049e1c629c5b,network=Network(a1d04537-c0d6-46a4-bce4-de3bb5e89921),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap151e4c1a-35')
Nov 17 01:52:38 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-beb1a5c9-dae5-4f7c-8ed3-186fe74970de tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] [instance: 014533a1-a4c3-4c65-a121-f46486cc5998] Deleting instance files /opt/stack/data/nova/instances/014533a1-a4c3-4c65-a121-f46486cc5998_del
Nov 17 01:52:38 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-beb1a5c9-dae5-4f7c-8ed3-186fe74970de tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] [instance: 014533a1-a4c3-4c65-a121-f46486cc5998] Deletion of /opt/stack/data/nova/instances/014533a1-a4c3-4c65-a121-f46486cc5998_del complete
Nov 17 01:52:39 user nova-compute[75226]: INFO nova.compute.manager [None req-beb1a5c9-dae5-4f7c-8ed3-186fe74970de tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] [instance: 014533a1-a4c3-4c65-a121-f46486cc5998] Took 0.84 seconds to destroy the instance on the hypervisor.
Nov 17 01:52:39 user nova-compute[75226]: DEBUG oslo.service.loopingcall [None req-beb1a5c9-dae5-4f7c-8ed3-186fe74970de tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75226) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 17 01:52:39 user nova-compute[75226]: DEBUG nova.compute.manager [-] [instance: 014533a1-a4c3-4c65-a121-f46486cc5998] Deallocating network for instance {{(pid=75226) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 17 01:52:39 user nova-compute[75226]: DEBUG nova.network.neutron [-] [instance: 014533a1-a4c3-4c65-a121-f46486cc5998] deallocate_for_instance() {{(pid=75226) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 17 01:52:40 user nova-compute[75226]: DEBUG nova.network.neutron [-] [instance: 014533a1-a4c3-4c65-a121-f46486cc5998] Updating instance_info_cache with network_info: [] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:52:40 user nova-compute[75226]: INFO nova.compute.manager [-] [instance: 014533a1-a4c3-4c65-a121-f46486cc5998] Took 1.19 seconds to deallocate network for instance.
Nov 17 01:52:40 user nova-compute[75226]: DEBUG nova.compute.manager [req-29baba27-cdb1-41f6-ad34-346c6534c297 req-6a3fa01f-5912-4328-b5ae-698bf5b87102 service nova] [instance: 014533a1-a4c3-4c65-a121-f46486cc5998] Received event network-vif-deleted-151e4c1a-3552-45f8-a49d-049e1c629c5b {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:52:40 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-beb1a5c9-dae5-4f7c-8ed3-186fe74970de tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:52:40 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-beb1a5c9-dae5-4f7c-8ed3-186fe74970de tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:52:40 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-beb1a5c9-dae5-4f7c-8ed3-186fe74970de tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:52:40 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-beb1a5c9-dae5-4f7c-8ed3-186fe74970de tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:52:40 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-beb1a5c9-dae5-4f7c-8ed3-186fe74970de tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.143s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:52:40 user nova-compute[75226]: INFO nova.scheduler.client.report [None req-beb1a5c9-dae5-4f7c-8ed3-186fe74970de tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Deleted allocations for instance 014533a1-a4c3-4c65-a121-f46486cc5998
Nov 17 01:52:40 user nova-compute[75226]: DEBUG nova.compute.manager [req-30dda528-5908-429a-b4c0-a87e54ffa538 req-e37eb910-c7ee-4a91-9733-3b1e7fa18364 service nova] [instance: 014533a1-a4c3-4c65-a121-f46486cc5998] Received event network-vif-plugged-151e4c1a-3552-45f8-a49d-049e1c629c5b {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:52:40 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-30dda528-5908-429a-b4c0-a87e54ffa538 req-e37eb910-c7ee-4a91-9733-3b1e7fa18364 service nova] Acquiring lock "014533a1-a4c3-4c65-a121-f46486cc5998-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:52:40 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-30dda528-5908-429a-b4c0-a87e54ffa538 req-e37eb910-c7ee-4a91-9733-3b1e7fa18364 service nova] Lock "014533a1-a4c3-4c65-a121-f46486cc5998-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:52:40 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-30dda528-5908-429a-b4c0-a87e54ffa538 req-e37eb910-c7ee-4a91-9733-3b1e7fa18364 service nova] Lock "014533a1-a4c3-4c65-a121-f46486cc5998-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:52:40 user nova-compute[75226]: DEBUG nova.compute.manager [req-30dda528-5908-429a-b4c0-a87e54ffa538 req-e37eb910-c7ee-4a91-9733-3b1e7fa18364 service nova] [instance: 014533a1-a4c3-4c65-a121-f46486cc5998] No waiting events found dispatching network-vif-plugged-151e4c1a-3552-45f8-a49d-049e1c629c5b {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:52:40 user nova-compute[75226]: WARNING nova.compute.manager [req-30dda528-5908-429a-b4c0-a87e54ffa538 req-e37eb910-c7ee-4a91-9733-3b1e7fa18364 service nova] [instance: 014533a1-a4c3-4c65-a121-f46486cc5998] Received unexpected event network-vif-plugged-151e4c1a-3552-45f8-a49d-049e1c629c5b for instance with vm_state deleted and task_state None.
Nov 17 01:52:40 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-beb1a5c9-dae5-4f7c-8ed3-186fe74970de tempest-SnapshotDataIntegrityTests-1627794135 tempest-SnapshotDataIntegrityTests-1627794135-project-member] Lock "014533a1-a4c3-4c65-a121-f46486cc5998" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.399s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:52:41 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:52:43 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:52:47 user nova-compute[75226]: DEBUG nova.compute.manager [req-a0b0e761-63a2-42fa-936e-28bd6351ec37 req-7b4a7948-0261-47ce-a870-7c8bfc671ac0 service nova] [instance: 19ff5421-3e67-4ac7-8021-bc4a4528d992] Received event network-changed-af3d3ad1-b936-4f8b-a16c-09f44988ba7b {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:52:47 user nova-compute[75226]: DEBUG nova.compute.manager [req-a0b0e761-63a2-42fa-936e-28bd6351ec37 req-7b4a7948-0261-47ce-a870-7c8bfc671ac0 service nova] [instance: 19ff5421-3e67-4ac7-8021-bc4a4528d992] Refreshing instance network info cache due to event network-changed-af3d3ad1-b936-4f8b-a16c-09f44988ba7b. {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 01:52:47 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-a0b0e761-63a2-42fa-936e-28bd6351ec37 req-7b4a7948-0261-47ce-a870-7c8bfc671ac0 service nova] Acquiring lock "refresh_cache-19ff5421-3e67-4ac7-8021-bc4a4528d992" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:52:47 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-a0b0e761-63a2-42fa-936e-28bd6351ec37 req-7b4a7948-0261-47ce-a870-7c8bfc671ac0 service nova] Acquired lock "refresh_cache-19ff5421-3e67-4ac7-8021-bc4a4528d992" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:52:47 user nova-compute[75226]: DEBUG nova.network.neutron [req-a0b0e761-63a2-42fa-936e-28bd6351ec37 req-7b4a7948-0261-47ce-a870-7c8bfc671ac0 service nova] [instance: 19ff5421-3e67-4ac7-8021-bc4a4528d992] Refreshing network info cache for port af3d3ad1-b936-4f8b-a16c-09f44988ba7b {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 01:52:47 user nova-compute[75226]: DEBUG nova.network.neutron [req-a0b0e761-63a2-42fa-936e-28bd6351ec37 req-7b4a7948-0261-47ce-a870-7c8bfc671ac0 service nova] [instance: 19ff5421-3e67-4ac7-8021-bc4a4528d992] Updated VIF entry in instance network info cache for port af3d3ad1-b936-4f8b-a16c-09f44988ba7b. {{(pid=75226) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 01:52:47 user nova-compute[75226]: DEBUG nova.network.neutron [req-a0b0e761-63a2-42fa-936e-28bd6351ec37 req-7b4a7948-0261-47ce-a870-7c8bfc671ac0 service nova] [instance: 19ff5421-3e67-4ac7-8021-bc4a4528d992] Updating instance_info_cache with network_info: [{"id": "af3d3ad1-b936-4f8b-a16c-09f44988ba7b", "address": "fa:16:3e:6c:79:d6", "network": {"id": "81bbbdad-218b-4fcd-b7f5-427fd49361cb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1151874504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "673620a69fba4a04af75baabe775dc8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf3d3ad1-b9", "ovs_interfaceid": "af3d3ad1-b936-4f8b-a16c-09f44988ba7b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:52:47 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-a0b0e761-63a2-42fa-936e-28bd6351ec37 req-7b4a7948-0261-47ce-a870-7c8bfc671ac0 service nova] Releasing lock "refresh_cache-19ff5421-3e67-4ac7-8021-bc4a4528d992" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:52:48 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-203b3c20-7f9f-48cc-af70-7ce0ad1fabcc tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Acquiring lock "19ff5421-3e67-4ac7-8021-bc4a4528d992" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:52:48 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-203b3c20-7f9f-48cc-af70-7ce0ad1fabcc tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Lock "19ff5421-3e67-4ac7-8021-bc4a4528d992" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:52:48 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-203b3c20-7f9f-48cc-af70-7ce0ad1fabcc tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Acquiring lock "19ff5421-3e67-4ac7-8021-bc4a4528d992-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:52:48 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-203b3c20-7f9f-48cc-af70-7ce0ad1fabcc tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Lock "19ff5421-3e67-4ac7-8021-bc4a4528d992-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:52:48 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-203b3c20-7f9f-48cc-af70-7ce0ad1fabcc tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Lock "19ff5421-3e67-4ac7-8021-bc4a4528d992-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:52:48 user nova-compute[75226]: INFO nova.compute.manager [None req-203b3c20-7f9f-48cc-af70-7ce0ad1fabcc tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: 19ff5421-3e67-4ac7-8021-bc4a4528d992] Terminating instance
Nov 17 01:52:48 user nova-compute[75226]: DEBUG nova.compute.manager [None req-203b3c20-7f9f-48cc-af70-7ce0ad1fabcc tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: 19ff5421-3e67-4ac7-8021-bc4a4528d992] Start destroying the instance on the hypervisor. {{(pid=75226) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 17 01:52:48 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:52:48 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:52:48 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:52:48 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:52:48 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:52:48 user nova-compute[75226]: INFO nova.virt.libvirt.driver [-] [instance: 19ff5421-3e67-4ac7-8021-bc4a4528d992] Instance destroyed successfully.
Nov 17 01:52:48 user nova-compute[75226]: DEBUG nova.objects.instance [None req-203b3c20-7f9f-48cc-af70-7ce0ad1fabcc tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Lazy-loading 'resources' on Instance uuid 19ff5421-3e67-4ac7-8021-bc4a4528d992 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:52:48 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-203b3c20-7f9f-48cc-af70-7ce0ad1fabcc tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:50:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1731373839',display_name='tempest-TestVolumeBootPattern-server-1731373839',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1731373839',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIOTXvx1rt0huiJMkCirjSAkUEIOTUxZuP5hnGbb4TZayM1DPwV+2un52eKf78XfXFJdTcPGOcA7AeRAFw+1gTwHIAhQ08B/zT7NrklMaP31fH3B8tWT2/QeOIfwk/TlfQ==',key_name='tempest-TestVolumeBootPattern-346525006',keypairs=<?>,launch_index=0,launched_at=2023-11-17T01:51:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='673620a69fba4a04af75baabe775dc8b',ramdisk_id='',reservation_id='r-t0oxvdod',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-971654489',owner_user_name='tempest-TestVolumeBootPattern-971654489-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T01:51:08Z,user_data=None,user_id='7c8c8baa56884dcd9a90f0187c9fc06f',uuid=19ff5421-3e67-4ac7-8021-bc4a4528d992,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "af3d3ad1-b936-4f8b-a16c-09f44988ba7b", "address": "fa:16:3e:6c:79:d6", "network": {"id": "81bbbdad-218b-4fcd-b7f5-427fd49361cb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1151874504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "673620a69fba4a04af75baabe775dc8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf3d3ad1-b9", "ovs_interfaceid": "af3d3ad1-b936-4f8b-a16c-09f44988ba7b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 17 01:52:48 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-203b3c20-7f9f-48cc-af70-7ce0ad1fabcc tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Converting VIF {"id": "af3d3ad1-b936-4f8b-a16c-09f44988ba7b", "address": "fa:16:3e:6c:79:d6", "network": {"id": "81bbbdad-218b-4fcd-b7f5-427fd49361cb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1151874504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "673620a69fba4a04af75baabe775dc8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf3d3ad1-b9", "ovs_interfaceid": "af3d3ad1-b936-4f8b-a16c-09f44988ba7b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:52:48 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-203b3c20-7f9f-48cc-af70-7ce0ad1fabcc tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6c:79:d6,bridge_name='br-int',has_traffic_filtering=True,id=af3d3ad1-b936-4f8b-a16c-09f44988ba7b,network=Network(81bbbdad-218b-4fcd-b7f5-427fd49361cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf3d3ad1-b9') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:52:48 user nova-compute[75226]: DEBUG os_vif [None req-203b3c20-7f9f-48cc-af70-7ce0ad1fabcc tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6c:79:d6,bridge_name='br-int',has_traffic_filtering=True,id=af3d3ad1-b936-4f8b-a16c-09f44988ba7b,network=Network(81bbbdad-218b-4fcd-b7f5-427fd49361cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf3d3ad1-b9') {{(pid=75226) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 17 01:52:48 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:52:48 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaf3d3ad1-b9, bridge=br-int, if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:52:48 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:52:48 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:52:48 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:52:48 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4cd022b3-0ba7-4661-9bf1-92d93a0256a6) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:52:48 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:52:48 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:52:48 user nova-compute[75226]: INFO os_vif [None req-203b3c20-7f9f-48cc-af70-7ce0ad1fabcc tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6c:79:d6,bridge_name='br-int',has_traffic_filtering=True,id=af3d3ad1-b936-4f8b-a16c-09f44988ba7b,network=Network(81bbbdad-218b-4fcd-b7f5-427fd49361cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf3d3ad1-b9')
Nov 17 01:52:48 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-203b3c20-7f9f-48cc-af70-7ce0ad1fabcc tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: 19ff5421-3e67-4ac7-8021-bc4a4528d992] calling os-brick to detach iSCSI Volume {{(pid=75226) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 17 01:52:48 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-203b3c20-7f9f-48cc-af70-7ce0ad1fabcc tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc4cc36b490>, {'target_iqn': 'iqn.2010-10.org.openstack:875a05e9-5133-418e-a210-0b01076d92a8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DMmFhyko', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:52:48 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-203b3c20-7f9f-48cc-af70-7ce0ad1fabcc tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:52:48 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-203b3c20-7f9f-48cc-af70-7ce0ad1fabcc tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:52:48 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-203b3c20-7f9f-48cc-af70-7ce0ad1fabcc tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:52:48 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:52:48 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:52:48 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[b646ffc4-b668-4646-ab92-65e83c52316f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:875a05e9-5133-418e-a210-0b01076d92a8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:52:48 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-203b3c20-7f9f-48cc-af70-7ce0ad1fabcc tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 17 01:52:48 user nova-compute[75226]: No targets found.
Nov 17 01:52:48 user nova-compute[75226]: iSNS:
Nov 17 01:52:48 user nova-compute[75226]: No targets found.
Nov 17 01:52:48 user nova-compute[75226]: STATIC:
Nov 17 01:52:48 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:875a05e9-5133-418e-a210-0b01076d92a8
Nov 17 01:52:48 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:52:48 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:52:48 user nova-compute[75226]: FIRMWARE:
Nov 17 01:52:48 user nova-compute[75226]: No targets found.
Nov 17 01:52:48 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:52:48 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-203b3c20-7f9f-48cc-af70-7ce0ad1fabcc tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 17 01:52:48 user nova-compute[75226]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 17 01:52:48 user nova-compute[75226]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75226) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 17 01:52:48 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-203b3c20-7f9f-48cc-af70-7ce0ad1fabcc tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:875a05e9-5133-418e-a210-0b01076d92a8', 0)] {{(pid=75226) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 17 01:52:48 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:52:48 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:52:48 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0584587-142c-4372-a631-75d3d35a7d8b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:875a05e9-5133-418e-a210-0b01076d92a8\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:52:48 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:52:48 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:52:48 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[b30fe78f-2e8a-4e39-b34e-c995f4a42e10]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:875a05e9-5133-418e-a210-0b01076d92a8 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:52:48 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-203b3c20-7f9f-48cc-af70-7ce0ad1fabcc tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:875a05e9-5133-418e-a210-0b01076d92a8 (non-flash)
Nov 17 01:52:48 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:52:48 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-203b3c20-7f9f-48cc-af70-7ce0ad1fabcc tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:875a05e9-5133-418e-a210-0b01076d92a8 (non-flash)
Nov 17 01:52:48 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:52:48 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-203b3c20-7f9f-48cc-af70-7ce0ad1fabcc tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc4cc1fb010>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:875a05e9-5133-418e-a210-0b01076d92a8'): ({'sdc'}, set())}) {{(pid=75226) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 17 01:52:48 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-203b3c20-7f9f-48cc-af70-7ce0ad1fabcc tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Removing single pathed devices sdc {{(pid=75226) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 17 01:52:48 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:52:48 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:52:48 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[50b70ac0-3811-4edf-92a1-8a4a8a07e2d5]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:52:48 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:52:48 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:52:48 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e390a21-edf3-4cd7-a497-7ac49af51711]: (4, ('ok\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:52:48 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-203b3c20-7f9f-48cc-af70-7ce0ad1fabcc tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Flushing IO for device /dev/sdc {{(pid=75226) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 17 01:52:48 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:52:48 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:52:48 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[fac55ebd-36e4-4cc9-ad07-64e6a024b201]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:52:48 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-203b3c20-7f9f-48cc-af70-7ce0ad1fabcc tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75226) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 17 01:52:48 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:52:49 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.048s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:52:49 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fe9f1c3-a3cb-4c9c-89e1-e653e6427d8f]: (4, ('1', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:52:49 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-203b3c20-7f9f-48cc-af70-7ce0ad1fabcc tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75226) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 17 01:52:49 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-203b3c20-7f9f-48cc-af70-7ce0ad1fabcc tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] SCSI volumes sdc have been removed. {{(pid=75226) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 17 01:52:49 user nova-compute[75226]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_24a41b1f', '/dev/disk/by-id/scsi-1SCST_BIO24a41b1f-22ad42292783a90b', '/dev/disk/by-id/scsi-23232616434323239') {{(pid=85818) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 17 01:52:49 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[a024d8b7-834e-46a9-b26d-cdd0baea3654]: (4, None) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:52:49 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-203b3c20-7f9f-48cc-af70-7ce0ad1fabcc tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:875a05e9-5133-418e-a210-0b01076d92a8')] {{(pid=75226) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 17 01:52:49 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:875a05e9-5133-418e-a210-0b01076d92a8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:52:49 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:875a05e9-5133-418e-a210-0b01076d92a8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:52:49 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[388a7cb0-cad9-4c7a-943d-48b806a66d05]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:52:49 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-203b3c20-7f9f-48cc-af70-7ce0ad1fabcc tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:52:49 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:875a05e9-5133-418e-a210-0b01076d92a8 -p 172.16.0.220:3260 --logout {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:52:49 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:875a05e9-5133-418e-a210-0b01076d92a8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:52:49 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[8102cd8e-9d13-4fd5-9c80-be4e66cc4493]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:875a05e9-5133-418e-a210-0b01076d92a8, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:875a05e9-5133-418e-a210-0b01076d92a8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:52:49 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-203b3c20-7f9f-48cc-af70-7ce0ad1fabcc tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:875a05e9-5133-418e-a210-0b01076d92a8, portal: 172.16.0.220,3260]
Nov 17 01:52:49 user nova-compute[75226]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:875a05e9-5133-418e-a210-0b01076d92a8, portal: 172.16.0.220,3260] successful.
Nov 17 01:52:49 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:52:49 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:875a05e9-5133-418e-a210-0b01076d92a8 -p 172.16.0.220:3260 --op delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:52:49 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:875a05e9-5133-418e-a210-0b01076d92a8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:52:49 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdc59f97-23a9-4087-8664-6190a47176e4]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:52:49 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-203b3c20-7f9f-48cc-af70-7ce0ad1fabcc tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:52:49 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-203b3c20-7f9f-48cc-af70-7ce0ad1fabcc tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.302s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:52:49 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-203b3c20-7f9f-48cc-af70-7ce0ad1fabcc tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] <== disconnect_volume: return (304ms) None {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:52:49 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-203b3c20-7f9f-48cc-af70-7ce0ad1fabcc tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: 19ff5421-3e67-4ac7-8021-bc4a4528d992] Disconnected iSCSI Volume {{(pid=75226) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 17 01:52:49 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-203b3c20-7f9f-48cc-af70-7ce0ad1fabcc tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: 19ff5421-3e67-4ac7-8021-bc4a4528d992] Deleting instance files /opt/stack/data/nova/instances/19ff5421-3e67-4ac7-8021-bc4a4528d992_del
Nov 17 01:52:49 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-203b3c20-7f9f-48cc-af70-7ce0ad1fabcc tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: 19ff5421-3e67-4ac7-8021-bc4a4528d992] Deletion of /opt/stack/data/nova/instances/19ff5421-3e67-4ac7-8021-bc4a4528d992_del complete
Nov 17 01:52:49 user nova-compute[75226]: INFO nova.compute.manager [None req-203b3c20-7f9f-48cc-af70-7ce0ad1fabcc tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: 19ff5421-3e67-4ac7-8021-bc4a4528d992] Took 1.17 seconds to destroy the instance on the hypervisor.
Nov 17 01:52:49 user nova-compute[75226]: DEBUG oslo.service.loopingcall [None req-203b3c20-7f9f-48cc-af70-7ce0ad1fabcc tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75226) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 17 01:52:49 user nova-compute[75226]: DEBUG nova.compute.manager [-] [instance: 19ff5421-3e67-4ac7-8021-bc4a4528d992] Deallocating network for instance {{(pid=75226) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 17 01:52:49 user nova-compute[75226]: DEBUG nova.network.neutron [-] [instance: 19ff5421-3e67-4ac7-8021-bc4a4528d992] deallocate_for_instance() {{(pid=75226) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 17 01:52:49 user nova-compute[75226]: DEBUG nova.compute.manager [req-eebea2e8-5bde-4b8f-a61a-f8351c771fbe req-50f46318-2395-4403-92ec-f17c3eeae17c service nova] [instance: 19ff5421-3e67-4ac7-8021-bc4a4528d992] Received event network-vif-unplugged-af3d3ad1-b936-4f8b-a16c-09f44988ba7b {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:52:49 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-eebea2e8-5bde-4b8f-a61a-f8351c771fbe req-50f46318-2395-4403-92ec-f17c3eeae17c service nova] Acquiring lock "19ff5421-3e67-4ac7-8021-bc4a4528d992-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:52:49 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-eebea2e8-5bde-4b8f-a61a-f8351c771fbe req-50f46318-2395-4403-92ec-f17c3eeae17c service nova] Lock "19ff5421-3e67-4ac7-8021-bc4a4528d992-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:52:49 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-eebea2e8-5bde-4b8f-a61a-f8351c771fbe req-50f46318-2395-4403-92ec-f17c3eeae17c service nova] Lock "19ff5421-3e67-4ac7-8021-bc4a4528d992-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:52:49 user nova-compute[75226]: DEBUG nova.compute.manager [req-eebea2e8-5bde-4b8f-a61a-f8351c771fbe req-50f46318-2395-4403-92ec-f17c3eeae17c service nova] [instance: 19ff5421-3e67-4ac7-8021-bc4a4528d992] No waiting events found dispatching network-vif-unplugged-af3d3ad1-b936-4f8b-a16c-09f44988ba7b {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:52:49 user nova-compute[75226]: DEBUG nova.compute.manager [req-eebea2e8-5bde-4b8f-a61a-f8351c771fbe req-50f46318-2395-4403-92ec-f17c3eeae17c service nova] [instance: 19ff5421-3e67-4ac7-8021-bc4a4528d992] Received event network-vif-unplugged-af3d3ad1-b936-4f8b-a16c-09f44988ba7b for instance with task_state deleting. {{(pid=75226) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 17 01:52:49 user nova-compute[75226]: DEBUG nova.compute.manager [req-eebea2e8-5bde-4b8f-a61a-f8351c771fbe req-50f46318-2395-4403-92ec-f17c3eeae17c service nova] [instance: 19ff5421-3e67-4ac7-8021-bc4a4528d992] Received event network-vif-plugged-af3d3ad1-b936-4f8b-a16c-09f44988ba7b {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:52:49 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-eebea2e8-5bde-4b8f-a61a-f8351c771fbe req-50f46318-2395-4403-92ec-f17c3eeae17c service nova] Acquiring lock "19ff5421-3e67-4ac7-8021-bc4a4528d992-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:52:49 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-eebea2e8-5bde-4b8f-a61a-f8351c771fbe req-50f46318-2395-4403-92ec-f17c3eeae17c service nova] Lock "19ff5421-3e67-4ac7-8021-bc4a4528d992-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:52:49 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-eebea2e8-5bde-4b8f-a61a-f8351c771fbe req-50f46318-2395-4403-92ec-f17c3eeae17c service nova] Lock "19ff5421-3e67-4ac7-8021-bc4a4528d992-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:52:49 user nova-compute[75226]: DEBUG nova.compute.manager [req-eebea2e8-5bde-4b8f-a61a-f8351c771fbe req-50f46318-2395-4403-92ec-f17c3eeae17c service nova] [instance: 19ff5421-3e67-4ac7-8021-bc4a4528d992] No waiting events found dispatching network-vif-plugged-af3d3ad1-b936-4f8b-a16c-09f44988ba7b {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:52:49 user nova-compute[75226]: WARNING nova.compute.manager [req-eebea2e8-5bde-4b8f-a61a-f8351c771fbe req-50f46318-2395-4403-92ec-f17c3eeae17c service nova] [instance: 19ff5421-3e67-4ac7-8021-bc4a4528d992] Received unexpected event network-vif-plugged-af3d3ad1-b936-4f8b-a16c-09f44988ba7b for instance with vm_state active and task_state deleting.
Nov 17 01:52:49 user nova-compute[75226]: DEBUG nova.network.neutron [-] [instance: 19ff5421-3e67-4ac7-8021-bc4a4528d992] Updating instance_info_cache with network_info: [] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:52:49 user nova-compute[75226]: INFO nova.compute.manager [-] [instance: 19ff5421-3e67-4ac7-8021-bc4a4528d992] Took 0.68 seconds to deallocate network for instance.
Nov 17 01:52:50 user nova-compute[75226]: INFO nova.compute.manager [None req-203b3c20-7f9f-48cc-af70-7ce0ad1fabcc tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: 19ff5421-3e67-4ac7-8021-bc4a4528d992] Took 0.71 seconds to detach 1 volumes for instance.
Nov 17 01:52:50 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-203b3c20-7f9f-48cc-af70-7ce0ad1fabcc tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:52:50 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-203b3c20-7f9f-48cc-af70-7ce0ad1fabcc tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:52:50 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-203b3c20-7f9f-48cc-af70-7ce0ad1fabcc tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:52:50 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-203b3c20-7f9f-48cc-af70-7ce0ad1fabcc tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:52:50 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-203b3c20-7f9f-48cc-af70-7ce0ad1fabcc tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.134s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:52:50 user nova-compute[75226]: INFO nova.scheduler.client.report [None req-203b3c20-7f9f-48cc-af70-7ce0ad1fabcc tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Deleted allocations for instance 19ff5421-3e67-4ac7-8021-bc4a4528d992
Nov 17 01:52:50 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-203b3c20-7f9f-48cc-af70-7ce0ad1fabcc tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Lock "19ff5421-3e67-4ac7-8021-bc4a4528d992" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.887s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:52:51 user nova-compute[75226]: DEBUG nova.compute.manager [req-51a69cd8-044b-4fe3-9d65-c9e528946733 req-44e76aad-4b94-444d-a224-cd66f921fade service nova] [instance: 19ff5421-3e67-4ac7-8021-bc4a4528d992] Received event network-vif-deleted-af3d3ad1-b936-4f8b-a16c-09f44988ba7b {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:52:52 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:52:52 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:52:52 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:52:52 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:52:52 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:52:52 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:52:52 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:52:52 user nova-compute[75226]: DEBUG nova.virt.libvirt.imagecache [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Verify base images {{(pid=75226) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Nov 17 01:52:52 user nova-compute[75226]: WARNING nova.virt.libvirt.imagecache [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Unknown base file: /opt/stack/data/nova/instances/_base/7fdb905bd01258dcf4217958e5bd5218074db835
Nov 17 01:52:52 user nova-compute[75226]: WARNING nova.virt.libvirt.imagecache [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Unknown base file: /opt/stack/data/nova/instances/_base/86ea0cbaaeb2d30ade0aaf877499f237da655392
Nov 17 01:52:52 user nova-compute[75226]: WARNING nova.virt.libvirt.imagecache [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Unknown base file: /opt/stack/data/nova/instances/_base/391ae0785444ade97eb9cd60c251e05e79857e81
Nov 17 01:52:52 user nova-compute[75226]: WARNING nova.virt.libvirt.imagecache [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Unknown base file: /opt/stack/data/nova/instances/_base/f98cc1a7de4561ff4f2045cea2489811672b1b01
Nov 17 01:52:52 user nova-compute[75226]: WARNING nova.virt.libvirt.imagecache [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Unknown base file: /opt/stack/data/nova/instances/_base/9157a104ed5ed8b51d920dc191d70012eed08815
Nov 17 01:52:52 user nova-compute[75226]: WARNING nova.virt.libvirt.imagecache [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Unknown base file: /opt/stack/data/nova/instances/_base/d8d5653144b428d20b746276ec0860012540b47e
Nov 17 01:52:52 user nova-compute[75226]: WARNING nova.virt.libvirt.imagecache [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Unknown base file: /opt/stack/data/nova/instances/_base/c26246469b0fe452ea7e2a241a7e59c8d5f2dd53
Nov 17 01:52:52 user nova-compute[75226]: WARNING nova.virt.libvirt.imagecache [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Unknown base file: /opt/stack/data/nova/instances/_base/cdf30fec2ac4e026616c6c725d2f0fd91e521550
Nov 17 01:52:52 user nova-compute[75226]: WARNING nova.virt.libvirt.imagecache [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Unknown base file: /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371
Nov 17 01:52:52 user nova-compute[75226]: WARNING nova.virt.libvirt.imagecache [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Unknown base file: /opt/stack/data/nova/instances/_base/3468189901db823a58475181091cbb5d8259d088
Nov 17 01:52:52 user nova-compute[75226]: INFO nova.virt.libvirt.imagecache [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Removable base files: /opt/stack/data/nova/instances/_base/7fdb905bd01258dcf4217958e5bd5218074db835 /opt/stack/data/nova/instances/_base/86ea0cbaaeb2d30ade0aaf877499f237da655392 /opt/stack/data/nova/instances/_base/391ae0785444ade97eb9cd60c251e05e79857e81 /opt/stack/data/nova/instances/_base/f98cc1a7de4561ff4f2045cea2489811672b1b01 /opt/stack/data/nova/instances/_base/9157a104ed5ed8b51d920dc191d70012eed08815 /opt/stack/data/nova/instances/_base/d8d5653144b428d20b746276ec0860012540b47e /opt/stack/data/nova/instances/_base/c26246469b0fe452ea7e2a241a7e59c8d5f2dd53 /opt/stack/data/nova/instances/_base/cdf30fec2ac4e026616c6c725d2f0fd91e521550 /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 /opt/stack/data/nova/instances/_base/3468189901db823a58475181091cbb5d8259d088
Nov 17 01:52:52 user nova-compute[75226]: INFO nova.virt.libvirt.imagecache [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/7fdb905bd01258dcf4217958e5bd5218074db835
Nov 17 01:52:52 user nova-compute[75226]: INFO nova.virt.libvirt.imagecache [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/86ea0cbaaeb2d30ade0aaf877499f237da655392
Nov 17 01:52:52 user nova-compute[75226]: INFO nova.virt.libvirt.imagecache [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/391ae0785444ade97eb9cd60c251e05e79857e81
Nov 17 01:52:52 user nova-compute[75226]: INFO nova.virt.libvirt.imagecache [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/f98cc1a7de4561ff4f2045cea2489811672b1b01
Nov 17 01:52:52 user nova-compute[75226]: INFO nova.virt.libvirt.imagecache [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/9157a104ed5ed8b51d920dc191d70012eed08815
Nov 17 01:52:52 user nova-compute[75226]: INFO nova.virt.libvirt.imagecache [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/d8d5653144b428d20b746276ec0860012540b47e
Nov 17 01:52:52 user nova-compute[75226]: INFO nova.virt.libvirt.imagecache [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/c26246469b0fe452ea7e2a241a7e59c8d5f2dd53
Nov 17 01:52:52 user nova-compute[75226]: INFO nova.virt.libvirt.imagecache [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/cdf30fec2ac4e026616c6c725d2f0fd91e521550
Nov 17 01:52:52 user nova-compute[75226]: INFO nova.virt.libvirt.imagecache [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371
Nov 17 01:52:52 user nova-compute[75226]: INFO nova.virt.libvirt.imagecache [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/3468189901db823a58475181091cbb5d8259d088
Nov 17 01:52:52 user nova-compute[75226]: DEBUG nova.virt.libvirt.imagecache [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Verification complete {{(pid=75226) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Nov 17 01:52:52 user nova-compute[75226]: DEBUG nova.virt.libvirt.imagecache [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Verify swap images {{(pid=75226) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Nov 17 01:52:52 user nova-compute[75226]: DEBUG nova.virt.libvirt.imagecache [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Verify ephemeral images {{(pid=75226) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Nov 17 01:52:53 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:52:58 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:53:03 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:53:08 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:53:13 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:53:17 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:53:18 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:53:18 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:53:18 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:53:18 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75226) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 17 01:53:18 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:53:18 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:53:18 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Hypervisor/Node resource view: name=user free_ram=9116MB free_disk=24.96725845336914GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75226) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 17 01:53:18 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:53:18 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:53:18 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75226) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 17 01:53:18 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75226) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 17 01:53:18 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:53:18 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:53:18 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Compute_service record updated for user:user {{(pid=75226) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 17 01:53:18 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.293s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:53:18 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:53:23 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:53:23 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:53:23 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75226) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 17 01:53:23 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75226) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 01:53:23 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75226) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 01:53:23 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:53:26 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:53:26 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:53:28 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:53:28 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:53:29 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:53:30 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:53:30 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75226) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 17 01:53:31 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:53:32 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:53:32 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:53:32 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Starting heal instance info cache {{(pid=75226) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 17 01:53:32 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Didn't find any instances for network info cache update. {{(pid=75226) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 17 01:53:33 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:53:33 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:53:34 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:53:34 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:53:36 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:53:38 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:53:39 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-f12abf49-064f-41ca-aed9-a91fa362834f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Acquiring lock "cd6a5eb8-8d48-4894-aff3-a9d04ae85aca" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:53:39 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-f12abf49-064f-41ca-aed9-a91fa362834f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Lock "cd6a5eb8-8d48-4894-aff3-a9d04ae85aca" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:53:39 user nova-compute[75226]: DEBUG nova.compute.manager [None req-f12abf49-064f-41ca-aed9-a91fa362834f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: cd6a5eb8-8d48-4894-aff3-a9d04ae85aca] Starting instance... {{(pid=75226) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 17 01:53:40 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-f12abf49-064f-41ca-aed9-a91fa362834f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:53:40 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-f12abf49-064f-41ca-aed9-a91fa362834f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:53:40 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-f12abf49-064f-41ca-aed9-a91fa362834f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75226) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 17 01:53:40 user nova-compute[75226]: INFO nova.compute.claims [None req-f12abf49-064f-41ca-aed9-a91fa362834f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: cd6a5eb8-8d48-4894-aff3-a9d04ae85aca] Claim successful on node user
Nov 17 01:53:40 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-f12abf49-064f-41ca-aed9-a91fa362834f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:53:40 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-f12abf49-064f-41ca-aed9-a91fa362834f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:53:40 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-f12abf49-064f-41ca-aed9-a91fa362834f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.207s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:53:40 user nova-compute[75226]: DEBUG nova.compute.manager [None req-f12abf49-064f-41ca-aed9-a91fa362834f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: cd6a5eb8-8d48-4894-aff3-a9d04ae85aca] Start building networks asynchronously for instance. {{(pid=75226) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 17 01:53:40 user nova-compute[75226]: DEBUG nova.compute.manager [None req-f12abf49-064f-41ca-aed9-a91fa362834f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: cd6a5eb8-8d48-4894-aff3-a9d04ae85aca] Allocating IP information in the background. {{(pid=75226) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 17 01:53:40 user nova-compute[75226]: DEBUG nova.network.neutron [None req-f12abf49-064f-41ca-aed9-a91fa362834f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: cd6a5eb8-8d48-4894-aff3-a9d04ae85aca] allocate_for_instance() {{(pid=75226) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 17 01:53:40 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-f12abf49-064f-41ca-aed9-a91fa362834f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: cd6a5eb8-8d48-4894-aff3-a9d04ae85aca] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 17 01:53:40 user nova-compute[75226]: DEBUG nova.compute.manager [None req-f12abf49-064f-41ca-aed9-a91fa362834f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: cd6a5eb8-8d48-4894-aff3-a9d04ae85aca] Start building block device mappings for instance. {{(pid=75226) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 17 01:53:40 user nova-compute[75226]: DEBUG nova.policy [None req-f12abf49-064f-41ca-aed9-a91fa362834f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7c8c8baa56884dcd9a90f0187c9fc06f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673620a69fba4a04af75baabe775dc8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75226) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 17 01:53:40 user nova-compute[75226]: INFO nova.virt.block_device [None req-f12abf49-064f-41ca-aed9-a91fa362834f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: cd6a5eb8-8d48-4894-aff3-a9d04ae85aca] Booting with volume 875a05e9-5133-418e-a210-0b01076d92a8 at /dev/vda
Nov 17 01:53:40 user nova-compute[75226]: DEBUG os_brick.utils [None req-f12abf49-064f-41ca-aed9-a91fa362834f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:53:40 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:53:40 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:53:40 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bbfb063-7ab6-4b4e-91bf-f707a08176e7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f62857db69\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:53:40 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:53:40 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:53:40 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fc7b9b3-73ae-457f-a37d-68e5eedd67c1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:53:40 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:53:40 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:53:40 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d880416-030a-484a-b4b3-21567330967b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:53:40 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7554d6b-6463-402a-9f9d-e5b9c3c68c80]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:53:40 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-f12abf49-064f-41ca-aed9-a91fa362834f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Running cmd (subprocess): nvme version {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:53:40 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-f12abf49-064f-41ca-aed9-a91fa362834f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] 'nvme version' failed. Not Retrying. {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 01:53:40 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f12abf49-064f-41ca-aed9-a91fa362834f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] nvme not present on system {{(pid=75226) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 17 01:53:40 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:53:40 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 01:53:40 user nova-compute[75226]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 17 01:53:40 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[4578808d-719b-4558-ab92-778022e47acd]: (4, '') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:53:40 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-f12abf49-064f-41ca-aed9-a91fa362834f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75226) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 17 01:53:40 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-f12abf49-064f-41ca-aed9-a91fa362834f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75226) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 17 01:53:40 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-f12abf49-064f-41ca-aed9-a91fa362834f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] LIGHTOS: no hostnqn found. {{(pid=75226) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 17 01:53:40 user nova-compute[75226]: DEBUG os_brick.utils [None req-f12abf49-064f-41ca-aed9-a91fa362834f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f62857db69', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:53:40 user nova-compute[75226]: DEBUG nova.virt.block_device [None req-f12abf49-064f-41ca-aed9-a91fa362834f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: cd6a5eb8-8d48-4894-aff3-a9d04ae85aca] Updating existing volume attachment record: bef54788-f81a-4348-904b-f7ba35db91e9 {{(pid=75226) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 17 01:53:40 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:53:40 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75226) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 17 01:53:41 user nova-compute[75226]: DEBUG nova.network.neutron [None req-f12abf49-064f-41ca-aed9-a91fa362834f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: cd6a5eb8-8d48-4894-aff3-a9d04ae85aca] Successfully created port: b9cd1004-903b-4e1d-ac1e-579f3de9ed98 {{(pid=75226) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 17 01:53:41 user nova-compute[75226]: DEBUG nova.network.neutron [None req-f12abf49-064f-41ca-aed9-a91fa362834f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: cd6a5eb8-8d48-4894-aff3-a9d04ae85aca] Successfully updated port: b9cd1004-903b-4e1d-ac1e-579f3de9ed98 {{(pid=75226) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 17 01:53:41 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-f12abf49-064f-41ca-aed9-a91fa362834f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Acquiring lock "refresh_cache-cd6a5eb8-8d48-4894-aff3-a9d04ae85aca" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:53:41 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-f12abf49-064f-41ca-aed9-a91fa362834f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Acquired lock "refresh_cache-cd6a5eb8-8d48-4894-aff3-a9d04ae85aca" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:53:41 user nova-compute[75226]: DEBUG nova.network.neutron [None req-f12abf49-064f-41ca-aed9-a91fa362834f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: cd6a5eb8-8d48-4894-aff3-a9d04ae85aca] Building network info cache for instance {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 01:53:41 user nova-compute[75226]: DEBUG nova.compute.manager [req-030ada97-613f-4299-bcb4-983a8a0886d4 req-57bf0bfb-a233-49be-9560-704e942363ea service nova] [instance: cd6a5eb8-8d48-4894-aff3-a9d04ae85aca] Received event network-changed-b9cd1004-903b-4e1d-ac1e-579f3de9ed98 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:53:41 user nova-compute[75226]: DEBUG nova.compute.manager [req-030ada97-613f-4299-bcb4-983a8a0886d4 req-57bf0bfb-a233-49be-9560-704e942363ea service nova] [instance: cd6a5eb8-8d48-4894-aff3-a9d04ae85aca] Refreshing instance network info cache due to event network-changed-b9cd1004-903b-4e1d-ac1e-579f3de9ed98. {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 01:53:41 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-030ada97-613f-4299-bcb4-983a8a0886d4 req-57bf0bfb-a233-49be-9560-704e942363ea service nova] Acquiring lock "refresh_cache-cd6a5eb8-8d48-4894-aff3-a9d04ae85aca" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:53:41 user nova-compute[75226]: DEBUG nova.network.neutron [None req-f12abf49-064f-41ca-aed9-a91fa362834f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: cd6a5eb8-8d48-4894-aff3-a9d04ae85aca] Instance cache missing network info. {{(pid=75226) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 17 01:53:41 user nova-compute[75226]: DEBUG nova.network.neutron [None req-f12abf49-064f-41ca-aed9-a91fa362834f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: cd6a5eb8-8d48-4894-aff3-a9d04ae85aca] Updating instance_info_cache with network_info: [{"id": "b9cd1004-903b-4e1d-ac1e-579f3de9ed98", "address": "fa:16:3e:fb:e6:d2", "network": {"id": "81bbbdad-218b-4fcd-b7f5-427fd49361cb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1151874504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "673620a69fba4a04af75baabe775dc8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9cd1004-90", "ovs_interfaceid": "b9cd1004-903b-4e1d-ac1e-579f3de9ed98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:53:41 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-f12abf49-064f-41ca-aed9-a91fa362834f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Releasing lock "refresh_cache-cd6a5eb8-8d48-4894-aff3-a9d04ae85aca" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:53:41 user nova-compute[75226]: DEBUG nova.compute.manager [None req-f12abf49-064f-41ca-aed9-a91fa362834f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: cd6a5eb8-8d48-4894-aff3-a9d04ae85aca] Instance network_info: |[{"id": "b9cd1004-903b-4e1d-ac1e-579f3de9ed98", "address": "fa:16:3e:fb:e6:d2", "network": {"id": "81bbbdad-218b-4fcd-b7f5-427fd49361cb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1151874504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "673620a69fba4a04af75baabe775dc8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9cd1004-90", "ovs_interfaceid": "b9cd1004-903b-4e1d-ac1e-579f3de9ed98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75226) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 17 01:53:41 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-030ada97-613f-4299-bcb4-983a8a0886d4 req-57bf0bfb-a233-49be-9560-704e942363ea service nova] Acquired lock "refresh_cache-cd6a5eb8-8d48-4894-aff3-a9d04ae85aca" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:53:41 user nova-compute[75226]: DEBUG nova.network.neutron [req-030ada97-613f-4299-bcb4-983a8a0886d4 req-57bf0bfb-a233-49be-9560-704e942363ea service nova] [instance: cd6a5eb8-8d48-4894-aff3-a9d04ae85aca] Refreshing network info cache for port b9cd1004-903b-4e1d-ac1e-579f3de9ed98 {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 01:53:42 user nova-compute[75226]: DEBUG nova.network.neutron [req-030ada97-613f-4299-bcb4-983a8a0886d4 req-57bf0bfb-a233-49be-9560-704e942363ea service nova] [instance: cd6a5eb8-8d48-4894-aff3-a9d04ae85aca] Updated VIF entry in instance network info cache for port b9cd1004-903b-4e1d-ac1e-579f3de9ed98. {{(pid=75226) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 01:53:42 user nova-compute[75226]: DEBUG nova.network.neutron [req-030ada97-613f-4299-bcb4-983a8a0886d4 req-57bf0bfb-a233-49be-9560-704e942363ea service nova] [instance: cd6a5eb8-8d48-4894-aff3-a9d04ae85aca] Updating instance_info_cache with network_info: [{"id": "b9cd1004-903b-4e1d-ac1e-579f3de9ed98", "address": "fa:16:3e:fb:e6:d2", "network": {"id": "81bbbdad-218b-4fcd-b7f5-427fd49361cb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1151874504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "673620a69fba4a04af75baabe775dc8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9cd1004-90", "ovs_interfaceid": "b9cd1004-903b-4e1d-ac1e-579f3de9ed98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:53:42 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-030ada97-613f-4299-bcb4-983a8a0886d4 req-57bf0bfb-a233-49be-9560-704e942363ea service nova] Releasing lock "refresh_cache-cd6a5eb8-8d48-4894-aff3-a9d04ae85aca" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:53:43 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:53:43 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:53:43 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Cleaning up deleted instances {{(pid=75226) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 17 01:53:43 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] There are 0 instances to clean {{(pid=75226) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 17 01:53:45 user nova-compute[75226]: DEBUG nova.compute.manager [None req-f12abf49-064f-41ca-aed9-a91fa362834f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: cd6a5eb8-8d48-4894-aff3-a9d04ae85aca] Start spawning the instance on the hypervisor. {{(pid=75226) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 17 01:53:45 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-f12abf49-064f-41ca-aed9-a91fa362834f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: cd6a5eb8-8d48-4894-aff3-a9d04ae85aca] Creating instance directory {{(pid=75226) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 17 01:53:45 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-f12abf49-064f-41ca-aed9-a91fa362834f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: cd6a5eb8-8d48-4894-aff3-a9d04ae85aca] Creating image(s)
Nov 17 01:53:45 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-f12abf49-064f-41ca-aed9-a91fa362834f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: cd6a5eb8-8d48-4894-aff3-a9d04ae85aca] Did not create local disks {{(pid=75226) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 17 01:53:45 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-f12abf49-064f-41ca-aed9-a91fa362834f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: cd6a5eb8-8d48-4894-aff3-a9d04ae85aca] Ensure instance console log exists: /opt/stack/data/nova/instances/cd6a5eb8-8d48-4894-aff3-a9d04ae85aca/console.log {{(pid=75226) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 17 01:53:45 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-f12abf49-064f-41ca-aed9-a91fa362834f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:53:45 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-f12abf49-064f-41ca-aed9-a91fa362834f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:53:45 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-f12abf49-064f-41ca-aed9-a91fa362834f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:53:45 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-f12abf49-064f-41ca-aed9-a91fa362834f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: cd6a5eb8-8d48-4894-aff3-a9d04ae85aca] Start _get_guest_xml network_info=[{"id": "b9cd1004-903b-4e1d-ac1e-579f3de9ed98", "address": "fa:16:3e:fb:e6:d2", "network": {"id": "81bbbdad-218b-4fcd-b7f5-427fd49361cb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1151874504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "673620a69fba4a04af75baabe775dc8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9cd1004-90", "ovs_interfaceid": "b9cd1004-903b-4e1d-ac1e-579f3de9ed98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:875a05e9-5133-418e-a210-0b01076d92a8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DMmFhyko', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'cd6a5eb8-8d48-4894-aff3-a9d04ae85aca', 'attached_at': '', 'detached_at': '', 'volume_id': '875a05e9-5133-418e-a210-0b01076d92a8', 'serial': '875a05e9-5133-418e-a210-0b01076d92a8'}, 'attachment_id': 'bef54788-f81a-4348-904b-f7ba35db91e9', 'device_type': 'disk', 'volume_type': None} {{(pid=75226) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 17 01:53:45 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-f12abf49-064f-41ca-aed9-a91fa362834f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:53:45 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-f12abf49-064f-41ca-aed9-a91fa362834f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:53:45 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-f12abf49-064f-41ca-aed9-a91fa362834f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75226) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 17 01:53:45 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-f12abf49-064f-41ca-aed9-a91fa362834f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] CPU controller missing on host. {{(pid=75226) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 17 01:53:45 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-f12abf49-064f-41ca-aed9-a91fa362834f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75226) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 17 01:53:45 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-f12abf49-064f-41ca-aed9-a91fa362834f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] CPU controller found on host. {{(pid=75226) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 17 01:53:45 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-f12abf49-064f-41ca-aed9-a91fa362834f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75226) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 17 01:53:45 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-f12abf49-064f-41ca-aed9-a91fa362834f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-17T01:13:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 17 01:53:45 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-f12abf49-064f-41ca-aed9-a91fa362834f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Flavor limits 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 17 01:53:45 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-f12abf49-064f-41ca-aed9-a91fa362834f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Image limits 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 17 01:53:45 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-f12abf49-064f-41ca-aed9-a91fa362834f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Flavor pref 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 17 01:53:45 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-f12abf49-064f-41ca-aed9-a91fa362834f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Image pref 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 17 01:53:45 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-f12abf49-064f-41ca-aed9-a91fa362834f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 17 01:53:45 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-f12abf49-064f-41ca-aed9-a91fa362834f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 17 01:53:45 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-f12abf49-064f-41ca-aed9-a91fa362834f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75226) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 17 01:53:45 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-f12abf49-064f-41ca-aed9-a91fa362834f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Got 1 possible topologies {{(pid=75226) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 17 01:53:45 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-f12abf49-064f-41ca-aed9-a91fa362834f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 17 01:53:45 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-f12abf49-064f-41ca-aed9-a91fa362834f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 17 01:53:45 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f12abf49-064f-41ca-aed9-a91fa362834f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: cd6a5eb8-8d48-4894-aff3-a9d04ae85aca] Calling os-brick to attach iSCSI Volume {{(pid=75226) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 17 01:53:45 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-f12abf49-064f-41ca-aed9-a91fa362834f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc4cc36b490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:875a05e9-5133-418e-a210-0b01076d92a8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DMmFhyko', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:53:45 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-f12abf49-064f-41ca-aed9-a91fa362834f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:53:45 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-f12abf49-064f-41ca-aed9-a91fa362834f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:53:45 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-f12abf49-064f-41ca-aed9-a91fa362834f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:53:45 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-f12abf49-064f-41ca-aed9-a91fa362834f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:53:45 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-f12abf49-064f-41ca-aed9-a91fa362834f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:875a05e9-5133-418e-a210-0b01076d92a8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:53:45 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-f12abf49-064f-41ca-aed9-a91fa362834f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:875a05e9-5133-418e-a210-0b01076d92a8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:53:45 user nova-compute[75226]: INFO os_brick.initiator.connectors.iscsi [None req-f12abf49-064f-41ca-aed9-a91fa362834f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 17 01:53:45 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:875a05e9-5133-418e-a210-0b01076d92a8 -p 172.16.0.220:3260 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:53:45 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:875a05e9-5133-418e-a210-0b01076d92a8 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:53:45 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[04c01946-f435-4bec-93aa-df0efa388c3b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:53:45 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-f12abf49-064f-41ca-aed9-a91fa362834f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 17 01:53:45 user nova-compute[75226]:  {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:53:45 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:875a05e9-5133-418e-a210-0b01076d92a8 -p 172.16.0.220:3260 --interface default --op new {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:53:45 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:875a05e9-5133-418e-a210-0b01076d92a8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:53:45 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[72a149f6-fd35-492e-93be-f13d29ace579]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:875a05e9-5133-418e-a210-0b01076d92a8] added\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:53:45 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-f12abf49-064f-41ca-aed9-a91fa362834f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:875a05e9-5133-418e-a210-0b01076d92a8] added
Nov 17 01:53:45 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:53:45 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:875a05e9-5133-418e-a210-0b01076d92a8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:53:45 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:875a05e9-5133-418e-a210-0b01076d92a8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:53:45 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e208e6a-0b9d-4d8d-8be0-53d41ef73728]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:53:45 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-f12abf49-064f-41ca-aed9-a91fa362834f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:53:45 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:875a05e9-5133-418e-a210-0b01076d92a8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:53:45 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:875a05e9-5133-418e-a210-0b01076d92a8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:53:45 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[982b5529-95cb-414b-849d-2852d1b7cdc2]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:53:45 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-f12abf49-064f-41ca-aed9-a91fa362834f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:53:45 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:875a05e9-5133-418e-a210-0b01076d92a8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DMmFhyko {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:53:45 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:875a05e9-5133-418e-a210-0b01076d92a8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DMmFhyko" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:53:45 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2a8764f-6f31-4e9e-812d-f1a61b8e1de6]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:53:45 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-f12abf49-064f-41ca-aed9-a91fa362834f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DMmFhyko'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:53:45 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:875a05e9-5133-418e-a210-0b01076d92a8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:53:46 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:875a05e9-5133-418e-a210-0b01076d92a8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:53:46 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[35c1d318-0e0b-4de9-92a9-b14062eb3327]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:53:46 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-f12abf49-064f-41ca-aed9-a91fa362834f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:53:46 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:53:46 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:53:46 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1e4f02b-1008-4c37-a521-08b61ff55ead]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:53:46 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-f12abf49-064f-41ca-aed9-a91fa362834f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 17 01:53:46 user nova-compute[75226]:  {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:53:46 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-f12abf49-064f-41ca-aed9-a91fa362834f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 17 01:53:46 user nova-compute[75226]:  {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:53:46 user nova-compute[75226]: WARNING os_brick.initiator.connectors.iscsi [None req-f12abf49-064f-41ca-aed9-a91fa362834f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 17 01:53:46 user nova-compute[75226]: 
Nov 17 01:53:46 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:875a05e9-5133-418e-a210-0b01076d92a8 -p 172.16.0.220:3260 --login {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:53:46 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:875a05e9-5133-418e-a210-0b01076d92a8 -p 172.16.0.220:3260 --login" returned: 0 in 0.042s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:53:46 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[59d25b59-cce1-4268-81e3-8395ac3bb675]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:875a05e9-5133-418e-a210-0b01076d92a8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:875a05e9-5133-418e-a210-0b01076d92a8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:53:46 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-f12abf49-064f-41ca-aed9-a91fa362834f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:875a05e9-5133-418e-a210-0b01076d92a8, portal: 172.16.0.220,3260]
Nov 17 01:53:46 user nova-compute[75226]: Login to [iface: default, target: iqn.2010-10.org.openstack:875a05e9-5133-418e-a210-0b01076d92a8, portal: 172.16.0.220,3260] successful.
Nov 17 01:53:46 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:53:46 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:875a05e9-5133-418e-a210-0b01076d92a8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:53:46 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:875a05e9-5133-418e-a210-0b01076d92a8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:53:46 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a234011-b8c9-40f2-96b9-d2ddc32b83af]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:53:46 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-f12abf49-064f-41ca-aed9-a91fa362834f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:53:46 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:53:46 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:53:46 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b209fde-8211-49f7-a93a-d40721eb73b7]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:875a05e9-5133-418e-a210-0b01076d92a8 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:53:46 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-f12abf49-064f-41ca-aed9-a91fa362834f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:875a05e9-5133-418e-a210-0b01076d92a8 (non-flash)
Nov 17 01:53:46 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:53:46 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-f12abf49-064f-41ca-aed9-a91fa362834f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:875a05e9-5133-418e-a210-0b01076d92a8 (non-flash)
Nov 17 01:53:46 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:53:46 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-f12abf49-064f-41ca-aed9-a91fa362834f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:875a05e9-5133-418e-a210-0b01076d92a8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.243s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:53:46 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-f12abf49-064f-41ca-aed9-a91fa362834f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Connected to 172.16.0.220:3260 {{(pid=75226) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 17 01:53:46 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-f12abf49-064f-41ca-aed9-a91fa362834f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] HCTL ('33', '-', '-', 0) found on session 62 with lun 0 {{(pid=75226) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 17 01:53:46 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-f12abf49-064f-41ca-aed9-a91fa362834f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75226) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 17 01:53:46 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:53:46 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:53:46 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[50fc5ab8-02eb-44df-a0f9-b2f1a3b560ff]: (4, ('- - 0', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:53:46 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-f12abf49-064f-41ca-aed9-a91fa362834f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Searching for a device in session 62 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75226) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 01:53:46 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-f12abf49-064f-41ca-aed9-a91fa362834f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:875a05e9-5133-418e-a210-0b01076d92a8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DMmFhyko', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75226) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 17 01:53:46 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:53:47 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-f12abf49-064f-41ca-aed9-a91fa362834f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.275s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:53:47 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-f12abf49-064f-41ca-aed9-a91fa362834f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] <== connect_volume: return (1276ms) {'type': 'block', 'scsi_wwn': '23232616434323239', 'path': '/dev/sdb'} {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:53:47 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f12abf49-064f-41ca-aed9-a91fa362834f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: cd6a5eb8-8d48-4894-aff3-a9d04ae85aca] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23232616434323239', 'path': '/dev/sdb'} {{(pid=75226) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 17 01:53:47 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-f12abf49-064f-41ca-aed9-a91fa362834f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:53:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1147170578',display_name='tempest-TestVolumeBootPattern-server-1147170578',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1147170578',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIOTXvx1rt0huiJMkCirjSAkUEIOTUxZuP5hnGbb4TZayM1DPwV+2un52eKf78XfXFJdTcPGOcA7AeRAFw+1gTwHIAhQ08B/zT7NrklMaP31fH3B8tWT2/QeOIfwk/TlfQ==',key_name='tempest-TestVolumeBootPattern-346525006',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='673620a69fba4a04af75baabe775dc8b',ramdisk_id='',reservation_id='r-cvvzgvy7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-971654489',owner_user_name='tempest-TestVolumeBootPattern-971654489-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T01:53:40Z,user_data=None,user_id='7c8c8baa56884dcd9a90f0187c9fc06f',uuid=cd6a5eb8-8d48-4894-aff3-a9d04ae85aca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b9cd1004-903b-4e1d-ac1e-579f3de9ed98", "address": "fa:16:3e:fb:e6:d2", "network": {"id": "81bbbdad-218b-4fcd-b7f5-427fd49361cb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1151874504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "673620a69fba4a04af75baabe775dc8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9cd1004-90", "ovs_interfaceid": "b9cd1004-903b-4e1d-ac1e-579f3de9ed98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75226) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 01:53:47 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-f12abf49-064f-41ca-aed9-a91fa362834f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Converting VIF {"id": "b9cd1004-903b-4e1d-ac1e-579f3de9ed98", "address": "fa:16:3e:fb:e6:d2", "network": {"id": "81bbbdad-218b-4fcd-b7f5-427fd49361cb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1151874504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "673620a69fba4a04af75baabe775dc8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9cd1004-90", "ovs_interfaceid": "b9cd1004-903b-4e1d-ac1e-579f3de9ed98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:53:47 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-f12abf49-064f-41ca-aed9-a91fa362834f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:e6:d2,bridge_name='br-int',has_traffic_filtering=True,id=b9cd1004-903b-4e1d-ac1e-579f3de9ed98,network=Network(81bbbdad-218b-4fcd-b7f5-427fd49361cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9cd1004-90') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:53:47 user nova-compute[75226]: DEBUG nova.objects.instance [None req-f12abf49-064f-41ca-aed9-a91fa362834f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Lazy-loading 'pci_devices' on Instance uuid cd6a5eb8-8d48-4894-aff3-a9d04ae85aca {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:53:47 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-f12abf49-064f-41ca-aed9-a91fa362834f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: cd6a5eb8-8d48-4894-aff3-a9d04ae85aca] End _get_guest_xml xml=<domain type="kvm">
Nov 17 01:53:47 user nova-compute[75226]:   <uuid>cd6a5eb8-8d48-4894-aff3-a9d04ae85aca</uuid>
Nov 17 01:53:47 user nova-compute[75226]:   <name>instance-00000033</name>
Nov 17 01:53:47 user nova-compute[75226]:   <memory>524288</memory>
Nov 17 01:53:47 user nova-compute[75226]:   <vcpu>1</vcpu>
Nov 17 01:53:47 user nova-compute[75226]:   <metadata>
Nov 17 01:53:47 user nova-compute[75226]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 17 01:53:47 user nova-compute[75226]:       <nova:package version="0.0.0"/>
Nov 17 01:53:47 user nova-compute[75226]:       <nova:name>tempest-TestVolumeBootPattern-server-1147170578</nova:name>
Nov 17 01:53:47 user nova-compute[75226]:       <nova:creationTime>2023-11-17 01:53:45</nova:creationTime>
Nov 17 01:53:47 user nova-compute[75226]:       <nova:flavor name="m1.tiny">
Nov 17 01:53:47 user nova-compute[75226]:         <nova:memory>512</nova:memory>
Nov 17 01:53:47 user nova-compute[75226]:         <nova:disk>1</nova:disk>
Nov 17 01:53:47 user nova-compute[75226]:         <nova:swap>0</nova:swap>
Nov 17 01:53:47 user nova-compute[75226]:         <nova:ephemeral>0</nova:ephemeral>
Nov 17 01:53:47 user nova-compute[75226]:         <nova:vcpus>1</nova:vcpus>
Nov 17 01:53:47 user nova-compute[75226]:       </nova:flavor>
Nov 17 01:53:47 user nova-compute[75226]:       <nova:owner>
Nov 17 01:53:47 user nova-compute[75226]:         <nova:user uuid="7c8c8baa56884dcd9a90f0187c9fc06f">tempest-TestVolumeBootPattern-971654489-project-member</nova:user>
Nov 17 01:53:47 user nova-compute[75226]:         <nova:project uuid="673620a69fba4a04af75baabe775dc8b">tempest-TestVolumeBootPattern-971654489</nova:project>
Nov 17 01:53:47 user nova-compute[75226]:       </nova:owner>
Nov 17 01:53:47 user nova-compute[75226]:       <nova:ports>
Nov 17 01:53:47 user nova-compute[75226]:         <nova:port uuid="b9cd1004-903b-4e1d-ac1e-579f3de9ed98">
Nov 17 01:53:47 user nova-compute[75226]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 17 01:53:47 user nova-compute[75226]:         </nova:port>
Nov 17 01:53:47 user nova-compute[75226]:       </nova:ports>
Nov 17 01:53:47 user nova-compute[75226]:     </nova:instance>
Nov 17 01:53:47 user nova-compute[75226]:   </metadata>
Nov 17 01:53:47 user nova-compute[75226]:   <sysinfo type="smbios">
Nov 17 01:53:47 user nova-compute[75226]:     <system>
Nov 17 01:53:47 user nova-compute[75226]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 17 01:53:47 user nova-compute[75226]:       <entry name="product">OpenStack Nova</entry>
Nov 17 01:53:47 user nova-compute[75226]:       <entry name="version">0.0.0</entry>
Nov 17 01:53:47 user nova-compute[75226]:       <entry name="serial">cd6a5eb8-8d48-4894-aff3-a9d04ae85aca</entry>
Nov 17 01:53:47 user nova-compute[75226]:       <entry name="uuid">cd6a5eb8-8d48-4894-aff3-a9d04ae85aca</entry>
Nov 17 01:53:47 user nova-compute[75226]:       <entry name="family">Virtual Machine</entry>
Nov 17 01:53:47 user nova-compute[75226]:     </system>
Nov 17 01:53:47 user nova-compute[75226]:   </sysinfo>
Nov 17 01:53:47 user nova-compute[75226]:   <os>
Nov 17 01:53:47 user nova-compute[75226]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 17 01:53:47 user nova-compute[75226]:     <boot dev="hd"/>
Nov 17 01:53:47 user nova-compute[75226]:     <smbios mode="sysinfo"/>
Nov 17 01:53:47 user nova-compute[75226]:   </os>
Nov 17 01:53:47 user nova-compute[75226]:   <features>
Nov 17 01:53:47 user nova-compute[75226]:     <acpi/>
Nov 17 01:53:47 user nova-compute[75226]:     <apic/>
Nov 17 01:53:47 user nova-compute[75226]:     <vmcoreinfo/>
Nov 17 01:53:47 user nova-compute[75226]:   </features>
Nov 17 01:53:47 user nova-compute[75226]:   <clock offset="utc">
Nov 17 01:53:47 user nova-compute[75226]:     <timer name="pit" tickpolicy="delay"/>
Nov 17 01:53:47 user nova-compute[75226]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 17 01:53:47 user nova-compute[75226]:     <timer name="hpet" present="no"/>
Nov 17 01:53:47 user nova-compute[75226]:   </clock>
Nov 17 01:53:47 user nova-compute[75226]:   <cpu mode="custom" match="exact">
Nov 17 01:53:47 user nova-compute[75226]:     <model>Nehalem</model>
Nov 17 01:53:47 user nova-compute[75226]:     <topology sockets="1" cores="1" threads="1"/>
Nov 17 01:53:47 user nova-compute[75226]:   </cpu>
Nov 17 01:53:47 user nova-compute[75226]:   <devices>
Nov 17 01:53:47 user nova-compute[75226]:     <disk type="block" device="disk">
Nov 17 01:53:47 user nova-compute[75226]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 01:53:47 user nova-compute[75226]:       <source dev="/dev/sdb"/>
Nov 17 01:53:47 user nova-compute[75226]:       <target dev="vda" bus="virtio"/>
Nov 17 01:53:47 user nova-compute[75226]:       <serial>875a05e9-5133-418e-a210-0b01076d92a8</serial>
Nov 17 01:53:47 user nova-compute[75226]:     </disk>
Nov 17 01:53:47 user nova-compute[75226]:     <interface type="ethernet">
Nov 17 01:53:47 user nova-compute[75226]:       <mac address="fa:16:3e:fb:e6:d2"/>
Nov 17 01:53:47 user nova-compute[75226]:       <model type="virtio"/>
Nov 17 01:53:47 user nova-compute[75226]:       <mtu size="1442"/>
Nov 17 01:53:47 user nova-compute[75226]:       <target dev="tapb9cd1004-90"/>
Nov 17 01:53:47 user nova-compute[75226]:     </interface>
Nov 17 01:53:47 user nova-compute[75226]:     <serial type="pty">
Nov 17 01:53:47 user nova-compute[75226]:       <log file="/opt/stack/data/nova/instances/cd6a5eb8-8d48-4894-aff3-a9d04ae85aca/console.log" append="off"/>
Nov 17 01:53:47 user nova-compute[75226]:     </serial>
Nov 17 01:53:47 user nova-compute[75226]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 17 01:53:47 user nova-compute[75226]:     <video>
Nov 17 01:53:47 user nova-compute[75226]:       <model type="virtio"/>
Nov 17 01:53:47 user nova-compute[75226]:     </video>
Nov 17 01:53:47 user nova-compute[75226]:     <rng model="virtio">
Nov 17 01:53:47 user nova-compute[75226]:       <backend model="random">/dev/urandom</backend>
Nov 17 01:53:47 user nova-compute[75226]:     </rng>
Nov 17 01:53:47 user nova-compute[75226]:     <controller type="usb" index="0" model="none"/>
Nov 17 01:53:47 user nova-compute[75226]:     <memballoon model="virtio">
Nov 17 01:53:47 user nova-compute[75226]:       <stats period="10"/>
Nov 17 01:53:47 user nova-compute[75226]:     </memballoon>
Nov 17 01:53:47 user nova-compute[75226]:   </devices>
Nov 17 01:53:47 user nova-compute[75226]: </domain>
Nov 17 01:53:47 user nova-compute[75226]:  {{(pid=75226) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 17 01:53:47 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-f12abf49-064f-41ca-aed9-a91fa362834f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:53:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1147170578',display_name='tempest-TestVolumeBootPattern-server-1147170578',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1147170578',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIOTXvx1rt0huiJMkCirjSAkUEIOTUxZuP5hnGbb4TZayM1DPwV+2un52eKf78XfXFJdTcPGOcA7AeRAFw+1gTwHIAhQ08B/zT7NrklMaP31fH3B8tWT2/QeOIfwk/TlfQ==',key_name='tempest-TestVolumeBootPattern-346525006',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='673620a69fba4a04af75baabe775dc8b',ramdisk_id='',reservation_id='r-cvvzgvy7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-971654489',owner_user_name='tempest-TestVolumeBootPattern-971654489-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T01:53:40Z,user_data=None,user_id='7c8c8baa56884dcd9a90f0187c9fc06f',uuid=cd6a5eb8-8d48-4894-aff3-a9d04ae85aca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b9cd1004-903b-4e1d-ac1e-579f3de9ed98", "address": "fa:16:3e:fb:e6:d2", "network": {"id": "81bbbdad-218b-4fcd-b7f5-427fd49361cb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1151874504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "673620a69fba4a04af75baabe775dc8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9cd1004-90", "ovs_interfaceid": "b9cd1004-903b-4e1d-ac1e-579f3de9ed98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 17 01:53:47 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-f12abf49-064f-41ca-aed9-a91fa362834f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Converting VIF {"id": "b9cd1004-903b-4e1d-ac1e-579f3de9ed98", "address": "fa:16:3e:fb:e6:d2", "network": {"id": "81bbbdad-218b-4fcd-b7f5-427fd49361cb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1151874504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "673620a69fba4a04af75baabe775dc8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9cd1004-90", "ovs_interfaceid": "b9cd1004-903b-4e1d-ac1e-579f3de9ed98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:53:47 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-f12abf49-064f-41ca-aed9-a91fa362834f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:e6:d2,bridge_name='br-int',has_traffic_filtering=True,id=b9cd1004-903b-4e1d-ac1e-579f3de9ed98,network=Network(81bbbdad-218b-4fcd-b7f5-427fd49361cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9cd1004-90') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:53:47 user nova-compute[75226]: DEBUG os_vif [None req-f12abf49-064f-41ca-aed9-a91fa362834f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:e6:d2,bridge_name='br-int',has_traffic_filtering=True,id=b9cd1004-903b-4e1d-ac1e-579f3de9ed98,network=Network(81bbbdad-218b-4fcd-b7f5-427fd49361cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9cd1004-90') {{(pid=75226) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 17 01:53:47 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:53:47 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:53:47 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 17 01:53:47 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:53:47 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '82f2d04b-2c9c-5f0c-a0d1-f210c5ed7d28', '_type': 'linux-noop'}}, row=False) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:53:47 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:53:47 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:53:47 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb9cd1004-90, may_exist=True, interface_attrs={}) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:53:47 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb9cd1004-90, col_values=(('qos', UUID('cbb99991-622a-40aa-9a77-819d3f8be8d4')),), if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:53:47 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb9cd1004-90, col_values=(('external_ids', {'iface-id': 'b9cd1004-903b-4e1d-ac1e-579f3de9ed98', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fb:e6:d2', 'vm-uuid': 'cd6a5eb8-8d48-4894-aff3-a9d04ae85aca'}),), if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:53:47 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:53:47 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:53:47 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:53:47 user nova-compute[75226]: INFO os_vif [None req-f12abf49-064f-41ca-aed9-a91fa362834f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:e6:d2,bridge_name='br-int',has_traffic_filtering=True,id=b9cd1004-903b-4e1d-ac1e-579f3de9ed98,network=Network(81bbbdad-218b-4fcd-b7f5-427fd49361cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9cd1004-90')
Nov 17 01:53:47 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-f12abf49-064f-41ca-aed9-a91fa362834f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] No BDM found with device name vda, not building metadata. {{(pid=75226) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 01:53:47 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-f12abf49-064f-41ca-aed9-a91fa362834f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] No VIF found with MAC fa:16:3e:fb:e6:d2, not building metadata {{(pid=75226) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 01:53:48 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:53:48 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:53:48 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:53:48 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:53:48 user nova-compute[75226]: DEBUG nova.compute.manager [req-68cc9f4c-476e-481a-bfee-2d1dd2925378 req-93321890-7582-4ecb-8922-0562ebe10754 service nova] [instance: cd6a5eb8-8d48-4894-aff3-a9d04ae85aca] Received event network-vif-plugged-b9cd1004-903b-4e1d-ac1e-579f3de9ed98 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:53:48 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-68cc9f4c-476e-481a-bfee-2d1dd2925378 req-93321890-7582-4ecb-8922-0562ebe10754 service nova] Acquiring lock "cd6a5eb8-8d48-4894-aff3-a9d04ae85aca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:53:48 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-68cc9f4c-476e-481a-bfee-2d1dd2925378 req-93321890-7582-4ecb-8922-0562ebe10754 service nova] Lock "cd6a5eb8-8d48-4894-aff3-a9d04ae85aca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:53:48 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-68cc9f4c-476e-481a-bfee-2d1dd2925378 req-93321890-7582-4ecb-8922-0562ebe10754 service nova] Lock "cd6a5eb8-8d48-4894-aff3-a9d04ae85aca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:53:48 user nova-compute[75226]: DEBUG nova.compute.manager [req-68cc9f4c-476e-481a-bfee-2d1dd2925378 req-93321890-7582-4ecb-8922-0562ebe10754 service nova] [instance: cd6a5eb8-8d48-4894-aff3-a9d04ae85aca] No waiting events found dispatching network-vif-plugged-b9cd1004-903b-4e1d-ac1e-579f3de9ed98 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:53:48 user nova-compute[75226]: WARNING nova.compute.manager [req-68cc9f4c-476e-481a-bfee-2d1dd2925378 req-93321890-7582-4ecb-8922-0562ebe10754 service nova] [instance: cd6a5eb8-8d48-4894-aff3-a9d04ae85aca] Received unexpected event network-vif-plugged-b9cd1004-903b-4e1d-ac1e-579f3de9ed98 for instance with vm_state building and task_state spawning.
Nov 17 01:53:49 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:53:49 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:53:50 user nova-compute[75226]: DEBUG nova.compute.manager [None req-f12abf49-064f-41ca-aed9-a91fa362834f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: cd6a5eb8-8d48-4894-aff3-a9d04ae85aca] Instance event wait completed in 0 seconds for  {{(pid=75226) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 17 01:53:50 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-f12abf49-064f-41ca-aed9-a91fa362834f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: cd6a5eb8-8d48-4894-aff3-a9d04ae85aca] Guest created on hypervisor {{(pid=75226) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 17 01:53:50 user nova-compute[75226]: INFO nova.virt.libvirt.driver [-] [instance: cd6a5eb8-8d48-4894-aff3-a9d04ae85aca] Instance spawned successfully.
Nov 17 01:53:50 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-f12abf49-064f-41ca-aed9-a91fa362834f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: cd6a5eb8-8d48-4894-aff3-a9d04ae85aca] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 17 01:53:50 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-f12abf49-064f-41ca-aed9-a91fa362834f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: cd6a5eb8-8d48-4894-aff3-a9d04ae85aca] Found default for hw_cdrom_bus of ide {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:53:50 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-f12abf49-064f-41ca-aed9-a91fa362834f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: cd6a5eb8-8d48-4894-aff3-a9d04ae85aca] Found default for hw_disk_bus of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:53:50 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-f12abf49-064f-41ca-aed9-a91fa362834f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: cd6a5eb8-8d48-4894-aff3-a9d04ae85aca] Found default for hw_input_bus of None {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:53:50 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-f12abf49-064f-41ca-aed9-a91fa362834f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: cd6a5eb8-8d48-4894-aff3-a9d04ae85aca] Found default for hw_pointer_model of None {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:53:50 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-f12abf49-064f-41ca-aed9-a91fa362834f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: cd6a5eb8-8d48-4894-aff3-a9d04ae85aca] Found default for hw_video_model of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:53:50 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-f12abf49-064f-41ca-aed9-a91fa362834f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: cd6a5eb8-8d48-4894-aff3-a9d04ae85aca] Found default for hw_vif_model of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:53:50 user nova-compute[75226]: DEBUG nova.compute.manager [req-a1effc12-41de-4dfc-ac7a-7b6df87be463 req-532e7502-56ce-4c32-87bd-e0ce034edc80 service nova] [instance: cd6a5eb8-8d48-4894-aff3-a9d04ae85aca] Received event network-vif-plugged-b9cd1004-903b-4e1d-ac1e-579f3de9ed98 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:53:50 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-a1effc12-41de-4dfc-ac7a-7b6df87be463 req-532e7502-56ce-4c32-87bd-e0ce034edc80 service nova] Acquiring lock "cd6a5eb8-8d48-4894-aff3-a9d04ae85aca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:53:50 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-a1effc12-41de-4dfc-ac7a-7b6df87be463 req-532e7502-56ce-4c32-87bd-e0ce034edc80 service nova] Lock "cd6a5eb8-8d48-4894-aff3-a9d04ae85aca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:53:50 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-a1effc12-41de-4dfc-ac7a-7b6df87be463 req-532e7502-56ce-4c32-87bd-e0ce034edc80 service nova] Lock "cd6a5eb8-8d48-4894-aff3-a9d04ae85aca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:53:50 user nova-compute[75226]: DEBUG nova.compute.manager [req-a1effc12-41de-4dfc-ac7a-7b6df87be463 req-532e7502-56ce-4c32-87bd-e0ce034edc80 service nova] [instance: cd6a5eb8-8d48-4894-aff3-a9d04ae85aca] No waiting events found dispatching network-vif-plugged-b9cd1004-903b-4e1d-ac1e-579f3de9ed98 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:53:50 user nova-compute[75226]: WARNING nova.compute.manager [req-a1effc12-41de-4dfc-ac7a-7b6df87be463 req-532e7502-56ce-4c32-87bd-e0ce034edc80 service nova] [instance: cd6a5eb8-8d48-4894-aff3-a9d04ae85aca] Received unexpected event network-vif-plugged-b9cd1004-903b-4e1d-ac1e-579f3de9ed98 for instance with vm_state building and task_state spawning.
Nov 17 01:53:50 user nova-compute[75226]: INFO nova.compute.manager [None req-f12abf49-064f-41ca-aed9-a91fa362834f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: cd6a5eb8-8d48-4894-aff3-a9d04ae85aca] Took 5.00 seconds to spawn the instance on the hypervisor.
Nov 17 01:53:50 user nova-compute[75226]: DEBUG nova.compute.manager [None req-f12abf49-064f-41ca-aed9-a91fa362834f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: cd6a5eb8-8d48-4894-aff3-a9d04ae85aca] Checking state {{(pid=75226) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 01:53:50 user nova-compute[75226]: INFO nova.compute.manager [None req-f12abf49-064f-41ca-aed9-a91fa362834f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: cd6a5eb8-8d48-4894-aff3-a9d04ae85aca] Took 10.86 seconds to build instance.
Nov 17 01:53:50 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-f12abf49-064f-41ca-aed9-a91fa362834f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Lock "cd6a5eb8-8d48-4894-aff3-a9d04ae85aca" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.944s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:53:52 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:53:53 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:53:57 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:54:02 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:54:07 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:54:08 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:54:12 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:54:13 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:54:17 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:54:18 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:54:19 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:54:19 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:54:19 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:54:19 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:54:19 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75226) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 17 01:54:20 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75226) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 01:54:20 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:54:20 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:54:20 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Hypervisor/Node resource view: name=user free_ram=9035MB free_disk=24.964900970458984GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75226) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 17 01:54:20 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:54:20 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:54:20 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance cd6a5eb8-8d48-4894-aff3-a9d04ae85aca actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:54:20 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75226) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 17 01:54:20 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75226) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 17 01:54:20 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Refreshing inventories for resource provider f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 17 01:54:20 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Updating ProviderTree inventory for provider f431122b-abb2-4ecb-9e21-e3ec333d823b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 17 01:54:20 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Updating inventory in ProviderTree for provider f431122b-abb2-4ecb-9e21-e3ec333d823b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 17 01:54:20 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Refreshing aggregate associations for resource provider f431122b-abb2-4ecb-9e21-e3ec333d823b, aggregates: None {{(pid=75226) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 17 01:54:20 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Refreshing trait associations for resource provider f431122b-abb2-4ecb-9e21-e3ec333d823b, traits: COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE42,HW_CPU_X86_SSE,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSSE3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_SATA {{(pid=75226) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 17 01:54:20 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:54:20 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:54:20 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Compute_service record updated for user:user {{(pid=75226) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 17 01:54:20 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.282s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:54:22 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:54:27 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:54:27 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:54:27 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:54:29 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:54:31 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:54:31 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75226) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 17 01:54:32 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:54:32 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:54:32 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75226) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 17 01:54:32 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75226) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 01:54:32 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75226) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 01:54:32 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:54:33 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:54:33 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Starting heal instance info cache {{(pid=75226) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 17 01:54:33 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Rebuilding the list of instances to heal {{(pid=75226) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 17 01:54:34 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "refresh_cache-cd6a5eb8-8d48-4894-aff3-a9d04ae85aca" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:54:34 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquired lock "refresh_cache-cd6a5eb8-8d48-4894-aff3-a9d04ae85aca" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:54:34 user nova-compute[75226]: DEBUG nova.network.neutron [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] [instance: cd6a5eb8-8d48-4894-aff3-a9d04ae85aca] Forcefully refreshing network info cache for instance {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 17 01:54:34 user nova-compute[75226]: DEBUG nova.objects.instance [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lazy-loading 'info_cache' on Instance uuid cd6a5eb8-8d48-4894-aff3-a9d04ae85aca {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:54:34 user nova-compute[75226]: DEBUG nova.network.neutron [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] [instance: cd6a5eb8-8d48-4894-aff3-a9d04ae85aca] Updating instance_info_cache with network_info: [{"id": "b9cd1004-903b-4e1d-ac1e-579f3de9ed98", "address": "fa:16:3e:fb:e6:d2", "network": {"id": "81bbbdad-218b-4fcd-b7f5-427fd49361cb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1151874504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "673620a69fba4a04af75baabe775dc8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9cd1004-90", "ovs_interfaceid": "b9cd1004-903b-4e1d-ac1e-579f3de9ed98", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:54:34 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Releasing lock "refresh_cache-cd6a5eb8-8d48-4894-aff3-a9d04ae85aca" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:54:34 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] [instance: cd6a5eb8-8d48-4894-aff3-a9d04ae85aca] Updated the network info_cache for instance {{(pid=75226) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 17 01:54:35 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:54:35 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:54:36 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:54:37 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:54:37 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:54:37 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75226) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 17 01:54:37 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75226) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 01:54:37 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75226) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 01:54:37 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:54:37 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:54:37 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Triggering sync for uuid cd6a5eb8-8d48-4894-aff3-a9d04ae85aca {{(pid=75226) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 17 01:54:37 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "cd6a5eb8-8d48-4894-aff3-a9d04ae85aca" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:54:37 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "cd6a5eb8-8d48-4894-aff3-a9d04ae85aca" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:54:37 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "cd6a5eb8-8d48-4894-aff3-a9d04ae85aca" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.028s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:54:42 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:54:42 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:54:42 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75226) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 17 01:54:42 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75226) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 01:54:42 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75226) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 01:54:42 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:54:47 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:54:52 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:54:57 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:54:57 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:54:57 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75226) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 17 01:54:57 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75226) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 01:54:57 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75226) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 01:54:57 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:55:02 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:55:07 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:55:12 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:55:12 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:55:12 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75226) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 17 01:55:12 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75226) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 01:55:12 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75226) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 01:55:12 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:55:17 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:55:17 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:55:17 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75226) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 17 01:55:17 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75226) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 01:55:17 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75226) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 01:55:17 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:55:21 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:55:21 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:55:21 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:55:21 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:55:21 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75226) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 17 01:55:22 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75226) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 01:55:22 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:55:22 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:55:22 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:55:22 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Hypervisor/Node resource view: name=user free_ram=9063MB free_disk=24.964336395263672GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75226) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 17 01:55:22 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:55:22 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:55:22 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance cd6a5eb8-8d48-4894-aff3-a9d04ae85aca actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:55:22 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75226) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 17 01:55:22 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75226) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 17 01:55:22 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:55:22 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:55:22 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Compute_service record updated for user:user {{(pid=75226) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 17 01:55:22 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.149s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:55:27 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:55:27 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:55:28 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:55:30 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:55:31 user nova-compute[75226]: DEBUG nova.compute.manager [req-8ba0d918-2804-4c77-9cc5-6ade4bda28a9 req-4ff0cdb8-e969-4d85-a2ee-a78051f16a5b service nova] [instance: cd6a5eb8-8d48-4894-aff3-a9d04ae85aca] Received event network-changed-b9cd1004-903b-4e1d-ac1e-579f3de9ed98 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:55:31 user nova-compute[75226]: DEBUG nova.compute.manager [req-8ba0d918-2804-4c77-9cc5-6ade4bda28a9 req-4ff0cdb8-e969-4d85-a2ee-a78051f16a5b service nova] [instance: cd6a5eb8-8d48-4894-aff3-a9d04ae85aca] Refreshing instance network info cache due to event network-changed-b9cd1004-903b-4e1d-ac1e-579f3de9ed98. {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 01:55:31 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-8ba0d918-2804-4c77-9cc5-6ade4bda28a9 req-4ff0cdb8-e969-4d85-a2ee-a78051f16a5b service nova] Acquiring lock "refresh_cache-cd6a5eb8-8d48-4894-aff3-a9d04ae85aca" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:55:31 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-8ba0d918-2804-4c77-9cc5-6ade4bda28a9 req-4ff0cdb8-e969-4d85-a2ee-a78051f16a5b service nova] Acquired lock "refresh_cache-cd6a5eb8-8d48-4894-aff3-a9d04ae85aca" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:55:31 user nova-compute[75226]: DEBUG nova.network.neutron [req-8ba0d918-2804-4c77-9cc5-6ade4bda28a9 req-4ff0cdb8-e969-4d85-a2ee-a78051f16a5b service nova] [instance: cd6a5eb8-8d48-4894-aff3-a9d04ae85aca] Refreshing network info cache for port b9cd1004-903b-4e1d-ac1e-579f3de9ed98 {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 01:55:31 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:55:32 user nova-compute[75226]: DEBUG nova.network.neutron [req-8ba0d918-2804-4c77-9cc5-6ade4bda28a9 req-4ff0cdb8-e969-4d85-a2ee-a78051f16a5b service nova] [instance: cd6a5eb8-8d48-4894-aff3-a9d04ae85aca] Updated VIF entry in instance network info cache for port b9cd1004-903b-4e1d-ac1e-579f3de9ed98. {{(pid=75226) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 01:55:32 user nova-compute[75226]: DEBUG nova.network.neutron [req-8ba0d918-2804-4c77-9cc5-6ade4bda28a9 req-4ff0cdb8-e969-4d85-a2ee-a78051f16a5b service nova] [instance: cd6a5eb8-8d48-4894-aff3-a9d04ae85aca] Updating instance_info_cache with network_info: [{"id": "b9cd1004-903b-4e1d-ac1e-579f3de9ed98", "address": "fa:16:3e:fb:e6:d2", "network": {"id": "81bbbdad-218b-4fcd-b7f5-427fd49361cb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1151874504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "673620a69fba4a04af75baabe775dc8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9cd1004-90", "ovs_interfaceid": "b9cd1004-903b-4e1d-ac1e-579f3de9ed98", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:55:32 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-8ba0d918-2804-4c77-9cc5-6ade4bda28a9 req-4ff0cdb8-e969-4d85-a2ee-a78051f16a5b service nova] Releasing lock "refresh_cache-cd6a5eb8-8d48-4894-aff3-a9d04ae85aca" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:55:32 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:55:33 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:55:33 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:55:33 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Starting heal instance info cache {{(pid=75226) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 17 01:55:33 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Rebuilding the list of instances to heal {{(pid=75226) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 17 01:55:34 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "refresh_cache-cd6a5eb8-8d48-4894-aff3-a9d04ae85aca" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:55:34 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquired lock "refresh_cache-cd6a5eb8-8d48-4894-aff3-a9d04ae85aca" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:55:34 user nova-compute[75226]: DEBUG nova.network.neutron [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] [instance: cd6a5eb8-8d48-4894-aff3-a9d04ae85aca] Forcefully refreshing network info cache for instance {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 17 01:55:34 user nova-compute[75226]: DEBUG nova.objects.instance [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lazy-loading 'info_cache' on Instance uuid cd6a5eb8-8d48-4894-aff3-a9d04ae85aca {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:55:34 user nova-compute[75226]: DEBUG nova.network.neutron [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] [instance: cd6a5eb8-8d48-4894-aff3-a9d04ae85aca] Updating instance_info_cache with network_info: [{"id": "b9cd1004-903b-4e1d-ac1e-579f3de9ed98", "address": "fa:16:3e:fb:e6:d2", "network": {"id": "81bbbdad-218b-4fcd-b7f5-427fd49361cb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1151874504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "673620a69fba4a04af75baabe775dc8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9cd1004-90", "ovs_interfaceid": "b9cd1004-903b-4e1d-ac1e-579f3de9ed98", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:55:34 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Releasing lock "refresh_cache-cd6a5eb8-8d48-4894-aff3-a9d04ae85aca" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:55:34 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] [instance: cd6a5eb8-8d48-4894-aff3-a9d04ae85aca] Updated the network info_cache for instance {{(pid=75226) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 17 01:55:34 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:55:34 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75226) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 17 01:55:35 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:55:35 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:55:36 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:55:37 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:55:38 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-acf61e8f-e128-4043-a385-1682e9e27b5f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Acquiring lock "98e83f0d-40f2-4c5a-8a13-cf7846fd6af3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:55:38 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-acf61e8f-e128-4043-a385-1682e9e27b5f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Lock "98e83f0d-40f2-4c5a-8a13-cf7846fd6af3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:55:38 user nova-compute[75226]: DEBUG nova.compute.manager [None req-acf61e8f-e128-4043-a385-1682e9e27b5f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: 98e83f0d-40f2-4c5a-8a13-cf7846fd6af3] Starting instance... {{(pid=75226) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 17 01:55:38 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-acf61e8f-e128-4043-a385-1682e9e27b5f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:55:38 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-acf61e8f-e128-4043-a385-1682e9e27b5f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:55:38 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-acf61e8f-e128-4043-a385-1682e9e27b5f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75226) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 17 01:55:38 user nova-compute[75226]: INFO nova.compute.claims [None req-acf61e8f-e128-4043-a385-1682e9e27b5f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: 98e83f0d-40f2-4c5a-8a13-cf7846fd6af3] Claim successful on node user
Nov 17 01:55:38 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-acf61e8f-e128-4043-a385-1682e9e27b5f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:55:38 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-acf61e8f-e128-4043-a385-1682e9e27b5f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:55:38 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-acf61e8f-e128-4043-a385-1682e9e27b5f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.221s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:55:38 user nova-compute[75226]: DEBUG nova.compute.manager [None req-acf61e8f-e128-4043-a385-1682e9e27b5f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: 98e83f0d-40f2-4c5a-8a13-cf7846fd6af3] Start building networks asynchronously for instance. {{(pid=75226) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 17 01:55:38 user nova-compute[75226]: DEBUG nova.compute.manager [None req-acf61e8f-e128-4043-a385-1682e9e27b5f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: 98e83f0d-40f2-4c5a-8a13-cf7846fd6af3] Allocating IP information in the background. {{(pid=75226) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 17 01:55:38 user nova-compute[75226]: DEBUG nova.network.neutron [None req-acf61e8f-e128-4043-a385-1682e9e27b5f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: 98e83f0d-40f2-4c5a-8a13-cf7846fd6af3] allocate_for_instance() {{(pid=75226) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 17 01:55:38 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-acf61e8f-e128-4043-a385-1682e9e27b5f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: 98e83f0d-40f2-4c5a-8a13-cf7846fd6af3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 17 01:55:38 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:55:38 user nova-compute[75226]: DEBUG nova.compute.manager [None req-acf61e8f-e128-4043-a385-1682e9e27b5f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: 98e83f0d-40f2-4c5a-8a13-cf7846fd6af3] Start building block device mappings for instance. {{(pid=75226) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 17 01:55:38 user nova-compute[75226]: DEBUG nova.policy [None req-acf61e8f-e128-4043-a385-1682e9e27b5f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7c8c8baa56884dcd9a90f0187c9fc06f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673620a69fba4a04af75baabe775dc8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75226) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 17 01:55:38 user nova-compute[75226]: INFO nova.virt.block_device [None req-acf61e8f-e128-4043-a385-1682e9e27b5f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: 98e83f0d-40f2-4c5a-8a13-cf7846fd6af3] Booting with volume 8c573c04-5be0-4335-a5f5-298c4fa045be at /dev/vda
Nov 17 01:55:38 user nova-compute[75226]: DEBUG os_brick.utils [None req-acf61e8f-e128-4043-a385-1682e9e27b5f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:55:38 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:55:38 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:55:38 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d866f9b-bcc1-41ec-a536-40664976f18a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f62857db69\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:55:38 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:55:38 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:55:38 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[09be042d-66a8-4ade-b6f5-ed8580f22784]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:55:38 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:55:38 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:55:38 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2719b6f-26a4-4916-b91c-659f706f3e83]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:55:38 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[de0e1ce2-28d7-4804-96e7-4e3f7b2cb5aa]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:55:38 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-acf61e8f-e128-4043-a385-1682e9e27b5f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Running cmd (subprocess): nvme version {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:55:38 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-acf61e8f-e128-4043-a385-1682e9e27b5f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] 'nvme version' failed. Not Retrying. {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 01:55:38 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.nvmeof [None req-acf61e8f-e128-4043-a385-1682e9e27b5f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] nvme not present on system {{(pid=75226) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 17 01:55:38 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:55:38 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 01:55:38 user nova-compute[75226]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 17 01:55:38 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b532673-c0cc-43b6-8a51-08ed9f72d7f0]: (4, '') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:55:38 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-acf61e8f-e128-4043-a385-1682e9e27b5f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75226) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 17 01:55:38 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-acf61e8f-e128-4043-a385-1682e9e27b5f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75226) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 17 01:55:38 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-acf61e8f-e128-4043-a385-1682e9e27b5f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] LIGHTOS: no hostnqn found. {{(pid=75226) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 17 01:55:38 user nova-compute[75226]: DEBUG os_brick.utils [None req-acf61e8f-e128-4043-a385-1682e9e27b5f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f62857db69', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:55:38 user nova-compute[75226]: DEBUG nova.virt.block_device [None req-acf61e8f-e128-4043-a385-1682e9e27b5f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: 98e83f0d-40f2-4c5a-8a13-cf7846fd6af3] Updating existing volume attachment record: 5944170f-6eaf-45e4-a747-ef5251afc0bd {{(pid=75226) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 17 01:55:39 user nova-compute[75226]: DEBUG nova.network.neutron [None req-acf61e8f-e128-4043-a385-1682e9e27b5f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: 98e83f0d-40f2-4c5a-8a13-cf7846fd6af3] Successfully created port: 1b2b4f7b-bfec-43bd-8715-bcba1be74685 {{(pid=75226) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 17 01:55:40 user nova-compute[75226]: DEBUG nova.network.neutron [None req-acf61e8f-e128-4043-a385-1682e9e27b5f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: 98e83f0d-40f2-4c5a-8a13-cf7846fd6af3] Successfully updated port: 1b2b4f7b-bfec-43bd-8715-bcba1be74685 {{(pid=75226) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 17 01:55:40 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-acf61e8f-e128-4043-a385-1682e9e27b5f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Acquiring lock "refresh_cache-98e83f0d-40f2-4c5a-8a13-cf7846fd6af3" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:55:40 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-acf61e8f-e128-4043-a385-1682e9e27b5f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Acquired lock "refresh_cache-98e83f0d-40f2-4c5a-8a13-cf7846fd6af3" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:55:40 user nova-compute[75226]: DEBUG nova.network.neutron [None req-acf61e8f-e128-4043-a385-1682e9e27b5f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: 98e83f0d-40f2-4c5a-8a13-cf7846fd6af3] Building network info cache for instance {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 01:55:40 user nova-compute[75226]: DEBUG nova.compute.manager [req-dd3ba4eb-441f-46aa-a5bd-f7dfb4c06c3e req-fb328482-8af4-4c11-a85d-f45727cb9fcc service nova] [instance: 98e83f0d-40f2-4c5a-8a13-cf7846fd6af3] Received event network-changed-1b2b4f7b-bfec-43bd-8715-bcba1be74685 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:55:40 user nova-compute[75226]: DEBUG nova.compute.manager [req-dd3ba4eb-441f-46aa-a5bd-f7dfb4c06c3e req-fb328482-8af4-4c11-a85d-f45727cb9fcc service nova] [instance: 98e83f0d-40f2-4c5a-8a13-cf7846fd6af3] Refreshing instance network info cache due to event network-changed-1b2b4f7b-bfec-43bd-8715-bcba1be74685. {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 01:55:40 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-dd3ba4eb-441f-46aa-a5bd-f7dfb4c06c3e req-fb328482-8af4-4c11-a85d-f45727cb9fcc service nova] Acquiring lock "refresh_cache-98e83f0d-40f2-4c5a-8a13-cf7846fd6af3" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:55:40 user nova-compute[75226]: DEBUG nova.network.neutron [None req-acf61e8f-e128-4043-a385-1682e9e27b5f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: 98e83f0d-40f2-4c5a-8a13-cf7846fd6af3] Instance cache missing network info. {{(pid=75226) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 17 01:55:40 user nova-compute[75226]: DEBUG nova.network.neutron [None req-acf61e8f-e128-4043-a385-1682e9e27b5f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: 98e83f0d-40f2-4c5a-8a13-cf7846fd6af3] Updating instance_info_cache with network_info: [{"id": "1b2b4f7b-bfec-43bd-8715-bcba1be74685", "address": "fa:16:3e:c2:45:34", "network": {"id": "81bbbdad-218b-4fcd-b7f5-427fd49361cb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1151874504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "673620a69fba4a04af75baabe775dc8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b2b4f7b-bf", "ovs_interfaceid": "1b2b4f7b-bfec-43bd-8715-bcba1be74685", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:55:40 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-acf61e8f-e128-4043-a385-1682e9e27b5f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Releasing lock "refresh_cache-98e83f0d-40f2-4c5a-8a13-cf7846fd6af3" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:55:40 user nova-compute[75226]: DEBUG nova.compute.manager [None req-acf61e8f-e128-4043-a385-1682e9e27b5f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: 98e83f0d-40f2-4c5a-8a13-cf7846fd6af3] Instance network_info: |[{"id": "1b2b4f7b-bfec-43bd-8715-bcba1be74685", "address": "fa:16:3e:c2:45:34", "network": {"id": "81bbbdad-218b-4fcd-b7f5-427fd49361cb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1151874504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "673620a69fba4a04af75baabe775dc8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b2b4f7b-bf", "ovs_interfaceid": "1b2b4f7b-bfec-43bd-8715-bcba1be74685", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75226) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 17 01:55:40 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-dd3ba4eb-441f-46aa-a5bd-f7dfb4c06c3e req-fb328482-8af4-4c11-a85d-f45727cb9fcc service nova] Acquired lock "refresh_cache-98e83f0d-40f2-4c5a-8a13-cf7846fd6af3" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:55:40 user nova-compute[75226]: DEBUG nova.network.neutron [req-dd3ba4eb-441f-46aa-a5bd-f7dfb4c06c3e req-fb328482-8af4-4c11-a85d-f45727cb9fcc service nova] [instance: 98e83f0d-40f2-4c5a-8a13-cf7846fd6af3] Refreshing network info cache for port 1b2b4f7b-bfec-43bd-8715-bcba1be74685 {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 01:55:40 user nova-compute[75226]: DEBUG nova.network.neutron [req-dd3ba4eb-441f-46aa-a5bd-f7dfb4c06c3e req-fb328482-8af4-4c11-a85d-f45727cb9fcc service nova] [instance: 98e83f0d-40f2-4c5a-8a13-cf7846fd6af3] Updated VIF entry in instance network info cache for port 1b2b4f7b-bfec-43bd-8715-bcba1be74685. {{(pid=75226) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 01:55:40 user nova-compute[75226]: DEBUG nova.network.neutron [req-dd3ba4eb-441f-46aa-a5bd-f7dfb4c06c3e req-fb328482-8af4-4c11-a85d-f45727cb9fcc service nova] [instance: 98e83f0d-40f2-4c5a-8a13-cf7846fd6af3] Updating instance_info_cache with network_info: [{"id": "1b2b4f7b-bfec-43bd-8715-bcba1be74685", "address": "fa:16:3e:c2:45:34", "network": {"id": "81bbbdad-218b-4fcd-b7f5-427fd49361cb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1151874504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "673620a69fba4a04af75baabe775dc8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b2b4f7b-bf", "ovs_interfaceid": "1b2b4f7b-bfec-43bd-8715-bcba1be74685", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:55:41 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-dd3ba4eb-441f-46aa-a5bd-f7dfb4c06c3e req-fb328482-8af4-4c11-a85d-f45727cb9fcc service nova] Releasing lock "refresh_cache-98e83f0d-40f2-4c5a-8a13-cf7846fd6af3" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:55:42 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:55:44 user nova-compute[75226]: DEBUG nova.compute.manager [None req-acf61e8f-e128-4043-a385-1682e9e27b5f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: 98e83f0d-40f2-4c5a-8a13-cf7846fd6af3] Start spawning the instance on the hypervisor. {{(pid=75226) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 17 01:55:44 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-acf61e8f-e128-4043-a385-1682e9e27b5f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: 98e83f0d-40f2-4c5a-8a13-cf7846fd6af3] Creating instance directory {{(pid=75226) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 17 01:55:44 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-acf61e8f-e128-4043-a385-1682e9e27b5f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: 98e83f0d-40f2-4c5a-8a13-cf7846fd6af3] Creating image(s)
Nov 17 01:55:44 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-acf61e8f-e128-4043-a385-1682e9e27b5f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: 98e83f0d-40f2-4c5a-8a13-cf7846fd6af3] Did not create local disks {{(pid=75226) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 17 01:55:44 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-acf61e8f-e128-4043-a385-1682e9e27b5f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: 98e83f0d-40f2-4c5a-8a13-cf7846fd6af3] Ensure instance console log exists: /opt/stack/data/nova/instances/98e83f0d-40f2-4c5a-8a13-cf7846fd6af3/console.log {{(pid=75226) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 17 01:55:44 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-acf61e8f-e128-4043-a385-1682e9e27b5f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:55:44 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-acf61e8f-e128-4043-a385-1682e9e27b5f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:55:44 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-acf61e8f-e128-4043-a385-1682e9e27b5f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:55:44 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-acf61e8f-e128-4043-a385-1682e9e27b5f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: 98e83f0d-40f2-4c5a-8a13-cf7846fd6af3] Start _get_guest_xml network_info=[{"id": "1b2b4f7b-bfec-43bd-8715-bcba1be74685", "address": "fa:16:3e:c2:45:34", "network": {"id": "81bbbdad-218b-4fcd-b7f5-427fd49361cb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1151874504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "673620a69fba4a04af75baabe775dc8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b2b4f7b-bf", "ovs_interfaceid": "1b2b4f7b-bfec-43bd-8715-bcba1be74685", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8c573c04-5be0-4335-a5f5-298c4fa045be', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EYtjPpQc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '98e83f0d-40f2-4c5a-8a13-cf7846fd6af3', 'attached_at': '', 'detached_at': '', 'volume_id': '8c573c04-5be0-4335-a5f5-298c4fa045be', 'serial': '8c573c04-5be0-4335-a5f5-298c4fa045be'}, 'attachment_id': '5944170f-6eaf-45e4-a747-ef5251afc0bd', 'device_type': 'disk', 'volume_type': None} {{(pid=75226) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 17 01:55:44 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-acf61e8f-e128-4043-a385-1682e9e27b5f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:55:44 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-acf61e8f-e128-4043-a385-1682e9e27b5f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:55:44 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-acf61e8f-e128-4043-a385-1682e9e27b5f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75226) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 17 01:55:44 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-acf61e8f-e128-4043-a385-1682e9e27b5f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] CPU controller missing on host. {{(pid=75226) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 17 01:55:44 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-acf61e8f-e128-4043-a385-1682e9e27b5f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75226) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 17 01:55:44 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-acf61e8f-e128-4043-a385-1682e9e27b5f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] CPU controller found on host. {{(pid=75226) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 17 01:55:44 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-acf61e8f-e128-4043-a385-1682e9e27b5f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75226) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 17 01:55:44 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-acf61e8f-e128-4043-a385-1682e9e27b5f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-17T01:13:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 17 01:55:44 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-acf61e8f-e128-4043-a385-1682e9e27b5f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Flavor limits 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 17 01:55:44 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-acf61e8f-e128-4043-a385-1682e9e27b5f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Image limits 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 17 01:55:44 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-acf61e8f-e128-4043-a385-1682e9e27b5f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Flavor pref 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 17 01:55:44 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-acf61e8f-e128-4043-a385-1682e9e27b5f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Image pref 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 17 01:55:44 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-acf61e8f-e128-4043-a385-1682e9e27b5f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 17 01:55:44 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-acf61e8f-e128-4043-a385-1682e9e27b5f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 17 01:55:44 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-acf61e8f-e128-4043-a385-1682e9e27b5f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75226) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 17 01:55:44 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-acf61e8f-e128-4043-a385-1682e9e27b5f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Got 1 possible topologies {{(pid=75226) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 17 01:55:44 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-acf61e8f-e128-4043-a385-1682e9e27b5f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 17 01:55:44 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-acf61e8f-e128-4043-a385-1682e9e27b5f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 17 01:55:44 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-acf61e8f-e128-4043-a385-1682e9e27b5f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: 98e83f0d-40f2-4c5a-8a13-cf7846fd6af3] Calling os-brick to attach iSCSI Volume {{(pid=75226) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 17 01:55:44 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-acf61e8f-e128-4043-a385-1682e9e27b5f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc4cc36b490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8c573c04-5be0-4335-a5f5-298c4fa045be', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EYtjPpQc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:55:44 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-acf61e8f-e128-4043-a385-1682e9e27b5f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:55:44 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-acf61e8f-e128-4043-a385-1682e9e27b5f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:55:44 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-acf61e8f-e128-4043-a385-1682e9e27b5f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:55:44 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-acf61e8f-e128-4043-a385-1682e9e27b5f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:55:44 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-acf61e8f-e128-4043-a385-1682e9e27b5f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8c573c04-5be0-4335-a5f5-298c4fa045be" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:55:44 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-acf61e8f-e128-4043-a385-1682e9e27b5f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8c573c04-5be0-4335-a5f5-298c4fa045be" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:55:44 user nova-compute[75226]: INFO os_brick.initiator.connectors.iscsi [None req-acf61e8f-e128-4043-a385-1682e9e27b5f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 17 01:55:44 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c573c04-5be0-4335-a5f5-298c4fa045be -p 172.16.0.220:3260 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:55:44 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c573c04-5be0-4335-a5f5-298c4fa045be -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:55:44 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[e439953d-1e60-46be-bfd6-ccf336423a46]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:55:44 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-acf61e8f-e128-4043-a385-1682e9e27b5f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 17 01:55:44 user nova-compute[75226]:  {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:55:44 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c573c04-5be0-4335-a5f5-298c4fa045be -p 172.16.0.220:3260 --interface default --op new {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:55:44 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c573c04-5be0-4335-a5f5-298c4fa045be -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:55:44 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[899920d3-9c5a-4b92-a138-e223cd729dd2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8c573c04-5be0-4335-a5f5-298c4fa045be] added\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:55:44 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-acf61e8f-e128-4043-a385-1682e9e27b5f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8c573c04-5be0-4335-a5f5-298c4fa045be] added
Nov 17 01:55:44 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:55:44 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c573c04-5be0-4335-a5f5-298c4fa045be -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:55:44 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c573c04-5be0-4335-a5f5-298c4fa045be -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:55:44 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8d6744f-17ff-4db6-bf6f-ba05369e6b14]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:55:44 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-acf61e8f-e128-4043-a385-1682e9e27b5f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:55:44 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c573c04-5be0-4335-a5f5-298c4fa045be -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:55:44 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c573c04-5be0-4335-a5f5-298c4fa045be -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:55:44 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7ab1358-d7d7-44b5-b615-9e31d5ff3930]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:55:44 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-acf61e8f-e128-4043-a385-1682e9e27b5f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:55:44 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c573c04-5be0-4335-a5f5-298c4fa045be -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EYtjPpQc {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:55:44 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c573c04-5be0-4335-a5f5-298c4fa045be -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EYtjPpQc" returned: 0 in 0.024s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:55:44 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1a344dc-336a-47c3-98c0-eebeb27823da]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:55:44 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-acf61e8f-e128-4043-a385-1682e9e27b5f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EYtjPpQc'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:55:44 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c573c04-5be0-4335-a5f5-298c4fa045be -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:55:44 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c573c04-5be0-4335-a5f5-298c4fa045be -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:55:44 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cd20cde-681e-417f-9ad3-6438880e3a89]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:55:44 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-acf61e8f-e128-4043-a385-1682e9e27b5f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:55:44 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:55:44 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:55:44 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fd44da2-d315-416a-988a-9976526b0fc0]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:875a05e9-5133-418e-a210-0b01076d92a8 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:55:44 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-acf61e8f-e128-4043-a385-1682e9e27b5f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:875a05e9-5133-418e-a210-0b01076d92a8 (non-flash)
Nov 17 01:55:44 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:55:44 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-acf61e8f-e128-4043-a385-1682e9e27b5f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:875a05e9-5133-418e-a210-0b01076d92a8 (non-flash)
Nov 17 01:55:44 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:55:44 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c573c04-5be0-4335-a5f5-298c4fa045be -p 172.16.0.220:3260 --login {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:55:44 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c573c04-5be0-4335-a5f5-298c4fa045be -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:55:44 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[b89a8494-032a-4c7d-85a1-4e4ead17f9f1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8c573c04-5be0-4335-a5f5-298c4fa045be, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8c573c04-5be0-4335-a5f5-298c4fa045be, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:55:44 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-acf61e8f-e128-4043-a385-1682e9e27b5f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8c573c04-5be0-4335-a5f5-298c4fa045be, portal: 172.16.0.220,3260]
Nov 17 01:55:44 user nova-compute[75226]: Login to [iface: default, target: iqn.2010-10.org.openstack:8c573c04-5be0-4335-a5f5-298c4fa045be, portal: 172.16.0.220,3260] successful.
Nov 17 01:55:44 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:55:44 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c573c04-5be0-4335-a5f5-298c4fa045be -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:55:44 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c573c04-5be0-4335-a5f5-298c4fa045be -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:55:44 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[488f6d33-becb-4ee1-b92c-41d57447420d]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:55:44 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-acf61e8f-e128-4043-a385-1682e9e27b5f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:55:44 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:55:44 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:55:44 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebbc4ce2-1112-47ce-b2dc-196f54bee42f]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:875a05e9-5133-418e-a210-0b01076d92a8 (non-flash)\ntcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c573c04-5be0-4335-a5f5-298c4fa045be (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:55:44 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-acf61e8f-e128-4043-a385-1682e9e27b5f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:875a05e9-5133-418e-a210-0b01076d92a8 (non-flash)
Nov 17 01:55:44 user nova-compute[75226]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c573c04-5be0-4335-a5f5-298c4fa045be (non-flash)
Nov 17 01:55:44 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:55:44 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-acf61e8f-e128-4043-a385-1682e9e27b5f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:875a05e9-5133-418e-a210-0b01076d92a8 (non-flash)
Nov 17 01:55:44 user nova-compute[75226]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c573c04-5be0-4335-a5f5-298c4fa045be (non-flash)
Nov 17 01:55:44 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:55:44 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-acf61e8f-e128-4043-a385-1682e9e27b5f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8c573c04-5be0-4335-a5f5-298c4fa045be" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.263s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:55:44 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-acf61e8f-e128-4043-a385-1682e9e27b5f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Connected to 172.16.0.220:3260 {{(pid=75226) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 17 01:55:44 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-acf61e8f-e128-4043-a385-1682e9e27b5f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] HCTL ('34', '-', '-', 0) found on session 63 with lun 0 {{(pid=75226) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 17 01:55:44 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-acf61e8f-e128-4043-a385-1682e9e27b5f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75226) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 17 01:55:44 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:55:44 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:55:44 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4c7b6f1-7f32-459d-8e05-ee7e638b191b]: (4, ('- - 0', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:55:44 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-acf61e8f-e128-4043-a385-1682e9e27b5f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Searching for a device in session 63 and hctl ['34', '*', '*', 0] yield: None {{(pid=75226) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 01:55:45 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-acf61e8f-e128-4043-a385-1682e9e27b5f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Searching for a device in session 63 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75226) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 01:55:45 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-acf61e8f-e128-4043-a385-1682e9e27b5f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:8c573c04-5be0-4335-a5f5-298c4fa045be', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EYtjPpQc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75226) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 17 01:55:45 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-acf61e8f-e128-4043-a385-1682e9e27b5f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.289s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:55:45 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-acf61e8f-e128-4043-a385-1682e9e27b5f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] <== connect_volume: return (1290ms) {'type': 'block', 'scsi_wwn': '23761366138313066', 'path': '/dev/sdc'} {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:55:45 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-acf61e8f-e128-4043-a385-1682e9e27b5f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: 98e83f0d-40f2-4c5a-8a13-cf7846fd6af3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23761366138313066', 'path': '/dev/sdc'} {{(pid=75226) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 17 01:55:45 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-acf61e8f-e128-4043-a385-1682e9e27b5f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:55:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-540701959',display_name='tempest-TestVolumeBootPattern-server-540701959',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-540701959',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIOTXvx1rt0huiJMkCirjSAkUEIOTUxZuP5hnGbb4TZayM1DPwV+2un52eKf78XfXFJdTcPGOcA7AeRAFw+1gTwHIAhQ08B/zT7NrklMaP31fH3B8tWT2/QeOIfwk/TlfQ==',key_name='tempest-TestVolumeBootPattern-346525006',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='673620a69fba4a04af75baabe775dc8b',ramdisk_id='',reservation_id='r-2g9yk8tb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-971654489',owner_user_name='tempest-TestVolumeBootPattern-971654489-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T01:55:39Z,user_data=None,user_id='7c8c8baa56884dcd9a90f0187c9fc06f',uuid=98e83f0d-40f2-4c5a-8a13-cf7846fd6af3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1b2b4f7b-bfec-43bd-8715-bcba1be74685", "address": "fa:16:3e:c2:45:34", "network": {"id": "81bbbdad-218b-4fcd-b7f5-427fd49361cb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1151874504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "673620a69fba4a04af75baabe775dc8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b2b4f7b-bf", "ovs_interfaceid": "1b2b4f7b-bfec-43bd-8715-bcba1be74685", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75226) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 01:55:45 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-acf61e8f-e128-4043-a385-1682e9e27b5f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Converting VIF {"id": "1b2b4f7b-bfec-43bd-8715-bcba1be74685", "address": "fa:16:3e:c2:45:34", "network": {"id": "81bbbdad-218b-4fcd-b7f5-427fd49361cb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1151874504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "673620a69fba4a04af75baabe775dc8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b2b4f7b-bf", "ovs_interfaceid": "1b2b4f7b-bfec-43bd-8715-bcba1be74685", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:55:45 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-acf61e8f-e128-4043-a385-1682e9e27b5f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:45:34,bridge_name='br-int',has_traffic_filtering=True,id=1b2b4f7b-bfec-43bd-8715-bcba1be74685,network=Network(81bbbdad-218b-4fcd-b7f5-427fd49361cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b2b4f7b-bf') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:55:45 user nova-compute[75226]: DEBUG nova.objects.instance [None req-acf61e8f-e128-4043-a385-1682e9e27b5f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Lazy-loading 'pci_devices' on Instance uuid 98e83f0d-40f2-4c5a-8a13-cf7846fd6af3 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:55:46 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-acf61e8f-e128-4043-a385-1682e9e27b5f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: 98e83f0d-40f2-4c5a-8a13-cf7846fd6af3] End _get_guest_xml xml=<domain type="kvm">
Nov 17 01:55:46 user nova-compute[75226]:   <uuid>98e83f0d-40f2-4c5a-8a13-cf7846fd6af3</uuid>
Nov 17 01:55:46 user nova-compute[75226]:   <name>instance-00000034</name>
Nov 17 01:55:46 user nova-compute[75226]:   <memory>524288</memory>
Nov 17 01:55:46 user nova-compute[75226]:   <vcpu>1</vcpu>
Nov 17 01:55:46 user nova-compute[75226]:   <metadata>
Nov 17 01:55:46 user nova-compute[75226]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 17 01:55:46 user nova-compute[75226]:       <nova:package version="0.0.0"/>
Nov 17 01:55:46 user nova-compute[75226]:       <nova:name>tempest-TestVolumeBootPattern-server-540701959</nova:name>
Nov 17 01:55:46 user nova-compute[75226]:       <nova:creationTime>2023-11-17 01:55:44</nova:creationTime>
Nov 17 01:55:46 user nova-compute[75226]:       <nova:flavor name="m1.tiny">
Nov 17 01:55:46 user nova-compute[75226]:         <nova:memory>512</nova:memory>
Nov 17 01:55:46 user nova-compute[75226]:         <nova:disk>1</nova:disk>
Nov 17 01:55:46 user nova-compute[75226]:         <nova:swap>0</nova:swap>
Nov 17 01:55:46 user nova-compute[75226]:         <nova:ephemeral>0</nova:ephemeral>
Nov 17 01:55:46 user nova-compute[75226]:         <nova:vcpus>1</nova:vcpus>
Nov 17 01:55:46 user nova-compute[75226]:       </nova:flavor>
Nov 17 01:55:46 user nova-compute[75226]:       <nova:owner>
Nov 17 01:55:46 user nova-compute[75226]:         <nova:user uuid="7c8c8baa56884dcd9a90f0187c9fc06f">tempest-TestVolumeBootPattern-971654489-project-member</nova:user>
Nov 17 01:55:46 user nova-compute[75226]:         <nova:project uuid="673620a69fba4a04af75baabe775dc8b">tempest-TestVolumeBootPattern-971654489</nova:project>
Nov 17 01:55:46 user nova-compute[75226]:       </nova:owner>
Nov 17 01:55:46 user nova-compute[75226]:       <nova:ports>
Nov 17 01:55:46 user nova-compute[75226]:         <nova:port uuid="1b2b4f7b-bfec-43bd-8715-bcba1be74685">
Nov 17 01:55:46 user nova-compute[75226]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 17 01:55:46 user nova-compute[75226]:         </nova:port>
Nov 17 01:55:46 user nova-compute[75226]:       </nova:ports>
Nov 17 01:55:46 user nova-compute[75226]:     </nova:instance>
Nov 17 01:55:46 user nova-compute[75226]:   </metadata>
Nov 17 01:55:46 user nova-compute[75226]:   <sysinfo type="smbios">
Nov 17 01:55:46 user nova-compute[75226]:     <system>
Nov 17 01:55:46 user nova-compute[75226]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 17 01:55:46 user nova-compute[75226]:       <entry name="product">OpenStack Nova</entry>
Nov 17 01:55:46 user nova-compute[75226]:       <entry name="version">0.0.0</entry>
Nov 17 01:55:46 user nova-compute[75226]:       <entry name="serial">98e83f0d-40f2-4c5a-8a13-cf7846fd6af3</entry>
Nov 17 01:55:46 user nova-compute[75226]:       <entry name="uuid">98e83f0d-40f2-4c5a-8a13-cf7846fd6af3</entry>
Nov 17 01:55:46 user nova-compute[75226]:       <entry name="family">Virtual Machine</entry>
Nov 17 01:55:46 user nova-compute[75226]:     </system>
Nov 17 01:55:46 user nova-compute[75226]:   </sysinfo>
Nov 17 01:55:46 user nova-compute[75226]:   <os>
Nov 17 01:55:46 user nova-compute[75226]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 17 01:55:46 user nova-compute[75226]:     <boot dev="hd"/>
Nov 17 01:55:46 user nova-compute[75226]:     <smbios mode="sysinfo"/>
Nov 17 01:55:46 user nova-compute[75226]:   </os>
Nov 17 01:55:46 user nova-compute[75226]:   <features>
Nov 17 01:55:46 user nova-compute[75226]:     <acpi/>
Nov 17 01:55:46 user nova-compute[75226]:     <apic/>
Nov 17 01:55:46 user nova-compute[75226]:     <vmcoreinfo/>
Nov 17 01:55:46 user nova-compute[75226]:   </features>
Nov 17 01:55:46 user nova-compute[75226]:   <clock offset="utc">
Nov 17 01:55:46 user nova-compute[75226]:     <timer name="pit" tickpolicy="delay"/>
Nov 17 01:55:46 user nova-compute[75226]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 17 01:55:46 user nova-compute[75226]:     <timer name="hpet" present="no"/>
Nov 17 01:55:46 user nova-compute[75226]:   </clock>
Nov 17 01:55:46 user nova-compute[75226]:   <cpu mode="custom" match="exact">
Nov 17 01:55:46 user nova-compute[75226]:     <model>Nehalem</model>
Nov 17 01:55:46 user nova-compute[75226]:     <topology sockets="1" cores="1" threads="1"/>
Nov 17 01:55:46 user nova-compute[75226]:   </cpu>
Nov 17 01:55:46 user nova-compute[75226]:   <devices>
Nov 17 01:55:46 user nova-compute[75226]:     <disk type="block" device="disk">
Nov 17 01:55:46 user nova-compute[75226]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 01:55:46 user nova-compute[75226]:       <source dev="/dev/sdc"/>
Nov 17 01:55:46 user nova-compute[75226]:       <target dev="vda" bus="virtio"/>
Nov 17 01:55:46 user nova-compute[75226]:       <serial>8c573c04-5be0-4335-a5f5-298c4fa045be</serial>
Nov 17 01:55:46 user nova-compute[75226]:     </disk>
Nov 17 01:55:46 user nova-compute[75226]:     <interface type="ethernet">
Nov 17 01:55:46 user nova-compute[75226]:       <mac address="fa:16:3e:c2:45:34"/>
Nov 17 01:55:46 user nova-compute[75226]:       <model type="virtio"/>
Nov 17 01:55:46 user nova-compute[75226]:       <mtu size="1442"/>
Nov 17 01:55:46 user nova-compute[75226]:       <target dev="tap1b2b4f7b-bf"/>
Nov 17 01:55:46 user nova-compute[75226]:     </interface>
Nov 17 01:55:46 user nova-compute[75226]:     <serial type="pty">
Nov 17 01:55:46 user nova-compute[75226]:       <log file="/opt/stack/data/nova/instances/98e83f0d-40f2-4c5a-8a13-cf7846fd6af3/console.log" append="off"/>
Nov 17 01:55:46 user nova-compute[75226]:     </serial>
Nov 17 01:55:46 user nova-compute[75226]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 17 01:55:46 user nova-compute[75226]:     <video>
Nov 17 01:55:46 user nova-compute[75226]:       <model type="virtio"/>
Nov 17 01:55:46 user nova-compute[75226]:     </video>
Nov 17 01:55:46 user nova-compute[75226]:     <rng model="virtio">
Nov 17 01:55:46 user nova-compute[75226]:       <backend model="random">/dev/urandom</backend>
Nov 17 01:55:46 user nova-compute[75226]:     </rng>
Nov 17 01:55:46 user nova-compute[75226]:     <controller type="usb" index="0" model="none"/>
Nov 17 01:55:46 user nova-compute[75226]:     <memballoon model="virtio">
Nov 17 01:55:46 user nova-compute[75226]:       <stats period="10"/>
Nov 17 01:55:46 user nova-compute[75226]:     </memballoon>
Nov 17 01:55:46 user nova-compute[75226]:   </devices>
Nov 17 01:55:46 user nova-compute[75226]: </domain>
Nov 17 01:55:46 user nova-compute[75226]:  {{(pid=75226) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 17 01:55:46 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-acf61e8f-e128-4043-a385-1682e9e27b5f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:55:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-540701959',display_name='tempest-TestVolumeBootPattern-server-540701959',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-540701959',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIOTXvx1rt0huiJMkCirjSAkUEIOTUxZuP5hnGbb4TZayM1DPwV+2un52eKf78XfXFJdTcPGOcA7AeRAFw+1gTwHIAhQ08B/zT7NrklMaP31fH3B8tWT2/QeOIfwk/TlfQ==',key_name='tempest-TestVolumeBootPattern-346525006',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='673620a69fba4a04af75baabe775dc8b',ramdisk_id='',reservation_id='r-2g9yk8tb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-971654489',owner_user_name='tempest-TestVolumeBootPattern-971654489-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T01:55:39Z,user_data=None,user_id='7c8c8baa56884dcd9a90f0187c9fc06f',uuid=98e83f0d-40f2-4c5a-8a13-cf7846fd6af3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1b2b4f7b-bfec-43bd-8715-bcba1be74685", "address": "fa:16:3e:c2:45:34", "network": {"id": "81bbbdad-218b-4fcd-b7f5-427fd49361cb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1151874504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "673620a69fba4a04af75baabe775dc8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b2b4f7b-bf", "ovs_interfaceid": "1b2b4f7b-bfec-43bd-8715-bcba1be74685", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 17 01:55:46 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-acf61e8f-e128-4043-a385-1682e9e27b5f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Converting VIF {"id": "1b2b4f7b-bfec-43bd-8715-bcba1be74685", "address": "fa:16:3e:c2:45:34", "network": {"id": "81bbbdad-218b-4fcd-b7f5-427fd49361cb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1151874504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "673620a69fba4a04af75baabe775dc8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b2b4f7b-bf", "ovs_interfaceid": "1b2b4f7b-bfec-43bd-8715-bcba1be74685", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:55:46 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-acf61e8f-e128-4043-a385-1682e9e27b5f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:45:34,bridge_name='br-int',has_traffic_filtering=True,id=1b2b4f7b-bfec-43bd-8715-bcba1be74685,network=Network(81bbbdad-218b-4fcd-b7f5-427fd49361cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b2b4f7b-bf') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:55:46 user nova-compute[75226]: DEBUG os_vif [None req-acf61e8f-e128-4043-a385-1682e9e27b5f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:45:34,bridge_name='br-int',has_traffic_filtering=True,id=1b2b4f7b-bfec-43bd-8715-bcba1be74685,network=Network(81bbbdad-218b-4fcd-b7f5-427fd49361cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b2b4f7b-bf') {{(pid=75226) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 17 01:55:46 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:55:46 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:55:46 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 17 01:55:46 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:55:46 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a0905fa0-673e-5df2-b005-9e857bc57ec4', '_type': 'linux-noop'}}, row=False) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:55:46 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:55:46 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:55:46 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:55:46 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1b2b4f7b-bf, may_exist=True, interface_attrs={}) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:55:46 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1b2b4f7b-bf, col_values=(('qos', UUID('7cb24b8d-5479-47f2-b21d-25a330d48786')),), if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:55:46 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1b2b4f7b-bf, col_values=(('external_ids', {'iface-id': '1b2b4f7b-bfec-43bd-8715-bcba1be74685', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c2:45:34', 'vm-uuid': '98e83f0d-40f2-4c5a-8a13-cf7846fd6af3'}),), if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:55:46 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:55:46 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:55:46 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:55:46 user nova-compute[75226]: INFO os_vif [None req-acf61e8f-e128-4043-a385-1682e9e27b5f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:45:34,bridge_name='br-int',has_traffic_filtering=True,id=1b2b4f7b-bfec-43bd-8715-bcba1be74685,network=Network(81bbbdad-218b-4fcd-b7f5-427fd49361cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b2b4f7b-bf')
Nov 17 01:55:46 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-acf61e8f-e128-4043-a385-1682e9e27b5f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] No BDM found with device name vda, not building metadata. {{(pid=75226) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 01:55:46 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-acf61e8f-e128-4043-a385-1682e9e27b5f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] No VIF found with MAC fa:16:3e:c2:45:34, not building metadata {{(pid=75226) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 01:55:47 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:55:47 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:55:47 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:55:47 user nova-compute[75226]: DEBUG nova.compute.manager [req-cbd092ce-f6a5-4516-9858-e84870512c2e req-318936d6-9fba-45cf-818c-8e782cdfbcbf service nova] [instance: 98e83f0d-40f2-4c5a-8a13-cf7846fd6af3] Received event network-vif-plugged-1b2b4f7b-bfec-43bd-8715-bcba1be74685 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:55:47 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-cbd092ce-f6a5-4516-9858-e84870512c2e req-318936d6-9fba-45cf-818c-8e782cdfbcbf service nova] Acquiring lock "98e83f0d-40f2-4c5a-8a13-cf7846fd6af3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:55:47 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-cbd092ce-f6a5-4516-9858-e84870512c2e req-318936d6-9fba-45cf-818c-8e782cdfbcbf service nova] Lock "98e83f0d-40f2-4c5a-8a13-cf7846fd6af3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:55:47 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-cbd092ce-f6a5-4516-9858-e84870512c2e req-318936d6-9fba-45cf-818c-8e782cdfbcbf service nova] Lock "98e83f0d-40f2-4c5a-8a13-cf7846fd6af3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:55:47 user nova-compute[75226]: DEBUG nova.compute.manager [req-cbd092ce-f6a5-4516-9858-e84870512c2e req-318936d6-9fba-45cf-818c-8e782cdfbcbf service nova] [instance: 98e83f0d-40f2-4c5a-8a13-cf7846fd6af3] No waiting events found dispatching network-vif-plugged-1b2b4f7b-bfec-43bd-8715-bcba1be74685 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:55:47 user nova-compute[75226]: WARNING nova.compute.manager [req-cbd092ce-f6a5-4516-9858-e84870512c2e req-318936d6-9fba-45cf-818c-8e782cdfbcbf service nova] [instance: 98e83f0d-40f2-4c5a-8a13-cf7846fd6af3] Received unexpected event network-vif-plugged-1b2b4f7b-bfec-43bd-8715-bcba1be74685 for instance with vm_state building and task_state spawning.
Nov 17 01:55:47 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:55:48 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:55:49 user nova-compute[75226]: DEBUG nova.compute.manager [None req-acf61e8f-e128-4043-a385-1682e9e27b5f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: 98e83f0d-40f2-4c5a-8a13-cf7846fd6af3] Instance event wait completed in 0 seconds for  {{(pid=75226) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 17 01:55:49 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-acf61e8f-e128-4043-a385-1682e9e27b5f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: 98e83f0d-40f2-4c5a-8a13-cf7846fd6af3] Guest created on hypervisor {{(pid=75226) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 17 01:55:49 user nova-compute[75226]: INFO nova.virt.libvirt.driver [-] [instance: 98e83f0d-40f2-4c5a-8a13-cf7846fd6af3] Instance spawned successfully.
Nov 17 01:55:49 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-acf61e8f-e128-4043-a385-1682e9e27b5f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: 98e83f0d-40f2-4c5a-8a13-cf7846fd6af3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 17 01:55:49 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-acf61e8f-e128-4043-a385-1682e9e27b5f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: 98e83f0d-40f2-4c5a-8a13-cf7846fd6af3] Found default for hw_cdrom_bus of ide {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:55:49 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-acf61e8f-e128-4043-a385-1682e9e27b5f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: 98e83f0d-40f2-4c5a-8a13-cf7846fd6af3] Found default for hw_disk_bus of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:55:49 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-acf61e8f-e128-4043-a385-1682e9e27b5f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: 98e83f0d-40f2-4c5a-8a13-cf7846fd6af3] Found default for hw_input_bus of None {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:55:49 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-acf61e8f-e128-4043-a385-1682e9e27b5f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: 98e83f0d-40f2-4c5a-8a13-cf7846fd6af3] Found default for hw_pointer_model of None {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:55:49 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-acf61e8f-e128-4043-a385-1682e9e27b5f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: 98e83f0d-40f2-4c5a-8a13-cf7846fd6af3] Found default for hw_video_model of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:55:49 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-acf61e8f-e128-4043-a385-1682e9e27b5f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: 98e83f0d-40f2-4c5a-8a13-cf7846fd6af3] Found default for hw_vif_model of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 01:55:49 user nova-compute[75226]: INFO nova.compute.manager [None req-acf61e8f-e128-4043-a385-1682e9e27b5f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: 98e83f0d-40f2-4c5a-8a13-cf7846fd6af3] Took 4.84 seconds to spawn the instance on the hypervisor.
Nov 17 01:55:49 user nova-compute[75226]: DEBUG nova.compute.manager [None req-acf61e8f-e128-4043-a385-1682e9e27b5f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: 98e83f0d-40f2-4c5a-8a13-cf7846fd6af3] Checking state {{(pid=75226) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 01:55:49 user nova-compute[75226]: DEBUG nova.compute.manager [req-775e83e2-1a0b-4b47-8a8b-7da13b1ec909 req-27dbb924-615c-49a0-846d-b4c937ded793 service nova] [instance: 98e83f0d-40f2-4c5a-8a13-cf7846fd6af3] Received event network-vif-plugged-1b2b4f7b-bfec-43bd-8715-bcba1be74685 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:55:49 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-775e83e2-1a0b-4b47-8a8b-7da13b1ec909 req-27dbb924-615c-49a0-846d-b4c937ded793 service nova] Acquiring lock "98e83f0d-40f2-4c5a-8a13-cf7846fd6af3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:55:49 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-775e83e2-1a0b-4b47-8a8b-7da13b1ec909 req-27dbb924-615c-49a0-846d-b4c937ded793 service nova] Lock "98e83f0d-40f2-4c5a-8a13-cf7846fd6af3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:55:49 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-775e83e2-1a0b-4b47-8a8b-7da13b1ec909 req-27dbb924-615c-49a0-846d-b4c937ded793 service nova] Lock "98e83f0d-40f2-4c5a-8a13-cf7846fd6af3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:55:49 user nova-compute[75226]: DEBUG nova.compute.manager [req-775e83e2-1a0b-4b47-8a8b-7da13b1ec909 req-27dbb924-615c-49a0-846d-b4c937ded793 service nova] [instance: 98e83f0d-40f2-4c5a-8a13-cf7846fd6af3] No waiting events found dispatching network-vif-plugged-1b2b4f7b-bfec-43bd-8715-bcba1be74685 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:55:49 user nova-compute[75226]: WARNING nova.compute.manager [req-775e83e2-1a0b-4b47-8a8b-7da13b1ec909 req-27dbb924-615c-49a0-846d-b4c937ded793 service nova] [instance: 98e83f0d-40f2-4c5a-8a13-cf7846fd6af3] Received unexpected event network-vif-plugged-1b2b4f7b-bfec-43bd-8715-bcba1be74685 for instance with vm_state building and task_state spawning.
Nov 17 01:55:49 user nova-compute[75226]: INFO nova.compute.manager [None req-acf61e8f-e128-4043-a385-1682e9e27b5f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: 98e83f0d-40f2-4c5a-8a13-cf7846fd6af3] Took 11.18 seconds to build instance.
Nov 17 01:55:49 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-acf61e8f-e128-4043-a385-1682e9e27b5f tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Lock "98e83f0d-40f2-4c5a-8a13-cf7846fd6af3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.290s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:55:51 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:55:51 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:55:56 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:55:56 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:55:56 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75226) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 17 01:55:56 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75226) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 01:55:56 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75226) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 01:55:56 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:56:01 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:56:03 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:56:06 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:56:08 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:56:11 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:56:13 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:56:16 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:56:18 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:56:21 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:56:22 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:56:22 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:56:22 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:56:22 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:56:22 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75226) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 17 01:56:23 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75226) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 01:56:23 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75226) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 01:56:23 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:56:23 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:56:23 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Hypervisor/Node resource view: name=user free_ram=8897MB free_disk=24.96249771118164GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75226) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 17 01:56:23 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:56:23 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:56:23 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance cd6a5eb8-8d48-4894-aff3-a9d04ae85aca actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:56:23 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 98e83f0d-40f2-4c5a-8a13-cf7846fd6af3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:56:23 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75226) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 17 01:56:23 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75226) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 17 01:56:23 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:56:23 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:56:23 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Compute_service record updated for user:user {{(pid=75226) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 17 01:56:23 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.200s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:56:26 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:56:26 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:56:26 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75226) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 17 01:56:26 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75226) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 01:56:26 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75226) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 01:56:26 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:56:28 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:56:28 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:56:31 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:56:31 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:56:35 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:56:35 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Starting heal instance info cache {{(pid=75226) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 17 01:56:35 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Rebuilding the list of instances to heal {{(pid=75226) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 17 01:56:36 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "refresh_cache-cd6a5eb8-8d48-4894-aff3-a9d04ae85aca" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:56:36 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquired lock "refresh_cache-cd6a5eb8-8d48-4894-aff3-a9d04ae85aca" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:56:36 user nova-compute[75226]: DEBUG nova.network.neutron [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] [instance: cd6a5eb8-8d48-4894-aff3-a9d04ae85aca] Forcefully refreshing network info cache for instance {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 17 01:56:36 user nova-compute[75226]: DEBUG nova.objects.instance [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lazy-loading 'info_cache' on Instance uuid cd6a5eb8-8d48-4894-aff3-a9d04ae85aca {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:56:36 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:56:36 user nova-compute[75226]: DEBUG nova.network.neutron [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] [instance: cd6a5eb8-8d48-4894-aff3-a9d04ae85aca] Updating instance_info_cache with network_info: [{"id": "b9cd1004-903b-4e1d-ac1e-579f3de9ed98", "address": "fa:16:3e:fb:e6:d2", "network": {"id": "81bbbdad-218b-4fcd-b7f5-427fd49361cb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1151874504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "673620a69fba4a04af75baabe775dc8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9cd1004-90", "ovs_interfaceid": "b9cd1004-903b-4e1d-ac1e-579f3de9ed98", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:56:36 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Releasing lock "refresh_cache-cd6a5eb8-8d48-4894-aff3-a9d04ae85aca" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:56:36 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] [instance: cd6a5eb8-8d48-4894-aff3-a9d04ae85aca] Updated the network info_cache for instance {{(pid=75226) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 17 01:56:36 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:56:36 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:56:36 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75226) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 17 01:56:37 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:56:37 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:56:41 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:56:41 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:56:41 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75226) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 17 01:56:41 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75226) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 01:56:41 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75226) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 01:56:41 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:56:46 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:56:51 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:56:56 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:57:01 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:57:06 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:57:06 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:57:06 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75226) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 17 01:57:06 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75226) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 01:57:06 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75226) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 01:57:06 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:57:11 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:57:11 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:57:11 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75226) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 17 01:57:11 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75226) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 01:57:11 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75226) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 01:57:11 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:57:16 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:57:21 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:57:21 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:57:21 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75226) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 17 01:57:21 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75226) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 01:57:21 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75226) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 01:57:21 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:57:23 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:57:23 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:57:23 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:57:23 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:57:23 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75226) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 17 01:57:24 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75226) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 01:57:24 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75226) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 01:57:24 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:57:24 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:57:24 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Hypervisor/Node resource view: name=user free_ram=8976MB free_disk=24.961898803710938GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75226) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 17 01:57:24 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:57:24 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:57:24 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance cd6a5eb8-8d48-4894-aff3-a9d04ae85aca actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:57:24 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 98e83f0d-40f2-4c5a-8a13-cf7846fd6af3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:57:24 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75226) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 17 01:57:24 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75226) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 17 01:57:24 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:57:24 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:57:24 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Compute_service record updated for user:user {{(pid=75226) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 17 01:57:24 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.212s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:57:26 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:57:26 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:57:26 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75226) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 17 01:57:26 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75226) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 01:57:26 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75226) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 01:57:26 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:57:29 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:57:30 user nova-compute[75226]: DEBUG nova.compute.manager [req-fe033599-19be-4a2c-856c-68bb52d10c0c req-d5335637-485e-4bf2-885d-8200d0a952b1 service nova] [instance: 98e83f0d-40f2-4c5a-8a13-cf7846fd6af3] Received event network-changed-1b2b4f7b-bfec-43bd-8715-bcba1be74685 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:57:30 user nova-compute[75226]: DEBUG nova.compute.manager [req-fe033599-19be-4a2c-856c-68bb52d10c0c req-d5335637-485e-4bf2-885d-8200d0a952b1 service nova] [instance: 98e83f0d-40f2-4c5a-8a13-cf7846fd6af3] Refreshing instance network info cache due to event network-changed-1b2b4f7b-bfec-43bd-8715-bcba1be74685. {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 01:57:30 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-fe033599-19be-4a2c-856c-68bb52d10c0c req-d5335637-485e-4bf2-885d-8200d0a952b1 service nova] Acquiring lock "refresh_cache-98e83f0d-40f2-4c5a-8a13-cf7846fd6af3" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:57:30 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-fe033599-19be-4a2c-856c-68bb52d10c0c req-d5335637-485e-4bf2-885d-8200d0a952b1 service nova] Acquired lock "refresh_cache-98e83f0d-40f2-4c5a-8a13-cf7846fd6af3" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:57:30 user nova-compute[75226]: DEBUG nova.network.neutron [req-fe033599-19be-4a2c-856c-68bb52d10c0c req-d5335637-485e-4bf2-885d-8200d0a952b1 service nova] [instance: 98e83f0d-40f2-4c5a-8a13-cf7846fd6af3] Refreshing network info cache for port 1b2b4f7b-bfec-43bd-8715-bcba1be74685 {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 01:57:30 user nova-compute[75226]: DEBUG nova.network.neutron [req-fe033599-19be-4a2c-856c-68bb52d10c0c req-d5335637-485e-4bf2-885d-8200d0a952b1 service nova] [instance: 98e83f0d-40f2-4c5a-8a13-cf7846fd6af3] Updated VIF entry in instance network info cache for port 1b2b4f7b-bfec-43bd-8715-bcba1be74685. {{(pid=75226) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 01:57:30 user nova-compute[75226]: DEBUG nova.network.neutron [req-fe033599-19be-4a2c-856c-68bb52d10c0c req-d5335637-485e-4bf2-885d-8200d0a952b1 service nova] [instance: 98e83f0d-40f2-4c5a-8a13-cf7846fd6af3] Updating instance_info_cache with network_info: [{"id": "1b2b4f7b-bfec-43bd-8715-bcba1be74685", "address": "fa:16:3e:c2:45:34", "network": {"id": "81bbbdad-218b-4fcd-b7f5-427fd49361cb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1151874504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "673620a69fba4a04af75baabe775dc8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b2b4f7b-bf", "ovs_interfaceid": "1b2b4f7b-bfec-43bd-8715-bcba1be74685", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:57:30 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-fe033599-19be-4a2c-856c-68bb52d10c0c req-d5335637-485e-4bf2-885d-8200d0a952b1 service nova] Releasing lock "refresh_cache-98e83f0d-40f2-4c5a-8a13-cf7846fd6af3" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:57:30 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:57:30 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:57:30 user nova-compute[75226]: DEBUG nova.compute.manager [req-1f7a9b19-0acd-4b28-a56d-4b497f906b7f req-a3a3fcc2-5f6c-4ffa-b8a4-3f7582c8ca2b service nova] [instance: 98e83f0d-40f2-4c5a-8a13-cf7846fd6af3] Received event network-changed-1b2b4f7b-bfec-43bd-8715-bcba1be74685 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:57:30 user nova-compute[75226]: DEBUG nova.compute.manager [req-1f7a9b19-0acd-4b28-a56d-4b497f906b7f req-a3a3fcc2-5f6c-4ffa-b8a4-3f7582c8ca2b service nova] [instance: 98e83f0d-40f2-4c5a-8a13-cf7846fd6af3] Refreshing instance network info cache due to event network-changed-1b2b4f7b-bfec-43bd-8715-bcba1be74685. {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 01:57:30 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-1f7a9b19-0acd-4b28-a56d-4b497f906b7f req-a3a3fcc2-5f6c-4ffa-b8a4-3f7582c8ca2b service nova] Acquiring lock "refresh_cache-98e83f0d-40f2-4c5a-8a13-cf7846fd6af3" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:57:30 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-1f7a9b19-0acd-4b28-a56d-4b497f906b7f req-a3a3fcc2-5f6c-4ffa-b8a4-3f7582c8ca2b service nova] Acquired lock "refresh_cache-98e83f0d-40f2-4c5a-8a13-cf7846fd6af3" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:57:30 user nova-compute[75226]: DEBUG nova.network.neutron [req-1f7a9b19-0acd-4b28-a56d-4b497f906b7f req-a3a3fcc2-5f6c-4ffa-b8a4-3f7582c8ca2b service nova] [instance: 98e83f0d-40f2-4c5a-8a13-cf7846fd6af3] Refreshing network info cache for port 1b2b4f7b-bfec-43bd-8715-bcba1be74685 {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 01:57:30 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-95efaab2-1b47-41c4-9ac7-77ff3460a32c tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Acquiring lock "98e83f0d-40f2-4c5a-8a13-cf7846fd6af3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:57:30 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-95efaab2-1b47-41c4-9ac7-77ff3460a32c tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Lock "98e83f0d-40f2-4c5a-8a13-cf7846fd6af3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:57:30 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-95efaab2-1b47-41c4-9ac7-77ff3460a32c tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Acquiring lock "98e83f0d-40f2-4c5a-8a13-cf7846fd6af3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:57:30 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-95efaab2-1b47-41c4-9ac7-77ff3460a32c tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Lock "98e83f0d-40f2-4c5a-8a13-cf7846fd6af3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:57:30 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-95efaab2-1b47-41c4-9ac7-77ff3460a32c tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Lock "98e83f0d-40f2-4c5a-8a13-cf7846fd6af3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:57:30 user nova-compute[75226]: INFO nova.compute.manager [None req-95efaab2-1b47-41c4-9ac7-77ff3460a32c tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: 98e83f0d-40f2-4c5a-8a13-cf7846fd6af3] Terminating instance
Nov 17 01:57:30 user nova-compute[75226]: DEBUG nova.compute.manager [None req-95efaab2-1b47-41c4-9ac7-77ff3460a32c tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: 98e83f0d-40f2-4c5a-8a13-cf7846fd6af3] Start destroying the instance on the hypervisor. {{(pid=75226) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 17 01:57:30 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:57:31 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:57:31 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:57:31 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:57:31 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:57:31 user nova-compute[75226]: DEBUG nova.network.neutron [req-1f7a9b19-0acd-4b28-a56d-4b497f906b7f req-a3a3fcc2-5f6c-4ffa-b8a4-3f7582c8ca2b service nova] [instance: 98e83f0d-40f2-4c5a-8a13-cf7846fd6af3] Updated VIF entry in instance network info cache for port 1b2b4f7b-bfec-43bd-8715-bcba1be74685. {{(pid=75226) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 01:57:31 user nova-compute[75226]: DEBUG nova.network.neutron [req-1f7a9b19-0acd-4b28-a56d-4b497f906b7f req-a3a3fcc2-5f6c-4ffa-b8a4-3f7582c8ca2b service nova] [instance: 98e83f0d-40f2-4c5a-8a13-cf7846fd6af3] Updating instance_info_cache with network_info: [{"id": "1b2b4f7b-bfec-43bd-8715-bcba1be74685", "address": "fa:16:3e:c2:45:34", "network": {"id": "81bbbdad-218b-4fcd-b7f5-427fd49361cb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1151874504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "673620a69fba4a04af75baabe775dc8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b2b4f7b-bf", "ovs_interfaceid": "1b2b4f7b-bfec-43bd-8715-bcba1be74685", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:57:31 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-1f7a9b19-0acd-4b28-a56d-4b497f906b7f req-a3a3fcc2-5f6c-4ffa-b8a4-3f7582c8ca2b service nova] Releasing lock "refresh_cache-98e83f0d-40f2-4c5a-8a13-cf7846fd6af3" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:57:31 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:57:31 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:57:31 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:57:31 user nova-compute[75226]: INFO nova.virt.libvirt.driver [-] [instance: 98e83f0d-40f2-4c5a-8a13-cf7846fd6af3] Instance destroyed successfully.
Nov 17 01:57:31 user nova-compute[75226]: DEBUG nova.objects.instance [None req-95efaab2-1b47-41c4-9ac7-77ff3460a32c tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Lazy-loading 'resources' on Instance uuid 98e83f0d-40f2-4c5a-8a13-cf7846fd6af3 {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:57:31 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-95efaab2-1b47-41c4-9ac7-77ff3460a32c tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:55:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-540701959',display_name='tempest-TestVolumeBootPattern-server-540701959',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-540701959',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIOTXvx1rt0huiJMkCirjSAkUEIOTUxZuP5hnGbb4TZayM1DPwV+2un52eKf78XfXFJdTcPGOcA7AeRAFw+1gTwHIAhQ08B/zT7NrklMaP31fH3B8tWT2/QeOIfwk/TlfQ==',key_name='tempest-TestVolumeBootPattern-346525006',keypairs=<?>,launch_index=0,launched_at=2023-11-17T01:55:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='673620a69fba4a04af75baabe775dc8b',ramdisk_id='',reservation_id='r-2g9yk8tb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-971654489',owner_user_name='tempest-TestVolumeBootPattern-971654489-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T01:55:50Z,user_data=None,user_id='7c8c8baa56884dcd9a90f0187c9fc06f',uuid=98e83f0d-40f2-4c5a-8a13-cf7846fd6af3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1b2b4f7b-bfec-43bd-8715-bcba1be74685", "address": "fa:16:3e:c2:45:34", "network": {"id": "81bbbdad-218b-4fcd-b7f5-427fd49361cb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1151874504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "673620a69fba4a04af75baabe775dc8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b2b4f7b-bf", "ovs_interfaceid": "1b2b4f7b-bfec-43bd-8715-bcba1be74685", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 17 01:57:31 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-95efaab2-1b47-41c4-9ac7-77ff3460a32c tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Converting VIF {"id": "1b2b4f7b-bfec-43bd-8715-bcba1be74685", "address": "fa:16:3e:c2:45:34", "network": {"id": "81bbbdad-218b-4fcd-b7f5-427fd49361cb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1151874504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "673620a69fba4a04af75baabe775dc8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b2b4f7b-bf", "ovs_interfaceid": "1b2b4f7b-bfec-43bd-8715-bcba1be74685", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:57:31 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-95efaab2-1b47-41c4-9ac7-77ff3460a32c tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c2:45:34,bridge_name='br-int',has_traffic_filtering=True,id=1b2b4f7b-bfec-43bd-8715-bcba1be74685,network=Network(81bbbdad-218b-4fcd-b7f5-427fd49361cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b2b4f7b-bf') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:57:31 user nova-compute[75226]: DEBUG os_vif [None req-95efaab2-1b47-41c4-9ac7-77ff3460a32c tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c2:45:34,bridge_name='br-int',has_traffic_filtering=True,id=1b2b4f7b-bfec-43bd-8715-bcba1be74685,network=Network(81bbbdad-218b-4fcd-b7f5-427fd49361cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b2b4f7b-bf') {{(pid=75226) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 17 01:57:31 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:57:31 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1b2b4f7b-bf, bridge=br-int, if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:57:31 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:57:31 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:57:31 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:57:31 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7cb24b8d-5479-47f2-b21d-25a330d48786) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:57:31 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:57:31 user nova-compute[75226]: INFO os_vif [None req-95efaab2-1b47-41c4-9ac7-77ff3460a32c tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c2:45:34,bridge_name='br-int',has_traffic_filtering=True,id=1b2b4f7b-bfec-43bd-8715-bcba1be74685,network=Network(81bbbdad-218b-4fcd-b7f5-427fd49361cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b2b4f7b-bf')
Nov 17 01:57:31 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-95efaab2-1b47-41c4-9ac7-77ff3460a32c tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: 98e83f0d-40f2-4c5a-8a13-cf7846fd6af3] calling os-brick to detach iSCSI Volume {{(pid=75226) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 17 01:57:31 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-95efaab2-1b47-41c4-9ac7-77ff3460a32c tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc4cc36b490>, {'target_iqn': 'iqn.2010-10.org.openstack:8c573c04-5be0-4335-a5f5-298c4fa045be', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EYtjPpQc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:57:31 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-95efaab2-1b47-41c4-9ac7-77ff3460a32c tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:57:31 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-95efaab2-1b47-41c4-9ac7-77ff3460a32c tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:57:31 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-95efaab2-1b47-41c4-9ac7-77ff3460a32c tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:57:31 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:57:31 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:57:31 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[16f57da8-aa3b-4e1f-a3e2-4a1cba5e3716]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:875a05e9-5133-418e-a210-0b01076d92a8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8c573c04-5be0-4335-a5f5-298c4fa045be\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:57:31 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-95efaab2-1b47-41c4-9ac7-77ff3460a32c tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 17 01:57:31 user nova-compute[75226]: No targets found.
Nov 17 01:57:31 user nova-compute[75226]: iSNS:
Nov 17 01:57:31 user nova-compute[75226]: No targets found.
Nov 17 01:57:31 user nova-compute[75226]: STATIC:
Nov 17 01:57:31 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:875a05e9-5133-418e-a210-0b01076d92a8
Nov 17 01:57:31 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:57:31 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:57:31 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:8c573c04-5be0-4335-a5f5-298c4fa045be
Nov 17 01:57:31 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:57:31 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:57:31 user nova-compute[75226]: FIRMWARE:
Nov 17 01:57:31 user nova-compute[75226]: No targets found.
Nov 17 01:57:31 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:57:31 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-95efaab2-1b47-41c4-9ac7-77ff3460a32c tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 17 01:57:31 user nova-compute[75226]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 17 01:57:31 user nova-compute[75226]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75226) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 17 01:57:31 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-95efaab2-1b47-41c4-9ac7-77ff3460a32c tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8c573c04-5be0-4335-a5f5-298c4fa045be', 0)] {{(pid=75226) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 17 01:57:31 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:57:31 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:57:31 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[a65d4689-5bf3-417f-8729-13fc9d4eb40d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:875a05e9-5133-418e-a210-0b01076d92a8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c573c04-5be0-4335-a5f5-298c4fa045be\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:57:31 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:57:31 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:57:31 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:57:31 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9ff15e6-4495-4b82-8518-748c83de9e35]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:875a05e9-5133-418e-a210-0b01076d92a8 (non-flash)\ntcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c573c04-5be0-4335-a5f5-298c4fa045be (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:57:31 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-95efaab2-1b47-41c4-9ac7-77ff3460a32c tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:875a05e9-5133-418e-a210-0b01076d92a8 (non-flash)
Nov 17 01:57:31 user nova-compute[75226]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c573c04-5be0-4335-a5f5-298c4fa045be (non-flash)
Nov 17 01:57:31 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:57:31 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-95efaab2-1b47-41c4-9ac7-77ff3460a32c tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:875a05e9-5133-418e-a210-0b01076d92a8 (non-flash)
Nov 17 01:57:31 user nova-compute[75226]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c573c04-5be0-4335-a5f5-298c4fa045be (non-flash)
Nov 17 01:57:31 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:57:31 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-95efaab2-1b47-41c4-9ac7-77ff3460a32c tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc4b42d6710>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8c573c04-5be0-4335-a5f5-298c4fa045be'): ({'sdc'}, set())}) {{(pid=75226) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 17 01:57:31 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-95efaab2-1b47-41c4-9ac7-77ff3460a32c tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Removing single pathed devices sdc {{(pid=75226) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 17 01:57:31 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:57:31 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:57:31 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[f68171ea-53db-4821-9660-816b0ebcb999]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:57:31 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:57:32 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:57:32 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[3617ce94-a6c5-4eed-84e9-a3386d7ed3a0]: (4, ('ok\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:57:32 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-95efaab2-1b47-41c4-9ac7-77ff3460a32c tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Flushing IO for device /dev/sdc {{(pid=75226) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 17 01:57:32 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:57:32 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:57:32 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:57:32 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[828f05e6-2560-42fb-afb5-4ad3b97f7a2f]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:57:32 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-95efaab2-1b47-41c4-9ac7-77ff3460a32c tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75226) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 17 01:57:32 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:57:32 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.039s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:57:32 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee32fc54-ef3f-4a46-bb6e-2b6b7d96017c]: (4, ('1', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:57:32 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-95efaab2-1b47-41c4-9ac7-77ff3460a32c tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75226) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 17 01:57:32 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-95efaab2-1b47-41c4-9ac7-77ff3460a32c tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] SCSI volumes sdc have been removed. {{(pid=75226) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 17 01:57:32 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-95efaab2-1b47-41c4-9ac7-77ff3460a32c tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8c573c04-5be0-4335-a5f5-298c4fa045be')] {{(pid=75226) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 17 01:57:32 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c573c04-5be0-4335-a5f5-298c4fa045be -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:57:32 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c573c04-5be0-4335-a5f5-298c4fa045be -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:57:32 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[f78e89e6-b5c9-4981-9d33-fe09e620908d]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:57:32 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-95efaab2-1b47-41c4-9ac7-77ff3460a32c tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:57:32 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c573c04-5be0-4335-a5f5-298c4fa045be -p 172.16.0.220:3260 --logout {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:57:32 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c573c04-5be0-4335-a5f5-298c4fa045be -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:57:32 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6919c6c-2989-41e0-b87b-659069b15cb4]: (4, ('Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:8c573c04-5be0-4335-a5f5-298c4fa045be, portal: 172.16.0.220,3260]\nLogout of [sid: 63, target: iqn.2010-10.org.openstack:8c573c04-5be0-4335-a5f5-298c4fa045be, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:57:32 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-95efaab2-1b47-41c4-9ac7-77ff3460a32c tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:8c573c04-5be0-4335-a5f5-298c4fa045be, portal: 172.16.0.220,3260]
Nov 17 01:57:32 user nova-compute[75226]: Logout of [sid: 63, target: iqn.2010-10.org.openstack:8c573c04-5be0-4335-a5f5-298c4fa045be, portal: 172.16.0.220,3260] successful.
Nov 17 01:57:32 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:57:32 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c573c04-5be0-4335-a5f5-298c4fa045be -p 172.16.0.220:3260 --op delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:57:32 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c573c04-5be0-4335-a5f5-298c4fa045be -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:57:32 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[436ae43f-085b-4a7a-ab78-239f18afdb43]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:57:32 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-95efaab2-1b47-41c4-9ac7-77ff3460a32c tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:57:32 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-95efaab2-1b47-41c4-9ac7-77ff3460a32c tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:57:32 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-95efaab2-1b47-41c4-9ac7-77ff3460a32c tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] <== disconnect_volume: return (318ms) None {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:57:32 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-95efaab2-1b47-41c4-9ac7-77ff3460a32c tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: 98e83f0d-40f2-4c5a-8a13-cf7846fd6af3] Disconnected iSCSI Volume {{(pid=75226) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 17 01:57:32 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-95efaab2-1b47-41c4-9ac7-77ff3460a32c tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: 98e83f0d-40f2-4c5a-8a13-cf7846fd6af3] Deleting instance files /opt/stack/data/nova/instances/98e83f0d-40f2-4c5a-8a13-cf7846fd6af3_del
Nov 17 01:57:32 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-95efaab2-1b47-41c4-9ac7-77ff3460a32c tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: 98e83f0d-40f2-4c5a-8a13-cf7846fd6af3] Deletion of /opt/stack/data/nova/instances/98e83f0d-40f2-4c5a-8a13-cf7846fd6af3_del complete
Nov 17 01:57:32 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:57:32 user nova-compute[75226]: INFO nova.compute.manager [None req-95efaab2-1b47-41c4-9ac7-77ff3460a32c tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: 98e83f0d-40f2-4c5a-8a13-cf7846fd6af3] Took 1.37 seconds to destroy the instance on the hypervisor.
Nov 17 01:57:32 user nova-compute[75226]: DEBUG oslo.service.loopingcall [None req-95efaab2-1b47-41c4-9ac7-77ff3460a32c tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75226) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 17 01:57:32 user nova-compute[75226]: DEBUG nova.compute.manager [-] [instance: 98e83f0d-40f2-4c5a-8a13-cf7846fd6af3] Deallocating network for instance {{(pid=75226) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 17 01:57:32 user nova-compute[75226]: DEBUG nova.network.neutron [-] [instance: 98e83f0d-40f2-4c5a-8a13-cf7846fd6af3] deallocate_for_instance() {{(pid=75226) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 17 01:57:32 user nova-compute[75226]: DEBUG nova.network.neutron [-] [instance: 98e83f0d-40f2-4c5a-8a13-cf7846fd6af3] Updating instance_info_cache with network_info: [] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:57:32 user nova-compute[75226]: INFO nova.compute.manager [-] [instance: 98e83f0d-40f2-4c5a-8a13-cf7846fd6af3] Took 0.48 seconds to deallocate network for instance.
Nov 17 01:57:32 user nova-compute[75226]: DEBUG nova.compute.manager [req-548d087d-c741-4250-906b-a7123dc9e868 req-0ab3832b-e0af-4536-90c2-ba607a1c795b service nova] [instance: 98e83f0d-40f2-4c5a-8a13-cf7846fd6af3] Received event network-vif-unplugged-1b2b4f7b-bfec-43bd-8715-bcba1be74685 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:57:32 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-548d087d-c741-4250-906b-a7123dc9e868 req-0ab3832b-e0af-4536-90c2-ba607a1c795b service nova] Acquiring lock "98e83f0d-40f2-4c5a-8a13-cf7846fd6af3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:57:32 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-548d087d-c741-4250-906b-a7123dc9e868 req-0ab3832b-e0af-4536-90c2-ba607a1c795b service nova] Lock "98e83f0d-40f2-4c5a-8a13-cf7846fd6af3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:57:32 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-548d087d-c741-4250-906b-a7123dc9e868 req-0ab3832b-e0af-4536-90c2-ba607a1c795b service nova] Lock "98e83f0d-40f2-4c5a-8a13-cf7846fd6af3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:57:32 user nova-compute[75226]: DEBUG nova.compute.manager [req-548d087d-c741-4250-906b-a7123dc9e868 req-0ab3832b-e0af-4536-90c2-ba607a1c795b service nova] [instance: 98e83f0d-40f2-4c5a-8a13-cf7846fd6af3] No waiting events found dispatching network-vif-unplugged-1b2b4f7b-bfec-43bd-8715-bcba1be74685 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:57:32 user nova-compute[75226]: DEBUG nova.compute.manager [req-548d087d-c741-4250-906b-a7123dc9e868 req-0ab3832b-e0af-4536-90c2-ba607a1c795b service nova] [instance: 98e83f0d-40f2-4c5a-8a13-cf7846fd6af3] Received event network-vif-unplugged-1b2b4f7b-bfec-43bd-8715-bcba1be74685 for instance with task_state deleting. {{(pid=75226) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 17 01:57:32 user nova-compute[75226]: DEBUG nova.compute.manager [req-548d087d-c741-4250-906b-a7123dc9e868 req-0ab3832b-e0af-4536-90c2-ba607a1c795b service nova] [instance: 98e83f0d-40f2-4c5a-8a13-cf7846fd6af3] Received event network-vif-plugged-1b2b4f7b-bfec-43bd-8715-bcba1be74685 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:57:32 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-548d087d-c741-4250-906b-a7123dc9e868 req-0ab3832b-e0af-4536-90c2-ba607a1c795b service nova] Acquiring lock "98e83f0d-40f2-4c5a-8a13-cf7846fd6af3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:57:32 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-548d087d-c741-4250-906b-a7123dc9e868 req-0ab3832b-e0af-4536-90c2-ba607a1c795b service nova] Lock "98e83f0d-40f2-4c5a-8a13-cf7846fd6af3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:57:32 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-548d087d-c741-4250-906b-a7123dc9e868 req-0ab3832b-e0af-4536-90c2-ba607a1c795b service nova] Lock "98e83f0d-40f2-4c5a-8a13-cf7846fd6af3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:57:32 user nova-compute[75226]: DEBUG nova.compute.manager [req-548d087d-c741-4250-906b-a7123dc9e868 req-0ab3832b-e0af-4536-90c2-ba607a1c795b service nova] [instance: 98e83f0d-40f2-4c5a-8a13-cf7846fd6af3] No waiting events found dispatching network-vif-plugged-1b2b4f7b-bfec-43bd-8715-bcba1be74685 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:57:32 user nova-compute[75226]: WARNING nova.compute.manager [req-548d087d-c741-4250-906b-a7123dc9e868 req-0ab3832b-e0af-4536-90c2-ba607a1c795b service nova] [instance: 98e83f0d-40f2-4c5a-8a13-cf7846fd6af3] Received unexpected event network-vif-plugged-1b2b4f7b-bfec-43bd-8715-bcba1be74685 for instance with vm_state active and task_state deleting.
Nov 17 01:57:32 user nova-compute[75226]: DEBUG nova.compute.manager [req-548d087d-c741-4250-906b-a7123dc9e868 req-0ab3832b-e0af-4536-90c2-ba607a1c795b service nova] [instance: 98e83f0d-40f2-4c5a-8a13-cf7846fd6af3] Received event network-vif-plugged-1b2b4f7b-bfec-43bd-8715-bcba1be74685 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:57:32 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-548d087d-c741-4250-906b-a7123dc9e868 req-0ab3832b-e0af-4536-90c2-ba607a1c795b service nova] Acquiring lock "98e83f0d-40f2-4c5a-8a13-cf7846fd6af3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:57:32 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-548d087d-c741-4250-906b-a7123dc9e868 req-0ab3832b-e0af-4536-90c2-ba607a1c795b service nova] Lock "98e83f0d-40f2-4c5a-8a13-cf7846fd6af3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:57:32 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-548d087d-c741-4250-906b-a7123dc9e868 req-0ab3832b-e0af-4536-90c2-ba607a1c795b service nova] Lock "98e83f0d-40f2-4c5a-8a13-cf7846fd6af3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:57:32 user nova-compute[75226]: DEBUG nova.compute.manager [req-548d087d-c741-4250-906b-a7123dc9e868 req-0ab3832b-e0af-4536-90c2-ba607a1c795b service nova] [instance: 98e83f0d-40f2-4c5a-8a13-cf7846fd6af3] No waiting events found dispatching network-vif-plugged-1b2b4f7b-bfec-43bd-8715-bcba1be74685 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:57:32 user nova-compute[75226]: WARNING nova.compute.manager [req-548d087d-c741-4250-906b-a7123dc9e868 req-0ab3832b-e0af-4536-90c2-ba607a1c795b service nova] [instance: 98e83f0d-40f2-4c5a-8a13-cf7846fd6af3] Received unexpected event network-vif-plugged-1b2b4f7b-bfec-43bd-8715-bcba1be74685 for instance with vm_state active and task_state deleting.
Nov 17 01:57:32 user nova-compute[75226]: DEBUG nova.compute.manager [req-548d087d-c741-4250-906b-a7123dc9e868 req-0ab3832b-e0af-4536-90c2-ba607a1c795b service nova] [instance: 98e83f0d-40f2-4c5a-8a13-cf7846fd6af3] Received event network-vif-plugged-1b2b4f7b-bfec-43bd-8715-bcba1be74685 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:57:32 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-548d087d-c741-4250-906b-a7123dc9e868 req-0ab3832b-e0af-4536-90c2-ba607a1c795b service nova] Acquiring lock "98e83f0d-40f2-4c5a-8a13-cf7846fd6af3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:57:32 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-548d087d-c741-4250-906b-a7123dc9e868 req-0ab3832b-e0af-4536-90c2-ba607a1c795b service nova] Lock "98e83f0d-40f2-4c5a-8a13-cf7846fd6af3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:57:32 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-548d087d-c741-4250-906b-a7123dc9e868 req-0ab3832b-e0af-4536-90c2-ba607a1c795b service nova] Lock "98e83f0d-40f2-4c5a-8a13-cf7846fd6af3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:57:32 user nova-compute[75226]: DEBUG nova.compute.manager [req-548d087d-c741-4250-906b-a7123dc9e868 req-0ab3832b-e0af-4536-90c2-ba607a1c795b service nova] [instance: 98e83f0d-40f2-4c5a-8a13-cf7846fd6af3] No waiting events found dispatching network-vif-plugged-1b2b4f7b-bfec-43bd-8715-bcba1be74685 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:57:32 user nova-compute[75226]: WARNING nova.compute.manager [req-548d087d-c741-4250-906b-a7123dc9e868 req-0ab3832b-e0af-4536-90c2-ba607a1c795b service nova] [instance: 98e83f0d-40f2-4c5a-8a13-cf7846fd6af3] Received unexpected event network-vif-plugged-1b2b4f7b-bfec-43bd-8715-bcba1be74685 for instance with vm_state active and task_state deleting.
Nov 17 01:57:32 user nova-compute[75226]: DEBUG nova.compute.manager [req-548d087d-c741-4250-906b-a7123dc9e868 req-0ab3832b-e0af-4536-90c2-ba607a1c795b service nova] [instance: 98e83f0d-40f2-4c5a-8a13-cf7846fd6af3] Received event network-vif-unplugged-1b2b4f7b-bfec-43bd-8715-bcba1be74685 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:57:32 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-548d087d-c741-4250-906b-a7123dc9e868 req-0ab3832b-e0af-4536-90c2-ba607a1c795b service nova] Acquiring lock "98e83f0d-40f2-4c5a-8a13-cf7846fd6af3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:57:32 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-548d087d-c741-4250-906b-a7123dc9e868 req-0ab3832b-e0af-4536-90c2-ba607a1c795b service nova] Lock "98e83f0d-40f2-4c5a-8a13-cf7846fd6af3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:57:32 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-548d087d-c741-4250-906b-a7123dc9e868 req-0ab3832b-e0af-4536-90c2-ba607a1c795b service nova] Lock "98e83f0d-40f2-4c5a-8a13-cf7846fd6af3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:57:32 user nova-compute[75226]: DEBUG nova.compute.manager [req-548d087d-c741-4250-906b-a7123dc9e868 req-0ab3832b-e0af-4536-90c2-ba607a1c795b service nova] [instance: 98e83f0d-40f2-4c5a-8a13-cf7846fd6af3] No waiting events found dispatching network-vif-unplugged-1b2b4f7b-bfec-43bd-8715-bcba1be74685 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:57:32 user nova-compute[75226]: DEBUG nova.compute.manager [req-548d087d-c741-4250-906b-a7123dc9e868 req-0ab3832b-e0af-4536-90c2-ba607a1c795b service nova] [instance: 98e83f0d-40f2-4c5a-8a13-cf7846fd6af3] Received event network-vif-unplugged-1b2b4f7b-bfec-43bd-8715-bcba1be74685 for instance with task_state deleting. {{(pid=75226) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 17 01:57:32 user nova-compute[75226]: DEBUG nova.compute.manager [req-548d087d-c741-4250-906b-a7123dc9e868 req-0ab3832b-e0af-4536-90c2-ba607a1c795b service nova] [instance: 98e83f0d-40f2-4c5a-8a13-cf7846fd6af3] Received event network-vif-plugged-1b2b4f7b-bfec-43bd-8715-bcba1be74685 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:57:32 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-548d087d-c741-4250-906b-a7123dc9e868 req-0ab3832b-e0af-4536-90c2-ba607a1c795b service nova] Acquiring lock "98e83f0d-40f2-4c5a-8a13-cf7846fd6af3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:57:32 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-548d087d-c741-4250-906b-a7123dc9e868 req-0ab3832b-e0af-4536-90c2-ba607a1c795b service nova] Lock "98e83f0d-40f2-4c5a-8a13-cf7846fd6af3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:57:32 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-548d087d-c741-4250-906b-a7123dc9e868 req-0ab3832b-e0af-4536-90c2-ba607a1c795b service nova] Lock "98e83f0d-40f2-4c5a-8a13-cf7846fd6af3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:57:32 user nova-compute[75226]: DEBUG nova.compute.manager [req-548d087d-c741-4250-906b-a7123dc9e868 req-0ab3832b-e0af-4536-90c2-ba607a1c795b service nova] [instance: 98e83f0d-40f2-4c5a-8a13-cf7846fd6af3] No waiting events found dispatching network-vif-plugged-1b2b4f7b-bfec-43bd-8715-bcba1be74685 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:57:32 user nova-compute[75226]: WARNING nova.compute.manager [req-548d087d-c741-4250-906b-a7123dc9e868 req-0ab3832b-e0af-4536-90c2-ba607a1c795b service nova] [instance: 98e83f0d-40f2-4c5a-8a13-cf7846fd6af3] Received unexpected event network-vif-plugged-1b2b4f7b-bfec-43bd-8715-bcba1be74685 for instance with vm_state active and task_state deleting.
Nov 17 01:57:32 user nova-compute[75226]: DEBUG nova.compute.manager [req-f426f90f-6ae3-45f9-9ff6-036090ab1073 req-b87803e8-85f0-462f-a91c-deef61f63ec4 service nova] [instance: 98e83f0d-40f2-4c5a-8a13-cf7846fd6af3] Received event network-vif-deleted-1b2b4f7b-bfec-43bd-8715-bcba1be74685 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:57:33 user nova-compute[75226]: INFO nova.compute.manager [None req-95efaab2-1b47-41c4-9ac7-77ff3460a32c tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: 98e83f0d-40f2-4c5a-8a13-cf7846fd6af3] Took 0.77 seconds to detach 1 volumes for instance.
Nov 17 01:57:33 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-95efaab2-1b47-41c4-9ac7-77ff3460a32c tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:57:33 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-95efaab2-1b47-41c4-9ac7-77ff3460a32c tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:57:33 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-95efaab2-1b47-41c4-9ac7-77ff3460a32c tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:57:33 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-95efaab2-1b47-41c4-9ac7-77ff3460a32c tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:57:33 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-95efaab2-1b47-41c4-9ac7-77ff3460a32c tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.126s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:57:33 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:57:33 user nova-compute[75226]: INFO nova.scheduler.client.report [None req-95efaab2-1b47-41c4-9ac7-77ff3460a32c tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Deleted allocations for instance 98e83f0d-40f2-4c5a-8a13-cf7846fd6af3
Nov 17 01:57:33 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-95efaab2-1b47-41c4-9ac7-77ff3460a32c tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Lock "98e83f0d-40f2-4c5a-8a13-cf7846fd6af3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.958s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:57:35 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:57:36 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:57:36 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:57:36 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:57:36 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Starting heal instance info cache {{(pid=75226) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 17 01:57:36 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Didn't find any instances for network info cache update. {{(pid=75226) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 17 01:57:37 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:57:37 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:57:37 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75226) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 17 01:57:41 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:57:46 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:57:51 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:57:51 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:57:51 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75226) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 17 01:57:51 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75226) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 01:57:51 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75226) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 01:57:51 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:57:53 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:57:56 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:58:01 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:58:01 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:58:01 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75226) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 17 01:58:01 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75226) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 01:58:01 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75226) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 01:58:01 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:58:06 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:58:06 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:58:06 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75226) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 17 01:58:06 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75226) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 01:58:06 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75226) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 01:58:06 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:58:11 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:58:11 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:58:11 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75226) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 17 01:58:11 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75226) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 01:58:11 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75226) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 01:58:11 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:58:16 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:58:21 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:58:21 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:58:21 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75226) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 17 01:58:21 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75226) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 01:58:21 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75226) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 01:58:21 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:58:23 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:58:23 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:58:23 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:58:23 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:58:23 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75226) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 17 01:58:24 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75226) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 17 01:58:24 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:58:24 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:58:24 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Hypervisor/Node resource view: name=user free_ram=9065MB free_disk=24.960887908935547GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75226) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 17 01:58:24 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:58:24 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:58:24 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance cd6a5eb8-8d48-4894-aff3-a9d04ae85aca actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 01:58:24 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75226) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 17 01:58:24 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75226) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 17 01:58:24 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:58:24 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:58:24 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Compute_service record updated for user:user {{(pid=75226) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 17 01:58:24 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.295s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:58:26 user nova-compute[75226]: DEBUG nova.compute.manager [req-6d9789ec-251a-4dd8-bcb5-e6a7a50ebcb7 req-b3c2337f-452c-457c-9b97-e1334f4925c2 service nova] [instance: cd6a5eb8-8d48-4894-aff3-a9d04ae85aca] Received event network-changed-b9cd1004-903b-4e1d-ac1e-579f3de9ed98 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:58:26 user nova-compute[75226]: DEBUG nova.compute.manager [req-6d9789ec-251a-4dd8-bcb5-e6a7a50ebcb7 req-b3c2337f-452c-457c-9b97-e1334f4925c2 service nova] [instance: cd6a5eb8-8d48-4894-aff3-a9d04ae85aca] Refreshing instance network info cache due to event network-changed-b9cd1004-903b-4e1d-ac1e-579f3de9ed98. {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 01:58:26 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-6d9789ec-251a-4dd8-bcb5-e6a7a50ebcb7 req-b3c2337f-452c-457c-9b97-e1334f4925c2 service nova] Acquiring lock "refresh_cache-cd6a5eb8-8d48-4894-aff3-a9d04ae85aca" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 01:58:26 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-6d9789ec-251a-4dd8-bcb5-e6a7a50ebcb7 req-b3c2337f-452c-457c-9b97-e1334f4925c2 service nova] Acquired lock "refresh_cache-cd6a5eb8-8d48-4894-aff3-a9d04ae85aca" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 01:58:26 user nova-compute[75226]: DEBUG nova.network.neutron [req-6d9789ec-251a-4dd8-bcb5-e6a7a50ebcb7 req-b3c2337f-452c-457c-9b97-e1334f4925c2 service nova] [instance: cd6a5eb8-8d48-4894-aff3-a9d04ae85aca] Refreshing network info cache for port b9cd1004-903b-4e1d-ac1e-579f3de9ed98 {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 01:58:26 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-4a898587-8db7-436f-875a-8d19367cc795 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Acquiring lock "cd6a5eb8-8d48-4894-aff3-a9d04ae85aca" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:58:26 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-4a898587-8db7-436f-875a-8d19367cc795 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Lock "cd6a5eb8-8d48-4894-aff3-a9d04ae85aca" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:58:26 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-4a898587-8db7-436f-875a-8d19367cc795 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Acquiring lock "cd6a5eb8-8d48-4894-aff3-a9d04ae85aca-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:58:26 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-4a898587-8db7-436f-875a-8d19367cc795 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Lock "cd6a5eb8-8d48-4894-aff3-a9d04ae85aca-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:58:26 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-4a898587-8db7-436f-875a-8d19367cc795 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Lock "cd6a5eb8-8d48-4894-aff3-a9d04ae85aca-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:58:26 user nova-compute[75226]: INFO nova.compute.manager [None req-4a898587-8db7-436f-875a-8d19367cc795 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: cd6a5eb8-8d48-4894-aff3-a9d04ae85aca] Terminating instance
Nov 17 01:58:26 user nova-compute[75226]: DEBUG nova.compute.manager [None req-4a898587-8db7-436f-875a-8d19367cc795 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: cd6a5eb8-8d48-4894-aff3-a9d04ae85aca] Start destroying the instance on the hypervisor. {{(pid=75226) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 17 01:58:26 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:58:26 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:58:26 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:58:26 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:58:26 user nova-compute[75226]: DEBUG nova.compute.manager [req-b6478a8e-b1ff-4385-9926-3e0f4dcf3d48 req-da5cea83-3f0f-44ea-88e9-c1ac1579f5ef service nova] [instance: cd6a5eb8-8d48-4894-aff3-a9d04ae85aca] Received event network-vif-unplugged-b9cd1004-903b-4e1d-ac1e-579f3de9ed98 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:58:26 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-b6478a8e-b1ff-4385-9926-3e0f4dcf3d48 req-da5cea83-3f0f-44ea-88e9-c1ac1579f5ef service nova] Acquiring lock "cd6a5eb8-8d48-4894-aff3-a9d04ae85aca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:58:26 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-b6478a8e-b1ff-4385-9926-3e0f4dcf3d48 req-da5cea83-3f0f-44ea-88e9-c1ac1579f5ef service nova] Lock "cd6a5eb8-8d48-4894-aff3-a9d04ae85aca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:58:26 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-b6478a8e-b1ff-4385-9926-3e0f4dcf3d48 req-da5cea83-3f0f-44ea-88e9-c1ac1579f5ef service nova] Lock "cd6a5eb8-8d48-4894-aff3-a9d04ae85aca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:58:26 user nova-compute[75226]: DEBUG nova.compute.manager [req-b6478a8e-b1ff-4385-9926-3e0f4dcf3d48 req-da5cea83-3f0f-44ea-88e9-c1ac1579f5ef service nova] [instance: cd6a5eb8-8d48-4894-aff3-a9d04ae85aca] No waiting events found dispatching network-vif-unplugged-b9cd1004-903b-4e1d-ac1e-579f3de9ed98 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:58:26 user nova-compute[75226]: DEBUG nova.compute.manager [req-b6478a8e-b1ff-4385-9926-3e0f4dcf3d48 req-da5cea83-3f0f-44ea-88e9-c1ac1579f5ef service nova] [instance: cd6a5eb8-8d48-4894-aff3-a9d04ae85aca] Received event network-vif-unplugged-b9cd1004-903b-4e1d-ac1e-579f3de9ed98 for instance with task_state deleting. {{(pid=75226) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 17 01:58:26 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:58:27 user nova-compute[75226]: DEBUG nova.network.neutron [req-6d9789ec-251a-4dd8-bcb5-e6a7a50ebcb7 req-b3c2337f-452c-457c-9b97-e1334f4925c2 service nova] [instance: cd6a5eb8-8d48-4894-aff3-a9d04ae85aca] Updated VIF entry in instance network info cache for port b9cd1004-903b-4e1d-ac1e-579f3de9ed98. {{(pid=75226) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 01:58:27 user nova-compute[75226]: DEBUG nova.network.neutron [req-6d9789ec-251a-4dd8-bcb5-e6a7a50ebcb7 req-b3c2337f-452c-457c-9b97-e1334f4925c2 service nova] [instance: cd6a5eb8-8d48-4894-aff3-a9d04ae85aca] Updating instance_info_cache with network_info: [{"id": "b9cd1004-903b-4e1d-ac1e-579f3de9ed98", "address": "fa:16:3e:fb:e6:d2", "network": {"id": "81bbbdad-218b-4fcd-b7f5-427fd49361cb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1151874504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "673620a69fba4a04af75baabe775dc8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9cd1004-90", "ovs_interfaceid": "b9cd1004-903b-4e1d-ac1e-579f3de9ed98", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:58:27 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-6d9789ec-251a-4dd8-bcb5-e6a7a50ebcb7 req-b3c2337f-452c-457c-9b97-e1334f4925c2 service nova] Releasing lock "refresh_cache-cd6a5eb8-8d48-4894-aff3-a9d04ae85aca" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 01:58:27 user nova-compute[75226]: INFO nova.virt.libvirt.driver [-] [instance: cd6a5eb8-8d48-4894-aff3-a9d04ae85aca] Instance destroyed successfully.
Nov 17 01:58:27 user nova-compute[75226]: DEBUG nova.objects.instance [None req-4a898587-8db7-436f-875a-8d19367cc795 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Lazy-loading 'resources' on Instance uuid cd6a5eb8-8d48-4894-aff3-a9d04ae85aca {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 01:58:27 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-4a898587-8db7-436f-875a-8d19367cc795 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T01:53:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1147170578',display_name='tempest-TestVolumeBootPattern-server-1147170578',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1147170578',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIOTXvx1rt0huiJMkCirjSAkUEIOTUxZuP5hnGbb4TZayM1DPwV+2un52eKf78XfXFJdTcPGOcA7AeRAFw+1gTwHIAhQ08B/zT7NrklMaP31fH3B8tWT2/QeOIfwk/TlfQ==',key_name='tempest-TestVolumeBootPattern-346525006',keypairs=<?>,launch_index=0,launched_at=2023-11-17T01:53:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='673620a69fba4a04af75baabe775dc8b',ramdisk_id='',reservation_id='r-cvvzgvy7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-971654489',owner_user_name='tempest-TestVolumeBootPattern-971654489-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T01:53:51Z,user_data=None,user_id='7c8c8baa56884dcd9a90f0187c9fc06f',uuid=cd6a5eb8-8d48-4894-aff3-a9d04ae85aca,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b9cd1004-903b-4e1d-ac1e-579f3de9ed98", "address": "fa:16:3e:fb:e6:d2", "network": {"id": "81bbbdad-218b-4fcd-b7f5-427fd49361cb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1151874504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "673620a69fba4a04af75baabe775dc8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9cd1004-90", "ovs_interfaceid": "b9cd1004-903b-4e1d-ac1e-579f3de9ed98", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 17 01:58:27 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-4a898587-8db7-436f-875a-8d19367cc795 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Converting VIF {"id": "b9cd1004-903b-4e1d-ac1e-579f3de9ed98", "address": "fa:16:3e:fb:e6:d2", "network": {"id": "81bbbdad-218b-4fcd-b7f5-427fd49361cb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1151874504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "673620a69fba4a04af75baabe775dc8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9cd1004-90", "ovs_interfaceid": "b9cd1004-903b-4e1d-ac1e-579f3de9ed98", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 01:58:27 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-4a898587-8db7-436f-875a-8d19367cc795 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fb:e6:d2,bridge_name='br-int',has_traffic_filtering=True,id=b9cd1004-903b-4e1d-ac1e-579f3de9ed98,network=Network(81bbbdad-218b-4fcd-b7f5-427fd49361cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9cd1004-90') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 01:58:27 user nova-compute[75226]: DEBUG os_vif [None req-4a898587-8db7-436f-875a-8d19367cc795 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fb:e6:d2,bridge_name='br-int',has_traffic_filtering=True,id=b9cd1004-903b-4e1d-ac1e-579f3de9ed98,network=Network(81bbbdad-218b-4fcd-b7f5-427fd49361cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9cd1004-90') {{(pid=75226) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 17 01:58:27 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:58:27 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb9cd1004-90, bridge=br-int, if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:58:27 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:58:27 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:58:27 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cbb99991-622a-40aa-9a77-819d3f8be8d4) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 01:58:27 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:58:27 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:58:27 user nova-compute[75226]: INFO os_vif [None req-4a898587-8db7-436f-875a-8d19367cc795 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fb:e6:d2,bridge_name='br-int',has_traffic_filtering=True,id=b9cd1004-903b-4e1d-ac1e-579f3de9ed98,network=Network(81bbbdad-218b-4fcd-b7f5-427fd49361cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9cd1004-90')
Nov 17 01:58:27 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a898587-8db7-436f-875a-8d19367cc795 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: cd6a5eb8-8d48-4894-aff3-a9d04ae85aca] calling os-brick to detach iSCSI Volume {{(pid=75226) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 17 01:58:27 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a898587-8db7-436f-875a-8d19367cc795 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc4cc36b490>, {'target_iqn': 'iqn.2010-10.org.openstack:875a05e9-5133-418e-a210-0b01076d92a8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DMmFhyko', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 01:58:27 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-4a898587-8db7-436f-875a-8d19367cc795 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 01:58:27 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-4a898587-8db7-436f-875a-8d19367cc795 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 01:58:27 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-4a898587-8db7-436f-875a-8d19367cc795 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 01:58:27 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:58:27 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:58:27 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[8de121e9-d97c-4318-aa15-092e1bc55f9e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:875a05e9-5133-418e-a210-0b01076d92a8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:58:27 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a898587-8db7-436f-875a-8d19367cc795 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 17 01:58:27 user nova-compute[75226]: No targets found.
Nov 17 01:58:27 user nova-compute[75226]: iSNS:
Nov 17 01:58:27 user nova-compute[75226]: No targets found.
Nov 17 01:58:27 user nova-compute[75226]: STATIC:
Nov 17 01:58:27 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:875a05e9-5133-418e-a210-0b01076d92a8
Nov 17 01:58:27 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 01:58:27 user nova-compute[75226]:                 Iface Name: default
Nov 17 01:58:27 user nova-compute[75226]: FIRMWARE:
Nov 17 01:58:27 user nova-compute[75226]: No targets found.
Nov 17 01:58:27 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:58:27 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a898587-8db7-436f-875a-8d19367cc795 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 17 01:58:27 user nova-compute[75226]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 17 01:58:27 user nova-compute[75226]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75226) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 17 01:58:27 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a898587-8db7-436f-875a-8d19367cc795 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:875a05e9-5133-418e-a210-0b01076d92a8', 0)] {{(pid=75226) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 17 01:58:27 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:58:27 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.015s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:58:27 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[19255e9f-6031-4d2b-bb76-7d13e2fba6a6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:875a05e9-5133-418e-a210-0b01076d92a8\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:58:27 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:58:27 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:58:27 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ff82386-fe01-41cf-8506-00d9d2b0c97e]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:875a05e9-5133-418e-a210-0b01076d92a8 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:58:27 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a898587-8db7-436f-875a-8d19367cc795 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:875a05e9-5133-418e-a210-0b01076d92a8 (non-flash)
Nov 17 01:58:27 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 01:58:27 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a898587-8db7-436f-875a-8d19367cc795 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:875a05e9-5133-418e-a210-0b01076d92a8 (non-flash)
Nov 17 01:58:27 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 01:58:27 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a898587-8db7-436f-875a-8d19367cc795 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc4b42d6b00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:875a05e9-5133-418e-a210-0b01076d92a8'): ({'sdb'}, set())}) {{(pid=75226) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 17 01:58:27 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-4a898587-8db7-436f-875a-8d19367cc795 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Removing single pathed devices sdb {{(pid=75226) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 17 01:58:27 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:58:27 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:58:27 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[531dd75c-fd17-429d-a498-5361c627c181]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:58:27 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:58:27 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:58:27 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[01797205-8376-41f8-92b6-d2dd9d746237]: (4, ('ok\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:58:27 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-4a898587-8db7-436f-875a-8d19367cc795 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Flushing IO for device /dev/sdb {{(pid=75226) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 17 01:58:27 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:58:27 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:58:27 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[effbc5fd-a67d-4134-8bcf-d8759847900e]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:58:27 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-4a898587-8db7-436f-875a-8d19367cc795 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75226) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 17 01:58:27 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:58:27 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.056s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:58:27 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[afc96cdc-5f2d-44ab-a9ab-1871a6a3b15a]: (4, ('1', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:58:27 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-4a898587-8db7-436f-875a-8d19367cc795 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75226) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 17 01:58:27 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-4a898587-8db7-436f-875a-8d19367cc795 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] SCSI volumes sdb have been removed. {{(pid=75226) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 17 01:58:27 user nova-compute[75226]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_24a41b1f', '/dev/disk/by-id/scsi-1SCST_BIO24a41b1f-22ad42292783a90b', '/dev/disk/by-id/scsi-23232616434323239') {{(pid=85818) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 17 01:58:27 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[094825b9-6011-4b8f-8dcf-055b182fbc15]: (4, None) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:58:27 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a898587-8db7-436f-875a-8d19367cc795 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:875a05e9-5133-418e-a210-0b01076d92a8')] {{(pid=75226) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 17 01:58:27 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:875a05e9-5133-418e-a210-0b01076d92a8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:58:27 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:875a05e9-5133-418e-a210-0b01076d92a8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:58:27 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccb9d26f-0a97-4d35-be70-482f8929690a]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:58:27 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a898587-8db7-436f-875a-8d19367cc795 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:58:27 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:875a05e9-5133-418e-a210-0b01076d92a8 -p 172.16.0.220:3260 --logout {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:58:27 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:875a05e9-5133-418e-a210-0b01076d92a8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:58:27 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e7a54f6-d9fa-4e18-9368-5cd55f5da6d9]: (4, ('Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:875a05e9-5133-418e-a210-0b01076d92a8, portal: 172.16.0.220,3260]\nLogout of [sid: 62, target: iqn.2010-10.org.openstack:875a05e9-5133-418e-a210-0b01076d92a8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:58:27 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a898587-8db7-436f-875a-8d19367cc795 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:875a05e9-5133-418e-a210-0b01076d92a8, portal: 172.16.0.220,3260]
Nov 17 01:58:27 user nova-compute[75226]: Logout of [sid: 62, target: iqn.2010-10.org.openstack:875a05e9-5133-418e-a210-0b01076d92a8, portal: 172.16.0.220,3260] successful.
Nov 17 01:58:27 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:58:27 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:875a05e9-5133-418e-a210-0b01076d92a8 -p 172.16.0.220:3260 --op delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 01:58:27 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:875a05e9-5133-418e-a210-0b01076d92a8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 01:58:27 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[943511e1-bece-45e4-b7d2-85c8e017ff61]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 01:58:27 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a898587-8db7-436f-875a-8d19367cc795 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 01:58:27 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-4a898587-8db7-436f-875a-8d19367cc795 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.279s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 01:58:27 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a898587-8db7-436f-875a-8d19367cc795 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] <== disconnect_volume: return (279ms) None {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 01:58:27 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a898587-8db7-436f-875a-8d19367cc795 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: cd6a5eb8-8d48-4894-aff3-a9d04ae85aca] Disconnected iSCSI Volume {{(pid=75226) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 17 01:58:27 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-4a898587-8db7-436f-875a-8d19367cc795 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: cd6a5eb8-8d48-4894-aff3-a9d04ae85aca] Deleting instance files /opt/stack/data/nova/instances/cd6a5eb8-8d48-4894-aff3-a9d04ae85aca_del
Nov 17 01:58:27 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-4a898587-8db7-436f-875a-8d19367cc795 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: cd6a5eb8-8d48-4894-aff3-a9d04ae85aca] Deletion of /opt/stack/data/nova/instances/cd6a5eb8-8d48-4894-aff3-a9d04ae85aca_del complete
Nov 17 01:58:27 user nova-compute[75226]: INFO nova.compute.manager [None req-4a898587-8db7-436f-875a-8d19367cc795 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: cd6a5eb8-8d48-4894-aff3-a9d04ae85aca] Took 1.12 seconds to destroy the instance on the hypervisor.
Nov 17 01:58:27 user nova-compute[75226]: DEBUG oslo.service.loopingcall [None req-4a898587-8db7-436f-875a-8d19367cc795 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75226) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 17 01:58:27 user nova-compute[75226]: DEBUG nova.compute.manager [-] [instance: cd6a5eb8-8d48-4894-aff3-a9d04ae85aca] Deallocating network for instance {{(pid=75226) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 17 01:58:27 user nova-compute[75226]: DEBUG nova.network.neutron [-] [instance: cd6a5eb8-8d48-4894-aff3-a9d04ae85aca] deallocate_for_instance() {{(pid=75226) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 17 01:58:27 user nova-compute[75226]: DEBUG nova.network.neutron [-] [instance: cd6a5eb8-8d48-4894-aff3-a9d04ae85aca] Updating instance_info_cache with network_info: [] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 01:58:27 user nova-compute[75226]: INFO nova.compute.manager [-] [instance: cd6a5eb8-8d48-4894-aff3-a9d04ae85aca] Took 0.39 seconds to deallocate network for instance.
Nov 17 01:58:27 user nova-compute[75226]: DEBUG nova.compute.manager [req-6fcb17d8-f5d5-4d6c-9893-9ddd89952238 req-5af2214d-58cd-407d-a08f-aac4dd905530 service nova] [instance: cd6a5eb8-8d48-4894-aff3-a9d04ae85aca] Received event network-vif-deleted-b9cd1004-903b-4e1d-ac1e-579f3de9ed98 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:58:28 user nova-compute[75226]: INFO nova.compute.manager [None req-4a898587-8db7-436f-875a-8d19367cc795 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] [instance: cd6a5eb8-8d48-4894-aff3-a9d04ae85aca] Took 0.68 seconds to detach 1 volumes for instance.
Nov 17 01:58:28 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-4a898587-8db7-436f-875a-8d19367cc795 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:58:28 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-4a898587-8db7-436f-875a-8d19367cc795 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:58:28 user nova-compute[75226]: DEBUG nova.compute.manager [req-95af063e-718d-47d4-988a-40c6f20380c3 req-413e4084-7a24-4ba0-844d-cf57966fbd83 service nova] [instance: cd6a5eb8-8d48-4894-aff3-a9d04ae85aca] Received event network-vif-plugged-b9cd1004-903b-4e1d-ac1e-579f3de9ed98 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 01:58:28 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-95af063e-718d-47d4-988a-40c6f20380c3 req-413e4084-7a24-4ba0-844d-cf57966fbd83 service nova] Acquiring lock "cd6a5eb8-8d48-4894-aff3-a9d04ae85aca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:58:28 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-95af063e-718d-47d4-988a-40c6f20380c3 req-413e4084-7a24-4ba0-844d-cf57966fbd83 service nova] Lock "cd6a5eb8-8d48-4894-aff3-a9d04ae85aca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:58:28 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-95af063e-718d-47d4-988a-40c6f20380c3 req-413e4084-7a24-4ba0-844d-cf57966fbd83 service nova] Lock "cd6a5eb8-8d48-4894-aff3-a9d04ae85aca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:58:28 user nova-compute[75226]: DEBUG nova.compute.manager [req-95af063e-718d-47d4-988a-40c6f20380c3 req-413e4084-7a24-4ba0-844d-cf57966fbd83 service nova] [instance: cd6a5eb8-8d48-4894-aff3-a9d04ae85aca] No waiting events found dispatching network-vif-plugged-b9cd1004-903b-4e1d-ac1e-579f3de9ed98 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 01:58:28 user nova-compute[75226]: WARNING nova.compute.manager [req-95af063e-718d-47d4-988a-40c6f20380c3 req-413e4084-7a24-4ba0-844d-cf57966fbd83 service nova] [instance: cd6a5eb8-8d48-4894-aff3-a9d04ae85aca] Received unexpected event network-vif-plugged-b9cd1004-903b-4e1d-ac1e-579f3de9ed98 for instance with vm_state deleted and task_state None.
Nov 17 01:58:28 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-4a898587-8db7-436f-875a-8d19367cc795 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:58:28 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-4a898587-8db7-436f-875a-8d19367cc795 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:58:28 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-4a898587-8db7-436f-875a-8d19367cc795 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.131s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:58:28 user nova-compute[75226]: INFO nova.scheduler.client.report [None req-4a898587-8db7-436f-875a-8d19367cc795 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Deleted allocations for instance cd6a5eb8-8d48-4894-aff3-a9d04ae85aca
Nov 17 01:58:29 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-4a898587-8db7-436f-875a-8d19367cc795 tempest-TestVolumeBootPattern-971654489 tempest-TestVolumeBootPattern-971654489-project-member] Lock "cd6a5eb8-8d48-4894-aff3-a9d04ae85aca" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.604s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:58:31 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:58:31 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:58:31 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:58:32 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:58:36 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:58:37 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:58:37 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:58:38 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:58:38 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Starting heal instance info cache {{(pid=75226) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 17 01:58:38 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Rebuilding the list of instances to heal {{(pid=75226) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 17 01:58:38 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Didn't find any instances for network info cache update. {{(pid=75226) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 17 01:58:38 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:58:38 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:58:38 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75226) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 17 01:58:42 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:58:46 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:58:46 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75226) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 17 01:58:46 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:58:47 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:58:47 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:58:47 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75226) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 17 01:58:47 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75226) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 01:58:47 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75226) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 01:58:47 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:58:47 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:58:47 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Cleaning up deleted instances {{(pid=75226) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 17 01:58:48 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] There are 0 instances to clean {{(pid=75226) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 17 01:58:52 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:58:57 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:59:02 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:59:07 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:59:12 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:59:17 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:59:17 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:59:22 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:59:22 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:59:25 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:59:25 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:59:25 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:59:25 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:59:26 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:59:26 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75226) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 17 01:59:26 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:59:26 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 01:59:26 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Hypervisor/Node resource view: name=user free_ram=9184MB free_disk=24.959575653076172GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75226) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 17 01:59:26 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 01:59:26 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 01:59:26 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75226) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 17 01:59:26 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75226) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 17 01:59:26 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Refreshing inventories for resource provider f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 17 01:59:26 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Updating ProviderTree inventory for provider f431122b-abb2-4ecb-9e21-e3ec333d823b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 17 01:59:26 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Updating inventory in ProviderTree for provider f431122b-abb2-4ecb-9e21-e3ec333d823b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 17 01:59:26 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Refreshing aggregate associations for resource provider f431122b-abb2-4ecb-9e21-e3ec333d823b, aggregates: None {{(pid=75226) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 17 01:59:26 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Refreshing trait associations for resource provider f431122b-abb2-4ecb-9e21-e3ec333d823b, traits: COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE42,HW_CPU_X86_SSE,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSSE3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_SATA {{(pid=75226) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 17 01:59:26 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 01:59:26 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 01:59:26 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Compute_service record updated for user:user {{(pid=75226) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 17 01:59:26 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.283s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 01:59:27 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:59:31 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:59:32 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:59:33 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:59:33 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:59:37 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:59:37 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:59:38 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:59:38 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Starting heal instance info cache {{(pid=75226) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 17 01:59:38 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Rebuilding the list of instances to heal {{(pid=75226) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 17 01:59:38 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Didn't find any instances for network info cache update. {{(pid=75226) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 17 01:59:38 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:59:38 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:59:38 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:59:38 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75226) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 17 01:59:42 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:59:47 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:59:52 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 01:59:52 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:59:52 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75226) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 17 01:59:52 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75226) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 01:59:52 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75226) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 01:59:52 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:59:53 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:59:57 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:59:57 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 01:59:58 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 01:59:58 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:00:01 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:00:02 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:00:03 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:00:04 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:00:07 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:00:08 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:00:10 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-00667f0d-5a80-4b1a-9b5c-0b2d250046a9 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Acquiring lock "4a981a97-8a93-4d0a-bf6b-9ec711cc621d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 02:00:10 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-00667f0d-5a80-4b1a-9b5c-0b2d250046a9 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Lock "4a981a97-8a93-4d0a-bf6b-9ec711cc621d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 02:00:10 user nova-compute[75226]: DEBUG nova.compute.manager [None req-00667f0d-5a80-4b1a-9b5c-0b2d250046a9 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] [instance: 4a981a97-8a93-4d0a-bf6b-9ec711cc621d] Starting instance... {{(pid=75226) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 17 02:00:10 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-00667f0d-5a80-4b1a-9b5c-0b2d250046a9 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 02:00:10 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-00667f0d-5a80-4b1a-9b5c-0b2d250046a9 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 02:00:10 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-00667f0d-5a80-4b1a-9b5c-0b2d250046a9 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75226) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 17 02:00:10 user nova-compute[75226]: INFO nova.compute.claims [None req-00667f0d-5a80-4b1a-9b5c-0b2d250046a9 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] [instance: 4a981a97-8a93-4d0a-bf6b-9ec711cc621d] Claim successful on node user
Nov 17 02:00:10 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-00667f0d-5a80-4b1a-9b5c-0b2d250046a9 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 02:00:10 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-00667f0d-5a80-4b1a-9b5c-0b2d250046a9 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 02:00:10 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-00667f0d-5a80-4b1a-9b5c-0b2d250046a9 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.245s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 02:00:10 user nova-compute[75226]: DEBUG nova.compute.manager [None req-00667f0d-5a80-4b1a-9b5c-0b2d250046a9 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] [instance: 4a981a97-8a93-4d0a-bf6b-9ec711cc621d] Start building networks asynchronously for instance. {{(pid=75226) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 17 02:00:10 user nova-compute[75226]: DEBUG nova.compute.manager [None req-00667f0d-5a80-4b1a-9b5c-0b2d250046a9 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] [instance: 4a981a97-8a93-4d0a-bf6b-9ec711cc621d] Allocating IP information in the background. {{(pid=75226) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 17 02:00:10 user nova-compute[75226]: DEBUG nova.network.neutron [None req-00667f0d-5a80-4b1a-9b5c-0b2d250046a9 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] [instance: 4a981a97-8a93-4d0a-bf6b-9ec711cc621d] allocate_for_instance() {{(pid=75226) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 17 02:00:10 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-00667f0d-5a80-4b1a-9b5c-0b2d250046a9 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] [instance: 4a981a97-8a93-4d0a-bf6b-9ec711cc621d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 17 02:00:10 user nova-compute[75226]: DEBUG nova.compute.manager [None req-00667f0d-5a80-4b1a-9b5c-0b2d250046a9 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] [instance: 4a981a97-8a93-4d0a-bf6b-9ec711cc621d] Start building block device mappings for instance. {{(pid=75226) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 17 02:00:10 user nova-compute[75226]: DEBUG nova.policy [None req-00667f0d-5a80-4b1a-9b5c-0b2d250046a9 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f4a8bc28db1c4c6abc1506bfa99ee41a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c84a4fc5baa459d9fb5a3ccb78d2a8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75226) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 17 02:00:10 user nova-compute[75226]: DEBUG nova.compute.manager [None req-00667f0d-5a80-4b1a-9b5c-0b2d250046a9 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] [instance: 4a981a97-8a93-4d0a-bf6b-9ec711cc621d] Start spawning the instance on the hypervisor. {{(pid=75226) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 17 02:00:10 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-00667f0d-5a80-4b1a-9b5c-0b2d250046a9 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] [instance: 4a981a97-8a93-4d0a-bf6b-9ec711cc621d] Creating instance directory {{(pid=75226) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 17 02:00:10 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-00667f0d-5a80-4b1a-9b5c-0b2d250046a9 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] [instance: 4a981a97-8a93-4d0a-bf6b-9ec711cc621d] Creating image(s)
Nov 17 02:00:10 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-00667f0d-5a80-4b1a-9b5c-0b2d250046a9 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Acquiring lock "/opt/stack/data/nova/instances/4a981a97-8a93-4d0a-bf6b-9ec711cc621d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 02:00:10 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-00667f0d-5a80-4b1a-9b5c-0b2d250046a9 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Lock "/opt/stack/data/nova/instances/4a981a97-8a93-4d0a-bf6b-9ec711cc621d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 02:00:10 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-00667f0d-5a80-4b1a-9b5c-0b2d250046a9 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Lock "/opt/stack/data/nova/instances/4a981a97-8a93-4d0a-bf6b-9ec711cc621d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.011s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 02:00:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-00667f0d-5a80-4b1a-9b5c-0b2d250046a9 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:00:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-00667f0d-5a80-4b1a-9b5c-0b2d250046a9 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json" returned: 0 in 0.195s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:00:10 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-00667f0d-5a80-4b1a-9b5c-0b2d250046a9 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Acquiring lock "a8a62c2546af3a2036b853250c5ac64d4c6b4371" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 02:00:10 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-00667f0d-5a80-4b1a-9b5c-0b2d250046a9 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Lock "a8a62c2546af3a2036b853250c5ac64d4c6b4371" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 02:00:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-00667f0d-5a80-4b1a-9b5c-0b2d250046a9 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:00:11 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-00667f0d-5a80-4b1a-9b5c-0b2d250046a9 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json" returned: 0 in 0.194s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:00:11 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-00667f0d-5a80-4b1a-9b5c-0b2d250046a9 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371,backing_fmt=raw /opt/stack/data/nova/instances/4a981a97-8a93-4d0a-bf6b-9ec711cc621d/disk 1073741824 {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:00:11 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-00667f0d-5a80-4b1a-9b5c-0b2d250046a9 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371,backing_fmt=raw /opt/stack/data/nova/instances/4a981a97-8a93-4d0a-bf6b-9ec711cc621d/disk 1073741824" returned: 0 in 0.092s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:00:11 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-00667f0d-5a80-4b1a-9b5c-0b2d250046a9 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Lock "a8a62c2546af3a2036b853250c5ac64d4c6b4371" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.293s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 02:00:11 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-00667f0d-5a80-4b1a-9b5c-0b2d250046a9 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:00:11 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-00667f0d-5a80-4b1a-9b5c-0b2d250046a9 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8a62c2546af3a2036b853250c5ac64d4c6b4371 --force-share --output=json" returned: 0 in 0.181s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:00:11 user nova-compute[75226]: DEBUG nova.virt.disk.api [None req-00667f0d-5a80-4b1a-9b5c-0b2d250046a9 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4a981a97-8a93-4d0a-bf6b-9ec711cc621d/disk. size=1073741824 {{(pid=75226) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 17 02:00:11 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-00667f0d-5a80-4b1a-9b5c-0b2d250046a9 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a981a97-8a93-4d0a-bf6b-9ec711cc621d/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:00:11 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-00667f0d-5a80-4b1a-9b5c-0b2d250046a9 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a981a97-8a93-4d0a-bf6b-9ec711cc621d/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:00:11 user nova-compute[75226]: DEBUG nova.virt.disk.api [None req-00667f0d-5a80-4b1a-9b5c-0b2d250046a9 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Cannot resize image /opt/stack/data/nova/instances/4a981a97-8a93-4d0a-bf6b-9ec711cc621d/disk to a smaller size. {{(pid=75226) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 17 02:00:11 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-00667f0d-5a80-4b1a-9b5c-0b2d250046a9 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] [instance: 4a981a97-8a93-4d0a-bf6b-9ec711cc621d] Created local disks {{(pid=75226) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 17 02:00:11 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-00667f0d-5a80-4b1a-9b5c-0b2d250046a9 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] [instance: 4a981a97-8a93-4d0a-bf6b-9ec711cc621d] Ensure instance console log exists: /opt/stack/data/nova/instances/4a981a97-8a93-4d0a-bf6b-9ec711cc621d/console.log {{(pid=75226) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 17 02:00:11 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-00667f0d-5a80-4b1a-9b5c-0b2d250046a9 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 02:00:11 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-00667f0d-5a80-4b1a-9b5c-0b2d250046a9 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 02:00:11 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-00667f0d-5a80-4b1a-9b5c-0b2d250046a9 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 02:00:11 user nova-compute[75226]: DEBUG nova.network.neutron [None req-00667f0d-5a80-4b1a-9b5c-0b2d250046a9 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] [instance: 4a981a97-8a93-4d0a-bf6b-9ec711cc621d] Successfully created port: 78739500-0226-4429-bf53-c512d2c01d89 {{(pid=75226) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 17 02:00:12 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:00:12 user nova-compute[75226]: DEBUG nova.network.neutron [None req-00667f0d-5a80-4b1a-9b5c-0b2d250046a9 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] [instance: 4a981a97-8a93-4d0a-bf6b-9ec711cc621d] Successfully updated port: 78739500-0226-4429-bf53-c512d2c01d89 {{(pid=75226) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 17 02:00:12 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-00667f0d-5a80-4b1a-9b5c-0b2d250046a9 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Acquiring lock "refresh_cache-4a981a97-8a93-4d0a-bf6b-9ec711cc621d" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 02:00:12 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-00667f0d-5a80-4b1a-9b5c-0b2d250046a9 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Acquired lock "refresh_cache-4a981a97-8a93-4d0a-bf6b-9ec711cc621d" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 02:00:12 user nova-compute[75226]: DEBUG nova.network.neutron [None req-00667f0d-5a80-4b1a-9b5c-0b2d250046a9 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] [instance: 4a981a97-8a93-4d0a-bf6b-9ec711cc621d] Building network info cache for instance {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 17 02:00:12 user nova-compute[75226]: DEBUG nova.compute.manager [req-3bbc4058-7787-4cb5-a869-be783edcfebc req-737c4668-510c-4e8d-933d-b465c8990ceb service nova] [instance: 4a981a97-8a93-4d0a-bf6b-9ec711cc621d] Received event network-changed-78739500-0226-4429-bf53-c512d2c01d89 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 02:00:12 user nova-compute[75226]: DEBUG nova.compute.manager [req-3bbc4058-7787-4cb5-a869-be783edcfebc req-737c4668-510c-4e8d-933d-b465c8990ceb service nova] [instance: 4a981a97-8a93-4d0a-bf6b-9ec711cc621d] Refreshing instance network info cache due to event network-changed-78739500-0226-4429-bf53-c512d2c01d89. {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 02:00:12 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-3bbc4058-7787-4cb5-a869-be783edcfebc req-737c4668-510c-4e8d-933d-b465c8990ceb service nova] Acquiring lock "refresh_cache-4a981a97-8a93-4d0a-bf6b-9ec711cc621d" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 02:00:12 user nova-compute[75226]: DEBUG nova.network.neutron [None req-00667f0d-5a80-4b1a-9b5c-0b2d250046a9 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] [instance: 4a981a97-8a93-4d0a-bf6b-9ec711cc621d] Instance cache missing network info. {{(pid=75226) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 17 02:00:12 user nova-compute[75226]: DEBUG nova.network.neutron [None req-00667f0d-5a80-4b1a-9b5c-0b2d250046a9 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] [instance: 4a981a97-8a93-4d0a-bf6b-9ec711cc621d] Updating instance_info_cache with network_info: [{"id": "78739500-0226-4429-bf53-c512d2c01d89", "address": "fa:16:3e:f5:a8:40", "network": {"id": "e111d356-c2ca-4cdc-bd8c-1d6bca9a54fd", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-640637510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c84a4fc5baa459d9fb5a3ccb78d2a8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78739500-02", "ovs_interfaceid": "78739500-0226-4429-bf53-c512d2c01d89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 02:00:12 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-00667f0d-5a80-4b1a-9b5c-0b2d250046a9 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Releasing lock "refresh_cache-4a981a97-8a93-4d0a-bf6b-9ec711cc621d" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 02:00:12 user nova-compute[75226]: DEBUG nova.compute.manager [None req-00667f0d-5a80-4b1a-9b5c-0b2d250046a9 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] [instance: 4a981a97-8a93-4d0a-bf6b-9ec711cc621d] Instance network_info: |[{"id": "78739500-0226-4429-bf53-c512d2c01d89", "address": "fa:16:3e:f5:a8:40", "network": {"id": "e111d356-c2ca-4cdc-bd8c-1d6bca9a54fd", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-640637510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c84a4fc5baa459d9fb5a3ccb78d2a8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78739500-02", "ovs_interfaceid": "78739500-0226-4429-bf53-c512d2c01d89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75226) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 17 02:00:12 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-3bbc4058-7787-4cb5-a869-be783edcfebc req-737c4668-510c-4e8d-933d-b465c8990ceb service nova] Acquired lock "refresh_cache-4a981a97-8a93-4d0a-bf6b-9ec711cc621d" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 02:00:12 user nova-compute[75226]: DEBUG nova.network.neutron [req-3bbc4058-7787-4cb5-a869-be783edcfebc req-737c4668-510c-4e8d-933d-b465c8990ceb service nova] [instance: 4a981a97-8a93-4d0a-bf6b-9ec711cc621d] Refreshing network info cache for port 78739500-0226-4429-bf53-c512d2c01d89 {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 02:00:12 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-00667f0d-5a80-4b1a-9b5c-0b2d250046a9 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] [instance: 4a981a97-8a93-4d0a-bf6b-9ec711cc621d] Start _get_guest_xml network_info=[{"id": "78739500-0226-4429-bf53-c512d2c01d89", "address": "fa:16:3e:f5:a8:40", "network": {"id": "e111d356-c2ca-4cdc-bd8c-1d6bca9a54fd", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-640637510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c84a4fc5baa459d9fb5a3ccb78d2a8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78739500-02", "ovs_interfaceid": "78739500-0226-4429-bf53-c512d2c01d89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T01:13:22Z,direct_url=<?>,disk_format='qcow2',id=0b369aea-6f3f-4690-9f01-229b90ab6310,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4e110cbf9a84362a6864a7732c435a1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T01:13:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '0b369aea-6f3f-4690-9f01-229b90ab6310'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75226) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 17 02:00:12 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-00667f0d-5a80-4b1a-9b5c-0b2d250046a9 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 02:00:12 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-00667f0d-5a80-4b1a-9b5c-0b2d250046a9 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 02:00:12 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-00667f0d-5a80-4b1a-9b5c-0b2d250046a9 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75226) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 17 02:00:12 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-00667f0d-5a80-4b1a-9b5c-0b2d250046a9 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] CPU controller missing on host. {{(pid=75226) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 17 02:00:12 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-00667f0d-5a80-4b1a-9b5c-0b2d250046a9 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75226) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 17 02:00:12 user nova-compute[75226]: DEBUG nova.virt.libvirt.host [None req-00667f0d-5a80-4b1a-9b5c-0b2d250046a9 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] CPU controller found on host. {{(pid=75226) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 17 02:00:12 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-00667f0d-5a80-4b1a-9b5c-0b2d250046a9 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75226) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 17 02:00:12 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-00667f0d-5a80-4b1a-9b5c-0b2d250046a9 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-17T01:13:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-17T01:13:22Z,direct_url=<?>,disk_format='qcow2',id=0b369aea-6f3f-4690-9f01-229b90ab6310,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e4e110cbf9a84362a6864a7732c435a1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-17T01:13:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 17 02:00:12 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-00667f0d-5a80-4b1a-9b5c-0b2d250046a9 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Flavor limits 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 17 02:00:12 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-00667f0d-5a80-4b1a-9b5c-0b2d250046a9 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Image limits 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 17 02:00:12 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-00667f0d-5a80-4b1a-9b5c-0b2d250046a9 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Flavor pref 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 17 02:00:12 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-00667f0d-5a80-4b1a-9b5c-0b2d250046a9 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Image pref 0:0:0 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 17 02:00:12 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-00667f0d-5a80-4b1a-9b5c-0b2d250046a9 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75226) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 17 02:00:12 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-00667f0d-5a80-4b1a-9b5c-0b2d250046a9 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 17 02:00:12 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-00667f0d-5a80-4b1a-9b5c-0b2d250046a9 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75226) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 17 02:00:12 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-00667f0d-5a80-4b1a-9b5c-0b2d250046a9 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Got 1 possible topologies {{(pid=75226) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 17 02:00:12 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-00667f0d-5a80-4b1a-9b5c-0b2d250046a9 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 17 02:00:12 user nova-compute[75226]: DEBUG nova.virt.hardware [None req-00667f0d-5a80-4b1a-9b5c-0b2d250046a9 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75226) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 17 02:00:12 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-00667f0d-5a80-4b1a-9b5c-0b2d250046a9 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T02:00:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1412778893',display_name='tempest-SnapshotDataIntegrityTests-server-1412778893',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1412778893',id=53,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBq2KpG+48yTQTweHDmAzliSQZiYkltbHx+1phs/8oAYJYxY3ivkVT9YAjyPMv8WkUuJfDX92mAwaMt5kTog8wZjziy9xWCRO89qBdwytzKgRH1J0asvJ/EBf1kHQ6OlRw==',key_name='tempest-keypair-1136126954',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4c84a4fc5baa459d9fb5a3ccb78d2a8d',ramdisk_id='',reservation_id='r-0qid39ov',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1099353435',owner_user_name='tempest-SnapshotDataIntegrityTests-1099353435-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T02:00:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f4a8bc28db1c4c6abc1506bfa99ee41a',uuid=4a981a97-8a93-4d0a-bf6b-9ec711cc621d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "78739500-0226-4429-bf53-c512d2c01d89", "address": "fa:16:3e:f5:a8:40", "network": {"id": "e111d356-c2ca-4cdc-bd8c-1d6bca9a54fd", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-640637510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c84a4fc5baa459d9fb5a3ccb78d2a8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78739500-02", "ovs_interfaceid": "78739500-0226-4429-bf53-c512d2c01d89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75226) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 17 02:00:12 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-00667f0d-5a80-4b1a-9b5c-0b2d250046a9 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Converting VIF {"id": "78739500-0226-4429-bf53-c512d2c01d89", "address": "fa:16:3e:f5:a8:40", "network": {"id": "e111d356-c2ca-4cdc-bd8c-1d6bca9a54fd", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-640637510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c84a4fc5baa459d9fb5a3ccb78d2a8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78739500-02", "ovs_interfaceid": "78739500-0226-4429-bf53-c512d2c01d89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 02:00:12 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-00667f0d-5a80-4b1a-9b5c-0b2d250046a9 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:a8:40,bridge_name='br-int',has_traffic_filtering=True,id=78739500-0226-4429-bf53-c512d2c01d89,network=Network(e111d356-c2ca-4cdc-bd8c-1d6bca9a54fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78739500-02') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 02:00:12 user nova-compute[75226]: DEBUG nova.objects.instance [None req-00667f0d-5a80-4b1a-9b5c-0b2d250046a9 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Lazy-loading 'pci_devices' on Instance uuid 4a981a97-8a93-4d0a-bf6b-9ec711cc621d {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 02:00:12 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-00667f0d-5a80-4b1a-9b5c-0b2d250046a9 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] [instance: 4a981a97-8a93-4d0a-bf6b-9ec711cc621d] End _get_guest_xml xml=<domain type="kvm">
Nov 17 02:00:12 user nova-compute[75226]:   <uuid>4a981a97-8a93-4d0a-bf6b-9ec711cc621d</uuid>
Nov 17 02:00:12 user nova-compute[75226]:   <name>instance-00000035</name>
Nov 17 02:00:12 user nova-compute[75226]:   <memory>524288</memory>
Nov 17 02:00:12 user nova-compute[75226]:   <vcpu>1</vcpu>
Nov 17 02:00:12 user nova-compute[75226]:   <metadata>
Nov 17 02:00:12 user nova-compute[75226]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 17 02:00:12 user nova-compute[75226]:       <nova:package version="0.0.0"/>
Nov 17 02:00:12 user nova-compute[75226]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1412778893</nova:name>
Nov 17 02:00:12 user nova-compute[75226]:       <nova:creationTime>2023-11-17 02:00:12</nova:creationTime>
Nov 17 02:00:12 user nova-compute[75226]:       <nova:flavor name="m1.tiny">
Nov 17 02:00:12 user nova-compute[75226]:         <nova:memory>512</nova:memory>
Nov 17 02:00:12 user nova-compute[75226]:         <nova:disk>1</nova:disk>
Nov 17 02:00:12 user nova-compute[75226]:         <nova:swap>0</nova:swap>
Nov 17 02:00:12 user nova-compute[75226]:         <nova:ephemeral>0</nova:ephemeral>
Nov 17 02:00:12 user nova-compute[75226]:         <nova:vcpus>1</nova:vcpus>
Nov 17 02:00:12 user nova-compute[75226]:       </nova:flavor>
Nov 17 02:00:12 user nova-compute[75226]:       <nova:owner>
Nov 17 02:00:12 user nova-compute[75226]:         <nova:user uuid="f4a8bc28db1c4c6abc1506bfa99ee41a">tempest-SnapshotDataIntegrityTests-1099353435-project-member</nova:user>
Nov 17 02:00:12 user nova-compute[75226]:         <nova:project uuid="4c84a4fc5baa459d9fb5a3ccb78d2a8d">tempest-SnapshotDataIntegrityTests-1099353435</nova:project>
Nov 17 02:00:12 user nova-compute[75226]:       </nova:owner>
Nov 17 02:00:12 user nova-compute[75226]:       <nova:root type="image" uuid="0b369aea-6f3f-4690-9f01-229b90ab6310"/>
Nov 17 02:00:12 user nova-compute[75226]:       <nova:ports>
Nov 17 02:00:12 user nova-compute[75226]:         <nova:port uuid="78739500-0226-4429-bf53-c512d2c01d89">
Nov 17 02:00:12 user nova-compute[75226]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 17 02:00:12 user nova-compute[75226]:         </nova:port>
Nov 17 02:00:12 user nova-compute[75226]:       </nova:ports>
Nov 17 02:00:12 user nova-compute[75226]:     </nova:instance>
Nov 17 02:00:12 user nova-compute[75226]:   </metadata>
Nov 17 02:00:12 user nova-compute[75226]:   <sysinfo type="smbios">
Nov 17 02:00:12 user nova-compute[75226]:     <system>
Nov 17 02:00:12 user nova-compute[75226]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 17 02:00:12 user nova-compute[75226]:       <entry name="product">OpenStack Nova</entry>
Nov 17 02:00:12 user nova-compute[75226]:       <entry name="version">0.0.0</entry>
Nov 17 02:00:12 user nova-compute[75226]:       <entry name="serial">4a981a97-8a93-4d0a-bf6b-9ec711cc621d</entry>
Nov 17 02:00:12 user nova-compute[75226]:       <entry name="uuid">4a981a97-8a93-4d0a-bf6b-9ec711cc621d</entry>
Nov 17 02:00:12 user nova-compute[75226]:       <entry name="family">Virtual Machine</entry>
Nov 17 02:00:12 user nova-compute[75226]:     </system>
Nov 17 02:00:12 user nova-compute[75226]:   </sysinfo>
Nov 17 02:00:12 user nova-compute[75226]:   <os>
Nov 17 02:00:12 user nova-compute[75226]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 17 02:00:12 user nova-compute[75226]:     <boot dev="hd"/>
Nov 17 02:00:12 user nova-compute[75226]:     <smbios mode="sysinfo"/>
Nov 17 02:00:12 user nova-compute[75226]:   </os>
Nov 17 02:00:12 user nova-compute[75226]:   <features>
Nov 17 02:00:12 user nova-compute[75226]:     <acpi/>
Nov 17 02:00:12 user nova-compute[75226]:     <apic/>
Nov 17 02:00:12 user nova-compute[75226]:     <vmcoreinfo/>
Nov 17 02:00:12 user nova-compute[75226]:   </features>
Nov 17 02:00:12 user nova-compute[75226]:   <clock offset="utc">
Nov 17 02:00:12 user nova-compute[75226]:     <timer name="pit" tickpolicy="delay"/>
Nov 17 02:00:12 user nova-compute[75226]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 17 02:00:12 user nova-compute[75226]:     <timer name="hpet" present="no"/>
Nov 17 02:00:12 user nova-compute[75226]:   </clock>
Nov 17 02:00:12 user nova-compute[75226]:   <cpu mode="custom" match="exact">
Nov 17 02:00:12 user nova-compute[75226]:     <model>Nehalem</model>
Nov 17 02:00:12 user nova-compute[75226]:     <topology sockets="1" cores="1" threads="1"/>
Nov 17 02:00:12 user nova-compute[75226]:   </cpu>
Nov 17 02:00:12 user nova-compute[75226]:   <devices>
Nov 17 02:00:12 user nova-compute[75226]:     <disk type="file" device="disk">
Nov 17 02:00:12 user nova-compute[75226]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 17 02:00:12 user nova-compute[75226]:       <source file="/opt/stack/data/nova/instances/4a981a97-8a93-4d0a-bf6b-9ec711cc621d/disk"/>
Nov 17 02:00:12 user nova-compute[75226]:       <target dev="vda" bus="virtio"/>
Nov 17 02:00:12 user nova-compute[75226]:     </disk>
Nov 17 02:00:12 user nova-compute[75226]:     <interface type="ethernet">
Nov 17 02:00:12 user nova-compute[75226]:       <mac address="fa:16:3e:f5:a8:40"/>
Nov 17 02:00:12 user nova-compute[75226]:       <model type="virtio"/>
Nov 17 02:00:12 user nova-compute[75226]:       <mtu size="1442"/>
Nov 17 02:00:12 user nova-compute[75226]:       <target dev="tap78739500-02"/>
Nov 17 02:00:12 user nova-compute[75226]:     </interface>
Nov 17 02:00:12 user nova-compute[75226]:     <serial type="pty">
Nov 17 02:00:12 user nova-compute[75226]:       <log file="/opt/stack/data/nova/instances/4a981a97-8a93-4d0a-bf6b-9ec711cc621d/console.log" append="off"/>
Nov 17 02:00:12 user nova-compute[75226]:     </serial>
Nov 17 02:00:12 user nova-compute[75226]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 17 02:00:12 user nova-compute[75226]:     <video>
Nov 17 02:00:12 user nova-compute[75226]:       <model type="virtio"/>
Nov 17 02:00:12 user nova-compute[75226]:     </video>
Nov 17 02:00:12 user nova-compute[75226]:     <rng model="virtio">
Nov 17 02:00:12 user nova-compute[75226]:       <backend model="random">/dev/urandom</backend>
Nov 17 02:00:12 user nova-compute[75226]:     </rng>
Nov 17 02:00:12 user nova-compute[75226]:     <controller type="usb" index="0" model="none"/>
Nov 17 02:00:12 user nova-compute[75226]:     <memballoon model="virtio">
Nov 17 02:00:12 user nova-compute[75226]:       <stats period="10"/>
Nov 17 02:00:12 user nova-compute[75226]:     </memballoon>
Nov 17 02:00:12 user nova-compute[75226]:   </devices>
Nov 17 02:00:12 user nova-compute[75226]: </domain>
Nov 17 02:00:12 user nova-compute[75226]:  {{(pid=75226) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 17 02:00:12 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-00667f0d-5a80-4b1a-9b5c-0b2d250046a9 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T02:00:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1412778893',display_name='tempest-SnapshotDataIntegrityTests-server-1412778893',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1412778893',id=53,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBq2KpG+48yTQTweHDmAzliSQZiYkltbHx+1phs/8oAYJYxY3ivkVT9YAjyPMv8WkUuJfDX92mAwaMt5kTog8wZjziy9xWCRO89qBdwytzKgRH1J0asvJ/EBf1kHQ6OlRw==',key_name='tempest-keypair-1136126954',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4c84a4fc5baa459d9fb5a3ccb78d2a8d',ramdisk_id='',reservation_id='r-0qid39ov',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1099353435',owner_user_name='tempest-SnapshotDataIntegrityTests-1099353435-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-17T02:00:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f4a8bc28db1c4c6abc1506bfa99ee41a',uuid=4a981a97-8a93-4d0a-bf6b-9ec711cc621d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "78739500-0226-4429-bf53-c512d2c01d89", "address": "fa:16:3e:f5:a8:40", "network": {"id": "e111d356-c2ca-4cdc-bd8c-1d6bca9a54fd", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-640637510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c84a4fc5baa459d9fb5a3ccb78d2a8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78739500-02", "ovs_interfaceid": "78739500-0226-4429-bf53-c512d2c01d89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 17 02:00:12 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-00667f0d-5a80-4b1a-9b5c-0b2d250046a9 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Converting VIF {"id": "78739500-0226-4429-bf53-c512d2c01d89", "address": "fa:16:3e:f5:a8:40", "network": {"id": "e111d356-c2ca-4cdc-bd8c-1d6bca9a54fd", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-640637510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c84a4fc5baa459d9fb5a3ccb78d2a8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78739500-02", "ovs_interfaceid": "78739500-0226-4429-bf53-c512d2c01d89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 02:00:12 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-00667f0d-5a80-4b1a-9b5c-0b2d250046a9 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:a8:40,bridge_name='br-int',has_traffic_filtering=True,id=78739500-0226-4429-bf53-c512d2c01d89,network=Network(e111d356-c2ca-4cdc-bd8c-1d6bca9a54fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78739500-02') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 02:00:12 user nova-compute[75226]: DEBUG os_vif [None req-00667f0d-5a80-4b1a-9b5c-0b2d250046a9 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:a8:40,bridge_name='br-int',has_traffic_filtering=True,id=78739500-0226-4429-bf53-c512d2c01d89,network=Network(e111d356-c2ca-4cdc-bd8c-1d6bca9a54fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78739500-02') {{(pid=75226) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 17 02:00:12 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:00:12 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 02:00:12 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 17 02:00:12 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:00:12 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f28aa05d-690c-5048-b471-c62c7d2a11b9', '_type': 'linux-noop'}}, row=False) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 02:00:12 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:00:12 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 02:00:12 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:00:12 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap78739500-02, may_exist=True, interface_attrs={}) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 02:00:12 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap78739500-02, col_values=(('qos', UUID('2bf2f28a-7dd2-41f2-90b4-318b93720d8a')),), if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 02:00:12 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap78739500-02, col_values=(('external_ids', {'iface-id': '78739500-0226-4429-bf53-c512d2c01d89', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f5:a8:40', 'vm-uuid': '4a981a97-8a93-4d0a-bf6b-9ec711cc621d'}),), if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 02:00:12 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:00:12 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 02:00:13 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:00:13 user nova-compute[75226]: INFO os_vif [None req-00667f0d-5a80-4b1a-9b5c-0b2d250046a9 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:a8:40,bridge_name='br-int',has_traffic_filtering=True,id=78739500-0226-4429-bf53-c512d2c01d89,network=Network(e111d356-c2ca-4cdc-bd8c-1d6bca9a54fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78739500-02')
Nov 17 02:00:13 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-00667f0d-5a80-4b1a-9b5c-0b2d250046a9 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] No BDM found with device name vda, not building metadata. {{(pid=75226) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 02:00:13 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-00667f0d-5a80-4b1a-9b5c-0b2d250046a9 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] No VIF found with MAC fa:16:3e:f5:a8:40, not building metadata {{(pid=75226) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 02:00:13 user nova-compute[75226]: DEBUG nova.network.neutron [req-3bbc4058-7787-4cb5-a869-be783edcfebc req-737c4668-510c-4e8d-933d-b465c8990ceb service nova] [instance: 4a981a97-8a93-4d0a-bf6b-9ec711cc621d] Updated VIF entry in instance network info cache for port 78739500-0226-4429-bf53-c512d2c01d89. {{(pid=75226) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 02:00:13 user nova-compute[75226]: DEBUG nova.network.neutron [req-3bbc4058-7787-4cb5-a869-be783edcfebc req-737c4668-510c-4e8d-933d-b465c8990ceb service nova] [instance: 4a981a97-8a93-4d0a-bf6b-9ec711cc621d] Updating instance_info_cache with network_info: [{"id": "78739500-0226-4429-bf53-c512d2c01d89", "address": "fa:16:3e:f5:a8:40", "network": {"id": "e111d356-c2ca-4cdc-bd8c-1d6bca9a54fd", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-640637510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c84a4fc5baa459d9fb5a3ccb78d2a8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78739500-02", "ovs_interfaceid": "78739500-0226-4429-bf53-c512d2c01d89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 02:00:13 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-3bbc4058-7787-4cb5-a869-be783edcfebc req-737c4668-510c-4e8d-933d-b465c8990ceb service nova] Releasing lock "refresh_cache-4a981a97-8a93-4d0a-bf6b-9ec711cc621d" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 02:00:13 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:00:14 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:00:14 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:00:14 user nova-compute[75226]: DEBUG nova.compute.manager [req-17e1adc9-aadc-4504-8033-1e1cc56378b7 req-293e105b-2c0a-42a5-aba0-5ff38411eade service nova] [instance: 4a981a97-8a93-4d0a-bf6b-9ec711cc621d] Received event network-vif-plugged-78739500-0226-4429-bf53-c512d2c01d89 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 02:00:14 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-17e1adc9-aadc-4504-8033-1e1cc56378b7 req-293e105b-2c0a-42a5-aba0-5ff38411eade service nova] Acquiring lock "4a981a97-8a93-4d0a-bf6b-9ec711cc621d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 02:00:14 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-17e1adc9-aadc-4504-8033-1e1cc56378b7 req-293e105b-2c0a-42a5-aba0-5ff38411eade service nova] Lock "4a981a97-8a93-4d0a-bf6b-9ec711cc621d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 02:00:14 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-17e1adc9-aadc-4504-8033-1e1cc56378b7 req-293e105b-2c0a-42a5-aba0-5ff38411eade service nova] Lock "4a981a97-8a93-4d0a-bf6b-9ec711cc621d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 02:00:14 user nova-compute[75226]: DEBUG nova.compute.manager [req-17e1adc9-aadc-4504-8033-1e1cc56378b7 req-293e105b-2c0a-42a5-aba0-5ff38411eade service nova] [instance: 4a981a97-8a93-4d0a-bf6b-9ec711cc621d] No waiting events found dispatching network-vif-plugged-78739500-0226-4429-bf53-c512d2c01d89 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 02:00:14 user nova-compute[75226]: WARNING nova.compute.manager [req-17e1adc9-aadc-4504-8033-1e1cc56378b7 req-293e105b-2c0a-42a5-aba0-5ff38411eade service nova] [instance: 4a981a97-8a93-4d0a-bf6b-9ec711cc621d] Received unexpected event network-vif-plugged-78739500-0226-4429-bf53-c512d2c01d89 for instance with vm_state building and task_state spawning.
Nov 17 02:00:15 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:00:15 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:00:15 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:00:16 user nova-compute[75226]: DEBUG nova.compute.manager [req-fe7f1e06-bdd8-42df-a237-5baa52f0a01a req-8482a779-860d-43e1-ae20-b2309a40c386 service nova] [instance: 4a981a97-8a93-4d0a-bf6b-9ec711cc621d] Received event network-vif-plugged-78739500-0226-4429-bf53-c512d2c01d89 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 02:00:16 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-fe7f1e06-bdd8-42df-a237-5baa52f0a01a req-8482a779-860d-43e1-ae20-b2309a40c386 service nova] Acquiring lock "4a981a97-8a93-4d0a-bf6b-9ec711cc621d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 02:00:16 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-fe7f1e06-bdd8-42df-a237-5baa52f0a01a req-8482a779-860d-43e1-ae20-b2309a40c386 service nova] Lock "4a981a97-8a93-4d0a-bf6b-9ec711cc621d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 02:00:16 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-fe7f1e06-bdd8-42df-a237-5baa52f0a01a req-8482a779-860d-43e1-ae20-b2309a40c386 service nova] Lock "4a981a97-8a93-4d0a-bf6b-9ec711cc621d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 02:00:16 user nova-compute[75226]: DEBUG nova.compute.manager [req-fe7f1e06-bdd8-42df-a237-5baa52f0a01a req-8482a779-860d-43e1-ae20-b2309a40c386 service nova] [instance: 4a981a97-8a93-4d0a-bf6b-9ec711cc621d] No waiting events found dispatching network-vif-plugged-78739500-0226-4429-bf53-c512d2c01d89 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 02:00:16 user nova-compute[75226]: WARNING nova.compute.manager [req-fe7f1e06-bdd8-42df-a237-5baa52f0a01a req-8482a779-860d-43e1-ae20-b2309a40c386 service nova] [instance: 4a981a97-8a93-4d0a-bf6b-9ec711cc621d] Received unexpected event network-vif-plugged-78739500-0226-4429-bf53-c512d2c01d89 for instance with vm_state building and task_state spawning.
Nov 17 02:00:16 user nova-compute[75226]: DEBUG nova.compute.manager [None req-00667f0d-5a80-4b1a-9b5c-0b2d250046a9 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] [instance: 4a981a97-8a93-4d0a-bf6b-9ec711cc621d] Instance event wait completed in 0 seconds for  {{(pid=75226) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 17 02:00:16 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-00667f0d-5a80-4b1a-9b5c-0b2d250046a9 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] [instance: 4a981a97-8a93-4d0a-bf6b-9ec711cc621d] Guest created on hypervisor {{(pid=75226) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 17 02:00:16 user nova-compute[75226]: INFO nova.virt.libvirt.driver [-] [instance: 4a981a97-8a93-4d0a-bf6b-9ec711cc621d] Instance spawned successfully.
Nov 17 02:00:16 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-00667f0d-5a80-4b1a-9b5c-0b2d250046a9 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] [instance: 4a981a97-8a93-4d0a-bf6b-9ec711cc621d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 17 02:00:16 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-00667f0d-5a80-4b1a-9b5c-0b2d250046a9 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] [instance: 4a981a97-8a93-4d0a-bf6b-9ec711cc621d] Found default for hw_cdrom_bus of ide {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 02:00:16 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-00667f0d-5a80-4b1a-9b5c-0b2d250046a9 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] [instance: 4a981a97-8a93-4d0a-bf6b-9ec711cc621d] Found default for hw_disk_bus of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 02:00:16 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-00667f0d-5a80-4b1a-9b5c-0b2d250046a9 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] [instance: 4a981a97-8a93-4d0a-bf6b-9ec711cc621d] Found default for hw_input_bus of None {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 02:00:16 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-00667f0d-5a80-4b1a-9b5c-0b2d250046a9 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] [instance: 4a981a97-8a93-4d0a-bf6b-9ec711cc621d] Found default for hw_pointer_model of None {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 02:00:16 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-00667f0d-5a80-4b1a-9b5c-0b2d250046a9 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] [instance: 4a981a97-8a93-4d0a-bf6b-9ec711cc621d] Found default for hw_video_model of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 02:00:16 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-00667f0d-5a80-4b1a-9b5c-0b2d250046a9 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] [instance: 4a981a97-8a93-4d0a-bf6b-9ec711cc621d] Found default for hw_vif_model of virtio {{(pid=75226) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 17 02:00:16 user nova-compute[75226]: INFO nova.compute.manager [None req-00667f0d-5a80-4b1a-9b5c-0b2d250046a9 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] [instance: 4a981a97-8a93-4d0a-bf6b-9ec711cc621d] Took 6.16 seconds to spawn the instance on the hypervisor.
Nov 17 02:00:16 user nova-compute[75226]: DEBUG nova.compute.manager [None req-00667f0d-5a80-4b1a-9b5c-0b2d250046a9 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] [instance: 4a981a97-8a93-4d0a-bf6b-9ec711cc621d] Checking state {{(pid=75226) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 17 02:00:16 user nova-compute[75226]: INFO nova.compute.manager [None req-00667f0d-5a80-4b1a-9b5c-0b2d250046a9 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] [instance: 4a981a97-8a93-4d0a-bf6b-9ec711cc621d] Took 6.83 seconds to build instance.
Nov 17 02:00:17 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-00667f0d-5a80-4b1a-9b5c-0b2d250046a9 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Lock "4a981a97-8a93-4d0a-bf6b-9ec711cc621d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.012s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 02:00:17 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:00:18 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:00:20 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:00:22 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:00:25 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 02:00:26 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 02:00:26 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 02:00:26 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 02:00:26 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75226) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 17 02:00:26 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a981a97-8a93-4d0a-bf6b-9ec711cc621d/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:00:26 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a981a97-8a93-4d0a-bf6b-9ec711cc621d/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:00:26 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a981a97-8a93-4d0a-bf6b-9ec711cc621d/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:00:26 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a981a97-8a93-4d0a-bf6b-9ec711cc621d/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:00:27 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 02:00:27 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 02:00:27 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Hypervisor/Node resource view: name=user free_ram=8809MB free_disk=24.943737030029297GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75226) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 17 02:00:27 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 02:00:27 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 02:00:27 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 4a981a97-8a93-4d0a-bf6b-9ec711cc621d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 02:00:27 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75226) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 17 02:00:27 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75226) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 17 02:00:27 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 02:00:27 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 02:00:27 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Compute_service record updated for user:user {{(pid=75226) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 17 02:00:27 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.243s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 02:00:27 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 02:00:28 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:00:33 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:00:33 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 02:00:33 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:00:33 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 02:00:35 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 02:00:38 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:00:38 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:00:38 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 02:00:38 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Starting heal instance info cache {{(pid=75226) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 17 02:00:38 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Rebuilding the list of instances to heal {{(pid=75226) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 17 02:00:39 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "refresh_cache-4a981a97-8a93-4d0a-bf6b-9ec711cc621d" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 02:00:39 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquired lock "refresh_cache-4a981a97-8a93-4d0a-bf6b-9ec711cc621d" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 02:00:39 user nova-compute[75226]: DEBUG nova.network.neutron [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] [instance: 4a981a97-8a93-4d0a-bf6b-9ec711cc621d] Forcefully refreshing network info cache for instance {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 17 02:00:39 user nova-compute[75226]: DEBUG nova.objects.instance [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lazy-loading 'info_cache' on Instance uuid 4a981a97-8a93-4d0a-bf6b-9ec711cc621d {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 02:00:39 user nova-compute[75226]: DEBUG nova.network.neutron [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] [instance: 4a981a97-8a93-4d0a-bf6b-9ec711cc621d] Updating instance_info_cache with network_info: [{"id": "78739500-0226-4429-bf53-c512d2c01d89", "address": "fa:16:3e:f5:a8:40", "network": {"id": "e111d356-c2ca-4cdc-bd8c-1d6bca9a54fd", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-640637510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c84a4fc5baa459d9fb5a3ccb78d2a8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78739500-02", "ovs_interfaceid": "78739500-0226-4429-bf53-c512d2c01d89", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 02:00:39 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Releasing lock "refresh_cache-4a981a97-8a93-4d0a-bf6b-9ec711cc621d" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 02:00:39 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] [instance: 4a981a97-8a93-4d0a-bf6b-9ec711cc621d] Updated the network info_cache for instance {{(pid=75226) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 17 02:00:39 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 02:00:39 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 02:00:39 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 02:00:39 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 02:00:39 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75226) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 17 02:00:43 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:00:43 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:00:48 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:00:48 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:00:53 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:00:58 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:01:03 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:01:08 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 02:01:13 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 02:01:18 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:01:23 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:01:26 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 02:01:26 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 02:01:26 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 02:01:26 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 02:01:26 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75226) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 17 02:01:27 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a981a97-8a93-4d0a-bf6b-9ec711cc621d/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:01:27 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a981a97-8a93-4d0a-bf6b-9ec711cc621d/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:01:27 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a981a97-8a93-4d0a-bf6b-9ec711cc621d/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:01:27 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a981a97-8a93-4d0a-bf6b-9ec711cc621d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:01:27 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 02:01:27 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 02:01:27 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Hypervisor/Node resource view: name=user free_ram=9035MB free_disk=24.906532287597656GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75226) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 17 02:01:27 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 02:01:27 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 02:01:27 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 4a981a97-8a93-4d0a-bf6b-9ec711cc621d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 02:01:27 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75226) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 17 02:01:27 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75226) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 17 02:01:27 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 02:01:28 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 02:01:28 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Compute_service record updated for user:user {{(pid=75226) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 17 02:01:28 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.194s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 02:01:28 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 02:01:33 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 02:01:34 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 02:01:34 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 02:01:37 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 02:01:38 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 02:01:39 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 02:01:39 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 02:01:39 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Starting heal instance info cache {{(pid=75226) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 17 02:01:39 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Rebuilding the list of instances to heal {{(pid=75226) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 17 02:01:40 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "refresh_cache-4a981a97-8a93-4d0a-bf6b-9ec711cc621d" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 02:01:40 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquired lock "refresh_cache-4a981a97-8a93-4d0a-bf6b-9ec711cc621d" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 02:01:40 user nova-compute[75226]: DEBUG nova.network.neutron [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] [instance: 4a981a97-8a93-4d0a-bf6b-9ec711cc621d] Forcefully refreshing network info cache for instance {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 17 02:01:40 user nova-compute[75226]: DEBUG nova.objects.instance [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lazy-loading 'info_cache' on Instance uuid 4a981a97-8a93-4d0a-bf6b-9ec711cc621d {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 02:01:40 user nova-compute[75226]: DEBUG nova.network.neutron [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] [instance: 4a981a97-8a93-4d0a-bf6b-9ec711cc621d] Updating instance_info_cache with network_info: [{"id": "78739500-0226-4429-bf53-c512d2c01d89", "address": "fa:16:3e:f5:a8:40", "network": {"id": "e111d356-c2ca-4cdc-bd8c-1d6bca9a54fd", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-640637510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c84a4fc5baa459d9fb5a3ccb78d2a8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78739500-02", "ovs_interfaceid": "78739500-0226-4429-bf53-c512d2c01d89", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 02:01:40 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Releasing lock "refresh_cache-4a981a97-8a93-4d0a-bf6b-9ec711cc621d" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 02:01:40 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] [instance: 4a981a97-8a93-4d0a-bf6b-9ec711cc621d] Updated the network info_cache for instance {{(pid=75226) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 17 02:01:40 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 02:01:40 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 02:01:40 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75226) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 17 02:01:40 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 02:01:43 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:01:48 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:01:53 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 02:01:58 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:02:00 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 02:02:01 user nova-compute[75226]: DEBUG nova.compute.manager [req-e7f4af70-7c47-46dd-a3c8-0f0010cf42e5 req-0e951eb2-1fca-4f28-a884-2885a6a86470 service nova] [instance: 4a981a97-8a93-4d0a-bf6b-9ec711cc621d] Received event network-changed-78739500-0226-4429-bf53-c512d2c01d89 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 02:02:01 user nova-compute[75226]: DEBUG nova.compute.manager [req-e7f4af70-7c47-46dd-a3c8-0f0010cf42e5 req-0e951eb2-1fca-4f28-a884-2885a6a86470 service nova] [instance: 4a981a97-8a93-4d0a-bf6b-9ec711cc621d] Refreshing instance network info cache due to event network-changed-78739500-0226-4429-bf53-c512d2c01d89. {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 17 02:02:01 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-e7f4af70-7c47-46dd-a3c8-0f0010cf42e5 req-0e951eb2-1fca-4f28-a884-2885a6a86470 service nova] Acquiring lock "refresh_cache-4a981a97-8a93-4d0a-bf6b-9ec711cc621d" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 02:02:01 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-e7f4af70-7c47-46dd-a3c8-0f0010cf42e5 req-0e951eb2-1fca-4f28-a884-2885a6a86470 service nova] Acquired lock "refresh_cache-4a981a97-8a93-4d0a-bf6b-9ec711cc621d" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 02:02:01 user nova-compute[75226]: DEBUG nova.network.neutron [req-e7f4af70-7c47-46dd-a3c8-0f0010cf42e5 req-0e951eb2-1fca-4f28-a884-2885a6a86470 service nova] [instance: 4a981a97-8a93-4d0a-bf6b-9ec711cc621d] Refreshing network info cache for port 78739500-0226-4429-bf53-c512d2c01d89 {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 17 02:02:01 user nova-compute[75226]: DEBUG nova.network.neutron [req-e7f4af70-7c47-46dd-a3c8-0f0010cf42e5 req-0e951eb2-1fca-4f28-a884-2885a6a86470 service nova] [instance: 4a981a97-8a93-4d0a-bf6b-9ec711cc621d] Updated VIF entry in instance network info cache for port 78739500-0226-4429-bf53-c512d2c01d89. {{(pid=75226) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 17 02:02:01 user nova-compute[75226]: DEBUG nova.network.neutron [req-e7f4af70-7c47-46dd-a3c8-0f0010cf42e5 req-0e951eb2-1fca-4f28-a884-2885a6a86470 service nova] [instance: 4a981a97-8a93-4d0a-bf6b-9ec711cc621d] Updating instance_info_cache with network_info: [{"id": "78739500-0226-4429-bf53-c512d2c01d89", "address": "fa:16:3e:f5:a8:40", "network": {"id": "e111d356-c2ca-4cdc-bd8c-1d6bca9a54fd", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-640637510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c84a4fc5baa459d9fb5a3ccb78d2a8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78739500-02", "ovs_interfaceid": "78739500-0226-4429-bf53-c512d2c01d89", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 02:02:01 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-e7f4af70-7c47-46dd-a3c8-0f0010cf42e5 req-0e951eb2-1fca-4f28-a884-2885a6a86470 service nova] Releasing lock "refresh_cache-4a981a97-8a93-4d0a-bf6b-9ec711cc621d" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 02:02:03 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:02:03 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:02:04 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e9b417b6-b5f3-4370-925e-487f60aac50f tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Acquiring lock "4a981a97-8a93-4d0a-bf6b-9ec711cc621d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 02:02:04 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e9b417b6-b5f3-4370-925e-487f60aac50f tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Lock "4a981a97-8a93-4d0a-bf6b-9ec711cc621d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 02:02:04 user nova-compute[75226]: DEBUG nova.objects.instance [None req-e9b417b6-b5f3-4370-925e-487f60aac50f tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Lazy-loading 'flavor' on Instance uuid 4a981a97-8a93-4d0a-bf6b-9ec711cc621d {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 02:02:04 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e9b417b6-b5f3-4370-925e-487f60aac50f tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Lock "4a981a97-8a93-4d0a-bf6b-9ec711cc621d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.070s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 02:02:04 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e9b417b6-b5f3-4370-925e-487f60aac50f tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Acquiring lock "4a981a97-8a93-4d0a-bf6b-9ec711cc621d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 02:02:04 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e9b417b6-b5f3-4370-925e-487f60aac50f tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Lock "4a981a97-8a93-4d0a-bf6b-9ec711cc621d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 02:02:04 user nova-compute[75226]: INFO nova.compute.manager [None req-e9b417b6-b5f3-4370-925e-487f60aac50f tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] [instance: 4a981a97-8a93-4d0a-bf6b-9ec711cc621d] Attaching volume 927cbfc1-4de8-4cc0-aa27-c80f6f07057c to /dev/vdb
Nov 17 02:02:04 user nova-compute[75226]: DEBUG os_brick.utils [None req-e9b417b6-b5f3-4370-925e-487f60aac50f tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 02:02:04 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:02:04 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:02:04 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[73353472-37f8-4644-86e3-a0c83d5afe25]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f62857db69\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 02:02:04 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:02:04 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:02:04 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[a772a068-b484-483e-88f8-db0afa56b15d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 02:02:04 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:02:04 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:02:04 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[36c0271b-7506-49dd-98f6-cd32fcc1261a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 02:02:04 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fbb96b6-d96b-4ae6-a4ba-9dfe2488f165]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 02:02:04 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e9b417b6-b5f3-4370-925e-487f60aac50f tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Running cmd (subprocess): nvme version {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:02:04 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e9b417b6-b5f3-4370-925e-487f60aac50f tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] 'nvme version' failed. Not Retrying. {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 02:02:04 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e9b417b6-b5f3-4370-925e-487f60aac50f tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] nvme not present on system {{(pid=75226) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 17 02:02:04 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:02:04 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 02:02:04 user nova-compute[75226]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 17 02:02:04 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0171545-c6a7-4b99-819a-df4f01847207]: (4, '') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 02:02:04 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-e9b417b6-b5f3-4370-925e-487f60aac50f tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75226) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 17 02:02:04 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-e9b417b6-b5f3-4370-925e-487f60aac50f tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75226) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 17 02:02:04 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-e9b417b6-b5f3-4370-925e-487f60aac50f tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] LIGHTOS: no hostnqn found. {{(pid=75226) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 17 02:02:04 user nova-compute[75226]: DEBUG os_brick.utils [None req-e9b417b6-b5f3-4370-925e-487f60aac50f tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f62857db69', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 02:02:04 user nova-compute[75226]: DEBUG nova.virt.block_device [None req-e9b417b6-b5f3-4370-925e-487f60aac50f tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] [instance: 4a981a97-8a93-4d0a-bf6b-9ec711cc621d] Updating existing volume attachment record: 77bc2695-d30a-4b88-b3b0-da6099e846d1 {{(pid=75226) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 17 02:02:08 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:02:08 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:02:09 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9b417b6-b5f3-4370-925e-487f60aac50f tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] [instance: 4a981a97-8a93-4d0a-bf6b-9ec711cc621d] Calling os-brick to attach iSCSI Volume {{(pid=75226) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 17 02:02:09 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9b417b6-b5f3-4370-925e-487f60aac50f tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc4cc36b490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:927cbfc1-4de8-4cc0-aa27-c80f6f07057c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xLdSAzDh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 02:02:09 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-e9b417b6-b5f3-4370-925e-487f60aac50f tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 02:02:09 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-e9b417b6-b5f3-4370-925e-487f60aac50f tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 02:02:09 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-e9b417b6-b5f3-4370-925e-487f60aac50f tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 02:02:09 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-e9b417b6-b5f3-4370-925e-487f60aac50f tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 02:02:09 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-e9b417b6-b5f3-4370-925e-487f60aac50f tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:927cbfc1-4de8-4cc0-aa27-c80f6f07057c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 02:02:09 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-e9b417b6-b5f3-4370-925e-487f60aac50f tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:927cbfc1-4de8-4cc0-aa27-c80f6f07057c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 02:02:09 user nova-compute[75226]: INFO os_brick.initiator.connectors.iscsi [None req-e9b417b6-b5f3-4370-925e-487f60aac50f tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 17 02:02:09 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:927cbfc1-4de8-4cc0-aa27-c80f6f07057c -p 172.16.0.220:3260 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:02:09 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:927cbfc1-4de8-4cc0-aa27-c80f6f07057c -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:02:09 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[20dc5a4c-1644-436b-8f4f-0c6adaa7edb0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 02:02:09 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9b417b6-b5f3-4370-925e-487f60aac50f tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 17 02:02:09 user nova-compute[75226]:  {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 02:02:09 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:927cbfc1-4de8-4cc0-aa27-c80f6f07057c -p 172.16.0.220:3260 --interface default --op new {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:02:09 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:927cbfc1-4de8-4cc0-aa27-c80f6f07057c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:02:09 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1e1fa14-51f4-43a9-8739-250cd3a20693]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:927cbfc1-4de8-4cc0-aa27-c80f6f07057c] added\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 02:02:09 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9b417b6-b5f3-4370-925e-487f60aac50f tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:927cbfc1-4de8-4cc0-aa27-c80f6f07057c] added
Nov 17 02:02:09 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 02:02:09 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:927cbfc1-4de8-4cc0-aa27-c80f6f07057c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:02:09 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:927cbfc1-4de8-4cc0-aa27-c80f6f07057c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:02:09 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4a0a59c-b457-48e9-9645-fd150eeb66bf]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 02:02:09 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9b417b6-b5f3-4370-925e-487f60aac50f tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 02:02:09 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:927cbfc1-4de8-4cc0-aa27-c80f6f07057c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:02:09 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:927cbfc1-4de8-4cc0-aa27-c80f6f07057c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:02:09 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[f221b267-d691-401b-b43d-3f2314059706]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 02:02:09 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9b417b6-b5f3-4370-925e-487f60aac50f tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 02:02:09 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:927cbfc1-4de8-4cc0-aa27-c80f6f07057c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xLdSAzDh {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:02:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:927cbfc1-4de8-4cc0-aa27-c80f6f07057c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xLdSAzDh" returned: 0 in 0.025s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:02:10 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[04b22812-4c28-429c-89c3-cc4dfad2f4db]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 02:02:10 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9b417b6-b5f3-4370-925e-487f60aac50f tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xLdSAzDh'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 02:02:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:927cbfc1-4de8-4cc0-aa27-c80f6f07057c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:02:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:927cbfc1-4de8-4cc0-aa27-c80f6f07057c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:02:10 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[38c9e115-d610-40af-a4a8-e4ba7e85edf0]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 02:02:10 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9b417b6-b5f3-4370-925e-487f60aac50f tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 02:02:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:02:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:02:10 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[480944f3-d257-4b94-88a1-edc2f4a57a22]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 02:02:10 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9b417b6-b5f3-4370-925e-487f60aac50f tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 17 02:02:10 user nova-compute[75226]:  {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 02:02:10 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9b417b6-b5f3-4370-925e-487f60aac50f tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 17 02:02:10 user nova-compute[75226]:  {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 02:02:10 user nova-compute[75226]: WARNING os_brick.initiator.connectors.iscsi [None req-e9b417b6-b5f3-4370-925e-487f60aac50f tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 17 02:02:10 user nova-compute[75226]: 
Nov 17 02:02:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:927cbfc1-4de8-4cc0-aa27-c80f6f07057c -p 172.16.0.220:3260 --login {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:02:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:927cbfc1-4de8-4cc0-aa27-c80f6f07057c -p 172.16.0.220:3260 --login" returned: 0 in 0.042s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:02:10 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[57d50239-5f74-4bf3-8fdf-8167759260ae]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:927cbfc1-4de8-4cc0-aa27-c80f6f07057c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:927cbfc1-4de8-4cc0-aa27-c80f6f07057c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 02:02:10 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9b417b6-b5f3-4370-925e-487f60aac50f tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:927cbfc1-4de8-4cc0-aa27-c80f6f07057c, portal: 172.16.0.220,3260]
Nov 17 02:02:10 user nova-compute[75226]: Login to [iface: default, target: iqn.2010-10.org.openstack:927cbfc1-4de8-4cc0-aa27-c80f6f07057c, portal: 172.16.0.220,3260] successful.
Nov 17 02:02:10 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 02:02:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:927cbfc1-4de8-4cc0-aa27-c80f6f07057c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:02:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:927cbfc1-4de8-4cc0-aa27-c80f6f07057c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:02:10 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[530113b3-4907-4ce6-9ad7-d8b4db418fa8]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 02:02:10 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9b417b6-b5f3-4370-925e-487f60aac50f tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 02:02:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:02:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:02:10 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1708061-a78c-47a2-8d1e-92474d044b45]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:927cbfc1-4de8-4cc0-aa27-c80f6f07057c (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 02:02:10 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9b417b6-b5f3-4370-925e-487f60aac50f tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:927cbfc1-4de8-4cc0-aa27-c80f6f07057c (non-flash)
Nov 17 02:02:10 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 02:02:10 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9b417b6-b5f3-4370-925e-487f60aac50f tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:927cbfc1-4de8-4cc0-aa27-c80f6f07057c (non-flash)
Nov 17 02:02:10 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 02:02:10 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-e9b417b6-b5f3-4370-925e-487f60aac50f tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:927cbfc1-4de8-4cc0-aa27-c80f6f07057c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.257s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 02:02:10 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9b417b6-b5f3-4370-925e-487f60aac50f tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Connected to 172.16.0.220:3260 {{(pid=75226) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 17 02:02:10 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-e9b417b6-b5f3-4370-925e-487f60aac50f tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] HCTL ('33', '-', '-', 0) found on session 67 with lun 0 {{(pid=75226) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 17 02:02:10 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-e9b417b6-b5f3-4370-925e-487f60aac50f tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75226) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 17 02:02:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:02:10 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:02:10 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b5d247c-e2a9-4147-a00d-5dc9be1ac4c7]: (4, ('- - 0', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 02:02:10 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-e9b417b6-b5f3-4370-925e-487f60aac50f tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Searching for a device in session 67 and hctl ['33', '*', '*', 0] yield: None {{(pid=75226) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 02:02:11 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-e9b417b6-b5f3-4370-925e-487f60aac50f tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Searching for a device in session 67 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75226) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 02:02:11 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9b417b6-b5f3-4370-925e-487f60aac50f tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:927cbfc1-4de8-4cc0-aa27-c80f6f07057c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xLdSAzDh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75226) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 17 02:02:11 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-e9b417b6-b5f3-4370-925e-487f60aac50f tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.287s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 02:02:11 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9b417b6-b5f3-4370-925e-487f60aac50f tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] <== connect_volume: return (1289ms) {'type': 'block', 'scsi_wwn': '23632386630653161', 'path': '/dev/sdb'} {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 02:02:11 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9b417b6-b5f3-4370-925e-487f60aac50f tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] [instance: 4a981a97-8a93-4d0a-bf6b-9ec711cc621d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23632386630653161', 'path': '/dev/sdb'} {{(pid=75226) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 17 02:02:11 user nova-compute[75226]: DEBUG nova.objects.instance [None req-e9b417b6-b5f3-4370-925e-487f60aac50f tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Lazy-loading 'flavor' on Instance uuid 4a981a97-8a93-4d0a-bf6b-9ec711cc621d {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 02:02:11 user nova-compute[75226]: DEBUG nova.virt.libvirt.guest [None req-e9b417b6-b5f3-4370-925e-487f60aac50f tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] attach device xml: <disk type="block" device="disk">
Nov 17 02:02:11 user nova-compute[75226]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 02:02:11 user nova-compute[75226]:   <source dev="/dev/sdb"/>
Nov 17 02:02:11 user nova-compute[75226]:   <target dev="vdb" bus="virtio"/>
Nov 17 02:02:11 user nova-compute[75226]:   <serial>927cbfc1-4de8-4cc0-aa27-c80f6f07057c</serial>
Nov 17 02:02:11 user nova-compute[75226]: </disk>
Nov 17 02:02:11 user nova-compute[75226]:  {{(pid=75226) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 17 02:02:11 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-e9b417b6-b5f3-4370-925e-487f60aac50f tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] No BDM found with device name vda, not building metadata. {{(pid=75226) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 02:02:11 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-e9b417b6-b5f3-4370-925e-487f60aac50f tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75226) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 02:02:11 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-e9b417b6-b5f3-4370-925e-487f60aac50f tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] No VIF found with MAC fa:16:3e:f5:a8:40, not building metadata {{(pid=75226) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 02:02:11 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e9b417b6-b5f3-4370-925e-487f60aac50f tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Lock "4a981a97-8a93-4d0a-bf6b-9ec711cc621d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.074s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 02:02:13 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:02:13 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:02:18 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:02:18 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:02:22 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-aa606484-2df6-45c9-9908-342257214cb7 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Acquiring lock "4a981a97-8a93-4d0a-bf6b-9ec711cc621d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 02:02:22 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-aa606484-2df6-45c9-9908-342257214cb7 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Lock "4a981a97-8a93-4d0a-bf6b-9ec711cc621d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 02:02:22 user nova-compute[75226]: INFO nova.compute.manager [None req-aa606484-2df6-45c9-9908-342257214cb7 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] [instance: 4a981a97-8a93-4d0a-bf6b-9ec711cc621d] Detaching volume 927cbfc1-4de8-4cc0-aa27-c80f6f07057c
Nov 17 02:02:22 user nova-compute[75226]: INFO nova.virt.block_device [None req-aa606484-2df6-45c9-9908-342257214cb7 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] [instance: 4a981a97-8a93-4d0a-bf6b-9ec711cc621d] Attempting to driver detach volume 927cbfc1-4de8-4cc0-aa27-c80f6f07057c from mountpoint /dev/vdb
Nov 17 02:02:22 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-aa606484-2df6-45c9-9908-342257214cb7 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Attempting to detach device vdb from instance 4a981a97-8a93-4d0a-bf6b-9ec711cc621d from the persistent domain config. {{(pid=75226) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 17 02:02:22 user nova-compute[75226]: DEBUG nova.virt.libvirt.guest [None req-aa606484-2df6-45c9-9908-342257214cb7 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] detach device xml: <disk type="block" device="disk">
Nov 17 02:02:22 user nova-compute[75226]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 02:02:22 user nova-compute[75226]:   <source dev="/dev/sdb"/>
Nov 17 02:02:22 user nova-compute[75226]:   <target dev="vdb" bus="virtio"/>
Nov 17 02:02:22 user nova-compute[75226]:   <serial>927cbfc1-4de8-4cc0-aa27-c80f6f07057c</serial>
Nov 17 02:02:22 user nova-compute[75226]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 17 02:02:22 user nova-compute[75226]: </disk>
Nov 17 02:02:22 user nova-compute[75226]:  {{(pid=75226) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 17 02:02:22 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-aa606484-2df6-45c9-9908-342257214cb7 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Successfully detached device vdb from instance 4a981a97-8a93-4d0a-bf6b-9ec711cc621d from the persistent domain config.
Nov 17 02:02:22 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-aa606484-2df6-45c9-9908-342257214cb7 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4a981a97-8a93-4d0a-bf6b-9ec711cc621d from the live domain config. {{(pid=75226) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 17 02:02:22 user nova-compute[75226]: DEBUG nova.virt.libvirt.guest [None req-aa606484-2df6-45c9-9908-342257214cb7 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] detach device xml: <disk type="block" device="disk">
Nov 17 02:02:22 user nova-compute[75226]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 02:02:22 user nova-compute[75226]:   <source dev="/dev/sdb"/>
Nov 17 02:02:22 user nova-compute[75226]:   <target dev="vdb" bus="virtio"/>
Nov 17 02:02:22 user nova-compute[75226]:   <serial>927cbfc1-4de8-4cc0-aa27-c80f6f07057c</serial>
Nov 17 02:02:22 user nova-compute[75226]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 17 02:02:22 user nova-compute[75226]: </disk>
Nov 17 02:02:22 user nova-compute[75226]:  {{(pid=75226) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 17 02:02:22 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-aa606484-2df6-45c9-9908-342257214cb7 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4a981a97-8a93-4d0a-bf6b-9ec711cc621d {{(pid=75226) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 17 02:02:23 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:02:23 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:02:28 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:02:28 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 02:02:28 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 02:02:28 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 02:02:28 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 02:02:28 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75226) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 17 02:02:29 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a981a97-8a93-4d0a-bf6b-9ec711cc621d/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:02:29 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a981a97-8a93-4d0a-bf6b-9ec711cc621d/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:02:29 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a981a97-8a93-4d0a-bf6b-9ec711cc621d/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:02:29 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a981a97-8a93-4d0a-bf6b-9ec711cc621d/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:02:29 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 02:02:29 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 02:02:29 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Hypervisor/Node resource view: name=user free_ram=9039MB free_disk=24.905284881591797GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75226) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 17 02:02:29 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 02:02:29 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 02:02:29 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 4a981a97-8a93-4d0a-bf6b-9ec711cc621d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 02:02:29 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75226) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 17 02:02:29 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75226) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 17 02:02:29 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 02:02:29 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 02:02:29 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Compute_service record updated for user:user {{(pid=75226) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 17 02:02:29 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.173s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 02:02:33 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:02:33 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:02:35 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 02:02:35 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 02:02:38 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:02:38 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 02:02:39 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 02:02:39 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75226) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 17 02:02:40 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 02:02:40 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 02:02:40 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Starting heal instance info cache {{(pid=75226) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 17 02:02:40 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Rebuilding the list of instances to heal {{(pid=75226) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 17 02:02:41 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "refresh_cache-4a981a97-8a93-4d0a-bf6b-9ec711cc621d" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 02:02:41 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquired lock "refresh_cache-4a981a97-8a93-4d0a-bf6b-9ec711cc621d" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 02:02:41 user nova-compute[75226]: DEBUG nova.network.neutron [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] [instance: 4a981a97-8a93-4d0a-bf6b-9ec711cc621d] Forcefully refreshing network info cache for instance {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 17 02:02:41 user nova-compute[75226]: DEBUG nova.objects.instance [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lazy-loading 'info_cache' on Instance uuid 4a981a97-8a93-4d0a-bf6b-9ec711cc621d {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 02:02:41 user nova-compute[75226]: DEBUG nova.network.neutron [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] [instance: 4a981a97-8a93-4d0a-bf6b-9ec711cc621d] Updating instance_info_cache with network_info: [{"id": "78739500-0226-4429-bf53-c512d2c01d89", "address": "fa:16:3e:f5:a8:40", "network": {"id": "e111d356-c2ca-4cdc-bd8c-1d6bca9a54fd", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-640637510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c84a4fc5baa459d9fb5a3ccb78d2a8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78739500-02", "ovs_interfaceid": "78739500-0226-4429-bf53-c512d2c01d89", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 02:02:41 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Releasing lock "refresh_cache-4a981a97-8a93-4d0a-bf6b-9ec711cc621d" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 02:02:41 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] [instance: 4a981a97-8a93-4d0a-bf6b-9ec711cc621d] Updated the network info_cache for instance {{(pid=75226) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 17 02:02:41 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 02:02:41 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 02:02:42 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-aa606484-2df6-45c9-9908-342257214cb7 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 4a981a97-8a93-4d0a-bf6b-9ec711cc621d is timed out.
Nov 17 02:02:42 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-aa606484-2df6-45c9-9908-342257214cb7 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Successfully detached device vdb from instance 4a981a97-8a93-4d0a-bf6b-9ec711cc621d from the live domain config.
Nov 17 02:02:42 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa606484-2df6-45c9-9908-342257214cb7 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] [instance: 4a981a97-8a93-4d0a-bf6b-9ec711cc621d] calling os-brick to detach iSCSI Volume {{(pid=75226) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 17 02:02:42 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa606484-2df6-45c9-9908-342257214cb7 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc4cc36b490>, {'target_iqn': 'iqn.2010-10.org.openstack:927cbfc1-4de8-4cc0-aa27-c80f6f07057c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xLdSAzDh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 02:02:42 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-aa606484-2df6-45c9-9908-342257214cb7 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 02:02:42 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-aa606484-2df6-45c9-9908-342257214cb7 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 02:02:42 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-aa606484-2df6-45c9-9908-342257214cb7 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 02:02:42 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:02:42 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:02:42 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[958a6481-83dd-4c62-9791-12cd6d152613]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:927cbfc1-4de8-4cc0-aa27-c80f6f07057c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 02:02:42 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa606484-2df6-45c9-9908-342257214cb7 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 17 02:02:42 user nova-compute[75226]: No targets found.
Nov 17 02:02:42 user nova-compute[75226]: iSNS:
Nov 17 02:02:42 user nova-compute[75226]: No targets found.
Nov 17 02:02:42 user nova-compute[75226]: STATIC:
Nov 17 02:02:42 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:927cbfc1-4de8-4cc0-aa27-c80f6f07057c
Nov 17 02:02:42 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 02:02:42 user nova-compute[75226]:                 Iface Name: default
Nov 17 02:02:42 user nova-compute[75226]: FIRMWARE:
Nov 17 02:02:42 user nova-compute[75226]: No targets found.
Nov 17 02:02:42 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 02:02:42 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa606484-2df6-45c9-9908-342257214cb7 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 17 02:02:42 user nova-compute[75226]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 17 02:02:42 user nova-compute[75226]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75226) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 17 02:02:42 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa606484-2df6-45c9-9908-342257214cb7 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:927cbfc1-4de8-4cc0-aa27-c80f6f07057c', 0)] {{(pid=75226) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 17 02:02:42 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:02:42 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:02:42 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dd96ae5-2238-4313-bcf8-289278212132]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:927cbfc1-4de8-4cc0-aa27-c80f6f07057c\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 02:02:42 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:02:42 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:02:42 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0a62ce7-f089-43cc-8113-29862de73f79]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:927cbfc1-4de8-4cc0-aa27-c80f6f07057c (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 02:02:42 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa606484-2df6-45c9-9908-342257214cb7 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:927cbfc1-4de8-4cc0-aa27-c80f6f07057c (non-flash)
Nov 17 02:02:42 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 02:02:42 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa606484-2df6-45c9-9908-342257214cb7 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:927cbfc1-4de8-4cc0-aa27-c80f6f07057c (non-flash)
Nov 17 02:02:42 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 02:02:42 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa606484-2df6-45c9-9908-342257214cb7 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc4b4459f30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:927cbfc1-4de8-4cc0-aa27-c80f6f07057c'): ({'sdb'}, set())}) {{(pid=75226) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 17 02:02:42 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-aa606484-2df6-45c9-9908-342257214cb7 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Removing single pathed devices sdb {{(pid=75226) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 17 02:02:42 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:02:42 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:02:42 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bf9f9f0-f2c3-473a-b99a-0273c941675c]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 02:02:42 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:02:42 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:02:42 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4b07bbf-001d-460c-ad77-ed5bbd2e2674]: (4, ('ok\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 02:02:42 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-aa606484-2df6-45c9-9908-342257214cb7 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Flushing IO for device /dev/sdb {{(pid=75226) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 17 02:02:42 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:02:42 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:02:42 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cb21cc9-d5b5-4b73-81b1-46b564142836]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 02:02:42 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-aa606484-2df6-45c9-9908-342257214cb7 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75226) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 17 02:02:42 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:02:42 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:02:42 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[95ff2917-0f39-40dc-ae0e-768731ec5a66]: (4, ('1', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 02:02:42 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-aa606484-2df6-45c9-9908-342257214cb7 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75226) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 17 02:02:42 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-aa606484-2df6-45c9-9908-342257214cb7 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] SCSI volumes sdb have been removed. {{(pid=75226) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 17 02:02:42 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa606484-2df6-45c9-9908-342257214cb7 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:927cbfc1-4de8-4cc0-aa27-c80f6f07057c')] {{(pid=75226) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 17 02:02:42 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:927cbfc1-4de8-4cc0-aa27-c80f6f07057c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:02:42 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:927cbfc1-4de8-4cc0-aa27-c80f6f07057c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:02:42 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b696746-ceb4-455b-bc0f-ddb48ba443f4]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 02:02:42 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa606484-2df6-45c9-9908-342257214cb7 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 02:02:42 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:927cbfc1-4de8-4cc0-aa27-c80f6f07057c -p 172.16.0.220:3260 --logout {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:02:43 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:927cbfc1-4de8-4cc0-aa27-c80f6f07057c -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:02:43 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[32f90bcc-dff5-4fea-90fc-1f0eec632339]: (4, ('Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:927cbfc1-4de8-4cc0-aa27-c80f6f07057c, portal: 172.16.0.220,3260]\nLogout of [sid: 67, target: iqn.2010-10.org.openstack:927cbfc1-4de8-4cc0-aa27-c80f6f07057c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 02:02:43 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa606484-2df6-45c9-9908-342257214cb7 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:927cbfc1-4de8-4cc0-aa27-c80f6f07057c, portal: 172.16.0.220,3260]
Nov 17 02:02:43 user nova-compute[75226]: Logout of [sid: 67, target: iqn.2010-10.org.openstack:927cbfc1-4de8-4cc0-aa27-c80f6f07057c, portal: 172.16.0.220,3260] successful.
Nov 17 02:02:43 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 02:02:43 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:927cbfc1-4de8-4cc0-aa27-c80f6f07057c -p 172.16.0.220:3260 --op delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:02:43 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:927cbfc1-4de8-4cc0-aa27-c80f6f07057c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:02:43 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb14ff4f-e0ad-458d-b1ff-2735fc47945b]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 02:02:43 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa606484-2df6-45c9-9908-342257214cb7 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 02:02:43 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-aa606484-2df6-45c9-9908-342257214cb7 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.278s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 02:02:43 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa606484-2df6-45c9-9908-342257214cb7 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] <== disconnect_volume: return (280ms) None {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 02:02:43 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa606484-2df6-45c9-9908-342257214cb7 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] [instance: 4a981a97-8a93-4d0a-bf6b-9ec711cc621d] Disconnected iSCSI Volume {{(pid=75226) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 17 02:02:43 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 02:02:43 user nova-compute[75226]: DEBUG nova.objects.instance [None req-aa606484-2df6-45c9-9908-342257214cb7 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Lazy-loading 'flavor' on Instance uuid 4a981a97-8a93-4d0a-bf6b-9ec711cc621d {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 02:02:43 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-aa606484-2df6-45c9-9908-342257214cb7 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Lock "4a981a97-8a93-4d0a-bf6b-9ec711cc621d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.723s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 02:02:48 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 02:02:48 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:02:48 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75226) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 17 02:02:48 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75226) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 02:02:48 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75226) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 02:02:48 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:02:53 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:02:58 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:03:03 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:03:08 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 02:03:13 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:03:13 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:03:14 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-4cf6d0e6-9e2f-4a70-a5c0-dce6e8d87620 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Acquiring lock "4a981a97-8a93-4d0a-bf6b-9ec711cc621d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 02:03:14 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-4cf6d0e6-9e2f-4a70-a5c0-dce6e8d87620 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Lock "4a981a97-8a93-4d0a-bf6b-9ec711cc621d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 02:03:14 user nova-compute[75226]: DEBUG nova.objects.instance [None req-4cf6d0e6-9e2f-4a70-a5c0-dce6e8d87620 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Lazy-loading 'flavor' on Instance uuid 4a981a97-8a93-4d0a-bf6b-9ec711cc621d {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 02:03:14 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-4cf6d0e6-9e2f-4a70-a5c0-dce6e8d87620 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Lock "4a981a97-8a93-4d0a-bf6b-9ec711cc621d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 02:03:14 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-4cf6d0e6-9e2f-4a70-a5c0-dce6e8d87620 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Acquiring lock "4a981a97-8a93-4d0a-bf6b-9ec711cc621d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 02:03:14 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-4cf6d0e6-9e2f-4a70-a5c0-dce6e8d87620 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Lock "4a981a97-8a93-4d0a-bf6b-9ec711cc621d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 02:03:14 user nova-compute[75226]: INFO nova.compute.manager [None req-4cf6d0e6-9e2f-4a70-a5c0-dce6e8d87620 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] [instance: 4a981a97-8a93-4d0a-bf6b-9ec711cc621d] Attaching volume 8c5b6f63-e67d-4a69-aa56-c2d3c746d861 to /dev/vdb
Nov 17 02:03:14 user nova-compute[75226]: DEBUG os_brick.utils [None req-4cf6d0e6-9e2f-4a70-a5c0-dce6e8d87620 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 02:03:14 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:03:14 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:03:14 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[76a2f332-dc27-441d-b46d-cdbf3b98afe7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f62857db69\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 02:03:14 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:03:14 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:03:14 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[574111b9-b814-4b1d-9e0c-69b109f2d036]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 02:03:14 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:03:14 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:03:14 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5758a03-5d0d-4f1e-aa5e-dc27b0dd5ed4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 02:03:14 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b3b7e7c-17a0-40a3-9aa3-ba7ea28e338c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 02:03:14 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-4cf6d0e6-9e2f-4a70-a5c0-dce6e8d87620 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Running cmd (subprocess): nvme version {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:03:14 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-4cf6d0e6-9e2f-4a70-a5c0-dce6e8d87620 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] 'nvme version' failed. Not Retrying. {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 02:03:14 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4cf6d0e6-9e2f-4a70-a5c0-dce6e8d87620 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] nvme not present on system {{(pid=75226) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 17 02:03:14 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:03:14 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 02:03:14 user nova-compute[75226]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 17 02:03:14 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[7979aec1-1844-444c-8bb4-bb922d5a1986]: (4, '') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 02:03:14 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-4cf6d0e6-9e2f-4a70-a5c0-dce6e8d87620 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75226) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 17 02:03:14 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-4cf6d0e6-9e2f-4a70-a5c0-dce6e8d87620 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75226) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 17 02:03:14 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-4cf6d0e6-9e2f-4a70-a5c0-dce6e8d87620 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] LIGHTOS: no hostnqn found. {{(pid=75226) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 17 02:03:14 user nova-compute[75226]: DEBUG os_brick.utils [None req-4cf6d0e6-9e2f-4a70-a5c0-dce6e8d87620 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f62857db69', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 02:03:14 user nova-compute[75226]: DEBUG nova.virt.block_device [None req-4cf6d0e6-9e2f-4a70-a5c0-dce6e8d87620 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] [instance: 4a981a97-8a93-4d0a-bf6b-9ec711cc621d] Updating existing volume attachment record: d3b39f78-6334-4a5b-a597-d0224f159200 {{(pid=75226) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 17 02:03:18 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:03:18 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:03:19 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4cf6d0e6-9e2f-4a70-a5c0-dce6e8d87620 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] [instance: 4a981a97-8a93-4d0a-bf6b-9ec711cc621d] Calling os-brick to attach iSCSI Volume {{(pid=75226) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 17 02:03:19 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cf6d0e6-9e2f-4a70-a5c0-dce6e8d87620 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc4cc36b490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8c5b6f63-e67d-4a69-aa56-c2d3c746d861', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xGMybeKU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 02:03:19 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-4cf6d0e6-9e2f-4a70-a5c0-dce6e8d87620 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 02:03:19 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-4cf6d0e6-9e2f-4a70-a5c0-dce6e8d87620 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 02:03:19 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-4cf6d0e6-9e2f-4a70-a5c0-dce6e8d87620 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 02:03:19 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-4cf6d0e6-9e2f-4a70-a5c0-dce6e8d87620 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 02:03:19 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-4cf6d0e6-9e2f-4a70-a5c0-dce6e8d87620 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8c5b6f63-e67d-4a69-aa56-c2d3c746d861" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 02:03:19 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-4cf6d0e6-9e2f-4a70-a5c0-dce6e8d87620 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8c5b6f63-e67d-4a69-aa56-c2d3c746d861" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 02:03:19 user nova-compute[75226]: INFO os_brick.initiator.connectors.iscsi [None req-4cf6d0e6-9e2f-4a70-a5c0-dce6e8d87620 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 17 02:03:19 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c5b6f63-e67d-4a69-aa56-c2d3c746d861 -p 172.16.0.220:3260 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:03:19 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c5b6f63-e67d-4a69-aa56-c2d3c746d861 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:03:19 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[31a93047-8511-4c5a-8934-3986c0baa570]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 02:03:19 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cf6d0e6-9e2f-4a70-a5c0-dce6e8d87620 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 17 02:03:19 user nova-compute[75226]:  {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 02:03:19 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c5b6f63-e67d-4a69-aa56-c2d3c746d861 -p 172.16.0.220:3260 --interface default --op new {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:03:19 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c5b6f63-e67d-4a69-aa56-c2d3c746d861 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:03:19 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb139099-f227-4027-b50f-73896a7c3ff2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8c5b6f63-e67d-4a69-aa56-c2d3c746d861] added\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 02:03:19 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cf6d0e6-9e2f-4a70-a5c0-dce6e8d87620 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8c5b6f63-e67d-4a69-aa56-c2d3c746d861] added
Nov 17 02:03:19 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 02:03:19 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c5b6f63-e67d-4a69-aa56-c2d3c746d861 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:03:19 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c5b6f63-e67d-4a69-aa56-c2d3c746d861 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:03:19 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[b32eb437-af6f-4be5-ae3c-dcd77986ee9a]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 02:03:19 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cf6d0e6-9e2f-4a70-a5c0-dce6e8d87620 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 02:03:19 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c5b6f63-e67d-4a69-aa56-c2d3c746d861 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:03:19 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c5b6f63-e67d-4a69-aa56-c2d3c746d861 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:03:19 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[56fc117c-03b1-4e96-9d1b-682b7ca25ef9]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 02:03:19 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cf6d0e6-9e2f-4a70-a5c0-dce6e8d87620 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 02:03:19 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c5b6f63-e67d-4a69-aa56-c2d3c746d861 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xGMybeKU {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:03:19 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c5b6f63-e67d-4a69-aa56-c2d3c746d861 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xGMybeKU" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:03:19 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[d81b9db6-5654-4c8b-ad0c-3ed981d2d06f]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 02:03:19 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cf6d0e6-9e2f-4a70-a5c0-dce6e8d87620 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xGMybeKU'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 02:03:19 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c5b6f63-e67d-4a69-aa56-c2d3c746d861 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:03:19 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c5b6f63-e67d-4a69-aa56-c2d3c746d861 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:03:19 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dd8d87e-302d-4507-acb4-43e22615cdb3]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 02:03:19 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cf6d0e6-9e2f-4a70-a5c0-dce6e8d87620 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 02:03:19 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:03:19 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:03:19 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[014b4d73-ab1c-439a-b8c7-a72b90d99444]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 02:03:19 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cf6d0e6-9e2f-4a70-a5c0-dce6e8d87620 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 17 02:03:19 user nova-compute[75226]:  {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 02:03:19 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cf6d0e6-9e2f-4a70-a5c0-dce6e8d87620 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 17 02:03:19 user nova-compute[75226]:  {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 02:03:19 user nova-compute[75226]: WARNING os_brick.initiator.connectors.iscsi [None req-4cf6d0e6-9e2f-4a70-a5c0-dce6e8d87620 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 17 02:03:19 user nova-compute[75226]: 
Nov 17 02:03:19 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c5b6f63-e67d-4a69-aa56-c2d3c746d861 -p 172.16.0.220:3260 --login {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:03:19 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c5b6f63-e67d-4a69-aa56-c2d3c746d861 -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:03:19 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[42dd690d-e07f-49fe-ae94-29e6c647f143]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8c5b6f63-e67d-4a69-aa56-c2d3c746d861, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8c5b6f63-e67d-4a69-aa56-c2d3c746d861, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 02:03:19 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cf6d0e6-9e2f-4a70-a5c0-dce6e8d87620 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8c5b6f63-e67d-4a69-aa56-c2d3c746d861, portal: 172.16.0.220,3260]
Nov 17 02:03:19 user nova-compute[75226]: Login to [iface: default, target: iqn.2010-10.org.openstack:8c5b6f63-e67d-4a69-aa56-c2d3c746d861, portal: 172.16.0.220,3260] successful.
Nov 17 02:03:19 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 02:03:19 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c5b6f63-e67d-4a69-aa56-c2d3c746d861 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:03:19 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c5b6f63-e67d-4a69-aa56-c2d3c746d861 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:03:19 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c34c956-9a2c-4753-a21d-c787b8b456a5]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 02:03:19 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cf6d0e6-9e2f-4a70-a5c0-dce6e8d87620 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 02:03:19 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:03:19 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:03:19 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e6430a2-dfbe-432f-a7b8-bcdaca79ee83]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c5b6f63-e67d-4a69-aa56-c2d3c746d861 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 02:03:19 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cf6d0e6-9e2f-4a70-a5c0-dce6e8d87620 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c5b6f63-e67d-4a69-aa56-c2d3c746d861 (non-flash)
Nov 17 02:03:19 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 02:03:19 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cf6d0e6-9e2f-4a70-a5c0-dce6e8d87620 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c5b6f63-e67d-4a69-aa56-c2d3c746d861 (non-flash)
Nov 17 02:03:19 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 02:03:19 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-4cf6d0e6-9e2f-4a70-a5c0-dce6e8d87620 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8c5b6f63-e67d-4a69-aa56-c2d3c746d861" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.227s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 02:03:19 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cf6d0e6-9e2f-4a70-a5c0-dce6e8d87620 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Connected to 172.16.0.220:3260 {{(pid=75226) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 17 02:03:19 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-4cf6d0e6-9e2f-4a70-a5c0-dce6e8d87620 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] HCTL ('33', '-', '-', 0) found on session 68 with lun 0 {{(pid=75226) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 17 02:03:19 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-4cf6d0e6-9e2f-4a70-a5c0-dce6e8d87620 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75226) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 17 02:03:19 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:03:19 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:03:19 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[c620d389-8cd3-432d-983e-6161a06bb19f]: (4, ('- - 0', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 02:03:19 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-4cf6d0e6-9e2f-4a70-a5c0-dce6e8d87620 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Searching for a device in session 68 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75226) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 02:03:19 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cf6d0e6-9e2f-4a70-a5c0-dce6e8d87620 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:8c5b6f63-e67d-4a69-aa56-c2d3c746d861', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xGMybeKU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75226) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 17 02:03:20 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-4cf6d0e6-9e2f-4a70-a5c0-dce6e8d87620 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.257s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 02:03:20 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cf6d0e6-9e2f-4a70-a5c0-dce6e8d87620 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] <== connect_volume: return (1259ms) {'type': 'block', 'scsi_wwn': '23066313136643263', 'path': '/dev/sdb'} {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 02:03:20 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4cf6d0e6-9e2f-4a70-a5c0-dce6e8d87620 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] [instance: 4a981a97-8a93-4d0a-bf6b-9ec711cc621d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23066313136643263', 'path': '/dev/sdb'} {{(pid=75226) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 17 02:03:20 user nova-compute[75226]: DEBUG nova.objects.instance [None req-4cf6d0e6-9e2f-4a70-a5c0-dce6e8d87620 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Lazy-loading 'flavor' on Instance uuid 4a981a97-8a93-4d0a-bf6b-9ec711cc621d {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 02:03:20 user nova-compute[75226]: DEBUG nova.virt.libvirt.guest [None req-4cf6d0e6-9e2f-4a70-a5c0-dce6e8d87620 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] attach device xml: <disk type="block" device="disk">
Nov 17 02:03:20 user nova-compute[75226]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 02:03:20 user nova-compute[75226]:   <source dev="/dev/sdb"/>
Nov 17 02:03:20 user nova-compute[75226]:   <target dev="vdb" bus="virtio"/>
Nov 17 02:03:20 user nova-compute[75226]:   <serial>8c5b6f63-e67d-4a69-aa56-c2d3c746d861</serial>
Nov 17 02:03:20 user nova-compute[75226]: </disk>
Nov 17 02:03:20 user nova-compute[75226]:  {{(pid=75226) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 17 02:03:21 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-4cf6d0e6-9e2f-4a70-a5c0-dce6e8d87620 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] No BDM found with device name vda, not building metadata. {{(pid=75226) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 02:03:21 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-4cf6d0e6-9e2f-4a70-a5c0-dce6e8d87620 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75226) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 02:03:21 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-4cf6d0e6-9e2f-4a70-a5c0-dce6e8d87620 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] No VIF found with MAC fa:16:3e:f5:a8:40, not building metadata {{(pid=75226) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 02:03:21 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-4cf6d0e6-9e2f-4a70-a5c0-dce6e8d87620 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Lock "4a981a97-8a93-4d0a-bf6b-9ec711cc621d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.915s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 02:03:23 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:03:23 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-2039737b-d999-4fea-8787-f448bf7dc43f tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Acquiring lock "4a981a97-8a93-4d0a-bf6b-9ec711cc621d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 02:03:23 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-2039737b-d999-4fea-8787-f448bf7dc43f tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Lock "4a981a97-8a93-4d0a-bf6b-9ec711cc621d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 02:03:23 user nova-compute[75226]: INFO nova.compute.manager [None req-2039737b-d999-4fea-8787-f448bf7dc43f tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] [instance: 4a981a97-8a93-4d0a-bf6b-9ec711cc621d] Detaching volume 8c5b6f63-e67d-4a69-aa56-c2d3c746d861
Nov 17 02:03:23 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:03:23 user nova-compute[75226]: INFO nova.virt.block_device [None req-2039737b-d999-4fea-8787-f448bf7dc43f tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] [instance: 4a981a97-8a93-4d0a-bf6b-9ec711cc621d] Attempting to driver detach volume 8c5b6f63-e67d-4a69-aa56-c2d3c746d861 from mountpoint /dev/vdb
Nov 17 02:03:23 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-2039737b-d999-4fea-8787-f448bf7dc43f tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Attempting to detach device vdb from instance 4a981a97-8a93-4d0a-bf6b-9ec711cc621d from the persistent domain config. {{(pid=75226) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 17 02:03:23 user nova-compute[75226]: DEBUG nova.virt.libvirt.guest [None req-2039737b-d999-4fea-8787-f448bf7dc43f tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] detach device xml: <disk type="block" device="disk">
Nov 17 02:03:23 user nova-compute[75226]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 02:03:23 user nova-compute[75226]:   <source dev="/dev/sdb"/>
Nov 17 02:03:23 user nova-compute[75226]:   <target dev="vdb" bus="virtio"/>
Nov 17 02:03:23 user nova-compute[75226]:   <serial>8c5b6f63-e67d-4a69-aa56-c2d3c746d861</serial>
Nov 17 02:03:23 user nova-compute[75226]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 17 02:03:23 user nova-compute[75226]: </disk>
Nov 17 02:03:23 user nova-compute[75226]:  {{(pid=75226) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 17 02:03:23 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-2039737b-d999-4fea-8787-f448bf7dc43f tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Successfully detached device vdb from instance 4a981a97-8a93-4d0a-bf6b-9ec711cc621d from the persistent domain config.
Nov 17 02:03:23 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-2039737b-d999-4fea-8787-f448bf7dc43f tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4a981a97-8a93-4d0a-bf6b-9ec711cc621d from the live domain config. {{(pid=75226) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 17 02:03:23 user nova-compute[75226]: DEBUG nova.virt.libvirt.guest [None req-2039737b-d999-4fea-8787-f448bf7dc43f tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] detach device xml: <disk type="block" device="disk">
Nov 17 02:03:23 user nova-compute[75226]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 02:03:23 user nova-compute[75226]:   <source dev="/dev/sdb"/>
Nov 17 02:03:23 user nova-compute[75226]:   <target dev="vdb" bus="virtio"/>
Nov 17 02:03:23 user nova-compute[75226]:   <serial>8c5b6f63-e67d-4a69-aa56-c2d3c746d861</serial>
Nov 17 02:03:23 user nova-compute[75226]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 17 02:03:23 user nova-compute[75226]: </disk>
Nov 17 02:03:23 user nova-compute[75226]:  {{(pid=75226) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 17 02:03:24 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-2039737b-d999-4fea-8787-f448bf7dc43f tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4a981a97-8a93-4d0a-bf6b-9ec711cc621d {{(pid=75226) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 17 02:03:28 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:03:28 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:03:30 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 02:03:30 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 02:03:30 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 02:03:30 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 02:03:30 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75226) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 17 02:03:31 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a981a97-8a93-4d0a-bf6b-9ec711cc621d/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:03:31 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a981a97-8a93-4d0a-bf6b-9ec711cc621d/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:03:31 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a981a97-8a93-4d0a-bf6b-9ec711cc621d/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:03:31 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a981a97-8a93-4d0a-bf6b-9ec711cc621d/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:03:31 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 02:03:31 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 02:03:31 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Hypervisor/Node resource view: name=user free_ram=9036MB free_disk=24.904361724853516GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75226) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 17 02:03:31 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 02:03:31 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 02:03:32 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 4a981a97-8a93-4d0a-bf6b-9ec711cc621d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 02:03:32 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75226) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 17 02:03:32 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75226) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 17 02:03:32 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 02:03:32 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 02:03:32 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Compute_service record updated for user:user {{(pid=75226) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 17 02:03:32 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.314s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 02:03:33 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:03:36 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 02:03:36 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 02:03:38 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:03:38 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 02:03:39 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 02:03:39 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75226) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 17 02:03:40 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 02:03:40 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 02:03:41 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 02:03:41 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Starting heal instance info cache {{(pid=75226) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 17 02:03:41 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Rebuilding the list of instances to heal {{(pid=75226) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 17 02:03:42 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "refresh_cache-4a981a97-8a93-4d0a-bf6b-9ec711cc621d" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 02:03:42 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquired lock "refresh_cache-4a981a97-8a93-4d0a-bf6b-9ec711cc621d" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 02:03:42 user nova-compute[75226]: DEBUG nova.network.neutron [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] [instance: 4a981a97-8a93-4d0a-bf6b-9ec711cc621d] Forcefully refreshing network info cache for instance {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 17 02:03:42 user nova-compute[75226]: DEBUG nova.objects.instance [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lazy-loading 'info_cache' on Instance uuid 4a981a97-8a93-4d0a-bf6b-9ec711cc621d {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 02:03:42 user nova-compute[75226]: DEBUG nova.network.neutron [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] [instance: 4a981a97-8a93-4d0a-bf6b-9ec711cc621d] Updating instance_info_cache with network_info: [{"id": "78739500-0226-4429-bf53-c512d2c01d89", "address": "fa:16:3e:f5:a8:40", "network": {"id": "e111d356-c2ca-4cdc-bd8c-1d6bca9a54fd", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-640637510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c84a4fc5baa459d9fb5a3ccb78d2a8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78739500-02", "ovs_interfaceid": "78739500-0226-4429-bf53-c512d2c01d89", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 02:03:42 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Releasing lock "refresh_cache-4a981a97-8a93-4d0a-bf6b-9ec711cc621d" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 02:03:42 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] [instance: 4a981a97-8a93-4d0a-bf6b-9ec711cc621d] Updated the network info_cache for instance {{(pid=75226) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 17 02:03:43 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:03:43 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 02:03:44 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-2039737b-d999-4fea-8787-f448bf7dc43f tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 4a981a97-8a93-4d0a-bf6b-9ec711cc621d is timed out.
Nov 17 02:03:44 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-2039737b-d999-4fea-8787-f448bf7dc43f tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Successfully detached device vdb from instance 4a981a97-8a93-4d0a-bf6b-9ec711cc621d from the live domain config.
Nov 17 02:03:44 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2039737b-d999-4fea-8787-f448bf7dc43f tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] [instance: 4a981a97-8a93-4d0a-bf6b-9ec711cc621d] calling os-brick to detach iSCSI Volume {{(pid=75226) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 17 02:03:44 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-2039737b-d999-4fea-8787-f448bf7dc43f tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc4cc36b490>, {'target_iqn': 'iqn.2010-10.org.openstack:8c5b6f63-e67d-4a69-aa56-c2d3c746d861', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xGMybeKU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 02:03:44 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-2039737b-d999-4fea-8787-f448bf7dc43f tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 02:03:44 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-2039737b-d999-4fea-8787-f448bf7dc43f tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 02:03:44 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-2039737b-d999-4fea-8787-f448bf7dc43f tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 02:03:44 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:03:44 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:03:44 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[092de396-46b4-4900-b978-12915c7b5690]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8c5b6f63-e67d-4a69-aa56-c2d3c746d861\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 02:03:44 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-2039737b-d999-4fea-8787-f448bf7dc43f tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 17 02:03:44 user nova-compute[75226]: No targets found.
Nov 17 02:03:44 user nova-compute[75226]: iSNS:
Nov 17 02:03:44 user nova-compute[75226]: No targets found.
Nov 17 02:03:44 user nova-compute[75226]: STATIC:
Nov 17 02:03:44 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:8c5b6f63-e67d-4a69-aa56-c2d3c746d861
Nov 17 02:03:44 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 02:03:44 user nova-compute[75226]:                 Iface Name: default
Nov 17 02:03:44 user nova-compute[75226]: FIRMWARE:
Nov 17 02:03:44 user nova-compute[75226]: No targets found.
Nov 17 02:03:44 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 02:03:44 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-2039737b-d999-4fea-8787-f448bf7dc43f tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 17 02:03:44 user nova-compute[75226]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 17 02:03:44 user nova-compute[75226]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75226) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 17 02:03:44 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-2039737b-d999-4fea-8787-f448bf7dc43f tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8c5b6f63-e67d-4a69-aa56-c2d3c746d861', 0)] {{(pid=75226) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 17 02:03:44 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:03:44 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:03:44 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e884cf8-2c71-47fa-a0a3-eb082ec90605]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c5b6f63-e67d-4a69-aa56-c2d3c746d861\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 02:03:44 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:03:44 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:03:44 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe089c79-449e-4ec7-9b22-a6c6ef85217d]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c5b6f63-e67d-4a69-aa56-c2d3c746d861 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 02:03:44 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-2039737b-d999-4fea-8787-f448bf7dc43f tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c5b6f63-e67d-4a69-aa56-c2d3c746d861 (non-flash)
Nov 17 02:03:44 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 02:03:44 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-2039737b-d999-4fea-8787-f448bf7dc43f tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c5b6f63-e67d-4a69-aa56-c2d3c746d861 (non-flash)
Nov 17 02:03:44 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 02:03:44 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-2039737b-d999-4fea-8787-f448bf7dc43f tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc4b428ea70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8c5b6f63-e67d-4a69-aa56-c2d3c746d861'): ({'sdb'}, set())}) {{(pid=75226) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 17 02:03:44 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-2039737b-d999-4fea-8787-f448bf7dc43f tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Removing single pathed devices sdb {{(pid=75226) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 17 02:03:44 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:03:44 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:03:44 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d760f6c-19ac-4628-b4f2-4c2bb78ee3e3]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 02:03:44 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:03:44 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:03:44 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[61b7a483-6415-41b3-a8bf-984004e98182]: (4, ('ok\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 02:03:44 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-2039737b-d999-4fea-8787-f448bf7dc43f tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Flushing IO for device /dev/sdb {{(pid=75226) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 17 02:03:44 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:03:44 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.024s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:03:44 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf94cb07-c901-489c-a6d5-f9e134f620db]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 02:03:44 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-2039737b-d999-4fea-8787-f448bf7dc43f tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75226) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 17 02:03:44 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:03:44 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:03:44 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[194344ee-2545-47e1-add3-ee0940cb5cb9]: (4, ('1', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 02:03:44 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-2039737b-d999-4fea-8787-f448bf7dc43f tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75226) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 17 02:03:44 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-2039737b-d999-4fea-8787-f448bf7dc43f tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] SCSI volumes sdb have been removed. {{(pid=75226) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 17 02:03:44 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-2039737b-d999-4fea-8787-f448bf7dc43f tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8c5b6f63-e67d-4a69-aa56-c2d3c746d861')] {{(pid=75226) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 17 02:03:44 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c5b6f63-e67d-4a69-aa56-c2d3c746d861 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:03:44 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c5b6f63-e67d-4a69-aa56-c2d3c746d861 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:03:44 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[098dfc52-7eaf-451d-9439-9c22cb5b5ef7]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 02:03:44 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-2039737b-d999-4fea-8787-f448bf7dc43f tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 02:03:44 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c5b6f63-e67d-4a69-aa56-c2d3c746d861 -p 172.16.0.220:3260 --logout {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:03:44 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c5b6f63-e67d-4a69-aa56-c2d3c746d861 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:03:44 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[6686991a-9f03-41ff-a8e7-c72d8ebe3e23]: (4, ('Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:8c5b6f63-e67d-4a69-aa56-c2d3c746d861, portal: 172.16.0.220,3260]\nLogout of [sid: 68, target: iqn.2010-10.org.openstack:8c5b6f63-e67d-4a69-aa56-c2d3c746d861, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 02:03:44 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-2039737b-d999-4fea-8787-f448bf7dc43f tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:8c5b6f63-e67d-4a69-aa56-c2d3c746d861, portal: 172.16.0.220,3260]
Nov 17 02:03:44 user nova-compute[75226]: Logout of [sid: 68, target: iqn.2010-10.org.openstack:8c5b6f63-e67d-4a69-aa56-c2d3c746d861, portal: 172.16.0.220,3260] successful.
Nov 17 02:03:44 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 02:03:44 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c5b6f63-e67d-4a69-aa56-c2d3c746d861 -p 172.16.0.220:3260 --op delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:03:44 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c5b6f63-e67d-4a69-aa56-c2d3c746d861 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:03:44 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[854dd652-2bd1-471a-bad9-d61686c368e8]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 02:03:44 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-2039737b-d999-4fea-8787-f448bf7dc43f tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 02:03:44 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-2039737b-d999-4fea-8787-f448bf7dc43f tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 02:03:44 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-2039737b-d999-4fea-8787-f448bf7dc43f tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] <== disconnect_volume: return (296ms) None {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 02:03:44 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2039737b-d999-4fea-8787-f448bf7dc43f tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] [instance: 4a981a97-8a93-4d0a-bf6b-9ec711cc621d] Disconnected iSCSI Volume {{(pid=75226) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 17 02:03:45 user nova-compute[75226]: DEBUG nova.objects.instance [None req-2039737b-d999-4fea-8787-f448bf7dc43f tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Lazy-loading 'flavor' on Instance uuid 4a981a97-8a93-4d0a-bf6b-9ec711cc621d {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 02:03:45 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-2039737b-d999-4fea-8787-f448bf7dc43f tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Lock "4a981a97-8a93-4d0a-bf6b-9ec711cc621d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.699s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 02:03:47 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 02:03:47 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Cleaning up deleted instances {{(pid=75226) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 17 02:03:47 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] There are 0 instances to clean {{(pid=75226) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 17 02:03:48 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 02:03:49 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 02:03:53 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:03:55 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 02:03:55 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75226) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 17 02:03:58 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 02:04:03 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:04:04 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 02:04:08 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:04:13 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:04:15 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-fe61f3c7-904c-42b3-83df-aaece4eb06c7 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Acquiring lock "4a981a97-8a93-4d0a-bf6b-9ec711cc621d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 02:04:15 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-fe61f3c7-904c-42b3-83df-aaece4eb06c7 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Lock "4a981a97-8a93-4d0a-bf6b-9ec711cc621d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 02:04:15 user nova-compute[75226]: DEBUG nova.objects.instance [None req-fe61f3c7-904c-42b3-83df-aaece4eb06c7 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Lazy-loading 'flavor' on Instance uuid 4a981a97-8a93-4d0a-bf6b-9ec711cc621d {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 02:04:15 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-fe61f3c7-904c-42b3-83df-aaece4eb06c7 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Lock "4a981a97-8a93-4d0a-bf6b-9ec711cc621d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 02:04:15 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-fe61f3c7-904c-42b3-83df-aaece4eb06c7 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Acquiring lock "4a981a97-8a93-4d0a-bf6b-9ec711cc621d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 02:04:15 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-fe61f3c7-904c-42b3-83df-aaece4eb06c7 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Lock "4a981a97-8a93-4d0a-bf6b-9ec711cc621d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 02:04:15 user nova-compute[75226]: INFO nova.compute.manager [None req-fe61f3c7-904c-42b3-83df-aaece4eb06c7 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] [instance: 4a981a97-8a93-4d0a-bf6b-9ec711cc621d] Attaching volume d004c39a-1aae-4dd1-8000-4d48456d4f50 to /dev/vdb
Nov 17 02:04:16 user nova-compute[75226]: DEBUG os_brick.utils [None req-fe61f3c7-904c-42b3-83df-aaece4eb06c7 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 02:04:16 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:04:16 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:04:16 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9a16f06-df9e-428f-8be2-567371fe776d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f62857db69\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 02:04:16 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:04:16 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:04:16 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[444f6a07-5d8d-4db4-97ec-23fcffb539d1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 02:04:16 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:04:16 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:04:16 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dbf2b5f-3574-4904-b4f1-0e1dde6b6bb9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 02:04:16 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed657b6f-2583-4754-adee-b66de5d8dc8f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 02:04:16 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-fe61f3c7-904c-42b3-83df-aaece4eb06c7 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Running cmd (subprocess): nvme version {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:04:16 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-fe61f3c7-904c-42b3-83df-aaece4eb06c7 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] 'nvme version' failed. Not Retrying. {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 02:04:16 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fe61f3c7-904c-42b3-83df-aaece4eb06c7 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] nvme not present on system {{(pid=75226) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 17 02:04:16 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:04:16 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 02:04:16 user nova-compute[75226]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 17 02:04:16 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[b11c9c66-7625-46e0-86d1-0ed47a19d3d7]: (4, '') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 02:04:16 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-fe61f3c7-904c-42b3-83df-aaece4eb06c7 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75226) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 17 02:04:16 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-fe61f3c7-904c-42b3-83df-aaece4eb06c7 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75226) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 17 02:04:16 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-fe61f3c7-904c-42b3-83df-aaece4eb06c7 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] LIGHTOS: no hostnqn found. {{(pid=75226) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 17 02:04:16 user nova-compute[75226]: DEBUG os_brick.utils [None req-fe61f3c7-904c-42b3-83df-aaece4eb06c7 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f62857db69', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 02:04:16 user nova-compute[75226]: DEBUG nova.virt.block_device [None req-fe61f3c7-904c-42b3-83df-aaece4eb06c7 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] [instance: 4a981a97-8a93-4d0a-bf6b-9ec711cc621d] Updating existing volume attachment record: b7b96c11-ec50-499f-afee-5eea2c68290a {{(pid=75226) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 17 02:04:18 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:04:18 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:04:22 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe61f3c7-904c-42b3-83df-aaece4eb06c7 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] [instance: 4a981a97-8a93-4d0a-bf6b-9ec711cc621d] Calling os-brick to attach iSCSI Volume {{(pid=75226) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 17 02:04:22 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe61f3c7-904c-42b3-83df-aaece4eb06c7 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc4cc36b490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d004c39a-1aae-4dd1-8000-4d48456d4f50', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uJjeaOlY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 02:04:22 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-fe61f3c7-904c-42b3-83df-aaece4eb06c7 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 02:04:22 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-fe61f3c7-904c-42b3-83df-aaece4eb06c7 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 02:04:22 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-fe61f3c7-904c-42b3-83df-aaece4eb06c7 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 02:04:22 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-fe61f3c7-904c-42b3-83df-aaece4eb06c7 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 02:04:22 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-fe61f3c7-904c-42b3-83df-aaece4eb06c7 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d004c39a-1aae-4dd1-8000-4d48456d4f50" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 02:04:22 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-fe61f3c7-904c-42b3-83df-aaece4eb06c7 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d004c39a-1aae-4dd1-8000-4d48456d4f50" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 02:04:22 user nova-compute[75226]: INFO os_brick.initiator.connectors.iscsi [None req-fe61f3c7-904c-42b3-83df-aaece4eb06c7 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 17 02:04:22 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d004c39a-1aae-4dd1-8000-4d48456d4f50 -p 172.16.0.220:3260 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:04:22 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d004c39a-1aae-4dd1-8000-4d48456d4f50 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:04:22 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[32c6e70c-c929-4adc-8a6f-b361fc0a21f1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 02:04:22 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe61f3c7-904c-42b3-83df-aaece4eb06c7 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 17 02:04:22 user nova-compute[75226]:  {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 02:04:22 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d004c39a-1aae-4dd1-8000-4d48456d4f50 -p 172.16.0.220:3260 --interface default --op new {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:04:22 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d004c39a-1aae-4dd1-8000-4d48456d4f50 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:04:22 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee7f3f52-0e11-4473-80b7-37f37df68ae5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d004c39a-1aae-4dd1-8000-4d48456d4f50] added\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 02:04:22 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe61f3c7-904c-42b3-83df-aaece4eb06c7 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d004c39a-1aae-4dd1-8000-4d48456d4f50] added
Nov 17 02:04:22 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 02:04:22 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d004c39a-1aae-4dd1-8000-4d48456d4f50 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:04:22 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d004c39a-1aae-4dd1-8000-4d48456d4f50 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:04:22 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[19f7d90d-2d7c-46b5-8302-3278846ee4dc]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 02:04:22 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe61f3c7-904c-42b3-83df-aaece4eb06c7 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 02:04:22 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d004c39a-1aae-4dd1-8000-4d48456d4f50 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:04:22 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d004c39a-1aae-4dd1-8000-4d48456d4f50 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:04:22 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[76f7b89b-4a73-41da-9b40-35e9a020bb5f]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 02:04:22 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe61f3c7-904c-42b3-83df-aaece4eb06c7 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 02:04:22 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d004c39a-1aae-4dd1-8000-4d48456d4f50 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uJjeaOlY {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:04:22 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d004c39a-1aae-4dd1-8000-4d48456d4f50 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uJjeaOlY" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:04:22 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[89563001-fd26-436e-8a8c-2fdbbc7140ca]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 02:04:22 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe61f3c7-904c-42b3-83df-aaece4eb06c7 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uJjeaOlY'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 02:04:22 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d004c39a-1aae-4dd1-8000-4d48456d4f50 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:04:22 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d004c39a-1aae-4dd1-8000-4d48456d4f50 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:04:22 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[d15049e4-0ecc-472b-a2ca-435d0d825550]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 02:04:22 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe61f3c7-904c-42b3-83df-aaece4eb06c7 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 02:04:22 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:04:22 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:04:22 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[10463171-1dc0-44bc-9b58-da56f6f308c6]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 02:04:22 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe61f3c7-904c-42b3-83df-aaece4eb06c7 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 17 02:04:22 user nova-compute[75226]:  {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 02:04:22 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe61f3c7-904c-42b3-83df-aaece4eb06c7 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 17 02:04:22 user nova-compute[75226]:  {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 02:04:22 user nova-compute[75226]: WARNING os_brick.initiator.connectors.iscsi [None req-fe61f3c7-904c-42b3-83df-aaece4eb06c7 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 17 02:04:22 user nova-compute[75226]: 
Nov 17 02:04:22 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d004c39a-1aae-4dd1-8000-4d48456d4f50 -p 172.16.0.220:3260 --login {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:04:22 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d004c39a-1aae-4dd1-8000-4d48456d4f50 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:04:22 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b927b7d-812e-4a63-8610-579d5b9990d6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d004c39a-1aae-4dd1-8000-4d48456d4f50, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d004c39a-1aae-4dd1-8000-4d48456d4f50, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 02:04:22 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe61f3c7-904c-42b3-83df-aaece4eb06c7 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d004c39a-1aae-4dd1-8000-4d48456d4f50, portal: 172.16.0.220,3260]
Nov 17 02:04:22 user nova-compute[75226]: Login to [iface: default, target: iqn.2010-10.org.openstack:d004c39a-1aae-4dd1-8000-4d48456d4f50, portal: 172.16.0.220,3260] successful.
Nov 17 02:04:22 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 02:04:22 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d004c39a-1aae-4dd1-8000-4d48456d4f50 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:04:22 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d004c39a-1aae-4dd1-8000-4d48456d4f50 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:04:22 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bb0e821-30e4-43c1-bc1d-1fae04082157]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 02:04:22 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe61f3c7-904c-42b3-83df-aaece4eb06c7 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 02:04:22 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:04:22 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:04:22 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[3103758e-d0d4-4ea9-b1d6-17c90bf69d2a]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d004c39a-1aae-4dd1-8000-4d48456d4f50 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 02:04:22 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe61f3c7-904c-42b3-83df-aaece4eb06c7 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d004c39a-1aae-4dd1-8000-4d48456d4f50 (non-flash)
Nov 17 02:04:22 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 02:04:22 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe61f3c7-904c-42b3-83df-aaece4eb06c7 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d004c39a-1aae-4dd1-8000-4d48456d4f50 (non-flash)
Nov 17 02:04:22 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 02:04:22 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-fe61f3c7-904c-42b3-83df-aaece4eb06c7 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d004c39a-1aae-4dd1-8000-4d48456d4f50" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.264s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 02:04:22 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe61f3c7-904c-42b3-83df-aaece4eb06c7 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Connected to 172.16.0.220:3260 {{(pid=75226) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 17 02:04:22 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-fe61f3c7-904c-42b3-83df-aaece4eb06c7 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] HCTL ('33', '-', '-', 0) found on session 69 with lun 0 {{(pid=75226) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 17 02:04:22 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-fe61f3c7-904c-42b3-83df-aaece4eb06c7 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75226) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 17 02:04:22 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:04:22 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:04:22 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[c410f3f0-4240-4841-9a7b-3f3488124aef]: (4, ('- - 0', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 02:04:22 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-fe61f3c7-904c-42b3-83df-aaece4eb06c7 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75226) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 02:04:22 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe61f3c7-904c-42b3-83df-aaece4eb06c7 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:d004c39a-1aae-4dd1-8000-4d48456d4f50', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uJjeaOlY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75226) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 17 02:04:23 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:04:23 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-fe61f3c7-904c-42b3-83df-aaece4eb06c7 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.302s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 02:04:23 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe61f3c7-904c-42b3-83df-aaece4eb06c7 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] <== connect_volume: return (1304ms) {'type': 'block', 'scsi_wwn': '23562643234616230', 'path': '/dev/sdb'} {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 02:04:23 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe61f3c7-904c-42b3-83df-aaece4eb06c7 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] [instance: 4a981a97-8a93-4d0a-bf6b-9ec711cc621d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23562643234616230', 'path': '/dev/sdb'} {{(pid=75226) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 17 02:04:23 user nova-compute[75226]: DEBUG nova.objects.instance [None req-fe61f3c7-904c-42b3-83df-aaece4eb06c7 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Lazy-loading 'flavor' on Instance uuid 4a981a97-8a93-4d0a-bf6b-9ec711cc621d {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 02:04:23 user nova-compute[75226]: DEBUG nova.virt.libvirt.guest [None req-fe61f3c7-904c-42b3-83df-aaece4eb06c7 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] attach device xml: <disk type="block" device="disk">
Nov 17 02:04:23 user nova-compute[75226]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 02:04:23 user nova-compute[75226]:   <source dev="/dev/sdb"/>
Nov 17 02:04:23 user nova-compute[75226]:   <target dev="vdb" bus="virtio"/>
Nov 17 02:04:23 user nova-compute[75226]:   <serial>d004c39a-1aae-4dd1-8000-4d48456d4f50</serial>
Nov 17 02:04:23 user nova-compute[75226]: </disk>
Nov 17 02:04:23 user nova-compute[75226]:  {{(pid=75226) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 17 02:04:24 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-fe61f3c7-904c-42b3-83df-aaece4eb06c7 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] No BDM found with device name vda, not building metadata. {{(pid=75226) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 02:04:24 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-fe61f3c7-904c-42b3-83df-aaece4eb06c7 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75226) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 02:04:24 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-fe61f3c7-904c-42b3-83df-aaece4eb06c7 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] No VIF found with MAC fa:16:3e:f5:a8:40, not building metadata {{(pid=75226) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 02:04:24 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-fe61f3c7-904c-42b3-83df-aaece4eb06c7 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Lock "4a981a97-8a93-4d0a-bf6b-9ec711cc621d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.468s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 02:04:25 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-52568e2c-ae9f-4013-92e4-3a498b043fcb tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Acquiring lock "4a981a97-8a93-4d0a-bf6b-9ec711cc621d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 02:04:25 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-52568e2c-ae9f-4013-92e4-3a498b043fcb tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Lock "4a981a97-8a93-4d0a-bf6b-9ec711cc621d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 02:04:25 user nova-compute[75226]: INFO nova.compute.manager [None req-52568e2c-ae9f-4013-92e4-3a498b043fcb tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] [instance: 4a981a97-8a93-4d0a-bf6b-9ec711cc621d] Detaching volume d004c39a-1aae-4dd1-8000-4d48456d4f50
Nov 17 02:04:26 user nova-compute[75226]: INFO nova.virt.block_device [None req-52568e2c-ae9f-4013-92e4-3a498b043fcb tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] [instance: 4a981a97-8a93-4d0a-bf6b-9ec711cc621d] Attempting to driver detach volume d004c39a-1aae-4dd1-8000-4d48456d4f50 from mountpoint /dev/vdb
Nov 17 02:04:26 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-52568e2c-ae9f-4013-92e4-3a498b043fcb tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Attempting to detach device vdb from instance 4a981a97-8a93-4d0a-bf6b-9ec711cc621d from the persistent domain config. {{(pid=75226) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 17 02:04:26 user nova-compute[75226]: DEBUG nova.virt.libvirt.guest [None req-52568e2c-ae9f-4013-92e4-3a498b043fcb tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] detach device xml: <disk type="block" device="disk">
Nov 17 02:04:26 user nova-compute[75226]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 02:04:26 user nova-compute[75226]:   <source dev="/dev/sdb"/>
Nov 17 02:04:26 user nova-compute[75226]:   <target dev="vdb" bus="virtio"/>
Nov 17 02:04:26 user nova-compute[75226]:   <serial>d004c39a-1aae-4dd1-8000-4d48456d4f50</serial>
Nov 17 02:04:26 user nova-compute[75226]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 17 02:04:26 user nova-compute[75226]: </disk>
Nov 17 02:04:26 user nova-compute[75226]:  {{(pid=75226) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 17 02:04:26 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-52568e2c-ae9f-4013-92e4-3a498b043fcb tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Successfully detached device vdb from instance 4a981a97-8a93-4d0a-bf6b-9ec711cc621d from the persistent domain config.
Nov 17 02:04:26 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-52568e2c-ae9f-4013-92e4-3a498b043fcb tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4a981a97-8a93-4d0a-bf6b-9ec711cc621d from the live domain config. {{(pid=75226) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 17 02:04:26 user nova-compute[75226]: DEBUG nova.virt.libvirt.guest [None req-52568e2c-ae9f-4013-92e4-3a498b043fcb tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] detach device xml: <disk type="block" device="disk">
Nov 17 02:04:26 user nova-compute[75226]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 02:04:26 user nova-compute[75226]:   <source dev="/dev/sdb"/>
Nov 17 02:04:26 user nova-compute[75226]:   <target dev="vdb" bus="virtio"/>
Nov 17 02:04:26 user nova-compute[75226]:   <serial>d004c39a-1aae-4dd1-8000-4d48456d4f50</serial>
Nov 17 02:04:26 user nova-compute[75226]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 17 02:04:26 user nova-compute[75226]: </disk>
Nov 17 02:04:26 user nova-compute[75226]:  {{(pid=75226) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 17 02:04:26 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-52568e2c-ae9f-4013-92e4-3a498b043fcb tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4a981a97-8a93-4d0a-bf6b-9ec711cc621d {{(pid=75226) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 17 02:04:28 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 02:04:28 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:04:28 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75226) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 17 02:04:28 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75226) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 02:04:28 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75226) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 02:04:28 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:04:28 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:04:31 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 02:04:31 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 02:04:31 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 02:04:31 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 02:04:31 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75226) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 17 02:04:32 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a981a97-8a93-4d0a-bf6b-9ec711cc621d/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:04:32 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a981a97-8a93-4d0a-bf6b-9ec711cc621d/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:04:32 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a981a97-8a93-4d0a-bf6b-9ec711cc621d/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:04:32 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a981a97-8a93-4d0a-bf6b-9ec711cc621d/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:04:32 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 02:04:32 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 02:04:32 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Hypervisor/Node resource view: name=user free_ram=9035MB free_disk=24.903377532958984GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75226) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 17 02:04:32 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 02:04:32 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 02:04:32 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 4a981a97-8a93-4d0a-bf6b-9ec711cc621d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 02:04:32 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75226) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 17 02:04:32 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75226) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 17 02:04:33 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Refreshing inventories for resource provider f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 17 02:04:33 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Updating ProviderTree inventory for provider f431122b-abb2-4ecb-9e21-e3ec333d823b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 17 02:04:33 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Updating inventory in ProviderTree for provider f431122b-abb2-4ecb-9e21-e3ec333d823b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 17 02:04:33 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Refreshing aggregate associations for resource provider f431122b-abb2-4ecb-9e21-e3ec333d823b, aggregates: None {{(pid=75226) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 17 02:04:33 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Refreshing trait associations for resource provider f431122b-abb2-4ecb-9e21-e3ec333d823b, traits: COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE42,HW_CPU_X86_SSE,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSSE3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_SATA {{(pid=75226) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 17 02:04:33 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:04:33 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 02:04:33 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 02:04:33 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Compute_service record updated for user:user {{(pid=75226) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 17 02:04:33 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.301s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 02:04:38 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:04:38 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 02:04:38 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 02:04:39 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 02:04:39 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75226) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 17 02:04:40 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 02:04:41 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 02:04:41 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 02:04:43 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 02:04:43 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 02:04:43 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Starting heal instance info cache {{(pid=75226) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 17 02:04:43 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Rebuilding the list of instances to heal {{(pid=75226) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 17 02:04:44 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "refresh_cache-4a981a97-8a93-4d0a-bf6b-9ec711cc621d" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 02:04:44 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquired lock "refresh_cache-4a981a97-8a93-4d0a-bf6b-9ec711cc621d" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 02:04:44 user nova-compute[75226]: DEBUG nova.network.neutron [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] [instance: 4a981a97-8a93-4d0a-bf6b-9ec711cc621d] Forcefully refreshing network info cache for instance {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 17 02:04:44 user nova-compute[75226]: DEBUG nova.objects.instance [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lazy-loading 'info_cache' on Instance uuid 4a981a97-8a93-4d0a-bf6b-9ec711cc621d {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 02:04:44 user nova-compute[75226]: DEBUG nova.network.neutron [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] [instance: 4a981a97-8a93-4d0a-bf6b-9ec711cc621d] Updating instance_info_cache with network_info: [{"id": "78739500-0226-4429-bf53-c512d2c01d89", "address": "fa:16:3e:f5:a8:40", "network": {"id": "e111d356-c2ca-4cdc-bd8c-1d6bca9a54fd", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-640637510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c84a4fc5baa459d9fb5a3ccb78d2a8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78739500-02", "ovs_interfaceid": "78739500-0226-4429-bf53-c512d2c01d89", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 02:04:44 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Releasing lock "refresh_cache-4a981a97-8a93-4d0a-bf6b-9ec711cc621d" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 02:04:44 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] [instance: 4a981a97-8a93-4d0a-bf6b-9ec711cc621d] Updated the network info_cache for instance {{(pid=75226) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 17 02:04:45 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 02:04:46 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-52568e2c-ae9f-4013-92e4-3a498b043fcb tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 4a981a97-8a93-4d0a-bf6b-9ec711cc621d is timed out.
Nov 17 02:04:46 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-52568e2c-ae9f-4013-92e4-3a498b043fcb tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Successfully detached device vdb from instance 4a981a97-8a93-4d0a-bf6b-9ec711cc621d from the live domain config.
Nov 17 02:04:46 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52568e2c-ae9f-4013-92e4-3a498b043fcb tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] [instance: 4a981a97-8a93-4d0a-bf6b-9ec711cc621d] calling os-brick to detach iSCSI Volume {{(pid=75226) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 17 02:04:46 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-52568e2c-ae9f-4013-92e4-3a498b043fcb tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc4cc36b490>, {'target_iqn': 'iqn.2010-10.org.openstack:d004c39a-1aae-4dd1-8000-4d48456d4f50', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uJjeaOlY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 02:04:46 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-52568e2c-ae9f-4013-92e4-3a498b043fcb tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 02:04:46 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-52568e2c-ae9f-4013-92e4-3a498b043fcb tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 02:04:46 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-52568e2c-ae9f-4013-92e4-3a498b043fcb tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 02:04:46 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:04:46 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:04:46 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[01d8a1f2-fba1-4a49-bc4c-f3afa9dcb28a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d004c39a-1aae-4dd1-8000-4d48456d4f50\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 02:04:46 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-52568e2c-ae9f-4013-92e4-3a498b043fcb tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 17 02:04:46 user nova-compute[75226]: No targets found.
Nov 17 02:04:46 user nova-compute[75226]: iSNS:
Nov 17 02:04:46 user nova-compute[75226]: No targets found.
Nov 17 02:04:46 user nova-compute[75226]: STATIC:
Nov 17 02:04:46 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:d004c39a-1aae-4dd1-8000-4d48456d4f50
Nov 17 02:04:46 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 02:04:46 user nova-compute[75226]:                 Iface Name: default
Nov 17 02:04:46 user nova-compute[75226]: FIRMWARE:
Nov 17 02:04:46 user nova-compute[75226]: No targets found.
Nov 17 02:04:46 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 02:04:46 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-52568e2c-ae9f-4013-92e4-3a498b043fcb tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 17 02:04:46 user nova-compute[75226]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 17 02:04:46 user nova-compute[75226]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75226) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 17 02:04:46 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-52568e2c-ae9f-4013-92e4-3a498b043fcb tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d004c39a-1aae-4dd1-8000-4d48456d4f50', 0)] {{(pid=75226) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 17 02:04:46 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:04:46 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:04:46 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e165553-e6be-4a3b-bee3-200b5dfc1641]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d004c39a-1aae-4dd1-8000-4d48456d4f50\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 02:04:46 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:04:46 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:04:46 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ab2e605-be82-40d8-8c19-975365c27d22]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d004c39a-1aae-4dd1-8000-4d48456d4f50 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 02:04:46 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-52568e2c-ae9f-4013-92e4-3a498b043fcb tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d004c39a-1aae-4dd1-8000-4d48456d4f50 (non-flash)
Nov 17 02:04:46 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 02:04:46 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-52568e2c-ae9f-4013-92e4-3a498b043fcb tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d004c39a-1aae-4dd1-8000-4d48456d4f50 (non-flash)
Nov 17 02:04:46 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 02:04:46 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-52568e2c-ae9f-4013-92e4-3a498b043fcb tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc4d4163760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d004c39a-1aae-4dd1-8000-4d48456d4f50'): ({'sdb'}, set())}) {{(pid=75226) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 17 02:04:46 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-52568e2c-ae9f-4013-92e4-3a498b043fcb tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Removing single pathed devices sdb {{(pid=75226) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 17 02:04:46 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:04:46 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:04:46 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[f75dc4d1-9cf0-49b4-94f6-73820b5bfc63]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 02:04:46 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:04:46 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:04:46 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f5791da-e7d8-4322-a8a2-a6805cb43ee6]: (4, ('ok\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 02:04:46 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-52568e2c-ae9f-4013-92e4-3a498b043fcb tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Flushing IO for device /dev/sdb {{(pid=75226) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 17 02:04:46 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:04:46 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:04:46 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbc17ebf-0045-4d37-802b-e44aaeeff186]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 02:04:46 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-52568e2c-ae9f-4013-92e4-3a498b043fcb tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75226) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 17 02:04:46 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:04:46 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:04:46 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[aae5bab3-072f-45f0-b125-1cbf9e191cf9]: (4, ('1', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 02:04:46 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-52568e2c-ae9f-4013-92e4-3a498b043fcb tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75226) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 17 02:04:46 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-52568e2c-ae9f-4013-92e4-3a498b043fcb tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] SCSI volumes sdb have been removed. {{(pid=75226) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 17 02:04:46 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-52568e2c-ae9f-4013-92e4-3a498b043fcb tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d004c39a-1aae-4dd1-8000-4d48456d4f50')] {{(pid=75226) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 17 02:04:46 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d004c39a-1aae-4dd1-8000-4d48456d4f50 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:04:46 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d004c39a-1aae-4dd1-8000-4d48456d4f50 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:04:46 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[415ff4ac-ef31-42a6-a824-8ec7679b96ba]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 02:04:46 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-52568e2c-ae9f-4013-92e4-3a498b043fcb tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 02:04:46 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d004c39a-1aae-4dd1-8000-4d48456d4f50 -p 172.16.0.220:3260 --logout {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:04:46 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d004c39a-1aae-4dd1-8000-4d48456d4f50 -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:04:46 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[83509f61-1200-4344-aed4-5fac24ce9ede]: (4, ('Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:d004c39a-1aae-4dd1-8000-4d48456d4f50, portal: 172.16.0.220,3260]\nLogout of [sid: 69, target: iqn.2010-10.org.openstack:d004c39a-1aae-4dd1-8000-4d48456d4f50, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 02:04:46 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-52568e2c-ae9f-4013-92e4-3a498b043fcb tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:d004c39a-1aae-4dd1-8000-4d48456d4f50, portal: 172.16.0.220,3260]
Nov 17 02:04:46 user nova-compute[75226]: Logout of [sid: 69, target: iqn.2010-10.org.openstack:d004c39a-1aae-4dd1-8000-4d48456d4f50, portal: 172.16.0.220,3260] successful.
Nov 17 02:04:46 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 02:04:46 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d004c39a-1aae-4dd1-8000-4d48456d4f50 -p 172.16.0.220:3260 --op delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:04:46 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d004c39a-1aae-4dd1-8000-4d48456d4f50 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:04:46 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0fb1128-7e34-4dfe-8760-20972843ff6f]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 02:04:46 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-52568e2c-ae9f-4013-92e4-3a498b043fcb tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 02:04:46 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-52568e2c-ae9f-4013-92e4-3a498b043fcb tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.300s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 02:04:46 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-52568e2c-ae9f-4013-92e4-3a498b043fcb tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] <== disconnect_volume: return (301ms) None {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 02:04:46 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52568e2c-ae9f-4013-92e4-3a498b043fcb tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] [instance: 4a981a97-8a93-4d0a-bf6b-9ec711cc621d] Disconnected iSCSI Volume {{(pid=75226) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 17 02:04:47 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 02:04:47 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Triggering sync for uuid 4a981a97-8a93-4d0a-bf6b-9ec711cc621d {{(pid=75226) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 17 02:04:47 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "4a981a97-8a93-4d0a-bf6b-9ec711cc621d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 02:04:47 user nova-compute[75226]: DEBUG nova.objects.instance [None req-52568e2c-ae9f-4013-92e4-3a498b043fcb tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Lazy-loading 'flavor' on Instance uuid 4a981a97-8a93-4d0a-bf6b-9ec711cc621d {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 02:04:47 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-52568e2c-ae9f-4013-92e4-3a498b043fcb tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Lock "4a981a97-8a93-4d0a-bf6b-9ec711cc621d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.628s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 02:04:47 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "4a981a97-8a93-4d0a-bf6b-9ec711cc621d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.192s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 02:04:47 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "4a981a97-8a93-4d0a-bf6b-9ec711cc621d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.022s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 02:04:48 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 02:04:48 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:04:48 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75226) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 17 02:04:48 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75226) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 02:04:48 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75226) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 02:04:48 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 02:04:53 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:04:58 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:05:03 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:05:08 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 02:05:08 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:05:08 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75226) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 17 02:05:08 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75226) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 02:05:08 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75226) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 02:05:08 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:05:13 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:05:18 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 02:05:18 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:05:18 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75226) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 17 02:05:18 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75226) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 02:05:18 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75226) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 02:05:18 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:05:18 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:05:19 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-b911cf55-6051-4b97-971f-1e885d6e26e4 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Acquiring lock "4a981a97-8a93-4d0a-bf6b-9ec711cc621d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 02:05:19 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-b911cf55-6051-4b97-971f-1e885d6e26e4 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Lock "4a981a97-8a93-4d0a-bf6b-9ec711cc621d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 02:05:19 user nova-compute[75226]: DEBUG nova.objects.instance [None req-b911cf55-6051-4b97-971f-1e885d6e26e4 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Lazy-loading 'flavor' on Instance uuid 4a981a97-8a93-4d0a-bf6b-9ec711cc621d {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 02:05:19 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-b911cf55-6051-4b97-971f-1e885d6e26e4 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Lock "4a981a97-8a93-4d0a-bf6b-9ec711cc621d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 02:05:19 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-b911cf55-6051-4b97-971f-1e885d6e26e4 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Acquiring lock "4a981a97-8a93-4d0a-bf6b-9ec711cc621d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 02:05:19 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-b911cf55-6051-4b97-971f-1e885d6e26e4 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Lock "4a981a97-8a93-4d0a-bf6b-9ec711cc621d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 02:05:19 user nova-compute[75226]: INFO nova.compute.manager [None req-b911cf55-6051-4b97-971f-1e885d6e26e4 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] [instance: 4a981a97-8a93-4d0a-bf6b-9ec711cc621d] Attaching volume ed1c5c95-6a27-4903-9da8-f82fa2007329 to /dev/vdb
Nov 17 02:05:19 user nova-compute[75226]: DEBUG os_brick.utils [None req-b911cf55-6051-4b97-971f-1e885d6e26e4 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 02:05:19 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:05:19 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:05:19 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[40bc15fb-f593-4dca-8442-b32fea4d210d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f62857db69\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 02:05:19 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:05:19 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:05:19 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc21fc32-c6c5-47e4-a33d-943de70f3d0c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 02:05:19 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:05:19 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:05:19 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[0022f444-65d3-41a4-b8ec-e55cfb69f9a7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 02:05:19 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[26b56b0e-9b65-4c88-acbb-4fd64951a33b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 02:05:19 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-b911cf55-6051-4b97-971f-1e885d6e26e4 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Running cmd (subprocess): nvme version {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:05:19 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-b911cf55-6051-4b97-971f-1e885d6e26e4 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] 'nvme version' failed. Not Retrying. {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 02:05:19 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b911cf55-6051-4b97-971f-1e885d6e26e4 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] nvme not present on system {{(pid=75226) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 17 02:05:19 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:05:19 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 17 02:05:19 user nova-compute[75226]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 17 02:05:19 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[01e01ac2-fc3f-4db7-a980-753654bb0199]: (4, '') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 02:05:19 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-b911cf55-6051-4b97-971f-1e885d6e26e4 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75226) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 17 02:05:19 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-b911cf55-6051-4b97-971f-1e885d6e26e4 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75226) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 17 02:05:19 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.lightos [None req-b911cf55-6051-4b97-971f-1e885d6e26e4 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] LIGHTOS: no hostnqn found. {{(pid=75226) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 17 02:05:19 user nova-compute[75226]: DEBUG os_brick.utils [None req-b911cf55-6051-4b97-971f-1e885d6e26e4 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f62857db69', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 02:05:19 user nova-compute[75226]: DEBUG nova.virt.block_device [None req-b911cf55-6051-4b97-971f-1e885d6e26e4 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] [instance: 4a981a97-8a93-4d0a-bf6b-9ec711cc621d] Updating existing volume attachment record: 1a27b826-75d2-42c4-b03f-691e30357e85 {{(pid=75226) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 17 02:05:23 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:05:23 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:05:24 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b911cf55-6051-4b97-971f-1e885d6e26e4 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] [instance: 4a981a97-8a93-4d0a-bf6b-9ec711cc621d] Calling os-brick to attach iSCSI Volume {{(pid=75226) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 17 02:05:24 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-b911cf55-6051-4b97-971f-1e885d6e26e4 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc4cc36b490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ed1c5c95-6a27-4903-9da8-f82fa2007329', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MkZaylRs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 02:05:24 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-b911cf55-6051-4b97-971f-1e885d6e26e4 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 02:05:24 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-b911cf55-6051-4b97-971f-1e885d6e26e4 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 02:05:24 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-b911cf55-6051-4b97-971f-1e885d6e26e4 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 02:05:24 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-b911cf55-6051-4b97-971f-1e885d6e26e4 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 02:05:24 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-b911cf55-6051-4b97-971f-1e885d6e26e4 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ed1c5c95-6a27-4903-9da8-f82fa2007329" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 02:05:24 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-b911cf55-6051-4b97-971f-1e885d6e26e4 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ed1c5c95-6a27-4903-9da8-f82fa2007329" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 02:05:24 user nova-compute[75226]: INFO os_brick.initiator.connectors.iscsi [None req-b911cf55-6051-4b97-971f-1e885d6e26e4 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 17 02:05:24 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed1c5c95-6a27-4903-9da8-f82fa2007329 -p 172.16.0.220:3260 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:05:24 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed1c5c95-6a27-4903-9da8-f82fa2007329 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:05:24 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[29502673-1788-451a-9b67-381f4dd45cfc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 02:05:24 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-b911cf55-6051-4b97-971f-1e885d6e26e4 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 17 02:05:24 user nova-compute[75226]:  {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 02:05:24 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed1c5c95-6a27-4903-9da8-f82fa2007329 -p 172.16.0.220:3260 --interface default --op new {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:05:24 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed1c5c95-6a27-4903-9da8-f82fa2007329 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:05:24 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[c564b64b-61dc-4f10-86f0-cd7c9cc62f2f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ed1c5c95-6a27-4903-9da8-f82fa2007329] added\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 02:05:24 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-b911cf55-6051-4b97-971f-1e885d6e26e4 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ed1c5c95-6a27-4903-9da8-f82fa2007329] added
Nov 17 02:05:24 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 02:05:24 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed1c5c95-6a27-4903-9da8-f82fa2007329 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:05:24 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed1c5c95-6a27-4903-9da8-f82fa2007329 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:05:24 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[0922c5a1-f86b-4c23-968c-cd357329d7ff]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 02:05:24 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-b911cf55-6051-4b97-971f-1e885d6e26e4 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 02:05:24 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed1c5c95-6a27-4903-9da8-f82fa2007329 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:05:24 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed1c5c95-6a27-4903-9da8-f82fa2007329 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:05:24 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ee125e7-5132-49cf-8d34-1578b6c3d036]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 02:05:24 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-b911cf55-6051-4b97-971f-1e885d6e26e4 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 02:05:24 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed1c5c95-6a27-4903-9da8-f82fa2007329 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MkZaylRs {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:05:24 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed1c5c95-6a27-4903-9da8-f82fa2007329 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MkZaylRs" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:05:24 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[86ffc16e-bdb2-4cb2-ad2a-036ada5b7f81]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 02:05:24 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-b911cf55-6051-4b97-971f-1e885d6e26e4 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MkZaylRs'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 02:05:24 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed1c5c95-6a27-4903-9da8-f82fa2007329 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:05:24 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed1c5c95-6a27-4903-9da8-f82fa2007329 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:05:24 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ba25b99-b441-4ab9-8612-5802c3737633]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 02:05:24 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-b911cf55-6051-4b97-971f-1e885d6e26e4 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 02:05:24 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:05:24 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:05:24 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c6549c6-855a-4151-9183-cdd8d2406b8b]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 02:05:24 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-b911cf55-6051-4b97-971f-1e885d6e26e4 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 17 02:05:24 user nova-compute[75226]:  {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 02:05:24 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-b911cf55-6051-4b97-971f-1e885d6e26e4 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 17 02:05:24 user nova-compute[75226]:  {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 02:05:24 user nova-compute[75226]: WARNING os_brick.initiator.connectors.iscsi [None req-b911cf55-6051-4b97-971f-1e885d6e26e4 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 17 02:05:24 user nova-compute[75226]: 
Nov 17 02:05:24 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed1c5c95-6a27-4903-9da8-f82fa2007329 -p 172.16.0.220:3260 --login {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:05:24 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed1c5c95-6a27-4903-9da8-f82fa2007329 -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:05:24 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3f45362-3d1c-4e44-8017-166c0d923d7a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ed1c5c95-6a27-4903-9da8-f82fa2007329, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ed1c5c95-6a27-4903-9da8-f82fa2007329, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 02:05:24 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-b911cf55-6051-4b97-971f-1e885d6e26e4 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ed1c5c95-6a27-4903-9da8-f82fa2007329, portal: 172.16.0.220,3260]
Nov 17 02:05:24 user nova-compute[75226]: Login to [iface: default, target: iqn.2010-10.org.openstack:ed1c5c95-6a27-4903-9da8-f82fa2007329, portal: 172.16.0.220,3260] successful.
Nov 17 02:05:24 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 02:05:24 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed1c5c95-6a27-4903-9da8-f82fa2007329 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:05:24 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed1c5c95-6a27-4903-9da8-f82fa2007329 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:05:24 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[25bc95bf-d478-4a29-81e1-e3a11d26b1bb]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 02:05:24 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-b911cf55-6051-4b97-971f-1e885d6e26e4 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 02:05:24 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:05:24 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:05:24 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfef04bb-3c6a-4cdb-8be7-e2036fef4007]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed1c5c95-6a27-4903-9da8-f82fa2007329 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 02:05:24 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-b911cf55-6051-4b97-971f-1e885d6e26e4 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed1c5c95-6a27-4903-9da8-f82fa2007329 (non-flash)
Nov 17 02:05:24 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 02:05:24 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-b911cf55-6051-4b97-971f-1e885d6e26e4 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed1c5c95-6a27-4903-9da8-f82fa2007329 (non-flash)
Nov 17 02:05:24 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 02:05:24 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-b911cf55-6051-4b97-971f-1e885d6e26e4 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ed1c5c95-6a27-4903-9da8-f82fa2007329" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.235s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 02:05:24 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-b911cf55-6051-4b97-971f-1e885d6e26e4 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Connected to 172.16.0.220:3260 {{(pid=75226) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 17 02:05:24 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-b911cf55-6051-4b97-971f-1e885d6e26e4 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] HCTL ('33', '-', '-', 0) found on session 70 with lun 0 {{(pid=75226) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 17 02:05:24 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-b911cf55-6051-4b97-971f-1e885d6e26e4 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75226) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 17 02:05:24 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:05:24 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:05:24 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3a48420-1955-47c8-82ca-bf0031d10e68]: (4, ('- - 0', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 02:05:24 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-b911cf55-6051-4b97-971f-1e885d6e26e4 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Searching for a device in session 70 and hctl ['33', '*', '*', 0] yield: None {{(pid=75226) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 02:05:25 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-b911cf55-6051-4b97-971f-1e885d6e26e4 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Searching for a device in session 70 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75226) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 17 02:05:25 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-b911cf55-6051-4b97-971f-1e885d6e26e4 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:ed1c5c95-6a27-4903-9da8-f82fa2007329', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MkZaylRs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75226) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 17 02:05:25 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-b911cf55-6051-4b97-971f-1e885d6e26e4 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.266s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 02:05:25 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-b911cf55-6051-4b97-971f-1e885d6e26e4 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] <== connect_volume: return (1268ms) {'type': 'block', 'scsi_wwn': '23264623964343434', 'path': '/dev/sdb'} {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 02:05:25 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b911cf55-6051-4b97-971f-1e885d6e26e4 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] [instance: 4a981a97-8a93-4d0a-bf6b-9ec711cc621d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23264623964343434', 'path': '/dev/sdb'} {{(pid=75226) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 17 02:05:25 user nova-compute[75226]: DEBUG nova.objects.instance [None req-b911cf55-6051-4b97-971f-1e885d6e26e4 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Lazy-loading 'flavor' on Instance uuid 4a981a97-8a93-4d0a-bf6b-9ec711cc621d {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 02:05:25 user nova-compute[75226]: DEBUG nova.virt.libvirt.guest [None req-b911cf55-6051-4b97-971f-1e885d6e26e4 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] attach device xml: <disk type="block" device="disk">
Nov 17 02:05:25 user nova-compute[75226]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 02:05:25 user nova-compute[75226]:   <source dev="/dev/sdb"/>
Nov 17 02:05:25 user nova-compute[75226]:   <target dev="vdb" bus="virtio"/>
Nov 17 02:05:25 user nova-compute[75226]:   <serial>ed1c5c95-6a27-4903-9da8-f82fa2007329</serial>
Nov 17 02:05:25 user nova-compute[75226]: </disk>
Nov 17 02:05:25 user nova-compute[75226]:  {{(pid=75226) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 17 02:05:26 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-b911cf55-6051-4b97-971f-1e885d6e26e4 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] No BDM found with device name vda, not building metadata. {{(pid=75226) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 02:05:26 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-b911cf55-6051-4b97-971f-1e885d6e26e4 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75226) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 17 02:05:26 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-b911cf55-6051-4b97-971f-1e885d6e26e4 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] No VIF found with MAC fa:16:3e:f5:a8:40, not building metadata {{(pid=75226) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 17 02:05:26 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-b911cf55-6051-4b97-971f-1e885d6e26e4 tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Lock "4a981a97-8a93-4d0a-bf6b-9ec711cc621d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.164s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 02:05:28 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:05:28 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-36fcc18c-1c03-4466-bd76-fa562a8ba9ee tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Acquiring lock "4a981a97-8a93-4d0a-bf6b-9ec711cc621d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 02:05:28 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-36fcc18c-1c03-4466-bd76-fa562a8ba9ee tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Lock "4a981a97-8a93-4d0a-bf6b-9ec711cc621d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 02:05:28 user nova-compute[75226]: INFO nova.compute.manager [None req-36fcc18c-1c03-4466-bd76-fa562a8ba9ee tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] [instance: 4a981a97-8a93-4d0a-bf6b-9ec711cc621d] Detaching volume ed1c5c95-6a27-4903-9da8-f82fa2007329
Nov 17 02:05:28 user nova-compute[75226]: INFO nova.virt.block_device [None req-36fcc18c-1c03-4466-bd76-fa562a8ba9ee tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] [instance: 4a981a97-8a93-4d0a-bf6b-9ec711cc621d] Attempting to driver detach volume ed1c5c95-6a27-4903-9da8-f82fa2007329 from mountpoint /dev/vdb
Nov 17 02:05:28 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-36fcc18c-1c03-4466-bd76-fa562a8ba9ee tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Attempting to detach device vdb from instance 4a981a97-8a93-4d0a-bf6b-9ec711cc621d from the persistent domain config. {{(pid=75226) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 17 02:05:28 user nova-compute[75226]: DEBUG nova.virt.libvirt.guest [None req-36fcc18c-1c03-4466-bd76-fa562a8ba9ee tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] detach device xml: <disk type="block" device="disk">
Nov 17 02:05:28 user nova-compute[75226]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 02:05:28 user nova-compute[75226]:   <source dev="/dev/sdb"/>
Nov 17 02:05:28 user nova-compute[75226]:   <target dev="vdb" bus="virtio"/>
Nov 17 02:05:28 user nova-compute[75226]:   <serial>ed1c5c95-6a27-4903-9da8-f82fa2007329</serial>
Nov 17 02:05:28 user nova-compute[75226]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 17 02:05:28 user nova-compute[75226]: </disk>
Nov 17 02:05:28 user nova-compute[75226]:  {{(pid=75226) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 17 02:05:28 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-36fcc18c-1c03-4466-bd76-fa562a8ba9ee tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Successfully detached device vdb from instance 4a981a97-8a93-4d0a-bf6b-9ec711cc621d from the persistent domain config.
Nov 17 02:05:28 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-36fcc18c-1c03-4466-bd76-fa562a8ba9ee tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4a981a97-8a93-4d0a-bf6b-9ec711cc621d from the live domain config. {{(pid=75226) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 17 02:05:28 user nova-compute[75226]: DEBUG nova.virt.libvirt.guest [None req-36fcc18c-1c03-4466-bd76-fa562a8ba9ee tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] detach device xml: <disk type="block" device="disk">
Nov 17 02:05:28 user nova-compute[75226]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 17 02:05:28 user nova-compute[75226]:   <source dev="/dev/sdb"/>
Nov 17 02:05:28 user nova-compute[75226]:   <target dev="vdb" bus="virtio"/>
Nov 17 02:05:28 user nova-compute[75226]:   <serial>ed1c5c95-6a27-4903-9da8-f82fa2007329</serial>
Nov 17 02:05:28 user nova-compute[75226]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 17 02:05:28 user nova-compute[75226]: </disk>
Nov 17 02:05:28 user nova-compute[75226]:  {{(pid=75226) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 17 02:05:28 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:05:29 user nova-compute[75226]: DEBUG nova.virt.libvirt.driver [None req-36fcc18c-1c03-4466-bd76-fa562a8ba9ee tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4a981a97-8a93-4d0a-bf6b-9ec711cc621d {{(pid=75226) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 17 02:05:32 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 02:05:32 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 02:05:32 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 02:05:32 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 02:05:32 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75226) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 17 02:05:33 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a981a97-8a93-4d0a-bf6b-9ec711cc621d/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:05:33 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:05:33 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a981a97-8a93-4d0a-bf6b-9ec711cc621d/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:05:33 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a981a97-8a93-4d0a-bf6b-9ec711cc621d/disk --force-share --output=json {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:05:33 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a981a97-8a93-4d0a-bf6b-9ec711cc621d/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75226) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:05:33 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 02:05:33 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 02:05:33 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Hypervisor/Node resource view: name=user free_ram=9040MB free_disk=24.902420043945312GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75226) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 17 02:05:33 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 02:05:33 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 02:05:33 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 4a981a97-8a93-4d0a-bf6b-9ec711cc621d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 02:05:33 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75226) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 17 02:05:33 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75226) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 17 02:05:34 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 02:05:34 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 02:05:34 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Compute_service record updated for user:user {{(pid=75226) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 17 02:05:34 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.196s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 02:05:38 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:05:39 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 02:05:39 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 02:05:39 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 02:05:39 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75226) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 17 02:05:41 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 02:05:41 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 02:05:42 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 02:05:43 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 02:05:45 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 02:05:45 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Starting heal instance info cache {{(pid=75226) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 17 02:05:45 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Rebuilding the list of instances to heal {{(pid=75226) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 17 02:05:46 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "refresh_cache-4a981a97-8a93-4d0a-bf6b-9ec711cc621d" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 17 02:05:46 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquired lock "refresh_cache-4a981a97-8a93-4d0a-bf6b-9ec711cc621d" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 17 02:05:46 user nova-compute[75226]: DEBUG nova.network.neutron [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] [instance: 4a981a97-8a93-4d0a-bf6b-9ec711cc621d] Forcefully refreshing network info cache for instance {{(pid=75226) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 17 02:05:46 user nova-compute[75226]: DEBUG nova.objects.instance [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lazy-loading 'info_cache' on Instance uuid 4a981a97-8a93-4d0a-bf6b-9ec711cc621d {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 02:05:46 user nova-compute[75226]: DEBUG nova.network.neutron [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] [instance: 4a981a97-8a93-4d0a-bf6b-9ec711cc621d] Updating instance_info_cache with network_info: [{"id": "78739500-0226-4429-bf53-c512d2c01d89", "address": "fa:16:3e:f5:a8:40", "network": {"id": "e111d356-c2ca-4cdc-bd8c-1d6bca9a54fd", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-640637510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c84a4fc5baa459d9fb5a3ccb78d2a8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78739500-02", "ovs_interfaceid": "78739500-0226-4429-bf53-c512d2c01d89", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 02:05:46 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Releasing lock "refresh_cache-4a981a97-8a93-4d0a-bf6b-9ec711cc621d" {{(pid=75226) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 17 02:05:46 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] [instance: 4a981a97-8a93-4d0a-bf6b-9ec711cc621d] Updated the network info_cache for instance {{(pid=75226) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 17 02:05:46 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 02:05:48 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:05:49 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-36fcc18c-1c03-4466-bd76-fa562a8ba9ee tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 4a981a97-8a93-4d0a-bf6b-9ec711cc621d is timed out.
Nov 17 02:05:49 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-36fcc18c-1c03-4466-bd76-fa562a8ba9ee tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Successfully detached device vdb from instance 4a981a97-8a93-4d0a-bf6b-9ec711cc621d from the live domain config.
Nov 17 02:05:49 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-36fcc18c-1c03-4466-bd76-fa562a8ba9ee tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] [instance: 4a981a97-8a93-4d0a-bf6b-9ec711cc621d] calling os-brick to detach iSCSI Volume {{(pid=75226) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 17 02:05:49 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-36fcc18c-1c03-4466-bd76-fa562a8ba9ee tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc4cc36b490>, {'target_iqn': 'iqn.2010-10.org.openstack:ed1c5c95-6a27-4903-9da8-f82fa2007329', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MkZaylRs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 17 02:05:49 user nova-compute[75226]: WARNING os_brick.initiator.connectors.base [None req-36fcc18c-1c03-4466-bd76-fa562a8ba9ee tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 17 02:05:49 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-36fcc18c-1c03-4466-bd76-fa562a8ba9ee tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 17 02:05:49 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-36fcc18c-1c03-4466-bd76-fa562a8ba9ee tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 17 02:05:49 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:05:49 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:05:49 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbab9816-190a-4ebb-bbad-eae98574ecd7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ed1c5c95-6a27-4903-9da8-f82fa2007329\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 02:05:49 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-36fcc18c-1c03-4466-bd76-fa562a8ba9ee tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 17 02:05:49 user nova-compute[75226]: No targets found.
Nov 17 02:05:49 user nova-compute[75226]: iSNS:
Nov 17 02:05:49 user nova-compute[75226]: No targets found.
Nov 17 02:05:49 user nova-compute[75226]: STATIC:
Nov 17 02:05:49 user nova-compute[75226]: Target: iqn.2010-10.org.openstack:ed1c5c95-6a27-4903-9da8-f82fa2007329
Nov 17 02:05:49 user nova-compute[75226]:         Portal: 172.16.0.220:3260,-1
Nov 17 02:05:49 user nova-compute[75226]:                 Iface Name: default
Nov 17 02:05:49 user nova-compute[75226]: FIRMWARE:
Nov 17 02:05:49 user nova-compute[75226]: No targets found.
Nov 17 02:05:49 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 02:05:49 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-36fcc18c-1c03-4466-bd76-fa562a8ba9ee tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 17 02:05:49 user nova-compute[75226]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 17 02:05:49 user nova-compute[75226]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75226) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 17 02:05:49 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-36fcc18c-1c03-4466-bd76-fa562a8ba9ee tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ed1c5c95-6a27-4903-9da8-f82fa2007329', 0)] {{(pid=75226) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 17 02:05:49 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:05:49 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:05:49 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfd4f8ea-8a91-4818-b758-da5d62426473]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ed1c5c95-6a27-4903-9da8-f82fa2007329\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 02:05:49 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:05:49 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:05:49 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[75dd2a62-4921-4709-9392-d68c701cb0c6]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed1c5c95-6a27-4903-9da8-f82fa2007329 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 02:05:49 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-36fcc18c-1c03-4466-bd76-fa562a8ba9ee tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed1c5c95-6a27-4903-9da8-f82fa2007329 (non-flash)
Nov 17 02:05:49 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 17 02:05:49 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-36fcc18c-1c03-4466-bd76-fa562a8ba9ee tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed1c5c95-6a27-4903-9da8-f82fa2007329 (non-flash)
Nov 17 02:05:49 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 17 02:05:49 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-36fcc18c-1c03-4466-bd76-fa562a8ba9ee tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc4b42d41f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ed1c5c95-6a27-4903-9da8-f82fa2007329'): ({'sdb'}, set())}) {{(pid=75226) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 17 02:05:49 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-36fcc18c-1c03-4466-bd76-fa562a8ba9ee tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Removing single pathed devices sdb {{(pid=75226) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 17 02:05:49 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:05:49 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:05:49 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad632083-0b5c-4027-8364-f0e79064599d]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 02:05:49 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:05:49 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:05:49 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[32fd764f-385c-45e8-8e93-37dc8501725e]: (4, ('ok\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 02:05:49 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-36fcc18c-1c03-4466-bd76-fa562a8ba9ee tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Flushing IO for device /dev/sdb {{(pid=75226) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 17 02:05:49 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:05:49 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:05:49 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[431e5f28-e0dd-4f8d-abab-b526a51bbf08]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 02:05:49 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-36fcc18c-1c03-4466-bd76-fa562a8ba9ee tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75226) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 17 02:05:49 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:05:49 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.033s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:05:49 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[888f4e67-3317-42de-9496-20fee2d0e886]: (4, ('1', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 02:05:49 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-36fcc18c-1c03-4466-bd76-fa562a8ba9ee tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75226) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 17 02:05:49 user nova-compute[75226]: DEBUG os_brick.initiator.linuxscsi [None req-36fcc18c-1c03-4466-bd76-fa562a8ba9ee tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] SCSI volumes sdb have been removed. {{(pid=75226) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 17 02:05:49 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-36fcc18c-1c03-4466-bd76-fa562a8ba9ee tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ed1c5c95-6a27-4903-9da8-f82fa2007329')] {{(pid=75226) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 17 02:05:49 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed1c5c95-6a27-4903-9da8-f82fa2007329 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:05:49 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed1c5c95-6a27-4903-9da8-f82fa2007329 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:05:49 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[452ab768-cae8-4cb9-9eb4-96320ea42b10]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 02:05:49 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-36fcc18c-1c03-4466-bd76-fa562a8ba9ee tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 02:05:49 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed1c5c95-6a27-4903-9da8-f82fa2007329 -p 172.16.0.220:3260 --logout {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:05:49 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed1c5c95-6a27-4903-9da8-f82fa2007329 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:05:49 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fe21256-9601-49be-8c8b-1370d5555636]: (4, ('Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:ed1c5c95-6a27-4903-9da8-f82fa2007329, portal: 172.16.0.220,3260]\nLogout of [sid: 70, target: iqn.2010-10.org.openstack:ed1c5c95-6a27-4903-9da8-f82fa2007329, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 02:05:49 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-36fcc18c-1c03-4466-bd76-fa562a8ba9ee tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:ed1c5c95-6a27-4903-9da8-f82fa2007329, portal: 172.16.0.220,3260]
Nov 17 02:05:49 user nova-compute[75226]: Logout of [sid: 70, target: iqn.2010-10.org.openstack:ed1c5c95-6a27-4903-9da8-f82fa2007329, portal: 172.16.0.220,3260] successful.
Nov 17 02:05:49 user nova-compute[75226]:  stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 02:05:49 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed1c5c95-6a27-4903-9da8-f82fa2007329 -p 172.16.0.220:3260 --op delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 17 02:05:49 user nova-compute[75226]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed1c5c95-6a27-4903-9da8-f82fa2007329 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 17 02:05:49 user nova-compute[75226]: DEBUG oslo.privsep.daemon [-] privsep: reply[274029c5-fa33-48ba-bb59-fdc58f07ee24]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 17 02:05:49 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-36fcc18c-1c03-4466-bd76-fa562a8ba9ee tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75226) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 17 02:05:49 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.base [None req-36fcc18c-1c03-4466-bd76-fa562a8ba9ee tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.289s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 17 02:05:49 user nova-compute[75226]: DEBUG os_brick.initiator.connectors.iscsi [None req-36fcc18c-1c03-4466-bd76-fa562a8ba9ee tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] <== disconnect_volume: return (291ms) None {{(pid=75226) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 17 02:05:49 user nova-compute[75226]: DEBUG nova.virt.libvirt.volume.iscsi [None req-36fcc18c-1c03-4466-bd76-fa562a8ba9ee tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] [instance: 4a981a97-8a93-4d0a-bf6b-9ec711cc621d] Disconnected iSCSI Volume {{(pid=75226) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 17 02:05:50 user nova-compute[75226]: DEBUG nova.objects.instance [None req-36fcc18c-1c03-4466-bd76-fa562a8ba9ee tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Lazy-loading 'flavor' on Instance uuid 4a981a97-8a93-4d0a-bf6b-9ec711cc621d {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 02:05:50 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-36fcc18c-1c03-4466-bd76-fa562a8ba9ee tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Lock "4a981a97-8a93-4d0a-bf6b-9ec711cc621d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.642s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 02:05:53 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:05:58 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:06:03 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 02:06:03 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:06:03 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75226) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 17 02:06:03 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75226) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 02:06:03 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75226) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 02:06:03 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:06:05 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 02:06:08 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:06:13 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:06:18 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:06:23 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 02:06:28 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 02:06:28 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:06:28 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75226) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 17 02:06:28 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75226) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 02:06:28 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75226) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 02:06:28 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:06:33 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:06:34 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-947f9150-6b78-4b47-bd3a-47cedcd5d0ea tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Acquiring lock "4a981a97-8a93-4d0a-bf6b-9ec711cc621d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 02:06:34 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-947f9150-6b78-4b47-bd3a-47cedcd5d0ea tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Lock "4a981a97-8a93-4d0a-bf6b-9ec711cc621d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 02:06:34 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-947f9150-6b78-4b47-bd3a-47cedcd5d0ea tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Acquiring lock "4a981a97-8a93-4d0a-bf6b-9ec711cc621d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 02:06:34 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-947f9150-6b78-4b47-bd3a-47cedcd5d0ea tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Lock "4a981a97-8a93-4d0a-bf6b-9ec711cc621d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 02:06:34 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-947f9150-6b78-4b47-bd3a-47cedcd5d0ea tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Lock "4a981a97-8a93-4d0a-bf6b-9ec711cc621d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 02:06:34 user nova-compute[75226]: INFO nova.compute.manager [None req-947f9150-6b78-4b47-bd3a-47cedcd5d0ea tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] [instance: 4a981a97-8a93-4d0a-bf6b-9ec711cc621d] Terminating instance
Nov 17 02:06:34 user nova-compute[75226]: DEBUG nova.compute.manager [None req-947f9150-6b78-4b47-bd3a-47cedcd5d0ea tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] [instance: 4a981a97-8a93-4d0a-bf6b-9ec711cc621d] Start destroying the instance on the hypervisor. {{(pid=75226) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 17 02:06:34 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:06:34 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:06:34 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:06:34 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:06:34 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 02:06:35 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 02:06:35 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 02:06:35 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 02:06:35 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75226) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 17 02:06:35 user nova-compute[75226]: DEBUG nova.compute.manager [req-938f28b4-812f-467c-a02d-781be5a6ac9c req-927d712f-2553-4a21-ac4f-5b1873fda6be service nova] [instance: 4a981a97-8a93-4d0a-bf6b-9ec711cc621d] Received event network-vif-unplugged-78739500-0226-4429-bf53-c512d2c01d89 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 02:06:35 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-938f28b4-812f-467c-a02d-781be5a6ac9c req-927d712f-2553-4a21-ac4f-5b1873fda6be service nova] Acquiring lock "4a981a97-8a93-4d0a-bf6b-9ec711cc621d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 02:06:35 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-938f28b4-812f-467c-a02d-781be5a6ac9c req-927d712f-2553-4a21-ac4f-5b1873fda6be service nova] Lock "4a981a97-8a93-4d0a-bf6b-9ec711cc621d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 02:06:35 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-938f28b4-812f-467c-a02d-781be5a6ac9c req-927d712f-2553-4a21-ac4f-5b1873fda6be service nova] Lock "4a981a97-8a93-4d0a-bf6b-9ec711cc621d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 02:06:35 user nova-compute[75226]: DEBUG nova.compute.manager [req-938f28b4-812f-467c-a02d-781be5a6ac9c req-927d712f-2553-4a21-ac4f-5b1873fda6be service nova] [instance: 4a981a97-8a93-4d0a-bf6b-9ec711cc621d] No waiting events found dispatching network-vif-unplugged-78739500-0226-4429-bf53-c512d2c01d89 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 02:06:35 user nova-compute[75226]: DEBUG nova.compute.manager [req-938f28b4-812f-467c-a02d-781be5a6ac9c req-927d712f-2553-4a21-ac4f-5b1873fda6be service nova] [instance: 4a981a97-8a93-4d0a-bf6b-9ec711cc621d] Received event network-vif-unplugged-78739500-0226-4429-bf53-c512d2c01d89 for instance with task_state deleting. {{(pid=75226) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 17 02:06:35 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:06:35 user nova-compute[75226]: INFO nova.virt.libvirt.driver [-] [instance: 4a981a97-8a93-4d0a-bf6b-9ec711cc621d] Instance destroyed successfully.
Nov 17 02:06:35 user nova-compute[75226]: DEBUG nova.objects.instance [None req-947f9150-6b78-4b47-bd3a-47cedcd5d0ea tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Lazy-loading 'resources' on Instance uuid 4a981a97-8a93-4d0a-bf6b-9ec711cc621d {{(pid=75226) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 17 02:06:35 user nova-compute[75226]: DEBUG nova.virt.libvirt.vif [None req-947f9150-6b78-4b47-bd3a-47cedcd5d0ea tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-17T02:00:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1412778893',display_name='tempest-SnapshotDataIntegrityTests-server-1412778893',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1412778893',id=53,image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBq2KpG+48yTQTweHDmAzliSQZiYkltbHx+1phs/8oAYJYxY3ivkVT9YAjyPMv8WkUuJfDX92mAwaMt5kTog8wZjziy9xWCRO89qBdwytzKgRH1J0asvJ/EBf1kHQ6OlRw==',key_name='tempest-keypair-1136126954',keypairs=<?>,launch_index=0,launched_at=2023-11-17T02:00:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4c84a4fc5baa459d9fb5a3ccb78d2a8d',ramdisk_id='',reservation_id='r-0qid39ov',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0b369aea-6f3f-4690-9f01-229b90ab6310',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1099353435',owner_user_name='tempest-SnapshotDataIntegrityTests-1099353435-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-17T02:00:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f4a8bc28db1c4c6abc1506bfa99ee41a',uuid=4a981a97-8a93-4d0a-bf6b-9ec711cc621d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "78739500-0226-4429-bf53-c512d2c01d89", "address": "fa:16:3e:f5:a8:40", "network": {"id": "e111d356-c2ca-4cdc-bd8c-1d6bca9a54fd", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-640637510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c84a4fc5baa459d9fb5a3ccb78d2a8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78739500-02", "ovs_interfaceid": "78739500-0226-4429-bf53-c512d2c01d89", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 17 02:06:35 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-947f9150-6b78-4b47-bd3a-47cedcd5d0ea tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Converting VIF {"id": "78739500-0226-4429-bf53-c512d2c01d89", "address": "fa:16:3e:f5:a8:40", "network": {"id": "e111d356-c2ca-4cdc-bd8c-1d6bca9a54fd", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-640637510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c84a4fc5baa459d9fb5a3ccb78d2a8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78739500-02", "ovs_interfaceid": "78739500-0226-4429-bf53-c512d2c01d89", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 17 02:06:35 user nova-compute[75226]: DEBUG nova.network.os_vif_util [None req-947f9150-6b78-4b47-bd3a-47cedcd5d0ea tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f5:a8:40,bridge_name='br-int',has_traffic_filtering=True,id=78739500-0226-4429-bf53-c512d2c01d89,network=Network(e111d356-c2ca-4cdc-bd8c-1d6bca9a54fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78739500-02') {{(pid=75226) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 17 02:06:35 user nova-compute[75226]: DEBUG os_vif [None req-947f9150-6b78-4b47-bd3a-47cedcd5d0ea tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f5:a8:40,bridge_name='br-int',has_traffic_filtering=True,id=78739500-0226-4429-bf53-c512d2c01d89,network=Network(e111d356-c2ca-4cdc-bd8c-1d6bca9a54fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78739500-02') {{(pid=75226) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 17 02:06:35 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:06:35 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap78739500-02, bridge=br-int, if_exists=True) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 02:06:35 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:06:35 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 02:06:35 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:06:35 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2bf2f28a-7dd2-41f2-90b4-318b93720d8a) {{(pid=75226) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 17 02:06:35 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:06:35 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 02:06:35 user nova-compute[75226]: INFO os_vif [None req-947f9150-6b78-4b47-bd3a-47cedcd5d0ea tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f5:a8:40,bridge_name='br-int',has_traffic_filtering=True,id=78739500-0226-4429-bf53-c512d2c01d89,network=Network(e111d356-c2ca-4cdc-bd8c-1d6bca9a54fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78739500-02')
Nov 17 02:06:35 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-947f9150-6b78-4b47-bd3a-47cedcd5d0ea tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] [instance: 4a981a97-8a93-4d0a-bf6b-9ec711cc621d] Deleting instance files /opt/stack/data/nova/instances/4a981a97-8a93-4d0a-bf6b-9ec711cc621d_del
Nov 17 02:06:35 user nova-compute[75226]: INFO nova.virt.libvirt.driver [None req-947f9150-6b78-4b47-bd3a-47cedcd5d0ea tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] [instance: 4a981a97-8a93-4d0a-bf6b-9ec711cc621d] Deletion of /opt/stack/data/nova/instances/4a981a97-8a93-4d0a-bf6b-9ec711cc621d_del complete
Nov 17 02:06:35 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Periodic task is updating the host stats, it is trying to get disk info for instance-00000035, but the backing disk storage was removed by a concurrent operation such as resize. Error: No disk at /opt/stack/data/nova/instances/4a981a97-8a93-4d0a-bf6b-9ec711cc621d/disk: nova.exception.DiskNotFound: No disk at /opt/stack/data/nova/instances/4a981a97-8a93-4d0a-bf6b-9ec711cc621d/disk
Nov 17 02:06:35 user nova-compute[75226]: INFO nova.compute.manager [None req-947f9150-6b78-4b47-bd3a-47cedcd5d0ea tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] [instance: 4a981a97-8a93-4d0a-bf6b-9ec711cc621d] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 17 02:06:35 user nova-compute[75226]: DEBUG oslo.service.loopingcall [None req-947f9150-6b78-4b47-bd3a-47cedcd5d0ea tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75226) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 17 02:06:35 user nova-compute[75226]: DEBUG nova.compute.manager [-] [instance: 4a981a97-8a93-4d0a-bf6b-9ec711cc621d] Deallocating network for instance {{(pid=75226) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 17 02:06:35 user nova-compute[75226]: DEBUG nova.network.neutron [-] [instance: 4a981a97-8a93-4d0a-bf6b-9ec711cc621d] deallocate_for_instance() {{(pid=75226) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 17 02:06:36 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 02:06:36 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 02:06:36 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Hypervisor/Node resource view: name=user free_ram=9168MB free_disk=24.90148162841797GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75226) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 17 02:06:36 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 02:06:36 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 02:06:36 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Instance 4a981a97-8a93-4d0a-bf6b-9ec711cc621d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75226) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 17 02:06:36 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75226) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 17 02:06:36 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75226) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 17 02:06:36 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 02:06:36 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 02:06:36 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Compute_service record updated for user:user {{(pid=75226) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 17 02:06:36 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.223s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 02:06:37 user nova-compute[75226]: DEBUG nova.network.neutron [-] [instance: 4a981a97-8a93-4d0a-bf6b-9ec711cc621d] Updating instance_info_cache with network_info: [] {{(pid=75226) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 17 02:06:37 user nova-compute[75226]: INFO nova.compute.manager [-] [instance: 4a981a97-8a93-4d0a-bf6b-9ec711cc621d] Took 1.47 seconds to deallocate network for instance.
Nov 17 02:06:37 user nova-compute[75226]: DEBUG nova.compute.manager [req-489142d3-060b-4ce1-8a94-efc36a35e2c7 req-d94e8b17-8d62-4d50-abb4-97664cfa0818 service nova] [instance: 4a981a97-8a93-4d0a-bf6b-9ec711cc621d] Received event network-vif-deleted-78739500-0226-4429-bf53-c512d2c01d89 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 02:06:37 user nova-compute[75226]: DEBUG nova.compute.manager [req-6c663db6-86fc-4069-b479-a6ddb23b5d34 req-35b2a96e-5544-45dd-8423-0da19fe79beb service nova] [instance: 4a981a97-8a93-4d0a-bf6b-9ec711cc621d] Received event network-vif-plugged-78739500-0226-4429-bf53-c512d2c01d89 {{(pid=75226) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 17 02:06:37 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-6c663db6-86fc-4069-b479-a6ddb23b5d34 req-35b2a96e-5544-45dd-8423-0da19fe79beb service nova] Acquiring lock "4a981a97-8a93-4d0a-bf6b-9ec711cc621d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 02:06:37 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-6c663db6-86fc-4069-b479-a6ddb23b5d34 req-35b2a96e-5544-45dd-8423-0da19fe79beb service nova] Lock "4a981a97-8a93-4d0a-bf6b-9ec711cc621d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 02:06:37 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [req-6c663db6-86fc-4069-b479-a6ddb23b5d34 req-35b2a96e-5544-45dd-8423-0da19fe79beb service nova] Lock "4a981a97-8a93-4d0a-bf6b-9ec711cc621d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 02:06:37 user nova-compute[75226]: DEBUG nova.compute.manager [req-6c663db6-86fc-4069-b479-a6ddb23b5d34 req-35b2a96e-5544-45dd-8423-0da19fe79beb service nova] [instance: 4a981a97-8a93-4d0a-bf6b-9ec711cc621d] No waiting events found dispatching network-vif-plugged-78739500-0226-4429-bf53-c512d2c01d89 {{(pid=75226) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 17 02:06:37 user nova-compute[75226]: WARNING nova.compute.manager [req-6c663db6-86fc-4069-b479-a6ddb23b5d34 req-35b2a96e-5544-45dd-8423-0da19fe79beb service nova] [instance: 4a981a97-8a93-4d0a-bf6b-9ec711cc621d] Received unexpected event network-vif-plugged-78739500-0226-4429-bf53-c512d2c01d89 for instance with vm_state active and task_state deleting.
Nov 17 02:06:37 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-947f9150-6b78-4b47-bd3a-47cedcd5d0ea tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 02:06:37 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-947f9150-6b78-4b47-bd3a-47cedcd5d0ea tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 02:06:37 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-947f9150-6b78-4b47-bd3a-47cedcd5d0ea tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 02:06:37 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-947f9150-6b78-4b47-bd3a-47cedcd5d0ea tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 02:06:37 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-947f9150-6b78-4b47-bd3a-47cedcd5d0ea tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.152s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 02:06:37 user nova-compute[75226]: INFO nova.scheduler.client.report [None req-947f9150-6b78-4b47-bd3a-47cedcd5d0ea tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Deleted allocations for instance 4a981a97-8a93-4d0a-bf6b-9ec711cc621d
Nov 17 02:06:37 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-947f9150-6b78-4b47-bd3a-47cedcd5d0ea tempest-SnapshotDataIntegrityTests-1099353435 tempest-SnapshotDataIntegrityTests-1099353435-project-member] Lock "4a981a97-8a93-4d0a-bf6b-9ec711cc621d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.799s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 02:06:39 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 02:06:39 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 02:06:40 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:06:40 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 02:06:40 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75226) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 17 02:06:41 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 02:06:43 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 02:06:43 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 02:06:45 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 02:06:46 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 02:06:46 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Starting heal instance info cache {{(pid=75226) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 17 02:06:46 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Rebuilding the list of instances to heal {{(pid=75226) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 17 02:06:46 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Didn't find any instances for network info cache update. {{(pid=75226) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 17 02:06:46 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 02:06:50 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:06:55 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 02:07:00 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 02:07:05 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 02:07:10 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:07:15 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:07:20 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 02:07:20 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:07:20 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75226) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 17 02:07:20 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75226) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 02:07:20 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75226) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 17 02:07:20 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:07:25 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 17 02:07:25 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:07:28 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:07:30 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:07:31 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:07:35 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:07:36 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 02:07:37 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 02:07:37 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 02:07:37 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 02:07:37 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75226) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 17 02:07:37 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 02:07:37 user nova-compute[75226]: WARNING nova.virt.libvirt.driver [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 17 02:07:37 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Hypervisor/Node resource view: name=user free_ram=9305MB free_disk=24.928394317626953GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75226) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 17 02:07:37 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 17 02:07:37 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 17 02:07:37 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75226) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 17 02:07:37 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75226) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 17 02:07:37 user nova-compute[75226]: DEBUG nova.compute.provider_tree [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Inventory has not changed in ProviderTree for provider: f431122b-abb2-4ecb-9e21-e3ec333d823b {{(pid=75226) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 17 02:07:37 user nova-compute[75226]: DEBUG nova.scheduler.client.report [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Inventory has not changed for provider f431122b-abb2-4ecb-9e21-e3ec333d823b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75226) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 17 02:07:37 user nova-compute[75226]: DEBUG nova.compute.resource_tracker [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Compute_service record updated for user:user {{(pid=75226) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 17 02:07:37 user nova-compute[75226]: DEBUG oslo_concurrency.lockutils [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.159s {{(pid=75226) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 17 02:07:40 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:07:40 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 02:07:41 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 02:07:42 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 02:07:42 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75226) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 17 02:07:43 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 02:07:43 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 02:07:45 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 17 02:07:45 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 02:07:47 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 02:07:47 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Starting heal instance info cache {{(pid=75226) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 17 02:07:47 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Rebuilding the list of instances to heal {{(pid=75226) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 17 02:07:47 user nova-compute[75226]: DEBUG nova.compute.manager [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Didn't find any instances for network info cache update. {{(pid=75226) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 17 02:07:47 user nova-compute[75226]: DEBUG oslo_service.periodic_task [None req-e47f78e0-6ae6-403e-811b-5503a002f8f8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75226) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 17 02:07:50 user nova-compute[75226]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75226) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}